We're updating the issue view to help you get more done. 

Multiple output fails when being used with HDFS sink and anything else

Description

multiple outputs considers hdfs sink to be a dataset and tries to validate the hdfs path as a dataset name.

Release Notes

HDFSSink can now be used alongside other sinks in a Hydrator pipeline.

Activity

Show:
Ali Anwar
June 23, 2016, 3:24 AM

I don't think we need to be aliasing any of the sinks, but instead just name them as their configured 'referenceName'. I believe that would solve this issue.
suggestion?

Ali Anwar
June 23, 2016, 3:34 AM
Edited

PR to do so, against develop (3.5):
https://github.com/caskdata/hydrator-plugins/pull/296

backported to release/1.3 for CDAP 3.4.3:
https://github.com/caskdata/hydrator-plugins/pull/298

Gokul Gunasekaran
June 23, 2016, 10:30 PM

We are planning to override/suffix (in ETLMapReduce code) the alias set by the user to uniquely identify the source/sink.

Priyanka Nambiar
June 28, 2016, 8:44 PM
Edited

PR open: https://github.com/caskdata/cdap/pull/5930, which will need to be cherry picked into release/3.4 once merged

Priyanka Nambiar
June 29, 2016, 10:24 PM

Cherry picked to release/3.4: https://github.com/caskdata/cdap/pull/5943

Fixed

Assignee

Ali Anwar

Reporter

Russ Savage

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Affects versions

Priority

Major
Configure