Issues

Oracle E2E tests are failing while installing the plugin

GCS Done File Marker plugin e2e test failed pipeline scenario is incorrectly configured because the pipeline succeeds when we are using SA json

CDAP E2E for Database plugins leaking tables

Joiner: When number of Partition field has value, the output has no difference with and without value in Number of partition field.

CLONE - Wrangler plugin is not getting saved when macro used in table field as macro in source plugin.

Distinct: When number of Partition field is used, the output has no difference with and without value in Number of partition field also blank output files are generated along with single records are present in each output files.

Wrangler plugin is not getting saved when macro used in table field as macro in source plugin.

GroupBy: When number of Partition field has value, the output has no difference with and without value in Number of partition field.

BigQueryArgument Setter: No error message is displayed with invalid Argument Column field and also 'Column Name' text should be displayed instead of 'Value' in field

BigQueryArgument Setter: Documentation/Raw logs should be more clear with table and property field expected values and result

BigQueryArgument Setter: Argument set conditions is setting "AND" in query request raw logs

BigQueryArgument Setter: Unable to set the arguments from an existing BigQuery table with provided argument set conditions and columns

Deduplicate:When number of Partition field is used, the output has no difference with and without value in Number of partition field also blank output files are generated along with single records are present in each output files.

Error collector: Documentation there is a different name for a property called Error Emitter Node Name

Record Splitter (Delimited) - With pipe | value delimiter the records splits with each letter. With [|] and \\| inserted in BQ, then same letters splits.

Record Splitter (Delimited) - With \ slash delimiter preview fails for field to split and inserted data with double slash in BQ table.

Record Splitter (Delimited) - No error message displayed on invalid delimiter value when provided as number, preview is successful

Record Splitter (Delimited) - Improper message is displayed when invalid field to split is provided not available in input schema

Record Splitter (Delimited) - Unable to deploy the pipeline with macro enabled fields in record splitter plugin

Record Splitter (Delimited) - With { delimiter preview fails having data from BQ to GCS

Send Email Alert : Validation error , user is able to validate Invalid email address in sender and recipients

Deduplicate Plugin:Preview is getting failed if unique fields is selected none.

Distinct: BQsource->Distinct->GCSsink, In Distinct if incorrect field name is provided highlighted field, error is displayed, but 2 errors is shown on top

Transpose(Normalize): Error is displayed when comma separated field values are provided first then validate, then close and reopen the properties page, error not relavent is thrown

Transpose(Normalize): No error message is displayed when comma separated field values are provided but fields are highlighted, example need to be more clear

Transpose(Normalize): Since output schema is required to be added same needs to be added in documentation of plugin.

Transpose(Normalize): If null values are in csv filepath in source GCS then preview gets failed getting field 'xyz' cannot be set to null values

Transpose(Normalize): Null values from GCS source tables are dropped in target BigQuery table created

Transpose(Normalize): Output schema added in Transpose only accepts string datatype for all the fields in output schema added

Transpose(Normalize): Error messages are displayed for only field name first and not for field value if both are invalid

Transpose(Normalize): Error messages are not getting highlighted for field to be normalized field when invalid values are provided

Transpose(Normalize): In documentation the plugin name is not in sync with that provided in docs

DateTransformPlugin:Error is getting when we clear the output schema and again click on validate button no schema is generated.

DateTransformPlugin:Preview is getting failed with source fields transform when takes a date in long or unix Timestamp .

DateTransformPlugin:Error is getting when we do testing with macros(Source Field Name Field)

Distinct: After successful pipeline from BQsource->Distinct->GCSsink, blank files are generated along with files having records in GCP bucket path with single record each

Distinct: After successful pipeline from BQsource->Distinct->GCSsink, for 4 distinct records, 4 different files are created one record in each file created in GCP bucket path and others are blank files

Send Email Alert : Throws an error on validating the send email alert after filling all the mandatory fields, shows port (non mandatory) field needs to be given.

Deduplicate: Preview is success but the pipeline is getting intermittent error after 9 mins using Deduplicate analytics plugin with BigQuery source and BigQuery as sink(BQ source->Deduplicate->BQ sink).

Distinct: Preview is success but the pipeline is getting failed after 13 mins using Distinct analytics plugin with BigQuery source and BigQuery as sink(BQ source->Distinct->BQ sink).

Get Schema button missing from GCS Source Config

Joiner plugin performance issue :Pipeline takes long time to complete even for tables with very few records(like 2-3 rows)

CloudSQL MySQL sink- When only password is provided and username is blank throws proper error of username, but when only username is provided no proper error for password

Oracle source: Pipeline from Oracle source to GCS sink, the CSV file generated is not showing correct values for number datatype in Oracle table for CDAP mapped with decimal datatype.

BQMT: Allow Flexible Schema in output field macro enabled is not taking 'Yes' value at run time arguments

BQMT: Table names are created as null when text and blob files formats are used to transfer from GCS to BQMT sink

Joiner Plugin:When selected Join Condition Type as Advanced putting join condition like SQL Query output schema get generated but preview is getting failed so pipeline is also getting failed.

Joiner Plugin:Putting invalid vales in mandatory field "fields" no error is getting output schema is also generated with invalid field name.

Joiner Plugin:Output schema on top there is no detail saying checkbox is for what, + button is for what