We're updating the issue view to help you get more done. 

Remove MultiSink runtime argument requirements

Description

Today, the multi sink plugins require the pipeline to set a runtime argument for each table, with the schema for each table. It seems like this should be something that can be determined dynamically at runtime instead of requiring arguments to be set. For example, the GCS multisink doesn't need to know the schemas beforehand for most formats – it can just write out whatever it gets.

This would make the plugins much easier to use, and would also additional use cases, like modifying the schema of the data in the middle of the pipeline (ex: adding or dropping a field).

Release Notes

None

Assignee

Bhooshan Mogal

Reporter

Albert Shau

Labels

None

Product Requirement Doc

None

Reviewer

None

Dev Complete Date

None

Publish Date

None

Docs Impact

None

UX Impact

None

Sprint

Cirus Sprint 3

Fix versions

Priority

Major
Configure