Kafka consumer should support automatic partition handling for a topic
Description
If no partitions are configured in Kafka consumer, then it should subscribe to all partitions for a given topic. Also, as and when partitions get added or removed, we will need to subscribe/unsubscribe to them.
This also brings up a question of how do we divide partitions automatically amongst multiple instances of same flowlet that are subscribing to a topic.
Release Notes
None
Activity
Show:
Terence YimApril 25, 2019 at 9:09 PM
This is related to Flow pack and Flow is removed as of 6.0
Won't Fix
Pinned fields
Click on the next to a field label to start pinning.
If no partitions are configured in Kafka consumer, then it should subscribe to all partitions for a given topic. Also, as and when partitions get added or removed, we will need to subscribe/unsubscribe to them.
This also brings up a question of how do we divide partitions automatically amongst multiple instances of same flowlet that are subscribing to a topic.