Kafka Batch Source Plugin- Initial offset not getting applied
Description
When setting the initial offset functionality of the Kafka Batch Source PlugIn, It ignores the initial offset or the partition set. The plugin retrieves all the data in the topic, even if the initial offset is set as "0:5" or "1:8".
Expected behaviour: The starting point for reading from Kafka should be from the offset specified and not start from the beginning.
Release Notes
Fixed bug where initial offset was not considered in Kafka batch source.
When setting the initial offset functionality of the Kafka Batch Source PlugIn, It ignores the initial offset or the partition set. The plugin retrieves all the data in the topic, even if the initial offset is set as "0:5" or "1:8".
Expected behaviour: The starting point for reading from Kafka should be from the offset specified and not start from the beginning.