Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Document supported Kafka versions

Description

We currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server.

The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml:

<kafka.version>0.8.2.2</kafka.version>

We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html.

We mention using an external version on:

Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka.

The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the rst_epilog, as the "embedded-kafka-version".

We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as.

Not certain where to add this version information, as this is not obvious. Perhaps on either of these:

Release Notes

None

Activity

Show:
Yaojie Feng
updated the LabelsSeptember 20, 2018 at 1:32 AM
cdap_user
cdap_user moved-of-5.1
Yaojie Feng
updated the Fix versionsSeptember 20, 2018 at 1:31 AM
5.1.0
None
Priyanka Nambiar
changed the AssigneeAugust 2, 2018 at 3:40 PM
Poorna Chandra
Yaojie Feng
Sreevatsan Raman
updated the Fix versionsJune 8, 2018 at 6:19 PM
None
5.1.0
Sreevatsan Raman
updated the Fix versionsJune 8, 2018 at 6:19 PM
5.0.0
None
Sreevatsan Raman
updated the Issue TypeJune 8, 2018 at 6:19 PM
Bug
Task
Sreevatsan Raman
changed the AssigneeJune 8, 2018 at 6:19 PM
Sreevatsan Raman
Poorna Chandra
Priyanka Nambiar
changed the AssigneeJanuary 30, 2018 at 7:37 PM
John Jackson
Sreevatsan Raman
Priyanka Nambiar
updated the LabelsJune 19, 2017 at 9:39 PM
None
cdap_user
Sreevatsan Raman
updated the Fix versionsMay 13, 2017 at 12:47 AM
None
4.4.0
Sreevatsan Raman
updated the Fix versionsMay 13, 2017 at 12:47 AM
4.2.0
None
Sreevatsan Raman
updated the Fix versionsFebruary 15, 2017 at 7:15 PM
4.1.0
None
Sreevatsan Raman
updated the Fix versionsFebruary 15, 2017 at 7:15 PM
None
4.2.0
John Jackson
updated the Fix versionsDecember 7, 2016 at 7:13 PM
4.0.0
None
John Jackson
updated the Fix versionsDecember 7, 2016 at 7:13 PM
None
4.1.0
John Jackson
updated the DescriptionNovember 18, 2016 at 12:06 AM
We currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server. The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml: {code} <kafka.version>0.8.2.2</kafka.version> {code} We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html. We mention using an external version on: - http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/audit-logging.html#audit-logging-configuring-audit-publishing - http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/metadata-lineage.html#metadata-update-notifications (deprecated) Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka. The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the {{rst_epilog}}, as the "embedded-kafka-version". We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as.
We currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server. The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml: {code} <kafka.version>0.8.2.2</kafka.version> {code} We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html. We mention using an external version on: - http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/audit-logging.html#audit-logging-configuring-audit-publishing - http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/metadata-lineage.html#metadata-update-notifications (deprecated) Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka. The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the {{rst_epilog}}, as the "embedded-kafka-version". We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as. Not certain where to add this version information, as this is not obvious. Perhaps on either of these: - http://docs.cask.co/cdap/current/en/admin-manual/hadoop-compatibility.html - http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html
John Jackson
created the IssueNovember 18, 2016 at 12:01 AM
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Affects versions

Components

Priority

Created November 18, 2016 at 12:01 AM
Updated September 20, 2018 at 1:32 AM
Configure