Document supported Kafka versions
Description
Release Notes
None
Activity
Show:

Yaojie Feng
updated the LabelsSeptember 20, 2018 at 1:32 AMcdap_user
cdap_user moved-of-5.1

Yaojie Feng
updated the Fix versionsSeptember 20, 2018 at 1:31 AM5.1.0
None

Priyanka Nambiar
changed the AssigneeAugust 2, 2018 at 3:40 PM
Poorna Chandra

Yaojie Feng

Sreevatsan Raman
updated the Fix versionsJune 8, 2018 at 6:19 PMNone
5.1.0

Sreevatsan Raman
updated the Fix versionsJune 8, 2018 at 6:19 PM5.0.0
None

Sreevatsan Raman
updated the Issue TypeJune 8, 2018 at 6:19 PMBug
Task

Sreevatsan Raman
changed the AssigneeJune 8, 2018 at 6:19 PM
Sreevatsan Raman

Poorna Chandra

Priyanka Nambiar
changed the AssigneeJanuary 30, 2018 at 7:37 PM
John Jackson

Sreevatsan Raman

Priyanka Nambiar
updated the LabelsJune 19, 2017 at 9:39 PMNone
cdap_user

Sreevatsan Raman
updated the Fix versionsMay 13, 2017 at 12:47 AMNone
4.4.0

Sreevatsan Raman
updated the Fix versionsMay 13, 2017 at 12:47 AM4.2.0
None

Sreevatsan Raman
updated the Fix versionsFebruary 15, 2017 at 7:15 PM4.1.0
None

Sreevatsan Raman
updated the Fix versionsFebruary 15, 2017 at 7:15 PMNone
4.2.0

John Jackson
updated the Fix versionsDecember 7, 2016 at 7:13 PM4.0.0
None

John Jackson
updated the Fix versionsDecember 7, 2016 at 7:13 PMNone
4.1.0

John Jackson
updated the DescriptionNovember 18, 2016 at 12:06 AMWe currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server.
The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml:
{code}
<kafka.version>0.8.2.2</kafka.version>
{code}
We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html.
We mention using an external version on:
- http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/audit-logging.html#audit-logging-configuring-audit-publishing
- http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/metadata-lineage.html#metadata-update-notifications (deprecated)
Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka.
The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the {{rst_epilog}}, as the "embedded-kafka-version".
We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as.
We currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server.
The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml:
{code}
<kafka.version>0.8.2.2</kafka.version>
{code}
We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html.
We mention using an external version on:
- http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/audit-logging.html#audit-logging-configuring-audit-publishing
- http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/metadata-lineage.html#metadata-update-notifications (deprecated)
Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka.
The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the {{rst_epilog}}, as the "embedded-kafka-version".
We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as.
Not certain where to add this version information, as this is not obvious. Perhaps on either of these:
- http://docs.cask.co/cdap/current/en/admin-manual/hadoop-compatibility.html
- http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html

John Jackson
created the IssueNovember 18, 2016 at 12:01 AMPinned fields
Click on the next to a field label to start pinning.
Details
Details
Assignee
Yaojie Feng
Yaojie FengReporter
John Jackson
John JacksonLabels
Affects versions
Components
Priority
Created November 18, 2016 at 12:01 AM
Updated September 20, 2018 at 1:32 AM
We currently don't document which version of Kafka we ship with CDAP, nor which version(s) we would support for an external Kafka server.
The current version of Kafka (as of 4.0.0-SNAPSHOT) is 0.8.2.2, and can be found in the pom.xml:
<kafka.version>0.8.2.2</kafka.version>
We mention the embedded version on http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html.
We mention using an external version on:
http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/audit-logging.html#audit-logging-configuring-audit-publishing
http://docs.cask.co/cdap/current/en/developers-manual/building-blocks/metadata-lineage.html#metadata-update-notifications (deprecated)
Each of the installation guides mentions Kafka, such as http://docs.cask.co/cdap/current/en/admin-manual/installation/packages.html?highlight=kafka.
The build script (common_conf.py) could be modified to extract the Kafka version as it does the CDAP version (in get_sdk_version()) and publish it as part of the
rst_epilog
, as the "embedded-kafka-version".We need to test higher versions to see if they are compatible; currently, only 0.8.2.2 is known as.
Not certain where to add this version information, as this is not obvious. Perhaps on either of these:
http://docs.cask.co/cdap/current/en/admin-manual/hadoop-compatibility.html
http://docs.cask.co/cdap/current/en/admin-manual/cdap-components.html