Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For a Distributed CDAP cluster, version 6.2.0 and later, you must install these Hadoop components (see notes following the tables):

Component

Source

Supported Versions

Hadoop

various

2.0 and higher

HBase

Apache

0.98.x and 1.2

Cloudera Distribution of Apache Hadoop (CDH)

5.1 through 5.12 (Note 4)

Hortonworks Data Platform (HDP)

2.0 through 2.6 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8 (with Apache HBase)

HDFS

Apache Hadoop

2.0.2-alpha through 2.6

Cloudera Distribution of Apache Hadoop (CDH)

5.1 through 5.12 (Note 4)

Hortonworks Data Platform (HDP)

2.0 through 2.6 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8

YARN and MapReduce2

Apache Hadoop

2.0.2-alpha through 2.7

Cloudera Distribution of Apache Hadoop (CDH)

5.1 through 5.12 (Note 4)

Hortonworks Data Platform (HDP)

2.0 through 2.6 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8

ZooKeeper

Apache

Version 3.4.3 through 3

.4

Cloudera Distribution of Apache Hadoop (CDH)

5.1 through 5

.

12 (Note

4

)

Hortonworks Data Platform (HDP)

2.0 through 2.6 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8

For a Distributed CDAP cluster, version 6.2.0 and later, you can (optionally) install these Hadoop components, as required:

Component

Source

Supported Versions

Hive

Apache

Version 0.12.0 through 1.2.x

Cloudera Distribution of Apache Hadoop (CDH)

5.1 through 5.12 (Note 4)

Hortonworks Data Platform (HDP)

2.0 through 2.6 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8

Spark

Apache

Versions 1.6.x through 2.3.x

Cloudera Distribution of Apache Hadoop (CDH)

Hortonworks Data Platform (HDP)

2.0 through 2.6.5 (Note 4)

5.1 through 5.12 (Note 4)

Amazon Hadoop (EMR)

4.6 through 4.8

Note 1: Component versions shown in these tables are those that we have tested and are confident of their suitability and compatibility. Later versions of components may work, but have not necessarily been either tested or confirmed compatible.

...

Note 3: Hive 0.12 is not supported for secure cluster configurations.Note 4: An upcoming release of CDAP (scheduled for CDAP 4.3) will drop support for all versions older than CDH 5.4.11 or HDP 2.5.0.0 due to an Apache Hadoop Privilege Escalation Vulnerability.