Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Configuration: General

What are the memory and core requirements for CDAP?

...

Code Block
$ rpm -ql cdap-cli
$ dpkg -L cdap-cli

...

I've followed the install instructions, yet CDAP does not start. What next?

...

  • Look in the CDAP logs for error messages (located either in /var/log/cdap for Distributed CDAP or $CDAP_HOME/logs for CDAP Sandbox)

  • If you see an error such as:

    Code Block
    ERROR [main:c.c.c.StandaloneMain@268] - Failed to start CDAP Sandbox
    java.lang.NoSuchMethodError:
    io.cdap.cdap.UserInterfaceService.getServiceName()Ljava/lang/String
    

    then you have downloaded the CDAP Sandbox version of CDAP, which is not intended to be run on Hadoop clusters. Download the appropriate distributed packages (RPM or Debian version) from http://cdap.io/get-started/downloads.

  • Check permissions of directories:

    • The CDAP HDFS User (by default, yarn) owns the HDFS directory (by default, /cdap).

    • The Kafka Log directory (by default, /data/cdap/kafka-logs), must be writable by the CDAP UNIX user.

    • The temp directories utilized by CDAP must be writable by the CDAP UNIX user.

...

It's possible that YARN can't extract the .JARs to the /tmp, either due to a lack of disk space or permissions.

Installation: General

The CDAP Master log shows permissions issues.

...

  1. Check if the JDK being used is supported by CDAP:

    Code Block
    $ java -version
    
  2. Check if the CDAP user is using a correct version of the JDK:

    Code Block
    $ sudo su - <cdap-user>
    $ java -version
    
  3. Run this command to see if all the CDAP classpaths are included:

    Code Block
    $ /opt/cdap/master/bin/cdap classpath | tr ':' '\n'
    

    Expect to see (where <version> is the appropriate hbase-compat version):

    Code Block
    /etc/cdap/conf/
    /opt/cdap/hbase-compat-<version>/lib/*
    /opt/cdap/master/conf/
    /opt/cdap/master/lib/*
    

    If the classpath is incorrect (in general, the hbase-compat-<version>/lib/* and cdap/master/lib/* entries must precede any other paths that contain JARs or classes such as the HBase classpath), review the installation instructions and correct.

...

Code Block
[2013-10-10 20:48:46,160] ERROR [KafkaApi-1511941310]
      Error while retrieving topic metadata (kafka.server.KafkaApis)
      kafka.admin.AdministrationException:
             replication factor: 2 larger than available brokers: 1

As a last resort, cdap_kafka can be reset by stopping CDAP (including cdap_kafka), removing the Kafka znode (from within ZooKeeper use rmr /${cdap.namespace}/kafka) and restarting CDAP.

...

At the end, remove the entry for hbase.coprocessor.abortonerror in order to ensure that data correctness is maintained.

Ask the CDAP Community for assistance

...

You can post a question at the cdap-user@googlegroups.com.

...