Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Complete the requirements and instructions below prior to installing the CDAP components.

Memory and Core Requirements

Memory and core requirements are governed by two sources: CDAP and YARN.

The default settings for CDAP are found in the cdap-defaults.xml, and are overridden in particular instances by the cdap-site.xml file. These vary with each service and range from 512 to 1024 MB and from one to two cores.

The YARN settings will override these; for instance, the minimum YARN container size is determined by yarn.scheduler.minimum-allocation-mb. The YARN default in Hadoop is 1024 MB, so containers will be allocated with 1024 MB, even if the CDAP settings are for 512 MB.

With these default YARN and CDAP memory settings, just starting CDAP can require having 14 to 16 CPU cores (and a total of 14 to 16 GB of memory) available to YARN.

Network Requirements

CDAP components communicate over your network with HBaseHDFS, and YARN. For the best performance, CDAP components should be located on the same LAN, ideally running at 1 Gbps or faster. A good rule of thumb is to treat CDAP components as you would Hadoop datanodes.

...