Memory and Core Requirements

Memory and core requirements are governed by two sources: CDAP and YARN.

The default settings for CDAP are found in the cdap-default.xml, and are overridden in particular instances by the cdap-site.xml file. These vary with each service and range from 512 to 1024 MB and from one to two cores.

The YARN settings will override these; for instance, the minimum YARN container size is determined by yarn.scheduler.minimum-allocation-mb. The YARN default in Hadoop is 1024 MB, so containers will be allocated with 1024 MB, even if the CDAP settings are for 512 MB.

With these default YARN and CDAP memory settings, just starting CDAP can require having 14 to 16 CPU cores (and a total of 14 to 16 GB of memory) available to YARN.