Gathering Pre-install Properties

Owned by mwuenschel
Last updated: Feb 11, 2017 by priyanambiar
2 min read

This document covers how to gather the following properties required in preparation for a CDAP Installation. The properties required are:

  • yarn.scheduler.minimum-allocation-vcores
  • yarn.scheduler.minimum-allocation-mb
  • yarn.nodemanager.resource.cpu-vcores
  • yarn.nodemanager.resource.memory-mb
  • mapreduce.task.io.sort.mb
  • mapreduce.map.java.opts
  • mapreduce.reduce.java.opts
  • mapreduce.map.memory.mb
  • mapreduce.reduce.memory.mb

     

Table of Contents:

Cloudera Managed cluster

  1. Login to the Cloudera Manager UI

  2. Click on the YARN service

  3. Go to the Configuration tab

  4. In the search bar, type the name of the property

Ambari cluster

  1. Login to the Ambari UI

  2. For properties that start with "yarn." Click on the YARN service.

  3. For properties that start with "mapreduce." Click on the MapReduce2 service.

  4. Go to the Configs tab

  5. In the search bar, type the name of the property

Mapr cluster

  • Currently Mapr doesn't have a way to set or acquire properties from the UI

  • To get the properties, on the server, navigate to /opt/mapr/hadoop/hadoop-2.x.x/etc/hadoop/yarn-site.xml. Here you can search for the properties.

Downloading the Properties

In Ambari and Cloudera there is also an option to "Download Client Configs". This can be found under the Actions tab of each service. 

  

 

Created in 2020 by Google Inc.