Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

You can assign profiles to batch pipelines in the following ways:

Assign a default profile for all of CDAP, as well as a default profile for a specific namespace.Assign a profile to a batch pipeline to use for runs that are started manually.Assign a profile to a pipeline schedule.

The profile that is used at runtime is determined by walking the CDAP hierarchy from most specific to most general.

...

Alternatively, you can use the Preferences RESTful API to set default profiles.

To set the default profile for all of CDAP, set a preference on the CDAP instance with key system.profile.name and value system:<profile-name>.To set the default profile for a namespace, set a preference on the desired namespace with key system.profile.name and value <scope>:<profile-name>.

Assigning a Profile for Manual Runs

...

To override a profile property, set a runtime argument with key system.profile.properties.<propety<property-name> and value equal to the desired value for that property. For example, to override the numWorkerssetting to a value of 10, set a preference or runtime argument with key system.profile.properties.numWorkers and value 10.