You can assign compute profiles to batch pipelines in the following ways:
...
Similarly, if a pipeline is manually run and there is a profile assigned to that pipeline, that profile is used. If no profile is set, the default profile for the namespace is used. If no default is set on the namespace, the default for CDAP is used. If no CDAP default is set, the native profile is used.
Note: If you have deployed your own custom applications and are using workflows, you can also use profiles to run your workflow in a cloud environment. Batch pipelines are just workflows with special UI support that makes profiles are easy to use.
Assigning Default Profiles
You can assign default profiles to a namespace and to the CDAP instance through the UI. Navigate to the Administration page and click the star next to the profile.
...
To set the default profile for all of CDAP, set a preference on the CDAP instance with key system.profile.name and value system:<profile-name>.
To set the default profile for a namespace, set a preference on the desired namespace with key system.profile.name and value <scope>:<profile-name>.
Assigning a Profile for Manual Runs
You can assign a profile to use for manual pipeline runs. Navigate to the pipeline detail page and click Configure > Advanced Options > Compute config. Next, select a profile and save. From that point on, the profile is used any time the pipeline is run manually.
...
Alternatively, you can use the Preferences RESTful API to set the profile for manual runs by setting preference on the DataPipelineWorkflow entity with key system.profile.name and value <scope>:<profile-name>.
Assigning a Profile to a Schedule
Any time you create a schedule for a pipeline, you can assign a profile to it. Whenever the schedule triggers a pipeline run, it will use that profile for the run. This is true for time schedules and schedules that other pipelines trigger.
...
Alternatively, you can use the Schedules RESTful API to assign a profile to a schedule.
Overriding Profile Configuration
When a profile is created, each configuration settings can be made immutable by locking it. All other configuration settings can be overridden at runtime. You can edit configuration settings in the same page where you assign the profile.
...