...
It is recommended to always have the Instrumentation setting on unless the environment is short on resources.
For streaming pipelines, you can also set the Batch interval (seconds/minutes) for streaming data.
Engine config
For each pipeline, you can choose Spark or MapReduce as the execution engine. Spark is the default execution engine. You can also add custom configurations, which allow you to add additional engine configurations. Typically, custom configurations apply to Spark and not as frequently to MapReduce.
...