Executor resource settings are not honored when app.pipeline.overwriteConfig is set

Description

We are not setting executor resources in ETLBatchConfig.Builder - https://github.com/cdapio/cdap/blob/develop/cdap-app-templates/cdap-etl/cdap-etl-proto/src/main/java/io/cdap/cdap/etl/proto/v2/ETLBatchConfig.java#L263 , so executor cpu and memory settings get ignored.

If app.pipeline.overwriteConfig is not set, we just return the original config, so the issue is not seen - https://github.com/cdapio/cdap/blob/develop/cdap-app-templates/cdap-etl/cdap-data-pipeline-base/src/main/java/io/cdap/cdap/datapipeline/SmartWorkflow.java#L785

Release Notes

Fixed an issue where executor resource settings are not honored when app.pipeline.overwriteConfig is set.

Activity

Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Triaged

Yes

Components

Fix versions

Due date

Priority

Created April 7, 2023 at 6:56 PM
Updated April 17, 2023 at 6:35 PM
Resolved April 11, 2023 at 12:50 AM