Ability for Task Workers to run concurrent tasks

Description

Presently task workers can only run a single request at a time. This is useful when code needs to be run in an isolation environment for security. In cases when isolated environment is not necessary, task workers can be allowed to run requests in parallel. This will increase the number of design time operations that can be handled with the same number of task workers.

Release Notes

Task workers can run requests concurrently if isolation is not required during user code execution. This behaviour is controlled using cdap-site properties `task.worker.request.userCodeIsolation.enabled` and `task.worker.request.limit`

Activity

Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Affects versions

Triaged

Yes

Size

S

Components

Fix versions

Priority

Created October 27, 2023 at 9:17 AM
Updated January 3, 2024 at 2:28 PM
Resolved November 6, 2023 at 1:02 PM