Skip to:

  1. Skip to Jira Navigation
  2. Skip to Side Navigation
  3. Skip to Main Content

Allow specifying dataproc cluster properties in dataproc provisioner

Description

The dataproc provisioner should allow customizing of cluster properties: https://cloud.google.com/dataproc/docs/concepts/configuring-clusters/cluster-properties

 

Some use-cases require properties be set, for example dataproc:dataproc.conscrypt.provider.enable must be false for any connection to MSSQL due to https://github.com/GoogleCloudPlatform/dataproc-initialization-actions/issues/177

 

 

Release Notes

Added support of using runtime arguments to pass in extra configurations for Dataproc provisioner

Activity

Show:

Ali Anwar May 24, 2019 at 6:33 PM

These properties can be set in the profile properties.

Alternatively, they can be set in the runtime argument, but for the runtime arguments, the key must be prefixed. For example:

system.profile.properties.dataproc:dataproc.conscrypt.provider.enable as the key and false as the value.

Terence Yim May 1, 2019 at 8:02 PM

Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Labels

Components

Fix versions

Priority

Created May 1, 2019 at 8:00 AM
Updated June 9, 2020 at 4:16 PM
Resolved May 1, 2019 at 11:56 PM
Configure