Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Default is Standard Persistent Disk

Worker Nodes Settings

Worker Machine Type

The type of worker machine to use. Select one of the following machine types:

  • n1

  • n2

  • n2d

  • e2

Default is n1.

Worker Cores

The number of virtual cores to allocate for each worker node.

Default is 2.

Worker Memory (GB)

The amount of memory in gigabytes to allocate to each worker node.

Default is 8 GB.

Worker Disk Size (GB)

The disk size in gigabytes to allocate for each worker node.

Default is 1000 GB

Worker Disk Type

Type of boot disk for the worker node:

  • Standard Persistent Disk

  • SSD Persistent Disk

Default is Standard Persistent Disk.

Number of Cluster Workers Settings

...

Recommended: Use autoscaling policies for increasing the cluster size, not for decreasing the size. Decreasing the cluster size with autoscaling removes nodes that hold intermediate data, which might cause your pipelines to run slowly or fail.

Worker Nodes Settings

Worker Machine Type

The type of worker machine to use. Select one of the following machine types:

  • n1

  • n2

  • n2d

  • e2

Default is n1.

Worker Cores

The number of virtual cores to allocate for each worker node.

Default is 2.

Worker Memory (GB)

The amount of memory in gigabytes to allocate to each worker node.

Default is 8 GB.

Worker Disk Size (GB)

The disk size in gigabytes to allocate for each worker node.

Default is 1000 GB

Worker Disk Type

Type of boot disk for the worker node:

  • Standard Persistent Disk

  • SSD Persistent Disk

Default is Standard Persistent Disk.

Cluster Metadata Settings

...