Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

Since the driver does not do much work, the default of 1cpu 1 CPU and 2gb 2 GB memory is normally enough to run most pipelines. You may need to increase the memory for pipelines that contain many stages or large schemas. As mentioned in the join section, if the pipeline is performing in-memory joins, the in-memory dataset(s) also need to fit in the driver's memory.

...