...
Memory
For most pipelines, 4gb 4 GB of executor memory is enough to successfully run the pipeline. Heavily skewed, multi terabyte joins have been completed with 4gb executors. It is possible to improve execution speed by increasing the amount of memory, but this requires a good understanding of both your data and your pipeline.
...