Cannot wrangle non-tiny GCS object
Description
Release Notes
Fixed a bug in wrangler that would cause it to go out of memory when sampling a GCS object that has a lot of rows.
Activity
Show:
Albert Shau May 6, 2020 at 6:50 PM
verified on the data file that was causing the original issue is now able to be loaded.
Albert Shau May 6, 2020 at 6:35 PM
By default, the wrangler service is created with 512mb of memory. This is not enough to wrangle a 128mb GCS object I have, which only contains:
0,ashau
0,ashau
0,ashau
over and over and over again.