Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

For example, the following pipeline reads data from a file stored in Cloud Storage, performs some data quality checks in Wrangler, inserts the data into the PostgreSQL staging table, and upserts the data from the staging table to the final table, and then truncates the staging table. It’s important to truncate the staging table after the upsert completes to ensure the upsert completes successfully in subsequent runs.

...