Replication Upgrade process is broken

Description

When a replication pipeline is upgraded, the previous state which is associated with an Pipeline identifier is lost. When if a replication pipeline is upgraded it loses its state/checkpoint and starts all over again.
This is because during upgrade we do not have the previous pipeline identifier (generation).

But Upgrade from any lower version(lower than 6.6.0 ) to 6.7.x+ is handled and upgrade works FINE. This is because we are migrating checkpoint info from GCS to CloudSql.

But for patch upgrade, for example, 6.7.06.7.1 will also lose state/checkpoint and start over.

This was a known issue previously as well ( lower than 6.6), but since it was in GCS , we used to guide the customer to edit the state/checkpoint file manually and restore the State.



Release Notes

Fixed upgrade for replication jobs. You can now upgrade replication jobs from CDAP 6.6.0 to 6.7.3.

Activity

Show:
Fixed
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

UX Impact

Yes

Affects versions

Triaged

No

Size

XL

Components

Fix versions

Due date

Priority

Created September 20, 2022 at 8:58 AM
Updated June 9, 2023 at 12:48 PM
Resolved January 24, 2023 at 2:29 PM