...
2. Or Use a API client on your system like curl. Follow API Introduction
Fetch or Read Offset ( CDAP 6.7 + )
...
Fetch the offset info using the above mentioned steps and Look look for offset. state . snapshot_completed .true means it is completed, false means it’s still in progress.
Assuming we get the following offset info using contexts/default/apps/my_app_name/generations/1663319016782/instances/1/offset
...
Fetch the offset info using the above mentioned steps and Look look for offset. state . snapshot
If the value is true : It means the SNAPSHOT is still in progress.
if the value if MISSING / false : it means the SNAPSHOT process is complete.
Example of a Successful Snapshot :
...
Datastream - Oracle Source
To be added. Fetch the offset info using the above mentioned steps, snapshot state will be at path
offset.state.<COMPOSITE_TABLE_NAME>.snapshot.done
where COMPOSITE_TABLE_NAME is <SCHEMA>_<TABLE_NAME>
If the value is true , it means snapshot process is complete for the table, while missing/false value signifies it is still in progress. Note that the snapshot state is maintained per table.
Example of a successful snapshot:
| Code Block |
|---|
{
"offset": {
"state": {
"HR_DISCOUNTS.table.detail": "{<table schema>}",
"HR_DISCOUNTS.schema.key": "fc68f8c7d56639d60974721c7af19f8184736bd1",
"HR_DISCOUNTS.snapshot.done": "true",
"HR_DISCOUNTS.last.done": "true",
"db.created": "true"
}
},
"sequenceNumber": 26
} |
For CDAP 6.6 and below
These info are present on a GCS location of customer project.
Steps to view offset info :
1. Export the JSON of the pipeline ( in pipeline ui page, ACTIONS → EXPORT )
...