DatasetService is not backwards compatible

Description

The cluster was previously running on CDAP 3.5.
It was upgraded to 4.0.0-SNAPSHOT. Upon running the upgrade tool, I see the following errors.

It indicates that DatasetService is unable to load dataset types, due to the data being in a different format than requested (due to Id --> EntityId changes).

This is due to the changes in https://github.com/caskdata/cdap/pull/6735/files#diff-97ff04cf135c1921e196b23f2b6fc93f

Release Notes

None

Activity

Show:
Ali Anwar
October 21, 2016, 10:03 AM

After the UpgradeTool ran, I started CDAP.
I ran the "list dataset types" command from the CLI and see this in the master logs:

Ali Anwar
October 21, 2016, 10:05 AM
Edited

We either need an upgrade step for this, or change the DatasetTypeManager to expect the old format.

Edit: Leaning towards the latter, to handle things in the code as much as possible.

Andreas Neumann
December 14, 2016, 11:50 AM
Edited

It seems that only the mapping from dataset type to data module id in the DatasetTypeMDS is affected (all other data structures in the dataset MDS do not the Id classes). Here is the difference:

Andreas Neumann
December 14, 2016, 1:35 PM
Fixed

Assignee

Andreas Neumann

Reporter

Ali Anwar

Labels

None

Docs Impact

None

UX Impact

None

Components

Fix versions

Affects versions

Priority

Blocker