Upgrade tool should be able to upgrade user datasets

For 2.8.0, upgrading user datasets is out of scope, we are adding compatibility mode in the code to deal with it. However, we should be able to upgrade user datasets in 3.0 and remove the hacks in code.