Table (HBase) based datasets only work on very old versions of Hadoop and don’t work at all with compute profiles. There are no plans to support Table based datasets or custom datasets moving forward, so we need to deprecate the relevant APIs.
FileSets are still technically usable, though most usage of the datasets API is now for external datasets for lineage purposes.
Release Notes
All datasets except FileSet and ExternalDataset are deprecated and will be removed in a future release. All the deprecated datasets use the Table dataset in some form, which only work for programs running with the native provisioner on very old Hadoop releases.
Table (HBase) based datasets only work on very old versions of Hadoop and don’t work at all with compute profiles. There are no plans to support Table based datasets or custom datasets moving forward, so we need to deprecate the relevant APIs.
FileSets are still technically usable, though most usage of the datasets API is now for external datasets for lineage purposes.