Decouple Logging system from Datasets

Description

Log Saver and Log Reader use Datasets and Transaction to store meta information like Kafka offsets, log file names, etc. When there is an issue starting Datasets or Transaction Service, Log Reader will not be able to startup and hence logs related to Datasets issue will not be available to users to debug.

By directly writing to HBase tables, there will be no dependency on any CDAP services, and Log Reader can startup without any other service. However, we will lose transaction rollback capability on errors.

Release Notes

None

Activity

Show:

Sreevatsan Raman June 24, 2016 at 8:28 PM

Adding to backlog.

Won't Fix
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Affects versions

Components

Priority

Created February 3, 2015 at 3:17 AM
Updated June 9, 2020 at 1:26 AM
Resolved June 9, 2020 at 1:26 AM