Log messages and metrics can be dropped if kafka is down

Description

Every component publishes logs and metrics to Kafka. Currently, publishing does best effort: if Kafka is down, the publisher doesn't buffer on local FS the data, but just drops it.

On top of that - many error logs in client, e.g.

We don't want to log it as ERROR as it freask out ops.
We don't want to loose data in case Kafka is down.

Release Notes

None

Activity

Show:
Won't Fix
Pinned fields
Click on the next to a field label to start pinning.

Details

Assignee

Reporter

Components

Priority

Created March 5, 2015 at 9:47 PM
Updated June 9, 2020 at 1:26 AM
Resolved June 9, 2020 at 1:26 AM