TMS cleanup thread can cause OOM if there are too many entries to remove

Description

None

Release Notes

None

Activity

Show:
Albert Shau
10 hours ago

cherry-picks:

Albert Shau
12 hours ago

upgrade for message tables -

Albert Shau
2 days ago

This work only includes partitioning the message tables and not the payload tables.

The payload table keys are of the form [topic][transaction pointer][write timestamp][sequence number]. The scans on the payload table are on a topic and a transaction pointer. Without assuming some sort of relationship between the transaction pointer and a timestamp, there isn’t a way to partition this table on time.


Albert Shau
3 days ago

message table partitioning -

Terence Yim
May 5, 2021, 6:11 PM

Attached the design doc.

Your pinned fields
Click on the next to a field label to start pinning.

Assignee

Albert Shau

Reporter

Terence Yim