TMS cleanup thread can cause OOM if there are too many entries to remove
upgrade for message tables -
This work only includes partitioning the message tables and not the payload tables.
The payload table keys are of the form [topic][transaction pointer][write timestamp][sequence number]. The scans on the payload table are on a topic and a transaction pointer. Without assuming some sort of relationship between the transaction pointer and a timestamp, there isn’t a way to partition this table on time.
message table partitioning -
Attached the design doc.