Goals

• Improving performance of single Tephra Transaction Server
• Make Tephra Transaction server scale horizontally
• Make Tephra Transaction server Highly Available (HA) with Isolation
• Improve operational aspects of Transaction Server
• Improve performance of Workflow scheduling to schedule 1000s of jobs / second

Areas of Focus

• Transaction Invalid List Management
• Tephra Single Server Performance Improvements
• Isolation and Scalability of Tephra Transaction Server
• Improving scheduling performance of Workflow system

High Level Requirements

Transaction Invalid List Management

• System should automatically handle pruning of the transaction invalid list
• Reduce operational complexity for running manual steps to prune invalid transaction list
• Applied during major and striped compaction
• Metrics around the current invalid list size
• Tool to inspect and report progress on pruning

Tephra Performance Improvement

• Single Tephra Server should be able to support up-to ~ 10K transactions/second
• Support read-only and hierarchical conflict detection

Scale and Isolation

• Run multiple instances of Tephra Transaction Server in active-active in single DC or multiple DC
• Isolation at namespace level 

Technical Breakdown

P&S-001 : Invalid list pruning with major compaction

The 

P&S-002 : Tool(s) to inspect and report progress on pruning

Progress of pruning when running, impact of pruning on invalid list, show any regions that are behind preventing pruning on invalid transaction list

P&S-003 : Performance improvements of Single Transaction server

This will be on focused on improving the performance of single transaction server. As part of this we will be improving on the locking granularity during conflict detection, support read-only transactions, improve group commit efficiency, hierarchical conflict detection, transmit only latest snapshot of invalid list. 

P&S-004 : Transaction server per namespace for resource isolation

P&S-005 : Support for running multiple instance of Transaction server in Active-Active mode

P&S-006 : Invalid List pruning with striped compaction

Open Questions

Action Items