CDAP
Community Information
CDAP Components
Environments
Infrastructure
- Instance ID generation in Kubernetes
- 5.0 Metadata
- Add native support for Dataframe APIs in data processing pipeline
- CDAP 5 incompatible changes
- CDAP Cloud 5.x
- CDAP Edge
- CDAP Operational APIs
- CDAP Scripts
- Change log level dynamically
- Control Flow support in Hydrator
- Dataset Infrastructure
- Exception Handling Improvements
- Field Level Lineage (WIP)
- Improving Plugins User Experience Across Different Modes
- Installation Improvements
- Messaging
- Metadata and Data Discovery
- Metrics
- Namespace Migration
- Provisioner System Properties
- Refined Program States
- Resiliency, Replication, Rolling Upgrade, Performance
- Resources Lifecycle
- Running on Kubernetes
- Scaling preview system on Kubernetes
- Security
- Spark Revamp
- System Bootstrapping
- Upgrade Tool Improvements
- Versioning Support - Applications and Services
- Workflow
Dataset and Streams
- Add SNAPSHOT dataset and SNAPSHOT source/sink
- Changes to Table Interface
- Dynamic Partitioning of MapReduce Output
- External File Sets
- Hive 2.0 Support
- Multiple Inputs of MapReduce
- Multiple Output Datasets of MapReduce
- Periodically consuming partitions of a PartitionedFileSetDataset
- Stream
- Streaming HTTP handlers
Application Concepts
Metadata and Data Discovery
- Active program runs heartbeat
- Enhancements to Search - CDAP 4.0
- External Search and Indexing Engine Investigation
- Metadata and Data Discovery 3.3
- Metadata Management - External Integrations
- Navigator Integration
- Performance improvement for getting active program runs within a time range for Ops Dashboard
- Sorting and Pagination for Search
- Workflow Level Lineage View
- Wrangler Lineage for Directives
Security
Metrics and Logging
Namespace
Metrics and Logging
Created in 2020 by Google Inc.