System Metadata

Owned by Robin Rielley
Last updated: Feb 09, 2023 by robin
1 min read

While CDAP allows users to tag entities with metadata properties and tags, it also tags entities with system properties and tags by default. These default properties and tags can be retrieved using the CDAP Metadata Microservices by setting the scope query parameter to system. These default annotations can be used to discover CDAP entities using the Metadata Search API.

This table lists the system metadata annotations of CDAP entities:

Entity

System Properties

System Tags

Entity

System Properties

System Tags

Artifacts

  • Plugins (name and version)

  • Artifact name

Applications

  • Programs (name and type) contained in the application

  • Plugins

  • Schedules (name and description)

  • Application name

  • Artifact name

Programs

  • n/a

  • Program name and type

  • Program mode (batch or realtime)

  • Workflow node names (for workflows only)

Datasets

  • Schema (field names and types)

  • Dataset type (FileSet, Table, KeyValueTable, etc.)

  • TTL (Time To Live)

  • Dataset name

  • batch for Datasets accessible through MapReduce or Spark programs

 

Created in 2020 by Google Inc.