Metadata parameters (cdap-site.xml and cdap-default.xml)

Parameter Name

Default Value

Version Introduced

Description

Parameter Name

Default Value

Version Introduced

Description

metadata.max.allowed.chars

50

 

Maximum number of characters for metadata keys, values, and tags.

metadata.consumer.extensions.dir

/opt/cdap/master/ext/metadataconsumers

6.8.0

Semicolon-separated list of local directories on the CDAP Master that are scanned for metadata consumer extensions.

metadata.consumer.extensions.enabled.list

 

6.8.0

Comma separated list of metadata consumer extension names that are enabled. Extensions that are not present in this list will be ignored.

metadata.service.bind.address

0.0.0.0

 

Metadata HTTP service bind address.

metadata.service.bind.port

0

 

Metadata HTTP service bind port; if 0, binds to a random port.

metadata.service.exec.threads

${http.service.exec.threads}

 

Number of Netty service executor threads for metadata HTTP service.

metadata.service.worker.threads

${http.service.worker.threads}

 

Number of Netty service IO worker threads for metadata HTTP service.

metadata.messaging.topic

metadata

 

Topic name used to publish metadata messages in the messaging system.

metadata.messaging.fetch.size

100

 

Number of messages to fetch from messaging system for each batch.

metadata.messaging.poll.delay.millis

2000

 

The delay in milliseconds that the lineage processor checks again for new events after it detects there was no event.

metadata.messaging.retries.on.conflict

100

 

The maximal number of times a metadata message will be processed if it repeatedly causes a conflict exception. After this, the message will be discarded.

metadata.messaging.publish.size.limit

2147483647

6.6.0

The maximum number of characters for a JSON string representation of a lineage to be published. If the lineage exceeds this size it will not be published.

Created in 2020 by Google Inc.