Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

NoSQL databases arose to address this limitation by allowing you to insert data without a predefined schema. Because of this, you can easily make changes to an application without interruption. The result is more reliable code integration, faster development, and database administration time.

Configuration

Property

Macro Enabled?

Description

Reference Name

No

Required. Name used to uniquely identify this sink for lineage, annotating metadata, etc.

Table Name

Yes

Required. Specifies the name of the Dataset to write. If the Dataset doesn’t exist, then it will be created. If a macro is not specified, then it’s created during deployment, else it’s created at runtime.

Zookeeper Quorum

Yes

Required. The ZooKeeper quorum for the hbase instance you are writing to. This should be a comma-separated list of hosts that make up the quorum. You can find the correct value by looking at the hbase.zookeeper.quorum setting in your hbase-site.xml file. This value defaults to 'localhost'.

Row key (input field name or expression)

Yes

Required. Specifies how unique key needs to be generated. This can be an expression.

Column Family (input field or expression or constant)

Yes

Required. Specifies how column family needs to be generated. This can be an expression or literal.

Zookeeper Port (DEFAULT: 2181)

Yes

Optional. The client port used to connect to the ZooKeeper quorum. You can find the correct value by looking at the hbase.zookeeper.quorum setting in your hbase-site.xml. This value defaults to 2181.

Parent Node of HBase in Zookeeper. (DEFAULT : /hbase)

Yes

Optional. The parent node of HBase in ZooKeeper. You can find the correct value by looking at the hbase.zookeeper.quorum setting in your hbase-site.xml. This value defaults to '/hbase'.

Row Level Durability (DEFAULT: WAL Synchronous)

Yes

Optional. Durability of writes.

Limitation

Currently, this plugin doesn’t support connecting to kerberos secured clusters.

...

Upon creating the CDAP table using this plugin, you can either use Apache Phoenix or Hive with HBase Storage handler to create a view over different schemas that are available in the same table.