Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 8 Current »

The MongoDB sink plugin is available in the Hub.

Plugin version: 2.0.0

This sink writes to a MongoDB collection.

Configuration

Property

Macro Enabled?

Description

Reference Name

No

Required. Name used to uniquely identify this sink for lineage, annotating metadata, etc.

Host

Yes

Required. Host that MongoDB is running on. Enter the hostname only. The connection string is constructed by the plugin.

Port

Yes

Required. Port that MongoDB is listening to.

Default is 27017.

Database

Yes

Required. MongoDB database name.

Collection

Yes

Required. Name of the database collection to write to.

ID Field

Yes

Optional. Which input field should be used as the document identifier. Identifier is expected to be a 12-byte value or it’s 24-byte hexadecimal string representation. If none is given, an identifier will be automatically generated.

Username

Yes

Optional. User identity for connecting to the specified database.

Password

Yes

Optional. Password to use to connect to the specified database.

Connection Arguments

Yes

Optional. A list of arbitrary string key/value pairs as connection arguments. See Connection String Options for a full description of these arguments.

Data Type Mapping

CDAP Schema Data Type

MongoDB Data Type

Comments

boolean

Boolean

bytes

Binary data, ObjectId

12-byte value of the identifier field is mapped to ObjectId.

string

String, ObjectId

24-byte hexadecimal string value of the identifier field is mapped to ObjectId.

date

Date

double

Double

decimal

Decimal128

float

Double

int

32-bit integer

long

64-bit integer

time

String

Time string in the following format: HH:mm:ss.SSS

timestamp

Date

array

Array

record

Object

enum

String

map

Object

union

Depends on the actual value. For example, if it's a union ["string","int","long"] and the value is actually a long, the MongoDB document will have the field as a 64-bit integer. If a different record comes in with the value as a string, the MongoDB document will end up with a String for that field.

  • No labels