Introduction

Confluent Cloud is a streaming data service with Apache Kafka delivered as a managed service.

User Storie(s)

As a pipeline developer, I would like to stream data real time from Confluent cloud
As a pipeline developer I would like to capture records that are not delivered downstream for analysis
As a pipeline developer, I would like to stream data real time to Confluent Cloud

Real time source

Property	description

Kafka topic	List of topics which we are listening to for streaming
Schema registry URL	URL endpoint for the schema registry on Confluent Cloud
Schema registry API key
Schema registry secret

Real time sink

Property	description

Kafka topic	List of topics to which the data should be published to
Schema registry URL	URL endpoint for the schema registry on Confluent Cloud
Schema registry API key	API key for
Schema registry secret

References

Design / Implementation Tips

Please attach one or more sample pipeline(s) and associated data.

Table of Contents

Checklist