Skip to end of metadata
Go to start of metadata

You are viewing an old version of this page. View the current version.

Compare with Current View Page History

« Previous Version 10 Next »

Introduction

Confluent Cloud is a streaming data service with Apache Kafka delivered as a managed service. 

User Storie(s)

  • As a pipeline developer, I would like to stream data real time from Confluent cloud 
  • As a pipeline developer I would like to capture records that are not delivered downstream for analysis 
  • As a pipeline developer, I would like to stream data real time to Confluent Cloud

Plugin Type

  • Batch Source
  • Batch Sink 
  • Real-time Source
  • Real-time Sink
  • Action
  • Post-Run Action
  • Aggregate
  • Join
  • Spark Model
  • Spark Compute

Prerequisites


Properties

Real time source

Propertydescription


Kafka topicList of topics which we are listening to for streaming
Schema registry URLURL endpoint for the schema registry on Confluent Cloud
Schema registry API key
Schema registry secret



Real time sink

Propertydescription


Kafka topicList of topics to which the data should be published to
Schema registry URLURL endpoint for the schema registry on Confluent Cloud
Schema registry API key
Schema registry secret




References

Design / Implementation Tips

  • Tip #1
  • Tip #2

Design

Approach(s)

Properties

Security

Limitation(s)

Future Work

  • Some future work – HYDRATOR-99999
  • Another future work – HYDRATOR-99999

Test Case(s)

  • Test case #1
  • Test case #2

Sample Pipeline

Please attach one or more sample pipeline(s) and associated data. 

Pipeline #1

Pipeline #2



Table of Contents

Checklist

  • User stories documented 
  • User stories reviewed 
  • Design documented 
  • Design reviewed 
  • Feature merged 
  • Examples and guides 
  • Integration tests 
  • Documentation for feature 
  • Short video demonstrating the feature
  • No labels