Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Kafka Connect Architecture - High Level

Kafka Connect and Flow of data

Kafka Connect Worker

Standalone - All work is performed in a single process.

Distributed - Work is shared and balanced across multiple nodes.

Kafka Connect Standalone

Info

Configuration to our connectors is by using a CONFIGURATION FILE AND NOT A REST API.

The offset management is done through a simple file that is stored on the same machine that the worker process is running.

Kafka Connect Distributed

Kafka Connect Connectors

Image Added