Kafka

The Couchbase Kafka connector syncs documents between Couchbase and Kafka in near real-time using source and sink components.

Get Started
apache-kafka-logo-vector-white

Kafka Connector overview & features

The Couchbase Kafka Connector integrates Couchbase Server with Apache Kafka, allowing real-time sync of data through source and sink components. The source connector streams document changes from Couchbase to Kafka topics. The sink connector writes messages from Kafka topics into Couchbase. It supports flexible deployment, custom transforms, configurable document IDs, and is available via Confluent Hub or GitHub.

Kafka resources

DATA APPLICATION
Sample Application

Stream JSON documents from Couchbase using Kafka Streams and the Couchbase Kafka Connector

  • Stream data from Couchbase: Automatically captures changes from a sample bucket.
  • Process data with Kafka Streams: Filters and organizes live data as it flows through Kafka.
  • Build a real-time pipeline: Shows how to move and transform data in motion with minimal setup.
Try now
PARTNER
Couchbase is on the Confluent Platform
Read more
SOURCE CODE
Kafka Connector
GitHub

Related integrations

Apache Flink

A framework and distributed processing engine for stateful computations over unbounded and bounded data streams.

  • Cloud
  • Streaming

Airbyte

An open-source data movement infrastructure for building extract and load (EL) data pipelines.

  • Cloud
  • Java
  • Python

PySpark

Python API to connect to the Apache Spark scalable computing engine for big data.

  • Cloud
  • Python

Apache Camel

Integration framework that empowers you to quickly and easily integrate various systems consuming or producing data.

  • Java
  • Streaming

Streamlit

Access Couchbase from Streamlit applications.

  • Python
  • Web

Talend

Manage and transform your data between Couchbase and other data stores in your enterprise.

  • Cloud
  • Migration

Power BI

Use Microsoft’s data visualization software for the Couchbase platform.

  • Visualization

GlueSync

Integrate data in real time with this cloud-native data replication suite for NoSQL.

  • Cloud

Elasticsearch

Replicate your documents from Couchbase Server or Capella to Elasticsearch or OpenSearch in near real time.

  • Search

Dataworkz

Ingest and remodel data from a variety of sources into Couchbase.

  • Analytics
  • Migration

CData ODBC/JDBC

Access live Couchbase data from BI, analytics, reporting, ETL, and custom apps.

  • Analytics
  • Migration

Apache Spark

Connect to a scalable computing engine for big data.

  • Cloud

Apache Airflow

Connect Couchbase to your Airflow workflows for ETL and ELT.

  • Migration
  • Python
See All

Frequently asked questions

  • Does the Kafka connector support Capella?

    Yes. You must use a Kafka connector version of 4.0.1 or higher.

  • Can Couchbase be used as a source and a sink?

    Yes, the connector supports both.

  • Is the connector available on Confluent Hub?

    Yes, the official connector is available for use with Confluent.

  • Do I have to use Confluent to use this connector?

    No, this connector will also work with Apache Kafka.

Couchbase developer community

  • Join the community!

    We’re all hanging out on Discord and would love for you to join our conversations.

    Learn More

  • Access our docs

    Here’s everything you need to start building with Couchbase Capella™.

    Explore Documentation

  • Get certified with Couchbase Academy

    Whether you’re managing Couchbase on premises, using Couchbase Autonomous Operator (CAO), using Couchbase Capella, or writing apps that use Couchbase, we have a certification for you.

    Get Certified

  • Stay sharp with our blog

    News breaks first on our blog. Stay up to date on the Couchbase ecosystem and learn tips and tricks from our engineers, developer advocates, and partners.

    Subscribe To Our Blog