Checking the max batch size option available for sink configurations. My requirement is to check the througput as the data produces 50k at a time. Checking for batch size option as it may increase throughput.

Hi Casavi. Short answer: The Couchbase Kafka Sink Connector does not have a config option for tuning the batch size. Long answer: The Kafka Connect framework sends records to the Couchbase Kafka Sink Connector in batches. The size of these batches is not controlled by the Couchbase connector; if…

Did not see th eoption of couchbase.batch.size.max is sink configuration. Is it not supporting for multiple batch insertions?

Kafka Connector

david.nault June 12, 2023, 4:45pm 9

Hi Vasavi, check out this similar discussion:

Topic		Replies	Views
Import 6 Million Record Java SDK	3	3027	January 17, 2015
maxConcurrency parameter for couchbaseUpsert in 3.X? Spark Connector connections	0	690	September 21, 2022
Kafka-couchbase-connect sink couchbase.remove.document.id=true is not working Kafka Connector	17	2489	November 26, 2022
Is there an option to throttle the documents load to kafka topic in Couchbase Source connector? Kafka Connector	1	1185	April 21, 2020
How to do bulk insert via couchbase for java Couchbase Server	10	6221	March 10, 2022

Did not see th eoption of couchbase.batch.size.max is sink configuration. Is it not supporting for multiple batch insertions?

Related topics