Hello Team,
I have a question. I have a kafka source connect process which runs in prod and polls couchbase every 100ms . Looks like the seed node names are changing. I have to now delete the connector and update the connector with the new node names and recreate the connector. Question is if I delete and recreate the source connector with the same name, will it begin polling from the saved offset or will it start from now on causing data loss? Using Couchbase Kafka Connect 4.1
Hi Shankar,
It will begin polling from the saved offset.
In the words of Robin Moffatt, Senior Developer Advocate at Confluent, the company founded by the original creators of Apache Kafka:
When you delete a connector, the offsets are retained in the offsets topic. If you recreate the connector with the same name, it will re-use the offsets from the previous execution (even if the connector was deleted in between).
Reference: Kafka Connect - Delete Connector with configs? - Stack Overflow
Thanks,
David