Can I rely on the ordering of the production of the events produced to kafka – that the latest publishing of document is the latest version of that document?
Always? No. Eventually, yes.
The connector may rewind the event stream and republish some changes. Typically this only happens when the connector restarts. I’m not aware of any guarantee that would prevent the connector from publishing version 1 of a document, then version 2, then rewinding and republishing version 1 again followed by version 2 again.
Is there a way virtual extended attributes be made available in the payload the connector produces to kafka
Not that I’m aware of.
Perhaps this could be worked around by adding a version or timestamp property to the documents you are streaming?
Thanks,
David