I have a small program that initiates our CouchBase server data. It basically gets records from a different DB, and for each record creates (or updates in case the key is already there) documents in CouchBase.
As the number of documents grew, within the first couple of days the performance diminished. I re-wrote this program as a multithreaded one, but that had little effect.
See image at: IMAGE (this forum won’t allow me to upload images?!)
(the “breakage” is the one discussed in topic Help! Server going berserk - that has been fixed and as already visible from the graph - it continues along the same slope after)
What can be the reason? I suppose searching for the documents is slowing me down as I have more and more of them, but I didn’t expect it to drop that hard.
Is there anything I can do to improve get/set speed?
The cluster is 4 nodes, each with: 48GB ram, 32 logical cores, raided disks)