Cbbackup: OverflowError: int too big to convert

Couchbase Server
1

I am getting below error on 1 Bucket. The issue is fixed in MB-38683

Is there a work around right now ???

Exception in thread w0:] 90.6% (13996/estimated 15444 msgs)
Traceback (most recent call last):
  File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 917, in _bootstrap_inner
    self.run()
  File "/opt/couchbase/lib/python/runtime/lib/python3.7/threading.py", line 865, in run
    self._target(*self._args, **self._kwargs)
  File "/opt/couchbase/lib/python/pump.py", line 446, in run_worker
    curx).run()
  File "/opt/couchbase/lib/python/pump.py", line 504, in run
    rv_batch, batch = self.source.provide_batch()
  File "/opt/couchbase/lib/python/pump_dcp.py", line 254, in provide_batch
    rv, batch = self.provide_dcp_batch_actual()
  File "/opt/couchbase/lib/python/pump_dcp.py", line 413, in provide_dcp_batch_actual
    msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(4, 'big'), val, seqno, dtype, metalen,
OverflowError: int too big to convert
2

Hello @Nikhil_Singh,

Here is the original post on this issue incase folks want the background.

With regards to a work around if you are using Couchbase Server Enterprise Edition then it’s recommended that cbbackupmgr is used to backup and restore the data, which is not affected by this bug.

If Community Edition is being used then the patch linked of MB-38683 can be applied.

Basically change the following two lines 413 and 427 in /opt/couchbase/lib/python/pump_dcp.py

Line 413 from:

msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(4, 'big'), val, seqno, dtype, metalen,

to

msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(8, 'big'), val, seqno, dtype, metalen,

Line 427 from:

msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(4, 'big'), val, seqno, dtype, metalen, 0)

to

msg = (cmd, vbucket_id, key, flg, exp, cas, rev_seqno.to_bytes(8, 'big'), val, seqno, dtype, metalen, 0)

Basically changing the 4 to the 8.

1 Like
3

@pvarley Thanks it works (Y)