Cbbackupmgr backup is failing from remote server intermittently

Hi Team,

We are running backup of one cluster from remote server and when first backup runs, its getting failed with below error:
Error backing up cluster: failed to execute cluster operations: failed to execute bucket operations: failed to transfer bucket config for bucket ‘xxxxx’: failed to get bucket configuration for bucket ‘xxxxxx’: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)

And again after one hour when the jobs runs, backup is running without any issue. Can you please let us know the reason for this error?

Hi @pruthvi. When doing a backup we make various REST requests to the cluster. In this case the request to get a bucket’s configuration (which we backup) is failing due to not receiving a response from the server in time. This could be an issue with your network (i.e. the server has sent a response but it does not successfully reach your remote server) or potentially an issue with the cluster (i.e. it does not send a response in time).

I would recommend doing some tests on the network - e.g. can you ping all the cluster nodes from your remote server, can you make the request using curl (see Getting Bucket Information | Couchbase Docs) from the remote cluster etc.

If it happens repeatedly and you can open a support ticket then we could look at the cluster logs to find out if the problem is there.