Unambiguous error in go sdk Couchbase

Environment: MacOS
K8s Cluster: Kind
Endpoint: localhost:5984

unambiguous timeout | {“InnerError”:{“InnerError”:{“InnerError”:{},“Message”:“unambiguous timeout”}},“OperationID”:“WaitUntilReady”,“Opaque”:“”,"Tim

eObserved":25000583949,“RetryReasons”:[“NOT_READY”],“RetryAttempts”:30,“LastDispatchedTo”:“”,“LastDispatchedFrom”:“”,“LastConnectionID”:“”}

Logs:
GOCB 20:45:53.340471 cluster.go:282: SDK Version: gocbcore/v10.1.5
GOCB 20:45:53.341304 cluster.go:282: Creating new agent group: &{AgentConfig:{BucketName: UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}}
GOCB 20:45:53.343609 agentgroup.go:30: SDK Version: gocbcore/v10.1.5
GOCB 20:45:53.344159 agentgroup.go:30: Creating new agent: &{BucketName: UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}
GOCB 20:45:53.345144 agent.go:76: HTTP muxer applying endpoints:
Bucket:
Capi Eps:
Mgmt Eps:
N1ql Eps:
FTS Eps:
CBAS Eps:
Eventing Eps:
GSI Eps:
Backup Eps:
GOCB 20:45:53.345267 agent.go:407: KV muxer applying endpoints:
Bucket:

  • localhost:5984
    GOCB 20:45:53.345458 agentgroup.go:40: HTTP muxer applying endpoints:
    Bucket:
    Capi Eps:
    Mgmt Eps:
    N1ql Eps:
    FTS Eps:
    CBAS Eps:
    Eventing Eps:
    GSI Eps:
    Backup Eps:
    GOCB 20:45:53.345664 ???:0: Pipeline Client localhost:5984/0xc000094540 preparing for new client loop
    GOCB 20:45:53.345766 pollercontroller.go:103: CCCP Looper starting.
    GOCB 20:45:53.345803 ???:0: Pipeline Client localhost:5984/0xc000094540 retrieving new client connection for parent 0xc000094480
    GOCB 20:45:53.345883 cluster.go:288: Initializing transactions: CustomATRLocation:%!s(PANIC=String method: runtime error: invalid memory address or nil pointer dereference) ExpirationTime:0s DurabilityLevel:MAJORITY KeyValueTimeout:2.5s CleanupWindow:0s CleanupClientAttempts:true CleanupLostAttempts:true CleanupQueueSize:0 BucketAgentProvider:0x12d9580 LostCleanupATRLocationProvider:0x12d9600 Internal:{EnableNonFatalGets:false EnableParallelUnstaging:false EnableExplicitATRs:false EnableMutationCaching:false NumATRs:0}
    GOCB 20:45:53.346401 ???:0: Starting cleanup for 0xc000096910
    GOCB 20:45:53.346562 agentgroup.go:75: SDK Version: gocbcore/v10.1.5
    GOCB 20:45:53.346657 ???:0: Lost transactions cf8a276a-f67b-4fc6-a4c4-942cc251231f starting
    GOCB 20:45:53.346716 agentgroup.go:75: Creating new agent: &{BucketName:travel-sample UserAgent:gocb/v2.5.3 SeedConfig:{HTTPAddrs: MemdAddrs:[localhost:5984]} SecurityConfig:{UseTLS:false TLSRootCAProvider: NoTLSSeedNode:false Auth:0xc000091b70 AuthMechanisms:} CompressionConfig:{Enabled:true DisableDecompression:false MinSize:0 MinRatio:0} ConfigPollerConfig:{HTTPRedialPeriod:0s HTTPRetryDelay:0s HTTPMaxWait:0s CccpMaxWait:0s CccpPollPeriod:0s} IoConfig:{NetworkType: UseMutationTokens:true UseDurations:true UseOutOfOrderResponses:true DisableXErrorHello:false DisableJSONHello:false DisableSyncReplicationHello:false EnablePITRHello:false UseCollections:true} KVConfig:{ConnectTimeout:1m35s ServerWaitBackoff:0s PoolSize:0 MaxQueueSize:0 ConnectionBufferSize:0} HTTPConfig:{MaxIdleConns:0 MaxIdleConnsPerHost:0 ConnectTimeout:0s IdleConnectionTimeout:0s} DefaultRetryStrategy:0xc000091a50 CircuitBreakerConfig:{Enabled:true VolumeThreshold:0 ErrorThresholdPercentage:0 SleepWindow:0s RollingWindow:0s CompletionCallback: CanaryTimeout:0s} OrphanReporterConfig:{Enabled:true ReportInterval:0s SampleSize:0} TracerConfig:{Tracer:0xc000091a60 NoRootTraceSpans:true} MeterConfig:{Meter:} InternalConfig:{EnableResourceUnitsTrackingHello:false}}
    GOCB 20:45:53.346960 agent.go:76: HTTP muxer applying endpoints:
    Bucket:
    Capi Eps:
    Mgmt Eps:
    N1ql Eps:
    FTS Eps:
    CBAS Eps:
    Eventing Eps:
    GSI Eps:
    Backup Eps:
    GOCB 20:45:53.347014 agent.go:407: KV muxer applying endpoints:
    Bucket:
  • localhost:5984
    GOCB 20:45:53.347090 client.go:148: Shutting down global level agent
    GOCB 20:45:53.347249 ???:0: Pipeline Client localhost:5984/0xc000094b40 preparing for new client loop
    GOCB 20:45:53.347329 ???:0: Pipeline Client localhost:5984/0xc000094b40 retrieving new client connection for parent 0xc000094a80
    GOCB 20:45:53.347387 cccpcfgcontroller.go:119: CCCPPOLL: CCCP request was cancelled or connection was shutdown: request canceled
    GOCB 20:45:53.347452 pollercontroller.go:103: CCCPPOLL: CCCP request was cancelled.
    GOCB 20:45:53.347328 kvmux.go:440: Pipeline Client localhost:5984/0xc000094540 received close request
    GOCB 20:45:53.347543 kvmux.go:440: Pipeline client localhost:5984/0xc000094540 closing consumer 0x0
    GOCB 20:45:53.347262 pollercontroller.go:103: CCCP Looper starting.
    GOCB 20:45:53.347642 kvmux.go:692: Failed to connect. check server ports and cluster encryption setting: dial tcp: lookup localhost: operation was canceled
    GOCB 20:45:53.347291 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:53.347885 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:53.347844 ???:0: Pipeline Client localhost:5984/0xc000094540 preparing for new client loop
    GOCB 20:45:53.348168 ???:0: Pipeline Client localhost:5984/0xc000094540 is shutting down
    GOCB 20:45:53.348047 asm_amd64.s:1594: Will retry request. Backoff=1ms, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:53.348228 kvmux.go:440: Pipeline Client localhost:5984/0xc000094540 has exited
    GOCB 20:45:53.348492 agent.go:424: Draining queue &{address:localhost:5984 getClientFn:0x1294ae0 maxItems:2048 queue:0xc0000c6360 maxClients:1 clients: clientsLock:{state:0 sema:0} isSeedNode:true}
    GOCB 20:45:53.349493 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:53.349573 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:53.349617 asm_amd64.s:1594: Will retry request. Backoff=10ms, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:53.359342 kvmux.go:692: Memdclient localhost:5984/0xc000224000 Fetching cluster client data
    GOCB 20:45:53.359573 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x1f. Opaque=1
    GOCB 20:45:53.359804 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:53.359879 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:53.359800 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0xfe. Opaque=2
    GOCB 20:45:53.359925 asm_amd64.s:1594: Will retry request. Backoff=50ms, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:53.360091 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x20. Opaque=3
    GOCB 20:45:53.360331 memdclient.go:1150: Writing request. [::1]:53460 to localhost:5984 OP=0x21. Opaque=4
    GOCB 20:45:53.410470 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:53.410598 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:53.410660 asm_amd64.s:1594: Will retry request. Backoff=100ms, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:53.511826 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:53.511955 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:53.512017 asm_amd64.s:1594: Will retry request. Backoff=500ms, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:54.012247 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:54.012348 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:54.012397 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:55.012767 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:55.012898 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:55.015379 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:56.015597 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:56.015738 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:56.015788 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:56.347892 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
    GOCB 20:45:56.347985 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
    GOCB 20:45:57.016483 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:57.016641 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:57.016737 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:58.017700 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:58.017856 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:58.017921 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:45:59.019042 ???:0: Bootstrap error found before config seen:
    GOCB 20:45:59.019152 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:45:59.019193 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:00.020801 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:00.020928 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:00.020982 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:01.025423 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:01.025540 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:01.025608 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:01.849348 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
    GOCB 20:46:01.849560 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
    GOCB 20:46:02.026492 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:02.026644 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:02.026726 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:03.026884 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:03.027065 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:03.027197 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:04.029364 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:04.029753 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:04.029864 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:05.030173 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:05.030339 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:05.030409 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:06.032042 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:06.032200 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:06.032266 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:07.033528 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:07.033666 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:07.033889 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:07.351175 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
    GOCB 20:46:07.351357 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
    GOCB 20:46:08.034927 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:08.035096 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:08.035202 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:09.035796 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:09.036073 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:09.036306 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:10.036566 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:10.038023 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:10.038174 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:11.038622 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:11.038735 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:11.038847 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:12.039221 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:12.039414 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:12.039655 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:12.853312 cccpcfgcontroller.go:119: CCCPPOLL: Failed to retrieve CCCP config. ambiguous timeout
    GOCB 20:46:12.853452 pollercontroller.go:103: CCCPPOLL: Failed to retrieve config from any node.
    GOCB 20:46:13.040395 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:13.040617 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:13.040701 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:14.041882 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:14.042006 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:14.042067 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:15.042509 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:15.042774 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:15.042830 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:16.043225 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:16.043335 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:16.043417 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:17.043881 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:17.043980 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:17.044035 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    GOCB 20:46:18.044680 ???:0: Bootstrap error found before config seen:
    GOCB 20:46:18.044759 ???:0: No config seen yet in kv muxer but no errors found.
    GOCB 20:46:18.044796 asm_amd64.s:1594: Will retry request. Backoff=1s, OperationID=waituntilready. Reason=NOT_READY
    2022/10/07 20:46:18 unambiguous timeout | {“InnerError”:{“InnerError”:{“InnerError”:{},“Message”:“unambiguous timeout”}},“OperationID”:“WaitUntilReady”,“Opaque”:“”,“TimeObserved”:25000081728,“RetryReasons”:[“NOT_READY”],“RetryAttempts”:30,“LastDispatchedTo”:“”,“LastDispatchedFrom”:“”,“LastConnectionID”:“”}

GOCB 20:45:53.347642 kvmux.go:692: Failed to connect. check server ports and cluster

Check that your client has the correct information to connect to the server and that the necessary connectivity exists (i.e. port mapping).

Hi @mreiche , thanks for the quick reply. The connection string is localhost:5984. And I have tried with directly installing couchdb on macos, still didn’t work

The connection string is localhost:5984.

I would suggest to start out using the default ports for couchbase. Then the connection string need only specify the hostname.

If you must use non-default ports, then you need to get familiar with which port does what - Couchbase Server Ports | Couchbase Docs

The connection string needs to specify the memcached port (default 11210), as it uses kv to fetch the cluster configuration.

Are you able to connect with SDK Doctor? SDK Doctor | Couchbase Docs. (note that on MacOs you’ll need to give permissions to allow it to execute).

Hi @26tanishabanik just to further what @mreiche has commented a little. Are you trying to connect to couchdb or couchbase here? In your last comment you referenced couchdb and port 5984 is a default port for couchdb too. The Go SDK will only work against Couchbase.

1 Like

You can get the free Couchbase CE from Getting Started with Couchbase Server Community Edition (CE) | Couchbase Docs