Open Bucket Slow Or Timesout from Local but not on Production

jon.bick · August 15, 2022, 11:53am

Hi,

I am connecting an Azure hosted Couch Base server on Couchbase Server Community Edition 7.0.2 build 6703.

The code that I’m running is using CouchBaseNetClient 2.7.27.

We used CastleWindsor to create an instance of the ClusterHelper at application start. The code then calls a method to get the users cache everytime a page is loaded.

IBucket bucket = ClusterHelper.GetBucket(“default”);

The above method “GetBucket” is taking over a minute locally and then timing out. A second load will usually load instantly. This doesn’t happen in the production environment. As you can imagine this is making debugging locally very painful and I’m wondering if there is a reason why it is taking over a minute to GetBucket?

Thanks

btburnett3 · August 15, 2022, 12:21pm

First, I’d point out that SDK 2.x is no longer supported and isn’t receiving updates. I’d recommend moving to 3.x as soon as possible.

The most likely cause for your problem is initial bootstrapping. SDK 2.x doesn’t bootstrap the connections until the first call to GetBucket, so this is when it’s initially making connections, negotiating auth, etc. The most likely cause for bootstrapping issues like you describe would be networking related, either not all ports are open that should be or host names/ips are not resolving correctly when connecting remotely.

You may try turning on debug level logging to get more information.

jon.bick · August 15, 2022, 2:14pm

Thanks for the info. I’ve used the Getting Started with the .NET SDK section and setup a little console app to test with. I get the same behaviour when connecting to the ClusterAsync.

Is there some logging I can turn on in Couchbase as the current logs look bare.

btburnett3 · August 15, 2022, 2:23pm

The answer to the logging question, unfortunately, is “it depends”. The instructions are somewhat different in SDK 2.x .NET 4, SDK 2.x .NET Core, and SDK 3.x.

It sounds like you might be trying SDK 3.x now, so the trick there is to just add a ILoggerFactory to the ClusterOptions from the standard Microsoft.Extensions.Logging infrastructure. If you use Couchbase.Extensions.DependencyInjection this is done automatically, but you’ll need to configure logging on the DI container.

Here’s a bit of a down-and-dirty example you can use for a quick test command line app: couchbase-net-client/ClusterFixture.cs at master · couchbase/couchbase-net-client · GitHub

jon.bick · August 15, 2022, 3:02pm

Hi again,

I’m not sure logging in the application is going to tell me much. The problem is the code doesn’t get to bucket because the ConnectAsync times out. Sometimes when it gets through it works instantly and I can get the bucket.

var cluster = await Cluster.ConnectAsync(
// Update these credentials for your Local Couchbase instance!
“http://server”, “login”, “pass”);

await cluster.WaitUntilReadyAsync(new TimeSpan(0, 5, 0));

var bucket = await cluster.BucketAsync(“default”);

btburnett3 · August 15, 2022, 3:08pm

@jon.bick

The instructions I sent above link the application logging infrastructure into the Couchbase SDK so that you receive SDK logs as well. Setting it to the Debug log level will get you lots of details.

jon.bick · August 15, 2022, 3:13pm

2022-08-15T16:11:26.6990241+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:11:26.7303125+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:8091” (b4d836a6)
2022-08-15T16:11:26.7501000+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:11:26.8297319+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:26.8297375+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:26.8653116+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:26.8653116+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:26.8955232+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/1aeb85261a9b97eb","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 3. (ebdc59ba)
2022-08-15T16:11:26.8955232+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/d912484273b40088","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 4. (ebdc59ba)
2022-08-15T16:11:29.2115221+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:11:29.2121082+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:11:29.4043079+01:00 [INF] Closing connection 15641643906057371784 (f327a384)
2022-08-15T16:11:29.4043081+01:00 [INF] Closing connection 1939790463214786539 (f327a384)
2022-08-15T16:11:29.4148302+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:8091” has failed. (2cc4f355)
System.OperationCanceledException: The operation was canceled.
at Couchbase.Core.IO.Operations.OperationBase.GetResult(Int16 token)
at Couchbase.Core.ClusterNode.ExecuteOp(Func4 sender, IOperation op, Object state, CancellationTokenPair tokenPair) at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken) at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken) at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken) at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<<AddConnectionsAsync>g__StartConnection|0>d.MoveNext() --- End of stack trace from previous location --- at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken) at Couchbase.Core.ClusterNode.InitializeAsync() at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken) at Couchbase.Core.ClusterContext.BootstrapGlobalAsync() 2022-08-15T16:11:29.4386482+01:00 [DBG] Error encountered bootstrapping cluster; if the cluster is 6.5 or earlier, this can be ignored. "System.AggregateException: Bootstrapping has failed! (The operation was canceled.) ---> System.OperationCanceledException: The operation was canceled. at Couchbase.Core.IO.Operations.OperationBase.GetResult(Int16 token) at Couchbase.Core.ClusterNode.ExecuteOp(Func4 sender, IOperation op, Object state, CancellationTokenPair tokenPair)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
— End of inner exception stack trace —
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
at Couchbase.Cluster.Couchbase.Core.Bootstrapping.IBootstrappable.BootStrapAsync()". (ba6fd600)
2022-08-15T16:11:29.4424572+01:00 [DBG] The subject is not bootstrapped. (00d9dd49)
2022-08-15T16:11:29.4425021+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:8091” (b4d836a6)
2022-08-15T16:11:29.4427594+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:11:29.4522074+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:8091” (b4d836a6)
2022-08-15T16:11:29.4523968+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:11:29.4693910+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:29.4698053+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:29.4700343+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/546fa0e507a7ed45","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 6. (ebdc59ba)
2022-08-15T16:11:29.4763216+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:29.4764373+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:29.4767571+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/8bfae15e713ccacb","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 8. (ebdc59ba)
2022-08-15T16:11:29.4843582+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:29.4843489+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:29.4851876+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:29.4852687+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:29.4856954+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/855c53d7b59dda87","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 11. (ebdc59ba)
2022-08-15T16:11:29.4857003+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/658e66068ea16b20","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 12. (ebdc59ba)
2022-08-15T16:11:31.7220647+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:11:31.7221906+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:11:31.9988046+01:00 [INF] Closing connection 10086622111192632011 (f327a384)
2022-08-15T16:11:31.9988311+01:00 [INF] Closing connection 6084258527137230149 (f327a384)
2022-08-15T16:11:31.9988304+01:00 [INF] Closing connection 9609647890831891079 (f327a384)
2022-08-15T16:11:32.0007748+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:8091” has failed. (2cc4f355)
Couchbase.Core.Exceptions.UnambiguousTimeoutException: The operation 6/{“i”:“53ff90a205b0ba15/546fa0e507a7ed45”,“a”:“couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)”} timed out after 00:00:02.5274136. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.
at Couchbase.Utils.ThrowHelper.ThrowTimeoutException(IOperation operation, IErrorContext context)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
-----------------------Context Info---------------------------

2022-08-15T16:11:32.0015639+01:00 [DBG] KV Operation timeout for op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/658e66068ea16b20","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 12. Is orphaned: True (44ed321d)
2022-08-15T16:11:32.0017058+01:00 [DBG] Error encountered bootstrapping cluster; if the cluster is 6.5 or earlier, this can be ignored. "System.AggregateException: Bootstrapping has failed! (The operation 6/{"i":"53ff90a205b0ba15/546fa0e507a7ed45","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"} timed out after 00:00:02.5274136. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.)
—> Couchbase.Core.Exceptions.UnambiguousTimeoutException: The operation 6/{"i":"53ff90a205b0ba15/546fa0e507a7ed45","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"} timed out after 00:00:02.5274136. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.
at Couchbase.Utils.ThrowHelper.ThrowTimeoutException(IOperation operation, IErrorContext context)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
-----------------------Context Info---------------------------

— End of inner exception stack trace —
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
at Couchbase.Cluster.Couchbase.Core.Bootstrapping.IBootstrappable.BootStrapAsync()“. (ba6fd600)
2022-08-15T16:11:32.0032168+01:00 [DBG] The subject has successfully bootstrapped. (cd604aa2)
2022-08-15T16:11:32.0034396+01:00 [INF] Closing connection 7317898622872415008 (f327a384)
2022-08-15T16:11:32.0068728+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:8091” has failed. (2cc4f355)
Couchbase.Core.Exceptions.UnambiguousTimeoutException: The operation 12/{“i”:“53ff90a205b0ba15/658e66068ea16b20”,“a”:“couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)”} timed out after 00:00:02.5172551. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.
at Couchbase.Utils.ThrowHelper.ThrowTimeoutException(IOperation operation, IErrorContext context)
at Couchbase.Core.ClusterNode.ExecuteOp(Func`4 sender, IOperation op, Object state, CancellationTokenPair tokenPair)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
-----------------------Context Info---------------------------
{“dispatchedFrom”:“ip-redacted”,“dispatchedTo”:“192.168.8.10”,“documentKey”:”{\u0022i\u0022:\u002253ff90a205b0ba15/658e66068ea16b20\u0022,\u0022a\u0022:\u0022couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)\u0022}",“clientContextId”:“12”,“cas”:0,“status”:“success”,“bucketName”:null,“collectionName”:null,“scopeName”:null,“message”:null,“opCode”:“helo”,“retryReasons”:}

2022-08-15T16:11:32.0478539+01:00 [DBG] Error encountered bootstrapping cluster; if the cluster is 6.5 or earlier, this can be ignored. "System.AggregateException: Bootstrapping has failed! (The operation 12/{"i":"53ff90a205b0ba15/658e66068ea16b20","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"} timed out after 00:00:02.5172551. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.)
—> Couchbase.Core.Exceptions.UnambiguousTimeoutException: The operation 12/{"i":"53ff90a205b0ba15/658e66068ea16b20","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"} timed out after 00:00:02.5172551. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.
at Couchbase.Utils.ThrowHelper.ThrowTimeoutException(IOperation operation, IErrorContext context)
at Couchbase.Core.ClusterNode.ExecuteOp(Func`4 sender, IOperation op, Object state, CancellationTokenPair tokenPair)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
-----------------------Context Info---------------------------
{"dispatchedFrom":"ip-redacted","dispatchedTo":"192.168.8.10","documentKey":"{\u0022i\u0022:\u002253ff90a205b0ba15/658e66068ea16b20\u0022,\u0022a\u0022:\u0022couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)\u0022}","clientContextId":"12","cas":0,"status":"success","bucketName":null,"collectionName":null,"scopeName":null,"message":null,"opCode":"helo","retryReasons":}

— End of inner exception stack trace —
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
at Couchbase.Cluster.Couchbase.Core.Bootstrapping.IBootstrappable.BootStrapAsync()". (ba6fd600)
2022-08-15T16:11:32.1561463+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:8091” (b4d836a6)
2022-08-15T16:11:32.1564711+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:11:32.1834791+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:32.1841733+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:32.1842408+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/b690c91b99098002","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 14. (ebdc59ba)
2022-08-15T16:11:32.1856194+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:32.1856732+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:32.1858762+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/eff1a99e40fd1962","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 16. (ebdc59ba)
2022-08-15T16:11:34.2239871+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:11:34.2240419+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:11:34.5161270+01:00 [DBG] The subject is not bootstrapped. (00d9dd49)
2022-08-15T16:11:34.5161857+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:8091” (b4d836a6)
2022-08-15T16:11:34.5165611+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:11:34.5455297+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:34.5456739+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:34.5461997+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/b1ee12887f01a26d","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 18. (ebdc59ba)
2022-08-15T16:11:34.5497234+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:11:34.5498216+01:00 [DBG] Starting connection initialization on server “server-redacted:8091”. (5c5836f0)
2022-08-15T16:11:34.5499850+01:00 [DBG] Executing op Helo on “server-redacted:8091” with key “{"i":"53ff90a205b0ba15/93cbacb9d340ec31","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 20. (ebdc59ba)
2022-08-15T16:11:34.7023647+01:00 [INF] Closing connection 17289786941612300642 (f327a384)
2022-08-15T16:11:34.7023647+01:00 [INF] Closing connection 13155235631918055426 (f327a384)
2022-08-15T16:11:34.7041452+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:8091” has failed. (2cc4f355)
Couchbase.Core.Exceptions.UnambiguousTimeoutException: The operation 14/{“i”:“53ff90a205b0ba15/b690c91b99098002”,“a”:“couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)”} timed out after 00:00:02.5173820. It was retried 0 times using Couchbase.Core.Retry.BestEffortRetryStrategy.
at Couchbase.Utils.ThrowHelper.ThrowTimeoutException(IOperation operation, IErrorContext context)
at Couchbase.Core.ClusterNode.Hello(IConnection connection, IRequestSpan span, CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.Couchbase.Core.IO.Connections.IConnectionInitializer.InitializeConnectionAsync(IConnection connection, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
-----------------------Context Info---------------------------

jon.bick · August 15, 2022, 3:27pm

Hoping there is some useful information in there. The operation has timed out or was cancelled errors don’t tell me anything.

btburnett3 · August 15, 2022, 3:28pm

Ahh, try using “couchbase://” instead of “http://” in your connection string, “http://” is old school.

jon.bick · August 15, 2022, 3:30pm

Sadly its producing the same errors.

jon.bick · August 15, 2022, 3:33pm

Interesting, If i take the port number off the end of the connection string it attempts to poll alot and then complain about DNS and attempts to access on port 11210.

btburnett3 · August 15, 2022, 3:38pm

Modern couchbase should bootstrap on port 11210 using GCCCP (or pre-6.5 CCCP), or on port 11207 if using TLS for encryption. HTTP bootstrap on port 8091 is the old method which is less efficient. Can you get me the updated logs now that you’re using “couchbase://”? Note: If using TLS it should be “couchbases://”

jon.bick · August 15, 2022, 3:43pm

So this is without specifying a port number.

2022-08-15T16:41:20.5244150+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:23.0337757+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:23.0343136+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:25.5355344+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:25.5356252+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:28.0432924+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:28.0433413+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:30.5461269+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:30.5461651+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:33.0466688+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:33.0467033+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:35.5659136+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:35.5659947+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:38.0769442+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:38.0769929+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:40.5818180+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:40.5818798+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:43.1044565+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:43.1045785+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:45.6183153+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:45.6183475+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:48.1251826+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:48.1252493+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:50.6379405+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:50.6379912+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:50.7096952+01:00 [INF] There was an error attempting to resolve hosts using DNS-SRV - “Non-Existent Domain” (9daf8ee2)
2022-08-15T16:41:50.7172377+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:11210” (b4d836a6)
2022-08-15T16:41:50.7312895+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:41:53.1634102+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:53.1634613+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:55.6799811+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:55.6800374+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:41:58.1850257+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:41:58.1850762+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:00.6880977+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:00.6882028+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:00.7756229+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:11210” has failed. (2cc4f355)
System.Net.Sockets.SocketException (10060): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
at Couchbase.Core.IO.Connections.ConnectionFactory.CreateAndConnectAsync(HostEndpointWithPort hostEndpoint, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
2022-08-15T16:42:00.7944446+01:00 [DBG] Error encountered bootstrapping cluster; if the cluster is 6.5 or earlier, this can be ignored. “System.AggregateException: Bootstrapping has failed! (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
—> System.Net.Sockets.SocketException (10060): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
at Couchbase.Core.IO.Connections.ConnectionFactory.CreateAndConnectAsync(HostEndpointWithPort hostEndpoint, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
— End of inner exception stack trace —
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
at Couchbase.Cluster.Couchbase.Core.Bootstrapping.IBootstrappable.BootStrapAsync()”. (ba6fd600)
2022-08-15T16:42:00.7979360+01:00 [DBG] The subject is not bootstrapped. (00d9dd49)
2022-08-15T16:42:03.2064178+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:03.2064595+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:05.7222240+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:05.7222767+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:08.2443365+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:08.2443969+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:10.7611441+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:10.7612394+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:13.2658078+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:13.2658527+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:15.7717814+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:15.7718251+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:18.2880273+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:18.2881080+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:20.8020198+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:20.8020661+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:23.3122538+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:23.3123716+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:25.8274922+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:25.8275420+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:28.3370068+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:28.3370546+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:30.8412347+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:30.8412724+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:30.8912532+01:00 [INF] Error trying to retrieve DNS SRV entries. (addddf06)
DnsClient.DnsResponseException: Query 52641 => _couchbase._tcp.server-redacted IN SRV on 194.168.8.100:53 timed out or is a transient error.
—> System.OperationCanceledException: The operation was canceled.
at System.Threading.Tasks.TaskExtensions.WithCancellation[T](Task1 task, CancellationToken cancellationToken, Action onCancel) at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken)
— End of inner exception stack trace —
at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken) at DnsClient.LookupClient.QueryInternalAsync(DnsQuestion question, DnsQuerySettings queryOptions, IReadOnlyCollection1 servers, CancellationToken cancellationToken)
at Couchbase.DnsClientDnsResolver.GetDnsSrvEntriesAsync(Uri bootstrapUri, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
2022-08-15T16:42:30.8913069+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:11210” (b4d836a6)
2022-08-15T16:42:30.8915592+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:42:30.9050620+01:00 [INF] Error trying to retrieve DNS SRV entries. (addddf06)
DnsClient.DnsResponseException: Query 24513 => _couchbase._tcp.server-redacted IN SRV on 194.168.4.100:53 timed out or is a transient error.
—> System.OperationCanceledException: The operation was canceled.
at System.Threading.Tasks.TaskExtensions.WithCancellation[T](Task1 task, CancellationToken cancellationToken, Action onCancel) at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken)
— End of inner exception stack trace —
at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken) at DnsClient.LookupClient.QueryInternalAsync(DnsQuestion question, DnsQuerySettings queryOptions, IReadOnlyCollection1 servers, CancellationToken cancellationToken)
at Couchbase.DnsClientDnsResolver.GetDnsSrvEntriesAsync(Uri bootstrapUri, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
2022-08-15T16:42:30.9051017+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:11210” (b4d836a6)
2022-08-15T16:42:30.9053386+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:42:33.3422632+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:33.3423144+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:42:35.8483601+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:42:35.8484443+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)

jon.bick · August 15, 2022, 3:46pm

If I go direct to Node1 without a port number I connect after about 30 seconds.

2022-08-15T16:44:15.9535836+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:18.4763990+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:18.4770200+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:20.9914280+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:20.9914868+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:23.4977968+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:23.4978598+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:26.0095842+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:26.0096377+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:28.5173193+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:28.5173729+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:31.0185664+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:31.0186510+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:33.5237682+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:33.5238115+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:36.0359721+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:36.0360137+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:38.5505527+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:38.5506066+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:41.0649637+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:41.0650311+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:43.5703495+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:43.5704099+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:46.0737998+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-15T16:44:46.0738505+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-15T16:44:46.1551931+01:00 [INF] Error trying to retrieve DNS SRV entries. (addddf06)
DnsClient.DnsResponseException: Query 39550 => _couchbase._tcp.192.168.8.11 IN SRV on 194.168.4.100:53 timed out or is a transient error.
—> System.OperationCanceledException: The operation was canceled.
at System.Threading.Tasks.TaskExtensions.WithCancellation[T](Task1 task, CancellationToken cancellationToken, Action onCancel) at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken)
— End of inner exception stack trace —
at DnsClient.LookupClient.ResolveQueryAsync(IReadOnlyList1 servers, DnsQuerySettings settings, DnsMessageHandler handler, DnsRequestMessage request, LookupClientAudit audit, CancellationToken cancellationToken) at DnsClient.LookupClient.QueryInternalAsync(DnsQuestion question, DnsQuerySettings queryOptions, IReadOnlyCollection1 servers, CancellationToken cancellationToken)
at Couchbase.DnsClientDnsResolver.GetDnsSrvEntriesAsync(Uri bootstrapUri, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
2022-08-15T16:44:46.1719035+01:00 [DBG] Bootstrapping: global bootstrapping with node “192.168.8.11:11210” (b4d836a6)
2022-08-15T16:44:46.1863456+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:44:46.2376689+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.2377073+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.2683663+01:00 [DBG] Starting connection initialization on server “192.168.8.11:11210”. (5c5836f0)
2022-08-15T16:44:46.2683663+01:00 [DBG] Starting connection initialization on server “192.168.8.11:11210”. (5c5836f0)
2022-08-15T16:44:46.2921335+01:00 [DBG] Executing op Helo on “192.168.8.11:11210” with key “{"i":"8e5253052fa5a782/a61a292319669b4b","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 4. (ebdc59ba)
2022-08-15T16:44:46.2921336+01:00 [DBG] Executing op Helo on “192.168.8.11:11210” with key “{"i":"8e5253052fa5a782/39f6cff399bd4d1e","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 3. (ebdc59ba)
2022-08-15T16:44:46.3461396+01:00 [DBG] Completed executing op Helo on “192.168.8.11:11210” with key “{"i":"8e5253052fa5a782/a61a292319669b4b","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 4 (88e8675d)
2022-08-15T16:44:46.3461343+01:00 [DBG] Completed executing op Helo on “192.168.8.11:11210” with key “{"i":"8e5253052fa5a782/39f6cff399bd4d1e","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 3 (88e8675d)
2022-08-15T16:44:46.3515487+01:00 [DBG] Executing op GetErrorMap on “192.168.8.11:11210” with key “” and opaque 7. (ebdc59ba)
2022-08-15T16:44:46.3515484+01:00 [DBG] Executing op GetErrorMap on “192.168.8.11:11210” with key “” and opaque 8. (ebdc59ba)
2022-08-15T16:44:46.4060119+01:00 [DBG] Completed executing op GetErrorMap on “192.168.8.11:11210” with key “” and opaque 8 (88e8675d)
2022-08-15T16:44:46.4264211+01:00 [DBG] Completed executing op GetErrorMap on “192.168.8.11:11210” with key “” and opaque 7 (88e8675d)
2022-08-15T16:44:46.5366208+01:00 [INF] v=HYDsPoWo8MhjT9xsw/Tu0GzPCLY= (4189fbca)
2022-08-15T16:44:46.5366208+01:00 [INF] v=p935izGOJst2Lm6kfqj4XcVNk1I= (bfc09245)
2022-08-15T16:44:46.5385802+01:00 [DBG] Connection for “192.168.8.11:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.5385803+01:00 [DBG] Connection for “192.168.8.11:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.5404935+01:00 [DBG] Starting connection pool monitor on “192.168.8.11:11210”, idle timeout 00:01:00, back pressure threshold 8 (41924b22)
2022-08-15T16:44:46.5405290+01:00 [DBG] Connection pool for “192.168.8.11:11210” initialized with 2 connections. (ee89feb4)
2022-08-15T16:44:46.5439900+01:00 [DBG] Executing op GetClusterConfig on “192.168.8.11:11210” with key “” and opaque 14. (ebdc59ba)
2022-08-15T16:44:46.5765652+01:00 [DBG] Completed executing op GetClusterConfig on “192.168.8.11:11210” with key “” and opaque 14 (88e8675d)
2022-08-15T16:44:46.6166469+01:00 [INF] NetworkResolution [default] using default Node1-Redacted (7aa977a0)
2022-08-15T16:44:46.6166874+01:00 [INF] Bootstrapping: initializing a global non-bootstrap node [“Node1-Redacted:11210”] (52960c82)
2022-08-15T16:44:46.6171347+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:44:46.6585333+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.6590157+01:00 [DBG] Starting connection initialization on server “Node1-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:46.6592039+01:00 [DBG] Executing op Helo on “Node1-Redacted:11210” with key “{"i":"8e5253052fa5a782/69a835ce536f41a2","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 16. (ebdc59ba)
2022-08-15T16:44:46.6602784+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.6603353+01:00 [DBG] Starting connection initialization on server “Node1-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:46.6604297+01:00 [DBG] Executing op Helo on “Node1-Redacted:11210” with key “{"i":"8e5253052fa5a782/70b091d16b687bc7","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 18. (ebdc59ba)
2022-08-15T16:44:46.6869058+01:00 [DBG] Completed executing op Helo on “Node1-Redacted:11210” with key “{"i":"8e5253052fa5a782/69a835ce536f41a2","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 16 (88e8675d)
2022-08-15T16:44:46.6869693+01:00 [DBG] Executing op GetErrorMap on “Node1-Redacted:11210” with key “” and opaque 20. (ebdc59ba)
2022-08-15T16:44:46.6884862+01:00 [DBG] Completed executing op Helo on “Node1-Redacted:11210” with key “{"i":"8e5253052fa5a782/70b091d16b687bc7","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 18 (88e8675d)
2022-08-15T16:44:46.6886167+01:00 [DBG] Executing op GetErrorMap on “Node1-Redacted:11210” with key “” and opaque 22. (ebdc59ba)
2022-08-15T16:44:46.7416949+01:00 [DBG] Completed executing op GetErrorMap on “Node1-Redacted:11210” with key “” and opaque 20 (88e8675d)
2022-08-15T16:44:46.7636543+01:00 [DBG] Completed executing op GetErrorMap on “Node1-Redacted:11210” with key “” and opaque 22 (88e8675d)
2022-08-15T16:44:46.7908531+01:00 [INF] v=H7x6VbPFo9WkMImjIpo9qyh0mVM= (c944e243)
2022-08-15T16:44:46.7908996+01:00 [DBG] Connection for “Node1-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.8207798+01:00 [INF] v=/Ac3cNddNLSRqb4Bs8lc6Qg7jxU= (0b3274f9)
2022-08-15T16:44:46.8208192+01:00 [DBG] Connection for “Node1-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.8209513+01:00 [DBG] Starting connection pool monitor on “Node1-Redacted:11210”, idle timeout 00:01:00, back pressure threshold 8 (41924b22)
2022-08-15T16:44:46.8209800+01:00 [DBG] Connection pool for “Node1-Redacted:11210” initialized with 2 connections. (ee89feb4)
2022-08-15T16:44:46.8228129+01:00 [DBG] Adding node “Node1-Redacted:11210” to . (c16a5c9c)
2022-08-15T16:44:46.8256441+01:00 [DBG] Added node “Node1-Redacted:11210” to [“Node1-Redacted:11210-ffee6b37-1606-4a4d-9035-c963e1026c73”] (376de9ab)
2022-08-15T16:44:46.8256637+01:00 [INF] NetworkResolution [default] using default Node2-Redacted (b71c5f99)
2022-08-15T16:44:46.8256709+01:00 [INF] Bootstrapping: initializing a global non-bootstrap node [“Node2-Redacted:11210”] (52960c82)
2022-08-15T16:44:46.8258993+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:44:46.8548318+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.8549658+01:00 [DBG] Starting connection initialization on server “Node2-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:46.8552075+01:00 [DBG] Executing op Helo on “Node2-Redacted:11210” with key “{"i":"8e5253052fa5a782/2ce7e1c993566d9d","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 28. (ebdc59ba)
2022-08-15T16:44:46.8588110+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:46.8589464+01:00 [DBG] Starting connection initialization on server “Node2-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:46.8590623+01:00 [DBG] Executing op Helo on “Node2-Redacted:11210” with key “{"i":"8e5253052fa5a782/05fcfc4abdd28253","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 30. (ebdc59ba)
2022-08-15T16:44:46.8785367+01:00 [DBG] Completed executing op Helo on “Node2-Redacted:11210” with key “{"i":"8e5253052fa5a782/2ce7e1c993566d9d","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 28 (88e8675d)
2022-08-15T16:44:46.8786030+01:00 [DBG] Executing op GetErrorMap on “Node2-Redacted:11210” with key “” and opaque 32. (ebdc59ba)
2022-08-15T16:44:46.8833159+01:00 [DBG] Completed executing op Helo on “Node2-Redacted:11210” with key “{"i":"8e5253052fa5a782/05fcfc4abdd28253","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 30 (88e8675d)
2022-08-15T16:44:46.8833680+01:00 [DBG] Executing op GetErrorMap on “Node2-Redacted:11210” with key “” and opaque 34. (ebdc59ba)
2022-08-15T16:44:46.9347289+01:00 [DBG] Completed executing op GetErrorMap on “Node2-Redacted:11210” with key “” and opaque 32 (88e8675d)
2022-08-15T16:44:46.9347297+01:00 [DBG] Completed executing op GetErrorMap on “Node2-Redacted:11210” with key “” and opaque 34 (88e8675d)
2022-08-15T16:44:46.9919823+01:00 [INF] v=nrcK6EVXcfYP99odL8cAr876I8c= (7f2e8c9a)
2022-08-15T16:44:46.9920516+01:00 [DBG] Connection for “Node2-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.9938022+01:00 [INF] v=uBbQymJr/RFDBHNfqF6f+688tIk= (07a30297)
2022-08-15T16:44:46.9938358+01:00 [DBG] Connection for “Node2-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:46.9938670+01:00 [DBG] Starting connection pool monitor on “Node2-Redacted:11210”, idle timeout 00:01:00, back pressure threshold 8 (41924b22)
2022-08-15T16:44:46.9940674+01:00 [DBG] Connection pool for “Node2-Redacted:11210” initialized with 2 connections. (ee89feb4)
2022-08-15T16:44:46.9941227+01:00 [DBG] Adding node “Node2-Redacted:11210” to [“Node1-Redacted:11210-ffee6b37-1606-4a4d-9035-c963e1026c73”]. (c16a5c9c)
2022-08-15T16:44:46.9941522+01:00 [DBG] Added node “Node2-Redacted:11210” to [“Node1-Redacted:11210-ffee6b37-1606-4a4d-9035-c963e1026c73”, “Node2-Redacted:11210-c409ae82-eee1-4af8-8e0b-bd6d74d55143”] (376de9ab)
2022-08-15T16:44:46.9941563+01:00 [INF] NetworkResolution [default] using default Node3-Redacted (157fc357)
2022-08-15T16:44:46.9941608+01:00 [INF] Bootstrapping: initializing a global non-bootstrap node [“Node3-Redacted:11210”] (52960c82)
2022-08-15T16:44:46.9943996+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-15T16:44:47.0236597+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:47.0236701+01:00 [DBG] Setting TCP Keep-Alives using SocketOptions - enable keep-alives True, time 00:01:00, interval 00:00:01. (d66a37aa)
2022-08-15T16:44:47.0238172+01:00 [DBG] Starting connection initialization on server “Node3-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:47.0238202+01:00 [DBG] Starting connection initialization on server “Node3-Redacted:11210”. (5c5836f0)
2022-08-15T16:44:47.0241112+01:00 [DBG] Executing op Helo on “Node3-Redacted:11210” with key “{"i":"8e5253052fa5a782/1194e0e4c35bd02d","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 41. (ebdc59ba)
2022-08-15T16:44:47.0241989+01:00 [DBG] Executing op Helo on “Node3-Redacted:11210” with key “{"i":"8e5253052fa5a782/384067857b298a98","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 42. (ebdc59ba)
2022-08-15T16:44:47.0514413+01:00 [DBG] Completed executing op Helo on “Node3-Redacted:11210” with key “{"i":"8e5253052fa5a782/384067857b298a98","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 42 (88e8675d)
2022-08-15T16:44:47.0514417+01:00 [DBG] Completed executing op Helo on “Node3-Redacted:11210” with key “{"i":"8e5253052fa5a782/1194e0e4c35bd02d","a":"couchbase-net-sdk/3.3.4.0 (clr/.NET 6.0.6) (os/Microsoft Windows 10.0.22000)"}” and opaque 41 (88e8675d)
2022-08-15T16:44:47.0516271+01:00 [DBG] Executing op GetErrorMap on “Node3-Redacted:11210” with key “” and opaque 46. (ebdc59ba)
2022-08-15T16:44:47.0516308+01:00 [DBG] Executing op GetErrorMap on “Node3-Redacted:11210” with key “” and opaque 44. (ebdc59ba)
2022-08-15T16:44:47.1305954+01:00 [DBG] Completed executing op GetErrorMap on “Node3-Redacted:11210” with key “” and opaque 46 (88e8675d)
2022-08-15T16:44:47.1345028+01:00 [DBG] Completed executing op GetErrorMap on “Node3-Redacted:11210” with key “” and opaque 44 (88e8675d)
2022-08-15T16:44:47.2781669+01:00 [INF] v=yQ7baXlsD9o7BxRtkCatlfFGitc= (5cea4a44)
2022-08-15T16:44:47.2781670+01:00 [INF] v=sBxxiLkFm82wwm6Dc5sTy1AUzmc= (321e4cac)
2022-08-15T16:44:47.2782236+01:00 [DBG] Connection for “Node3-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:47.2782224+01:00 [DBG] Connection for “Node3-Redacted:11210” has been started. (5fb0d9b0)
2022-08-15T16:44:47.2782639+01:00 [DBG] Starting connection pool monitor on “Node3-Redacted:11210”, idle timeout 00:01:00, back pressure threshold 8 (41924b22)
2022-08-15T16:44:47.2783513+01:00 [DBG] Connection pool for “Node3-Redacted:11210” initialized with 2 connections. (ee89feb4)
2022-08-15T16:44:47.2784508+01:00 [DBG] Adding node “Node3-Redacted:11210” to [“Node1-Redacted:11210-ffee6b37-1606-4a4d-9035-c963e1026c73”, “Node2-Redacted:11210-c409ae82-eee1-4af8-8e0b-bd6d74d55143”]. (c16a5c9c)
2022-08-15T16:44:47.2785461+01:00 [DBG] Added node “Node3-Redacted:11210” to [“Node1-Redacted:11210-ffee6b37-1606-4a4d-9035-c963e1026c73”, “Node2-Redacted:11210-c409ae82-eee1-4af8-8e0b-bd6d74d55143”, “Node3-Redacted:11210-0848af35-78c3-4981-91b5-996f0528cf7f”] (376de9ab)
2022-08-15T16:44:47.2897400+01:00 [INF] Enabling Enhanced Prepared Statements (716ef045)
2022-08-15T16:44:47.3100389+01:00 [DBG] Executing op NoOp on “Node1-Redacted:11210” with key “” and opaque 51. (ebdc59ba)
2022-08-15T16:44:47.3320805+01:00 [DBG] Completed executing op NoOp on “Node1-Redacted:11210” with key “” and opaque 51 (88e8675d)
2022-08-15T16:44:47.3343016+01:00 [DBG] Executing op NoOp on “Node1-Redacted:11210” with key “” and opaque 52. (ebdc59ba)
2022-08-15T16:44:47.3612769+01:00 [DBG] Completed executing op NoOp on “Node1-Redacted:11210” with key “” and opaque 52 (88e8675d)
2022-08-15T16:44:47.4470694+01:00 [DBG] Sending query “8ed359ac-5d6e-4dcb-959a-34bd2ba8d0c1” to node http://Node1-Redacted:8093/query. (29668c0a)
2022-08-15T16:44:47.7050901+01:00 [DBG] Request 8ed359ac-5d6e-4dcb-959a-34bd2ba8d0c1 has succeeded. (2b15c5dd)
2022-08-15T16:44:47.7247298+01:00 [DBG] Sending FTS query with a context id null to server http://Node3-Redacted:8094/ (2fe93dcb)
2022-08-15T16:44:47.8111374+01:00 [DBG] Executing op NoOp on “Node2-Redacted:11210” with key “” and opaque 53. (ebdc59ba)
2022-08-15T16:44:47.9806502+01:00 [DBG] Completed executing op NoOp on “Node2-Redacted:11210” with key “” and opaque 53 (88e8675d)
2022-08-15T16:44:47.9807217+01:00 [DBG] Executing op NoOp on “Node2-Redacted:11210” with key “” and opaque 54. (ebdc59ba)
2022-08-15T16:44:48.0049499+01:00 [DBG] Completed executing op NoOp on “Node2-Redacted:11210” with key “” and opaque 54 (88e8675d)
2022-08-15T16:44:48.0052306+01:00 [DBG] Sending query “9ac8501c-2dde-4287-a9ab-07b74d9fbbe2” to node http://Node1-Redacted:8093/query. (29668c0a)
2022-08-15T16:44:48.0356837+01:00 [DBG] Request 9ac8501c-2dde-4287-a9ab-07b74d9fbbe2 has succeeded. (61ac60dc)
2022-08-15T16:44:48.0358288+01:00 [DBG] Sending FTS query with a context id null to server http://Node3-Redacted:8094/ (2fe93dcb)
2022-08-15T16:44:48.0695331+01:00 [DBG] Executing op NoOp on “Node3-Redacted:11210” with key “” and opaque 55. (ebdc59ba)
2022-08-15T16:44:48.1063687+01:00 [DBG] Completed executing op NoOp on “Node3-Redacted:11210” with key “” and opaque 55 (88e8675d)
2022-08-15T16:44:48.1064269+01:00 [DBG] Executing op NoOp on “Node3-Redacted:11210” with key “” and opaque 56. (ebdc59ba)
2022-08-15T16:44:48.1348268+01:00 [DBG] Completed executing op NoOp on “Node3-Redacted:11210” with key “” and opaque 56 (88e8675d)
2022-08-15T16:44:48.1349921+01:00 [DBG] Sending query “aa0fff72-7401-4739-a367-f3fcd90a19c3” to node http://Node2-Redacted:8093/query. (29668c0a)
2022-08-15T16:44:48.1918946+01:00 [DBG] Request aa0fff72-7401-4739-a367-f3fcd90a19c3 has succeeded. (b183ebf0)
2022-08-15T16:44:48.1920418+01:00 [DBG] Sending FTS query with a context id null to server http://Node2-Redacted:8094/ (2fe93dcb)

mreiche · August 15, 2022, 4:22pm

There might be some useful diagnostics in the error messages or logging. See the doc for information on logging.

It sounds like you don’t have an SRV record for your local server in you DNS (which is normal).

btburnett3 · August 15, 2022, 4:37pm

Yes, the error for DNS SRV is normal, it’s just a warning in case you are trying to use DNS SRV to bootstrap instead of giving a list of nodes manually.

That said, I think it may be causing your problem. It’s not 100% clear from the logs, but I wonder if the DNS SRV query is timing out rather than just erroring quickly due to some design factor on the DNS servers. Try setting “EnableDnsSrvResolution” to false on your options object and let’s see what that does.

If that doesn’t work, can you send a copy of your complete bootstrap code?

mreiche · August 15, 2022, 5:11pm

The DNS indicated - 194.168.4.100:53 - does exactly that.

% time curl 194.168.4.100:53
curl: (7) Failed to connect to 194.168.4.100 port 53: Operation timed out
curl 194.168.4.100:53 0.00s user 0.01s system 0% cpu 1:16.39 total

jon.bick · August 16, 2022, 8:27am

Interesting, so I set EnableDnsSrvResolution to false and it’s working instantly when going direct to a node. However I am still seeing the issue when going to the server. Logs to follow.

jon.bick · August 16, 2022, 8:39am

I think I need to rehost Couchbase on the updated port?

2022-08-16T09:26:31.3467414+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-16T09:26:31.3818847+01:00 [DBG] Bootstrapping: global bootstrapping with node “server-redacted:11210” (b4d836a6)
2022-08-16T09:26:31.4002186+01:00 [INF] Using the ChannelConnectionPool. (f94a77a7)
2022-08-16T09:26:33.8514745+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-16T09:26:33.8519430+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-16T09:26:36.3598968+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-16T09:26:36.3599722+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-16T09:26:38.8599697+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-16T09:26:38.8600180+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-16T09:26:41.3622753+01:00 [DBG] Done waiting, polling… (93018145)
2022-08-16T09:26:41.3623109+01:00 [DBG] Waiting for 00:00:02.5000000 before polling. (c8639b24)
2022-08-16T09:26:41.4615759+01:00 [DBG] Bootstrapping: attempted global bootstrapping on endpoint “server-redacted:11210” has failed. (2cc4f355)
System.Net.Sockets.SocketException (10060): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
at Couchbase.Core.IO.Connections.ConnectionFactory.CreateAndConnectAsync(HostEndpointWithPort hostEndpoint, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
2022-08-16T09:26:41.4832734+01:00 [DBG] Error encountered bootstrapping cluster; if the cluster is 6.5 or earlier, this can be ignored. “System.AggregateException: Bootstrapping has failed! (A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
—> System.Net.Sockets.SocketException (10060): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.
at Couchbase.Core.IO.Connections.ConnectionFactory.CreateAndConnectAsync(HostEndpointWithPort hostEndpoint, CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.ConnectionPoolBase.CreateConnectionAsync(CancellationToken cancellationToken)
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.<>c__DisplayClass28_0.<g__StartConnection|0>d.MoveNext()
— End of stack trace from previous location —
at Couchbase.Core.IO.Connections.Channels.ChannelConnectionPool.InitializeAsync(CancellationToken cancellationToken)
at Couchbase.Core.ClusterNode.InitializeAsync()
at Couchbase.Core.DI.ClusterNodeFactory.CreateAndConnectAsync(HostEndpointWithPort endPoint, NodeAdapter nodeAdapter, CancellationToken cancellationToken)
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
— End of inner exception stack trace —
at Couchbase.Core.ClusterContext.BootstrapGlobalAsync()
at Couchbase.Cluster.Couchbase.Core.Bootstrapping.IBootstrappable.BootStrapAsync()”. (ba6fd600)

jon.bick · August 16, 2022, 8:45am

YES! Our infra guys opened the port and its working now! Thank you very much for your help.