[NCBC-569] Client hangs on CLOSE_WAIT when node is removed from Cluster or when trying to bootstrap against node that isn't in a cluster. Created: 29/Jul/14  Updated: 29/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP3
Fix Version/s: 2.0 Beta

Type: Bug Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified





Implement Replica Read Capability (NCBC-493)

[NCBC-568] Update IVBucket to support more than one replica Created: 29/Jul/14  Updated: 29/Jul/14  Resolved: 29/Jul/14

Status: Resolved
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP3
Fix Version/s: 2.0 Beta

Type: Technical task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Comments   
Comment by Jeff Morris [ 29/Jul/14 ]
http://review.couchbase.org/#/c/39991/




[NCBC-567] Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism. Created: 28/Jul/14  Updated: 29/Jul/14

Status: Reopened
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 Beta

Type: Bug Priority: Blocker
Reporter: Andrei Baranouski Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Zip Archive log.zip    

 Description   
after some time the tests begin to fall with
2014-07-28 00:59:20,864 [27] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism.


Running Rb2Out-HYBRID: 2014-07-28 00:05:18
    rebalance/mode=out
    workload=HybridWorkloadGroup
    rebalance/count=2
    testcase=RebalanceScenario
    Logging to c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-973\Rb2Out-HYBRID\07-28-14\025518\7d8cf558a26ca99fe4dc3028bc6b2ec0

    To re-run the test, copy/paste the following into the shell.
    You may also copy/paste (except the first line) into an argfile
    8<----------------------------------------
    ./stester \
        --rebalance-mode out --workload HybridWorkloadGroup
 \
        --rebalance-count 2 --testcase RebalanceScenario -C share\rexec
 \
        --rexec_path C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port
 \
        8675 --cluster_node=10.3.121.134 --cluster_node=10.3.121.135
 \
        --cluster_node=10.3.121.136 --cluster_node=10.3.3.206
 \
        --cluster_ssh-username=root --cluster_ssh-password=couchbase
    ---------------------------------------->8
[1.47 WARN] (Drivers getDriver:76) 'rexec' is now mapped to *local* execution only. Use RemoteExecutingDriver for remote execution
[1.87 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds.
[1.88 INFO] (RunContext run:124) Starting cluster and driver
[1.89 INFO] (CBCluster startCluster:360) Node http://10.3.121.134:8091 is master now
[1.89 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe' 
[1.89 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations..
[2.26 INFO] (SDKD log:137) --- Logging Self-Test ---
[2.27 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message 
[2.27 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message 
[2.28 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message 
[2.28 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message 
[2.28 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675 
[2.42 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0
[2.43 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[2.76 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":{"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true},"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.17929"}}
[4.02 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.135:8091,ns_1@10.3.121.135>
[4.06 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.136:8091,ns_1@10.3.121.136>
[4.11 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.3.206:8091,ns_1@10.3.3.206>
[4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
[4.18 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
[4.70 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.134:8091
[4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.3.206:8091
[4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.135:8091
[4.71 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.136:8091
[4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.134
[4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.3.206
[4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.136
[4.73 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.135
[4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@641a034d
[4.94 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@19c6866d
[4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@51c293f8
[4.95 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@5a9b8ff9
[4.95 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@6e0f0ad
[18.52 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.135:8091
[26.45 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.136:8091
[30.42 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.3.206:8091
[35.78 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance
[35.84 DEBUG] (RebalanceWaiter sweepOnce:38) Rebalance Progress: 0%
[36.84 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete
[36.85 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups
[36.85 INFO] (CBCluster setupMainBucket:209) Creating bucket default
[36.87 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted
[42.18 INFO] (CBCluster waitForBucketReady:203) Bucket creation done
[42.23 INFO] (RunContext run:143) Driver and cluster initialized
[42.26 INFO] (RunContext call:167) Running scenario..
[42.26 INFO] (Scenario run:72) Starting RAMP phase
[42.26 INFO] (Workload setupDesign:63) Creating design test_design
[42.51 INFO] (Workload setupDesign:80) Design creation done
[42.51 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[42.52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[42.53 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101 
[42.54 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net 
[42.56 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e 
[42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net 
[42.59 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821 
[42.91 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@101.1
[42.91 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@101.2 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}}
[43.02 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409 
[43.39 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: {
[43.39 INFO] (SDKD log:137)  "0": 44,
[43.40 INFO] (SDKD log:137)  "264": 956
[43.40 INFO] (SDKD log:137) } 
[43.40 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@101.2 => {[OK]: 44, [MEMD:GENERIC]: 956}
[43.40 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.3
[43.40 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@102.4 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 102 
[43.41 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.42 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@102.4
[43.42 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_LOAD@102.5 => {DSType=DSTYPE_SEEDED, DS={KSeed=ViewFillerSeed, VSeed=ViewFillerSeed, Count=1000, Continuous=false, VSize=512, Repeat=rep, KSize=12}, Schema={InflateContent=meh, InflateLevel=40}, Options={DelayMax=0, DelayMin=0, IterWait=1, TimeRes=0}}
[43.82 INFO] (SDKD log:137) [Sdkd.ViewLoader|Info] Summary details: {
[43.82 INFO] (SDKD log:137)  "0": 39,
[43.83 INFO] (SDKD log:137)  "264": 961
[43.83 INFO] (SDKD log:137) } 
[43.83 DEBUG] (Handle receiveMessage:158) < CB_VIEW_LOAD@102.5 => {[OK]: 39, [MEMD:GENERIC]: 961}
[43.83 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.6
[43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.83 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@103.7 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.83 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 103 
[43.83 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.85 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@103.7
[43.85 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@103.8 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view}
[43.85 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@104.9 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.85 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.86 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 104 
[43.86 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.87 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@104.9
[43.88 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@104.10 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view}
[43.88 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@105.11 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.88 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 105 
[43.88 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.90 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@105.11
[43.90 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@105.12 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view}
[43.90 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.90 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@106.13 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.91 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 106 
[43.91 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.92 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@106.13
[43.93 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@106.14 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view}
[43.93 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.93 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@107.15 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 107 
[43.94 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.97 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@107.15
[43.97 DEBUG] (Handle sendMessageAsync:183) > CB_VIEW_QUERY@107.16 => {DSType=DSTYPE_SEEDED, DS={}, ViewParameters={}, DesignName=test_design, Options={DelayMax=10, DelayMin=1, IterWait=1, ViewQueryCount=-1, ViewQueryDelay=0, TimeRes=1}, ViewName=test_view}
[43.97 INFO] (Workload call:112) Preloading items into cluster before workload
[43.97 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[43.97 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@108.17 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[43.98 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 108 
[43.98 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[43.99 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@108.17
[43.99 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@108.18 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=false, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=0, DelayMin=0, IterWait=100, TimeRes=0}}
[51.93 DEBUG] (Handle receiveMessage:158) < MC_DS_MUTATE_SET@108.18 => {[OK]: 364, [MEMD:GENERIC]: 14636}
[51.93 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@108.19
[51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@111.22 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@112.23 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@115.26 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@116.27 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@110.21 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@109.20 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@114.25 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@113.24 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.94 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@117.28 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.95 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@118.29 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.96 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[51.99 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.00 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@111.22
[52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.00 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@111.30 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.00 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 111 
[52.00 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 110 
[52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 115 
[52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 109 
[52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 114 
[52.01 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@119.31 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.01 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 116 
[52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 117 
[52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 118 
[52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 112 
[52.02 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.02 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 113 
[52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.03 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@110.21
[52.03 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 119 
[52.03 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.03 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@110.32 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.04 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@120.33 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.04 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.05 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 120 
[52.07 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.07 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@115.26
[52.07 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@115.34 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.08 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.08 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@121.35 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.09 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 121 
[52.10 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.10 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@109.20
[52.10 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@109.36 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.11 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.11 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@122.37 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.12 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 122 
[52.12 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.13 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@114.25
[52.13 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@114.38 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.13 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@123.39 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.13 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.14 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 123 
[52.16 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.16 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@116.27
[52.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@116.40 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.17 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@124.41 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.17 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.18 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 124 
[52.24 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.25 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@117.28
[52.25 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@117.42 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.26 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@125.43 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.26 INFO] (SDKD log:137) 
[52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.26 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 125 
[52.27 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default
[52.30 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.30 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@118.29
[52.31 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 1
[52.31 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@118.44 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.31 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75
   at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40
   at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82
   at Couchbase.Core.Buckets.CouchbaseBucket.Upsert[T](String key, T value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 121
   at Sdkd.Commands.SetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\SetCommand.cs:line 77
   at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25
   at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191
   at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123
   at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.ThreadHelper.ThreadStart()
[52.31 INFO] (SDKD log:137) 
[52.32 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default
[52.32 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@126.45 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.32 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.33 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 126 
[52.34 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.35 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@112.23
[52.35 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@112.46 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.37 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@127.47 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.37 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 127 
[52.40 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@113.24
[52.40 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@113.48 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.40 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.41 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@128.49 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[52.41 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle 
[52.42 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 128 
[52.45 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.45 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@119.31
[52.46 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@119.50 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.52 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.53 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@120.33
[52.53 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@120.51 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.55 INFO] (SDKD log:137) +++ Received exception of ID 0
[52.55 INFO] (SDKD log:137) 
[52.56 INFO] (SDKD log:137) Unhandled Exception: System.Security.Authentication.AuthenticationException: default
[52.63 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.63 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@121.35
[52.63 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@121.52 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.67 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.68 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@122.37
[52.68 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@122.53 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[52.76 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[52.77 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@123.39
[52.77 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@123.54 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[53.05 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[53.05 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@124.41
[53.05 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@124.55 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[53.15 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew 
[53.15 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@125.43
[53.16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@125.56 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=15000, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[53.17 INFO] (LineGobbler doFilter:115) +++ Following exception has internal ID: 3
[53.18 INFO] (SDKD log:137)  at Couchbase.IO.Strategies.DefaultIOStrategy.Authenticate(IConnection connection) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 75
   at Couchbase.IO.Strategies.DefaultIOStrategy.Execute[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\IO\Strategies\DefaultIOStrategy.cs:line 40
   at Couchbase.Core.Server.Send[T](IOperation`1 operation) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 82
   at Couchbase.Core.Buckets.CouchbaseBucket.Get[T](String key) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line 282
   at Sdkd.Commands.GetCommand.ExecuteSingle(String key, String value) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\GetCommand.cs:line 18
   at Sdkd.Commands.KVCommand.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Commands\KVCommand.cs:line 25
   at SdkdConsole.Daemon.Handle.DispatchCommand(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 191
   at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 123
   at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.ThreadHelper.ThreadStart()
[53.18 INFO] (SDKD log:137) 
[53.19 INFO] (SDKD log:137) Unhandled Exception: Couchbase.Configuration.ConfigException: Could not bootstrap default. See log for details.
[65.28 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer
[65.29 INFO] (SDKD log:137)  at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 210
   at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 82
   at Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 55
   at Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 262
   at SdkdConsole.Daemon.Handle.CreateHandle(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 84
   at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 103
   at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.ThreadHelper.ThreadStart()
[65.30 ERROR] (BRun maybePropagate:243) Suppressing driver-related error
com.couchbase.sdkdclient.context.HarnessException: Driver crashed
at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27]
at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27]
[65.31 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@103.57
[65.31 WARN] (STester close:170) While stopping driver
java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27]
at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27]
at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27]
at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27]
at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27]
at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]

 Comments   
Comment by Jeff Morris [ 28/Jul/14 ]
This should be covered by NCBC-550.
Comment by Jeff Morris [ 28/Jul/14 ]
Should be covered by NCBC-550: commit 9ce8806edc38503086af1fe9af66484b5766859d
Comment by Andrei Baranouski [ 29/Jul/14 ]
Hi Jeff, still see the same issue for latest master branch:

http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/44/consoleFull


client logs: http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/44/artifact/log.txt

2014-07-29 01:32:12,669 [32] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Could not authenticate default using Couchbase.Authentication.SASL.CramMd5Mechanism - 22da11dd-6230-4ead-88f8-b68476731dc0.
2014-07-29 01:32:12,667 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.135:11210
2014-07-29 01:32:12,670 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.134:11210
Comment by Jeff Morris [ 29/Jul/14 ]
The authentication error is happening because the CouchbaseCluster object is being finalizing (your leaking it somewhere in SDKQE most likely) and then trying do operations against it, but internally everything is disposed.

Line 200: 2014-07-29 01:32:06,326 [2] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Finalizing DefaultIOStrategy for 10.3.121.134:11210 - b76ca56e-e63e-413e-83d6-af0930c69b6e
Line 205: 2014-07-29 01:32:06,328 [2] DEBUG Couchbase.IO.ConnectionPool`1 - Disposing ConnectionPool for 10.3.121.134:11210
Line 246: 2014-07-29 01:32:06,335 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.134:11210
Line 251: 2014-07-29 01:32:06,336 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.134:11210
Line 252: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.134:11210
Line 253: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.135:11210
Line 255: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.136:11210
Line 258: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.3.206:11210
Line 260: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.135:11210
Line 261: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.134:11210
Line 262: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.3.206:11210
Line 263: 2014-07-29 01:32:06,337 [2] DEBUG Couchbase.IO.ConnectionBase - Disposing connection for 10.3.121.136:11210
Line 264: 2014-07-29 01:32:06,338 [2] DEBUG Couchbase.CouchbaseCluster - Finalizing CouchbaseCluster
Line 265: 2014-07-29 01:32:06,341 [2] INFO Couchbase.Configuration.Server.Providers.ConfigProviderBase - Unregistering observer default
Line 271: 2014-07-29 01:32:06,342 [2] DEBUG Couchbase.Configuration.ConfigContextBase - Disposing ConfigContext
Line 272: 2014-07-29 01:32:06,403 [2] DEBUG Couchbase.Core.Server - Disposing Server for 10.3.121.134:11210
Line 273: 2014-07-29 01:32:06,404 [2] DEBUG Couchbase.IO.Strategies.DefaultIOStrategy - Disposing DefaultIOStrategy for 10.3.121.134:11210 - 9adbed7c-6e2a-4b6c-be4a-76897a4987bc

Thread [2] is the finalizer thread. Line 200 is suspect and likely a leak internally within the client, i believe it's fixed in a later commit but will dig deeper. Line 264 looks like the CouchbaseCluster object is no longer be referenced (leaked likely by SDKQE?) and is being finalized.

Let me look a little deeper - i am also going to change the log message so that when a TCP error is detected during auth, the log message states that as the reason.
Comment by Jeff Morris [ 29/Jul/14 ]
I think I found a problem with sdkq-net:

https://github.com/couchbase/sdkd-net/blob/client-2.0/src/Sdkd/Couchbase/ClientFactory.cs#L269

After calling ReleaseClient, which simply returns if the SharedClients is false, the CouchbaseCluster object is set to null:

https://github.com/couchbase/sdkd-net/blob/client-2.0/src/SdkdConsole/Daemon/Handle.cs#L68

The CouchbaseCluster object will be placed on the finalization queue (since it has a finalizer) and the instance will live on until GC kicks in and determines that it's finalizer must be called - this why we see:

Line 264: 2014-07-29 01:32:06,338 [2] DEBUG Couchbase.CouchbaseCluster - Finalizing CouchbaseCluster

In the logs. If the intention is to keep the CouchbaseClietnt alive through the entire run of tests, then we need to remove the SdkHandle = null. If the intention is to destroy the object, then call Dispose() then set to null and recreate the object when needed.





[NCBC-566] System.ObjectDisposedException: CancellationTokenSource has been removed(vpn run) Created: 28/Jul/14  Updated: 28/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: None
Affects Version/s: 2.0 DP3
Fix Version/s: 2.0 Beta

Type: Bug Priority: Critical
Reporter: Andrei Baranouski Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment: commit 9df097

Attachments: Zip Archive log.zip    

 Description   
I don't see this error on jenkins, but see in my local run via vpn

c:\jenkins\workspace-net2\sdkdclient-ng>call packages\sdkdclient\bin\brun.bat -I cluster_config.ini -I sdkd.args -d all:debug --no-upload --dsw_kvcount 10
[0,13 INFO] (BRun run:435) Initializing history database

============================================================
Running Rb2Out-KV
    rebalance/mode=out
    rebalance/count=2
    testcase=RebalanceScenario
    Logging to c:\jenkins\workspace-net2\sdkdclient-ng\log\SDK-SDK\CB-3.0.0-973\Rb2Out-KV\07-28-14\024288\f41f42648d9af13515187408fcc57f3a

    To re-run the test, copy/paste the following into the shell.
    You may also copy/paste (except the first line) into an argfile
    8<----------------------------------------
    ./stester \
 \ --rebalance-mode out --rebalance-count 2 --testcase
 \ RebalanceScenario -C share\rexec --rexec_path
 \ C:\temp\sdkd-out-debug\SdkdConsole.exe --rexec_port 8675
 \ --cluster_node=10.3.121.134 --cluster_node=10.3.121.135
 \ --cluster_node=10.3.121.136 --cluster_node=10.3.3.206
 \ --cluster_ssh-username=root --cluster_ssh-password=couchbase
        --dsw_kvcount 10
    ---------------------------------------->8
[1,49 WARN] (Drivers getDriver:76) 'rexec' is now mapped to *local* execution only. Use RemoteExecutingDriver for remote execution
[1,79 INFO] (RunContext run:102) Ramp for 30 seconds. Cluster modification: remove 2 nodes and rebalance. Rebound for 90 seconds.
[1,80 INFO] (RunContext run:124) Starting cluster and driver
[1,81 INFO] (CBCluster startCluster:360) Node http://10.3.121.134:8091 is master now
[1,81 INFO] (HostPortDriver launch:32) Invoking SDKD as 'C:\temp\sdkd-out-debug\SdkdConsole.exe'
[1,81 DEBUG] (CBCluster startCluster:366) Stopping any existing rebalance operations..
[1,96 INFO] (SDKD log:137) --- Logging Self-Test ---
[1,96 INFO] (SDKD log:137) [Sdkd.Main|Info] Info Message
[1,96 INFO] (SDKD log:137) [Sdkd.Main|Warn] Warn Message
[1,96 INFO] (SDKD log:137) [Sdkd.Main|Error] Error Message
[1,97 INFO] (SDKD log:137) [Sdkd.Main|Fatal] Fatal Message
[1,97 INFO] (SDKD log:137) [Sdkd.Main|Info] SDKD Listening on port 8675
[2,32 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[2,32 DEBUG] (Handle sendMessageAsync:183) > INFO@0.0
[2,46 DEBUG] (Handle receiveMessage:158) < INFO@0.0 => {"CAPS":{"DS_SHARED":true,"PREAMBLE":false,"CANCEL":true,"CONTINUOUS":true},"COMPONENTS":{"SDK":"1.0.0.0","CLR":"4.0.30319.34014"}}
[8,14 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.135:8091,ns_1@10.3.121.135>
[8,64 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.121.136:8091,ns_1@10.3.121.136>
[9,13 DEBUG] (CBCluster clearSingleCluster:140) Failing over existing node <URI:10.3.3.206:8091,ns_1@10.3.3.206>
[9,63 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
[9,64 DEBUG] (SSHConnection connect:99) Connecting with User[root] Pass[HASH=3b8cf05627127baaf3808913209aac84]
[11,64 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.136:8091
[11,64 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.134:8091
[11,65 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.3.206:8091
[11,65 INFO] (NodeHost createSSH:147) SSH Initialized for http://10.3.121.135:8091
[11,67 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.134
[11,67 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.3.206
[11,68 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.135
[11,68 DEBUG] (SSHCommand execute:75) Running /etc/init.d/couchbase-server start && pkill -CONT -f memcached && pkill -CONT -f beam.smp && iptables -F && iptables -t nat -F on 10.3.121.136
[12,52 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@58a5be95
[12,52 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@698355aa
[12,52 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@3caec762
[12,52 DEBUG] (SSHCommand close:147) Closing channel com.jcraft.jsch.ChannelExec@5305036e
[12,53 DEBUG] (CBCluster setupNewCluster:271) Provisioning initial node com.couchbase.cbadmin.client.CouchbaseAdmin@4a48489f
[27,05 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.135:8091
[29,85 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.121.136:8091
[36,65 DEBUG] (CBCluster tryOnce:286) Adding node http://10.3.3.206:8091
[44,43 INFO] (CBCluster setupNewCluster:293) All nodes added. Will rebalance
[45,40 INFO] (RebalanceWaiter sweepOnce:33) Rebalance complete
[45,40 DEBUG] (CBCluster setupServerGroups:222) Not creating any groups
[45,65 INFO] (CBCluster setupMainBucket:209) Creating bucket default
[45,90 INFO] (CBCluster setupMainBucket:211) Bucket creation submitted
[53,46 INFO] (CBCluster waitForBucketReady:203) Bucket creation done
[56,38 INFO] (RunContext run:143) Driver and cluster initialized
[56,63 INFO] (RunContext call:167) Running scenario..
[56,63 INFO] (Scenario run:72) Starting RAMP phase
[56,64 INFO] (Workload call:112) Preloading items into cluster before workload
[56,64 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[56,64 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@101.1 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[56,65 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 101
[56,65 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[56,66 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving Common.Logging.Log4Net
[56,66 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly Common.Logging.Log4Net, Version=2.0.0.0, Culture=neutral, PublicKeyToken=af08829b84f0328e
[56,68 INFO] (SDKD log:137) [Sdkd.Main|Info] Resolving log4net
[56,68 INFO] (SDKD log:137) [Sdkd.Main|Info] Have assembly log4net, Version=1.2.10.0, Culture=neutral, PublicKeyToken=1b44e1d426115821
[60,62 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@101.1
[60,62 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@101.2 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=false, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=0, DelayMin=0, IterWait=100, TimeRe
s=0}}
[64,45 DEBUG] (Handle receiveMessage:158) < MC_DS_MUTATE_SET@101.2 => {[OK]: 10}
[64,45 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@101.3
[64,45 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,45 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@107.9 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,45 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@105.7 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,46 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@106.8 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,46 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@104.6 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,46 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@103.5 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,47 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@102.4 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,47 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@111.13 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,47 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,47 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@110.12 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,48 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@109.11 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,48 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@108.10 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[64,48 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,49 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,49 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,49 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 105
[64,50 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[64,50 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 106
[64,50 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,50 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 107
[64,51 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 104
[64,51 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 103
[64,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 102
[64,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[64,52 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 111
[64,53 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 110
[64,53 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 109
[64,54 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 108
[68,23 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[68,24 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@105.7
[68,24 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@105.14 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[68,25 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[68,25 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@112.15 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[68,25 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 112
[75,75 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[75,75 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@106.8
[75,75 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@106.16 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes
=1}}
[75,76 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[75,76 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@113.17 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[75,76 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 113
[77,56 INFO] (SDKD log:137) [Sdkd.Result|Warn] Unrecognized return code 409
[85,70 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[85,70 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@107.9
[85,71 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@107.18 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes
=1}}
[85,72 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[85,72 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@114.19 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[85,72 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 114
[90,28 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[90,28 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@104.6
[90,28 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@104.20 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes
=1}}
[90,29 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@115.21 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[90,30 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[90,30 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 115
[94,10 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[94,10 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@102.4
[94,10 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@102.22 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[94,11 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[94,11 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@116.23 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[94,12 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 116
[97,89 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[97,89 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@103.5
[97,89 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@103.24 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[97,90 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[97,90 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@117.25 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[97,91 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 117
[101,67 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[101,67 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@111.13
[101,67 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@111.26 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[101,68 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[101,68 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@118.27 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[101,68 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 118
[105,46 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[105,46 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@110.12
[105,47 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@110.28 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[105,47 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[105,48 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@119.29 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[105,48 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 119
[111,46 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[111,46 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@109.11
[111,47 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@109.30 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[111,48 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@120.31 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[111,48 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[111,48 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 120
[115,29 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[115,29 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@108.10
[115,29 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@108.32 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[115,30 INFO] (SDKD log:137) [Sdkd.Control|Info] Got a new connection. Creating child handle
[115,30 DEBUG] (Handle sendMessageAsync:183) > NEWHANDLE@121.33 => {Port=8091, Bucket=default, Options={SSL=false, Username=default, Password=, OtherNodes=[["10.3.121.135",8091],["10.3.121.136",8091],["10.3.3.206",8091]]}, Hostname=10.3.121.134}
[115,30 INFO] (SDKD log:137) [Sdkd.Control|Info] Registering handle 121
[119,14 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[119,14 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@112.15
[119,14 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@112.34 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[125,40 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[125,40 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@113.17
[125,40 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@113.35 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[134,08 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[134,08 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@114.19
[134,08 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@114.36 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[138,16 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[138,16 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@115.21
[138,16 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@115.37 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[146,03 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[146,03 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@116.23
[146,03 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@116.38 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[150,29 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[150,29 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@117.25
[150,29 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@117.39 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[154,13 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[154,13 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@118.27
[154,13 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@118.40 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[158,32 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[158,32 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@119.29
[158,32 DEBUG] (Handle sendMessageAsync:183) > MC_DS_GET@119.41 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRes=1}}
[168,41 INFO] (SDKD log:137) [Sdkd.ClientFactory|Info] Shared clients disabled. Creating anew
[168,42 DEBUG] (Handle receiveMessage:158) < NEWHANDLE@120.31
[168,42 DEBUG] (Handle sendMessageAsync:183) > MC_DS_MUTATE_SET@120.42 => {DSType=DSTYPE_SEEDED, DS={KSeed=SimpleKey, VSeed=SimpleValue, Count=10, Continuous=true, VSize=128, Repeat=REP, KSize=32}, Options={DelayMax=10, DelayMin=1, IterWait=1, TimeRe
s=1}}
[168,79 INFO] (SDKD log:137)
[168,79 INFO] (SDKD log:137) Unrecognized исключение: System.ObjectDisposedException: CancellationTokenSource был удален(has been removed).
[168,79 INFO] (SDKD log:137) in System.Threading.CancellationTokenSource.ThrowObjectDisposedException()
[168,79 INFO] (SDKD log:137) in System.Threading.CancellationTokenSource.InternalRegister(Action`1 callback, Object stateForCallback, SynchronizationContext targetSyncContext, ExecutionContext executionContext)
[168,79 INFO] (SDKD log:137) in System.Threading.CancellationToken.Register(Action`1 callback, Object state, Boolean useSynchronizationContext, Boolean useExecutionContext)
[168,79 INFO] (SDKD log:137) in System.Threading.CancellationToken.Register(Action callback)
[168,80 INFO] (SDKD log:137) in Couchbase.Configuration.Server.Providers.Streaming.ConfigThreadState.ListenForConfigChanges() in c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\Streaming\ConfigThreadState.
cs:line 72
[168,80 INFO] (SDKD log:137) in System.Threading.ThreadHelper.ThreadStart_Context(Object state)
[168,81 INFO] (SDKD log:137) in System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
[168,81 INFO] (SDKD log:137) in System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
[168,81 INFO] (SDKD log:137) in System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
[168,82 INFO] (SDKD log:137) in System.Threading.ThreadHelper.ThreadStart()
[184,10 ERROR] (BRun maybePropagate:237) Suppressing driver-related error
com.couchbase.sdkdclient.context.HarnessException: Driver crashed
        at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_60]
        at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.7.0_60]
        at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.7.0_60]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) ~[na:1.7.0_60]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.7.0_60]
        at java.lang.Thread.run(Unknown Source) ~[na:1.7.0_60]
[184,13 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@102.43
[184,13 WARN] (STester close:170) While stopping driver
java.net.SocketException: Connection reset by peer: socket write error
        at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.7.0_60]
        at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.7.0_60]
        at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.7.0_60]
        at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.7.0_60]
        at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.7.0_60]
        at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.7.0_60]
        at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.7.0_60]
        at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.7.0_60]
        at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.7.0_60]
        at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:281) [sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:388) [sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:472) [sdkdclient-1.0-SNAPSHOT.jar:na]
        at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:504) [sdkdclient-1.0-SNAPSHOT.jar:na]



 Comments   
Comment by Andrei Baranouski [ 28/Jul/14 ]
this may depend on http://review.couchbase.org/#/c/39935/ from NCBC-550 still not commited.




[NCBC-565] Remove "verbose" logging and tracing Created: 27/Jul/14  Updated: 27/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 Beta
Fix Version/s: 2.0 GA

Type: Task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
This ticket is to ensure that the large number of trace/debug statements are removed before GA is released. While the verbosity make debugging easier, it may be a bit too much for a release candidate, thus this ticket is intended to ensure that extraneous trace/debug/log messages are removed or at least reviewed.




[NCBC-564] Respects JsonSerializer settings for deserialization Created: 26/Jul/14  Updated: 28/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 1.3.7
Fix Version/s: 1.3.8

Type: Bug Priority: Critical
Reporter: bchavez Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
Pull request here:
https://github.com/couchbase/couchbase-net-client/pull/17


 Comments   
Comment by Jeff Morris [ 28/Jul/14 ]
Thanks for submitting bchavez!
Comment by bchavez [ 28/Jul/14 ]
Thanks, I also am also (slightly off topic) having problems with this section of code:

            if (!IsArrayOrCollection(typeof(T)))
            {
                value = DocHelper.InsertId(value, key);
            }

I am managing all the document IDs myself in my application. But DocHelper keeps interfering with my ID during deserialization. Is there a way we can possibly set a flag that wont interfere with my JSON ?

One example: All my domain objects have a strongly typed Guid as their ID.

The KEY to an Account object is "acct:aaaa-bb-cc-dd".

POCO in C#:
public class Account{
    public Guid Id{get;set;}
}

I format the key to this object inside my App; however, during deserialization DocHelper interferes with the JSON by injecting the KEY: "acct:aaaa-bb-cc-dd" into the ID property in the JSON before deseralization.

So when Newtonsoft deserializes the JSON with the injected DocHelper Id:Key:"acct:aaaa-bb-cc-dd" cannot be converted to a Guid because of the prefix "acct:" is an invalid Guid format. I'd prefer the SDK not interfere with any of my ser/deser JSON.

Perhaps we can add some flag that can short circuit the DocHelper injection?

Thanks,
Brian
Comment by Jeff Morris [ 28/Jul/14 ]
Yes, the proper way to do this would be to create another ticket as a feature request.

A couple of criterion to consider:
a) The default should be the current behavior - don't break existing users
b) It's configurable through the app.config
c) Includes set of unit tests showing default and "set" behavior

As always, if you would like to take a stab at it and submit a PR, go for it :)

-Jeff
Comment by bchavez [ 28/Jul/14 ]
This is awesome. Thank you. Yea, I'll likely take a stab at it later today.
Comment by Jeff Morris [ 28/Jul/14 ]
>> I'd prefer the SDK not interfere with any of my ser/deser JSON.

Agreed, not sure why it enforces it TBH.

>>This is awesome. Thank you. Yea, I'll likely take a stab at it later today.

Cool, have fun!




[NCBC-563] NullReferenceException in CouchbaseConfigContext.LoadConfig Created: 25/Jul/14  Updated: 25/Jul/14  Resolved: 25/Jul/14

Status: Resolved
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0.0

Type: Bug Priority: Blocker
Reporter: Andrei Baranouski Assignee: Jeff Morris
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified

Attachments: Zip Archive log.zip    

 Description   
very often in different tests I see the following exception


http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/38/consoleFull

Running SvcRestart-HYBRID: 2014-07-25 05:20:15
..............

[365.86 INFO] (SDKD log:137) Unhandled Exception: System.NullReferenceException: Object reference not set to an instance of an object.
[366.20 INFO] (SDKD log:137) +++ Flushing remaining exception trace buffer
[366.20 INFO] (SDKD log:137)  at Couchbase.Configuration.CouchbaseConfigContext.LoadConfig(IBucketConfig bucketConfig) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\CouchbaseConfigContext.cs:line 51
   at Couchbase.Configuration.ConfigContextBase..ctor(IBucketConfig bucketConfig, ClientConfiguration clientConfig, Func`2 ioStrategyFactory, Func`3 connectionPoolFactory, Func`5 saslFactory, IByteConverter converter, ITypeSerializer serializer) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\ConfigContextBase.cs:line 51
   at Couchbase.Configuration.CouchbaseConfigContext..ctor(IBucketConfig bucketConfig, ClientConfiguration clientConfig, Func`2 ioStrategyFactory, Func`3 connectionPoolFactory, Func`5 saslFactory, IByteConverter converter, ITypeSerializer serializer) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\CouchbaseConfigContext.cs:line 22
   at Couchbase.Configuration.Server.Providers.CarrierPublication.CarrierPublicationProvider.GetConfig(IBucketConfig bucketConfig) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\CarrierPublication\CarrierPublicationProvider.cs:line 63
   at Couchbase.Configuration.Server.Providers.CarrierPublication.CarrierPublicationProvider.GetConfig(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Configuration\Server\Providers\CarrierPublication\CarrierPublicationProvider.cs:line 44
   at Couchbase.Core.ClusterManager.CreateBucket(String bucketName, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\Core\ClusterManager.cs:line 155
   at Couchbase.CouchbaseCluster.OpenBucket(String bucketname, String password) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\couchbase-net-client\Src\Couchbase\CouchbaseCluster.cs:line 82
   at Sdkd.Couchbase.ClientFactory.FindExistingClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 55
   at Sdkd.Couchbase.ClientFactory.CreateClient(ClientConfiguration config) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\Sdkd\Couchbase\ClientFactory.cs:line 262
   at SdkdConsole.Daemon.Handle.CreateHandle(Request req) in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 84
   at SdkdConsole.Daemon.Handle.Run() in c:\jenkins\workspace\.net-sdkdclient-ng2-andrei\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line 103
   at System.Threading.ThreadHelper.ThreadStart_Context(Object state)
   at System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
   at System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)
   at System.Threading.ThreadHelper.ThreadStart()
[366.20 ERROR] (BRun maybePropagate:243) Suppressing driver-related error
com.couchbase.sdkdclient.context.HarnessException: Driver crashed
at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:192) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.context.RunContext$5.call(RunContext.java:183) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask$Sync.innerRun(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.FutureTask.run(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) ~[na:1.6.0_27]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) ~[na:1.6.0_27]
at java.lang.Thread.run(Unknown Source) ~[na:1.6.0_27]
[366.21 DEBUG] (Handle sendMessageAsync:183) > CLOSEHANDLE@203.259
[366.21 WARN] (STester close:170) While stopping driver
java.net.SocketException: Connection reset by peer: socket write error
at java.net.SocketOutputStream.socketWrite0(Native Method) ~[na:1.6.0_27]
at java.net.SocketOutputStream.socketWrite(Unknown Source) ~[na:1.6.0_27]
at java.net.SocketOutputStream.write(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.implFlushBuffer(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.implFlush(Unknown Source) ~[na:1.6.0_27]
at sun.nio.cs.StreamEncoder.flush(Unknown Source) ~[na:1.6.0_27]
at java.io.OutputStreamWriter.flush(Unknown Source) ~[na:1.6.0_27]
at java.io.BufferedWriter.flush(Unknown Source) ~[na:1.6.0_27]
at com.couchbase.sdkdclient.handle.Handle.sendMessageAsync(Handle.java:188) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.handle.Handle.close(Handle.java:254) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.HandleManager.stopAll(HandleManager.java:26) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.HostPortDriver.stop(HostPortDriver.java:118) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.driver.ExecutingDriver.stop(ExecutingDriver.java:117) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.stester.STester.close(STester.java:167) ~[sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.runHarness(BRun.java:287) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.runSingleTest(BRun.java:394) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.run(BRun.java:478) [sdkdclient-1.0-SNAPSHOT.jar:na]
at com.couchbase.sdkdclient.batch.BRun.main(BRun.java:510) [sdkdclient-1.0-SNAPSHOT.jar:na]


client logs http://sdkbuilds.couchbase.com/job/.net-sdkdclient-ng2-andrei/38/artifact/log.txt

Jeff, believe that this is a problem on client side?



 Comments   
Comment by Jeff Morris [ 25/Jul/14 ]
Yes, I'll take a look into this today Andrei.
Comment by Jeff Morris [ 25/Jul/14 ]
Andrei - can you attach the SDK logs to this ticket?
Comment by Jeff Morris [ 25/Jul/14 ]
This is what's happening:

When the client attempts to bootstrap and the node it elects to bootstrap off of is in an inconsistent state, during the SASL process the first fails and thus the SaslMechanism is never chosen leading to a subsequent NRE:

https://github.com/couchbase/couchbase-net-client/blob/master/Src/Couchbase/Authentication/SASL/SaslFactory.cs#L24

https://github.com/couchbase/couchbase-net-client/blob/master/Src/Couchbase/Configuration/CouchbaseConfigContext.cs#L51

The simple solution seems to be check for null - which will push the problem further out. It should be a "cannot bootstrap error, please try again" perhaps looping through the bootstrap list in the configuration.
Comment by Jeff Morris [ 25/Jul/14 ]
commit b5fc255555f26eb5f691eb0441c7997577fc79e6




[NCBC-562] Provide configurable wait timeout for operations in mid-fight. Created: 24/Jul/14  Updated: 28/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 Beta

Type: Task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
When a failover occurs, the remote host immediately terminates the TCP connection causing the client to block for indefinite amount of time.This is to set a configurable timeout so that the client can abort the operation gracefully, if the timeout is exceeded.




[NCBC-561] During a Hard Failover -1 is returned in VBucketMap for Primary and all Replicas Created: 24/Jul/14  Updated: 28/Jul/14

Status: In Progress
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 Beta

Type: Task Priority: Test Blocker
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
Example VBucketMap:

["192.168.56.102:11210","192.168.56.103:11210"],"vBucketMap":[[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[-1],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0],[0]...

This causes a IndexOutOfRangeException.

 Comments   
Comment by Jeff Morris [ 24/Jul/14 ]
Spoke with Mordy and trying the following approach:

1 - If Primary is -1, then shuffle server list and randomly take a server
2 - Send operation and if NMV is returned, update config (add wait event w/timeout to block until set by NotifyObserver)
3 - Set a property for retry attempts and a configurable max retry limit
4 - Resend operation
5 - If max retries, then operation failed and return failure response to app layer




[NCBC-560] Measure performance impact of using Mutex's and possibly use RWSL instead. Created: 23/Jul/14  Updated: 23/Jul/14

Status: Open
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2, 2.0 DP3
Fix Version/s: backlog-2.0

Type: Task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
See this commit: http://review.couchbase.org/#/c/39761/ and http://www.couchbase.com/issues/browse/NCBC-558




[NCBC-559] During rebalance IConfigInfo impl is finalizing causing ODE on all Connections Created: 23/Jul/14  Updated: 23/Jul/14  Resolved: 23/Jul/14

Status: Resolved
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 DP3

Type: Task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Comments   
Comment by Jeff Morris [ 23/Jul/14 ]
commit 7bda23d243cde3894e7b498a87a20ec15239f6ad




[NCBC-558] Add Thread Synchronization to ClusterManager and Provider classes Created: 23/Jul/14  Updated: 23/Jul/14  Resolved: 23/Jul/14

Status: Resolved
Project: Couchbase .NET client library
Component/s: library
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 DP3

Type: Task Priority: Major
Reporter: Jeff Morris Assignee: Jeff Morris
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
Add mutex's around some of the methods that require thread synchronization.

 Comments   
Comment by Jeff Morris [ 23/Jul/14 ]
http://review.couchbase.org/#/c/39761/




[NCBC-557] couchbaseBucket.CreateQuery(*).BucketName equals "" -> NullReferenceException in Queries Created: 23/Jul/14  Updated: 23/Jul/14  Resolved: 23/Jul/14

Status: Resolved
Project: Couchbase .NET client library
Component/s: None
Affects Version/s: 2.0 DP2
Fix Version/s: 2.0 DP3

Type: Bug Priority: Blocker
Reporter: Andrei Baranouski Assignee: Jeff Morris
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified


 Description   
have a code like:
var query =couchbaseBucket.CreateQuery( true, dname, vname);
Console.WriteLine("couchbaseBucket.Name: " + couchbaseBucket.Name);
Console.WriteLine("bucket name in query: " + query.BucketName);
IViewResult<dynamic> view = couchbaseBucket.Query<dynamic>(query);

output:
couchbaseBucket.Name: default
bucket name in query:


so, query.BucketName is "" after CreateQuery

couchbaseBucket.Query<dynamic>(query); ====>


     public IViewResult<T> Send<T>(IViewQuery query)
        {
            var baseUri = GetBaseViewUri(query.BucketName);========>
            query.BaseUri(baseUri);
            return ViewClient.Execute<T>(query);
        }



        public string GetBaseViewUri(string bucketName)
        {
            var uri = _nodeInfo.CouchApiBase;
            var bucketConfig = _clientConfiguration.BucketConfigs[bucketName]; // !!!bucketName equals and exception appears:




System.NullReferenceException: Object reference not set to an instance of the object.
[93,80 INFO] (SDKD log:137) в Couchbase.Core.Server.GetBaseViewUri(String bucketName) в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Server.cs:line109
[93,81 INFO] (SDKD log:137) в Couchbase.Core.Server.Send[T](IViewQuery query) в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Server.cs:line 88
[93,81 INFO] (SDKD log:137) в Couchbase.Core.Buckets.CouchbaseBucket.Query[T](IViewQuery query) в c:\jenkins\workspace-net2\couchbase-net-client\Src\Couchbase\Core\Buckets\CouchbaseBucket.cs:line507
[93,81 INFO] (SDKD log:137) в Sdkd.Views.ViewCommand.GetViewObject(CouchbaseBucket cli, Request req, ViewOptions vo) в c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line126
[93,82 INFO] (SDKD log:137) в Sdkd.Views.ViewCommand.Run() в c:\jenkins\workspace-net2\sdkd-net\src\Sdkd\Views\ViewCommand.cs:line231
[93,82 INFO] (SDKD log:137) в SdkdConsole.Daemon.Handle.DispatchCommand(Request req) в c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line191
[93,82 INFO] (SDKD log:137) в SdkdConsole.Daemon.Handle.Run() в c:\jenkins\workspace-net2\sdkd-net\src\SdkdConsole\Daemon\Handle.cs:line123
[93,82 INFO] (SDKD log:137) в System.Threading.ThreadHelper.ThreadStart_Context(Object state)
[93,83 INFO] (SDKD log:137) в System.Threading.ExecutionContext.RunInternal(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
[93,83 INFO] (SDKD log:137) в System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state, Boolean preserveSyncCtx)
[93,83 INFO] (SDKD log:137) в System.Threading.ExecutionContext.Run(ExecutionContext executionContext, ContextCallback callback, Object state)



 Comments   
Comment by Jeff Morris [ 23/Jul/14 ]
Gerrit SHA: commit 9334ae491612644a306059aeb5d554c6132a22ae




Generated at Wed Jul 30 07:42:19 CDT 2014 using JIRA 5.2.4#845-sha1:c9f4cc41abe72fb236945343a1f485c2c844dac9.