[MB-5513] Rebalance failure due to replicator_died with "memcached_error,auth_error,<<"Auth failure">>" because node was marked as ready before isasl.pw was read Created: 11/Jun/12  Updated: 09/Jan/13  Resolved: 12/Jun/12

Status: Closed
Project: Couchbase Server
Component/s: ns_server
Affects Version/s: 1.8.1-release-candidate
Fix Version/s: 1.8.1
Security Level: Public

Type: Bug Priority: Blocker
Reporter: Karan Kumar Assignee: Aleksey Kondratenko
Resolution: Fixed Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment: Ubuntu 64 bit
181-901-rel

Attachments: GZip Archive 10.1.3.152-8091-diag.txt.gz     GZip Archive 10.1.3.153-8091-diag.txt.gz     GZip Archive 10.1.3.155-8091-diag.txt.gz     GZip Archive 10.1.3.156-8091-diag.txt.gz     GZip Archive 10.1.3.157-8091-diag.txt.gz     GZip Archive 10.1.3.158-8091-diag.txt.gz    

 Description   
Decided to file a new bug, but the old one is here:-
http://www.couchbase.com/issues/browse/MB-5259
http://www.couchbase.com/issues/browse/MB-5291


<0.4181.3> exited with {exited,
{'EXIT',<0.4182.3>,
{replicator_died,
{'EXIT',<15697.23073.1>,
{badmatch,
{memcached_error,auth_error,
<<"Auth failure">>}}}}}}


Failing testcase:-
swaprebalance.SwapRebalanceFailedTests.test_failover_swap_rebalance,replica=1,num-buckets=4,num-swap=1,swap-orchestrator=True
1) Failover a node orchestrator
2) Swap rebalance it.



 Comments   
Comment by Karan Kumar [ 11/Jun/12 ]
=========================CRASH REPORT=========================
  crasher:
    initial call: ebucketmigrator_srv:init/1
    pid: <0.6065.2>
    registered_name: []
    exception error: no match of right hand side value
                     {memcached_error,auth_error,<<"Auth failure">>}
      in function ebucketmigrator_srv:connect/4
      in call from ebucketmigrator_srv:init/1
    ancestors: ['ns_vbm_sup-bucket-3','single_bucket_sup-bucket-3',
                  <0.3856.2>]
    messages: []
    links: [#Port<0.23530>,<0.5813.2>,#Port<0.23527>]
    dictionary: []
    trap_exit: false
    status: running
    heap_size: 377
    stack_size: 24
    reductions: 1406
  neighbours:
Comment by Aleksey Kondratenko [ 12/Jun/12 ]
Done
Comment by Thuan Nguyen [ 12/Jun/12 ]
Integrated in github-ns-server-2-0 #371 (See [http://qa.hq.northscale.net/job/github-ns-server-2-0/371/])
    MB-5513: wait isasl.pw refresh before flagging warmup completion (Revision 9f7487ec66bc5c6dc8dde0eb4347869cd96d9a79)

     Result = SUCCESS
Aliaksey Artamonau :
Files :
* src/ns_config_isasl_sync.erl
* src/ns_memcached.erl
Comment by Thuan Nguyen [ 22/Jun/12 ]
Integrated in github-ns-server-2-0 #380 (See [http://qa.hq.northscale.net/job/github-ns-server-2-0/380/])
    MB-5513: don't allow ns_memcached to think it started twice (Revision e42fa1fcd59b54800da73a2702458adb2eae069d)

     Result = SUCCESS
Aliaksey Kandratsenka :
Files :
* src/ns_memcached.erl
Generated at Thu May 23 09:00:19 CDT 2013 using JIRA 5.2.4#845-sha1:c9f4cc41abe72fb236945343a1f485c2c844dac9.