[windows 7] bucket creation on windows 7 sometimes timeout if bucket is created immediately after another bucket was deleted

Aleksey Kondratenko added a comment - 14/Sep/12 12:53 PM I need full diags. Or at least all debug.* logs

Farshid Ghods added a comment - 14/Sep/12 2:22 PM Iryna, please use the fixVersion as 2.0 beta or 2.0 and also set the priorities accordingly/ being unable to create a bukcet on windows 7 is a blocker bug

Iryna Mironava added a comment - 14/Sep/12 3:07 PM all debug logs attached

Iryna Mironava added a comment - 14/Sep/12 3:07 PM logs attached

Iryna Mironava added a comment - 14/Sep/12 3:52 PM ip of machine is 10.3.2.188 Jin, can you take a look?

Jin Lim added a comment - 14/Sep/12 4:51 PM 1) NS Server reported TIMEOUT on deleting the bucket, "2replica_90e83784-3382-4a59-8e49-586975bceb76" [ns_server:warn,2012-09-13T16:31:47.616, ns_1@10.3.2.188 :<0.430.0>:ns_orchestrator:idle:418]Nodes [' ns_1@10.3.2.188 '] failed to delete bucket "2replica_90e83784-3382-4a59-8e49-586975bceb76" within expected time. 2) Prior to the TIMEOUT there were any error reported on mecached(ep_engine) side. However, there were this repeating CRASH from ns_server side. [error_logger:error,2012-09-13T16:31:17.678, ns_1@10.3.2.188 :error_logger:ale_error_logger_handler:log_msg:76]Error in process <0.27670.2> on node ' ns_1@10.3.2.188 ' with exit value: {{badmatch,{error,shutdown}},[{single_bucket_sup,'-start_link/1-fun-0-',2}]} [ns_server:debug,2012-09-13T16:31:18.553, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop:111]Exception from query_vbucket_states of "2replica_90e83784-3382-4a59-8e49-586975bceb76":' ns_1@10.3.2.188 ' {'EXIT',     {noproc,         {gen_server,call,             [{'janitor_agent-2replica_90e83784-3382-4a59-8e49-586975bceb76',                  ' ns_1@10.3.2.188 '},              query_vbucket_states,infinity]}}} [ns_server:debug,2012-09-13T16:31:18.553, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop_next_step:116]Waiting for "2replica_90e83784-3382-4a59-8e49-586975bceb76" on ' ns_1@10.3.2.188 ' [ns_server:debug,2012-09-13T16:31:19.569, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop:111]Exception from query_vbucket_states of "2replica_90e83784-3382-4a59-8e49-586975bceb76":' ns_1@10.3.2.188 ' {'EXIT',     {noproc,         {gen_server,call,             [{'janitor_agent-2replica_90e83784-3382-4a59-8e49-586975bceb76',                  ' ns_1@10.3.2.188 '},              query_vbucket_states,infinity]}}} [ns_server:debug,2012-09-13T16:31:19.569, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop_next_step:116]Waiting for "2replica_90e83784-3382-4a59-8e49-586975bceb76" on ' ns_1@10.3.2.188 ' [ns_server:debug,2012-09-13T16:31:20.585, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop:111]Exception from query_vbucket_states of "2replica_90e83784-3382-4a59-8e49-586975bceb76":' ns_1@10.3.2.188 ' {'EXIT',     {noproc,         {gen_server,call,             [{'janitor_agent-2replica_90e83784-3382-4a59-8e49-586975bceb76',                  ' ns_1@10.3.2.188 '},              query_vbucket_states,infinity]}}} [ns_server:debug,2012-09-13T16:31:20.585, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop_next_step:116]Waiting for "2replica_90e83784-3382-4a59-8e49-586975bceb76" on ' ns_1@10.3.2.188 ' [ns_server:debug,2012-09-13T16:31:21.600, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop:111]Exception from query_vbucket_states of "2replica_90e83784-3382-4a59-8e49-586975bceb76":' ns_1@10.3.2.188 ' {'EXIT',     {noproc,         {gen_server,call,             [{'janitor_agent-2replica_90e83784-3382-4a59-8e49-586975bceb76',                  ' ns_1@10.3.2.188 '},              query_vbucket_states,infinity]}}} [ns_server:debug,2012-09-13T16:31:21.600, ns_1@10.3.2.188 :<0.27676.2>:janitor_agent:new_style_query_vbucket_states_loop_next_step:116]Waiting for "2replica_90e83784-3382-4a59-8e49-586975bceb76" on ' ns_1@10.3.2.188 ' [ns_doctor:debug,2012-09-13T16:31:38.788, ns_1@10.3.2.188 :ns_doctor:ns_doctor:handle_info:136]Current node statuses: [{' ns_1@10.3.2.188 ', Can we rerun the test with increased memcached verbose level? wget -O- -q --user=Administrator --password=password --post-data='ns_config:update_key({node, node(), memcached}, fun (PList) -> lists:keyreplace(verbosity, 1, PList, {verbosity, "-vvv"}) end).' http://10.3.2.188:8091/diag/eval

Chiyoung Seo added a comment - 14/Sep/12 5:09 PM Assign it to Alk for the initial investigation.

Aleksey Kondratenko added a comment - 14/Sep/12 5:24 PM Logs were rotated past incident in ticket's description

Jin Lim added a comment - 14/Sep/12 5:30 PM Iryna & Alk, The log snippets from my initial investigation above are directly from the node (ssh to the node and peeked at the logs under ~/logs) Give either Alk the direct access info or collect entire logs for him. Thanks.   

Aleksey Kondratenko added a comment - 14/Sep/12 5:36 PM It may be easier to reproduce _and_ right after problem happens grab me _diags_.