bad JSON Configuration: Empty Server List and Bucket not ready
Hi,
I noticed a few things in my membase logs and wanted to know what might be causing them. I created a default Membase bucket via the web console. Could these two errors have a common cause?
-Jon
1) bad JSON Configuration: Empty Server List
2) Bucket not ready as indicated below
INFO REPORT <5643.175.0> 2011-03-08 21:18:07
===============================================================================
ns_1@10.101.0.178:ns_janitor:269: Waiting for "default" on ['ns_1@10.101.0.178']
ERROR REPORT <5643.175.0> 2011-03-08 21:18:07
===============================================================================
ns_1@10.101.0.178:ns_janitor:57: Bucket "default" not yet ready on ['ns_1@10.101
.0.178']
CRASH REPORT <5643.178.0> 2011-03-08 21:18:08
===============================================================================
Crashing process
initial_call {ns_memcached,init,['Argument__1']}
pid <5643.178.0>
registered_name []
error_info
{error,{badmatch,{error,timeout}},
[{mc_client_binary,stats_recv,4},
{mc_client_binary,stats,4},
{ns_memcached,wait_for_warmup,1},
{ns_memcached,init,1},
{proc_lib,init_p_do_apply,3}]}
ancestors
[ns_good_bucket_sup,ns_server_sup,ns_server_cluster_sup,<5643.52.0>]
messages []
links [<5643.108.0>,#Port<5643.3148>]
dictionary []
trap_exit false
status running
heap_size 46368
stack_size 24
reductions 4435
Hi, Here is the preceding Log report. Sorry for the length but I wanted to include as much detail as possible. Does anything look suspect on first impression? INFO REPORT <0.53.0> 2011-03-08 21:17:31 =============================================================================== nonode@nohost:log_os_info:25: OS type: {unix,linux} Version: {2,6,36} Runtime info: [{otp_release,"R14B"}, {erl_version,"5.8.1"}, {erl_version_long,"Erlang R14B (erts-5.8.1) [source] [smp:64:54] [rq:64] [async-threads:16] [kernel-poll:false]\n"}, {system_arch_raw,"tile-tilera-linux-gnu"}, {system_arch,"tile-tilera-linux-gnu"}, {localtime,{{2011,3,8},{21,17,31}}}, {memory,[{total,6464112}, {processes,849364}, {processes_used,841076}, {system,5614748}, {atom,252953}, {atom_used,249343}, {binary,17288}, {code,1735744}, {ets,162552}]}, {loaded,[ns_info,log_os_info,ns_log_mf_h,ns_server_cluster_sup, ns_server,timer,cpu_sup,io_lib_fread,memsup,disksup, os_mon,io_lib_pretty,unicode,io_lib_format,io_lib,io, sasl_report,release_handler,calendar,overload, alarm_handler,sasl_report_tty_h,sasl,ns_bootstrap, file_io_server,orddict,erl_eval,file,c, error_logger_tty_h,queue,kernel_config,user,user_sup, supervisor_bridge,standard_error,ets,gb_sets, hipe_unified_loader,packages,code_server,code, file_server,net_kernel,global_group,erl_distribution, filename,inet_gethost_native,inet_parse,inet,inet_udp, os,inet_config,inet_db,global,gb_trees,rpc,dict, supervisor,kernel,application_master,sys,application, gen_server,erl_parse,proplists,erl_scan,lists, application_controller,proc_lib,gen,gen_event, error_logger,heart,error_handler,erlang, erl_prim_loader,prim_zip,zlib,prim_file,prim_inet, init,otp_ring0]}, {applications,[{os_mon,"CPO CXC 138 46","2.2.5"}, {kernel,"ERTS CXC 138 10","2.14.1"}, {sasl,"SASL CXC 138 11","2.1.9.2"}, {ns_server,"Membase server",[]}, {menelaus,"Membase menelaus",[]}, {stdlib,"ERTS CXC 138 10","1.17.1"}]}, {pre_loaded,[erlang,erl_prim_loader,prim_zip,zlib,prim_file, prim_inet,init,otp_ring0]}, {process_count,43}, {node,nonode@nohost}, {nodes,[]}, {registered,[application_controller,erl_prim_loader, standard_error,global_group,user,timer_server, ns_server_cluster_sup,release_handler, standard_error_sup,init,overload,kernel_safe_sup, alarm_handler,os_mon_sup,rex,cpu_sup,sasl_sup, memsup,inet_db,kernel_sup,disksup, global_name_server,code_server,error_logger, file_server_2,sasl_safe_sup]}, {cookie,nocookie}, {wordsize,4}, {wall_clock,1}] INFO REPORT <0.54.0> 2011-03-08 21:17:31 =============================================================================== reading ip config from "priv/ip" PROGRESS REPORT <0.55.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,inet_gethost_native_sup} started [{pid,<0.56.0>},{mfa,{inet_gethost_native,init,[[]]}}] PROGRESS REPORT <0.26.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<0.55.0>}, {name,inet_gethost_native_sup}, {mfargs,{inet_gethost_native,start_link,[]}}, {restart_type,temporary}, {shutdown,1000}, {child_type,worker}] PROGRESS REPORT <0.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<0.58.0>}, {name,erl_epmd}, {mfargs,{erl_epmd,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <0.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<0.59.0>}, {name,auth}, {mfargs,{auth,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<5643.60.0>}, {name,net_kernel}, {mfargs,{net_kernel,start_link,[['ns_1@10.101.0.178',longnames]]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.11.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,kernel_sup} started [{pid,<5643.57.0>}, {name,net_sup_dynamic}, {mfargs,{erl_distribution,start_link, [['ns_1@10.101.0.178',longnames]]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.54.0>}, {name,dist_manager}, {mfargs,{dist_manager,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.63.0>}, {name,ns_cluster}, {mfargs,{ns_cluster,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.64.0> 2011-03-08 21:17:31 =============================================================================== loading config from "priv/config" PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.65.0>}, {name,ns_config_events}, {mfargs,{gen_event,start_link,[{local,ns_config_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.66.0>}, {name,ns_config}, {mfargs,{ns_config,start_link,["priv/config",ns_config_default]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.68.0>}, {name,ns_config_isasl_sync}, {mfargs,{ns_config_isasl_sync,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== isasl_sync init: ["/home/dev/membase/membase-server-community_1.6.4.1_src/ns_ser ver/data/ns_1/isasl.pw", "_admin","_admin"] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== isasl_sync init buckets: [] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== Writing isasl passwd file: "/home/dev/membase/membase-server-community_1.6.4.1_s rc/ns_server/data/ns_1/isasl.pw" PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.70.0>}, {name,ns_config_log}, {mfargs,{ns_config_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.64.0>}, {name,ns_config_sup}, {mfargs,{ns_config_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.72.0> 2011-03-08 21:17:32 =============================================================================== ns_log:init(): Couldn't load logs from "/home/dev/membase/membase-server-communi ty_1.6.4.1_src/ns_server/data/ns_1/ns_log": {error, enoent} PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.72.0>}, {name,ns_log}, {mfargs,{ns_log,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.73.0>}, {name,ns_log_events}, {mfargs,{gen_event,start_link,[{local,ns_log_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.74.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_mail_sup} started [{pid,<5643.75.0>}, {name,ns_mail}, {mfargs,{ns_mail,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.74.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_mail_sup} started [{pid,<5643.76.0>}, {name,ns_mail_log}, {mfargs,{ns_mail_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.74.0>}, {name,ns_mail_sup}, {mfargs,{ns_mail_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.78.0>}, {name,ns_node_disco_events}, {mfargs,{gen_event,start_link,[{local,ns_node_disco_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.79.0> 2011-03-08 21:17:32 =============================================================================== Initting ns_node_disco with [] INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_log: logging ns_node_disco:3:Initial otp cookie generated: ymwdluoqgoymhpfu INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: otp -> [{cookie,ymwdluoqgoymhpfu}] INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.79.0>}, {name,ns_node_disco}, {mfargs,{ns_node_disco,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.83.0>}, {name,ns_node_disco_log}, {mfargs,{ns_node_disco_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.84.0>}, {name,ns_node_disco_conf_events}, {mfargs,{ns_node_disco_conf_events,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init pulling INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init pushing INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init reannouncing INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config on otp INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: otp -> [{cookie,ymwdluoqgoymhpfu}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: alerts -> [{email,[]}, {email_alerts,false}, [{user,undefined}, {pass,"********"}, {addr,undefined}, {port,undefined}, {encrypt,false}], {alerts,[server_down,server_unresponsive,server_up,server_joined,server_left, bucket_created,bucket_deleted,bucket_auth_failed]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: buckets -> [{configs,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: memory_quota -> 7007 INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: moxi -> [{port,11211},{verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config on nodes_wanted INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: nodes_wanted -> ['ns_1@10.101.0.178'] INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: port_servers -> [{moxi,"./bin/moxi/moxi", ["-Z", {"port_listen=~B,default_bucket_name=default,downstream_max=1024,downstr eam_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,connect_timeout =400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200,downstream_tim eout=5000,wait_queue_timeout=200", [port]}, "-z", {"url=http://127.0.0.1:~B/pools/default/saslBucketsStreaming", [{rest,port}]}, "-p","0","-Y","y","-O","stderr", {"~s",[verbosity]}], [{env,[{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",{"~s",[{ns_moxi_sup,rest_user,[]}]}}, {"MOXI_SASL_PLAIN_PWD",{"~s",[{ns_moxi_sup,rest_pass,[]}]}}]}, use_stdio,stderr_to_stdout,stream]}, {memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p", {"~B",[port]}, "-E","./bin/bucket_engine/bucket_engine.so","-B","binary","-r", "-c","10000","-e", {"admin=~s;default_bucket_name=default;auto_create=false", [admin_user]}, {"~s",[verbosity]}], [{env,[{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE",{"~s",[{isasl,path}]}}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: replication -> [{enabled,true}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: rest -> [{port,8091}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: rest_creds -> ******** PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.85.0>}, {name,ns_config_rep}, {mfargs,{ns_config_rep,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',isasl} -> [{path,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/ns _1/isasl.pw"}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.77.0>}, {name,ns_node_disco_sup}, {mfargs,{ns_node_disco_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',membership} -> active INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',memcached} -> [{port,11210}, {dbdir,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/n s_1"}, {admin_user,"_admin"}, {admin_pass,"_admin"}, {bucket_engine,"./bin/bucket_engine/bucket_engine.so"}, {engines,[{membase,[{engine,"bin/ep_engine/ep.so"}, {initfile,"priv/init.sql"}]}, {memcached,[{engine,"bin/memcached/default_engine.so"}]}]}, {verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',ns_log} -> [{filename,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/dat a/ns_1/ns_log"}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== Pushing config INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== Pushing config done PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.90.0>}, {name,ns_heart}, {mfargs,{ns_heart,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.91.0>}, {name,ns_doctor}, {mfargs,{ns_doctor,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.91.0> 2011-03-08 21:17:32 =============================================================================== ns_1@10.101.0.178:ns_doctor:78: Got initial status [{'ns_1@10.101.0.178', [{last_heard, {1299,637052,138582}}, {active_buckets,[]}, {memory, [{total,7531432}, {processes,1422140}, {processes_used, 1416268}, {system,6109292}, {atom,312269}, {atom_used,290053}, {binary,48088}, {code,2099855}, {ets,196672}]}, {cluster_compatibility_ver sion, 1}, {version, [{os_mon,"2.2.5"}, {kernel,"2.14.1"}, {sasl,"2.1.9.2"}, {ns_server,[]}, {menelaus,[]}, {stdlib,"1.17.1"}]}, {system_arch, "tile-tilera-linux-gnu"}, {wall_clock,1}, {memory_data, {8421703680,1645412352, {<5643.7.0>,256896}}}, {disk_data, [{"/",41341688,59}, {"/dev/shm",4112128, 0}]}, {meminfo, <<"MemTotal: 82243 20 kB\nMemFree: 6617664 kB\nBuffers: 125696 kB\nCached: 505472 kB\nSwapCached: 0 kB\nActive: 554048 kB\nInactive : 137920 kB\nActive(anon): 60928 kB\nInactive(anon): 0 kB\nA ctive(file): 493120 kB\nInactive(file): 137920 kB\nUnevictable: 0 kB\nMlocked: 0 kB\nHighTotal: 7405568 kB\nHighFree: 6120896 kB\nLowTotal: 818752 kB\nLowFree: 496768 kB\nSwapTotal : 0 kB\nSwapFree: 0 kB\nDirty: 128 kB\nWr iteback: 0 kB\nAnonPages: 62656 kB\nMapped: 6592 kB\nShmem: 0 kB\nSlab: 190208 kB\nSReclaimable: 33280 kB\nSUnreclaim: 156928 kB\nKernelStack: 30400 kB\nPageTables : 4864 kB\nNFS_Unstable: 0 kB\nBounce: 0 kB\nWri tebackTmp: 0 kB\nCommitLimit: 4046592 kB\nCommitted_AS: 646080 kB\nVmallocTotal: 16256 kB\nVmallocUsed: 7616 kB\nVmallocChunk: 6272 kB\nSequestered: 510656 kB\nHugePages_Total: 8\nHugePages_Free: 8\nHugePages_Rsvd: 0\nHugePages_Surp: 0\nHugepagesize: 16384 kB\n">>}, {replication,[]}, {system_memory_data, [{system_total_memory, 8421703680}, {free_swap,0}, {total_swap,0}, {cached_memory, 517603328}, {buffered_memory, 128712704}, {free_memory, 6776487936}, {total_memory, 8421703680}]}, {statistics, [{wall_clock, {1932,252}}, {context_switches, {4673,0}}, {garbage_collection, {824,1872734,0}}, {io, {{input,2223572}, {output,126533}}}, {reductions, {925420,925420}}, {run_queue,2}, {runtime, {1510,1510}}]}]}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.95.0>}, {name,menelaus_web}, {mfargs,{menelaus_web,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.97.0>}, {name,menelaus_event}, {mfargs,{menelaus_event,start_link,[]}}, {restart_type,transient}, {shutdown,5000}, {child_type,worker}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.98.0>}, {name,hot_keys_keeper}, {mfargs,{hot_keys_keeper,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== ns_log: logging menelaus_app:1:Membase Server has started on web port 8091 on no de 'ns_1@10.101.0.178'. PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.94.0>}, {name,menelaus}, {mfargs,{menelaus_app,start_subapp,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.100.0>}, {name,ns_port_init}, {mfargs,{ns_port_init,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.101.0> 2011-03-08 21:17:32 =============================================================================== starting ns_port_server with delay of 5000 PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.101.0>}, {name, {moxi,"./bin/moxi/moxi", ["-Z", "port_listen=11211,default_bucket_name=default,downstream_max= 1024,downstream_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,con nect_timeout=400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200,do wnstream_timeout=5000,wait_queue_timeout=200", "-z", "url=http://127.0.0.1:8091/pools/default/saslBucketsStreaming" , "-p","0","-Y","y","-O","stderr",[]], [{env, [{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",[]}, {"MOXI_SASL_PLAIN_PWD",[]}]}, use_stdio,stderr_to_stdout,stream]}}, {mfargs, {supervisor_cushion,start_link, [moxi,5000,ns_port_server,start_link, [moxi,"./bin/moxi/moxi", ["-Z", "port_listen=11211,default_bucket_name=default,downstream_ma x=1024,downstream_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,c onnect_timeout=400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200, downstream_timeout=5000,wait_queue_timeout=200", "-z", "url=http://127.0.0.1:8091/pools/default/saslBucketsStreamin g", "-p","0","-Y","y","-O","stderr",[]], [{env, [{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",[]}, {"MOXI_SASL_PLAIN_PWD",[]}]}, use_stdio,stderr_to_stdout,stream]]]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.103.0> 2011-03-08 21:17:32 =============================================================================== starting ns_port_server with delay of 5000 PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.103.0>}, {name, {memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p","11210", "-E","./bin/bucket_engine/bucket_engine.so","-B","binary", "-r","-c","10000","-e", "admin=_admin;default_bucket_name=default;auto_create=false", []], [{env, [{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE", "/home/dev/membase/membase-server-community_1.6.4.1_src/ ns_server/data/ns_1/isasl.pw"}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]}}, {mfargs, {supervisor_cushion,start_link, [memcached,5000,ns_port_server,start_link, [memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p", "11210","-E","./bin/bucket_engine/bucket_engine.so","-B", "binary","-r","-c","10000","-e", "admin=_admin;default_bucket_name=default;auto_create=false" , []], [{env, [{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE", "/home/dev/membase/membase-server-community_1.6.4.1_sr c/ns_server/data/ns_1/isasl.pw"}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]]]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.99.0>}, {name,ns_port_sup}, {mfargs,{ns_port_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.105.0>}, {name,ns_tick_event}, {mfargs,{gen_event,start_link,[{local,ns_tick_event}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.106.0>}, {name,ns_stats_event}, {mfargs,{gen_event,start_link,[{local,ns_stats_event}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.107.0>}, {name,ns_good_bucket_worker}, {mfargs,{work_queue,start_link,[ns_good_bucket_worker]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.108.0>}, {name,ns_good_bucket_sup}, {mfargs,{ns_bucket_sup,start_link, [ns_good_bucket_sup, #Fun<ns_server_sup.0.109880752>, ns_good_bucket_worker]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== ns_1@10.101.0.178:misc:725: start_singleton(gen_fsm, ns_orchestrator, [], []): s tarted as <5643.110.0> on 'ns_1@10.101.0.178' PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.110.0>}, {name,ns_orchestrator}, {mfargs,{ns_orchestrator,start_link,[]}}, {restart_type,permanent}, {shutdown,20}, {child_type,worker}] PROGRESS REPORT <5643.115.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_sup} started [{pid,<5643.116.0>}, {name,mnesia_event}, {mfargs,{mnesia_sup,start_event,[]}}, {restart_type,permanent}, {shutdown,30000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.118.0>}, {name,mnesia_monitor}, {mfargs,{mnesia_monitor,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.119.0>}, {name,mnesia_subscr}, {mfargs,{mnesia_subscr,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.120.0>}, {name,mnesia_locker}, {mfargs,{mnesia_locker,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.121.0>}, {name,mnesia_recover}, {mfargs,{mnesia_recover,start,[]}}, {restart_type,permanent}, {shutdown,180000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.122.0>}, {name,mnesia_tm}, {mfargs,{mnesia_tm,start,[]}}, {restart_type,permanent}, {shutdown,30000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.123.0>}, {name,mnesia_checkpoint_sup}, {mfargs,{mnesia_checkpoint_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.124.0>}, {name,mnesia_snmp_sup}, {mfargs,{mnesia_snmp_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.125.0>}, {name,mnesia_controller}, {mfargs,{mnesia_controller,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.126.0>}, {name,mnesia_late_loader}, {mfargs,{mnesia_late_loader,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.115.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_sup} started [{pid,<5643.117.0>}, {name,mnesia_kernel_sup}, {mfargs,{mnesia_kernel_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.7.0> 2011-03-08 21:17:33 =============================================================================== application mnesia started_at 'ns_1@10.101.0.178' PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.129.0>}, {name,disk_log_sup}, {mfargs,{disk_log_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.130.0>}, {name,disk_log_server}, {mfargs,{disk_log_server,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.133.0>}, {name,dets_sup}, {mfargs,{dets_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.134.0>}, {name,dets}, {mfargs,{dets_server,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:250: Committed schema to disk. INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:196: Current config: [{access_module,mnesia}, {auto_repair,true}, {backup_module, mnesia_backup}, {checkpoints,[]}, {db_nodes, ['ns_1@10.101.0.178']}, {debug,verbose}, {directory, "/home/dev/membase/membase-se rver-community_1.6.4.1_src/ns_server/Mnesia.ns_1@10.101.0.178"}, {dump_log_load_regulation, false}, {dump_log_time_threshold, 180000}, {dump_log_update_in_place, true}, {dump_log_write_threshold, 1000}, {embedded_mnemosyne,false}, {event_module,mnesia_event}, {extra_db_nodes,[]}, {fallback_activated,false}, {held_locks,[]}, {ignore_fallback_at_startup, false}, {fallback_error_function, {mnesia,lkill}}, {is_running,yes}, {local_tables,[schema]}, {lock_queue,[]}, {log_version,"4.3"}, {master_node_tables,[]}, {max_wait_for_decision, 10000}, {protocol_version,{7,6}}, {running_db_nodes, ['ns_1@10.101.0.178']}, {schema_location,opt_disc}, {schema_version,{3,0}}, {subscribers, [<5643.116.0>, <5643.111.0>]}, {tables,[schema]}, {transaction_commits,3}, {transaction_failures,0}, {transaction_log_writes,1}, {transaction_restarts,0}, {transactions,[]}, {use_dir,true}, {core_dir,false}, {no_table_loaders,2}, {dc_dump_limit,4}, {send_compressed,0}, {version,"4.4.15"}] INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:144: Info from Mnesia: Create Directory "/home/dev/membase/membase-server-community_1.6.4.1_src/ns_serv er/Mnesia.ns_1@10.101.0.178" INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:170: Mnesia table event: {write,schema, {schema,schema, [{name,schema}, {type,set}, {ram_copies,[]}, {disc_copies,['ns_1@10.101.0.178']}, {disc_only_copies,[]}, {load_order,0}, {access_mode,read_write}, {index,[]}, {snmp,[]}, {local_content,false}, {record_name,schema}, {attributes,[table,cstruct]}, {user_properties,[]}, {frag_properties,[]}, {cookie,{{1299,637053,227828},'ns_1@10.101.0.178'}}, {version,{{3,0},{'ns_1@10.101.0.178',{1299,637053,410903}}}}]}, [{schema,schema, [{name,schema}, {type,set}, {ram_copies,[]}, {disc_copies,[]}, {disc_only_copies,[]}, {load_order,0}, {access_mode,read_write}, {index,[]}, {snmp,[]}, {local_content,false}, {record_name,schema}, {attributes,[table,cstruct]}, {user_properties,[]}, {frag_properties,[]}, {cookie,{{1299,637053,227828},'ns_1@10.101.0.178'}}, {version,{{2,0},[]}}]}], {tid,3,<5643.128.0>}} PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.111.0>}, {name,ns_mnesia}, {mfargs,{ns_mnesia,start_link,[]}}, {restart_type,permanent}, {shutdown,10000}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.146.0>}, {name,ns_bad_bucket_worker}, {mfargs,{work_queue,start_link,[ns_bad_bucket_worker]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.147.0>}, {name,ns_bad_bucket_sup}, {mfargs,{ns_bucket_sup,start_link, [ns_bad_bucket_sup, #Fun<ns_server_sup.1.88526718>, ns_bad_bucket_worker]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.148.0>}, {name,ns_moxi_sup}, {mfargs,{ns_moxi_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:misc:725: start_singleton(gen_server, ns_tick, [], []): starte d as <5643.149.0> on 'ns_1@10.101.0.178' PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.149.0>}, {name,ns_tick}, {mfargs,{ns_tick,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.71.0>}, {name,ns_server_sup}, {mfargs,{ns_server_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.7.0> 2011-03-08 21:17:34 =============================================================================== application ns_server started_at 'ns_1@10.101.0.178' INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== config change: {node,'ns_1@10.101.0.178',memcached} -> [{dbdir,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/n s_1"}, {port,11210}, {admin_user,"_admin"}, {admin_pass,"_admin"}, {bucket_engine,"./bin/bucket_engine/bucket_engine.so"}, {engines,[{membase,[{engine,"bin/ep_engine/ep.so"}, {initfile,"priv/init.sql"}]}, {memcached,[{engine,"bin/memcached/default_engine.so"}]}]}, {verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config done INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== config change: memory_quota -> 7007 INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config done INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default": {error, enoent} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-0.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-1.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-2.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-3.mb": {error , enoen t} INFO REPORT <5643.152.0> 2011-03-08 21:18:01 =============================================================================== ns_log: logging menelaus_web:12:Created bucket "default" of type: membase INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== config change: buckets -> [{configs,[{"default", [{num_replicas,1}, {ram_quota,7347372032}, {auth_type,sasl}, {sasl_password,[]}, {type,membase}, {num_vbuckets,1024}, {ht_size,3079}, {tap_keepalive,0}, {tap_noop_interval,20}, {max_txn_size,1000}, {ht_locks,5}, {servers,[]}, {map,undefined}]}]}] INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== Writing isasl passwd file: "/home/dev/membase/membase-server-community_1.6.4.1_s rc/ns_server/data/ns_1/isasl.pw" INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:18:01 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:18:01 =============================================================================== Pushing config done SUPERVISOR REPORT <5643.94.0> 2011-03-08 21:18:02 =============================================================================== Reporting supervisor {local,menelaus_sup} Child process errorContext child_terminated reason {noproc,{gen_server,call,['ns_memcached-default',topkeys,30000]}} pid <5643.98.0> name hot_keys_keeper mfargs {hot_keys_keeper,start_link,[]} restart_type permanent shutdown 5000 child_type worker PROGRESS REPORT <5643.94.0> 2011-03-08 21:18:02 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.174.0>}, {name,hot_keys_keeper}, {mfargs,{hot_keys_keeper,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.102.0> 2011-03-08 21:18:02 =============================================================================== moxi<0.102.0>: 2011-03-08 21:18:32: (agent_config.c.650) ERROR: bad JSON configu ration: Empty serverList ({ moxi<0.102.0>: "name": "default", moxi<0.102.0>: "nodeLocator": "vbucket", moxi<0.102.0>: "saslPassword": "", moxi<0.102.0>: "nodes": [], moxi<0.102.0>: "vBucketServerMap": { moxi<0.102.0>: "hashAlgorithm": "CRC", moxi<0.102.0>: "numReplicas": 1, moxi<0.102.0>: "serverList": [], moxi<0.102.0>: "vBucketMap": [[-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1 INFO REPORT <5643.146.0> 2011-03-08 21:18:02
===============================================================================
Hi, Here is the preceding Log report. Sorry for the length but I wanted to include as much detail as possible. Does anything look suspect on first impression? INFO REPORT <0.53.0> 2011-03-08 21:17:31 =============================================================================== nonode@nohost:log_os_info:25: OS type: {unix,linux} Version: {2,6,36} Runtime info: [{otp_release,"R14B"}, {erl_version,"5.8.1"}, {erl_version_long,"Erlang R14B (erts-5.8.1) [source] [smp:64:54] [rq:64] [async-threads:16] [kernel-poll:false]\n"}, {system_arch_raw,"tile-tilera-linux-gnu"}, {system_arch,"tile-tilera-linux-gnu"}, {localtime,{{2011,3,8},{21,17,31}}}, {memory,[{total,6464112}, {processes,849364}, {processes_used,841076}, {system,5614748}, {atom,252953}, {atom_used,249343}, {binary,17288}, {code,1735744}, {ets,162552}]}, {loaded,[ns_info,log_os_info,ns_log_mf_h,ns_server_cluster_sup, ns_server,timer,cpu_sup,io_lib_fread,memsup,disksup, os_mon,io_lib_pretty,unicode,io_lib_format,io_lib,io, sasl_report,release_handler,calendar,overload, alarm_handler,sasl_report_tty_h,sasl,ns_bootstrap, file_io_server,orddict,erl_eval,file,c, error_logger_tty_h,queue,kernel_config,user,user_sup, supervisor_bridge,standard_error,ets,gb_sets, hipe_unified_loader,packages,code_server,code, file_server,net_kernel,global_group,erl_distribution, filename,inet_gethost_native,inet_parse,inet,inet_udp, os,inet_config,inet_db,global,gb_trees,rpc,dict, supervisor,kernel,application_master,sys,application, gen_server,erl_parse,proplists,erl_scan,lists, application_controller,proc_lib,gen,gen_event, error_logger,heart,error_handler,erlang, erl_prim_loader,prim_zip,zlib,prim_file,prim_inet, init,otp_ring0]}, {applications,[{os_mon,"CPO CXC 138 46","2.2.5"}, {kernel,"ERTS CXC 138 10","2.14.1"}, {sasl,"SASL CXC 138 11","2.1.9.2"}, {ns_server,"Membase server",[]}, {menelaus,"Membase menelaus",[]}, {stdlib,"ERTS CXC 138 10","1.17.1"}]}, {pre_loaded,[erlang,erl_prim_loader,prim_zip,zlib,prim_file, prim_inet,init,otp_ring0]}, {process_count,43}, {node,nonode@nohost}, {nodes,[]}, {registered,[application_controller,erl_prim_loader, standard_error,global_group,user,timer_server, ns_server_cluster_sup,release_handler, standard_error_sup,init,overload,kernel_safe_sup, alarm_handler,os_mon_sup,rex,cpu_sup,sasl_sup, memsup,inet_db,kernel_sup,disksup, global_name_server,code_server,error_logger, file_server_2,sasl_safe_sup]}, {cookie,nocookie}, {wordsize,4}, {wall_clock,1}] INFO REPORT <0.54.0> 2011-03-08 21:17:31 =============================================================================== reading ip config from "priv/ip" PROGRESS REPORT <0.55.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,inet_gethost_native_sup} started [{pid,<0.56.0>},{mfa,{inet_gethost_native,init,[[]]}}] PROGRESS REPORT <0.26.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<0.55.0>}, {name,inet_gethost_native_sup}, {mfargs,{inet_gethost_native,start_link,[]}}, {restart_type,temporary}, {shutdown,1000}, {child_type,worker}] PROGRESS REPORT <0.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<0.58.0>}, {name,erl_epmd}, {mfargs,{erl_epmd,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <0.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<0.59.0>}, {name,auth}, {mfargs,{auth,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.57.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,net_sup} started [{pid,<5643.60.0>}, {name,net_kernel}, {mfargs,{net_kernel,start_link,[['ns_1@10.101.0.178',longnames]]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.11.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,kernel_sup} started [{pid,<5643.57.0>}, {name,net_sup_dynamic}, {mfargs,{erl_distribution,start_link, [['ns_1@10.101.0.178',longnames]]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.54.0>}, {name,dist_manager}, {mfargs,{dist_manager,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.63.0>}, {name,ns_cluster}, {mfargs,{ns_cluster,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.64.0> 2011-03-08 21:17:31 =============================================================================== loading config from "priv/config" PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:31 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.65.0>}, {name,ns_config_events}, {mfargs,{gen_event,start_link,[{local,ns_config_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.66.0>}, {name,ns_config}, {mfargs,{ns_config,start_link,["priv/config",ns_config_default]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.68.0>}, {name,ns_config_isasl_sync}, {mfargs,{ns_config_isasl_sync,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== isasl_sync init: ["/home/dev/membase/membase-server-community_1.6.4.1_src/ns_ser ver/data/ns_1/isasl.pw", "_admin","_admin"] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== isasl_sync init buckets: [] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== Writing isasl passwd file: "/home/dev/membase/membase-server-community_1.6.4.1_s rc/ns_server/data/ns_1/isasl.pw" PROGRESS REPORT <5643.64.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_config_sup} started [{pid,<5643.70.0>}, {name,ns_config_log}, {mfargs,{ns_config_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.64.0>}, {name,ns_config_sup}, {mfargs,{ns_config_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.72.0> 2011-03-08 21:17:32 =============================================================================== ns_log:init(): Couldn't load logs from "/home/dev/membase/membase-server-communi ty_1.6.4.1_src/ns_server/data/ns_1/ns_log": {error, enoent} PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.72.0>}, {name,ns_log}, {mfargs,{ns_log,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.73.0>}, {name,ns_log_events}, {mfargs,{gen_event,start_link,[{local,ns_log_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.74.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_mail_sup} started [{pid,<5643.75.0>}, {name,ns_mail}, {mfargs,{ns_mail,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.74.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_mail_sup} started [{pid,<5643.76.0>}, {name,ns_mail_log}, {mfargs,{ns_mail_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.74.0>}, {name,ns_mail_sup}, {mfargs,{ns_mail_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.78.0>}, {name,ns_node_disco_events}, {mfargs,{gen_event,start_link,[{local,ns_node_disco_events}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.79.0> 2011-03-08 21:17:32 =============================================================================== Initting ns_node_disco with [] INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_log: logging ns_node_disco:3:Initial otp cookie generated: ymwdluoqgoymhpfu INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: otp -> [{cookie,ymwdluoqgoymhpfu}] INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.80.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.79.0>}, {name,ns_node_disco}, {mfargs,{ns_node_disco,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.83.0>}, {name,ns_node_disco_log}, {mfargs,{ns_node_disco_log,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.84.0>}, {name,ns_node_disco_conf_events}, {mfargs,{ns_node_disco_conf_events,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init pulling INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init pushing INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== ns_config_rep init reannouncing INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config on otp INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: otp -> [{cookie,ymwdluoqgoymhpfu}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: alerts -> [{email,[]}, {email_alerts,false}, [{user,undefined}, {pass,"********"}, {addr,undefined}, {port,undefined}, {encrypt,false}], {alerts,[server_down,server_unresponsive,server_up,server_joined,server_left, bucket_created,bucket_deleted,bucket_auth_failed]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: buckets -> [{configs,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: memory_quota -> 7007 INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: moxi -> [{port,11211},{verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config on nodes_wanted INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: nodes_wanted -> ['ns_1@10.101.0.178'] INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.87.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco cookie_sync INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: port_servers -> [{moxi,"./bin/moxi/moxi", ["-Z", {"port_listen=~B,default_bucket_name=default,downstream_max=1024,downstr eam_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,connect_timeout =400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200,downstream_tim eout=5000,wait_queue_timeout=200", [port]}, "-z", {"url=http://127.0.0.1:~B/pools/default/saslBucketsStreaming", [{rest,port}]}, "-p","0","-Y","y","-O","stderr", {"~s",[verbosity]}], [{env,[{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",{"~s",[{ns_moxi_sup,rest_user,[]}]}}, {"MOXI_SASL_PLAIN_PWD",{"~s",[{ns_moxi_sup,rest_pass,[]}]}}]}, use_stdio,stderr_to_stdout,stream]}, {memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p", {"~B",[port]}, "-E","./bin/bucket_engine/bucket_engine.so","-B","binary","-r", "-c","10000","-e", {"admin=~s;default_bucket_name=default;auto_create=false", [admin_user]}, {"~s",[verbosity]}], [{env,[{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE",{"~s",[{isasl,path}]}}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: replication -> [{enabled,true}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: rest -> [{port,8091}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: rest_creds -> ******** PROGRESS REPORT <5643.77.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_node_disco_sup} started [{pid,<5643.85.0>}, {name,ns_config_rep}, {mfargs,{ns_config_rep,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',isasl} -> [{path,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/ns _1/isasl.pw"}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.77.0>}, {name,ns_node_disco_sup}, {mfargs,{ns_node_disco_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',membership} -> active INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted updated: ['ns_1@10.101.0.178'], with cookie: ymwdluo qgoymhpfu INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',memcached} -> [{port,11210}, {dbdir,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/n s_1"}, {admin_user,"_admin"}, {admin_pass,"_admin"}, {bucket_engine,"./bin/bucket_engine/bucket_engine.so"}, {engines,[{membase,[{engine,"bin/ep_engine/ep.so"}, {initfile,"priv/init.sql"}]}, {memcached,[{engine,"bin/memcached/default_engine.so"}]}]}, {verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== config change: {node,'ns_1@10.101.0.178',ns_log} -> [{filename,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/dat a/ns_1/ns_log"}] INFO REPORT <5643.65.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== Pushing config INFO REPORT <5643.88.0> 2011-03-08 21:17:32 =============================================================================== ns_node_disco: nodes_wanted pong: ['ns_1@10.101.0.178'], with cookie: ymwdluoqgo ymhpfu INFO REPORT <5643.85.0> 2011-03-08 21:17:32 =============================================================================== Pushing config done PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.90.0>}, {name,ns_heart}, {mfargs,{ns_heart,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.91.0>}, {name,ns_doctor}, {mfargs,{ns_doctor,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.91.0> 2011-03-08 21:17:32 =============================================================================== ns_1@10.101.0.178:ns_doctor:78: Got initial status [{'ns_1@10.101.0.178', [{last_heard, {1299,637052,138582}}, {active_buckets,[]}, {memory, [{total,7531432}, {processes,1422140}, {processes_used, 1416268}, {system,6109292}, {atom,312269}, {atom_used,290053}, {binary,48088}, {code,2099855}, {ets,196672}]}, {cluster_compatibility_ver sion, 1}, {version, [{os_mon,"2.2.5"}, {kernel,"2.14.1"}, {sasl,"2.1.9.2"}, {ns_server,[]}, {menelaus,[]}, {stdlib,"1.17.1"}]}, {system_arch, "tile-tilera-linux-gnu"}, {wall_clock,1}, {memory_data, {8421703680,1645412352, {<5643.7.0>,256896}}}, {disk_data, [{"/",41341688,59}, {"/dev/shm",4112128, 0}]}, {meminfo, <<"MemTotal: 82243 20 kB\nMemFree: 6617664 kB\nBuffers: 125696 kB\nCached: 505472 kB\nSwapCached: 0 kB\nActive: 554048 kB\nInactive : 137920 kB\nActive(anon): 60928 kB\nInactive(anon): 0 kB\nA ctive(file): 493120 kB\nInactive(file): 137920 kB\nUnevictable: 0 kB\nMlocked: 0 kB\nHighTotal: 7405568 kB\nHighFree: 6120896 kB\nLowTotal: 818752 kB\nLowFree: 496768 kB\nSwapTotal : 0 kB\nSwapFree: 0 kB\nDirty: 128 kB\nWr iteback: 0 kB\nAnonPages: 62656 kB\nMapped: 6592 kB\nShmem: 0 kB\nSlab: 190208 kB\nSReclaimable: 33280 kB\nSUnreclaim: 156928 kB\nKernelStack: 30400 kB\nPageTables : 4864 kB\nNFS_Unstable: 0 kB\nBounce: 0 kB\nWri tebackTmp: 0 kB\nCommitLimit: 4046592 kB\nCommitted_AS: 646080 kB\nVmallocTotal: 16256 kB\nVmallocUsed: 7616 kB\nVmallocChunk: 6272 kB\nSequestered: 510656 kB\nHugePages_Total: 8\nHugePages_Free: 8\nHugePages_Rsvd: 0\nHugePages_Surp: 0\nHugepagesize: 16384 kB\n">>}, {replication,[]}, {system_memory_data, [{system_total_memory, 8421703680}, {free_swap,0}, {total_swap,0}, {cached_memory, 517603328}, {buffered_memory, 128712704}, {free_memory, 6776487936}, {total_memory, 8421703680}]}, {statistics, [{wall_clock, {1932,252}}, {context_switches, {4673,0}}, {garbage_collection, {824,1872734,0}}, {io, {{input,2223572}, {output,126533}}}, {reductions, {925420,925420}}, {run_queue,2}, {runtime, {1510,1510}}]}]}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.95.0>}, {name,menelaus_web}, {mfargs,{menelaus_web,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.97.0>}, {name,menelaus_event}, {mfargs,{menelaus_event,start_link,[]}}, {restart_type,transient}, {shutdown,5000}, {child_type,worker}] PROGRESS REPORT <5643.94.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.98.0>}, {name,hot_keys_keeper}, {mfargs,{hot_keys_keeper,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== ns_log: logging menelaus_app:1:Membase Server has started on web port 8091 on no de 'ns_1@10.101.0.178'. PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.94.0>}, {name,menelaus}, {mfargs,{menelaus_app,start_subapp,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.100.0>}, {name,ns_port_init}, {mfargs,{ns_port_init,start_link,[]}}, {restart_type,transient}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.101.0> 2011-03-08 21:17:32 =============================================================================== starting ns_port_server with delay of 5000 PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.101.0>}, {name, {moxi,"./bin/moxi/moxi", ["-Z", "port_listen=11211,default_bucket_name=default,downstream_max= 1024,downstream_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,con nect_timeout=400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200,do wnstream_timeout=5000,wait_queue_timeout=200", "-z", "url=http://127.0.0.1:8091/pools/default/saslBucketsStreaming" , "-p","0","-Y","y","-O","stderr",[]], [{env, [{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",[]}, {"MOXI_SASL_PLAIN_PWD",[]}]}, use_stdio,stderr_to_stdout,stream]}}, {mfargs, {supervisor_cushion,start_link, [moxi,5000,ns_port_server,start_link, [moxi,"./bin/moxi/moxi", ["-Z", "port_listen=11211,default_bucket_name=default,downstream_ma x=1024,downstream_conn_max=4,connect_max_errors=5,connect_retry_interval=30000,c onnect_timeout=400,auth_timeout=100,cycle=200,downstream_conn_queue_timeout=200, downstream_timeout=5000,wait_queue_timeout=200", "-z", "url=http://127.0.0.1:8091/pools/default/saslBucketsStreamin g", "-p","0","-Y","y","-O","stderr",[]], [{env, [{"EVENT_NOSELECT","1"}, {"MOXI_SASL_PLAIN_USR",[]}, {"MOXI_SASL_PLAIN_PWD",[]}]}, use_stdio,stderr_to_stdout,stream]]]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] INFO REPORT <5643.103.0> 2011-03-08 21:17:32 =============================================================================== starting ns_port_server with delay of 5000 PROGRESS REPORT <5643.99.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_port_sup} started [{pid,<5643.103.0>}, {name, {memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p","11210", "-E","./bin/bucket_engine/bucket_engine.so","-B","binary", "-r","-c","10000","-e", "admin=_admin;default_bucket_name=default;auto_create=false", []], [{env, [{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE", "/home/dev/membase/membase-server-community_1.6.4.1_src/ ns_server/data/ns_1/isasl.pw"}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]}}, {mfargs, {supervisor_cushion,start_link, [memcached,5000,ns_port_server,start_link, [memcached,"./bin/memcached/memcached", ["-X","./bin/memcached/stdin_term_handler.so","-p", "11210","-E","./bin/bucket_engine/bucket_engine.so","-B", "binary","-r","-c","10000","-e", "admin=_admin;default_bucket_name=default;auto_create=false" , []], [{env, [{"EVENT_NOSELECT","1"}, {"MEMCACHED_TOP_KEYS","100"}, {"ISASL_PWFILE", "/home/dev/membase/membase-server-community_1.6.4.1_sr c/ns_server/data/ns_1/isasl.pw"}, {"ISASL_DB_CHECK_TIME","1"}]}, use_stdio,stderr_to_stdout,stream]]]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.99.0>}, {name,ns_port_sup}, {mfargs,{ns_port_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.105.0>}, {name,ns_tick_event}, {mfargs,{gen_event,start_link,[{local,ns_tick_event}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.106.0>}, {name,ns_stats_event}, {mfargs,{gen_event,start_link,[{local,ns_stats_event}]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.107.0>}, {name,ns_good_bucket_worker}, {mfargs,{work_queue,start_link,[ns_good_bucket_worker]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.108.0>}, {name,ns_good_bucket_sup}, {mfargs,{ns_bucket_sup,start_link, [ns_good_bucket_sup, #Fun<ns_server_sup.0.109880752>, ns_good_bucket_worker]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== ns_1@10.101.0.178:misc:725: start_singleton(gen_fsm, ns_orchestrator, [], []): s tarted as <5643.110.0> on 'ns_1@10.101.0.178' PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:32 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.110.0>}, {name,ns_orchestrator}, {mfargs,{ns_orchestrator,start_link,[]}}, {restart_type,permanent}, {shutdown,20}, {child_type,worker}] PROGRESS REPORT <5643.115.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_sup} started [{pid,<5643.116.0>}, {name,mnesia_event}, {mfargs,{mnesia_sup,start_event,[]}}, {restart_type,permanent}, {shutdown,30000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.118.0>}, {name,mnesia_monitor}, {mfargs,{mnesia_monitor,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.119.0>}, {name,mnesia_subscr}, {mfargs,{mnesia_subscr,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.120.0>}, {name,mnesia_locker}, {mfargs,{mnesia_locker,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.121.0>}, {name,mnesia_recover}, {mfargs,{mnesia_recover,start,[]}}, {restart_type,permanent}, {shutdown,180000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.122.0>}, {name,mnesia_tm}, {mfargs,{mnesia_tm,start,[]}}, {restart_type,permanent}, {shutdown,30000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.123.0>}, {name,mnesia_checkpoint_sup}, {mfargs,{mnesia_checkpoint_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.124.0>}, {name,mnesia_snmp_sup}, {mfargs,{mnesia_snmp_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.125.0>}, {name,mnesia_controller}, {mfargs,{mnesia_controller,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.117.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_kernel_sup} started [{pid,<5643.126.0>}, {name,mnesia_late_loader}, {mfargs,{mnesia_late_loader,start,[]}}, {restart_type,permanent}, {shutdown,3000}, {child_type,worker}] PROGRESS REPORT <5643.115.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,mnesia_sup} started [{pid,<5643.117.0>}, {name,mnesia_kernel_sup}, {mfargs,{mnesia_kernel_sup,start,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.7.0> 2011-03-08 21:17:33 =============================================================================== application mnesia started_at 'ns_1@10.101.0.178' PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.129.0>}, {name,disk_log_sup}, {mfargs,{disk_log_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.130.0>}, {name,disk_log_server}, {mfargs,{disk_log_server,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.133.0>}, {name,dets_sup}, {mfargs,{dets_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,1000}, {child_type,supervisor}] PROGRESS REPORT <5643.26.0> 2011-03-08 21:17:33 =============================================================================== supervisor {local,kernel_safe_sup} started [{pid,<5643.134.0>}, {name,dets}, {mfargs,{dets_server,start_link,[]}}, {restart_type,permanent}, {shutdown,2000}, {child_type,worker}] INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:250: Committed schema to disk. INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:196: Current config: [{access_module,mnesia}, {auto_repair,true}, {backup_module, mnesia_backup}, {checkpoints,[]}, {db_nodes, ['ns_1@10.101.0.178']}, {debug,verbose}, {directory, "/home/dev/membase/membase-se rver-community_1.6.4.1_src/ns_server/Mnesia.ns_1@10.101.0.178"}, {dump_log_load_regulation, false}, {dump_log_time_threshold, 180000}, {dump_log_update_in_place, true}, {dump_log_write_threshold, 1000}, {embedded_mnemosyne,false}, {event_module,mnesia_event}, {extra_db_nodes,[]}, {fallback_activated,false}, {held_locks,[]}, {ignore_fallback_at_startup, false}, {fallback_error_function, {mnesia,lkill}}, {is_running,yes}, {local_tables,[schema]}, {lock_queue,[]}, {log_version,"4.3"}, {master_node_tables,[]}, {max_wait_for_decision, 10000}, {protocol_version,{7,6}}, {running_db_nodes, ['ns_1@10.101.0.178']}, {schema_location,opt_disc}, {schema_version,{3,0}}, {subscribers, [<5643.116.0>, <5643.111.0>]}, {tables,[schema]}, {transaction_commits,3}, {transaction_failures,0}, {transaction_log_writes,1}, {transaction_restarts,0}, {transactions,[]}, {use_dir,true}, {core_dir,false}, {no_table_loaders,2}, {dc_dump_limit,4}, {send_compressed,0}, {version,"4.4.15"}] INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:144: Info from Mnesia: Create Directory "/home/dev/membase/membase-server-community_1.6.4.1_src/ns_serv er/Mnesia.ns_1@10.101.0.178" INFO REPORT <5643.111.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:ns_mnesia:170: Mnesia table event: {write,schema, {schema,schema, [{name,schema}, {type,set}, {ram_copies,[]}, {disc_copies,['ns_1@10.101.0.178']}, {disc_only_copies,[]}, {load_order,0}, {access_mode,read_write}, {index,[]}, {snmp,[]}, {local_content,false}, {record_name,schema}, {attributes,[table,cstruct]}, {user_properties,[]}, {frag_properties,[]}, {cookie,{{1299,637053,227828},'ns_1@10.101.0.178'}}, {version,{{3,0},{'ns_1@10.101.0.178',{1299,637053,410903}}}}]}, [{schema,schema, [{name,schema}, {type,set}, {ram_copies,[]}, {disc_copies,[]}, {disc_only_copies,[]}, {load_order,0}, {access_mode,read_write}, {index,[]}, {snmp,[]}, {local_content,false}, {record_name,schema}, {attributes,[table,cstruct]}, {user_properties,[]}, {frag_properties,[]}, {cookie,{{1299,637053,227828},'ns_1@10.101.0.178'}}, {version,{{2,0},[]}}]}], {tid,3,<5643.128.0>}} PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.111.0>}, {name,ns_mnesia}, {mfargs,{ns_mnesia,start_link,[]}}, {restart_type,permanent}, {shutdown,10000}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.146.0>}, {name,ns_bad_bucket_worker}, {mfargs,{work_queue,start_link,[ns_bad_bucket_worker]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.147.0>}, {name,ns_bad_bucket_sup}, {mfargs,{ns_bucket_sup,start_link, [ns_bad_bucket_sup, #Fun<ns_server_sup.1.88526718>, ns_bad_bucket_worker]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.148.0>}, {name,ns_moxi_sup}, {mfargs,{ns_moxi_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] INFO REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== ns_1@10.101.0.178:misc:725: start_singleton(gen_server, ns_tick, [], []): starte d as <5643.149.0> on 'ns_1@10.101.0.178' PROGRESS REPORT <5643.71.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_sup} started [{pid,<5643.149.0>}, {name,ns_tick}, {mfargs,{ns_tick,start_link,[]}}, {restart_type,permanent}, {shutdown,10}, {child_type,worker}] PROGRESS REPORT <5643.53.0> 2011-03-08 21:17:34 =============================================================================== supervisor {local,ns_server_cluster_sup} started [{pid,<5643.71.0>}, {name,ns_server_sup}, {mfargs,{ns_server_sup,start_link,[]}}, {restart_type,permanent}, {shutdown,infinity}, {child_type,supervisor}] PROGRESS REPORT <5643.7.0> 2011-03-08 21:17:34 =============================================================================== application ns_server started_at 'ns_1@10.101.0.178' INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== config change: {node,'ns_1@10.101.0.178',memcached} -> [{dbdir,"/home/dev/membase/membase-server-community_1.6.4.1_src/ns_server/data/n s_1"}, {port,11210}, {admin_user,"_admin"}, {admin_pass,"_admin"}, {bucket_engine,"./bin/bucket_engine/bucket_engine.so"}, {engines,[{membase,[{engine,"bin/ep_engine/ep.so"}, {initfile,"priv/init.sql"}]}, {memcached,[{engine,"bin/memcached/default_engine.so"}]}]}, {verbosity,[]}] INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config done INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== config change: memory_quota -> 7007 INFO REPORT <5643.65.0> 2011-03-08 21:17:52 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:17:52 =============================================================================== Pushing config done INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default": {error, enoent} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-0.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-1.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-2.mb": {error , enoen t} INFO REPORT <5643.169.0> 2011-03-08 21:18:01 =============================================================================== ns_1@10.101.0.178:ns_storage_conf:273: Result of deleting file "/home/dev/membas e/membase-server-community_1.6.4.1_src/ns_server/data/ns_1/default-3.mb": {error , enoen t} INFO REPORT <5643.152.0> 2011-03-08 21:18:01 =============================================================================== ns_log: logging menelaus_web:12:Created bucket "default" of type: membase INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== config change: buckets -> [{configs,[{"default", [{num_replicas,1}, {ram_quota,7347372032}, {auth_type,sasl}, {sasl_password,[]}, {type,membase}, {num_vbuckets,1024}, {ht_size,3079}, {tap_keepalive,0}, {tap_noop_interval,20}, {max_txn_size,1000}, {ht_locks,5}, {servers,[]}, {map,undefined}]}]}] INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== Writing isasl passwd file: "/home/dev/membase/membase-server-community_1.6.4.1_s rc/ns_server/data/ns_1/isasl.pw" INFO REPORT <5643.65.0> 2011-03-08 21:18:01 =============================================================================== ns_node_disco_conf_events config all INFO REPORT <5643.85.0> 2011-03-08 21:18:01 =============================================================================== Pushing config INFO REPORT <5643.85.0> 2011-03-08 21:18:01 =============================================================================== Pushing config done SUPERVISOR REPORT <5643.94.0> 2011-03-08 21:18:02 =============================================================================== Reporting supervisor {local,menelaus_sup} Child process errorContext child_terminated reason {noproc,{gen_server,call,['ns_memcached-default',topkeys,30000]}} pid <5643.98.0> name hot_keys_keeper mfargs {hot_keys_keeper,start_link,[]} restart_type permanent shutdown 5000 child_type worker PROGRESS REPORT <5643.94.0> 2011-03-08 21:18:02 =============================================================================== supervisor {local,menelaus_sup} started [{pid,<5643.174.0>}, {name,hot_keys_keeper}, {mfargs,{hot_keys_keeper,start_link,[]}}, {restart_type,permanent}, {shutdown,5000}, {child_type,worker}] INFO REPORT <5643.102.0> 2011-03-08 21:18:02 =============================================================================== moxi<0.102.0>: 2011-03-08 21:18:32: (agent_config.c.650) ERROR: bad JSON configu ration: Empty serverList ({ moxi<0.102.0>: "name": "default", moxi<0.102.0>: "nodeLocator": "vbucket", moxi<0.102.0>: "saslPassword": "", moxi<0.102.0>: "nodes": [], moxi<0.102.0>: "vBucketServerMap": { moxi<0.102.0>: "hashAlgorithm": "CRC", moxi<0.102.0>: "numReplicas": 1, moxi<0.102.0>: "serverList": [], moxi<0.102.0>: "vBucketMap": [[-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1], [-1, -1 INFO REPORT <5643.146.0> 2011-03-08 21:18:02
===============================================================================
Thanks Jon, unfortunately the logs don't seem to point to a specific issue. Are the errors continuing? It looks like it might have just been related to initial startup of the default bucket...
Perry
Looks like the memcached process may have exited unexpectadly...there should be messages higher up in the logs describing why.
Forum support is great for free but sometimes you need a guaranteed response time and dedicated resources for your questions or issues.
Consider purchasing enterprise-level support from Couchbase: http://www.couchbase.com/products-and-services/overview
Call or email "sales -at- couchbase-dot- com" today!