Couchbase

Couchbase http://www.couchbase.com/issues This file is an XML representation of an issue en-us

5.2.4

845

26-12-2012

[MB-6323] Disk not drain (windows) http://www.couchbase.com/issues/browse/MB-6323 Couchbase Server Please refer to the screenshot. For build 1578, disk did not drain. <br/> <br/> > Loaded 7M items. Waited for them to be flushed. 3.5M active items stayed in the queue. <br/> <br/> > Memory fragmentation was nearly 2.4G. May relate to disk too. <br/> <br/> Node: 10.2.2.231 (vms) <br/> <br/> Created issue: <br/> 2.0.0-1578, windows MB-6323

Disk not drain (windows)

Bug Blocker Resolved Fixed Public Jin Lim Ronnie Sun pblock Mon, 20 Aug 2012 13:32:24 -0500 Fri, 31 Aug 2012 20:02:16 -0500 Wed, 29 Aug 2012 21:42:29 -0500 2.0-beta couchbase-bucket 0 1 (seemed assigned to wrong folk) Ronnie,<br/> <br/> When you have this kind of problems, please grab the diag log file and attach it to the bug. Otherwise, it is difficult for us to debug this issue.<br/> attached diag logs @chiyoung,<br/> <br/> Attached diag logs.<br/> <br/> The cluster is live, 10.2.2.231.<br/> <br/> I'll leave it to you for debugging. Thanks The write dispatcher thread on 10.2.2.231 got an exception and terminated and that's the reason why disk write queue is not drained at all: <br/> <br/> [ns_server:info,2012-08-19T14:27:38.036,<a href='mailto:ns_1@10.2.2.231'>ns_1@10.2.2.231</a>:ns_port_memcached:ns_port_server:log:169]memcached<0.751.0>: 38 3: RW_Dispatcher: Caught an exception: MUTEX ERROR: Failed to destroy mutex: Invalid argument <br/> <br/> <a href="http://review.couchbase.org/#/c/20109/">http://review.couchbase.org/#/c/20109/</a> Integrated in github-ep-engine-2-0 #409 (See [<a href="http://qa.hq.northscale.net/job/github-ep-engine-2-0/409/">http://qa.hq.northscale.net/job/github-ep-engine-2-0/409/</a>])<br/>     <a href="http://www.couchbase.com/issues/browse/MB-6323" title="Disk not drain (windows)"><strike>MB-6323</strike></a> Remove a race condition in Dispatcher wake method (Revision 5ea867c641d33eb31b57bdb709e8513a3a57152a)<br/> <br/>      Result = SUCCESS<br/> Jin Lim : <br/> Files : <br/> * src/bgfetcher.hh<br/> * src/flusher.cc<br/> * src/dispatcher.cc<br/> * src/dispatcher.hh<br/> This happened it again with the latest fix. Ronnie, please attach the diag file. Node 10-2-2-232 went down<br/> <br/> Attached diag logs. Please reattache the diag logs. Don't see them. Thanks! <br/> Got the logs. Both write commit failure and mutex error occurred again. Looking into it. <a href="http://review.couchbase.org/#/c/20322/">http://review.couchbase.org/#/c/20322/</a> Integrated in github-ep-engine-2-0 #419 (See [<a href="http://qa.hq.northscale.net/job/github-ep-engine-2-0/419/">http://qa.hq.northscale.net/job/github-ep-engine-2-0/419/</a>])<br/>     <a href="http://www.couchbase.com/issues/browse/MB-6323" title="Disk not drain (windows)"><strike>MB-6323</strike></a> Ignore EINVAL from pthread_mutex/cond_destroy() (Revision 92e8151fcd8ea25b0799a5f9f59d1459f1aaea48)<br/> <a href="http://www.couchbase.com/issues/browse/MB-6323" title="Disk not drain (windows)"><strike>MB-6323</strike></a> attempt to open db with initial rev = 1 if file is not found (Revision aea990ac4f589f785b283d8b98e7d09d6e140884)<br/> <br/>      Result = SUCCESS<br/> Jin Lim : <br/> Files : <br/> * src/mutex.cc<br/> * Makefile.am<br/> * src/syncobject.hh<br/> <br/> Jin Lim : <br/> Files : <br/> * src/couch-kvstore/couch-kvstore.cc<br/> Integrated in github-ep-engine-2-0 #421 (See [<a href="http://qa.hq.northscale.net/job/github-ep-engine-2-0/421/">http://qa.hq.northscale.net/job/github-ep-engine-2-0/421/</a>])<br/>     <a href="http://www.couchbase.com/issues/browse/MB-6323" title="Disk not drain (windows)"><strike>MB-6323</strike></a> return TMPFAIL for failed bgfetch instead of assert (Revision 4bf1696c646d8a7706d29de86d6814b0ff1004bf)<br/> <br/>      Result = SUCCESS<br/> Jin Lim : <br/> Files : <br/> * src/ep.cc<br/> Date of First Response Mon, 20 Aug 2012 13:36:24 -0500 Rank 4301 Time In Status