Couchbase Server

7 empty buckets is nearly killing server [was: Couchbase causes unreasonable high CPU utilization without any connected clients]

Details

  • Type: Bug Bug
  • Status: Resolved Resolved
  • Priority: Blocker Blocker
  • Resolution: Fixed
  • Affects Version/s: recent-builds-2.0
  • Fix Version/s: 2.0-beta
  • Component/s: build, couchbase-bucket, performance
  • Security Level: Public
  • Labels:
  • Environment:
    Ubuntu 11.10, 12.04 LTS and CentOS 5.3 - Just plain setup and updated.

    For Ubuntu we're used this package:
    couchbase-server-community_x86_64_2.0.0-1554-rel.deb

Description

After setup the Couchbase and creating buckets the load increases to 100% (beam.smp and memcahed causing this, see screenshots).

All the time there are no clientd connected to this instance. All load was caused from config tasks in the web interface.

I put also a diagnostic report inside the attachment.

There where no reports in dmesg output or anything else on system level.
  1. Zip Archive
    Archive.zip
    24/Aug/12 4:37 AM
    4.32 MB
    Alexander Finger

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Aleksey Kondratenko added a comment -
Thanks for filing this. I'll take a look
Show
Aleksey Kondratenko added a comment - Thanks for filing this. I'll take a look
Hide
Permalink
Aleksey Kondratenko added a comment -
Thank you very much for reporting this.

I'm able to reproduce this on my box. This seems to be caused by larger than average number of buckets you have.

For now consider lowering number of buckets to 2-3 as a workaround
Show
Aleksey Kondratenko added a comment - Thank you very much for reporting this. I'm able to reproduce this on my box. This seems to be caused by larger than average number of buckets you have. For now consider lowering number of buckets to 2-3 as a workaround
Hide
Permalink
Aleksey Kondratenko added a comment -
We're indeed consuming more that 20% of CPU gathering couch stats if there's 7 buckets on my quite quick hardware. On slower box that indeed can be quite a bit higher.
Show
Aleksey Kondratenko added a comment - We're indeed consuming more that 20% of CPU gathering couch stats if there's 7 buckets on my quite quick hardware. On slower box that indeed can be quite a bit higher.
Hide
Permalink
Farshid Ghods added a comment -
moving this to 2.0 GA
Show
Farshid Ghods added a comment - moving this to 2.0 GA
Hide
Permalink
Thuan Nguyen added a comment -
Integrated in github-ns-server-2-0 #459 (See [http://qa.hq.northscale.net/job/github-ns-server-2-0/459/])
    MB-6413: re-implemented bucket_databases using efficient API (Revision 8ba83d2df2b35ebd8fbc621dcad193aec2255fe5)

     Result = SUCCESS
pwansch :
Files :
* src/capi_set_view_manager.erl
* src/ns_storage_conf.erl
* src/compaction_daemon.erl
Show
Thuan Nguyen added a comment - Integrated in github-ns-server-2-0 #459 (See [ http://qa.hq.northscale.net/job/github-ns-server-2-0/459/ ])      MB-6413 : re-implemented bucket_databases using efficient API (Revision 8ba83d2df2b35ebd8fbc621dcad193aec2255fe5)      Result = SUCCESS pwansch : Files : * src/capi_set_view_manager.erl * src/ns_storage_conf.erl * src/compaction_daemon.erl
Hide
Permalink
Thuan Nguyen added a comment -
Integrated in github-couchdb-preview #502 (See [http://qa.hq.northscale.net/job/github-couchdb-preview/502/])
    MB-6413 More reliable server startup when testing (Revision 9419f75d63ac4df9222df2d55d64991ea5efbb0d)
MB-6413: Fix race condition in test 12-errors.t (Revision 39ae383c157c8c6e0df11baf8522540655bbb9cc)
MB-6413: open all databases on startup (Revision 7db41d630c782db9eee6cd9e74b3b45324bcf463)
MB-6413: re-implemented all_known_databases/0 (Revision c4ba56ae22ec01bdd3453450f56a4a6e4ece6edb)

     Result = SUCCESS
pwansch :
Files :
* src/couchdb/couch_server_sup.erl
* src/couch_set_view/test/couch_set_view_test_util.erl
* src/couchdb/couch_server.erl

pwansch :
Files :
* src/couch_set_view/test/12-errors.t

pwansch :
Files :
* src/couchdb/couch_server.erl

pwansch :
Files :
* src/couchdb/couch_server.erl
Show
Thuan Nguyen added a comment - Integrated in github-couchdb-preview #502 (See [ http://qa.hq.northscale.net/job/github-couchdb-preview/502/ ])      MB-6413 More reliable server startup when testing (Revision 9419f75d63ac4df9222df2d55d64991ea5efbb0d) MB-6413 : Fix race condition in test 12-errors.t (Revision 39ae383c157c8c6e0df11baf8522540655bbb9cc) MB-6413 : open all databases on startup (Revision 7db41d630c782db9eee6cd9e74b3b45324bcf463) MB-6413 : re-implemented all_known_databases/0 (Revision c4ba56ae22ec01bdd3453450f56a4a6e4ece6edb)      Result = SUCCESS pwansch : Files : * src/couchdb/couch_server_sup.erl * src/couch_set_view/test/couch_set_view_test_util.erl * src/couchdb/couch_server.erl pwansch : Files : * src/couch_set_view/test/12-errors.t pwansch : Files : * src/couchdb/couch_server.erl pwansch : Files : * src/couchdb/couch_server.erl
Hide
Permalink
Aleksey Kondratenko added a comment -
We're still far from being good enough on multiple buckets, but worst problem was recently fixed. We were quadratic on total number of vbuckets (from all buckets) on certain periodic operations and that's now fixed and 7 buckets is far from being as bad as it was
Show
Aleksey Kondratenko added a comment - We're still far from being good enough on multiple buckets, but worst problem was recently fixed. We were quadratic on total number of vbuckets (from all buckets) on certain periodic operations and that's now fixed and 7 buckets is far from being as bad as it was

People

  • Assignee:
    Aleksey Kondratenko
    Reporter:
    Alexander Finger
Vote (0)
Watch (2)

Dates

  • Created:
    Updated:
    Resolved: