Couchbase Server

Improve performance of view engine for rebalance with consistent views enabled, and make it use less resources (CPU, IO)

Details

  • Type: Improvement Improvement
  • Status: Resolved Resolved
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: None
  • Fix Version/s: 2.0
  • Component/s: view-engine
  • Security Level: Public
  • Labels:
    None

Description

The goal here is to make rebalance, with consistent views enabled, faster and consume less CPU and ideally do less IO as well.

This relates to MB-6799.

Each commit will be very specific describing each improvement. Some of them, as a side effect, will also improve rebalance with consistent views disabled.

Activity

Descending order - Click to sort in ascending order
Hide
Permalink
Filipe Manana added a comment -
I thought this was still not close to the goals, that's why it remained open.
Show
Filipe Manana added a comment - I thought this was still not close to the goals, that's why it remained open.
Hide
Permalink
Steve Yen added a comment -
resolving this per bug-scrub mtg
Show
Steve Yen added a comment - resolving this per bug-scrub mtg
Hide
Permalink
Thuan Nguyen added a comment -
Integrated in github-couchdb-preview #527 (See [http://qa.hq.northscale.net/job/github-couchdb-preview/527/])
    MB-7030 Always send new group snapshot to parent (Revision 2f17fe571193d00c6c4ee8522710903e3fe7052f)
MB-7030 Use some cheaper BIFs for list and orddicts (Revision a2bef2f295fbc198d9206a2a4d0cc28c025af56e)
MB-7030 Check mail box for new group snapshot (Revision c2dd289640f1097d8a9b285e25004cdaadc07196)
MB-7030 Avoid not useful anymore header commit (Revision a0b3bb69a9a1f0c62a36f622db16cb8c928a1b81)
MB-7030 Don't fsync when doing some header commits (Revision aa361e5de8d129a8244503ee3d0d11bfdef17794)
MB-7030 Don't restart cleanup process (Revision d2eb7d5e4f5cac7f0533bb7c793180fbc67f0447)
MB-7030 Avoid unnecessary group pid lookup (Revision 1a5f6290bc21a37a4eb3bf4be75f4e5c995e05cf)

     Result = SUCCESS
steve :
Files :
* src/couch_set_view/src/couch_set_view_updater.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view_group.erl
* src/couch_set_view/src/couch_set_view_util.erl
* src/couch_set_view/src/couch_set_view_updater.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view_group.erl
* src/couch_set_view/src/couch_set_view_updater.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view_group.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view_group.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view_group.erl

steve :
Files :
* src/couch_set_view/src/couch_set_view.erl
* src/couch_set_view/src/couch_set_view_group.erl
Show
Thuan Nguyen added a comment - Integrated in github-couchdb-preview #527 (See [ http://qa.hq.northscale.net/job/github-couchdb-preview/527/ ])      MB-7030 Always send new group snapshot to parent (Revision 2f17fe571193d00c6c4ee8522710903e3fe7052f) MB-7030 Use some cheaper BIFs for list and orddicts (Revision a2bef2f295fbc198d9206a2a4d0cc28c025af56e) MB-7030 Check mail box for new group snapshot (Revision c2dd289640f1097d8a9b285e25004cdaadc07196) MB-7030 Avoid not useful anymore header commit (Revision a0b3bb69a9a1f0c62a36f622db16cb8c928a1b81) MB-7030 Don't fsync when doing some header commits (Revision aa361e5de8d129a8244503ee3d0d11bfdef17794) MB-7030 Don't restart cleanup process (Revision d2eb7d5e4f5cac7f0533bb7c793180fbc67f0447) MB-7030 Avoid unnecessary group pid lookup (Revision 1a5f6290bc21a37a4eb3bf4be75f4e5c995e05cf)      Result = SUCCESS steve : Files : * src/couch_set_view/src/couch_set_view_updater.erl steve : Files : * src/couch_set_view/src/couch_set_view_group.erl * src/couch_set_view/src/couch_set_view_util.erl * src/couch_set_view/src/couch_set_view_updater.erl steve : Files : * src/couch_set_view/src/couch_set_view_group.erl * src/couch_set_view/src/couch_set_view_updater.erl steve : Files : * src/couch_set_view/src/couch_set_view_group.erl steve : Files : * src/couch_set_view/src/couch_set_view_group.erl steve : Files : * src/couch_set_view/src/couch_set_view_group.erl steve : Files : * src/couch_set_view/src/couch_set_view.erl * src/couch_set_view/src/couch_set_view_group.erl

People

  • Assignee:
    Filipe Manana
    Reporter:
    Filipe Manana
Vote (0)
Watch (0)

Dates

  • Created:
    Updated:
    Resolved: