Couchbase Server

Empty Bucket rebalancing nodes takes long.

Details

  • Type: Story Story
  • Status: Resolved Resolved
  • Priority: Major Major
  • Resolution: Incomplete
  • Affects Version/s: 2.0.1
  • Fix Version/s: 2.1
  • Component/s: ns_server
  • Security Level: Public
  • Labels:
    None
  • Environment:
    2.0.1-160
    Linux
    1024 vbuckets
    4 Core system.

Description

Create 8 empty buckets on a single node.

Add 4 more nodes on cluster.

Rebalance.

Rebalance is taking longer than 30 minutes to complete.

Would like to understand system-expected behaviour for Empty-Bucket rebalances.

Adding logs.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Aleksey Kondratenko added a comment -
May I have comparison of:

* how long it takes to rebalance 1 bucket in your env.

* how long it takes to rebalance 8 buckets in your env.

?

So that I see if per-bucket rebalance time is growing too much with more buckets.

Show
Aleksey Kondratenko added a comment - May I have comparison of: * how long it takes to rebalance 1 bucket in your env. * how long it takes to rebalance 8 buckets in your env. ? So that I see if per-bucket rebalance time is growing too much with more buckets.
Hide
Permalink
Dipti Borkar added a comment -
why is fix version 2.1? we need to look into it sooner. Also is this a regression compared with 2.0 ? also would be helpful to understand the answers to Alk's questions.
Show
Dipti Borkar added a comment - why is fix version 2.1? we need to look into it sooner. Also is this a regression compared with 2.0 ? also would be helpful to understand the answers to Alk's questions.
Hide
Permalink
Farshid Ghods added a comment -
this is not a regresson from 2.0.0 . we have seen this behavior during 2.0 testing as well that rebalancing many buckets even empty takes a while ( in this test is < 4 mins per bucket)

this performance bug is filed to track this more closely and run more tests with empty buckets
Show
Farshid Ghods added a comment - this is not a regresson from 2.0.0 . we have seen this behavior during 2.0 testing as well that rebalancing many buckets even empty takes a while ( in this test is < 4 mins per bucket) this performance bug is filed to track this more closely and run more tests with empty buckets
Hide
Permalink
Aleksey Kondratenko added a comment -
Some improvements were made (and I recall some perf regression happened in about same build numbers of 2.0.1 as this bug was reported against).

Let's define precisely what is too slow and move from there. I'm not fan of tons of not very specific bugs open.
Show
Aleksey Kondratenko added a comment - Some improvements were made (and I recall some perf regression happened in about same build numbers of 2.0.1 as this bug was reported against). Let's define precisely what is too slow and move from there. I'm not fan of tons of not very specific bugs open.

People

  • Assignee:
    Ketaki Gangal
    Reporter:
    Ketaki Gangal
Vote (1)
Watch (5)

Dates

  • Created:
    Updated:
    Resolved: