Couchbase Server

Variances in large scale mixed tests

Details

  • Type: Bug Bug
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Fixed
  • Affects Version/s: 2.0.1
  • Fix Version/s: 2.1.0
  • Component/s: performance
  • Security Level: Public
  • Labels:
    None

Description

build 164: latencies vary from 1400 us to 2400 us. Need run newer build > 168 several times to confirm.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Ronnie Sun added a comment -
not seen in the new runs.
Show
Ronnie Sun added a comment - not seen in the new runs.
Hide
Permalink
Pavel Paulau added a comment -
by new runs you mean builds > 168 or something else?
Show
Pavel Paulau added a comment - by new runs you mean builds > 168 or something else?
Hide
Permalink
Ronnie Sun added a comment -
170. looks come back again.
Show
Ronnie Sun added a comment - 170. looks come back again.
Hide
Permalink
Pavel Paulau added a comment -
Can you share a couple of reports? Slow run vs. fast run?
Show
Pavel Paulau added a comment - Can you share a couple of reports? Slow run vs. fast run?
Hide
Permalink
Ronnie Sun added a comment -
http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor&testcase=mixed-large-4

right-click and use 'graphs'
Show
Ronnie Sun added a comment - http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor&testcase=mixed-large-4 right-click and use 'graphs'
Hide
Permalink
Aleksey Kondratenko added a comment -
Just to double check. This separate ticket is just memcached-side variation right? Nothing to do with rebalance times variations correct ?
Show
Aleksey Kondratenko added a comment - Just to double check. This separate ticket is just memcached-side variation right? Nothing to do with rebalance times variations correct ?
Hide
Permalink
Ronnie Sun added a comment -
 Nope, it doesn't have rebalance.
Show
Ronnie Sun added a comment -  Nope, it doesn't have rebalance.
Hide
Permalink
Anil Kumar added a comment -
Cluster is being used for toybuild testing will get to this after that.
Show
Anil Kumar added a comment - Cluster is being used for toybuild testing will get to this after that.
Hide
Permalink
Abhinav Dangeti added a comment -
Lot of variance seen in the rebalance runs, and the mixed large scale tests: <Build 2.0.1-170, 2.0.2-755>
http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor
Show
Abhinav Dangeti added a comment - Lot of variance seen in the rebalance runs, and the mixed large scale tests: <Build 2.0.1-170, 2.0.2-755> http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor
Hide
Permalink
Maria McDuff added a comment -
Abhinav, Are you still seeing variances in your latest run with the toy build from Jin?
Can you update this ticket? Thanks.
Show
Maria McDuff added a comment - Abhinav, Are you still seeing variances in your latest run with the toy build from Jin? Can you update this ticket? Thanks.
Hide
Permalink
Anil Kumar added a comment -
the issue doesn't show up in 2.0.2 build. will continue to run this for 2.0.2 build
Show
Anil Kumar added a comment - the issue doesn't show up in 2.0.2 build. will continue to run this for 2.0.2 build
Hide
Permalink
Maria McDuff added a comment -
ronnie, can you post the latest perf result from your 2.0.2 run?
how bad the variance with perf on set/get and rebalance in/out?
pls update this bug.
Show
Maria McDuff added a comment - ronnie, can you post the latest perf result from your 2.0.2 run? how bad the variance with perf on set/get and rebalance in/out? pls update this bug.
Hide
Permalink
Ronnie Sun added a comment -
the cluster was constantly engaged with rebalance and mrw medium scale tests. No large scale updates for now. Will schedule them afterwards.

Show
Ronnie Sun added a comment - the cluster was constantly engaged with rebalance and mrw medium scale tests. No large scale updates for now. Will schedule them afterwards.
Hide
Permalink
Maria McDuff added a comment -
per bug triage, ronnie --- can you please update this bug with your large scale test result?
Show
Maria McDuff added a comment - per bug triage, ronnie --- can you please update this bug with your large scale test result?
Hide
Permalink
Ronnie Sun added a comment -
http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor

Please refer to mixed-large-4

To verify the variances, need multiple runs of the same 2.0.2 build.

Show
Ronnie Sun added a comment - http://dashboard.hq.couchbase.com/litmus/dashboard/?env=thor Please refer to mixed-large-4 To verify the variances, need multiple runs of the same 2.0.2 build.
Hide
Permalink
Anil Kumar added a comment -
In recent runs the variance delta has reduced. closing this we will reopen if we see high variance.
Show
Anil Kumar added a comment - In recent runs the variance delta has reduced. closing this we will reopen if we see high variance.

People

  • Assignee:
    Ronnie Sun
    Reporter:
    Ronnie Sun
Vote (0)
Watch (6)

Dates

  • Created:
    Updated:
    Resolved:

Agile