swap rebalance slowness

Details

Type: Bug
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: 2.0-beta-2
Fix Version/s: 2.0
Component/s: ns_server
Security Level: Public
Labels:
None

Description

____________________
From: Ronnie Sun
Sent: Friday, November 09, 2012 6:34 PM
To: Steve Yen
Subject: Re: swap rebalance perf?

Hi Steve,

Got some preliminary results showing 2.0 is 10x slower, which falls into the same area we've seen for reb-litmus tests.

1.8.1-938: 203 seconds
2.0.0-1939: 2983 seconds

Spec: (reb-litmus-swap-2) 3M mixed, start with 2 nodes, swap 1 node with 9 client firing 1k ops each.

Current jenkins automation for this has some problems, so I don't have comparison graphs.

Thanks,
Ronnie

Options
- Sort By Name
- Sort By Date
- Ascending
- Descending
- Download All

Attachments

Hide
10.2.1.58-11142012-1140-diag.zip

14/Nov/12 1:48 PM

4.33 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121114-194241/couchbase.log 782 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.xdcr.log 4 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.couchdb.log 2.48 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/stats.log 1.23 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.stats.log 838 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.error.log 35 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.views.log 317 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.info.log 10.27 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/diag.log 16.72 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/ns_server.debug.log 19.77 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194241/memcached.log 12.39 MB

Download Zip
Show

10.2.1.58-11142012-1140-diag.zip

14/Nov/12 1:48 PM

4.33 MB

Ronnie Sun
Hide
10.2.1.61-11142012-1139-diag.zip

14/Nov/12 1:48 PM

3.52 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121114-194010/couchbase.log 667 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.xdcr.log 5 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.couchdb.log 996 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/stats.log 2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.stats.log 489 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.error.log 32 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.views.log 323 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.info.log 12.14 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/ns_server.debug.log 22.71 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194010/memcached.log 2.09 MB

Download Zip
Show

10.2.1.61-11142012-1139-diag.zip

14/Nov/12 1:48 PM

3.52 MB

Ronnie Sun
Hide
10.2.1.63-11142012-1142-diag.zip

14/Nov/12 1:48 PM

6.99 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121114-194344/couchbase.log 783 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.xdcr.log 4 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.couchdb.log 2.88 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/stats.log 1.22 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.stats.log 952 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.error.log 35 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.views.log 513 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.info.log 18.32 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/diag.log 16.72 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/ns_server.debug.log 31.69 MB

cbcollect_info_ns_1@127.0.0.1_20121114-194344/memcached.log 21.82 MB

Download Zip
Show

10.2.1.63-11142012-1142-diag.zip

14/Nov/12 1:48 PM

6.99 MB

Ronnie Sun
Hide
info_168.zip

12/Nov/12 4:57 PM

6.50 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121112-225004/couchbase.log 870 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.xdcr.log 4 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.couchdb.log 6.01 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/stats.log 1.27 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.stats.log 2.21 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.error.log 33 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.views.log 293 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.info.log 15.23 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/diag.log 17.51 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/ns_server.debug.log 25.02 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225004/memcached.log 16.00 MB

Download Zip
Show

info_168.zip

12/Nov/12 4:57 PM

6.50 MB

Ronnie Sun
Hide
info_169.zip

12/Nov/12 4:57 PM

11.53 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121112-225053/couchbase.log 857 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.xdcr.log 4 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.couchdb.log 8.06 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/stats.log 1.26 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.stats.log 2.48 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.error.log 37 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.views.log 390 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.info.log 27.60 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/diag.log 17.50 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/ns_server.debug.log 41.02 MB

cbcollect_info_ns_1@127.0.0.1_20121112-225053/memcached.log 48.04 MB

Download Zip
Show

info_169.zip

12/Nov/12 4:57 PM

11.53 MB

Ronnie Sun
Hide
info.zip

10/Nov/12 4:54 PM

8.04 MB

Ronnie Sun
cbcollect_info_ns_1@127.0.0.1_20121110-223856/couchbase.log 875 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.xdcr.log 4 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.couchdb.log 6.03 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/stats.log 1.27 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.stats.log 14.06 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.error.log 37 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.views.log 292 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.info.log 16.89 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.xdcr_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.mapreduce_errors.log 0.2 kB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/diag.log 16.52 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/ns_server.debug.log 27.78 MB

cbcollect_info_ns_1@127.0.0.1_20121110-223856/memcached.log 17.14 MB

Download Zip
Show

info.zip

10/Nov/12 4:54 PM

8.04 MB

Ronnie Sun
Hide
ns-diag-168.txt.zip

12/Nov/12 4:57 PM

5.23 MB

Ronnie Sun
ns-diag-168.txt 64.17 MB

__MACOSX/._ns-diag-168.txt 0.4 kB

Download Zip
Show

ns-diag-168.txt.zip

12/Nov/12 4:57 PM

5.23 MB

Ronnie Sun
reb-swap-6-1.loop_1.8.1-938-rel-enterprise_2.0.0-1954-rel-enterprise_orange_Nov-21-2012_10-07-08.pdf

21/Nov/12 12:31 PM

1.80 MB

Ronnie Sun

Activity

An ssh error occurred while querying for reviews.

People

Assignee:

Ronnie Sun

Reporter:

Ronnie Sun

Vote (0)

Watch (3)

Dates

Created:

09/Nov/12 8:49 PM

Updated:

03/Jan/13 12:21 PM

Resolved:

21/Nov/12 1:25 PM

Agile

View on Board