couchnode performance issue
Sat, 02/16/2013 - 11:26
I've been testing couchbase using couchnode driver. Got strange results (couchbase is too slow):
Benchmark test at Sat Feb 16 2013 14:31:37 GMT+0400 (MSK): redis Number of totaol request: 5000, CONCURRENT users: 50 Time taken for tests: 0.184 seconds Complete requests: 5000 Failed requests: 0 Requests per second: 27173.91 [#/sec] Time per request: 1.63 [ms] Max response time: 10[ms] Response time distribute: Response time | Num | Proportion 0 ~ 5 | 4942 | 98.84% 5 ~ 10 | 47 | 0.94% 10 ~ 20 | 11 | 0.22% 20 ~ 30 | 0 | 0.00% 30 ~ 40 | 0 | 0.00% 40 ~ 50 | 0 | 0.00% 50 ~ 80 | 0 | 0.00% 80 ~ 100 | 0 | 0.00% 100 ~ 200 | 0 | 0.00% 200 ~ 300 | 0 | 0.00% 300 ~ 500 | 0 | 0.00% 500 ~ 1000 | 0 | 0.00% 1000 ~ 2000 | 0 | 0.00% 2000 ~ 3000 | 0 | 0.00% > 3000 | 0 | 0.00% Benchmark test at Sat Feb 16 2013 14:31:45 GMT+0400 (MSK): couchbase Number of totaol request: 5000, CONCURRENT users: 50 Time taken for tests: 6.64 seconds Complete requests: 5000 Failed requests: 0 Requests per second: 753.01 [#/sec] Time per request: 34.22 [ms] Max response time: 104[ms]Response time distribute: Response time | Num | Proportion 0 ~ 5 | 246 | 4.92% 5 ~ 10 | 418 | 8.36% 10 ~ 20 | 800 | 16.00% 20 ~ 30 | 798 | 15.96% 30 ~ 40 | 788 | 15.76% 40 ~ 50 | 742 | 14.84% 50 ~ 80 | 1127 | 22.54% 80 ~ 100 | 77 | 1.54% 100 ~ 200 | 4 | 0.08% 200 ~ 300 | 0 | 0.00% 300 ~ 500 | 0 | 0.00% 500 ~ 1000 | 0 | 0.00% 1000 ~ 2000 | 0 | 0.00% 2000 ~ 3000 | 0 | 0.00% > 3000 | 0 | 0.00% Benchmark test at Sat Feb 16 2013 14:31:47 GMT+0400 (MSK): pg Number of totaol request: 5000, CONCURRENT users: 50 Time taken for tests: 0.666 seconds Complete requests: 5000 Failed requests: 0 Requests per second: 7507.51 [#/sec] Time per request: 3.51 [ms] Max response time: 15[ms] Response time distribute: Response time | Num | Proportion 0 ~ 5 | 3379 | 67.58% 5 ~ 10 | 1546 | 30.92% 10 ~ 20 | 75 | 1.50% 20 ~ 30 | 0 | 0.00% 30 ~ 40 | 0 | 0.00% 40 ~ 50 | 0 | 0.00% 50 ~ 80 | 0 | 0.00% 80 ~ 100 | 0 | 0.00% 100 ~ 200 | 0 | 0.00% 200 ~ 300 | 0 | 0.00% 300 ~ 500 | 0 | 0.00% 500 ~ 1000 | 0 | 0.00% 1000 ~ 2000 | 0 | 0.00% 2000 ~ 3000 | 0 | 0.00% > 3000 | 0 | 0.00% Benchmark test at Sat Feb 16 2013 14:31:49 GMT+0400 (MSK): pg.native Number of totaol request: 5000, CONCURRENT users: 50 Time taken for tests: 0.536 seconds Complete requests: 5000 Failed requests: 0 Requests per second: 9328.36 [#/sec] Time per request: 2.77 [ms] Max response time: 8[ms] Response time distribute: Response time | Num | Proportion 0 ~ 5 | 4195 | 83.90% 5 ~ 10 | 805 | 16.10% 10 ~ 20 | 0 | 0.00% 20 ~ 30 | 0 | 0.00% 30 ~ 40 | 0 | 0.00% 40 ~ 50 | 0 | 0.00% 50 ~ 80 | 0 | 0.00% 80 ~ 100 | 0 | 0.00% 100 ~ 200 | 0 | 0.00% 200 ~ 300 | 0 | 0.00% 300 ~ 500 | 0 | 0.00% 500 ~ 1000 | 0 | 0.00% 1000 ~ 2000 | 0 | 0.00% 2000 ~ 3000 | 0 | 0.00% > 3000 | 0 | 0.00%
Is it couchnode or couchbase issue? Or this is usual for standalone couchbase instance?
Just tested on latest MacOS's couchbase distribution.
benchmark methods are:
benchmarks.push _.extend {}, bm_defaults,
description: 'redis'
method: (cb) ->
redis.get '1', (err, data) ->
cb err, JSON.parse data
benchmarks.push _.extend {}, bm_defaults,
description: 'couchbase'
method: (cb) ->
cbcli.get '1', cb
benchmarks.push _.extend {}, bm_defaults,
description: 'pg'
method: (cb) ->
pg.query "SELECT 1", cb
benchmarks.push _.extend {}, bm_defaults,
description: 'pg.native'
method: (cb) ->
pgn.query "SELECT 1", cb
Mon, 04/22/2013 - 04:59
It's a couchnode issue. We've been using couchnode for a while, and we just switched https://github.com/3rd-Eden/node-memcached, as we are not using views for now.
The speed difference is enormous. Our code runs about 8 times faster!
Tue, 04/23/2013 - 21:10
Hello,
We have pushed a new release of the Node driver, that have some improvement :
https://npmjs.org/package/couchbase (0.0.12)
Regards
Tue, 04/30/2013 - 10:18
Sorry, it's even slower(
I'll try node-memcached.
If you'd like I can share code for benchmarks.
Benchmark test at Tue Apr 30 2013 21:12:31 GMT+0400 (MSK): couchbase Number of totaol request: 5000, CONCURRENT users: 50 Time taken for tests: 74.788 seconds Complete requests: 5000 Failed requests: 0 Requests per second: 66.86 [#/sec] Time per request: 383.98 [ms] Max response time: 1256[ms]Response time distribute: Response time | Num | Proportion 0 ~ 5 | 0 | 0.00% 5 ~ 10 | 0 | 0.00% 10 ~ 20 | 87 | 1.74% 20 ~ 30 | 76 | 1.52% 30 ~ 40 | 67 | 1.34% 40 ~ 50 | 65 | 1.30% 50 ~ 80 | 212 | 4.24% 80 ~ 100 | 144 | 2.88% 100 ~ 200 | 693 | 13.86% 200 ~ 300 | 687 | 13.74% 300 ~ 500 | 1339 | 26.78% 500 ~ 1000 | 1552 | 31.04% 1000 ~ 2000 | 78 | 1.56% 2000 ~ 3000 | 0 | 0.00% > 3000 | 0 | 0.00%
Hello,
It is probably a Couchnode issue, when have not yet done benchmarks with this SDK that is still under development.
I have logged a task in the project to allow you to follow this work:
http://www.couchbase.com/issues/browse/JSCBC-17
Regards
Tug
Tug
@tgrall