Bucket maximum size
Hey there,
reading documentation I didn't find any information how NS manages bucket's that exceeds the maximum size.
We've made some load test on small buckets and when it hits 100% it continues to grow (214% still growing).
Some explanation would be much appreciated.
Thanx in advance
Alex
Perry, thanx for your answer.
Regarding your questions:
Which "level" are you seeing at 100% and beyond? Disk or RAM? And what are the configured sizes of each?
I can see it in the NS web interface under Cluster Overview > Buckets.
"Cache used" says 234%.
It's small bucket only for test purposes (around 2MB).
The cluster has 16 GB of memory allocated in 4 buckets.
I have no idea how to check how much storage is avidable here.
-Can you telnet into one of those buckets and run 'stats' and paste the output?
Here is the output:
{
"name":"TestBucket",
"uri":"/pools/default/buckets/TestBucket",
"streamingUri":"/pools/default/bucketsStreaming/TestBucket",
"flushCacheUri":"/pools/default/buckets/TestBucket/controller/doFlush",
"basicStats":{
"cacheSize":128,
"opsPerSec":0.0,
"evictionsPerSec":0.0,
"cachePercentUsed":0.028
},
"nodes":[
{
"hostname":"10.127.103.133",
"status":"healthy",
"uptime":"1106079",
"version":"1.0.3",
"os":"windows",
"memoryTotal":8588464128.0,
"memoryFree":7072706560.0,
"mcdMemoryReserved":2258,
"mcdMemoryAllocated":10762630,
"ports":{
"proxy":11212,
"direct":11211
}
},
{
"hostname":"10.127.103.134",
"status":"healthy",
"uptime":"2706304",
"version":"1.0.3",
"os":"windows",
"memoryTotal":8588464128.0,
"memoryFree":7594536960.0,
"mcdMemoryReserved":2258,
"mcdMemoryAllocated":10762630,
"ports":{
"proxy":11212,
"direct":11211
}
}
],
"stats":{
"uri":"/pools/default/buckets/TestBucket/stats"
}
}
-What are the sizes of items you're putting into the database?
You mean size of object that are cached in NS? Around 350-400 bytes each.
Thanks in advance.
Alex
Thanks Alex. For some reason I thought we were talking about our Membase server, not the Memcached one. My apologies...
I'm still looking through those stats. Can you paste a screenshot of your "Cluster Overview" -> Buckets screen?
Thanks
Perry
Ahh...no,no it's Memcached.
Here is the screenshot:
[IMG]http://dl.dropbox.com/u/1471493/buckets.PNG[/IMG]
Thanks again Perry.
Hmm, that does look odd. What version of the NorthScale server are you running (accessible via the 'About' link in the upper right-hand corner)?
it also appears that this is only related to the "test bucket" and may just be a bug there. I have been unable to reproduce it, but will continue trying on my side.
Do you experience the same behavior putting real data into a different bucket? In that case, you shouldn't ever see the "Cache Used" go over 100%.
Perry
Thanks Perry.
The version we're using is 1.0.3.
I will try to do some load test on some different custom (small) bucket and post results.
Alex
Hi, I am having the same problem as mentioned above. I have attached a screenshot showing this. We have been using the memcached server for 3-4 months with no problem and today we noticed this. I have checked the machine that the server is hosted on and it does not appear to be using that much RAM or diskspace. Also over the last 2 hours it is slowly dropping, 1-2% every half hour or so. [ATTACH]31[/ATTACH]
Thanks for the feedback Jim, looks like a bug in the UI and I'm glad to hear that the actual memory usage is not being impacted.
I will try to reproduce this internally.
Perry
Alex, the "design" is to stop accepting new data when a bucket fills up. We do have a known issue where we do not account of ALL the RAM that we are using, but I'm a little surprised that it is so much in your case.
A few questions:
-Which "level" are you seeing at 100% and beyond? Disk or RAM? And what are the configured sizes of each?
-Can you telnet into one of those buckets and run 'stats' and paste the output?
-What are the sizes of items you're putting into the database?
Thanks
Perry
Forum support is great for free but sometimes you need a guaranteed response time and dedicated resources for your questions or issues.
Consider purchasing enterprise-level support from Membase: http://www.membase.com/products-and-services/overview
Call or email "sales -at- membase -dot- com" today!