Bucket gradually fills up for no reason
I have a weird issue with a very large bucket. It doesn't seem to matter what size I make the bucket the ram usage always seems to creep up to near the quota.
When I first load the data on a 146GB bucket the space used is around 73GB. I walk away for a few hours (NOTHING) is going on with activity on the system as it's 100% dev and only I use it. And now there's 132GB / 146GB used. The same was true for this bucket when I had it at 96GB it would run up to 90 or so.
The bigger issue is that I can not run any set operations over this bucket when it gets to this state. All I get are temporary failures from the client library
Tgrall, I spoke with apage43 for a while yesterday about this and we collected some cbinfo and I published it to your aws store. The bug tracker is Here:
http://cbugg.hq.couchbase.com/bug/bug-294
To answer your other questions:
- Which version you have installed?
Couchbase 2.0 Enterprise
- on which System?
Ubuntu 12.04 on some nodes and 12.10 on others
- OS
- VM or Raw
VMware 6 nodes 8cores each @ 2.0ghz x 64GB Ram
- Memory
- Type of disk...
EXT4 presented to VM. Actual storage is a NetApp SAN connected via NFS to the VM Hosts @ 10Gig (No NFS presentation on actual VM, I know you guys have a problem with that).
So you have only 1 single bucket? Do you have lot of documents? operations?..
- could you describe your dataset?
I'm throwing around 200 milling key's with one single json value per key into the bucket. The cluster has 6 buckets in total, but i'm only operating on this one which is sized at 25000 x 6 = 146GB
Are you talking about memory or disk?
The disk only shows 35G but Memory is run up to 142GB. Once it gets there, any set operations get a Temporary Failure reply from the cluster.
One option will be also to provide more information about error:
- Server Logs?
- Client Logs?
Full CB Info already uploaded. Ping Apage he has all the data.
Hello Koeeok,
Could you please give us more detail about your environmet:
- Which version you have installed?
- on which System?
- OS
- VM or Raw
- Memory
- Type of disk...
So you have only 1 single bucket? Do you have lot of documents? operations?..
- could you describe your dataset?
Are you talking about memory or disk?
One option will be also to provide more information about error:
- Server Logs?
- Client Logs?
You can also in addition to these information prepare the logs to help us to analyze the issue:
http://www.couchbase.com/wiki/display/couchbase/Working+with+the+Couchba...
Regards
Tug
Tug
@tgrall