Couchbase
  • Why NoSQL?
  • Couchbase Server
  • Download
  • Resources
  • Careers
Home | Forums | Couchbase | Couchbase Server 2.0

Dent in items count?

8 replies [Last post]
  • Login or register to post comments
Mon, 02/11/2013 - 00:35
ghallas
Offline
Joined: 11/21/2012
Groups: None

Periodically I see a sudden "dent" in the number of items on the DB, matched by a drop in memory stats (even the watermarks...?) and a surge in the write queue.

Funny thing is the items count comes back in a few seconds time.

Any ideas what that is?

Top
  • Login or register to post comments
Tue, 02/12/2013 - 06:41
tgrall
Offline
Joined: 09/05/2012
Groups: None

Hello,

How often this thing is happening or you cluster?

Can you tell us more about your environment:
- OS
- Size of the cluster
- which client SDK is used to connect to your server?

And you application does not happen to delete and recreate documents? (for example delete with a TTL, and some injector...)

Regards

__________________

Tug
@tgrall

Top
  • Login or register to post comments
Tue, 02/12/2013 - 07:32
ghallas
Offline
Joined: 11/21/2012
Groups: None

Hi Tug,

let me try to cover your questions.

This is happening every few minutes. Actually, as I am keeping an eye on the monitor right now, I saw it happen three times in less than 10 minutes time, one of them being a double one.
Unfortunately, if I zoom out the monitor, I lose the details and the inverted spikes do not show. If there is a way to get this information from some logs, I would love to know it.

Other information:

OS:
Ubuntu server 12.04.1 64bits

Cluster:
4 Nodes x 16GB RAM (14.7 for Couchbase) - 43GB HardDisk space

Client SDK:
c# Assembly Couchbase.dll, v2.0.50727

About the application now, in a nutshell, I store documents with an validFor timespan as in:

CouchClient.Store(
   StoreMode.Set, id.ToString(), memory.GetBuffer(), Properties.Settings.Default.StateExpiration);

However, I do not store in batches, but rather at a more-or-less steady per-item flow, plus I have no recreate functionality.
Another note: It appears that the massive write queue is not a consistent "symptom", as you can see in the following screenshot, where the entire write queue on the chart is the single digits.
The item count reduction remains steady at 100k items

Top
  • Login or register to post comments
Tue, 02/12/2013 - 20:45
pgrigor
Offline
Joined: 01/08/2013
Groups: None

It happens because one of the nodes in your cluster didn't return data for that sample. If you click on the arrow at the bottom of the "little" graph with the stats that look funky and choose "show by server" you'll notice one (or possibly more) servers didn't supply data at that time.

Top
  • Login or register to post comments
Wed, 02/13/2013 - 00:47
ghallas
Offline
Joined: 11/21/2012
Groups: None

right you are, just checked it live.

this is expected (or at least tolerated) I presume?

Top
  • Login or register to post comments
Wed, 02/13/2013 - 08:24
pgrigor
Offline
Joined: 01/08/2013
Groups: None

Not sure. I don't work for CB. Me just pawn in game of life.

Top
  • Login or register to post comments
Wed, 02/13/2013 - 08:27
ghallas
Offline
Joined: 11/21/2012
Groups: None

you work for mongo then? :)

thanx mate

Top
  • Login or register to post comments
Wed, 02/13/2013 - 09:13
tgrall
Offline
Joined: 09/05/2012
Groups: None

Hello,

So Pgrigor is correct this happens when some of the stats requests are not returned soon enought so the console does not show them.

This has not impact on the data itself and the performance of the application that consumes the data.

Regards

__________________

Tug
@tgrall

Top
  • Login or register to post comments
Wed, 02/13/2013 - 09:15
ghallas
Offline
Joined: 11/21/2012
Groups: None

thank you for the input tgrall.

regards

Top
  • Login or register to post comments
  • Login or register to post comments
  • Login
  • Register

Company

  • About Us
  • Leadership
  • Customers
  • Partners
  • Contact Us

Product

  • Couchbase Server
  • Couchbase SDKs
  • Use Cases
  • Documentation
  • Forums

Open Source

  • Couchbase Project
  • Couchbase vs. CouchDB

Commercial

  • Subscriptions & Support
  • Training & Services

News

  • Blog
  • Newsletter
  • Press Releases
  • Buzz

Follow Us

    
  • Customer Login
  • Terms of Service
  • Privacy Policy
  • Trademark Policy
  • Site Map

© 2013 COUCHBASE All rights reserved.

Sign in to Couchbase Community

close
  • Create new account
  • Request new password
You are logging into the Forums, Wiki and Issue Tracker