Couchbase
  • Why NoSQL?
  • Couchbase Server
  • Download
  • Resources
  • Careers
Home | Forums | Couchbase | Couchbase Server 1.8.x

Rebalance failed after power failure

1 reply [Last post]
  • Login or register to post comments
Wed, 04/11/2012 - 12:56
j99
Offline
Joined: 02/24/2012
Groups: None

We recently survived a major power failure on two of our four nodes. We only have one replica so I guess we just lost some information but this is not cruical.

The main problem is that now we can not rebalance ... After both servers returned I re-added them to the cluster. Now I see all 4 servers in my admin console - two with status "up" (green) and two "pend" (yellow) together with warning: "Fail Over Warning: Rebalance required, some data is not currently replicated!"

When I click "rebalance" it waits for a couple of seconds and then I receive error:

Rebalance failed. See logs for detailed reason. You can try rebalance again.

I tried many times but everytime I get the same error. And my logs say:

Event: Starting rebalance, KeepNodes = ['ns_1@192.168.0.3','ns_1@192.168.0.7','ns_1@192.168.0.8','ns_1@192.168.0.14'], EjectNodes = []
Module Code: ns_orchestrator004
Server Node: ns_1@192.168.0.7
Time: 21:51:40 - Wed Apr 11, 2012
 
Event: Rebalance exited with reason {wait_for_memcached_failed,"users",['ns_1@192.168.0.3','ns_1@192.168.0.14']}
Module Code: ns_orchestrator002
Server Node: ns_1@192.168.0.7
Time: 21:51:52 - Wed Apr 11, 2012

... and that's it..
I tried restarting couchbase but nothing seems to help. Any clues?

Thanx! Regards.

Top
  • Login or register to post comments
Wed, 04/18/2012 - 23:58
ingenthr
Offline
Joined: 03/16/2010
Groups:

If it regularly won't rebalance, you may want to build a new cluster and restore the data from files. Support may be able to investigate further if you really need another resolution.

Top
  • Login or register to post comments
  • Login or register to post comments
  • Login
  • Register

Company

  • About Us
  • Leadership
  • Customers
  • Partners
  • Contact Us

Product

  • Couchbase Server
  • Couchbase SDKs
  • Use Cases
  • Documentation
  • Forums

Open Source

  • Couchbase Project
  • Couchbase vs. CouchDB

Commercial

  • Subscriptions & Support
  • Training & Services

News

  • Blog
  • Newsletter
  • Press Releases
  • Buzz

Follow Us

    
  • Customer Login
  • Terms of Service
  • Privacy Policy
  • Trademark Policy
  • Site Map

© 2013 COUCHBASE All rights reserved.

Sign in to Couchbase Community

close
  • Create new account
  • Request new password
You are logging into the Forums, Wiki and Issue Tracker