Couchbase Server

Unable to view stats on failed-over-node during xdcr+rebalance, server_error on call for capi_set_view_manager-biXDCR_bucket',

Details

  • Type: Bug Bug
  • Status: Closed Closed
  • Priority: Major Major
  • Resolution: Duplicate
  • Affects Version/s: 2.0
  • Fix Version/s: 2.0
  • Component/s: cross-datacenter-replication, ns_server
  • Security Level: Public
  • Labels:
    None
  • Environment:
    2.0-1952

Description

Issue rebalance on a xdcr cluster.

Seeing several server_errors on view stats for biXDCR bucket.

Server error during processing: ["web request failed",
{path,
"/pools/default/buckets/biXDCR_bucket/statsDirectory"},
{type,exit},
{what,
{noproc,
{gen_server,call,
['capi_set_view_manager-biXDCR_bucket',
{foreach_doc,
#Fun<capi_ddoc_replication_srv.1.36030090>},
infinity]}}},
{trace,
[{gen_server,call,3},
{capi_ddoc_replication_srv,
foreach_live_ddoc_id,2},
{capi_ddoc_replication_srv,fetch_ddoc_ids,
1},
{menelaus_stats,
couchbase_view_stats_descriptions,1},
{menelaus_stats,membase_stats_description,
1},
{menelaus_stats,serve_stats_directory,3},
{menelaus_web_buckets,
checking_bucket_access,4},
{menelaus_web,loop,3}]}]

Cluster accessible at http://ec2-175-41-186-167.ap-southeast-1.compute.amazonaws.com:8091/index.html#sec=log

Added screenshot of the cluster during rebalance.

Will add the logs in a bit.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Aliaksey Artamonau added a comment -
Node 175-41-186-167 was failed over. And then someone tried to get bucket stats on that particular node. Currently it does not handled really well because some of the processes on which stats rely are shut down when bucket is deleted.
Show
Aliaksey Artamonau added a comment - Node 175-41-186-167 was failed over. And then someone tried to get bucket stats on that particular node. Currently it does not handled really well because some of the processes on which stats rely are shut down when bucket is deleted.
Hide
Permalink
Ketaki Gangal added a comment -
Yes, I had failed over this node and did a add-back node within few minutes.
-Followed this by a rebalance on the cluster.
Show
Ketaki Gangal added a comment - Yes, I had failed over this node and did a add-back node within few minutes. -Followed this by a rebalance on the cluster.
Hide
Permalink
Steve Yen added a comment -
likely a dupe
Show
Steve Yen added a comment - likely a dupe
Hide
Permalink
Steve Yen added a comment -
from bug-scrub - this a duplicate
Show
Steve Yen added a comment - from bug-scrub - this a duplicate

People

  • Assignee:
    Aliaksey Artamonau
    Reporter:
    Ketaki Gangal
Vote (0)
Watch (1)

Dates

  • Created:
    Updated:
    Resolved: