Details
Description
upgrade 1.8.1 -> 2.0.1-120-rel
http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
/testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=1.8.1-942-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1
upgrade 2.0.0-1978-rel -> 2.0.1-120-rel
http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
./testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=2.0.0-1978-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1
after upgrade we wait warmup, ep_queue_size 0 == 0 , ep_flusher_todo 0 == 0, check vb_active_curr_items and curr_items, verify all items and only then to verify that
sum_of_curr_items == total_items we do:
[2013-01-09 03:13:43,690] - [rebalance_helper:259] INFO - waiting for sum_of_curr_items == total_items....
[2013-01-09 03:13:43,787] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.13:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
[2013-01-09 03:13:43,788] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.13:8091
[2013-01-09 03:13:43,836] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.14:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
[2013-01-09 03:13:43,837] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.14:8091
[2013-01-09 03:13:44,054] - [rebalance_helper:270] INFO - unable to retrieve stats for any node. returning true
[2013-01-09 03:13:44,125] - [data_helper:289] INFO - creating direct client 10.3.3.14:11210 default
2013-01-09 03:13:43.592 menelaus_web:19:warning:server error during request processing(ns_1@10.3.3.11) - Server error during processing: ["web request failed",
{path,
"/pools/default/buckets/default/nodes/10.3.3.13:8091/stats"},
{type,error},
{what, badarith},
{trace,
[{menelaus_stats,
'-computed_stats_lazy_proplist/0-fun-8-',
2},
{lists,zipwith,3},
{menelaus_stats,
'-samples_to_proplists/1-fun-3-',2},
{lists,map,2},
{menelaus_stats,samples_to_proplists,1},
{menelaus_stats,
build_buckets_stats_ops_response,4},
{menelaus_stats,
'-handle_bucket_node_stats/4-fun-0-',7},
{menelaus_web_buckets,
checking_bucket_access,4}]}]
http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
/testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=1.8.1-942-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1
upgrade 2.0.0-1978-rel -> 2.0.1-120-rel
http://qa.hq.northscale.net/view/2.0.1/job/centos-64-2.0-upgrade/51/consoleFull
./testrunner -i /tmp/upgrade.ini get-logs=False,upgrade_version=2.0.1-120-rel,initial_vbuckets=64 -t newupgradetests.MultiNodesUpgradeTests.offline_cluster_upgrade,initial_version=2.0.0-1978-rel,nodes_init=3,sasl_buckets=1,standard_buckets=1
after upgrade we wait warmup, ep_queue_size 0 == 0 , ep_flusher_todo 0 == 0, check vb_active_curr_items and curr_items, verify all items and only then to verify that
sum_of_curr_items == total_items we do:
[2013-01-09 03:13:43,690] - [rebalance_helper:259] INFO - waiting for sum_of_curr_items == total_items....
[2013-01-09 03:13:43,787] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.13:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
[2013-01-09 03:13:43,788] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.13:8091
[2013-01-09 03:13:43,836] - [rest_client:571] ERROR - http://10.3.3.11:8091/pools/default/buckets/default/nodes/10.3.3.14:8091/stats error 500 reason: unknown ["Unexpected server error, request logged."]
[2013-01-09 03:13:43,837] - [rebalance_helper:336] INFO - unable to get stats from 10.3.3.14:8091
[2013-01-09 03:13:44,054] - [rebalance_helper:270] INFO - unable to retrieve stats for any node. returning true
[2013-01-09 03:13:44,125] - [data_helper:289] INFO - creating direct client 10.3.3.14:11210 default
2013-01-09 03:13:43.592 menelaus_web:19:warning:server error during request processing(ns_1@10.3.3.11) - Server error during processing: ["web request failed",
{path,
"/pools/default/buckets/default/nodes/10.3.3.13:8091/stats"},
{type,error},
{what, badarith},
{trace,
[{menelaus_stats,
'-computed_stats_lazy_proplist/0-fun-8-',
2},
{lists,zipwith,3},
{menelaus_stats,
'-samples_to_proplists/1-fun-3-',2},
{lists,map,2},
{menelaus_stats,samples_to_proplists,1},
{menelaus_stats,
build_buckets_stats_ops_response,4},
{menelaus_stats,
'-handle_bucket_node_stats/4-fun-0-',7},
{menelaus_web_buckets,
checking_bucket_access,4}]}]