EPERF - Protocol Error between ep-engine and mccouch causes resetConnection

Karan Kumar added a comment - 16/Dec/11 7:08 PM [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.1763.0>:couch_log:info:39] 10.6.153.208 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.1765.0>:couch_log:info:39] 10.6.151.112 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.3289.0>:couch_log:info:39] 10.6.153.208 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.1739.0>:couch_log:info:39] 10.188.213.11 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.1777.0>:couch_log:info:39] 10.6.117.231 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:18] [ ns_1@10.6.87.130 :<0.1868.0>:couch_log:info:39] 10.191.7.242 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:19] [ ns_1@10.6.87.130 :<0.1725.0>:couch_log:info:39] 10.190.157.18 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3453.0>:couch_log:info:39] 10.6.117.231 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3500.0>:couch_log:info:39] 10.68.154.26 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3381.0>:couch_log:info:39] 10.6.129.242 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3526.0>:couch_log:info:39] 10.191.7.242 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3407.0>:couch_log:info:39] 10.188.213.11 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:20] [ ns_1@10.6.87.130 :<0.3487.0>:couch_log:info:39] 10.190.157.18 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:21] [ ns_1@10.6.87.130 :<0.3383.0>:couch_log:info:39] 10.6.129.242 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:21] [ ns_1@10.6.87.130 :<0.1655.0>:couch_log:info:39] 10.6.151.112 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:21] [ ns_1@10.6.87.130 :<0.640.0>:couch_log:info:39] 10.6.177.27 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:22] [ ns_1@10.6.87.130 :<0.1434.0>:couch_log:info:39] 10.68.154.26 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1724.0>:couch_log:info:39] 10.6.177.27 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1763.0>:couch_log:info:39] 10.6.153.208 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1765.0>:couch_log:info:39] 10.6.151.112 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.3289.0>:couch_log:info:39] 10.6.153.208 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1739.0>:couch_log:info:39] 10.188.213.11 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1777.0>:couch_log:info:39] 10.6.117.231 - - GET /default%2Fmaster/ 200 [ns_server:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1378.0>:ns_port_server:log:155] memcached<0.1378.0>: Rubbish received on the backend stream. closing it memcached<0.1378.0>: Trying to connect to mccouch: "localhost:11213" memcached<0.1378.0>: Connected to mccouch: "localhost:11213" [couchdb:info] [2011-12-16 19:38:23] [ ns_1@10.6.87.130 :<0.1868.0>:couch_log:info:39] 10.191.7.242 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:24] [ ns_1@10.6.87.130 :<0.1725.0>:couch_log:info:39] 10.190.157.18 - - GET /default%2Fmaster/ 200 [ns_server:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :ns_config_rep:ns_config_rep:do_pull:257] Pulling config from: ' ns_1@10.6.151.112 ' [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3453.0>:couch_log:info:39] 10.6.117.231 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3500.0>:couch_log:info:39] 10.68.154.26 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3381.0>:couch_log:info:39] 10.6.129.242 - - GET /default%2Fmaster/ 200 [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3526.0>:couch_log:info:39] 10.191.7.242 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3407.0>:couch_log:info:39] 10.188.213.11 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:25] [ ns_1@10.6.87.130 :<0.3487.0>:couch_log:info:39] 10.190.157.18 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:26] [ ns_1@10.6.87.130 :<0.3383.0>:couch_log:info:39] 10.6.129.242 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:26] [ ns_1@10.6.87.130 :<0.1655.0>:couch_log:info:39] 10.6.151.112 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:26] [ ns_1@10.6.87.130 :<0.640.0>:couch_log:info:39] 10.6.177.27 - - GET /_replicator/ 200 [couchdb:info] [2011-12-16 19:38:27] [ ns_1@10.6.87.130 :<0.1434.0>:couch_log:info:39] 10.68.154.26 - - GET /default%2Fmaster/ 200

Karan Kumar added a comment - 16/Dec/11 7:10 PM Attaching diags

Karan Kumar added a comment - 26/Dec/11 12:52 PM Assigning to Sharon, for triaging this appropriately.

Farshid Ghods added a comment - 20/Feb/12 10:36 AM Steve, can we get someone from ep-engine to just comment on the bug to understand this crash ? this have been seen a few times under load and also have been reported in the forum. we haven't seen this in the recent large cluster runs but i am not sure if this is completely fixed. we also don't need to spend time fixing this since we are replacing this path with couchstore

Steve Yen added a comment - 20/Feb/12 11:57 AM Jin, Since we're likely replacing this pathway with couchstore, this seems low priority -- however, there might be some case shared mccouch bug on the erlang side that would bite us even with the switch to couchstore.

Jin Lim added a comment - 30/Apr/12 6:05 PM More info/clarification needed.

Chiyoung Seo added a comment - 30/May/12 9:41 PM Fixed by Liang as part of extending mccouch mock server and testing various network communication failures.