Couchbase Server

Moxi returns errors during rebalance

Details

  • Type: Bug Bug
  • Status: Resolved Resolved
  • Priority: Critical Critical
  • Resolution: Duplicate
  • Affects Version/s: 1.7 GA
  • Fix Version/s: 1.7.1
  • Component/s: moxi, ns_server
  • Security Level: Public
  • Labels:
    None

Description

During rebalance in of new node and running mc-loader check here's what I'm getting:


root@tau:~/src/altoros/moxi/mc-loader# ./generate-keyset.rb -k 2700100 -v 1 | pv -letpr -s 2700100 | ./parallelize-lines 32 ./mc-loader dn2:11211 - check valuesize 302
Failed to get: 02533522, memcached failure 16 (NOT FOUND) ] 9% ETA 0:01:30
Failed to get: 02530071, memcached failure 16 (NOT FOUND)
Failed to get: 02529847, memcached failure 16 (NOT FOUND)
Failed to get: 02540834, memcached failure 16 (NOT FOUND)
Failed to get: 02528631, memcached failure 16 (NOT FOUND)
Failed to get: 02530693, memcached failure 16 (NOT FOUND)
Failed to get: 02539638, memcached failure 16 (NOT FOUND) ] 10% ETA 0:01:33
Failed to get: 02529074, memcached failure 16 (NOT FOUND)
Failed to get: 02539700, memcached failure 16 (NOT FOUND)
Failed to get: 02529696, memcached failure 16 (NOT FOUND)
Failed to get: 02538566, memcached failure 16 (NOT FOUND)
Failed to get: 02538637, memcached failure 16 (NOT FOUND)
Failed to get: 02537884, memcached failure 16 (NOT FOUND)
Failed to get: 02537494, memcached failure 16 (NOT FOUND)

Next time (still during rebalance) and after rebalance everything works.

Issue Links

duplicates

Bug - A problem which impairs or prevents the functions of the product. MB-3884 moxi returning 132 and 133 error when loading data during rebalance

  • Critical - Crashes, loss of data, severe memory leak.
  • Closed - The issue is considered finished, the resolution is correct. Issues which are closed can be reopened.

Activity

Ascending order - Click to sort in descending order
Hide
Permalink
Aleksey Kondratenko added a comment -
And I've seen similar issue right after failover
Show
Aleksey Kondratenko added a comment - And I've seen similar issue right after failover
Hide
Permalink
Farshid Ghods added a comment -
yeah this is a very well known issue with 1.7 and apparently i forgot to add it to release notes (MB-3884)

and a front runner in bugs need to be fixed for 1.7.1
Show
Farshid Ghods added a comment - yeah this is a very well known issue with 1.7 and apparently i forgot to add it to release notes ( MB-3884 ) and a front runner in bugs need to be fixed for 1.7.1
Hide
Permalink
Farshid Ghods added a comment - - edited
i marked mb-3884 as critical for 1.7.1.
the clients can handle this error by retrying because moxi recovers after 30-45 seconds and its able to send and receive the keys to the right memcached,
Show
Farshid Ghods added a comment - - edited i marked mb-3884 as critical for 1.7.1. the clients can handle this error by retrying because moxi recovers after 30-45 seconds and its able to send and receive the keys to the right memcached,

People

  • Assignee:
    Steve Yen
    Reporter:
    Aleksey Kondratenko
Vote (0)
Watch (0)

Dates

  • Created:
    Updated:
    Resolved: