[SPY-80] timeout error causing application to crash. Created: 23/Feb/12  Updated: 29/May/13

Status: Open
Project: Spymemcached Java Client
Component/s: None
Affects Version/s: None
Fix Version/s: .next
Security Level: Public

Type: Bug Priority: Major
Reporter: Alex Ma Assignee: Alex Ma
Resolution: Unresolved Votes: 0
Labels: None
Remaining Estimate: Not Specified
Time Spent: Not Specified
Original Estimate: Not Specified
Environment: membase 1.7.2r
spy 2.7.3


 Description   
We have a customer on membase 1.7.2r and spy 2.7.3 that saw a application issue during rebalance.

Their devs said that the app received timeout errors and the exception below:

Because of the timeout issues with rebalance, they ended up deleting the bucket and creating and repopulating them.

They'd like to know on the spy side, the cause for the timeout and if this is fixed in the new java client?

thanks

-Alex.

java.lang.RuntimeException: Exception waiting for value
at net.spy.memcached.MemcachedClient.gets(MemcachedClient.java:1103)
at net.spy.memcached.MemcachedClient.gets(MemcachedClient.java:1161)
at com.playtika.common.dal.vs.MembaseDAO.getUserMessages(MembaseDAO.java:343)
at com.playtika.cache.CacheDao.getUserMessage(CacheDao.java:978)
at com.playtika.servlets.Common.getUserMessages(Common.java:276)
at com.playtika.servlets.Common.doPost(Common.java:142)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.filters.RequestsLoggerFilter.doFilter(RequestsLoggerFilter.java:78)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.filters.LoggerFilter.doFilter(LoggerFilter.java:75)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.filters.SessionFilter.doFilter(SessionFilter.java:89)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.stats.StatisticFilter.doFilter(StatisticFilter.java:46)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.filters.RequestAccountMappingFilter.doFilter(RequestAccountMappingFilter.java:50)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.playtika.filters.CharsetEncodingFilter.doFilter(CharsetEncodingFilter.java:13)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.util.concurrent.ExecutionException: OperationException: SERVER: Internal error
at net.spy.memcached.internal.OperationFuture.get(OperationFuture.java:81)
at net.spy.memcached.MemcachedClient.gets(MemcachedClient.java:1098)
... 37 more
Caused by: OperationException: SERVER: Internal error
at net.spy.memcached.protocol.BaseOperationImpl.handleError(BaseOperationImpl.java:135)
at net.spy.memcached.protocol.binary.OperationImpl.getStatusForErrorCode(OperationImpl.java:184)
at net.spy.memcached.protocol.binary.OperationImpl.finishedPayload(OperationImpl.java:150)
at net.spy.memcached.protocol.binary.OperationImpl.readFromBuffer(OperationImpl.java:139)
at net.spy.memcached.protocol.binary.GetsOperationImpl.readFromBuffer(GetsOperationImpl.java:5)
at net.spy.memcached.MemcachedConnection.handleReads(MemcachedConnection.java:504)
at net.spy.memcached.MemcachedConnection.handleIO(MemcachedConnection.java:418)
at net.spy.memcached.MemcachedConnection.handleIO(MemcachedConnection.java:275)
at net.spy.memcached.MemcachedClient.run(MemcachedClient.java:2030)

 Comments   
Comment by Michael Nitschinger [ 08/May/13 ]
Hi Alex,

I know it's been a long time, but do you recall if this issue persisted even with a newer release of the client? 2.7 is old now and we recommend upgrading (we'll release 2.9 soon).

If this has not seen any progress, I think we can close this - right?
Generated at Sun Aug 31 00:46:08 CDT 2014 using JIRA 5.2.4#845-sha1:c9f4cc41abe72fb236945343a1f485c2c844dac9.