Python client error
Hi,
I'm trying to load 500K docs in a couchbase cluster, I have shards with 100k docs, each shards is loaded via same python script
The three first shards were loaded without any issue, but the fourth shard reported this error
Exception in thread dispatcher-thread (most likely raised during interpreter shutdown): Traceback (most recent call last): File "/usr/lib64/python2.6/threading.py", line 532, in __bootstrap_inner File "/usr/lib64/python2.6/threading.py", line 484, in run File "/usr/lib/python2.6/site-packages/couchbase/couchbaseclient.py", line 661, in _start_dispatcher File "/usr/lib/python2.6/site-packages/couchbase/couchbaseclient.py", line 968, in dispatch File "/usr/lib64/python2.6/Queue.py", line 174, in get <type 'exceptions.TypeError'>: 'NoneType' object is not callable
Now when I execute the loader script I have always this issue
Someone have idea what this could be?
Thanks
Hi,
Reading my server logs and other debug I did some identifications.
First, I didn't close the couchbaseclient with the done() method at the end of script, now the issue doesn't appears when script finish.
Second, my server exhaust the memory and crash the python script, in this case this exception is raise some times.
One thing I forget to say
My environment is a Centos OS 6 with python 2.6 and a Mac OSX lion 10.7.3 whit python 2.7, the version of the couchbase client is the 0.6
Regards
/Yago
Sorry for the trouble with the Python SDK. Would you be able to upload some sample Python that generates this error? That'd be a huge help to narrow down where and when it's happening--as I've not seen it, myself.
Are you using the Python SDK 0.6 download from...
http://www.couchbase.com/develop/python/next
...or a version you've built from the Github repo?
https://github.com/couchbase/couchbase-python-client
There is a bug listed in our issue tracker, but it references the 0.5 version:
http://www.couchbase.com/issues/browse/PYCBC-26
If you can confirm the version, etc, that'd be great.
Thanks,
Benjamin
Wanted to add I ran into this using
https://github.com/couchbase/couchbase-python-client/tree/couchbase-181
from what I can see the client.py: Bucket is missing the __del__ method that the main branch has. I cut and paste that in which stops the exception, and has us waiting 2 seconds for shutdown.
this happened to me today when testing importing ~100k docs that are each approx 100bytes in length. python 2.7.3 on mac / terminal / bash
Hi Yago,
I saw similar behavior recently while updating the client to its current version 0.6. However, I wasn't able to recreate the issue after it cleared up on its own. I've created an issue that's being tracked here - http://www.couchbase.com/issues/browse/PYCBC-26.
Thanks for reporting this error.
-- John