I can't tell what is going wrong, but indexing is taking days (> 48hrs, < 50% indexed) on some buckets with a small number of views and relatively small number of documents each (< 10million). The map function is essentially this:
if (/^type:.*/.test(doc.id_field)) emit (doc.id, doc)
There is a recommendation not to emit the doc, but I've encountered multiple issues trying to retrieve the document from the view so gave up one emitting null for the value. I had originally thought indexing was stalled, but now I think it is just very slow for some reason.
Just did an iostat check -- reads and writes are at about 1400 blocks/sec and 53% utilization. Is this high? How does Couchbase index documents?