I have the same problem with Couchbase 7.1.3 in a local docker container… Here the errors from indexer.log
If I recreate the container from scratch, it works for a while, I can create 1 or 2 indexes, then indexer stops working. After restart it’s random. Sometimes indexes simply stuck in “warmup” state, sometimes indexer crashes, sometimes it works for a while until it crashes.
Couchbase Container was installed this way:
and in the bucket there are only 8 small documents, so no memory problem or so.
2023-03-09T14:55:05.754+00:00 [Error] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 127.0.0.1:9999 Topic MAINT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891. Err projector.topicMissing
2023-03-09T14:55:05.754+00:00 [Error] KVSender::closeMutationStream MAINT_STREAM Error Received projector.topicMissing from 127.0.0.1:9999
2023-03-09T14:55:05.754+00:00 [Error] KVSender::sendShutdownTopic Unexpected Error During Shutdown Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891. Err projector.topicMissing
2023-03-09T14:55:05.754+00:00 [Error] KVSender::closeMutationStream INIT_STREAM Error Received projector.topicMissing from 127.0.0.1:9999
2023-03-09T14:55:05.795+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_CONFIG_UPDATE elapsed 762.986µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:55:05.813+00:00 [Error] KVSender::sendMutationTopicRequest Projector 127.0.0.1:9999 Topic MAINT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 content
Unexpected Error feed.feeder
2023-03-09T14:55:05.813+00:00 [Error] KVSender::openMutationStream MAINT_STREAM content Error Received feed.feeder from 127.0.0.1:9999
2023-03-09T14:55:05.822+00:00 [Error] GetMcConn(): MCResponse status=KEY_ENOENT, opcode=0x89, opaque=0, msg:
2023-03-09T14:55:05.823+00:00 [Warn] Indexer::getCurrentKVTs error=MCResponse status=KEY_ENOENT, opcode=0x89, opaque=0, msg: Retrying (1)
2023-03-09T14:55:06.833+00:00 [Error] KVSender::openMutationStream MAINT_STREAM content Error from Projector feed.feeder
2023-03-09T14:55:06.833+00:00 [Error] Indexer::startKeyspaceIdStream Stream MAINT_STREAM KeyspaceId content SessionId 69759. Error from Projector feed.feeder. Retrying 1.
2023-03-09T14:56:07.015+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.715097ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.015+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_CLIENT_STATS elapsed 5.751µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.030+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 101.571µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.049+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_COMMIT_CREATE_INDEX elapsed 18.737615ms len(expediates) 1 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.051+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 1.932047ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.746+00:00 [Error] watcher:ClientAuth cluster Ver (6)/Internal Version () not yet initialised
2023-03-09T14:56:07.748+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.647418ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.749+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_REPLICA_COUNT elapsed 11.125µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:07.751+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9100. Error = read tcp 127.0.0.1:47522->127.0.0.1:9100: use of closed network connection. Kill Pipe.
2023-03-09T14:56:07.751+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:47522. Error = EOF. Kill Pipe.
2023-03-09T14:56:08.382+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.287325ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] Accept() Error: accept tcp4 0.0.0.0:9103: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] receiving packet: read tcp4 127.0.0.1:9103->127.0.0.1:46892: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] worker “127.0.0.1:46892” exit: read tcp4 127.0.0.1:9103->127.0.0.1:46892: use of closed network connection
2023-03-09T14:56:09.373+00:00 [Error] DATP[->dataport “:9103”] fatal remote “127.0.0.1:46892” already gone
2023-03-09T14:56:09.383+00:00 [Error] KVSender::sendDelKeyspacesRequest Unexpected Error During Del Buckets Request Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 KeyspaceIds [content]. Err genServer.closed
2023-03-09T14:56:09.383+00:00 [Error] KVSender::deleteKeyspacesFromStream INIT_STREAM [content] Error Received genServer.closed from 127.0.0.1:9999
2023-03-09T14:56:09.385+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.708742ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.390+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 66.836µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.440+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_COMMIT_CREATE_INDEX elapsed 49.303086ms len(expediates) 1 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.442+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 2.170499ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.738+00:00 [Error] watcher:ClientAuth cluster Ver (6)/Internal Version () not yet initialised
2023-03-09T14:56:09.740+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_SERVICE_MAP elapsed 1.735139ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.741+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_REPLICA_COUNT elapsed 9.03µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:09.742+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:9100. Error = read tcp 127.0.0.1:36444->127.0.0.1:9100: use of closed network connection. Kill Pipe.
2023-03-09T14:56:09.742+00:00 [Error] PeerPipe.doRecieve() : ecounter error when received mesasage from Peer 127.0.0.1:36444. Error = EOF. Kill Pipe.
2023-03-09T14:56:10.729+00:00 [Error] DATP[->dataport “:9103”] Accept() Error: accept tcp4 0.0.0.0:9103: use of closed network connection
2023-03-09T14:56:10.729+00:00 [Error] receiving packet: read tcp4 127.0.0.1:9103->127.0.0.1:45124: use of closed network connection
2023-03-09T14:56:10.729+00:00 [Error] DATP[->dataport “:9103”] worker “127.0.0.1:45124” exit: read tcp4 127.0.0.1:9103->127.0.0.1:45124: use of closed network connection
2023-03-09T14:56:10.732+00:00 [Error] KVSender::sendDelKeyspacesRequest Unexpected Error During Del Buckets Request Projector 127.0.0.1:9999 Topic INIT_STREAM_TOPIC_805dd3c8e12a89dda0cadb31c9506891 KeyspaceIds [fts]. Err genServer.closed
2023-03-09T14:56:10.732+00:00 [Error] KVSender::deleteKeyspacesFromStream INIT_STREAM [fts] Error Received genServer.closed from 127.0.0.1:9999
2023-03-09T14:56:10.739+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_UPDATE_INDEX_INST elapsed 10.758309ms len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error
2023-03-09T14:56:10.744+00:00 [Info] lifecycleMgr.dispatchRequest: op OPCODE_PREPARE_CREATE_INDEX elapsed 70.115µs len(expediates) 0 len(incomings) 0 len(outgoings) 0 len(parallels) 0 error