Hello
I installed Couchbase Server Community Edition 6.5.1 build 6299 on my server.
Recently, One of my server’s disk has bad sector. So I replaced the server’s Disk (sdc1)
When I removed disk, The Server’s Couchbase Process is suddenly Down.
This is system log when i removed disk
Jan 27 15:33:48 [HOSTNAME] kernel: sd 0:2:2:0: SCSI device is removed
Jan 27 15:33:48 [HOSTNAME] dbus-daemon[1513]: dbus[1513]: [system] Activating service name='org.freedesktop.problems' (using servicehelper)
Jan 27 15:33:48 [HOSTNAME] dbus[1513]: [system] Activating service name='org.freedesktop.problems' (using servicehelper)
Jan 27 15:33:48 [HOSTNAME] kernel: megaraid_sas 0000:02:00.0: 3701258 (665076824s/0x0001/FATAL) - VD 02/2 is now OFFLINE
Jan 27 15:33:48 [HOSTNAME] dbus-daemon[1513]: dbus[1513]: [system] Successfully activated service 'org.freedesktop.problems'
Jan 27 15:33:48 [HOSTNAME] dbus[1513]: [system] Successfully activated service 'org.freedesktop.problems'
Jan 27 15:33:51 [HOSTNAME] ipmievd[1931]: Drive Slot / Bay sensor - Drive Present ()
Jan 27 15:33:59 [HOSTNAME] couchbase[30197]: 2021-01-27 15:33:59 cb_dist: terminating with reason: shutdown
Jan 27 15:34:00 [HOSTNAME] epmd[32169]: epmd: got KILL_REQ - terminates normal
Jan 27 15:34:00 [HOSTNAME] couchbase[32148]: erl_child_setup closed
Jan 27 15:34:00 [HOSTNAME] couchbase[32148]: Crash dump is being written to: erl_crash.dump.1604319020.32148.babysitter...done
Jan 27 15:34:00 [HOSTNAME] systemd[1]: couchbase-server.service: main process exited, code=exited, status=1/FAILURE
Jan 27 15:34:00 [HOSTNAME] systemd[1]: Unit couchbase-server.service entered failed state.
Jan 27 15:34:00 [HOSTNAME] systemd[1]: couchbase-server.service failed.
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): Unmounting Filesystem
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): metadata I/O error: block 0x180001170 ("xlog_iodone") error 5 numblks 64
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): xfs_do_force_shutdown(0x2) called from line 1238 of file fs/xfs/xfs_log.c. Return address = 0xffffffffc04e4210
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): Log I/O Error Detected. Shutting down filesystem
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): Unable to update superblock counters. Freespace may not be correct on next mount.
Jan 27 15:34:00 [HOSTNAME] kernel: XFS (sdc1): Please umount the filesystem and rectify the problem(s)
Jan 27 15:34:01 [HOSTNAME] ipmievd[1931]: Drive Slot / Bay sensor - Drive Present ()
How can i find the reason?
Thanks.