Yesterday my little Atom-based server's chipset fan was making a horrible noise. It's a cheap fan and tends to do that sometimes but I also noticed the drive light was continuously lit, which isn't normal, so I logged in to see what was going all. After a few minutes the SSH session froze and the machine stopped delivering web pages. I tried to log in again but got connection refused. it was time to hit the power button and instead of the expected ACPI shutdown the machine stopped instantly. I connected a keyboard and monitor.
On reboot the system complained the file /var/tm-main did not exist and went into single-user. I tried to edit /etc/fstab (which did indeed have a mount point of tm-main instead of tmp-main listed) but was told it was on a read-only file system.
I switched off and set up my backup VM I use when the server isn't available and updated its contents and certificates before switching the router over to send requests there. Then it was time to open the case and check connections. Nothing was loose, so I switched on again, and this time the machine booted properly into single user and mounted / rw, so I could edit fstab and correct the error. After that I got a normal boot and after satisfying myself all now seemed well boxed the case up again and switched my router back to it.
So what was going on? Is the SSD holding the main / partition failing, or was the noisy fan failing to cool the chipset properly, perhaps causing the chip to overheat enough to make the SATA port malfunction? How do I guess between these?
I suppose the safest option is to replace fan and drive, but copying the system onto the new drive would be a pain.
On reboot the system complained the file /var/tm-main did not exist and went into single-user. I tried to edit /etc/fstab (which did indeed have a mount point of tm-main instead of tmp-main listed) but was told it was on a read-only file system.
mount hung with no output and the same was true for most other commands I entered. Eventually I forced a reboot into the BIOS settings, where I found the SATA-0 port was claimed to be empty., even though that is where the / partition (ada0s1a) lives.I switched off and set up my backup VM I use when the server isn't available and updated its contents and certificates before switching the router over to send requests there. Then it was time to open the case and check connections. Nothing was loose, so I switched on again, and this time the machine booted properly into single user and mounted / rw, so I could edit fstab and correct the error. After that I got a normal boot and after satisfying myself all now seemed well boxed the case up again and switched my router back to it.
So what was going on? Is the SSD holding the main / partition failing, or was the noisy fan failing to cool the chipset properly, perhaps causing the chip to overheat enough to make the SATA port malfunction? How do I guess between these?
I suppose the safest option is to replace fan and drive, but copying the system onto the new drive would be a pain.