ZFS zfs: removing non-existent segment from range

vext01

vext01

Hi,

Noticed that my FreeBSD NAS was not accessible today. No ssh, no ping.

Ripped it out from its home and took it to a monitor and I see this:

broken2.jpg


It does this if I boot single user too :(

I'm praying that the NAS mirror (also ZFS) is not dead. I assume this is the boot zfs that is broken.

Anything I can try to get this to boot, or is it game over?

Cheers
 
oogh yeah that sounds like a horked zfs. boot to a rescue image and zpool import to see if that also explodes...
 
Judging by the number of disks, I suspect this is a redundant setup. Perhaps mirrored. You could theoretically try disabling half of each mirror pair, then trying a READONLY zpool import (probably from rescue media); if you're lucky, the corrupted metadata is only on one mirror copy. This would also be a good time to learn a lot of zdb skills and figure out ZFS internals ... that's mostly a joke, for most people it's not practical.

Do you know where your backup is? <- I love asking this question, it is meant rhetorically.

Out of idle curiosity: What FreeBSD and ZFS version did this to you?
 
ralphbsz said:
Judging by the number of disks, I suspect this is a redundant setup. Perhaps mirrored. You could theoretically try disabling half of each mirror pair, then trying a READONLY zpool import (probably from rescue media); if you're lucky, the corrupted metadata is only on one mirror copy.
Click to expand...

That's a good point. There are two zfs mirrors, one for the OS, one for the data. I could try unplugging one of the boot disks, although I'm not sure if both OS disks have a bootloader installed.
ralphbsz said:
Do you know where your backup is? <- I love asking this question, it is meant rhetorically.
Click to expand...

All of the good stuff actually is backed up to backblaze via restic :)

ralphbsz said:
Out of idle curiosity: What FreeBSD and ZFS version did this to you?
Click to expand...

I think it was 14.3.
 
Following up, it seems to be just one of the OS mirror disks with issues.

I was able to unplug the failed drive, boot the FreeBSD usb stick image and do `zpool import -o readonly=on -R /tmp/zfs <pool>` and my files are then available in `/tmp/zfs/<pool>`.

I'm going to transfer everything to new hardware, as I don't trust this box any more. It's given me a few problems in the past year.

Thanks everyone.
 
You must log in or register to reply here.
Back
Top