13.2-RELEASE not booting from NVME (ZFS mirror-ed)

tanis

tanis

Hi,

I tried to install 13.2-RELEASE and 13.1-RELEASE on an AMD Ryzen 5 3600 6-Core, and in both cases already the loader crashes. I'm yet to try 12.4-RELEASE, but I somehow doubt this is going to work either.

Google doesn't show anything about this kind of behaviour, anyone else experience with this issue ?

Regards,

tanis
 
tanis said:
Error message: BTX halted and before a bunch of memory addresses.
Click to expand...
That is one of the few situations where a photo of console would make sense.

Are you trying 32 or 64 bit install? Did you try switching between BIOS (that is CSM) and UEFI?
 
64 bit, and I managed to narrow it down a bit, seems to be related to nvme. ?

I can boot without any issue from sda/sdb mirrored using zfs auto installation but as soon as I try to do the same using the two nvme disks I get that message. ?
 
Screenshot trying to boot from nvme mirrored using ZFS default installation.
 

Attachments

  • FreeBSD-13.2-RELEASE.png
    FreeBSD-13.2-RELEASE.png
    173.8 KB · Views: 106
That’s a bummer. ? I got two additional systems running 13.1-Release on nvme using zfs stripe single disk working like a piece of cake. ? Maybe it’s related two the fact that there are now two disks instead of one?! ? Unfortunately this is a remote system I can’t just unplug one nvme drive. ??
 
Since it's remote system, can you disable one of the NVME devices in the bios? If so, see if it boots then.
 
Unfortunately this is the kind of mainboard (Asus) where it's not possible to disable one of the two drives. The m2 slots have to be enabled by setting PCIe in "NVMe RAID mode" which will then detect up to 4 drives, so my guess is that there is some magic going on which is probably causing the issue.
 
tanis said:
"NVMe RAID mode"
Click to expand...
Oh, I think that is an important bit of information. I have read/heard of issues when people have used the HW RAID stuff for SATA that is built into a lot of motherboards. I'd guess maybe the HW RAID is writing something in the same spots that ZFS does and gets it confused.
 
Unfortunately it's not really a HW RAID, as there are no options to specify what kind of raid is supported. The vendor it self promotes it as a SW raid. I guess I will just don't use them.
 
tanis said:
Unfortunately it's not really a HW RAID, as there are no options to specify what kind of raid is supported. The vendor it self promotes it as a SW raid. I guess I will just don't use them.
Click to expand...
Yep, that's kind of what I was thinking. "Have to set this mode in BIOS and then we restrict what you can do so we can completely mess things up for you".
I think a lot of times these RAID in BIOS default to striping devices, not really mirror or other RAID. Again, I'm speculating, but I can see the BIOS writing stuff to say first or last sector on a device which is where things like gpart and ZFS tend to also put things.
 
You must log in or register to reply here.
Back
Top