FreeBSD13.0: gptzfsboot will not boot from ZFS volume with bookmark_v2 active (fresh install)

I have (painfully) experienced the following problem and I would welcome the community's feedback before I go crazy:
On a newly installed FreeBSD13.0 system, with legacy bios boot and gptzfsboot installed, the system will not boot if the pool has a bookmark created giving error :

Code:
ZFS: unsupported feature: com.datto:bookmark_v2
ZFS: pool zroot is not supported

When switching to UEFI boot, the same system starts up (i.e. boots from ZFS) without problem.

The issue is easy to reproduce:

  1. Create a new VM (I used bhyve) and install 13.0 choosing GPT(dual) on ZFS root.
  2. Boot using a bios loader
  3. login, take a snapshot and create a bookmark
  4. reboot
  5. System gives an error as above
  6. power down system
  7. Change the loader to UEFI
  8. boot up the system
  9. the system works correctly.

Could it be that gptzfsboot does not support all the ZFS-supported features of 13.0? Or am I missing the obvious?
 
source code says it should be supported
are you sure you have the correct version of gptzfsboot ?
Code:
-r--r--r--  1 root  wheel  158858 Apr  9  2021 /boot/gptzfsboot
MD5 (/boot/gptzfsboot) = 7f225794f3a3c3c44d2475e23ad78a4a
 
source code says it should be supported
are you sure you have the correct version of gptzfsboot ?
Code:
-r--r--r--  1 root  wheel  158858 Apr  9  2021 /boot/gptzfsboot
MD5 (/boot/gptzfsboot) = 7f225794f3a3c3c44d2475e23ad78a4a
That’s the first thing I checked. It comes from the 13.0 install iso. I even dd’d the code and did a byte compare.
 
I would first try it on bare metal. Because what if the issue lies in bhyve or it's configuration ?
The error message comes from the boot code, But I will indeed try at least with another virtualisation platform to exclude this (no bare metal easily available).
EDIT: Not reproducible under VirtualBox
 
Back
Top