Solved Bhyve guests failing to boot

Hello,

I hosts few bhyve guests on a vmpool,

Code:
# zpool list vmpool

NAME     SIZE  ALLOC   FREE  CKPOINT  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT

vmpool   372G   257G   115G        -         -    64%    69%  1.00x  ONLINE  -

Unfortunately, the guests on this pool are failing to boot. Here is log for a debian guest,

Code:
# vm console debian
[    1.462724] ACPI Error: Could not enable RealTimeClock event (20160831/evxfevnt-212)
/dev/vda1: recovering journal
[    4.962864] blk_update_request: I/O error, dev vda, sector 2048
[    4.964793] Buffer I/O error on dev vda1, logical block 0, lost async page write
[    4.967367] Buffer I/O error on dev vda1, logical block 1, lost async page write
[    4.969906] blk_update_request: I/O error, dev vda, sector 2088
[    4.971920] Buffer I/O error on dev vda1, logical block 5, lost async page write
[    4.974550] blk_update_request: I/O error, dev vda, sector 10552
[    4.976580] Buffer I/O error on dev vda1, logical block 1063, lost async page write
[    4.980782] blk_update_request: I/O error, dev vda, sector 8390920
[    4.982934] Buffer I/O error on dev vda1, logical block 1048609, lost async page write
[    4.985529] blk_update_request: I/O error, dev vda, sector 8391072
[    4.987551] Buffer I/O error on dev vda1, logical block 1048628, lost async page write
[    4.990146] Buffer I/O error on dev vda1, logical block 1048629, lost async page write
[    4.992734] Buffer I/O error on dev vda1, logical block 1048630, lost async page write
[    4.995329] blk_update_request: I/O error, dev vda, sector 8391312
[    4.997358] Buffer I/O error on dev vda1, logical block 1048658, lost async page write
[    4.999942] Buffer I/O error on dev vda1, logical block 1048659, lost async page write
[    5.002544] blk_update_request: I/O error, dev vda, sector 8391184
[    5.004587] blk_update_request: I/O error, dev vda, sector 8391344
[    5.006661] blk_update_request: I/O error, dev vda, sector 8390952
[    5.008719] blk_update_request: I/O error, dev vda, sector 8391056
/dev/vda1: Superblock needs_recovery flag is clear, but journal has data.
/dev/vda1: Run journal anyway

/dev/vda1: UNEXPECTED INCONSISTENCY; RUN fsck MANUALLY.
        (i.e., without -a or -p options)
fsck exited with status code 4
The root filesystem on /dev/vda1 requires a manual fsck

BusyBox v1.22.1 (Debian 1:1.22.0-19+b3) built-in shell (ash)
Enter 'help' for a list of built-in commands.

(initramfs)

I have tried to do an fsck of the guest zvol drive but it fails with a No space left on device,
Code:
# fsck.ext4  /dev/zvol/vmpool/os2s1
e2fsck 1.44.3 (10-Jul-2018)
/dev/zvol/vmpool/os2s1: recovering journal
Error writing block 5799936 (No space left on device).  Ignore error<y>?

Is it because I have reached 69% of the capacity on vmpool?

Is there any way to fix this?

Thanks
 
Back
Top