Solved freebsd-update to 13.1-RELEASE Fails to Boot

I was using freebsd-update to upgrade a box to 13.1-RELEASE.

Here is the command I used to start the process...

freebsd-update upgrade -r 13.1-RELEASE

I followed the usual process and when prompted to reboot the first time, rebooted. Now I get this...

Code:
|
\  ______               ____   _____ _____
  |  ____|             |  _ \ / ____|  __ \
  | |___ _ __ ___  ___ | |_) | (___ | |  | |
  |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |
  | |   | | |  __/  __/| |_) |____) | |__| |
  | |   | | |    |    ||     |      |      |
  |_|   |_|  \___|\___||____/|_____/|_____/      ```                        `
                                                s` `.....---.......--.```   -/
 +---------- Welcome to FreeBSD -----------+    +o   .--`         /y:`      +.
 |                                         |     yo`:.            :o      `+-
 |  1. Boot Multi user [Enter]             |      y/               -/`   -o/
 |  2. Boot Single user                    |     .-                  ::/sy+:.
 |  3. Escape to loader prompt             |     /                     `--  /
 |  4. Reboot                              |    `:                          :`
 |  5. Cons: Video                         |    `:                          :`
 |                                         |     /                          /
 |  Options:                               |     .-                        -.
 |  6. Kernel: default/kernel (1 of 2)     |      --                      -.
 |  7. Boot Options                        |       `:`                  `:`
 |  8. Boot Environments                   |         .--             `--.
 |                                         |            .---.....----.
 +-----------------------------------------+
   Autoboot in 0 seconds. [Space] to pause

Loading kernel...
/boot/kernel/kernel text=0x184d70 text=0xdfdfc0 text=0x6634c4 data=0x140 data=0x1be3b8+0x440c48 syms=[0x8+0x188d78+0x8+0x1a7803]
Loading configured modules...
/boot/modules/if_re.ko size 0x11d288 at 0x2131000
loading required module 'kernel'
module 'kernel' exists but with wrong version
/boot/kernel/zfs.ko size 0x5b93a0 at 0x2131000
/boot/entropy size=0x1000
/boot/kernel/if_lagg.ko size 0x180f0 at 0x26ec000
loading required module 'if_infiniband'
/boot/kernel/if_infiniband.ko size 0x3580 at 0x2705000
/etc/hostid size=0x25
---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.1-RELEASE releng/13.1-n250148-fc952ac2212 GENERIC amd64
FreeBSD clang version 13.0.0 (git@github.com:llvm/llvm-project.git llvmorg-13.0.0-0-gd7b669b3a303)
VT(vga): resolution 640x480
CPU: AMD Phenom(tm) II X4 955 Processor (3210.92-MHz K8-class CPU)
  Origin="AuthenticAMD"  Id=0x100f43  Family=0x10  Model=0x4  Stepping=3
  Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
  Features2=0x802009<SSE3,MON,CX16,POPCNT>
  AMD Features=0xee500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM,3DNow!+,3DNow!>
  AMD Features2=0x837ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,OSVW,IBS,SKINIT,WDT,NodeId>
  SVM: NP,NRIP,NAsids=64
  TSC: P-state invariant
real memory  = 17179869184 (16384 MB)
avail memory = 16575979520 (15808 MB)
Event timer "LAPIC" quality 100
ACPI APIC Table: <ALASKA A M I>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s)
random: unblocking device.
Firmware Warning (ACPI): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20201113/tbfadt-796)
ioapic0 <Version 2.1> irqs 0-23
ioapic1 <Version 2.1> irqs 24-55
Launching APs: 2 3 1
random: entropy device external interface
kbd1 at kbdmux0
vtvga0: <VT VGA driver>
smbios0: <System Management BIOS> at iomem 0xf0480-0xf049e
smbios0: Version: 2.7, BCD Revision: 2.7
aesni0: No AES or SHA support.
acpi0: <ALASKA A M I>
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 450
Event timer "HPET1" frequency 14318180 Hz quality 450
Event timer "HPET2" frequency 14318180 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
acpi_ec0: <Embedded Controller: GPE 0xa> port 0x62,0x66 on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 52 at device 2.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xe000-0xe07f mem 0xfd000000-0xfdffffff,0xc0000000-0xcfffffff,0xd0000000-0xd1ffffff irq 24 at device 0.0 on pci1
vgapci0: Boot video device
hdac0: <NVIDIA (0x0be3) HDA Controller> mem 0xfe080000-0xfe083fff irq 25 at device 0.1 on pci1
pcib2: <ACPI PCI-PCI bridge> irq 52 at device 3.0 on pci0
pci2: <ACPI PCI bus> on pcib2
ahci0: <Marvell 88SE9215 AHCI SATA controller> port 0xd050-0xd057,0xd040-0xd043,0xd030-0xd037,0xd020-0xd023,0xd000-0xd01f mem 0xfe440000-0xfe4407ff irq 28 at device 0.0 on pci2
ahci0: AHCI v1.00 with 4 6Gbps ports, Port Multiplier supported with FBS
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
pcib3: <ACPI PCI-PCI bridge> irq 52 at device 4.0 on pci0
pci3: <ACPI PCI bus> on pcib3
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xc000-0xc0ff mem 0xd2104000-0xd2104fff,0xd2100000-0xd2103fff irq 44 at device 0.0 on pci3
re0: Using 1 MSI-X message
re0: Chip rev. 0x2c800000
re0: MAC rev. 0x00100000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: 14:da:e9:0f:75:3e
re0: netmap queues/slots: TX 1/256, RX 1/256
pcib4: <ACPI PCI-PCI bridge> irq 52 at device 5.0 on pci0
pci4: <ACPI PCI bus> on pcib4
xhci0: <ASMedia ASM1042 USB 3.0 controller> mem 0xfe300000-0xfe307fff irq 46 at device 0.0 on pci4
xhci0: 32 bytes context size, 32-bit DMA
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pcib5: <ACPI PCI-PCI bridge> irq 53 at device 7.0 on pci0
pci5: <ACPI PCI bus> on pcib5
xhci1: <ASMedia ASM1042 USB 3.0 controller> mem 0xfe200000-0xfe207fff irq 50 at device 0.0 on pci5
xhci1: 32 bytes context size, 32-bit DMA
usbus1 on xhci1
usbus1: 5.0Gbps Super Speed USB v3.0
ahci1: <AMD SB7x0/SB8x0/SB9x0 AHCI SATA controller> port 0xf040-0xf047,0xf030-0xf033,0xf020-0xf027,0xf010-0xf013,0xf000-0xf00f mem 0xfe50b000-0xfe50b3ff irq 19 at device 17.0 on pci0
ahci1: AHCI v1.20 with 6 6Gbps ports, Port Multiplier supported
ahci1: quirks=0x22000<ATI_PMP_BUG,1MSI>
ahcich4: <AHCI channel> at channel 0 on ahci1
ahcich5: <AHCI channel> at channel 1 on ahci1
ahcich6: <AHCI channel> at channel 2 on ahci1
ahcich7: <AHCI channel> at channel 3 on ahci1
ahcich8: <AHCI channel> at channel 4 on ahci1
ahcich9: <AHCI channel> at channel 5 on ahci1
ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe50a000-0xfe50afff irq 18 at device 18.0 on pci0
usbus2 on ohci0
usbus2: 12Mbps Full Speed USB v1.0
ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe509000-0xfe5090ff irq 17 at device 18.2 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci0
usbus3: 480Mbps High Speed USB v2.0
ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe508000-0xfe508fff irq 20 at device 19.0 on pci0
usbus4 on ohci1
usbus4: 12Mbps Full Speed USB v1.0
ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe507000-0xfe5070ff irq 21 at device 19.2 on pci0
usbus5: EHCI version 1.0
usbus5 on ehci1
usbus5: 480Mbps High Speed USB v2.0
hdac1: <ATI SB600 HDA Controller> mem 0xfe500000-0xfe503fff irq 16 at device 20.2 on pci0
isab0: <PCI-ISA bridge> at device 20.3 on pci0
isa0: <ISA bus> on isab0
pcib6: <ACPI PCI-PCI bridge> at device 20.4 on pci0
pci6: <ACPI PCI bus> on pcib6
em0: <Intel(R) Legacy PRO/1000 GT 82541PI> port 0xb080-0xb0bf mem 0xfe140000-0xfe15ffff,0xfe120000-0xfe13ffff irq 20 at device 5.0 on pci6
em0: EEPROM V1.0-0
em0: Using 1024 TX descriptors and 1024 RX descriptors
em0: Ethernet address: 00:1b:21:62:32:0e
em0: netmap queues/slots: TX 1/1024, RX 1/1024
pci6: <serial bus, FireWire> at device 6.0 (no driver attached)
ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe506000-0xfe506fff irq 18 at device 20.5 on pci0
usbus6 on ohci2
usbus6: 12Mbps Full Speed USB v1.0
ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfe505000-0xfe505fff irq 22 at device 22.0 on pci0
usbus7 on ohci3
usbus7: 12Mbps Full Speed USB v1.0
ehci2: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfe504000-0xfe5040ff irq 23 at device 22.2 on pci0
usbus8: EHCI version 1.0
usbus8 on ehci2
usbus8: 480Mbps High Speed USB v2.0
acpi_button0: <Power Button> on acpi0
uart0: console (9600,n,8,1)> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROMs> at iomem 0xce800-0xd17ff,0xd1800-0xd27ff pnpid ORM0000 on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbdc0: non-PNP ISA device will be removed from GENERIC in FreeBSD 14.
hwpstate0: <Cool`n'Quiet 2.0> on cpu0
Timecounter "TSC-low" frequency 1605411449 Hz quality 800
Timecounters tick every 1.000 msec
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
hdacc0: <NVIDIA GT21x HDA CODEC> at cad 0 on hdac0
hdaa0: <NVIDIA GT21x Audio Function Group> at nid 1 on hdacc0
pcm0: <NVIDIA GT21x (HDMI/DP 8ch)> at nid 5 on hdaa0
hdacc1: <NVIDIA GT21x HDA CODEC> at cad 1 on hdac0
hdaa1: <NVIDIA GT21x Audio Function Group> at nid 1 on hdacc1
pcm1: <NVIDIA GT21x (HDMI/DP 8ch)> at nid 5 on hdaa1
hdacc2: <NVIDIA GT21x HDA CODEC> at cad 2 on hdac0
hdaa2: <NVIDIA GT21x Audio Function Group> at nid 1 on hdacc2
pcm2: <NVIDIA GT21x (HDMI/DP 8ch)> at nid 5 on hdaa2
hdacc3: <NVIDIA GT21x HDA CODEC> at cad 3 on hdac0
hdaa3: <NVIDIA GT21x Audio Function Group> at nid 1 on hdacc3
pcm3: <NVIDIA GT21x (HDMI/DP 8ch)> at nid 5 on hdaa3
hdacc4: <Realtek ALC892 HDA CODEC> at cad 0 on hdac1
hdaa4: <Realtek ALC892 Audio Function Group> at nid 1 on hdacc4
pcm4: <Realtek ALC892 (Rear Analog 7.1/2.0)> at nid 20,22,21,23 and 24,26 on hdaa4
pcm5: <Realtek ALC892 (Front Analog)> at nid 27 and 25 on hdaa4
pcm6: <Realtek ALC892 (Rear Digital)> at nid 30 on hdaa4
pcm7: <Realtek ALC892 (Onboard Digital)> at nid 17 on hdaa4
ugen2.1: <ATI OHCI root HUB> at usbus2
ugen3.1: <ATI EHCI root HUB> at usbus3
ugen5.1: <ATI EHCI root HUB> at usbus5
ugen7.1: <ATI OHCI root HUB> at usbus7
uhub0 on usbus2
uhub1 on usbus3
uhub2 on usbus5
uhub3 on usbus7
uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus5
uhub3: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus7
uhub1: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ugen8.1: <ATI EHCI root HUB> at usbus8
Trying to mount root from zfs:zroot/. []...
uhub4ugen4.1: <ATI OHCI root HUB> at usbus4
 on usbus8
ugen6.1: <ATI OHCI root HUB> at usbus6
uhub4: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus8
uhub5 on usbus4
uhub6 on usbus6
uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus6
uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
ugen0.1: <(0x1b21) XHCI root HUB> at usbus0
ugen1.1: <(0x1b21) XHCI root HUB> at usbus1
uhub7 on usbus0
uhub7: <(0x1b21) XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub8 on usbus1
uhub8: <(0x1b21) XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub3: 4 ports with 4 removable, self powered
uhub6: 2 ports with 2 removable, self powered
uhub0: 5 ports with 5 removable, self powered
uhub5: 5 ports with 5 removable, self powered
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <Samsung SSD 860 PRO 256GB RVM01B6Q> ACS-4 ATA SATA 3.x device
ada0: Serial Number S5GANE0MB05459J
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada0: Command Queueing enabled
ada0: 244198MB (500118192 512 byte sectors)
uhub7: 4 ports with 4 removable, self powered
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <Samsung SSD 860 PRO 256GB RVM02B6Q> ACS-4 ATA SATA 3.x device
ada1: Serial Number S5GANJ0R207046Z
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 512bytes)
ada1: Command Queueing enabled
ada1: 244198MB (500118192 512 byte sectors)
uhub8: 4 ports with 4 removable, self powered
ada2 at ahcich4 bus 0 scbus4 target 0 lun 0
ada2: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada2: Serial Number WD-WCC7K6YX6A23
ada2: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 3815447MB (7814037168 512 byte sectors)
ada2: quirks=0x1<4K>
ada3 at ahcich5 bus 0 scbus5 target 0 lun 0
ada3: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada3: Serial Number WD-WCC7K4SY228H
ada3: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 3815447MB (7814037168 512 byte sectors)
ada3: quirks=0x1<4K>
ada4 at ahcich6 bus 0 scbus6 target 0 lun 0
ada4: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada4: Serial Number WD-WCC7K4ZSF46S
ada4: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 3815447MB (7814037168 512 byte sectors)
ada4: quirks=0x1<4K>
uhub2: 5 ports with 5 removable, self powered
ada5 at ahcich7 bus 0 scbus7 target 0 lun 0
ada5: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada5: Serial Number WD-WCC7K3JUHKKX
ada5: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 3815447MB (7814037168 512 byte sectors)
ada5: quirks=0x1<4K>
uhub4: 4 ports with 4 removable, self powered
ada6 at ahcich8 bus 0 scbus8 target 0 lun 0
ada6: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada6: Serial Number WD-WCC7K4RU9RU1
ada6: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada6: Command Queueing enabled
ada6: 3815447MB (7814037168 512 byte sectors)
ada6: quirks=0x1<4K>
uhub1: 5 ports with 5 removable, self powered
ada7 at ahcich9 bus 0 scbus9 target 0 lun 0
ada7: <WDC WD40EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada7: Serial Number WD-WCC7K4EZ7NRX
ada7: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada7: Command Queueing enabled
ada7: 3815447MB (7814037168 512 byte sectors)
ada7: quirks=0x1<4K>
Root mount waiting for: usbus5
Setting hostuuid: 1f00f880-00c6-pid 35 (zfs), jid 0, uid 0: exited on signal 6
1400-ec9b-14dae90f753e.
Setting hostid: 0x19830pid 73 (zfs), jid 0, uid 0: exited on signal 6 (core dumped)
eb3.
internal epid 78 (zfs), jid 0, uid 0: exited on signal 6 (core dumped)
rror: Invalid arpid 79 (zfs), jid 0, uid 0: exited on signal 6 (core dumped)
gument
Abort trap
No suitable ugen4.2: <American Power Conversion Back-UPS XS 1300G FW:864.L6 .D USB FW:L6> at usbus4
dump device was found.
Starting file system checks:
Mounting local filesystemslo0: link state changed to UP
:.
internal error: Invalid argument
Abort trap (core dumped)
re0: link state changed to DOWN
internal error: Invalid argument
Abort trap (core dumped)
internal error: Invalid argument
Abort trap (core dumped)
mount: /usr: unknown special file or file system
Setting hostname: somebox.somedomain.com.
eval: /usr/sbin/ip6addrctl: not found
Setting up harvesting: [UMA],[FS_ATIME],SWI,INTERRUPT,NET_NG,[NET_ETHER],NET_TUN,MOUSE,KEYBOARD,ATTACH,CACHED
Feeding entropy: eval: dirname: not found
eval: fsync: not found
eval: dirname: not found
eval: fsync: not found
.
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/ctld
ELF ldconfig path: /lib /usr/lib
ldconfig: warning: /usr/lib: No such file or directory
ldconfig: mkstemp(/var/run/ld-elf.so.hints.b1jnL4): No such file or directory
32-bit compatibility ldconfig path:
ldconfig: mkstemp(/var/run/ld-elf32.so.hints.23BBkg): No such file or directory
eval: sort: not found
ld-elf.so.1: Shared object "libdevinfo.so.6" not found, required by "devmatch"
eval: sed: not found
Created clone interfaces: lagg1.
re0: link state changed to UP
Starting Networkem0: link state changed to UP
: lo0 re0 em0 lagg1.
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
    options=680003<RXCSUM,TXCSUM,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6>
    inet6 ::1 prefixlen 128
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
    inet 127.0.0.1 netmask 0xff000000
    groups: lo
    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
    ether 14:da:e9:0f:75:3e
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
    nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
em0: flags=8863<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=80209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
    ether 14:da:e9:0f:75:3e
    hwaddr 00:1b:21:62:32:0e
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
    nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
lagg1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
    ether 14:da:e9:0f:75:3e
    inet 192.168.X.X netmask 0xffffff00 broadcast 192.168.X.255
    laggproto lacp lagghash l2,l3,l4
    laggport: re0 flags=0<>
    laggport: em0 flags=0<>
    groups: lagg
    media: Ethernet autoselect
    status: active
    nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
Starting devd.
eval: limits: not found
/etc/rc: WARNING: failed to start devd
add host 127.0.0.1: gateway lo0 fib 0: route already in table
add net default: gateway 192.168.X.X
add host ::1: gateway lo0 fib 0: route already in table
add net fe80::: gateway ::1
add net ff02::: gateway ::1
add net ::ffff:0.0.0.0: gateway ::1
add net ::0.0.0.0: gateway ::1
Creating and/or trimming log fileseval: /usr/sbin/newsyslog: not found
.
Updating /var/run/os-release eval: mktemp: not found
eval: cannot create : No such file or directory
eval: install: not found
done.
Updating motd:eval: mktemp: not found
eval: uname: not found
eval: cannot create : No such file or directory
eval: cannot create : No such file or directory
eval: cmp: not found
usage: cp [-R [-H | -L | -P]] [-f | -i | -n] [-alpsvx] source_file target_file
       cp [-R [-H | -L | -P]] [-f | -i | -n] [-alpsvx] source_file ... target_directory
.
/etc/rc.d/tmp: mktemp: not found
/etc/rc.d/tmp: grep: not found
/etc/rc: WARNING: devfs_set_ruleset: you must specify a ruleset number
/etc/rc: WARNING: devfs_apply_ruleset: you must specify a ruleset
eval: egrep: not found
eval: sed: not found
eval: egrep: not found
eval: logger: not found
eval: cannot create /var/run/dmesg.boot: No such file or directory
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/syslogd
Clearing /tmp (X related).
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/rpcbind
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/nfsd
eval: utx: not found
Mounting late filesystems:.
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/ntpd
swapon: mdconfig (attach) error: md99 on file=/usr/swap0
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/sshd
Configuring vt: blanktimeeval: vidcontrol: not found
.
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/cron
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/sendmail
/etc/rc: WARNING: run_rc_command: cannot run /usr/sbin/sendmail
eval: /usr/bin/id: not found
[: !=: unexpected operator
Starting background file system checks in 60 seconds.
eval: logger: not found

Sat Jun 18 08:53:49 UTC 2022
2022-06-18T08:53:51.453214+00:00 somebox.somedomain.com init 655 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv0: No such file or directory
2022-06-18T08:53lagg1: link state changed to UP
:51.453292+00:00 somebox.somedomain.com init 656 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv1: No such file or directory
2022-06-18T08:53:51.453702+00:00 somebox.somedomain.com init 660 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv5: No such file or directory
2022-06-18T08:53:51.453342+00:00 somebox.somedomain.com init 657 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv2: No such file or directory
2022-06-18T08:53:51.453738+00:00 somebox.somedomain.com init 661 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv6: No such file or directory
2022-06-18T08:53:51.453798+00:00 somebox.somedomain.com init 659 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv4: No such file or directory
2022-06-18T08:53:51.453712+00:00 somebox.somedomain.com init 662 - - can't exec getty '/usr/libexec/getty' for port /dev/ttyv7: No such file or directory
[...these tty messages continue to repeat...]

After booting into single user mode, I have a zfs command...

Code:
# /sbin/zfs  mount
zroot/.                         /

But I can't seem to use it to mount the other filesystems...


Code:
# /sbin/zfs  mount -a
internal error: pid 27 (zfs), jid 0, uid 0: exited on signal 6
Invalid argument
Abort trap

Any advice on how I can roll this back... or forward?

Thanks in advance!
 
Thanks for the tip on /rescue/zfs, but it gives the same error...

Code:
# /rescue/zfs mount
zroot/.                         /
# /rescue/zfs list
internal error: pid 34 (zfs), jid 0, uid 0: exited on signal 6
Invalid argument
Abort trap

Will try booting external media and report back...
 
There are boot environments present. Try booting from the old one (or one of the other one(s).
Pressing 8 gets me this...

Code:
   ______               ____   _____ _____
  |  ____|             |  _ \ / ____|  __ \
  | |___ _ __ ___  ___ | |_) | (___ | |  | |
  |  ___| '__/ _ \/ _ \|  _ < \___ \| |  | |
  | |   | | |  __/  __/| |_) |____) | |__| |
  | |   | | |    |    ||     |      |      |
  |_|   |_|  \___|\___||____/|_____/|_____/      ```                        `
                                                s` `.....---.......--.```   -/
 +---------- Welcome to FreeBSD -----------+    +o   .--`         /y:`      +.
 |                                         |     yo`:.            :o      `+-
 |  1. Back to main menu [Backspace]       |      y/               -/`   -o/
 |  2. Active: zfs:zroot/. (1 of 5)        |     .-                  ::/sy+:.
 |  3. bootfs: zfs:zroot/.                 |     /                     `--  /
 |                                         |    `:                          :`
 |                                         |    `:                          :`
 |                                         |     /                          /
 |                                         |     .-                        -.
 |                                         |      --                      -.
 |                                         |       `:`                  `:`
 |                                         |         .--             `--.
 |                                         |            .---.....----.
 +-----------------------------------------+

Then I seem to lose my ability to type. I.e. pressing further keys does nothing, including backspace.

Note: I am using the console. ...While I search my apartment high and low for an old video adapter for this ancient video card. 🙄
 
Booting from external media, I can see both my root pool and storage pool. Unfortunately, importing the zroot pool breaks everything; i.e. after that I cannot run zfs or zpool or /rescue/zfs or /rescue/zpool.

covacat I am able to list mounts, though, and there is only one filesystem that mounts to /.

PXL_20220618_183012584.jpg


Not sure how to fix this. Can I roll back (or forward) the freebsd-update upgrade?
 
I did a bit of research and ended up rolling back the zfs filesystems (each one separately as there doesn't seem to be a command to do this recursively) on zroot using commands like...

zfs rollback -R zroot@daily-snapshot-name
zfs rollback -R zroot/usr@daily-snapshot-name
zfs rollback -R zroot/var@daily-snapshot-name

...and so on for each child filesystem.

Then I rebooted and things were back to the way theey were earlier.
 
you may have multiple zfs datasets with the mountpoint set to /
see https://forums.freebsd.org/threads/zfs-not-loading-pool-in-multi-user.85352/
boot from external media / or in single user mode and inspect pool mountpoints (use /rescue/zfs )

Following up on this so I can complete the upgrade...

This is what my zroot layout looks like. (I know, it's a bit of a mess; I followed a blog post on how to convert my UFS system to ZFS.)

Code:
NAME                        USED  AVAIL  REFER  MOUNTPOINT
zroot                      33.3G   197G    88K  /
zroot/.                     153M   197G   140M  /.
zroot/tmp                   169M   197G   166M  /tmp
zroot/usr                  26.6G   197G  13.8G  /usr
zroot/usr/home             8.49G   197G   278M  /usr/home
zroot/usr/local            2.02G   197G   878M  /usr/local
zroot/usr/obj                88K   197G    88K  /usr/obj
zroot/usr/ports             966M   197G   838M  /usr/ports
zroot/usr/ports/distfiles   125M   197G   125M  /usr/ports/distfiles
zroot/usr/ports/packages   2.79M   197G  2.79M  /usr/ports/packages
zroot/usr/src              1.31G   197G  1.31G  /usr/src
zroot/var                  6.29G   197G  5.88G  /var
zroot/var/audit              88K   197G    88K  /var/audit
zroot/var/crash              88K   197G    88K  /var/crash
zroot/var/log              27.0M   197G  5.34M  /var/log
zroot/var/mail              964K   197G   876K  /var/mail
zroot/var/tmp               216K   197G    96K  /var/tmp

Questions:

1. Can I simply remove the mountpoint for just zroot?
2. Do I need to rename zroot/.? And if so, so I need to reboot to external media again for that? And then just update /boot/loader.conf with the new vfs.root.mountfrom value?
 
Back
Top