FreeBSD 14.0-RELEASE-p3 will not read my USB 3.0 disks

I did a freebsd-update fetch and install to FreeBSD 14.0-RELEASE-p3 this morning on a Raspberry Pi4. I have a mirrored zpool (two WD Red SATA SSD 500 GB disks), and until installing the P3 the Pi did recognised the USB 3 disks. After upgrading to FreeBSD 14.0-RELEASE-p3 the USB disks was not recognised by the kernel.

I don't know any details about the update, but it did brake my NAS. The solution was to do a freebsd-update rollback to FreeBSD 14.0-RELEASE-p2 and now the disks are recognised again..

Anyone else experienced any trouble with USB 3 ports after upgrade?
 
P3 fixes an issue with the NFS client. It doesn't come anywhere near the USB code.


OK, but the reality is that P3 did not find my USB disk. I did several power off (removed power) and reboots of my Pi. Disconnected and reconnected the USB drives several times, both when power was off and on... Still no USB disks.
The only way to get med USB disks back was going back to P2...
 
"not recognized" and "did not find" is not something we can help debug. We need more detailed information. For example, in dmesg there must be output relating to the USB ports, what does it say? Are there any error messages when running P3? Can you compare the dmesg and /var/log/messages output from P2 and P3?
 
"not recognized" and "did not find" is not something we can help debug. We need more detailed information. For example, in dmesg there must be output relating to the USB ports, what does it say? Are there any error messages when running P3? Can you compare the dmesg and /var/log/messages output from P2 and P3?
Dmesg did not find the USBs, da0 and da1.. This is the dmesg from P2 :

Code:
da0 at umass-sim0 bus 0 scbus0 target 0 lun 0
da0: <ASMT 2235 0> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number 12345679CE96
da0: 400.000MB/s transfers
da0: 476940MB (976773168 512 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
usb_msc_auto_quirk: UQ_MSC_NO_GETMAXLUN set for USB mass storage device asmedia ASMT1051 (0x174c:0x55aa)
ugen0.4: <asmedia ASMT1051> at usbus0
umass1 on uhub0
umass1: <asmedia ASMT1051, class 0/0, rev 3.10/1.00, addr 3> on usbus0
umass1:  SCSI over Bulk-Only; quirks = 0x0100
umass1:1:1: Attached to scbus1
da1 at umass-sim1 bus 1 scbus1 target 0 lun 0
da1: <ASMT 2235 0> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number 12345678DB65
da1: 400.000MB/s transfers
da1: 476940MB (976773168 512 byte sectors)
da1: quirks=0x2<NO_6_BYTE>

And this is from the /var/log/messages booting P3

Code:
Dec 13 07:21:42 backup kernel: WARNING: Cannot find freebsd,dts-version property, cannot check DTB compliance
Dec 13 07:21:42 backup kernel: Copyright (c) 1992-2023 The FreeBSD Project.
Dec 13 07:21:42 backup kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Dec 13 07:21:42 backup kernel:     The Regents of the University of California. All rights reserved.
Dec 13 07:21:42 backup kernel: FreeBSD is a registered trademark of The FreeBSD Foundation.
Dec 13 07:21:42 backup kernel: FreeBSD 14.0-RELEASE-p3 #0: Mon Dec 11 05:07:37 UTC 2023
Dec 13 07:21:42 backup kernel:     root@arm64-builder.daemonology.net:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC arm64
Dec 13 07:21:42 backup kernel: FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
Dec 13 07:21:42 backup kernel: VT: init without driver.
Dec 13 07:21:42 backup kernel: module scmi already present!
Dec 13 07:21:42 backup kernel: real memory  = 8443125760 (8051 MB)
Dec 13 07:21:42 backup kernel: avail memory = 8208924672 (7828 MB)
Dec 13 07:21:42 backup kernel: Starting CPU 1 (1)
Dec 13 07:21:42 backup kernel: Starting CPU 2 (2)
Dec 13 07:21:42 backup kernel: Starting CPU 3 (3)
Dec 13 07:21:42 backup kernel: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
Dec 13 07:21:42 backup kernel: random: unblocking device.
Dec 13 07:21:42 backup kernel: random: entropy device external interface
Dec 13 07:21:42 backup kernel: kbd0 at kbdmux0
Dec 13 07:21:42 backup kernel: ofwbus0: <Open Firmware Device Tree>
Dec 13 07:21:42 backup kernel: simplebus0: <Flattened device tree simple bus> on ofwbus0
Dec 13 07:21:42 backup kernel: ofw_clkbus0: <OFW clocks bus> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed0: <Fixed clock> on ofw_clkbus0
Dec 13 07:21:42 backup kernel: clk_fixed1: <Fixed clock> on ofw_clkbus0
Dec 13 07:21:42 backup kernel: clk_fixed2: <Fixed clock> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed3: <Fixed clock> on ofwbus0
Dec 13 07:21:42 backup kernel: simplebus1: <Flattened device tree simple bus> on ofwbus0
Dec 13 07:21:42 backup kernel: simplebus2: <Flattened device tree simple bus> on ofwbus0
Dec 13 07:21:42 backup kernel: regfix0: <Fixed Regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 1 times
Dec 13 07:21:42 backup kernel: regfix1: <Fixed Regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: regfix2: <Fixed Regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: regfix3: <Fixed Regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: regfix4: <Fixed Regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: simplebus3: <Flattened device tree simple bus> on ofwbus0
Dec 13 07:21:42 backup kernel: simple_mfd0: <Simple MFD (Multi-Functions Device)> mem 0x7d5d2000-0x7d5d2eff on simplebus0
Dec 13 07:21:42 backup kernel: bcm2835_firmware0: <BCM2835 Firmware> on simplebus0
Dec 13 07:21:42 backup kernel: ofw_clkbus1: <OFW clocks bus> on bcm2835_firmware0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 1 times
Dec 13 07:21:42 backup kernel: psci0: <ARM Power State Co-ordination Interface Driver> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 15 times
Dec 13 07:21:42 backup kernel: gic0: <ARM Generic Interrupt Controller> mem 0x40041000-0x40041fff,0x40042000-0x40043fff,0x40044000-0x40045fff,0x40046000-0x40047fff irq 30 on simplebus0
Dec 13 07:21:42 backup kernel: gic0: pn 0x2, arch 0x2, rev 0x1, implementer 0x43b irqs 256
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 3 times
Dec 13 07:21:42 backup kernel: gpio0: <BCM2708/2835 GPIO controller> mem 0x7e200000-0x7e2000b3 irq 14,15 on simplebus0
Dec 13 07:21:42 backup kernel: gpiobus0: <OFW GPIO bus> on gpio0
Dec 13 07:21:42 backup kernel: gpio1: <Raspberry Pi Firmware GPIO controller> on bcm2835_firmware0
Dec 13 07:21:42 backup kernel: gpiobus1: <GPIO bus> on gpio1
Dec 13 07:21:42 backup kernel: regfix0: Cannot configure GPIO pin: 5
Dec 13 07:21:42 backup kernel: REGNODE_INIT failed: 6
Dec 13 07:21:42 backup kernel: regfix0: Cannot register regulator.
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 1 times
Dec 13 07:21:42 backup kernel: regfix2: Cannot set GPIO pin: 6
Dec 13 07:21:42 backup kernel: REGNODE_INIT failed: 6
Dec 13 07:21:42 backup kernel: regfix2: Cannot register regulator.
Dec 13 07:21:42 backup kernel: mbox0: <BCM2835 VideoCore Mailbox> mem 0x7e00b880-0x7e00b8bf irq 13 on simplebus0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 1 times
Dec 13 07:21:42 backup kernel: gpioregulator0: <GPIO controlled regulator> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 3 times
Dec 13 07:21:42 backup kernel: generic_timer0: <ARMv8 Generic Timer> irq 4,5,6,7 on ofwbus0
Dec 13 07:21:42 backup kernel: Timecounter "ARM MPCore Timecounter" frequency 54000000 Hz quality 1000
Dec 13 07:21:42 backup kernel: Event timer "ARM MPCore Eventtimer" frequency 54000000 Hz quality 1000
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 19 times
Dec 13 07:21:42 backup kernel: bcm_dma0: <BCM2835 DMA Controller> mem 0x7e007000-0x7e007aff irq 31,32,33,34,35,36,37,38,39,40,41 on simplebus0
Dec 13 07:21:42 backup kernel: usb_nop_xceiv0: <USB NOP PHY> on ofwbus0
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 3 times
Dec 13 07:21:42 backup kernel: bcm2835_clkman0: <BCM283x Clock Manager> mem 0x7e101000-0x7e102fff on simplebus0
Dec 13 07:21:42 backup kernel: gpioc0: <GPIO controller> on gpio0
Dec 13 07:21:42 backup kernel: uart0: <PrimeCell UART (PL011)> mem 0x7e201000-0x7e2011ff irq 16 on simplebus0
Dec 13 07:21:42 backup kernel: uart0: console (115200,n,8,1)
Dec 13 07:21:42 backup kernel: spi0: <BCM2708/2835 SPI controller> mem 0x7e204000-0x7e2041ff irq 18 on simplebus0
Dec 13 07:21:42 backup kernel: spibus0: <OFW SPI bus> on spi0
Dec 13 07:21:42 backup kernel: spibus0: <unknown card> at cs 0 mode 0
Dec 13 07:21:42 backup kernel: spibus0: <unknown card> at cs 1 mode 0
Dec 13 07:21:42 backup kernel: sdhci_bcm0: <Broadcom 2708 SDHCI controller> mem 0x7e300000-0x7e3000ff irq 24 on simplebus0
Dec 13 07:21:42 backup kernel: mmc0: <MMC/SD bus> on sdhci_bcm0
Dec 13 07:21:42 backup kernel: iichb0: <BCM2708/2835 BSC controller> mem 0x7e804000-0x7e804fff irq 27 on simplebus0
Dec 13 07:21:42 backup kernel: bcmwd0: <BCM2708/2835 Watchdog> mem 0x7e100000-0x7e100113,0x7e00a000-0x7e00a023,0x7ec11000-0x7ec1101f on simplebus0
Dec 13 07:21:42 backup kernel: bcmrng0: <Broadcom BCM2835/BCM2838 RNG> mem 0x7e104000-0x7e104027 on simplebus0
Dec 13 07:21:42 backup kernel: gpioc1: <GPIO controller> on gpio1
Dec 13 07:21:42 backup kernel: fb0: <BCM2835 VT framebuffer driver> on simplebus0
Dec 13 07:21:42 backup kernel: fb0: changing fb bpp from 0 to 24
Dec 13 07:21:42 backup kernel: mbox0: mbox response error
Dec 13 07:21:42 backup kernel: fb0: bcm2835_mbox_fb_init failed, err=5
Dec 13 07:21:42 backup kernel: device_attach: fb0 attach returned 6
Dec 13 07:21:42 backup kernel: sdhci_bcm1: <Broadcom 2708 SDHCI controller> mem 0x7e340000-0x7e3400ff irq 79 on simplebus1
Dec 13 07:21:42 backup kernel: mmc1: <MMC/SD bus> on sdhci_bcm1
Dec 13 07:21:42 backup kernel: pmu0: <Performance Monitoring Unit> irq 0,1,2,3 on ofwbus0
Dec 13 07:21:42 backup kernel: cpulist0: <Open Firmware CPU Group> on ofwbus0
Dec 13 07:21:42 backup kernel: cpu0: <Open Firmware CPU> on cpulist0
Dec 13 07:21:42 backup kernel: bcm2835_cpufreq0: <CPU Frequency Control> on cpu0
Dec 13 07:21:42 backup kernel: pcib0: <BCM2838-compatible PCI-express controller> mem 0x7d500000-0x7d50930f irq 80,81 on simplebus2
Dec 13 07:21:42 backup kernel: pcib0: hardware identifies as revision 0x304.
Dec 13 07:21:42 backup kernel: pci0: <OFW PCI bus> on pcib0
Dec 13 07:21:42 backup kernel: pcib1: <PCI-PCI bridge> irq 91 at device 0.0 on pci0
Dec 13 07:21:42 backup kernel: pci1: <OFW PCI bus> on pcib1
Dec 13 07:21:42 backup kernel: bcm_xhci0: <VL805 USB 3.0 controller (on the Raspberry Pi 4b)> irq 92 at device 0.0 on pci1
Dec 13 07:21:42 backup kernel: bcm_xhci0: 32 bytes context size, 64-bit DMA
Dec 13 07:21:42 backup kernel: usbus0 on bcm_xhci0
Dec 13 07:21:42 backup kernel: genet0: <RPi4 Gigabit Ethernet> mem 0x7d580000-0x7d58ffff irq 82,83 on simplebus2
Dec 13 07:21:42 backup kernel: genet0: GENET version 5.0 phy 0x0000
Dec 13 07:21:42 backup kernel: miibus0: <MII bus> on genet0
Dec 13 07:21:42 backup kernel: brgphy0: <BCM54213PE 1000BASE-T media interface> PHY 1 on miibus0
Dec 13 07:21:42 backup kernel: brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto
Dec 13 07:21:42 backup kernel: genet0: Ethernet address: d8:3a:dd:5b:50:71
Dec 13 07:21:42 backup kernel: clk_fixed4: clock-fixed has no clock-frequency
Dec 13 07:21:42 backup syslogd: last message repeated 1 times
Dec 13 07:21:42 backup kernel: gpioled0: <GPIO LEDs> on ofwbus0
Dec 13 07:21:42 backup kernel: armv8crypto0: CPU lacks AES instructions
Dec 13 07:21:42 backup kernel: Timecounters tick every 1.000 msec
Dec 13 07:21:42 backup kernel: usbus0: 5.0Gbps Super Speed USB v3.0
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x000001aa | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: ugen0.1: <(0x1106) XHCI root HUB> at usbus0
Dec 13 07:21:42 backup kernel: uhub0 on usbus0
Dec 13 07:21:42 backup kernel: uhub0: <(0x1106) XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x000001aa | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x00000000 | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x00000000 | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x00000000 | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Got command interrupt 0x00030000, but there is no active command.
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ============== REGISTER DUMP ==============
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Sys addr: 0x00000000 | Version:  0x00009902
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Blk size: 0x00000000 | Blk cnt:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Argument: 0x00000000 | Trn mode: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Present:  0x000f0000 | Host ctl: 0x00000001
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Power:    0x0000000f | Blk gap:  0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Wake-up:  0x00000000 | Clock:    0x00003947
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Timeout:  0x00000000 | Int stat: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Int enab: 0x01ff00bb | Sig enab: 0x01ff00bb
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: AC12 err: 0x00000000 | Host ctl2:0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Caps:     0x00000000 | Caps2:    0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: Max curr: 0x00000001 | ADMA err: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ADMA addr:0x00000000 | Slot int: 0x00000000
Dec 13 07:21:42 backup kernel: sdhci_bcm0-slot0: ===========================================
Dec 13 07:21:42 backup kernel: mmc0: No compatible cards found on bus
Dec 13 07:21:42 backup kernel: iicbus0: <OFW I2C bus> on iichb0
Dec 13 07:21:42 backup kernel: iic0: <I2C generic I/O> on iicbus0
Dec 13 07:21:42 backup kernel: mmcsd0: 128GB <SDHC SR128 8.6 SN 4D8640E9 MFG 11/2022 by 3 SD> at mmc1 50.0MHz/4bit/65535-block
Dec 13 07:21:42 backup kernel: bcm2835_cpufreq0: ARM 600MHz, Core 200MHz, SDRAM 400MHz, Turbo OFF
Dec 13 07:21:42 backup kernel: CPU  0: ARM Cortex-A72 r0p3 affinity:  0
Dec 13 07:21:42 backup kernel:                    Cache Type = <64 byte D-cacheline,64 byte I-cacheline,PIPT ICache,64 byte ERG,64 byte CWG>
Dec 13 07:21:42 backup kernel:  Instruction Set Attributes 0 = <CRC32>
Dec 13 07:21:42 backup kernel:  Instruction Set Attributes 1 = <>
Dec 13 07:21:42 backup kernel:  Instruction Set Attributes 2 = <>
Dec 13 07:21:42 backup kernel:          Processor Features 0 = <AdvSIMD,FP,EL3 32,EL2 32,EL1 32,EL0 32>
Dec 13 07:21:42 backup kernel:          Processor Features 1 = <>
Dec 13 07:21:42 backup kernel:       Memory Model Features 0 = <TGran4,TGran64,SNSMem,BigEnd,16bit ASID,16TB PA>
Dec 13 07:21:42 backup kernel:       Memory Model Features 1 = <8bit VMID>
Dec 13 07:21:42 backup kernel:       Memory Model Features 2 = <32bit CCIDX,48bit VA>
Dec 13 07:21:42 backup kernel:              Debug Features 0 = <DoubleLock,2 CTX BKPTs,4 Watchpoints,6 Breakpoints,PMUv3,Debugv8>
Dec 13 07:21:42 backup kernel:              Debug Features 1 = <>
Dec 13 07:21:42 backup kernel:          Auxiliary Features 0 = <>
Dec 13 07:21:42 backup kernel:          Auxiliary Features 1 = <>
Dec 13 07:21:42 backup kernel: AArch32 Instruction Set Attributes 5 = <CRC32,SEVL>
Dec 13 07:21:42 backup kernel: AArch32 Media and VFP Features 0 = <FPRound,FPSqrt,FPDivide,DP VFPv3+v4,SP VFPv3+v4,AdvSIMD>
Dec 13 07:21:42 backup kernel: AArch32 Media and VFP Features 1 = <SIMDFMAC,FPHP DP Conv,SIMDHP SP Conv,SIMDSP,SIMDInt,SIMDLS,FPDNaN,FPFtZ>
Dec 13 07:21:42 backup kernel: CPU  1: ARM Cortex-A72 r0p3 affinity:  1
Dec 13 07:21:42 backup kernel: CPU  2: ARM Cortex-A72 r0p3 affinity:  2
Dec 13 07:21:42 backup kernel: CPU  3: ARM Cortex-A72 r0p3 affinity:  3
Dec 13 07:21:42 backup kernel: Release APs...done
Dec 13 07:21:42 backup kernel: Trying to mount root from ufs:/dev/ufs/rootfs [rw]...
Dec 13 07:21:42 backup kernel: TCP_ratelimit: Is now initialized
Dec 13 07:21:42 backup kernel: uhub0: 5 ports with 4 removable, self powered
Dec 13 07:21:42 backup kernel: Warning: no time-of-day clock registered, system time will not be set accurately
Dec 13 07:21:42 backup kernel: Dual Console: Serial Primary, Video Secondary
Dec 13 07:21:42 backup kernel: ugen0.2: <vendor 0x2109 USB2.0 Hub> at usbus0
Dec 13 07:21:42 backup kernel: uhub1 on uhub0
Dec 13 07:21:42 backup kernel: uhub1: <vendor 0x2109 USB2.0 Hub, class 9/0, rev 2.10/4.21, addr 1> on usbus0
Dec 13 07:21:42 backup kernel: uhub1: 4 ports with 4 removable, self powered
Dec 13 07:21:42 backup kernel: uhub_reattach_port: port 2 reset failed, error=USB_ERR_TIMEOUT
Dec 13 07:21:42 backup kernel: uhub_reattach_port: device problem (USB_ERR_TIMEOUT), disabling port 2
Dec 13 07:21:42 backup kernel: uhub_reattach_port: port 3 reset failed, error=USB_ERR_TIMEOUT
Dec 13 07:21:42 backup kernel: uhub_reattach_port: device problem (USB_ERR_TIMEOUT), disabling port 3
Dec 13 07:21:42 backup kernel: genet0: link state changed to UP
Dec 13 07:21:42 backup kernel: lo0: link state changed to UP
Dec 13 07:21:42 backup kernel: genet0: link state changed to DOWN
Dec 13 07:21:42 backup kernel: genet0: link state changed to UP
Dec 13 08:23:05 backup ntpd[1382]: ntpd 4.2.8p16-a (1): Starting
 
Seems like the P3 times out or something searching for USB ports

Code:
Dec 13 07:21:42 backup kernel: uhub_reattach_port: port 2 reset failed, error=USB_ERR_TIMEOUT
Dec 13 07:21:42 backup kernel: uhub_reattach_port: device problem (USB_ERR_TIMEOUT), disabling port 2
Dec 13 07:21:42 backup kernel: uhub_reattach_port: port 3 reset failed, error=USB_ERR_TIMEOUT
Dec 13 07:21:42 backup kernel: uhub_reattach_port: device problem (USB_ERR_TIMEOUT), disabling port 3
D
 
That timeout error message also caught my eye. Could this be a timing or power supply issue? As an example: I don't have a Pi4 at home (only Pi3s and Zeros), but I know that I can make my Pi3 crash by running software (!) when using an insufficient USB power adapter. To get it to run reliably when loaded, I need to use the 5.1V 3A power supply (Adafruit sells them). So my theory here is that something has changed (perhaps correlated with the install of P3) that is now causing hardware-related errors, which are preventing USB from working.

Suggestion: Divide and conquer. One USB at a time. Undo any other changes that happened at the same time. Simplify the system (for example unplug video and network). Or similar attempts.
 
That timeout error message also caught my eye. Could this be a timing or power supply issue? As an example: I don't have a Pi4 at home (only Pi3s and Zeros), but I know that I can make my Pi3 crash by running software (!) when using an insufficient USB power adapter. To get it to run reliably when loaded, I need to use the 5.1V 3A power supply (Adafruit sells them). So my theory here is that something has changed (perhaps correlated with the install of P3) that is now causing hardware-related errors, which are preventing USB from working.

Suggestion: Divide and conquer. One USB at a time. Undo any other changes that happened at the same time. Simplify the system (for example unplug video and network). Or similar attempts.
My Pi4 is powered by Raspberry Pi4 power adapter (15 W). I checked the power consumption on my WD Red SSD Sata disks and max power on write is 3.8W, max read 3W and idle 60mW.. It is working fine on P2, scrub works and reports no failure. It is a mirrored pool. It might very well be a power issue when upgrading to P3. But I do not want to damage the pool (degrade it) by just connect one disk at time.. And what if it is not a power issue? How many times can I do a freebsd-update rollback? On P3 I also tried connect the disks when powered up, no success..
 
I have a Pi with zroot, just one usb3 SATA disk, and I use zxfer to backup to a second usb3 SATA disk that I attach from time to time. This worked nearly all of the time with both disks powered over USB, but I did see cam errors (OK after retries) during backups. But the system wouldn't boot with both disks attached. Attaching the backup disk via a powered hub fixed the CAM errors and the booting problem. FreeBSD 13.1 & 13.2.
 
Understand your concerns about not trying degraded mode, or upgrade/rollback too much.

The disks are USB powered? If not, you could try to get a separate power supply for them. Or connect them via an external USB hub that has its own power. But: That is all operating on the theory that the root cause is insufficient power. It could also be something else.
 
I am running 14.0-p3 on my pi4 with ufs root on a usb ssd but I compiled it locally. The ssd is powered by pi4 & I am using the “official” power adapter so the conditions are not the same.
git diff of -p2 and -p3 verifies that changes are nfs related only

And what if it is not a power issue? How many times can I do a freebsd-update rollback? On P3 I also tried connect the disks when powered up, no success..
You need to figure out how to test your “not a power issue” hypothesis. With zfs root & bectl you don’t need to freebsd-update rollback, just pick a different boot environment!

WD Red SSD Sata disks and max power on write is 3.8W, max read 3W and idle 60mW..
On power up they will draw 6W, which maybe more than what pi4 can provide. Pi4 provides max 1.2A@5V on usb so if you have two disks, keyboard and mouse, you may be running into its limit. To test try removing mouse &keyboard and boot or use an external powered usb hub.
 
I am running 14.0-p3 on my pi4 with ufs root on a usb ssd but I compiled it locally. The ssd is powered by pi4 & I am using the “official” power adapter so the conditions are not the same.
git diff of -p2 and -p3 verifies that changes are nfs related only


You need to figure out how to test your “not a power issue” hypothesis. With zfs root & bectl you don’t need to freebsd-update rollback, just pick a different boot environment!


On power up they will draw 6W, which maybe more than what pi4 can provide. Pi4 provides max 1.2A@5V on usb so if you have two disks, keyboard and mouse, you may be running into its limit. To test try removing mouse &keyboard and boot or use an external powered usb hub.
Thx very much for input :) I am still booting from a non zfs root, booting from the internal SD card. I will in some time change boot to external SSD and also get a powered USB Hub.. For the moment the Pi4 works as expected on P2. Mouse and keyboard dongle is removed, only attached to Pi4 is cabled network and two USB 3 disks.. and the local SD card for boot... I have important data on the mirrored zpool, but also backup on other external SSDs. So if zpool fails it is not a disaster, but I am not ready to reestablish the pool before I have the powered USB hub in house... So for the moment it seems like no more update to P3 until extra powered HW is bought...
 
Seems too close to the edge (for my comfort)! Hope you are scrubbing it frequently.
Well, after discussion here and problems with P3 I just did a new scrub:
Code:
pool: backups
 state: ONLINE
  scan: scrub repaired 0B in 00:27:06 with 0 errors on Wed Dec 13 20:39:03 2023
config:

    NAME                          STATE     READ WRITE CKSUM
    backups                       ONLINE       0     0     0
      mirror-0                    ONLINE       0     0     0
        diskid/DISK-12345679CE96  ONLINE       0     0     0
        diskid/DISK-12345678DB65  ONLINE       0     0     0

errors: No known data errors

and I am shutting down the Pi4 and getting a powered USB hub... I am googling some issues with powered hub and the Pi, which hub are you using?
 
Update: I suspect the issue with USBC 3.0 disks and FreeBSD 14.0-RELEASE-p3 was power related. I have changed the boot from the internal SD disk to SATA SSD. Not yet got a powered USB HUB nor connected my mirrored ZFS pool. But my Pi4 is now booting FreeBSD 14.0-RELEASE-p3 from an external SSD SATA disk connected to one of the USBC 3.0 ports. Just followed a YouTube to change the boot priority. So I suspect the issues reported is due to not sufficient power from the Pi power supply.
 
Back
Top