FreeSBD 13.3 and FreeBSD 14 on Dell R450 with BOSS-S1 Card or PERC H74x/H75x

saznik · May 22, 2024

I need to migrate some older Dell Hardware Machines. They have a simple Disk Layout with a UFS Filesystem and good old PERC H730 RAID 1 Controller Setup.

Has anyone some experience running FreeBSD 13.3 and FreeBSD 14.0 on Dell Server 15th Generation R450 with a BOSS-S1 card in RAID 1 Mode. Im struggling to find the device listed as supported Hardware.
The Dell Boss-S1 Card seems to have a Marvell 88SE9230.
A Dell BOSS-2 Card would also be a option in a higher model like a Dell R650.

The newer PERC H345/H355/H745/H755 Raid Controller are not listed and other People seem to have some trouble to get them running. So to find some new supported Dell Hardware seems to get very tricky.

saznik · May 23, 2024

After some research i figured out.

PERC H745 is based on Broadcom (LSI) SAS3516 Chipset.
PERC H755 is based on Broadcom (LSI) SAS3916 Chipset.

So both Controller should be supported via the (mpr) Driver since FreeBSD 13.3 or newer. I only wonder why the Hardware Section does not explicit list that type of controller like the old one (PERC H730)?

This guy seemed to get running the system succesful on a Dell R450 with PERC H745.

Performance issues with PERC 730 RAID controller after upgrading to FreeBSD 13.1

We have a Dell Poweredge R530 with a PERC 730P Mini RAID Controller (RAID-5 with three disks, UFS file system). Firmware is up to date. After upgrading from FreeBSD 12.3 to 13.1-p2 the system sometimes seems to hang for a while, load is going up, and top is showing an almost 100% system load...

forums.freebsd.org

When the PERCs are supported I'm fine and no need to use the BOSS Cards

richardtoohey2 · May 23, 2024

There’s no tools under FreeBSD to check the RAID status or logs etc.

Dell have stopped MegaCli working with the newer PERC controllers. Their new PERCCLI tool is Windows and Linux only.

You should be OK with an R450 but you’ll have to use iDRAC or RACADM to check RAID status.

I have not used BOSS so can’t comment on that part.

Is there anything specific you want to know about the R450? I got a test system last year but got distracted so didn’t do much with it but I can setup a simple RAID1 with a couple of SSDs and attach a dmesg if that’s useful?

I just had a PERC740 break on an R640 and trash the FreeBSD file system so between that and no more MegaCli support for FreeBSD I’m looking more at Supermicro and ZFS.

saznik · May 23, 2024

Thank you.
I know the MegaCLI limitation. But this is OK in our use case and we use the iDRAC.

I want to avoid buying R450 Server with unsupported RAID Controllers. Back in the old PowerEdge 2950 times, I learned my lesson. The entry RAID Controller was unsupported and I had to buy a PERC 5 when I remember correct.

When you confirm FreeBSD is running with the PERC H745 and data is written/read without Problems and the system is booting, I'm fine.

Fingers crossed, we never had failed Dell RAID Controllers. Only other stuff

.

richardtoohey2 · May 23, 2024

saznik said:
we never had failed Dell RAID Controllers

For the previous twenty years I could say the same, until two weekends ago.

Then

The storage controller Integrated RAID Controller 1 is unable to communicate to the BMC because either the storage controller or BMC is not responding to the commands either because of an internal error or the bus is in an error state.

Hard-lockup and on cold-reboot a trashed file system (bye-bye large chunks of MySQL databases).

Not exactly a controller failure (everything seems to be "working") but a lock-up of "something" that caused a lot of pain.

I'll install 14.0 on this R450 and post what's what for you to peruse.

richardtoohey2 · May 26, 2024

Installed 13.3 on my test R450. UEFI, 4 Samsung 480 SSDs (just what I had to hand), set to RAID5. I had some issues with the 10G card in here initially so just using the bge0 Broadcom embedded 1G NIC.

I've not checked or updated the BIOS or firmware, on my TODO list.

Machine shows "Dell PERC H755 Front". Booted off 13.3 USB memory stick image: F11 for Boot Manager, choose One-shot UEFI Boot Menu and USB stick.

At boot loader graphic type "3", then "set hw.mfi.mrsas_enable=1", followed by "boot".

Installed 13.3 (just took UFS defaults), reboot, remove USB, at boot loader graphic type "3", then "set hw.mfi.mrsas_enable=1", followed by "boot".

Once booted, logged-in and created a /boot/loader.conf with hw.mfi.mrsas_enable=1.

Reboot to make sure FreeBSD comes back OK, then do freebsd-update fetch freebsd-update install and reboot. Below is dmesg from that lot:

Code:

---<<BOOT>>---
Copyright (c) 1992-2021 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 13.3-RELEASE-p1 GENERIC amd64
FreeBSD clang version 17.0.6 (https://github.com/llvm/llvm-project.git llvmorg-17.0.6-0-g6009708b4367)
VT(efifb): resolution 1024x768
CPU: Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz (2800.00-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x606a6  Family=0x6  Model=0x6a  Stepping=6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0xf3bfbfff<FSGSBASE,TSCADJ,SGX,BMI1,HLE,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,PROCTRACE,AVX512CD,SHA,AVX512BW,AVX512VL>
  Structured Extended Features2=0x40417f5e<AVX512VBMI,UMIP,PKU,OSPKE,AVX512VBMI2,GFNI,VAES,VPCLMULQDQ,AVX512VNNI,AVX512BITALG,TME,AVX512VPOPCNTDQ,LA57,RDPID,SGXLC>
  Structured Extended Features3=0xbc040412<FSRM,MD_CLEAR,PCONFIG,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  IA32_ARCH_CAPS=0x6bdeb<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO,TSX_CTRL,TAA_NO>
  AMD Extended Feature Extensions ID EBX=0x200<WBNOINVD>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
real memory  = 34359738368 (32768 MB)
avail memory = 32760045568 (31242 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <DELL   PE_SC3  >
FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 8 != hw id 13
ioapic0 <Version 2.0> irqs 0-119
Launching APs: 1 15 4 6 8 14 9 5 10 11 7 12 13 2 3
random: entropy device external interface
kbd0 at kbdmux0
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
smbios0: <System Management BIOS> at iomem 0x69537000-0x6953701e
smbios0: Version: 3.3, BCD Revision: 3.3
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <DELL PE_SC3>
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x71,0x72-0x73,0x74-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 24000000 Hz quality 950
Event timer "HPET" frequency 24000000 Hz quality 350
Event timer "HPET1" frequency 24000000 Hz quality 340
Event timer "HPET2" frequency 24000000 Hz quality 340
Event timer "HPET3" frequency 24000000 Hz quality 340
Event timer "HPET4" frequency 24000000 Hz quality 340
Event timer "HPET5" frequency 24000000 Hz quality 340
Event timer "HPET6" frequency 24000000 Hz quality 340
Event timer "HPET7" frequency 24000000 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0
acpi_syscontainer0: <System Container> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pcib0: could not evaluate _ADR - AE_NOT_FOUND
pci0: <ACPI PCI bus> numa-domain 0 on pcib0
pci0: <unknown> at device 2.4 (no driver attached)
pci0: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Lewisburg AHCI SATA controller> port 0x2068-0x206f,0x2074-0x2077,0x2040-0x205f mem 0x92dfa000-0x92dfbfff,0x92e05000-0x92e050ff,0x92b80000-0x92bfffff at device 17.5 numa-domain 0 on pci0
ahci0: AHCI v1.31 with 2 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Lewisburg USB 3.0 controller> mem 0x92de0000-0x92deffff at device 20.0 numa-domain 0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
pci0: <simple comms> at device 22.4 (no driver attached)
ahci1: <Intel Lewisburg AHCI SATA controller> port 0x2060-0x2067,0x2070-0x2073,0x2020-0x203f mem 0x92df8000-0x92df9fff,0x92e04000-0x92e040ff,0x92b00000-0x92b7ffff at device 23.0 numa-domain 0 on pci0
ahci1: AHCI v1.31 with 8 6Gbps ports, Port Multiplier not supported
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ahcich4: <AHCI channel> at channel 2 on ahci1
ahcich5: <AHCI channel> at channel 3 on ahci1
ahcich6: <AHCI channel> at channel 4 on ahci1
ahcich7: <AHCI channel> at channel 5 on ahci1
ahcich8: <AHCI channel> at channel 6 on ahci1
ahcich9: <AHCI channel> at channel 7 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib1: <ACPI PCI-PCI bridge> at device 28.0 numa-domain 0 on pci0
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 28.4 numa-domain 0 on pci0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
pcib3: <PCI-PCI bridge> at device 0.0 numa-domain 0 on pci2
pci3: <PCI bus> numa-domain 0 on pcib3
vgapci0: <VGA-compatible display> mem 0x91000000-0x91ffffff,0x92808000-0x9280bfff,0x92000000-0x927fffff at device 0.0 numa-domain 0 on pci3
vgapci0: Boot video device
pcib4: <ACPI PCI-PCI bridge> at device 28.5 numa-domain 0 on pci0
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
pci0:4:0:0: no valid vpd ident found
pci0:4:0:0: failed to read VPD data.
bge0: <Broadcom BCM5720 A0, ASIC rev. 0x5720000> mem 0x92930000-0x9293ffff,0x92940000-0x9294ffff,0x92950000-0x9295ffff at device 0.0 numa-domain 0 on pci4
bge0: APE FW version: NCSI v1.5.34.0
bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus0: <MII bus> numa-domain 0 on bge0
brgphy0: <BCM5720C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Using defaults for TSO: 65518/35/2048
bge0: Ethernet address: cc:96:e5:e7:2d:1e
bge1: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem 0x92900000-0x9290ffff,0x92910000-0x9291ffff,0x92920000-0x9292ffff at device 0.1 numa-domain 0 on pci4
bge1: APE FW version: NCSI v1.5.34.0
bge1: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus1: <MII bus> numa-domain 0 on bge1
brgphy1: <BCM5720C 1000BASE-T media interface> PHY 2 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Using defaults for TSO: 65518/35/2048
bge1: Ethernet address: cc:96:e5:e7:2d:1f
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci0
isa0: <ISA bus> numa-domain 0 on isab0
pci0: <memory> at device 31.2 (no driver attached)
pci0: <serial bus> at device 31.5 (no driver attached)
pcib5: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib5: could not evaluate _ADR - AE_NOT_FOUND
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib6: could not evaluate _ADR - AE_NOT_FOUND
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
pcib7: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib7: could not evaluate _ADR - AE_NOT_FOUND
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
pcib8: <ACPI PCI-PCI bridge> mem 0x38fffff00000-0x38fffff1ffff at device 2.0 numa-domain 0 on pci7
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pci8: <network, ethernet> at device 0.0 (no driver attached)
pci8: <network, ethernet> at device 0.1 (no driver attached)
pcib9: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib9: could not evaluate _ADR - AE_NOT_FOUND
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
pcib10: <ACPI PCI-PCI bridge> mem 0x393ffff00000-0x393ffff1ffff at device 4.0 numa-domain 0 on pci9
pci10: <ACPI PCI bus> numa-domain 0 on pcib10
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 07.709.04.00-fbsd
mrsas0: <BROADCOM AERO-10E2 SAS Controller> port 0xe000-0xe0ff mem 0xe6800000-0xe68fffff,0xe6900000-0xe69fffff,0xe6a00000-0xe6afffff at device 0.0 numa-domain 0 on pci10
mrsas0: FW now in Ready state
mrsas0: Using MSI-X with 16 number of vectors
mrsas0: FW supports <128> MSIX vector,Online CPU 16 Current MSIX <16>
mrsas0: mrsas_init_adapter: sc->reply_q_depth 0x27e0,sc->request_alloc_sz 0x9f60, sc->reply_alloc_sz 0x13f00,sc->io_frames_alloc_sz 0x13ee00
mrsas0: max sge: 0x106, max chain frame size: 0x1000, max fw cmd: 0x13ec sc->chain_frames_alloc_sz: 0x13ec000
mrsas0: Issuing IOC INIT command to FW.
mrsas0: IOC INIT response received from FW.
mrsas0: FW supports atomic descriptor: Yes
mrsas0: NVME page size    : (4096)
mrsas0: FW supports JBOD Map
mrsas0: FW supports JBOD Map Ext
mrsas0: Jbod map is supported
mrsas0: VD created target ID: 0xef
mrsas0: FW supports: UnevenSpanSupport=1

mrsas0: max_fw_cmds: 5100  max_scsi_cmds: 5084
mrsas0: MSI-x interrupts setup success
mrsas0: mrsas_ocr_thread
pcib11: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib11: could not evaluate _ADR - AE_NOT_FOUND
pci11: <ACPI PCI bus> numa-domain 0 on pcib11
pci11: <dasp, performance counters> at device 12.0 (no driver attached)
pci11: <dasp, performance counters> at device 13.0 (no driver attached)
pci11: <dasp, performance counters> at device 14.0 (no driver attached)
pci11: <dasp, performance counters> at device 15.0 (no driver attached)
pci11: <dasp, performance counters> at device 26.0 (no driver attached)
pci11: <dasp, performance counters> at device 27.0 (no driver attached)
pci11: <dasp, performance counters> at device 28.0 (no driver attached)
pci11: <dasp, performance counters> at device 29.0 (no driver attached)
pcib12: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pcib12: could not evaluate _ADR - AE_NOT_FOUND
pci12: <ACPI PCI bus> numa-domain 0 on pcib12
apei0: <ACPI Platform Error Interface> on acpi0
cpu0: <ACPI CPU> numa-domain 0 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROM> at iomem 0xed800-0xf17ff pnpid ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900 on isa0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est0 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est1 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est2 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est3 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est4 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est5 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est6 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est7 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est8 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est9 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est10 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est11 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est12 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est13 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est14 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est15 attach returned 6
Timecounter "TSC-low" frequency 1396718059 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <Intel XHCI root HUB> at usbus0
mrsas0: Disestablish mrsas intr hook
da0 at mrsas0 bus 0 scbus12 target 239 lun 0
da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
da0: 150.000MB/s transfers
da0: 1372032MB (2809921536 512 byte sectors)
ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
Trying to mount root from ufs:/dev/da0p2 [rw]...
uhub0 numa-domain 0 on usbus0
uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
pchtherm0: <Lewisburg Thermal Subsystem> mem 0x92e02000-0x92e02fff at device 20.2 numa-domain 0 on pci0
ichsmb0: <Intel Lewisburg SMBus controller> port 0x2000-0x201f mem 0x92dfe000-0x92dfe0ff at device 31.4 numa-domain 0 on pci0
smbus0: <System Management Bus> numa-domain 0 on ichsmb0
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: cannot find EC device
acpi_wmi0: Embedded MOF found
ACPI: \134_SB.AMW0.WQMO: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361)
acpi_wmi1: <ACPI-WMI mapping> on acpi0
acpi_wmi1: cannot find EC device
lo0: link state changed to UP
bge0: link state changed to DOWN
uhub0: 26 ports with 26 removable, self powered
ugen0.2: <Keychron K8 Keychron K8> at usbus0
ukbd0 numa-domain 0 on uhub0
ukbd0: <Keychron K8 Keychron K8, class 0/0, rev 2.00/1.07, addr 1> on usbus0
kbd1 at ukbd0
ugen0.3: <vendor 0x1604 product 0x10c0> at usbus0
uhub1 numa-domain 0 on uhub0
uhub1: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 2> on usbus0
bge0: link state changed to UP
uhub1: 4 ports with 4 removable, self powered
ugen0.4: <vendor 0x1604 product 0x10c0> at usbus0
uhub2 numa-domain 0 on uhub1
uhub2: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 3> on usbus0
uhub2: 4 ports with 4 removable, self powered
ugen0.5: <vendor 0x1604 product 0x10c0> at usbus0
uhub3 numa-domain 0 on uhub1
uhub3: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 4> on usbus0
uhub3: 4 ports with 4 removable, self powered
ums0 numa-domain 0 on uhub0
ums0: <Keychron K8 Keychron K8, class 0/0, rev 2.00/1.07, addr 1> on usbus0
ums0: 3 buttons and [XYZ] coordinates ID=6
Security policy loaded: MAC/ntpd (mac_ntpd)

I'll update to FreeBSD 14.0 and post the dmesg from that, then can build MySQL 8 or something to give it a bit of work to do.

richardtoohey2 · May 26, 2024

Code:

freebsd-update -r 14.0-RELEASE upgrade
/usr/sbin/freebsd-update install
shutdown -r now
/usr/sbin/freebsd-update install
# says about ports but haven't installed anything
/usr/sbin/freebsd-update install
# just after all updates
shutdown -r now

dmesg from 14.0-RELEASE:

Code:

---<<BOOT>>---
Copyright (c) 1992-2023 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
    The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 14.0-RELEASE-p6 #0: Tue Mar 26 20:26:20 UTC 2024
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
VT(efifb): resolution 1024x768
CPU: Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz (2800.00-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x606a6  Family=0x6  Model=0x6a  Stepping=6
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7ffefbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,DCA,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0xf3bfbfff<FSGSBASE,TSCADJ,SGX,BMI1,HLE,AVX2,FDPEXC,SMEP,BMI2,ERMS,INVPCID,RTM,PQM,NFPUSG,PQE,AVX512F,AVX512DQ,RDSEED,ADX,SMAP,AVX512IFMA,CLFLUSHOPT,CLWB,PROCTRACE,AVX512CD,SHA,AVX512BW,AVX512VL>
  Structured Extended Features2=0x40417f5e<AVX512VBMI,UMIP,PKU,OSPKE,AVX512VBMI2,GFNI,VAES,VPCLMULQDQ,AVX512VNNI,AVX512BITALG,TME,AVX512VPOPCNTDQ,LA57,RDPID,SGXLC>
  Structured Extended Features3=0xbc040412<FSRM,MD_CLEAR,PCONFIG,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  IA32_ARCH_CAPS=0x6bdeb<RDCL_NO,IBRS_ALL,SKIP_L1DFL_VME,MDS_NO,TSX_CTRL,TAA_NO>
  AMD Extended Feature Extensions ID EBX=0x200<WBNOINVD>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
  TSC: P-state invariant, performance statistics
real memory  = 34359738368 (32768 MB)
avail memory = 32763502592 (31245 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <DELL   PE_SC3  >
FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
FreeBSD/SMP: 1 package(s) x 8 core(s) x 2 hardware threads
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
random: unblocking device.
ioapic0: MADT APIC ID 8 != hw id 13
ioapic0 <Version 2.0> irqs 0-119
Launching APs: 1 12 14 8 7 10 13 6 9 2 4 15 11 5 3
random: entropy device external interface
kbd0 at kbdmux0
efirtc0: <EFI Realtime Clock>
efirtc0: registered as a time-of-day clock, resolution 1.000000s
smbios0: <System Management BIOS> at iomem 0x69537000-0x6953701e
smbios0: Version: 3.3, BCD Revision: 3.3
aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS,SHA1,SHA256>
acpi0: <DELL PE_SC3>
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x71,0x72-0x73,0x74-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 24000000 Hz quality 950
Event timer "HPET" frequency 24000000 Hz quality 350
Event timer "HPET1" frequency 24000000 Hz quality 340
Event timer "HPET2" frequency 24000000 Hz quality 340
Event timer "HPET3" frequency 24000000 Hz quality 340
Event timer "HPET4" frequency 24000000 Hz quality 340
Event timer "HPET5" frequency 24000000 Hz quality 340
Event timer "HPET6" frequency 24000000 Hz quality 340
Event timer "HPET7" frequency 24000000 Hz quality 340
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0
acpi_syscontainer0: <System Container> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
pci0: <ACPI PCI bus> numa-domain 0 on pcib0
pci0: <unknown> at device 17.0 (no driver attached)
ahci0: <Intel Lewisburg AHCI SATA controller> port 0x2068-0x206f,0x2074-0x2077,0x2040-0x205f mem 0x92dfa000-0x92dfbfff,0x92e05000-0x92e050ff,0x92b80000-0x92bfffff at device 17.5 numa-domain 0 on pci0
ahci0: AHCI v1.31 with 2 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
xhci0: <Intel Lewisburg USB 3.0 controller> mem 0x92de0000-0x92deffff at device 20.0 numa-domain 0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
usbus0 numa-domain 0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
pci0: <simple comms> at device 22.0 (no driver attached)
pci0: <simple comms> at device 22.1 (no driver attached)
pci0: <simple comms> at device 22.4 (no driver attached)
ahci1: <Intel Lewisburg AHCI SATA controller> port 0x2060-0x2067,0x2070-0x2073,0x2020-0x203f mem 0x92df8000-0x92df9fff,0x92e04000-0x92e040ff,0x92b00000-0x92b7ffff at device 23.0 numa-domain 0 on pci0
ahci1: AHCI v1.31 with 8 6Gbps ports, Port Multiplier not supported
ahcich2: <AHCI channel> at channel 0 on ahci1
ahcich3: <AHCI channel> at channel 1 on ahci1
ahcich4: <AHCI channel> at channel 2 on ahci1
ahcich5: <AHCI channel> at channel 3 on ahci1
ahcich6: <AHCI channel> at channel 4 on ahci1
ahcich7: <AHCI channel> at channel 5 on ahci1
ahcich8: <AHCI channel> at channel 6 on ahci1
ahcich9: <AHCI channel> at channel 7 on ahci1
ahciem1: <AHCI enclosure management bridge> on ahci1
pcib1: <ACPI PCI-PCI bridge> at device 28.0 numa-domain 0 on pci0
pci1: <ACPI PCI bus> numa-domain 0 on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 28.4 numa-domain 0 on pci0
pci2: <ACPI PCI bus> numa-domain 0 on pcib2
pcib3: <PCI-PCI bridge> at device 0.0 numa-domain 0 on pci2
pci3: <PCI bus> numa-domain 0 on pcib3
vgapci0: <VGA-compatible display> mem 0x91000000-0x91ffffff,0x92808000-0x9280bfff,0x92000000-0x927fffff at device 0.0 numa-domain 0 on pci3
vgapci0: Boot video device
pcib4: <ACPI PCI-PCI bridge> at device 28.5 numa-domain 0 on pci0
pci4: <ACPI PCI bus> numa-domain 0 on pcib4
bge0: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem 0x92930000-0x9293ffff,0x92940000-0x9294ffff,0x92950000-0x9295ffff at device 0.0 numa-domain 0 on pci4
bge0: APE FW version: NCSI v1.5.34.0
bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus0: <MII bus> numa-domain 0 on bge0
brgphy0: <BCM5720C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Using defaults for TSO: 65518/35/2048
bge0: Ethernet address: cc:96:e5:e7:2d:1e
bge1: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem 0x92900000-0x9290ffff,0x92910000-0x9291ffff,0x92920000-0x9292ffff at device 0.1 numa-domain 0 on pci4
bge1: APE FW version: NCSI v1.5.34.0
bge1: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus1: <MII bus> numa-domain 0 on bge1
brgphy1: <BCM5720C 1000BASE-T media interface> PHY 2 on miibus1
brgphy1:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Using defaults for TSO: 65518/35/2048
bge1: Ethernet address: cc:96:e5:e7:2d:1f
isab0: <PCI-ISA bridge> at device 31.0 numa-domain 0 on pci0
isa0: <ISA bus> numa-domain 0 on isab0
pci0: <memory> at device 31.2 (no driver attached)
pci0: <serial bus> at device 31.5 (no driver attached)
pcib5: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci5: <ACPI PCI bus> numa-domain 0 on pcib5
pcib6: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci6: <ACPI PCI bus> numa-domain 0 on pcib6
pcib7: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci7: <ACPI PCI bus> numa-domain 0 on pcib7
pcib8: <ACPI PCI-PCI bridge> mem 0x38fffff00000-0x38fffff1ffff at device 2.0 numa-domain 0 on pci7
pci8: <ACPI PCI bus> numa-domain 0 on pcib8
pci8: <network, ethernet> at device 0.0 (no driver attached)
pci8: <network, ethernet> at device 0.1 (no driver attached)
pcib9: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci9: <ACPI PCI bus> numa-domain 0 on pcib9
pcib10: <ACPI PCI-PCI bridge> mem 0x393ffff00000-0x393ffff1ffff at device 4.0 numa-domain 0 on pci9
pci10: <ACPI PCI bus> numa-domain 0 on pcib10
AVAGO MegaRAID SAS FreeBSD mrsas driver version: 07.709.04.00-fbsd
mrsas0: <BROADCOM AERO-10E2 SAS Controller> port 0xe000-0xe0ff mem 0xe6800000-0xe68fffff,0xe6900000-0xe69fffff,0xe6a00000-0xe6afffff at device 0.0 numa-domain 0 on pci10
mrsas0: FW now in Ready state
mrsas0: Using MSI-X with 16 number of vectors
mrsas0: FW supports <128> MSIX vector,Online CPU 16 Current MSIX <16>
mrsas0: mrsas_init_adapter: sc->reply_q_depth 0x27e0,sc->request_alloc_sz 0x9f60, sc->reply_alloc_sz 0x13f00,sc->io_frames_alloc_sz 0x13ee00
mrsas0: max sge: 0x106, max chain frame size: 0x1000, max fw cmd: 0x13ec sc->chain_frames_alloc_sz: 0x13ec000
mrsas0: Issuing IOC INIT command to FW.
mrsas0: IOC INIT response received from FW.
mrsas0: FW supports atomic descriptor: Yes
mrsas0: NVME page size    : (4096)
mrsas0: FW supports JBOD Map 
mrsas0: FW supports JBOD Map Ext 
mrsas0: Jbod map is supported
mrsas0: VD created target ID: 0xef
mrsas0: FW supports: UnevenSpanSupport=1

mrsas0: max_fw_cmds: 5100  max_scsi_cmds: 5084
mrsas0: MSI-x interrupts setup success
mrsas0: mrsas_ocr_thread
pcib11: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci11: <ACPI PCI bus> numa-domain 0 on pcib11
pci11: <dasp, performance counters> at device 12.0 (no driver attached)
pci11: <dasp, performance counters> at device 13.0 (no driver attached)
pci11: <dasp, performance counters> at device 14.0 (no driver attached)
pci11: <dasp, performance counters> at device 15.0 (no driver attached)
pci11: <dasp, performance counters> at device 26.0 (no driver attached)
pci11: <dasp, performance counters> at device 27.0 (no driver attached)
pci11: <dasp, performance counters> at device 28.0 (no driver attached)
pci11: <dasp, performance counters> at device 29.0 (no driver attached)
pcib12: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
pci12: <ACPI PCI bus> numa-domain 0 on pcib12
apei0: <ACPI Platform Error Interface> on acpi0
cpu0: <ACPI CPU> numa-domain 0 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
orm0: <ISA Option ROM> at iomem 0xed800-0xf17ff pnpid ORM0000 on isa0
vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900 on isa0
est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est0 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est1 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est2 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est3 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est4 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est5 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est6 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est7 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est8 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est9 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est10 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est11 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est12 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est13 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est14 attach returned 6
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 219900002200
device_attach: est15 attach returned 6
Timecounter "TSC-low" frequency 1396718453 Hz quality 1000
Timecounters tick every 1.000 msec
ugen0.1: <Intel XHCI root HUB> at usbus0
mrsas0: Disestablish mrsas intr hook
ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
cam_periph_alloc: attempt to re-allocate valid device pass2 rejected flags 0 refcount 3
passasync: Unable to attach new device due to status 0x6: CCB request was invalid
cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0 refcount 2
daasync: Unable to attach to new device due to status 0x6
da0 at mrsas0 bus 0 scbus12 target 239 lun 0
da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
da0: 150.000MB/s transfers
da0: 1372032MB (2809921536 512 byte sectors)
Trying to mount root from ufs:/dev/da0p2 [rw]...
uhub0 numa-domain 0 on usbus0
uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
pchtherm0: <Lewisburg Thermal Subsystem> mem 0x92e02000-0x92e02fff at device 20.2 numa-domain 0 on pci0
ichsmb0: <Intel Lewisburg SMBus controller> port 0x2000-0x201f mem 0x92dfe000-0x92dfe0ff at device 31.4 numa-domain 0 on pci0
smbus0: <System Management Bus> numa-domain 0 on ichsmb0
bnxt0: <Broadcom BCM57416 NetXtreme-E 10GBase-T Ethernet> mem 0xd1210000-0xd121ffff,0xd1100000-0xd11fffff,0xd1222000-0xd1223fff at device 0.0 numa-domain 0 on pci8
bnxt0: Using 256 TX descriptors and 256 RX descriptors
bnxt0: Using 8 RX queues 8 TX queues
bnxt0: Using MSI-X interrupts with 9 vectors
bnxt0: Ethernet address: 00:62:0b:53:68:50
bnxt0: netmap queues/slots: TX 8/256, RX 8/256
bnxt1: <Broadcom BCM57416 NetXtreme-E 10GBase-T Ethernet> mem 0xd1200000-0xd120ffff,0xd1000000-0xd10fffff,0xd1220000-0xd1221fff at device 0.1 numa-domain 0 on pci8
bnxt1: Using 256 TX descriptors and 256 RX descriptors
bnxt1: Using 8 RX queues 8 TX queues
bnxt1: Using MSI-X interrupts with 9 vectors
bnxt1: Ethernet address: 00:62:0b:53:68:51
bnxt1: netmap queues/slots: TX 8/256, RX 8/256
acpi_wmi0: <ACPI-WMI mapping> on acpi0
acpi_wmi0: cannot find EC device
acpi_wmi0: Embedded MOF found
ACPI: \134_SB.AMW0.WQMO: 1 arguments were passed to a non-method ACPI object (Buffer) (20221020/nsarguments-361)
acpi_wmi1: <ACPI-WMI mapping> on acpi0
acpi_wmi1: cannot find EC device
lo0: link state changed to UP
bge0: link state changed to DOWN
uhub0: 26 ports with 26 removable, self powered
ugen0.2: <Keychron K8 Keychron K8> at usbus0
ukbd0 numa-domain 0 on uhub0
ukbd0: <Keychron K8 Keychron K8, class 0/0, rev 2.00/1.07, addr 1> on usbus0
kbd1 at ukbd0
ugen0.3: <vendor 0x1604 product 0x10c0> at usbus0
uhub1 numa-domain 0 on uhub0
uhub1: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 2> on usbus0
bge0: link state changed to UP
uhub1: 4 ports with 4 removable, self powered
ugen0.4: <vendor 0x1604 product 0x10c0> at usbus0
uhub2 numa-domain 0 on uhub1
uhub2: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 3> on usbus0
uhub2: 4 ports with 4 removable, self powered
ugen0.5: <vendor 0x1604 product 0x10c0> at usbus0
uhub3 numa-domain 0 on uhub1
uhub3: <vendor 0x1604 product 0x10c0, class 9/0, rev 2.00/0.00, addr 4> on usbus0
uhub3: 4 ports with 4 removable, self powered
ums0 numa-domain 0 on uhub0
ums0: <Keychron K8 Keychron K8, class 0/0, rev 2.00/1.07, addr 1> on usbus0
ums0: 3 buttons and [XYZ] coordinates ID=6
Security policy loaded: MAC/ntpd (mac_ntpd)

richardtoohey2 · May 26, 2024

Difference between 13.3 dmesg and 14.0 dmesg:

Code:

diff -uw r450_dmesg_133 r450_dmesg_140 
--- r450_dmesg_133    2024-05-26 11:58:59.000000000 +1200
+++ r450_dmesg_140    2024-05-26 11:59:30.000000000 +1200
@@ -1,10 +1,11 @@
 ---<<BOOT>>---
-Copyright (c) 1992-2021 The FreeBSD Project.
+Copyright (c) 1992-2023 The FreeBSD Project.
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
     The Regents of the University of California. All rights reserved.
 FreeBSD is a registered trademark of The FreeBSD Foundation.
-FreeBSD 13.3-RELEASE-p1 GENERIC amd64
-FreeBSD clang version 17.0.6 (https://github.com/llvm/llvm-project.git llvmorg-17.0.6-0-g6009708b4367)
+FreeBSD 14.0-RELEASE-p6 #0: Tue Mar 26 20:26:20 UTC 2024
+    root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
+FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
 VT(efifb): resolution 1024x768
 CPU: Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz (2800.00-MHz K8-class CPU)
   Origin="GenuineIntel"  Id=0x606a6  Family=0x6  Model=0x6a  Stepping=6
@@ -21,7 +22,7 @@
   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
   TSC: P-state invariant, performance statistics
 real memory  = 34359738368 (32768 MB)
-avail memory = 32760045568 (31242 MB)
+avail memory = 32763502592 (31245 MB)
 Event timer "LAPIC" quality 600
 ACPI APIC Table: <DELL   PE_SC3  >
 FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
@@ -31,7 +32,7 @@
 random: unblocking device.
 ioapic0: MADT APIC ID 8 != hw id 13
 ioapic0 <Version 2.0> irqs 0-119
-Launching APs: 1 15 4 6 8 14 9 5 10 11 7 12 13 2 3
+Launching APs: 1 12 14 8 7 10 13 6 9 2 4 15 11 5 3
 random: entropy device external interface
 kbd0 at kbdmux0
 efirtc0: <EFI Realtime Clock>
@@ -61,9 +62,7 @@
 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x508-0x50b on acpi0
 acpi_syscontainer0: <System Container> on acpi0
 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff numa-domain 0 on acpi0
-pcib0: could not evaluate _ADR - AE_NOT_FOUND
 pci0: <ACPI PCI bus> numa-domain 0 on pcib0
-pci0: <unknown> at device 2.4 (no driver attached)
 pci0: <unknown> at device 17.0 (no driver attached)
 ahci0: <Intel Lewisburg AHCI SATA controller> port 0x2068-0x206f,0x2074-0x2077,0x2040-0x205f mem 0x92dfa000-0x92dfbfff,0x92e05000-0x92e050ff,0x92b80000-0x92bfffff at device 17.5 numa-domain 0 on pci0
 ahci0: AHCI v1.31 with 2 6Gbps ports, Port Multiplier not supported
@@ -98,9 +97,7 @@
 vgapci0: Boot video device
 pcib4: <ACPI PCI-PCI bridge> at device 28.5 numa-domain 0 on pci0
 pci4: <ACPI PCI bus> numa-domain 0 on pcib4
-pci0:4:0:0: no valid vpd ident found
-pci0:4:0:0: failed to read VPD data.
-bge0: <Broadcom BCM5720 A0, ASIC rev. 0x5720000> mem 0x92930000-0x9293ffff,0x92940000-0x9294ffff,0x92950000-0x9295ffff at device 0.0 numa-domain 0 on pci4
+bge0: <Broadcom NetXtreme Gigabit Ethernet, ASIC rev. 0x5720000> mem 0x92930000-0x9293ffff,0x92940000-0x9294ffff,0x92950000-0x9295ffff at device 0.0 numa-domain 0 on pci4
 bge0: APE FW version: NCSI v1.5.34.0
 bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
 miibus0: <MII bus> numa-domain 0 on bge0
@@ -121,20 +118,16 @@
 pci0: <memory> at device 31.2 (no driver attached)
 pci0: <serial bus> at device 31.5 (no driver attached)
 pcib5: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib5: could not evaluate _ADR - AE_NOT_FOUND
 pci5: <ACPI PCI bus> numa-domain 0 on pcib5
 pcib6: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib6: could not evaluate _ADR - AE_NOT_FOUND
 pci6: <ACPI PCI bus> numa-domain 0 on pcib6
 pcib7: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib7: could not evaluate _ADR - AE_NOT_FOUND
 pci7: <ACPI PCI bus> numa-domain 0 on pcib7
 pcib8: <ACPI PCI-PCI bridge> mem 0x38fffff00000-0x38fffff1ffff at device 2.0 numa-domain 0 on pci7
 pci8: <ACPI PCI bus> numa-domain 0 on pcib8
 pci8: <network, ethernet> at device 0.0 (no driver attached)
 pci8: <network, ethernet> at device 0.1 (no driver attached)
 pcib9: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib9: could not evaluate _ADR - AE_NOT_FOUND
 pci9: <ACPI PCI bus> numa-domain 0 on pcib9
 pcib10: <ACPI PCI-PCI bridge> mem 0x393ffff00000-0x393ffff1ffff at device 4.0 numa-domain 0 on pci9
 pci10: <ACPI PCI bus> numa-domain 0 on pcib10
@@ -159,7 +152,6 @@
 mrsas0: MSI-x interrupts setup success
 mrsas0: mrsas_ocr_thread
 pcib11: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib11: could not evaluate _ADR - AE_NOT_FOUND
 pci11: <ACPI PCI bus> numa-domain 0 on pcib11
 pci11: <dasp, performance counters> at device 12.0 (no driver attached)
 pci11: <dasp, performance counters> at device 13.0 (no driver attached)
@@ -170,7 +162,6 @@
 pci11: <dasp, performance counters> at device 28.0 (no driver attached)
 pci11: <dasp, performance counters> at device 29.0 (no driver attached)
 pcib12: <ACPI Host-PCI bridge> numa-domain 0 on acpi0
-pcib12: could not evaluate _ADR - AE_NOT_FOUND
 pci12: <ACPI PCI bus> numa-domain 0 on pcib12
 apei0: <ACPI Platform Error Interface> on acpi0
 cpu0: <ACPI CPU> numa-domain 0 on acpi0
@@ -227,31 +218,47 @@
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est15 attach returned 6
-Timecounter "TSC-low" frequency 1396718059 Hz quality 1000
+Timecounter "TSC-low" frequency 1396718453 Hz quality 1000
 Timecounters tick every 1.000 msec
 ugen0.1: <Intel XHCI root HUB> at usbus0
 mrsas0: Disestablish mrsas intr hook
-da0 at mrsas0 bus 0 scbus12 target 239 lun 0
-da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
-da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
-da0: 150.000MB/s transfers
-da0: 1372032MB (2809921536 512 byte sectors)
 ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
 ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses0: SEMB SES Device
 ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
 ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses1: SEMB SES Device
+cam_periph_alloc: attempt to re-allocate valid device pass2 rejected flags 0 refcount 3
+passasync: Unable to attach new device due to status 0x6: CCB request was invalid
+cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0 refcount 2
+daasync: Unable to attach to new device due to status 0x6
+da0 at mrsas0 bus 0 scbus12 target 239 lun 0
+da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
+da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
+da0: 150.000MB/s transfers
+da0: 1372032MB (2809921536 512 byte sectors)
 Trying to mount root from ufs:/dev/da0p2 [rw]...
 uhub0 numa-domain 0 on usbus0
 uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
 pchtherm0: <Lewisburg Thermal Subsystem> mem 0x92e02000-0x92e02fff at device 20.2 numa-domain 0 on pci0
 ichsmb0: <Intel Lewisburg SMBus controller> port 0x2000-0x201f mem 0x92dfe000-0x92dfe0ff at device 31.4 numa-domain 0 on pci0
 smbus0: <System Management Bus> numa-domain 0 on ichsmb0
+bnxt0: <Broadcom BCM57416 NetXtreme-E 10GBase-T Ethernet> mem 0xd1210000-0xd121ffff,0xd1100000-0xd11fffff,0xd1222000-0xd1223fff at device 0.0 numa-domain 0 on pci8
+bnxt0: Using 256 TX descriptors and 256 RX descriptors
+bnxt0: Using 8 RX queues 8 TX queues
+bnxt0: Using MSI-X interrupts with 9 vectors
+bnxt0: Ethernet address: 00:62:0b:53:68:50
+bnxt0: netmap queues/slots: TX 8/256, RX 8/256
+bnxt1: <Broadcom BCM57416 NetXtreme-E 10GBase-T Ethernet> mem 0xd1200000-0xd120ffff,0xd1000000-0xd10fffff,0xd1220000-0xd1221fff at device 0.1 numa-domain 0 on pci8
+bnxt1: Using 256 TX descriptors and 256 RX descriptors
+bnxt1: Using 8 RX queues 8 TX queues
+bnxt1: Using MSI-X interrupts with 9 vectors
+bnxt1: Ethernet address: 00:62:0b:53:68:51
+bnxt1: netmap queues/slots: TX 8/256, RX 8/256
 acpi_wmi0: <ACPI-WMI mapping> on acpi0
 acpi_wmi0: cannot find EC device
 acpi_wmi0: Embedded MOF found
-ACPI: \134_SB.AMW0.WQMO: 1 arguments were passed to a non-method ACPI object (Buffer) (20201113/nsarguments-361)
+ACPI: \134_SB.AMW0.WQMO: 1 arguments were passed to a non-method ACPI object (Buffer) (20221020/nsarguments-361)
 acpi_wmi1: <ACPI-WMI mapping> on acpi0
 acpi_wmi1: cannot find EC device
 lo0: link state changed to UP

Not sure what this chunk means? Looks a bit concerning, but I'm going ahead and building MySQL 8 just to give the machine a little bit of a workout.

cam_periph_alloc: attempt to re-allocate valid device pass2 rejected flags 0 refcount 3
passasync: Unable to attach new device due to status 0x6: CCB request was invalid
cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0 refcount 2
daasync: Unable to attach to new device due to status 0x6

(And looks like the Broadcom 10G issue might be fixed/improved based on those bnxt0/1 lines)

richardtoohey2 · May 26, 2024

Code:

# just to give the disks something to do ...
pkg install gitup
gitup ports
cd cd /usr/ports/databases/mysql80-server
make install

Reboot after that, dmesg shows the cam messages gone:

Code:

diff -uw r450_dmesg_140 r450_dmesg_140_mysql 
--- r450_dmesg_140    2024-05-26 11:59:30.000000000 +1200
+++ r450_dmesg_140_mysql    2024-05-26 12:33:37.000000000 +1200
@@ -32,7 +32,7 @@
 random: unblocking device.
 ioapic0: MADT APIC ID 8 != hw id 13
 ioapic0 <Version 2.0> irqs 0-119
-Launching APs: 1 12 14 8 7 10 13 6 9 2 4 15 11 5 3
+Launching APs: 1 4 8 9 5 10 14 2 15 12 7 13 3 11 6
 random: entropy device external interface
 kbd0 at kbdmux0
 efirtc0: <EFI Realtime Clock>
@@ -171,10 +171,10 @@
 vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900 on isa0
 est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est0 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est1 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
@@ -183,60 +183,56 @@
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est3 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est4 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est5 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est6 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est7 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est8 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est9 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est10 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est11 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est12 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est13 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est14 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 219900002200
+est: cpu_vendor GenuineIntel, msr 21ae00002200
 device_attach: est15 attach returned 6
-Timecounter "TSC-low" frequency 1396718453 Hz quality 1000
+Timecounter "TSC-low" frequency 1396719434 Hz quality 1000
 Timecounters tick every 1.000 msec
 ugen0.1: <Intel XHCI root HUB> at usbus0
 mrsas0: Disestablish mrsas intr hook
+da0 at mrsas0 bus 0 scbus12 target 239 lun 0
+da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
+da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
+da0: 150.000MB/s transfers
+da0: 1372032MB (2809921536 512 byte sectors)
 ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
 ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses0: SEMB SES Device
 ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
 ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses1: SEMB SES Device
-cam_periph_alloc: attempt to re-allocate valid device pass2 rejected flags 0 refcount 3
-passasync: Unable to attach new device due to status 0x6: CCB request was invalid
-cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0 refcount 2
-daasync: Unable to attach to new device due to status 0x6
-da0 at mrsas0 bus 0 scbus12 target 239 lun 0
-da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
-da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
-da0: 150.000MB/s transfers
-da0: 1372032MB (2809921536 512 byte sectors)
 Trying to mount root from ufs:/dev/da0p2 [rw]...
 uhub0 numa-domain 0 on usbus0
 uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0

richardtoohey2 · May 26, 2024

Last test, 14.1-BETA3:

Code:

freebsd-update -r 14.1-BETA3 upgrade
/usr/sbin/freebsd-update install
shutdown -r now
/usr/sbin/freebsd-update install
shutdown -r now

Difference between last 14.0 dmesg and 14.1 BETA3:

Code:

diff -uw r450_dmesg_140_mysql r450_dmesg_141b3
--- r450_dmesg_140_mysql    2024-05-26 12:33:37.000000000 +1200
+++ r450_dmesg_141b3    2024-05-26 12:47:18.000000000 +1200
@@ -3,9 +3,8 @@
 Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
     The Regents of the University of California. All rights reserved.
 FreeBSD is a registered trademark of The FreeBSD Foundation.
-FreeBSD 14.0-RELEASE-p6 #0: Tue Mar 26 20:26:20 UTC 2024
-    root@amd64-builder.daemonology.net:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64
-FreeBSD clang version 16.0.6 (https://github.com/llvm/llvm-project.git llvmorg-16.0.6-0-g7cbf1a259152)
+FreeBSD 14.1-BETA3 releng/14.1-n267636-2a964a7fc34e GENERIC amd64
+FreeBSD clang version 18.1.5 (https://github.com/llvm/llvm-project.git llvmorg-18.1.5-0-g617a15a9eac9)
 VT(efifb): resolution 1024x768
 CPU: Intel(R) Xeon(R) Silver 4309Y CPU @ 2.80GHz (2800.00-MHz K8-class CPU)
   Origin="GenuineIntel"  Id=0x606a6  Family=0x6  Model=0x6a  Stepping=6
@@ -22,7 +21,7 @@
   VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
   TSC: P-state invariant, performance statistics
 real memory  = 34359738368 (32768 MB)
-avail memory = 32763502592 (31245 MB)
+avail memory = 32761753600 (31244 MB)
 Event timer "LAPIC" quality 600
 ACPI APIC Table: <DELL   PE_SC3  >
 FreeBSD/SMP: Multiprocessor System Detected: 16 CPUs
@@ -32,7 +31,7 @@
 random: unblocking device.
 ioapic0: MADT APIC ID 8 != hw id 13
 ioapic0 <Version 2.0> irqs 0-119
-Launching APs: 1 4 8 9 5 10 14 2 15 12 7 13 3 11 6
+Launching APs: 1 9 2 10 5 4 14 15 13 12 11 3 8 6 7
 random: entropy device external interface
 kbd0 at kbdmux0
 efirtc0: <EFI Realtime Clock>
@@ -171,10 +170,10 @@
 vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff pnpid PNP0900 on isa0
 est0: <Enhanced SpeedStep Frequency Control> numa-domain 0 on cpu0
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est0 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est1 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
@@ -183,59 +182,63 @@
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est3 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est4 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est5 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est6 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est7 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est8 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est9 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est10 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est11 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est12 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
 est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est13 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est14 attach returned 6
 est: CPU supports Enhanced Speedstep, but is not recognized.
-est: cpu_vendor GenuineIntel, msr 21ae00002200
+est: cpu_vendor GenuineIntel, msr 219900002200
 device_attach: est15 attach returned 6
-Timecounter "TSC-low" frequency 1396719434 Hz quality 1000
+Timecounter "TSC-low" frequency 1396718338 Hz quality 1000
 Timecounters tick every 1.000 msec
 ugen0.1: <Intel XHCI root HUB> at usbus0
+uhub0 numa-domain 0 on usbus0
+uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
 mrsas0: Disestablish mrsas intr hook
-da0 at mrsas0 bus 0 scbus12 target 239 lun 0
-da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
-da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
-da0: 150.000MB/s transfers
-da0: 1372032MB (2809921536 512 byte sectors)
 ses0 at ahciem0 bus 0 scbus2 target 0 lun 0
 ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses0: SEMB SES Device
 ses1 at ahciem1 bus 0 scbus11 target 0 lun 0
 ses1: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
 ses1: SEMB SES Device
+cam_periph_alloc: attempt to re-allocate valid device pass2 rejected flags 0 refcount 3
+passasync: Unable to attach new device due to status 0x6: CCB request was invalid
+cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0 refcount 2
+daasync: Unable to attach to new device due to status 0x6
+da0 at mrsas0 bus 0 scbus12 target 239 lun 0
+da0: <DELL PERC H755 Front 5.16> Fixed Direct Access SPC-3 SCSI device
+da0: Serial Number 003567dd454a9ee52d00d1a04580e04e
+da0: 150.000MB/s transfers
+da0: 1372032MB (2809921536 512 byte sectors)
 Trying to mount root from ufs:/dev/da0p2 [rw]...
-uhub0 numa-domain 0 on usbus0
-uhub0: <Intel XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
 pchtherm0: <Lewisburg Thermal Subsystem> mem 0x92e02000-0x92e02fff at device 20.2 numa-domain 0 on pci0
 ichsmb0: <Intel Lewisburg SMBus controller> port 0x2000-0x201f mem 0x92dfe000-0x92dfe0ff at device 31.4 numa-domain 0 on pci0
 smbus0: <System Management Bus> numa-domain 0 on ichsmb0

cam message is back, reboot and dmesg and it is gone - so just seems to be after initial upgrade kernel step, maybe?

Hope all that is useful (and not too many dmesg posts) - it basically seems to work but YMMV depending on your requirements.

I looked in iDRAC to see if it had any complaints or events (e.g. anything related to those cam messages but it was all happy)

Code:

Name                           Device Description          PCI Slot           Firmware Version     Driver Version        Cache Memory Size
PERC H755 Front (Embedded)     RAID Controller in SL 3     Not Applicable     52.16.1-4405         07.709.04.00-fbsd     8192 MB

saznik · May 29, 2024

Wow you are awesome! I dont know how to honor this effort.
We will order R450 machines now and the dmesg is very helpfull and this is really enough work you had done.

My only question is know. Why did the mrsas driver work? I would have expected to use the mpr. Hardware Release Notes don't say that this Chip is supported by mrsas driver.

Thank you again!

richardtoohey2 · May 29, 2024

saznik said:
Why did the mrsas driver work? I would have expected to use the mpr. Hardware Release Notes don't say that this Chip is supported by mrsas driver.

Good question. I just saw error messages about mfi when it was booting the installer and thought “oh I need the mrsas workaround“ and did that without thinking.

I don’t know if it would be better / possible to use mpr.

richardtoohey2 · May 29, 2024

Also note there's something being discussed re. the bnxt and 14.1, but I've not looked at that aspect yet:

'Re: [Bug 269133] bnxt(4): BCM57416 - HWRM_CFA_L2_SET_RX_MASK command returned RESOURCE_ALLOC_ERROR e' - MARC

saznik · Monday at 7:58 AM

I will get the machines soon and try out how thinks are working. Will report back when I got them.