Hi,
Im having a hard time to boot FreeBSD 14.2-STABLE inside Proxmox.
For started - i had issues with booting under GPU passtrough, then i got one step forward and managed to boot it but im having a crash every time i use PCI passtrough inside Proxmox.
This is where my boot process stops:
At the beginning i was thinking NVIDIA as i forgot to enable nvidia module - enabled - same issue, deleted nvidia - same issues.
If i launch VM with VirtIO - im able to launch it.
Why i decided to use UEFI ROM for GPu is that proxmox logs showed me this:
Im not really a guru on stuff like this but - does OS loads something to GPU when it boots ?
My gpu nVidia P600 is also used when proxmox launches but then it freezes at some point , but ! im able to log in to web gui and when im launching FreeBSD VM my screen blanks and i can see FreeBSD boot
Im having a hard time to boot FreeBSD 14.2-STABLE inside Proxmox.
For started - i had issues with booting under GPU passtrough, then i got one step forward and managed to boot it but im having a crash every time i use PCI passtrough inside Proxmox.
This is where my boot process stops:
Code:
Apr 7 04:41:31 kodasBSD syslogd: kernel boot file is /boot/kernel/kernel
Apr 7 04:41:31 kodasBSD kernel: ---<<BOOT>>---
Apr 7 04:41:31 kodasBSD kernel: Copyright (c) 1992-2023 The FreeBSD Project.
Apr 7 04:41:31 kodasBSD kernel: Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
Apr 7 04:41:31 kodasBSD kernel: The Regents of the University of California. All rights reserved.
Apr 7 04:41:31 kodasBSD kernel: FreeBSD is a registered trademark of The FreeBSD Foundation.
Apr 7 04:41:31 kodasBSD kernel: FreeBSD 14.2-STABLE stable/14-n270904-0ae0226cd12a GENERIC amd64
Apr 7 04:41:31 kodasBSD kernel: FreeBSD clang version 19.1.7 (https://github.com/llvm/llvm-project.git llvmorg-19.1.7-0-gcd708029e0b2)
Apr 7 04:41:31 kodasBSD kernel: VT(efifb): resolution 1280x800
Apr 7 04:41:31 kodasBSD kernel: CPU: Intel(R) Xeon(R) CPU E5-2690 v4 @ 2.60GHz (2594.28-MHz K8-class CPU)
Apr 7 04:41:31 kodasBSD kernel: Origin="GenuineIntel" Id=0x406f1 Family=0x6 Model=0x4f Stepping=1
Apr 7 04:41:31 kodasBSD kernel: Features=0x1f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS,HTT>
Apr 7 04:41:31 kodasBSD kernel: Features2=0xfffab223<SSE3,PCLMULQDQ,VMX,SSSE3,FMA,CX16,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
Apr 7 04:41:31 kodasBSD kernel: AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
Apr 7 04:41:31 kodasBSD kernel: AMD Features2=0x121<LAHF,ABM,Prefetch>
Apr 7 04:41:31 kodasBSD kernel: Structured Extended Features=0x1c2fbb<FSGSBASE,TSCADJ,BMI1,HLE,AVX2,SMEP,BMI2,ERMS,INVPCID,RTM,NFPUSG,RDSEED,ADX,SMAP>
Apr 7 04:41:31 kodasBSD kernel: Structured Extended Features2=0x4<UMIP>
Apr 7 04:41:31 kodasBSD kernel: Structured Extended Features3=0xbc000400<MD_CLEAR,IBPB,STIBP,L1DFL,ARCH_CAP,SSBD>
Apr 7 04:41:31 kodasBSD kernel: XSAVE Features=0x1<XSAVEOPT>
Apr 7 04:41:31 kodasBSD kernel: IA32_ARCH_CAPS=0xc000048<SKIP_L1DFL_VME>
Apr 7 04:41:31 kodasBSD kernel: AMD Extended Feature Extensions ID EBX=0x100d000<IBPB,IBRS,STIBP,SSBD>
Apr 7 04:41:31 kodasBSD kernel: VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID,VID,PostIntr
Apr 7 04:41:31 kodasBSD kernel: real memory = 21474836480 (20480 MB)
Apr 7 04:41:31 kodasBSD kernel: avail memory = 20751446016 (19790 MB)
Apr 7 04:41:31 kodasBSD kernel: Event timer "LAPIC" quality 600
Apr 7 04:41:31 kodasBSD kernel: ACPI APIC Table: <BOCHS BXPC >
Apr 7 04:41:31 kodasBSD kernel: FreeBSD/SMP: Multiprocessor System Detected: 24 CPUs
Apr 7 04:41:31 kodasBSD kernel: FreeBSD/SMP: 1 package(s) x 24 core(s)
Apr 7 04:41:31 kodasBSD kernel: random: registering fast source Intel Secure Key RNG
Apr 7 04:41:31 kodasBSD kernel: random: fast provider: "Intel Secure Key RNG"
Apr 7 04:41:31 kodasBSD kernel: random: unblocking device.
Apr 7 04:41:31 kodasBSD kernel: ioapic0 <Version 1.1> irqs 0-23
Apr 7 04:41:31 kodasBSD kernel: Launching APs: 5 3 9 20 23 11 2 13 8 19 7 21 17 12 15 16 18 4 10 1 14 22 6
Apr 7 04:41:31 kodasBSD kernel: random: entropy device external interface
Apr 7 04:41:31 kodasBSD kernel: kbd1 at kbdmux0
Apr 7 04:41:31 kodasBSD kernel: efirtc0: <EFI Realtime Clock>
Apr 7 04:41:31 kodasBSD kernel: efirtc0: registered as a time-of-day clock, resolution 1.000000s
Apr 7 04:41:31 kodasBSD kernel: smbios0: <System Management BIOS> at iomem 0x7e9d4000-0x7e9d401e
Apr 7 04:41:31 kodasBSD kernel: smbios0: Version: 2.8, BCD Revision: 2.8
Apr 7 04:41:31 kodasBSD kernel: aesni0: <AES-CBC,AES-CCM,AES-GCM,AES-ICM,AES-XTS>
Apr 7 04:41:31 kodasBSD kernel: acpi0: <BOCHS BXPC>
Apr 7 04:41:31 kodasBSD kernel: acpi0: Power Button (fixed)
Apr 7 04:41:31 kodasBSD kernel: cpu0: <ACPI CPU> on acpi0
Apr 7 04:41:31 kodasBSD kernel: atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
Apr 7 04:41:31 kodasBSD kernel: atrtc0: registered as a time-of-day clock, resolution 1.000000s
Apr 7 04:41:31 kodasBSD kernel: Event timer "RTC" frequency 32768 Hz quality 0
Apr 7 04:41:31 kodasBSD kernel: hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Apr 7 04:41:31 kodasBSD kernel: Timecounter "HPET" frequency 100000000 Hz quality 950
Apr 7 04:41:31 kodasBSD kernel: Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
Apr 7 04:41:31 kodasBSD kernel: acpi_timer0: <24-bit timer at 3.579545MHz> port 0x608-0x60b on acpi0
Apr 7 04:41:31 kodasBSD kernel: pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
Apr 7 04:41:31 kodasBSD kernel: pci0: <ACPI PCI bus> on pcib0
Apr 7 04:41:31 kodasBSD kernel: virtio_pci0: <VirtIO PCI (modern) GPU adapter> mem 0x81800000-0x81ffffff,0x384000000000-0x384000003fff,0x8308b000-0x8308bfff irq 21 at device 1.0 on pci0
Apr 7 04:41:31 kodasBSD kernel: uhci0: <Intel 82801I (ICH9) USB controller> port 0x8100-0x811f irq 16 at device 26.0 on pci0
Apr 7 04:41:31 kodasBSD kernel: usbus0 on uhci0
Apr 7 04:41:31 kodasBSD kernel: usbus0: 12Mbps Full Speed USB v1.0
Apr 7 04:41:31 kodasBSD kernel: uhci1: <Intel 82801I (ICH9) USB controller> port 0x80e0-0x80ff irq 17 at device 26.1 on pci0
Apr 7 04:41:31 kodasBSD kernel: usbus1 on uhci1
Apr 7 04:41:31 kodasBSD kernel: usbus1: 12Mbps Full Speed USB v1.0
Apr 7 04:41:31 kodasBSD kernel: uhci2: <Intel 82801I (ICH9) USB controller> port 0x80c0-0x80df irq 18 at device 26.2 on pci0
Apr 7 04:41:31 kodasBSD kernel: usbus2 on uhci2
Apr 7 04:41:31 kodasBSD kernel: usbus2: 12Mbps Full Speed USB v1.0
Apr 7 04:41:31 kodasBSD kernel: ehci0: <Intel 82801I (ICH9) USB 2.0 controller> mem 0x8308a000-0x8308afff irq 19 at device 26.7 on pci0
Apr 7 04:41:31 kodasBSD kernel: usbus3: EHCI version 1.0
Apr 7 04:41:31 kodasBSD kernel: usbus3 on ehci0
Apr 7 04:41:31 kodasBSD kernel: usbus3: 480Mbps High Speed USB v2.0
Apr 7 04:41:31 kodasBSD kernel: hdac0: <Intel 82801I HDA Controller> mem 0x83080000-0x83083fff irq 16 at device 27.0 on pci0
Apr 7 04:41:31 kodasBSD kernel: pcib1: <ACPI PCI-PCI bridge> mem 0x83089000-0x83089fff irq 16 at device 28.0 on pci0At the beginning i was thinking NVIDIA as i forgot to enable nvidia module - enabled - same issue, deleted nvidia - same issues.
If i launch VM with VirtIO - im able to launch it.
Why i decided to use UEFI ROM for GPu is that proxmox logs showed me this:
vfio-pci xxxx:xx:xx.x: No more image in the PCI ROM Im not really a guru on stuff like this but - does OS loads something to GPU when it boots ?
My gpu nVidia P600 is also used when proxmox launches but then it freezes at some point , but ! im able to log in to web gui and when im launching FreeBSD VM my screen blanks and i can see FreeBSD boot