bhyve FreeBSD 14.1 bhyve Nvidia GPU passthru issue with Ubuntu 22.04

Q

quakelee

Hi guys,

I followed the guides and the posts of forum, merged the Corvin patches to 14.1 src code.
the VM can boot up, but nvidia driver can't work. I've tried all of available drivers on ubuntu,
but no luck.

the error message like below:
Code: 
[    1.291859] nvidia: loading out-of-tree module taints kernel.
[    1.292179] nvidia: module license 'NVIDIA' taints kernel.
[    1.292457] Disabling lock debugging due to kernel taint
[    1.299770] nvidia: module verification failed: signature and/or required key missing - tainting kernel
[    1.310614] nvidia-nvlink: Nvlink Core is being initialized, major device number 234

[    1.312098] nvidia 0000:00:06.0: can't derive routing for PCI INT A
[    1.312500] nvidia 0000:00:06.0: PCI INT A: not connected
[    1.312801] nvidia 0000:00:06.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[    1.355619] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  560.35.03  Fri Aug 16 21:39:15 UTC 2024
[    1.359345] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  560.35.03  Fri Aug 16 21:21:48 UTC 2024
[    1.360952] [drm] [nvidia-drm] [GPU ID 0x00000006] Loading driver
[    1.787253] tsc: Refined TSC clocksource calibration: 3790.233 MHz
[    1.787589] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x6d449cac678, max_idle_ns: 881591105836 ns
[    1.788194] clocksource: Switched to clocksource tsc
[    2.450868] nvidia-modeset: ERROR: GPU:0: Push buffer DMA allocation failed

This is my FreeBSD version
Code: 
$ :~ % uname -a
FreeBSD homenas.quakelee.org 14.1-RELEASE-p3 FreeBSD 14.1-RELEASE-p3
Attachement is my patch to the src which based on Corvin's 14.0 patch

Anyone has any idea about this?

Thanks,

Xin
 

Attachments

Lincas said:
Hi, try like this
Click to expand...
I've done your guide exactly, but no luck
Code: 
[   12.890378] nvidia_uvm: module uses symbols from proprietary module nvidia, inheriting taint.
[   13.224265] nvidia-uvm: Loaded the UVM driver, major device number 511.
[   14.244727] snd_hda_intel 0000:00:06.1: can't derive routing for PCI INT B
[   14.244730] snd_hda_intel 0000:00:06.1: PCI INT B: not connected
[   14.244740] snd_hda_intel 0000:00:06.1: Disabling MSI
[   14.248274] snd_hda_intel 0000:00:06.1: unable to grab IRQ -2147483648, disabling device
[   14.336281] EXT4-fs (nvme0n1p2): mounted filesystem with ordered data mode. Opts: (null). Quota mode: none.
[   15.484605] audit: type=1400 audit(1725966464.082:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="lsb_release" pid=556 comm="apparmor_parser"
[   15.491583] audit: type=1400 audit(1725966464.090:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe" pid=557 comm="apparmor_parser"
[   15.491591] audit: type=1400 audit(1725966464.090:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="nvidia_modprobe//kmod" pid=557 comm="apparmor_parser"
[   15.544057] audit: type=1400 audit(1725966464.142:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=558 comm="apparmor_parser"
[   15.544060] audit: type=1400 audit(1725966464.142:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=558 comm="apparmor_parser"
[   15.544062] audit: type=1400 audit(1725966464.142:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=558 comm="apparmor_parser"
[   15.544064] audit: type=1400 audit(1725966464.142:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/{,usr/}sbin/dhclient" pid=558 comm="apparmor_parser"
[   15.568646] audit: type=1400 audit(1725966464.166:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=559 comm="apparmor_parser"
[   15.568648] audit: type=1400 audit(1725966464.166:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=559 comm="apparmor_parser"
[   15.844814] audit: type=1400 audit(1725966464.442:11): apparmor="STATUS" operation="profile_load" profile="unconfined" name="snap.aws-cli.aws" pid=572 comm="apparmor_parser"
[   22.825337] nvidia-modeset: ERROR: GPU:0: Push buffer DMA allocation failed
 
same on driver 560

Code: 
[    1.323581] nvidia: loading out-of-tree module taints kernel.
[    1.323883] nvidia: module license 'NVIDIA' taints kernel.
[    1.324164] Disabling lock debugging due to kernel taint
[    1.335527] nvidia: module verification failed: signature and/or required key missing - tainting kernel
[    1.346273] nvidia-nvlink: Nvlink Core is being initialized, major device number 234

[    1.347764] nvidia 0000:00:06.0: can't derive routing for PCI INT A
[    1.348173] nvidia 0000:00:06.0: PCI INT A: not connected
[    1.348475] nvidia 0000:00:06.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[    1.399431] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  560.35.03  Fri Aug 16 21:39:15 UTC 2024
[    1.403149] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  560.35.03  Fri Aug 16 21:21:48 UTC 2024
[    1.404734] [drm] [nvidia-drm] [GPU ID 0x00000006] Loading driver
[    1.818406] tsc: Refined TSC clocksource calibration: 3790.249 MHz
[    1.819198] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x6d44b9d29f2, max_idle_ns: 881591113903 ns
[    1.841450] clocksource: Switched to clocksource tsc
[    2.525856] input: PS/2 Generic Mouse as /devices/platform/i8042/serio1/input/input3
[    2.602696] nvidia-modeset: ERROR: GPU:0: Push buffer DMA allocation failed
[    2.605239] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:00:06.0 on minor 0
 
quakelee said:
same on driver 560

Code: 
[    1.323581] nvidia: loading out-of-tree module taints kernel.
[    1.323883] nvidia: module license 'NVIDIA' taints kernel.
[    1.324164] Disabling lock debugging due to kernel taint
[    1.335527] nvidia: module verification failed: signature and/or required key missing - tainting kernel
[    1.346273] nvidia-nvlink: Nvlink Core is being initialized, major device number 234

[    1.347764] nvidia 0000:00:06.0: can't derive routing for PCI INT A
[    1.348173] nvidia 0000:00:06.0: PCI INT A: not connected
[    1.348475] nvidia 0000:00:06.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=none:owns=io+mem
[    1.399431] NVRM: loading NVIDIA UNIX x86_64 Kernel Module  560.35.03  Fri Aug 16 21:39:15 UTC 2024
[    1.403149] nvidia-modeset: Loading NVIDIA Kernel Mode Setting Driver for UNIX platforms  560.35.03  Fri Aug 16 21:21:48 UTC 2024
[    1.404734] [drm] [nvidia-drm] [GPU ID 0x00000006] Loading driver
[    1.818406] tsc: Refined TSC clocksource calibration: 3790.249 MHz
[    1.819198] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x6d44b9d29f2, max_idle_ns: 881591113903 ns
[    1.841450] clocksource: Switched to clocksource tsc
[    2.525856] input: PS/2 Generic Mouse as /devices/platform/i8042/serio1/input/input3
[    2.602696] nvidia-modeset: ERROR: GPU:0: Push buffer DMA allocation failed
[    2.605239] [drm] Initialized nvidia-drm 0.0.0 20160202 for 0000:00:06.0 on minor 0
Click to expand...
Sorry but you may be out of luck. These patches not in main branch not without a reason… did you tried OpenSource drivers or closed?
 
Lincas said:
Sorry but you may be out of luck. These patches not in main branch not without a reason… did you tried OpenSource drivers or closed?
Click to expand...
Yes, I've tried proprietary, open and server drivers, all of available versions, none of them can work so far

​

 
You must log in or register to reply here.
Back
Top