vmware Freebsd 11.4 crashes on reboots on ESXi with passthrough of NIC

[mak0708]

Hi All,

The FreeBSD 11.4 vanilla VM downloaded from freebsd.org is crashing when doing passthrough of Intel NIC
"Ethernet Controller X710 for 10GbE SFP+" after a couple of reboots.

In the ESXi kernel logs seeing this message

cpu10:2235436)IntrCookie: 1565: Unable to allocate 128 cookies: Out of resources
2021-02-24T13:32:47.831Z cpu10:2235436)PCIPassthru: 2461: Failed to allocate 128 MSIX interrupts"
2021-02-24T13:32:47.968Z cpu10:2235436)UserDump: 2630: vmx-vcpu-1:arif-debug-11: Dumping cartel 2235424 (from world 2235436) to file /vmfs/volumes/5e329ba9-50e9cd52-8a4b-0cc47aacfdbc/arif-new-11/vmx-zdump.000 ...
2021-02-24T13:32:48.771Z cpu1:2235436)UserDump: 2818: vmx-vcpu-1:arif-debug-11: Userworld(vmx-vcpu-1:arif-debug-11) coredump complete.
PCIPassthru: 2461: Failed to allocate 128 MSIX interrupts

The issue is not seen 8.4 freebsd VM. Looks like there is some issue with pci_alloc and free functions. First of all why ESX allocating 128 interrupts for one MSIX interrupt. And again after some reboots all the available interrupts are exhausted.

regards,
mak

 

[SirDice]

The issue is not seen 8.4 freebsd VM.

FreeBSD 8.4 doesn't support the ixl(4) interface, it was added in 10.1.

As for the issue, you might want to try 12.2 instead (11.x will be EoL around the end of this year). Or the net/intel-ixl-kmod port/package.

 

[mak0708]

I want to get connected with developer community on this. I feel there is some issue with freebsd MSIX allocator in ESX. ESX is allocating 128 interrupts for every interrupt allocation

 

[SirDice]

want to get connected with developer community on this

Ask on the freebsd-net mailing list. There are very few developers on the forums.