Other NVMe w/ FreeBSD 10.3 crash [Bug 199321 - Total MSI-X vector allocation limited to 191 vectors]

S

sbhanujan

Hello,

We're hitting bug 199321 when running FreeBSD 10.3 on a SuperMicro Server. Here're the details of the server -

Model 6019U-TN4R4T
MB X11DPU
CPU Intel 5218 (Cascade Lake)
NVME Intel P4610 1.6TB

The workaround for bug 199321 was to set hw.nvme.min_cpus_per_ioq=4 in /boot/loader.conf[.local]. Now, in a previous generation of SuperMicro servers, that uses CPU Intel 5118 (Skylake), the workaround addressed the issue. But w/ the new CPU, it doesn't seem to be working anymore.

Moving to FreeBSD 11.x, where the bug seems to have been fixed isn't an option for us. Can somebody please provide some guidance as to how to go about addressing this issue? Is there another workaround that can be used?

Regards,
Shiva
 
Judging by what you said, the bug has been fixed in the up-to-date FreeBSD version. You can't expect that fix to magically show up in an older version; the developers don't have time machines to port it into the past.

If you are skilled with kernel development, you could download the source code for 10.3, then look at the exact source code for the bug fix, and port it to the old version yourself, recompile and install. The problem with that is that bug fixes usually don't exist in a vacuum, and depend on infrastructure and other parts of the system. So this is unlikely to be easy, and may not even be possible with sensible effort.

Can you instead change to a configuration that doesn't trigger the bug? Move your storage from NVMe to another hardware? Change back to the older CPU where a workaround exists?

As SirDice said, the reasonable answer is to upgrade.
 
Hello,

Thanks for the responses. This seemed to be an issue w/ the NVMe itself. Using a PCI based Optane NVMe doesn't have the issue. Having said that, we're planning to move to a 11.x FreeBSD version soonish (I tried FreeBSD 11.3 w/ the Intel P4610 and it worked fine) , but given the urgency of the situation, we were trying to hash out a fix.
 
You must log in or register to reply here.
Back
Top