Thanks, I've already read this (I always read your articles!). But as for bhyve, I don't need these advanced virtual machine management features yet. My problem is described here:
I have been running quite a few windows 11 virtual machines on a couple of servers using BHYVE and 14.2-RELEASE.
Upon upgrading win11 to 24H2 the host cpu usage at idle (4 cpu guest) has increase from ~2% to %20 of a CPU (based on top). This has happened on both
intel and AMD CPUs. The other item of note is that the number of voluntary context switches for the BHYVE process has increased from approx 330/sec to 12000/sec.
As part of testing, I have created a fresh windows install (win11 21H2), then updated to 23H2, then 24H2. There was a slight jump to 23H2, but the huge jump was upon...
And a reasonable explanation of the problem is here:
One has to wonder if Windows 11 uses the hlt instruction less.
The other issue I notice with VMs running on Intel hypervisors (ESXi [VMware], VirtualBox, bhyve that I'm familiar with) is that VMs spend a lot of their time in the host's kernel mode. Unlike IBM's zVM which the guest O/S spends the majority of its time in user mode. This is a failing of the underlying hardware architecture -- read the paper by Popek and Goldberg about hardware requirements for virtualization.
Unlike the IBM mainframe's instruction set which userspace does not affect CPU state, on Intel machines it does, which is...