Solved Bhyve FreeBSD i386 guest memory

I am just getting around to bhyve i386 guests on FreeBSD 11.3-RELEASE host AMD64.
Host has 32GB RAM.
No problems per say but I have a problem issuing more than 2700M of memory to my VM.
If i set it to -m 2800M then it crashes with VMX error 33.
Code:
 # vm exit[0]
    reason        VMX
    rip        0x0000000000000000
    inst_length    0
    status        0
    exit_reason    33 (VM-entry failure due to invalid guest state)
    qualification    0x0000000000000000
    inst_type        0
    inst_error        0

Is this normal for Bhyve i386 guests? I am using bhyveload and bhyve with identical memory settings and -S wired memory switch.
 
So correct me if I am wrong, but on bare metal I would see 4000M of memory on i386 versions correct?
After that I would need to compile with PAE extensions on.
I did see some comments about 3GB max allowed for userland. Maybe this is my issue.

I am compiling now with an i386 instance and max ram 2760M and 10 cores. Will see how long buildworld & kernel take.
Wanting to build a i386 custom release image.
 
FreeBSD memory managment is really quite flexible. Using only 2.7Gigs, it is still responsive even while compiling.
I used to say for quicker compiling you want cores and disk speed. I think I want to refine that answer.
For quicker compiling you want to throw cores at it. I never see my NVMe even close to maxed out while compiling.
SATA3 SSD are fine as I never see that high throughput while compiling. More like 25MB/s-150MB/s.
Cores are humming at 95%

Here was a informative discussion about large memory i386 systems.
 
Sorry for the noise. I use /etc/rc.local to start my VM and I have sleep in between bhyveload and bhyve.
I found the more memory I add to the VM the more sleep time I need for bhyve.
Code:
bhyveload -S -m 3750M -c /dev/nmdm0A -d /vm/freebsd-i386a.img freebsd-i386a &
sleep 15
bhyve -S -c 16 -m 3750M -AHP -s 0:0,hostbridge -s 1:0,lpc -s 3:0,ahci-hd,/vm/freebsd-i386a.img -s 7:0,passthru,20/0/0 -l com1,/dev/nmdm0A freebsd-i386a &
 
Back
Top