Solaris 11 in bhyve

A

absduser

What is the current state of development towards running Solaris in a bhyve? Now, I know it's not officially supported... but I wonder how close this is to working? Would it even boot? Is it horribly broken? What is the difference in getting Solaris to run in a bhyve vs. Ubuntu, for example?

If Solaris in bhyve is unworkable or a long way off, might the following rat's nest have a chance of working?:

FreeBSD -> bhyve -> Ubuntu -> Xen -> Solaris 11
 
Thank you! I see that I would need FreeBSD 11 release r288524 or greater as I'm running something a bit older on 10.2 AMD which apparently doesn't support it:

Code: 
bhyve: invalid lpc device configuration 'bootrom,BHYVE_UEFI_CSM_20151002.fd'

I'd prefer not to reinstall my OS...would be it possible to copy in /usr/src/usr.sbin/bhyve/* (from FreeBSD 11) and build it on my 10.2 box to get the (UEFI) support I need to get this working?
 
absduser said:
I'd prefer not to reinstall my OS...would be it possible to copy in /usr/src/usr.sbin/bhyve/* (from FreeBSD 11) and build it on my 10.2 box to get the (UEFI) support I need to get this working?
Click to expand...
I very much doubt this will work as things are closely tied to the vmm kernel module. So you'd need to import that too. And that will cause problems because of differences between 10 and 11.

You may want to give 10-STABLE a shot. And there's no need to 'reinstall' the entire OS. You can simply do a source upgrade from 10.2-RELEASE to 10-STABLE or 11-CURRENT.
 
Thanks for your advice. I'm not sure SmartOS will work as we need some features that only Solaris ZFS supports. So, to my original question, is there a chance of getting any modern version (not necessarily the latest) of Solaris working in a bhyve?
 
I've been able to install Solaris 11.3 using UEFI (not CSM) firmware, but there's no virtio network driver support and also haven't been able to get a clean boot post-install.
 
Is there any new information regarding a Solaris bhyve running on FreeBSD 10.3-RELEASE ?

I was under the impression that this was supposed to be working in 10.3 because of new UEFI support ... has anyone successfully gotten this to work ?

Thanks.
 
absduser said:
Thanks for your advice. I'm not sure SmartOS will work as we need some features that only Solaris ZFS supports.
Click to expand...
I'm not sure SmartOS has any such features in its version of ZFS. Whatever stems from OpenSolaris, as does SmartOS, is shared by FreeBSD ZFS driver as well, is it not?
And all the unsupported Solaris ZFS features are in Oracle Solaris where they appeared after the closure of the code, are they not?
 
OK, I've got Solaris 11 running inside smartos (which is running inside a bhyve) per instructions here:
https://lists.freebsd.org/pipermail/freebsd-virtualization/2015-October/003833.html

I thought I'd try an experiment and try to run Solaris in a bhyve in the same way per:

bhyve -c 2 -s 3,ahci-cd,sol-11_3-text-x86.iso -s 4,ahci-hd,vm.img -s 5,virtio-net,tap1 -s 31,lpc -l com1,stdio -l com2,/dev/nmdm1A -l bootrom,BHYVE_UEFI_CSM_20151002.fd -m 4G -H solaris

And it seems to work- the installer runs, it sees the disk, but it does not see any NICs. This is no surprise since I needed to use e1000 within SmartOS to get Solaris to see the NIC in that install.

A little poking around reveals e1000 support was added for bhyve:

https://svnweb.freebsd.org/base?view=revision&sortby=date&revision=302504

So, on my 10.3-RELEASE system I patched:
Code: 
/usr/src/usr.sbin/bhyve/Makefile
/usr/src/usr.sbin/bhyve/bhyve.8
/usr/src/usr.sbin/bhyve/pci_e82545.c (added)
and rebuilt bhyve and when I run:

bhyve -c 2 -s 3,ahci-cd,sol-11_3-text-x86.iso -s 4,ahci-hd,vm.img -s 5,e1000,tap1 -s 31,lpc -l com1,stdio -l com2,/dev/nmdm1A -l bootrom,BHYVE_UEFI_CSM_20151002.fd -m 4G -H solaris

I get:


Code: 
*SNIP*

LegacyGetDataOrTable - ID: 0, Success
  Table - BE86D000, Size - 124, Location - BE622035, Alignment - 0
Table ID 0 length insufficient
LegacyGetDataOrTable - ID: 1, Unsupported
  Table - BE86D000, Size - 124, Location - BE622035, Alignment - 0
LegacyGetDataOrTable - ID: 2, Unsupported
  Table - BE86D000, Size - 124, Location - BE622035, Alignment - 0
LegacyGetDataOrTable - ID: 3, Unsupported
  Table - BE86D000, Size - 124, Location - BE622035, Alignment - 0
Bhyve-HandleProtocol: Copying DevPath: PciRoot(0x0)/Pci(0x3,0x0)/Sata(0x0,0x0,0x0) [32]
Legacy INT19 Boot...
vm_run error -1, errno 14

#

Of note, the patch to the Makefile for e1000 was not matching up nicely with the Makefile in 10.3 so here's my manually patched Makefile (in case that's the source of the issue):

Code: 
#
# $FreeBSD: releng/10.3/usr.sbin/bhyve/Makefile 295124 2016-02-01 14:56:11Z grehan $
#

PROG=   bhyve

DEBUG_FLAGS= -g -O0

MAN=    bhyve.8

SRCS=   \
        atkbdc.c                \
        acpi.c                  \
        bhyverun.c              \
        block_if.c              \
        bootrom.c               \
        consport.c              \
        dbgport.c               \
        fwctl.c                 \
        inout.c                 \
        ioapic.c                \
        mem.c                   \
        mevent.c                \
        mptbl.c                 \
        pci_ahci.c              \
        pci_e82545.c            \
        pci_emul.c              \
        pci_hostbridge.c        \
        pci_irq.c               \
        pci_lpc.c               \
        pci_passthru.c          \
        pci_virtio_block.c      \
        pci_virtio_net.c        \
        pci_virtio_rnd.c        \
        pci_uart.c              \
        pm.c                    \
        post.c                  \
        rtc.c                   \
        smbiostbl.c             \
        task_switch.c           \
        uart_emul.c             \
        virtio.c                \
        xmsr.c                  \
        spinup_ap.c

.PATH:  ${.CURDIR}/../../sys/amd64/vmm
SRCS+=  vmm_instruction_emul.c

DPADD=  ${LIBVMMAPI} ${LIBMD} ${LIBUTIL} ${LIBPTHREAD}
LDADD=  -lvmmapi -lmd -lutil -lpthread -lz
CFLAGS+= -I${BHYVE_SYSDIR}/sys/dev/e1000
CFLAGS+= -I${BHYVE_SYSDIR}/sys/dev/mii

WARNS?= 2

.include <bsd.prog.mk>

So, what have I missed, why doesn't e1000 work?

Are there some other dependencies which I should also patch?

Is this a fool's errand- will this (Solaris in a bhyve) ultimately not work for some other reason?
 
Last edited by a moderator:
I think FreeNAS 10 is based on FreeBSD 11 so that's not super applicable to my situation on 10.3

Unfortunately, adding hostbridge didn't help:

Code: 
Failed to emulate instruction [0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf 0xaf] at 0xbea43fe9
 
I wanted to share my BHYVE (vm-bhyve https://github.com/churchers) config for Solaris 11.4 on 14.1-RELEASE-p5 FreeBSD 14.1-RELEASE-p5 GENERIC amd64:

loader="uefi"
virt_random="yes"
grub_options="-p"

debug="yes"

hostbridge="none"

cpu="1"
memory="4G"

network0_type="e1000"
network0_switch="public"

graphics="yes"
graphics_wait="yes"
xhci_mouse="no"
#graphics_res="1920x1080"

disk0_type="ahci-hd"
disk0_name="disk0"
disk0_dev="zvol"

#auto-start="yes"

uuid="e1cb0f29-937b-11ef-93f3-70106fc7d24a"
network0_mac="58:9c:fc:06:33:4f"
 
I'm working on this topic,today :

ZioMario

Solved Thread 'Trying to virtualize Solaris 11.4 with bhyve...'

Hello.

I'm trying to boot and install Solaris 11.4 using bhyve. For some technical and unknown reason to me,bhyve is not able to detect and use the CD-ROM. To understand why,I've asked all around and I found what are the parameters needed to boot
it in qemu. I've used qemu as a means of comparison to understand the reason.

Well,the following are the correct parameters used by qemu to be able to boot the iso image and to start the installation :

Code: 
qemu-system-x86_64 -name guest=s11x64,debug-threads=on \
-machine pc,usb=off \
-cpu kvm64,hv_relaxed,hv_time,hv_synic \
-m 8G -smp...
 
Between the parameters that you have used I see : hostbridge="none" ; since I don't use vm-bhyve,I want to ask if I should launch bhyve using the following parameters :

Code: 
/usr/sbin/./bhyve-win -S -c sockets=2,cores=2,threads=2 -m 8G -w -H -A \
-s 1,ahci-cd,/mnt/zroot2/zroot2/OS/ISO/Unix/Solaris/sol-11_4-text-x86.iso,bootindex=1 \
-s 2,virtio-blk,/mnt/zroot2/zroot2/bhyve/img/Solaris/solaris114-empty.img \
-s 29,fbuf,tcp=0.0.0.0:5915,w=1600,h=950,wait \
-s 31,lpc \
-l bootrom,/usr/local/share/uefi-firmware/BHYVE_UEFI_CODE.fd \
vm0:15 < /dev/null & sleep 2 && vncviewer 0:15 &

Is that right ?
 
You must log in or register to reply here.
Back
Top