Solved FreeBSD bhyve guest upgrade 11.1 to 11.2

Ofloo

Ofloo

I've upgraded previous systems flawlessly this is one with full disk encryption, for some reason it doesn't work. Used freebsd-update to do so.

Code: 
/boot/kernel/kernel text=0x1547b48 data=0x143ff0+0x4bc418 syms=[0x8+0x16ad48+0x8+0x183d27]
/boot/entropy size=0x1000
/boot/kernel/aesni.ko size 0xaf98 at 0x2238000
/boot/kernel/geom_eli.ko size 0x1e0d8 at 0x2243000
Booting...
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.2-RELEASE-p1 #0: Sun Aug  5 12:04:13 UTC 2018
    root@amd64-builder.daemonology.net:/usr/obj/usr/src/sys/GENERIC amd64
FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0)
VT: init without driver.
CPU: Intel(R) Xeon(R) CPU E3-1265L v3 @ 2.50GHz (2499.60-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306c3  Family=0x6  Model=0x3c  Stepping=3
  Features=0x9f83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS,HTT,PBE>
  Features2=0xfeda7a17<SSE3,PCLMULQDQ,DTES64,DS_CPL,SSSE3,SDBG,FMA,CX16,xTPR,PCID,SSE4.1,SSE4.2,MOVBE,POPCNT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
  AMD Features=0x24100800<SYSCALL,NX,Page1GB,LM>
  AMD Features2=0x21<LAHF,ABM>
  Structured Extended Features=0x729<FSGSBASE,BMI1,AVX2,BMI2,ERMS,INVPCID>
  XSAVE Features=0x1<XSAVEOPT>
  TSC: P-state invariant
Hypervisor: Origin = "bhyve bhyve "
real memory  = 2147483648 (2048 MB)
avail memory = 2036342784 (1942 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <BHYVE  BVMADT  >
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 4 package(s)
ioapic0 <Version 1.1> irqs 0-31 on motherboard
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #1 Launched!
random: entropy device external interface
kbd1 at kbdmux0
netmap: loaded module
module_register_init: MOD_LOAD (vesa, 0xffffffff80ff4550, 0) error 19
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
nexus0
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
acpi0: <BHYVE BVXSDT> on motherboard
acpi0: Power Button (fixed)
atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 16777216 Hz quality 950
Event timer "HPET" frequency 16777216 Hz quality 550
Event timer "HPET1" frequency 16777216 Hz quality 450
Event timer "HPET2" frequency 16777216 Hz quality 450
Event timer "HPET3" frequency 16777216 Hz quality 450
Event timer "HPET4" frequency 16777216 Hz quality 450
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <32-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
virtio_pci0: <VirtIO PCI Block adapter> port 0x2000-0x203f mem 0xc0000000-0xc0001fff irq 16 at device 4.0 on pci0
vtblk0: <VirtIO Block Adapter> on virtio_pci0
vtblk0: 40960MB (83886080 512 byte sectors)
virtio_pci1: <VirtIO PCI Block adapter> port 0x2040-0x207f mem 0xc0002000-0xc0003fff irq 17 at device 4.1 on pci0
vtblk1: <VirtIO Block Adapter> on virtio_pci1
vtblk1: 17825792MB (36507222016 512 byte sectors)
virtio_pci2: <VirtIO PCI Network adapter> port 0x2080-0x209f mem 0xc0004000-0xc0005fff irq 18 at device 5.0 on pci0
vtnet0: <VirtIO Networking Adapter> on virtio_pci2
vtnet0: Ethernet address: 58:9c:fc:08:8c:68
000.001040 [ 421] vtnet_netmap_attach       max rings 1
vtnet0: netmap queues/slots: TX 1/1024, RX 1/1024
000.001041 [ 426] vtnet_netmap_attach       virtio attached txq=1, txd=1024 rxq=1, rxd=1024
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
driver bug: Unable to set devclass (class: atkbdc devname: (unknown))
Enter passphrase for vtbd0p4: psm0: <PS/2 Mouse> irq 12 on atkbdc0
psm0: [GIANT-LOCKED]
psm0: model Generic PS/2 mouse, device ID 0
uart0: <Non-standard ns8250 class UART with FIFOs> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart0: console (9600,n,8,1)
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
vga0: <Generic ISA VGA> at port 0x3b0-0x3bb iomem 0xb0000-0xb7fff on isa0
ppc0: cannot reserve I/O port range
Timecounters tick every 10.000 msec
usb_needs_explore_all: no devclass
Trying to mount root from ufs:vtbd0p4.eli []...

GEOM_ELI: Device vtbd0p4.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
Enter passphrase for vtbd1p1:
kernel trap 22 with interrupts disabled
panic: smp_targeted_tlb_shootdown: interrupts disabled
cpuid = 0
KDB: stack backtrace:
#0 0xffffffff80b3d567 at kdb_backtrace+0x67
#1 0xffffffff80af6b07 at vpanic+0x177
#2 0xffffffff80af6983 at panic+0x43
#3 0xffffffff810f17bf at smp_targeted_tlb_shootdown+0x3ef
#4 0xffffffff810f1852 at smp_masked_invlpg_range+0x42
#5 0xffffffff80f65a0a at pmap_invalidate_range+0x24a
#6 0xffffffff80decb70 at vm_thread_new+0x140
#7 0xffffffff80b088e1 at thread_alloc+0x31
#8 0xffffffff80ab81f5 at fork1+0x445
#9 0xffffffff80ac53f9 at kproc_create+0x79
#10 0xffffffff82244b98 at g_eli_create+0x4f8
#11 0xffffffff822438f2 at g_eli_taste+0x8f2
#12 0xffffffff80a4b71a at g_new_provider_event+0xca
#13 0xffffffff80a4679e at g_run_events+0x13e
#14 0xffffffff80aba083 at fork_exit+0x83
#15 0xffffffff80f585be at fork_trampoline+0xe
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e5e70
frame pointer           = 0x28:0xfffffe007b7e5e80
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e5ac0
frame pointer           = 0x28:0xfffffe007b7e5ad0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e5710
frame pointer           = 0x28:0xfffffe007b7e5720
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e5360
frame pointer           = 0x28:0xfffffe007b7e5370
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e4fb0
frame pointer           = 0x28:0xfffffe007b7e4fc0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e4c00
frame pointer           = 0x28:0xfffffe007b7e4c10
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e4850
frame pointer           = 0x28:0xfffffe007b7e4860
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e44a0
frame pointer           = 0x28:0xfffffe007b7e44b0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e40f0
frame pointer           = 0x28:0xfffffe007b7e4100
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e3d40
frame pointer           = 0x28:0xfffffe007b7e3d50
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xfffffe007b7e3990
frame pointer           = 0x28:0xfffffe007b7e39a0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled

Fatal double fault
rip 0xffffffff80b3fa04 rsp 0xfffffe007b7e2fd0 rbp 0xfffffe007b7e3090
rax 0xfffffe007b7e3261 rdx 0xfffffe007b7e3260 rbx 0x5
rcx 0x1 rsi 0xfffff8007fffffb8 rdi 0xffffffff
r8 0xfffffe007b7e3330 r9 0xfffffe007b7e3310 r10 0x28
r11 0x1 r12 0 r13 0
r14 0xfffffe007b7e3260 r15 0xfffffe007b7e3230 rflags 0x10082
cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x28
fsbase 0 gsbase 0xffffffff81e9df80 kgsbase 0
cpuid = 0; apic id = 00
panic: double fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81deb7e0
frame pointer           = 0x28:0xffffffff81deb7f0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81deb430
frame pointer           = 0x28:0xffffffff81deb440
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81deb080
frame pointer           = 0x28:0xffffffff81deb090
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81deacd0
frame pointer           = 0x28:0xffffffff81deace0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81dea920
frame pointer           = 0x28:0xffffffff81dea930
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81dea570
frame pointer           = 0x28:0xffffffff81dea580
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid = 0; apic id = 00
fault virtual address   = 0x2c
fault code              = supervisor read data, page not present
instruction pointer     = 0x20:0xffffffff8224627b
stack pointer           = 0x28:0xffffffff81dea1c0
frame pointer           = 0x28:0xffffffff81dea1d0
code segment            = base 0x0, limit 0xfffff, type 0x1b
                        = DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags        = resume, IOPL = 0
current process         = 13 (g_event)
trap number             = 12
panic: page fault
cpuid = 0
 
Ouch. Is the host up to 11.2 as well? Does setting kern.geom.eli.threads=1 alleviate it? Is IBRS active (hw.ibrs_active) and if so does disabling (hw.ibrs_disable) it alleviate it?
Is performing the encryption on the host instead of the guest an option?
 
The encryption is performed by the guest, .. zfs-sparse partition and the guest has control over the encryption.

The host is 11.2-RELEASE, on the host kern.geom.eli.threads: 0 and hw.ibrs_disable: 1 on the current system as well, did rollback to 11.1p11 kern.geom.eli.threads: 0 and hw.ibrs_disable: 1.

If you like I can try and upgrade once more, .. and post the results, .. maybe provide some instructions on how you'd like me to do that. Also maybe debug it not quite sure how to do that. If you can provide a guide on how to debug the error don't mind doing the work.
 
You must log in or register to reply here.
Back
Top