bhyve - make -j8 buildworld *** [vdev_raidz_math_sse2.o] Error code 1

I installed FreeBSD 13-2 RELEASE in a bhyve vm, I wanted to install Poudriere but many ports failed with error like:

Code:
!!! Jail is newer than host. (Jail: 1302505, Host: 1302001) !!!
!!! This is not supported. !!!
!!! Host kernel must be same or newer than jail. !!!
!!! Expect build failures. !!!

In an attempt to upgrade the VM, I fetched sources via git and then tried build world:

Code:
git clone -b stable/13 https://git.FreeBSD.org/src.git /usr/src
cd /usr/src
make -j8 buildworld

But I keep getting this error:

Code:
PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT:
Preprocessed source(s) and associated run script(s) are located at:
cc: note: diagnostic msg: /tmp/vdev_raidz_math_sse2-7de6a9.c
cc: note: diagnostic msg: /tmp/vdev_raidz_math_sse2-7de6a9.sh
cc: note: diagnostic msg:

********************
*** [vdev_raidz_math_sse2.o] Error code 1

make[5]: stopped in /usr/src/cddl/lib/libzpool
--- kerberos5/lib__L ---

make[4]: stopped in /usr/src/kerberos5/lib
--- lib__L ---

make[3]: stopped in /usr/src
--- kerberos5/lib__L ---

make[3]: stopped in /usr/src
--- cddl/lib__L ---
1 error

make[5]: stopped in /usr/src/cddl/lib/libzpool

make[4]: stopped in /usr/src/cddl/lib

make[3]: stopped in /usr/src

make[2]: stopped in /usr/src

make[1]: stopped in /usr/src

make: stopped in /usr/src

Any ideas about how to upgrade the VM so that I can later use poudriere?
 

Attachments

  • vdev_raidz_math_sse2-7de6a9.zip
    275.8 KB · Views: 55
I have this:

Code:
BOOTWAIT=0
NO_X=true
OPTIONS_UNSET=X11
WITHOUT="X11"
WITHOUT_FONTCONFIG=YES

Tried also with:
Code:
BUILD_OPTIMIZED=        YES
BUILD_STATIC=           YES
OPTIMIZED_CFLAGS=       YES
WITHOUT_DEBUG=          YES
WITH_CPUFLAGS=          YES
WITH_OPTIMIZED_CFLAGS=  YES
MALLOC_PRODUCTION=      YES
MK_PROFILE=             no

but same results
 
Tried also with:
The only thing you should try is removing /etc/make.conf entirely. And make sure to at least do a make clean in /usr/src/, just to flush out anything and everything that perhaps got built with some bad options.

But let's circle back to the beginning.
Code:
!!! Jail is newer than host. (Jail: 1302505, Host: 1302001) !!!
Are you really intending to build packages for 13-STABLE? If you want packages for 13.2-RELEASE then you should simply use a 13.2-RELEASE jail in poudriere. It looks like you used a snapshot of 13-STABLE there?
 
I created the poudriere jail with:

Code:
poudriere jail -c -j 13amd64 -v 13.2-STABLE -a amd64
, but installed the VM using FreeBSD-13.2-RELEASE-amd64-disc1.iso
 
All my other setups have 13.2 stable therefore though would make sense to have packages for the stable branch, any pros cons?
 
Nope, just that you're aware -STABLE is a development branch. And the only way to update it is by building from source (you can't use freebsd-update(8) to update it). I have two -STABLE systems, and everything else is a -RELEASE version.

Can you do a git pull in /usr/src? Just to make sure you haven't accidentally checked out the tree at a bad moment.
 
I was under the impression that stable was a "stable branch" not a "development branch", thanks for the hint.

If a custom kernel is needed can the release sources be fetched and do only ( make kernel) ?

git pull works, will try to updated and test
 
I was under the impression that stable was a "stable branch" not a "development branch", thanks for the hint.
-STABLE refers to the ABI being stable, i.e. not subject to change. It is still a development branch. Contrary to -CURRENT, the -STABLE branches are supported development branches.


If a custom kernel is needed can the release sources be fetched and do only ( make kernel) ?
Yes. But if you don't do a buildworld you may need to run a make kernel-toolchain beforehand.

Code:
     kernel-toolchain      Rebuild the tools needed for kernel compilation.
                           Use this if you did not do a buildworld first.
See build(7).
 
I will try to build a kernel using git checkout releng/13.2 how to switch a system using STABLE to releng/13.2 for example ?
 
how to switch a system using STABLE to releng/13.2 for example ?
You're technically downgrading. Because -STABLE is newer than 13.2-RELEASE. But I don't think there are any major issues right now, 13.2 is fairly recent. Be careful with ZFS pools though, you may have upgraded the pools with a more recent OpenZFS than 13.2-RELEASE has. And that will certainly cause problems.
 
I am trying now directly on the host, not byhve but getting similar errors: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=272271

how to reproduce:

Code:
cd /usr/src

git pull  (origin  https://git.FreeBSD.org/src.git )

git checkout stable/13

# git log --oneline -5
0da2f02c1b2a (HEAD -> stable/13) netinet: re-read IP length after PFIL hook
12ce57e6d3e7 pcib: Allocate the memory BAR with the MSI-X table.
7148e1593b68 <sys/cdefs.h>: Decay expression passed to fallback version of __generic()
ed19cb27bde8 ether_demux: Defer stripping the Ethernet header.
5771c3bd1df8 systat: Fix a bunch of use after frees in fetch_ifstat().

make -j4 buildworld

Any ideas? it is working for some of you? just in case I am trying on hosts based on AMD
 
Many of these entries seems to be options related to ports and they're defined like this

Code:
OPTIONS_UNSET=DOCS EXAMPLES FLANG NLS TEST
OPTIONS_SET=LTO OPTIMIZED_CFLAGS
 
I did again a git pull, and now is working, this commit fixed the problem:

1706d72e36a0 (HEAD -> stable/13, origin/stable/13) Apply llvm fix for hanging gcc builds on 32-bit arm (https://cgit.freebsd.org/src/commit/?h=stable/13&id=1706d72e36a03da4e5c2bd166362dabf8f2b1d6a)

Code:
# git log --oneline -5
1706d72e36a0 (HEAD -> stable/13, origin/stable/13) Apply llvm fix for hanging gcc builds on 32-bit arm
0da2f02c1b2a netinet: re-read IP length after PFIL hook
12ce57e6d3e7 pcib: Allocate the memory BAR with the MSI-X table.
7148e1593b68 <sys/cdefs.h>: Decay expression passed to fallback version of __generic()
ed19cb27bde8 ether_demux: Defer stripping the Ethernet header.

No idea how it can influence an amd64 but also tried again with these options in /etc/make and is working:
Code:
BUILD_OPTIMIZED=        YES
BUILD_STATIC=           YES
OPTIMIZED_CFLAGS=       YES
WITHOUT_DEBUG=          YES
WITH_CPUFLAGS=          YES
WITH_OPTIMIZED_CFLAGS=  YES
MALLOC_PRODUCTION=      YES
MK_PROFILE=             no

Are these options worth it in FreeBSD 13?, I have been carrying them for years.

Apart from that, I think something else is buggy, current output of uname -v after make buildworld, kernel etc:

Code:
 FreeBSD 13.2-STABLE stable/13-n255702-1706d72e36a0 GENERIC
 
So I went to another host to run the same procedure and keeps failing, in this case I tested first with and empty /etc/make

Code:
# git log --oneline -5
1706d72e36a0 (HEAD -> stable/13, origin/stable/13) Apply llvm fix for hanging gcc builds on 32-bit arm
0da2f02c1b2a netinet: re-read IP length after PFIL hook
12ce57e6d3e7 pcib: Allocate the memory BAR with the MSI-X table.
7148e1593b68 <sys/cdefs.h>: Decay expression passed to fallback version of __generic()
ed19cb27bde8 ether_demux: Defer stripping the Ethernet header.

This is the error when doing buildworld
Code:
--- ASTMatchers/Dynamic/Registry.o ---
PLEASE submit a bug report to https://bugs.freebsd.org/submit/ and include the crash backtrace, preprocessed source, and associated run script.
Stack dump:
0.    Program arguments: c++ -target x86_64-unknown-freebsd13.2 --sysroot=/usr/obj/usr/src/amd64.amd64/tmp -B/usr/obj/usr/src/amd64.amd64/tmp/usr/bin -O2 -pipe -fno-common -I/usr/obj/usr/src/amd64.amd64/lib/clang/libclang -I/usr/obj/usr/src/amd64.amd64/lib/clang/libllvm -I/usr/src/contrib/llvm-project/clang/lib/Basic -I/usr/src/contrib/llvm-project/clang/lib/Driver -I/usr/src/contrib/llvm-project/clang/include -DCLANG_ENABLE_ARCMT -DCLANG_ENABLE_STATIC_ANALYZER -I/usr/src/lib/clang/include -I/usr/src/contrib/llvm-project/llvm/include -D__STDC_CONSTANT_MACROS -D__STDC_FORMAT_MACROS -D__STDC_LIMIT_MACROS -DHAVE_VCS_VERSION_INC -DNDEBUG -DLLVM_DEFAULT_TARGET_TRIPLE=\"x86_64-unknown-freebsd13.2\" -DLLVM_HOST_TRIPLE=\"x86_64-unknown-freebsd13.2\" -DDEFAULT_SYSROOT=\"\" -DLLVM_TARGET_ENABLE_AARCH64 -DLLVM_TARGET_ENABLE_ARM -DLLVM_TARGET_ENABLE_MIPS -DLLVM_TARGET_ENABLE_POWERPC -DLLVM_TARGET_ENABLE_RISCV -DLLVM_TARGET_ENABLE_X86 -DLLVM_NATIVE_ASMPARSER=LLVMInitializeX86AsmParser -DLLVM_NATIVE_ASMPRINTER=LLVMInitializeX86AsmPrinter -DLLVM_NATIVE_DISASSEMBLER=LLVMInitializeX86Disassembler -DLLVM_NATIVE_TARGET=LLVMInitializeX86Target -DLLVM_NATIVE_TARGETINFO=LLVMInitializeX86TargetInfo -DLLVM_NATIVE_TARGETMC=LLVMInitializeX86TargetMC -ffunction-sections -fdata-sections -DNDEBUG -MD -MF.depend.ASTMatchers_Dynamic_Registry.o -MTASTMatchers/Dynamic/Registry.o -Wno-format-zero-length -fstack-protector-strong -Wno-empty-body -Wno-string-plus-int -Wno-unused-const-variable -Wno-error=unused-but-set-variable -Wno-error=array-parameter -Wno-error=deprecated-non-prototype -Wno-error=unused-but-set-parameter -Wno-tautological-compare -Wno-unused-value -Wno-parentheses-equality -Wno-unused-function -Wno-enum-conversion -Wno-unused-local-typedef -Wno-address-of-packed-member -Wno-switch -Wno-switch-enum -Wno-knr-promoted-parameter -Wno-parentheses -Qunused-arguments -fno-exceptions -fno-rtti -std=c++14 -stdlib=libc++ -Wno-c++11-extensions -c /usr/src/contrib/llvm-project/clang/lib/ASTMatchers/Dynamic/Registry.cpp -o ASTMatchers/Dynamic/Registry.o
1.    <eof> parser at end of file
2.    Per-file LLVM IR generation
3.    /usr/src/contrib/llvm-project/llvm/include/llvm/ADT/SmallVector.h:600:37: Generating code for declaration 'llvm::SmallVectorImpl<clang::ast_matchers::internal::Matcher<clang::ObjCAtCatchStmt> *>::resizeImpl'
4.    /usr/src/contrib/llvm-project/llvm/include/llvm/ADT/SmallVector.h:604:27: LLVM IR generation of compound statement ('{}')
 #0 0x0000000004c95081 (/usr/bin/c+++0x4c95081)
 #1 0x0000000004c93435 (/usr/bin/c+++0x4c93435)
 #2 0x0000000004c3c953 (/usr/bin/c+++0x4c3c953)
 #3 0x000000082a6fdc8e (/lib/libthr.so.3+0x19c8e)
 #4 0x000000082a6fd249 (/lib/libthr.so.3+0x19249)
 #5 0x00007fffffffe923 ([vdso]+0x2d3)
 #6 0x00000000024c0e0c (/usr/bin/c+++0x24c0e0c)
 #7 0x0000000002a0d6f4 (/usr/bin/c+++0x2a0d6f4)
 #8 0x000000000283866e (/usr/bin/c+++0x283866e)
 #9 0x00000000028e0722 (/usr/bin/c+++0x28e0722)
#10 0x00000000028d2e3b (/usr/bin/c+++0x28d2e3b)
#11 0x000000000281ce43 (/usr/bin/c+++0x281ce43)
#12 0x000000000281cce9 (/usr/bin/c+++0x281cce9)
#13 0x0000000002850882 (/usr/bin/c+++0x2850882)
#14 0x0000000002851311 (/usr/bin/c+++0x2851311)
#15 0x00000000028507a4 (/usr/bin/c+++0x28507a4)
#16 0x0000000002851d91 (/usr/bin/c+++0x2851d91)
#17 0x000000000285c56c (/usr/bin/c+++0x285c56c)
#18 0x00000000028431f5 (/usr/bin/c+++0x28431f5)
#19 0x0000000002843cfa (/usr/bin/c+++0x2843cfa)
#20 0x00000000023f22d0 (/usr/bin/c+++0x23f22d0)
#21 0x00000000023ebaa0 (/usr/bin/c+++0x23ebaa0)
#22 0x00000000023df3d1 (/usr/bin/c+++0x23df3d1)
#23 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#24 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#25 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#26 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#27 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#28 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#29 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#30 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#31 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#32 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#33 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#34 0x00000000023df3ed (/usr/bin/c+++0x23df3ed)
#35 0x00000000023dd52b (/usr/bin/c+++0x23dd52b)
#36 0x0000000002e3c2f4 (/usr/bin/c+++0x2e3c2f4)
#37 0x0000000002e39996 (/usr/bin/c+++0x2e39996)
#38 0x000000000330dd9a (/usr/bin/c+++0x330dd9a)
#39 0x0000000002d7e436 (/usr/bin/c+++0x2d7e436)
#40 0x0000000002d0a526 (/usr/bin/c+++0x2d0a526)
#41 0x0000000002e2bfbc (/usr/bin/c+++0x2e2bfbc)
#42 0x000000000238e219 (/usr/bin/c+++0x238e219)
#43 0x000000000239b397 (/usr/bin/c+++0x239b397)
#44 0x0000000002bc8107 (/usr/bin/c+++0x2bc8107)
#45 0x0000000004c3c6eb (/usr/bin/c+++0x4c3c6eb)
#46 0x0000000002bc7e1b (/usr/bin/c+++0x2bc7e1b)
#47 0x0000000002b93931 (/usr/bin/c+++0x2b93931)
#48 0x0000000002b93b9c (/usr/bin/c+++0x2b93b9c)
#49 0x0000000002baa3bf (/usr/bin/c+++0x2baa3bf)
c++: error: clang frontend command failed with exit code 138 (use -v to see invocation)
FreeBSD clang version 15.0.7 (https://github.com/llvm/llvm-project.git llvmorg-15.0.7-0-g8dfdcc7b7bf6)
Target: x86_64-unknown-freebsd13.2
Thread model: posix
InstalledDir: /usr/bin
c++: note: diagnostic msg:
********************

PLEASE ATTACH THE FOLLOWING FILES TO THE BUG REPORT:
Preprocessed source(s) and associated run script(s) are located at:
c++: note: diagnostic msg: /tmp/Registry-1b1c33.cpp
c++: note: diagnostic msg: /tmp/Registry-1b1c33.sh
c++: note: diagnostic msg:

********************
*** [ASTMatchers/Dynamic/Registry.o] Error code 1

make[6]: stopped in /usr/src/lib/clang/libclang
2 errors

make[6]: stopped in /usr/src/lib/clang/libclang

make[5]: stopped in /usr/src/lib/clang

make[4]: stopped in /usr/src/lib

make[3]: stopped in /usr/src

make[2]: stopped in /usr/src

make[1]: stopped in /usr/src

make: stopped in /usr/src
 
Back
Top