poudriere: whilst building, at ttvy1, a login prompt

Spun off from <https://old.reddit.com/r/freebsd/comments/1bfhu6w/-/kv5c5rf/?context=2>

The run was on an old computer, a MacBookPro8,3, with 8 G memory and 32 G swap.

At some point during the build, at ttyv1 (without a GUI), there was unexpected appearance of a login prompt, after which I could switch to ttyv0 but not back to ttyv1. No response to keyboard input, or a simple press on the power button, so I pressed and held to force off the computer.

If I can reproduce the issue, I'll take a photograph. In the meantime, maybe most relevant:
  • FreeBSD 13.3-RELEASE
  • ZFS.
Afterthought: I allowed ZFS for /tmp … now changed to tmpfs(5).
 
No clue in /var/log/messages:

Code:
…
Mar 16 09:39:28 mac login[1558]: ROOT LOGIN (root) ON ttyv1
Mar 16 14:55:57 mac syslogd: kernel boot file is /boot/kernel/kernel
Mar 16 14:55:57 mac kernel: ---<<BOOT>>---
…

(The BOOT at 14:55 was after I forced off the power.)

Log files from the run, sorted chronologically:

Code:
…
drwxr-xr-x  2 0  0     2B Mar 16 11:31 errors
-rw-r--r--  1 0  0   5.2K Mar 16 11:35 minixmlto-0.1.0.log
-rw-r--r--  1 0  0   6.1K Mar 16 11:35 py39-recommonmark-0.5.0_2.log
-rw-r--r--  1 0  0   5.9K Mar 16 11:35 py39-sphinx-5.3.0_1,1.log
-rw-r--r--  1 0  0   6.4K Mar 16 11:35 rust-1.76.0.log
-rw-r--r--  1 0  0   5.3K Mar 16 11:35 rust-cbindgen-0.26.0_4.log
-rw-r--r--  3 0  0    24K Mar 16 11:35 desktop-file-utils-0.26_2.log
-rw-r--r--  3 0  0   547K Mar 16 11:36 pango-1.50.14.log
-rw-r--r--  3 0  0    50K Mar 16 11:37 adwaita-icon-theme-42.0.log
-rw-r--r--  3 0  0   463K Mar 16 11:44 librsvg2-rust-2.56.4_5.log
-rw-r--r--  3 0  0   2.1M Mar 16 11:52 gtk3-3.24.41.log
-rw-r--r--  1 0  0   9.1M Mar 16 13:10 firefox-124.0,2.log

Tail of firefox-124.0,2.log:

Code:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders/mozilla/dom/PContentParent.h:34:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/RemoteDecoderManagerChild.h:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/GPUVideoImage.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/GPUVideoTextureClient.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/TextureClient.h:24:
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:55:3: warning: mutex 'mMutex' is still held at the end of function [-Wthread-safety-analysis]
  }
  ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:53:26: note: mutex acquired here
    DebugOnly<int> err = pthread_mutex_lock(&mMutex);
                         ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:58:26: warning: releasing mutex 'mMutex' that was not held [-Wthread-safety-analysis]
    DebugOnly<int> err = pthread_mutex_unlock(&mMutex);
                         ^
In file included from Unified_cpp_dom_serviceworkers2.cpp:11:
In file included from /wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/serviceworkers/ServiceWorkerRegistrationProxy.cpp:11:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/ipc/BackgroundParent.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/dom/ContentParent.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders/mozilla/dom/PContentParent.h:34:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/RemoteDecoderManagerChild.h:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/GPUVideoImage.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/GPUVideoTextureClient.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/TextureClient.h:24:
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:55:3: warning: mutex 'mMutex' is still held at the end of function [-Wthread-safety-analysis]
  }
  ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:53:26: note: mutex acquired here
    DebugOnly<int> err = pthread_mutex_lock(&mMutex);
                         ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:58:26: warning: releasing mutex 'mMutex' that was not held [-Wthread-safety-analysis]
    DebugOnly<int> err = pthread_mutex_unlock(&mMutex);
                         ^
In file included from Unified_cpp_dom_serviceworkers3.cpp:20:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/PServiceWorker.cpp:7:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders/mozilla/ipc/PBackgroundParent.h:24:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/RemoteDecoderManagerChild.h:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/GPUVideoImage.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/GPUVideoTextureClient.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/TextureClient.h:24:
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:55:3: warning: mutex 'mMutex' is still held at the end of function [-Wthread-safety-analysis]
  }
  ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:53:26: note: mutex acquired here
    DebugOnly<int> err = pthread_mutex_lock(&mMutex);
                         ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:58:26: warning: releasing mutex 'mMutex' that was not held [-Wthread-safety-analysis]
    DebugOnly<int> err = pthread_mutex_unlock(&mMutex);
                         ^
gmake[3]: Leaving directory '/wrkdirs/usr/ports/www/firefox/work/.build/dom/serializers'
gmake[3]: Entering directory '/wrkdirs/usr/ports/www/firefox/work/.build/dom/simpledb'
mkdir -p '.deps/'
dom/simpledb/Unified_cpp_dom_simpledb0.o
/usr/local/bin/clang++15 -std=gnu++17 -o Unified_cpp_dom_simpledb0.o -c  -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/stl_wrappers -fvisibility=hidden -fvisibility-inlines-hidden -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fstack-protector-strong -fstack-clash-protection -DNDEBUG=1 -DTRIMMED=1 -DMOZ_HAS_MOZGLUE -DMOZILLA_INTERNAL_API -DIMPL_LIBXUL -DSTATIC_EXPORTABLE_JS_API -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/simpledb -I/wrkdirs/usr/ports/www/firefox/work/.build/dom/simpledb -I/wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/ipc/chromium/src -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include -I/usr/local/include/nspr -I/usr/local/include -I/usr/local/include/nss -I/usr/local/include/nspr -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/nss -I/usr/local/include -I/usr/local/include/libpng16 -I/usr/local/include/pixman-1 -I/usr/local/include -DMOZILLA_CLIENT -include /wrkdirs/usr/ports/www/firefox/work/.build/mozilla-config.h -DLIBICONV_PLUG -isystem /usr/local/include -fno-sized-deallocation -fno-aligned-new -O2 -pipe -O3 -DLIBICONV_PLUG -fstack-protector-strong -isystem /usr/local/include -fno-strict-aliasing -DLIBICONV_PLUG -isystem /usr/local/include -fno-exceptions -fPIC -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -O2 -O3 -fno-omit-frame-pointer -funwind-tables -Wall -Wbitfield-enum-conversion -Wdeprecated-this-capture -Wempty-body -Wformat-type-confusion -Wignored-qualifiers -Wpointer-arith -Wshadow-field-in-constructor-modified -Wsign-compare -Wtautological-constant-in-range-compare -Wtype-limits -Wno-error=tautological-type-limit-compare -Wunreachable-code -Wunreachable-code-return -Wunused-but-set-parameter -Wno-invalid-offsetof -Wclass-varargs -Wempty-init-stmt -Wfloat-overflow-conversion -Wfloat-zero-conversion -Wloop-analysis -Wno-range-loop-analysis -Wc++2a-compat -Wenum-compare-conditional -Wenum-float-conversion -Wno-error=deprecated -Wno-error=deprecated-anon-enum-enum-conversion -Wno-error=deprecated-enum-enum-conversion -Wno-error=deprecated-pragma -Wno-error=deprecated-this-capture -Wcomma -Wimplicit-fallthrough -Wstring-conversion -Wno-inline-new-delete -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wno-error=atomic-alignment -Wno-error=deprecated-builtins -Wformat -Wformat-security -Wno-psabi -Wthread-safety -Wno-error=builtin-macro-redefined -Wno-unknown-warning-option -fno-strict-aliasing -ffp-contract=off  -MD -MP -MF .deps/Unified_cpp_dom_simpledb0.o.pp   Unified_cpp_dom_simpledb0.cpp
2 warnings generated.
gmake[3]: Entering directory '/wrkdirs/usr/ports/www/firefox/work/.build/dom/smil'
mkdir -p '.deps/'
dom/smil/Unified_cpp_dom_smil0.o
/usr/local/bin/clang++15 -std=gnu++17 -o Unified_cpp_dom_smil0.o -c  -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/stl_wrappers -fvisibility=hidden -fvisibility-inlines-hidden -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fstack-protector-strong -fstack-clash-protection -DNDEBUG=1 -DTRIMMED=1 -DMOZ_HAS_MOZGLUE -DMOZILLA_INTERNAL_API -DIMPL_LIBXUL -DSTATIC_EXPORTABLE_JS_API -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/smil -I/wrkdirs/usr/ports/www/firefox/work/.build/dom/smil -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/base -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/svg -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/layout/base -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/layout/style -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include -I/usr/local/include/nspr -I/usr/local/include -I/usr/local/include/nss -I/usr/local/include/nspr -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/nss -I/usr/local/include -I/usr/local/include/libpng16 -I/usr/local/include/pixman-1 -I/usr/local/include -DMOZILLA_CLIENT -include /wrkdirs/usr/ports/www/firefox/work/.build/mozilla-config.h -DLIBICONV_PLUG -isystem /usr/local/include -fno-sized-deallocation -fno-aligned-new -O2 -pipe -O3 -DLIBICONV_PLUG -fstack-protector-strong -isystem /usr/local/include -fno-strict-aliasing -DLIBICONV_PLUG -isystem /usr/local/include -fno-exceptions -fPIC -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -O2 -O3 -fno-omit-frame-pointer -funwind-tables -Wall -Wbitfield-enum-conversion -Wdeprecated-this-capture -Wempty-body -Wformat-type-confusion -Wignored-qualifiers -Wpointer-arith -Wshadow-field-in-constructor-modified -Wsign-compare -Wtautological-constant-in-range-compare -Wtype-limits -Wno-error=tautological-type-limit-compare -Wunreachable-code -Wunreachable-code-return -Wunused-but-set-parameter -Wno-invalid-offsetof -Wclass-varargs -Wempty-init-stmt -Wfloat-overflow-conversion -Wfloat-zero-conversion -Wloop-analysis -Wno-range-loop-analysis -Wc++2a-compat -Wenum-compare-conditional -Wenum-float-conversion -Wno-error=deprecated -Wno-error=deprecated-anon-enum-enum-conversion -Wno-error=deprecated-enum-enum-conversion -Wno-error=deprecated-pragma -Wno-error=deprecated-this-capture -Wcomma -Wimplicit-fallthrough -Wstring-conversion -Wno-inline-new-delete -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wno-error=atomic-alignment -Wno-error=deprecated-builtins -Wformat -Wformat-security -Wno-psabi -Wthread-safety -Wno-error=builtin-macro-redefined -Wno-unknown-warning-option -fno-strict-aliasing -ffp-contract=off  -MD -MP -MF .deps/Unified_cpp_dom_smil0.o.pp   Unified_cpp_dom_smil0.cpp
dom/smil/Unified_cpp_dom_smil1.o
2 warnings generated.
gmake[3]: Entering directory '/wrkdirs/usr/ports/www/firefox/work/.build/dom/storage'
mkdir -p '.deps/'
dom/storage/Unified_cpp_dom_storage0.o
/usr/local/bin/clang++15 -std=gnu++17 -o Unified_cpp_dom_storage0.o -c  -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/stl_wrappers -fvisibility=hidden -fvisibility-inlines-hidden -U_FORTIFY_SOURCE -D_FORTIFY_SOURCE=2 -fstack-protector-strong -fstack-clash-protection -DNDEBUG=1 -DTRIMMED=1 -DMOZ_HAS_MOZGLUE -DMOZILLA_INTERNAL_API -DIMPL_LIBXUL -DSTATIC_EXPORTABLE_JS_API -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/storage -I/wrkdirs/usr/ports/www/firefox/work/.build/dom/storage -I/wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/ipc/chromium/src -I/wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/base -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include -I/usr/local/include/nspr -I/usr/local/include -I/usr/local/include/nss -I/usr/local/include/nspr -I/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/nss -I/usr/local/include -I/usr/local/include/libpng16 -I/usr/local/include/pixman-1 -I/usr/local/include -DMOZILLA_CLIENT -include /wrkdirs/usr/ports/www/firefox/work/.build/mozilla-config.h -DLIBICONV_PLUG -isystem /usr/local/include -fno-sized-deallocation -fno-aligned-new -O2 -pipe -O3 -DLIBICONV_PLUG -fstack-protector-strong -isystem /usr/local/include -fno-strict-aliasing -DLIBICONV_PLUG -isystem /usr/local/include -fno-exceptions -fPIC -fno-rtti -ffunction-sections -fdata-sections -fno-exceptions -fno-math-errno -O2 -O3 -fno-omit-frame-pointer -funwind-tables -Wall -Wbitfield-enum-conversion -Wdeprecated-this-capture -Wempty-body -Wformat-type-confusion -Wignored-qualifiers -Wpointer-arith -Wshadow-field-in-constructor-modified -Wsign-compare -Wtautological-constant-in-range-compare -Wtype-limits -Wno-error=tautological-type-limit-compare -Wunreachable-code -Wunreachable-code-return -Wunused-but-set-parameter -Wno-invalid-offsetof -Wclass-varargs -Wempty-init-stmt -Wfloat-overflow-conversion -Wfloat-zero-conversion -Wloop-analysis -Wno-range-loop-analysis -Wc++2a-compat -Wenum-compare-conditional -Wenum-float-conversion -Wno-error=deprecated -Wno-error=deprecated-anon-enum-enum-conversion -Wno-error=deprecated-enum-enum-conversion -Wno-error=deprecated-pragma -Wno-error=deprecated-this-capture -Wcomma -Wimplicit-fallthrough -Wstring-conversion -Wno-inline-new-delete -Wno-error=deprecated-declarations -Wno-error=array-bounds -Wno-error=free-nonheap-object -Wno-error=atomic-alignment -Wno-error=deprecated-builtins -Wformat -Wformat-security -Wno-psabi -Wthread-safety -Wno-error=builtin-macro-redefined -Wno-unknown-warning-option -fno-strict-aliasing -ffp-contract=off  -MD -MP -MF .deps/Unified_cpp_dom_storage0.o.pp   Unified_cpp_dom_storage0.cpp
dom/storage/Unified_cpp_dom_storage1.o
In file included from Unified_cpp_dom_storage0.cpp:2:
In file included from /wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/storage/BackgroundSessionStorageServiceParent.cpp:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/dom/SessionStorageManager.h:18:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders/mozilla/ipc/PBackgroundChild.h:22:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/RemoteDecoderManagerChild.h:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/GPUVideoImage.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/GPUVideoTextureClient.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/TextureClient.h:24:
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:55:3: warning: mutex 'mMutex' is still held at the end of function [-Wthread-safety-analysis]
  }
  ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:53:26: note: mutex acquired here
    DebugOnly<int> err = pthread_mutex_lock(&mMutex);
                         ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:58:26: warning: releasing mutex 'mMutex' that was not held [-Wthread-safety-analysis]
    DebugOnly<int> err = pthread_mutex_unlock(&mMutex);
                         ^
In file included from Unified_cpp_dom_simpledb0.cpp:11:
In file included from /wrkdirs/usr/ports/www/firefox/work/firefox-124.0/dom/simpledb/ActorsParent.cpp:45:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/ipc/BackgroundParent.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/dom/ContentParent.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/ipc/ipdl/_ipdlheaders/mozilla/dom/PContentParent.h:34:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/RemoteDecoderManagerChild.h:9:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/GPUVideoImage.h:12:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/GPUVideoTextureClient.h:10:
In file included from /wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/layers/TextureClient.h:24:
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:55:3: warning: mutex 'mMutex' is still held at the end of function [-Wthread-safety-analysis]
  }
  ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:53:26: note: mutex acquired here
    DebugOnly<int> err = pthread_mutex_lock(&mMutex);
                         ^
/wrkdirs/usr/ports/www/firefox/work/.build/dist/include/mozilla/gfx/CriticalSection.h:58:26: warning: releasing mutex 'mMutex' that was not held [-Wthread-safety-analysis]
    DebugOnly<int> err = pthread_mutex_unlock(&mMutex);
                         ^
 
I doubt if memory was exhausted.
Are you able to keep track of memory and swap usage?

weak point: there is no log of processes killed for out of swap space, etc.
 
Currently:
  • tmpfs for /tmp
  • poudriere building www/firefox at ttyv1
  • htop at ttyv2 … so far, nothing alarming (4.59 of 32.0 G swap used).
 
With only 8G ram, building firefox, it is very likely the system gets to a point where it needs to optimize kernel memory usage. (This happens before swapspace is actually used.)
As we already know, this may trigger an issue in 13.3 leading to strange behaviour, stalls and failures.
So I would assume some likelyhood this might be related to the party around PR 275594 etc.etc.
 
tmpfs for /tmp (first attempt): build succeeded.

ZFS for /tmp (second attempt): build succeeded.

Tails of the two logs:

Code:
build of www/firefox | firefox-124.0,2 ended at Sat Mar 16 17:56:15 GMT 2024
build time: 01:53:01

Code:
build of www/firefox | firefox-124.0,2 ended at Sat Mar 16 22:56:14 GMT 2024
build time: 02:03:41
 
Back
Top