Date: Fri, 21 Nov 2025 11:34:21 -0800 From: Mark Millard <marklmi@yahoo.com> To: Konstantin Belousov <kib@freebsd.org>, Michal Meloun <mmel@freebsd.org>, Warner Losh <imp@bsdimp.com>, freebsd-arm@freebsd.org, freebsd-current@freebsd.org Cc: bob prohaska <fbsd@www.zefox.net>, Adrian Chadd <adrian@freebsd.org>, Carl Shapiro <cshapiro@panix.com>, Ronald Klop <ronald@freebsd.org> Subject: Re: Still seeing Failed assertion: "p[i] == 0" [ *** i386 chroot on amd64 can get the failure on main 16 too *** ] [failed without new kernel check detection] Message-ID: <FA55C060-54AF-4C96-907A-8DB458CD5980@yahoo.com> In-Reply-To: <0542BED0-5446-402C-8924-5EA745B8E51C@yahoo.com> References: <aOvTG-20QRJtJJwf@int21h> <aRXuLTN4hkGykHIl@www.zefox.net> <877bvthymv.fsf@panix.com> <aRdJ5xYeKEmhuIgh@www.zefox.net> <ouy1pm0nued.fsf@panix3.panix.com> <aRtBYaaa0n3_lwar@www.zefox.net> <CAJ-Vmo=TbT7nD7rBrNnq3cutwMp9f7WXtQ-k9mUBne5ht4zGWg@mail.gmail.com> <13E753F4-84F8-4ADB-96B6-908897D6971C@yahoo.com> <3174F751-9853-4697-B0C0-98B54518A69F@yahoo.com> <E634EF40-545C-44D7-9050-83D18090F6EB@yahoo.com> <BA9E6753-F895-46C8-95F3-C3C8B1692033@yahoo.com> <A27FE12B-0074-4403-81F7-8A224CC96CC8@yahoo.com> <D17E06B0-4591-45F2-8C46-70D94E371941@yahoo.com> <463AC500-C7C7-43FB-B5EF-332CEBA3D944@yahoo.com> <F9590F2F-0CB0-4AA9-870E-A97D45C1EC01@yahoo.com> <3E0D6079-0F5B-463E-94D4-37506A837D33@yahoo.com> <05479AC8-C8EB-42A3-9A54-2CAF687023D2@yahoo.com> <422A55DB-E005-4DA5-89F3-52879F35F6A4@yahoo.com> <F1F45DCF-609B-4C15-A799-5BE757F43EB2@yahoo.com> <87fra9fd4m.fsf@panix.com> <CB53A94B-8C78-4BCC-AD99-66DE833C749D@yahoo.com> <878qg1f8wz.fsf@panix.com> <265F191D-5400-4A9D-BE99-F060770B5DED@yahoo.com> <32C6B8A3-E390-48C8-8454-753511ADDF57@yahoo.com> <CD888A78-8BE4-4C0E-B767-B57DD212166C@yahoo.com> <5A0EABFD-A84F-444E-B41A-BC2F9584FF99@yahoo.com> <0542BED0-5446-402C-8924-5EA745B8E51C@yahoo.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Nov 21, 2025, at 10:29, Mark Millard <marklmi@yahoo.com> wrote:
> I patched the vintage of /usr/src/ on amd64 that is for
> the pkgbase vintage that I've been using on the test
> machines.
>
> # sysctl debug.vm_check_pg_zero=1
> debug.vm_check_pg_zero: 0 -> 1
>
> # env WITH_META_MODE= make -j10 buildworld
> --- buildworld ---
> . . .
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGBuiltin.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/PatternInit.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/SanitizerMetadata.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/SwiftCallingConv.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/TargetInfo.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/AArch64.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/AMDGPU.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/ARC.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/ARM.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/AVR.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/BPF.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/CSKY.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/Hexagon.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/Lanai.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/LoongArch.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/M68k.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/MSP430.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/Mips.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/NVPTX.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/PNaCl.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/PPC.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/RISCV.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/SPIR.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/Sparc.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/SystemZ.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/TCE.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/VE.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/WebAssembly.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/X86.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/Targets/XCore.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/VarBypassDetector.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CrossTU/CrossTranslationUnit.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Action.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Compilation.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Distro.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Driver.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/DriverOptions.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Job.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Multilib.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/MultilibBuilder.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/OptionUtils.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Phases.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/SanitizerArgs.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/Tool.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChain.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/AIX.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/AMDGPU.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/AMDGPUOpenMP.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/AVR.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/AArch64.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/ARM.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/CSKY.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/LoongArch.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/M68k.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/Mips.pico
> <jemalloc>: /usr/src/contrib/jemalloc/include/jemalloc/internal/ehooks.h:170: Failed assertion: "p[i] == 0"
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/PPC.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/RISCV.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/Driver/ToolChains/Arch/Sparc.pico
> Abort trap (core dumped)
> *** [CodeGen/CGBuiltin.pico] Error code 134
>
>
>
> I had also previously tested without enabling debug.vm_check_pg_zero
> just to check if failures were still happening. It turns out that
> for my current context that failed building the same .pico file:
>
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGBuiltin.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGHLSLRuntime.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGLoopInfo.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGNonTrivialStruct.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGObjC.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGObjCGNU.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGObjCMac.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGObjCRuntime.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGOpenCLRuntime.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGOpenMPRuntime.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGOpenMPRuntimeGPU.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGPointerAuth.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGRecordLayoutBuilder.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGStmt.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGStmtOpenMP.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGVTT.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CGVTables.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenAction.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenFunction.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenModule.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenPGO.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenTBAA.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CodeGenTypes.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/ConstantInitBuilder.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/CoverageMappingGen.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/ItaniumCXXABI.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/LinkInModulesPass.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/MacroPPCallbacks.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/MicrosoftCXXABI.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/ModuleBuilder.pico
> Building /usr/obj/usr/src/i386.i386/lib/clang/libclang/CodeGen/ObjectFilePCHContainerOperations.pico
> <jemalloc>: /usr/src/contrib/jemalloc/include/jemalloc/internal/ehooks.h:170: Failed assertion: "p[i] == 0"
> Abort trap (core dumped)
> *** [CodeGen/CGBuiltin.pico] Error code 134
>
>
It turns out that frames #0..#31 have bt text that match.
So just in case that much of a sometimes common context
might help in some way:
(lldb) bt
* thread #1, name = 'c++', stop reason = signal SIGABRT
* frame #0: 0x24bd378b libsys.so.7`__sys_thr_kill at thr_kill.S:4
frame #1: 0x2ab2231b libc.so.7`__raise(s=6) at raise.c:48:10
frame #2: 0x2abcc73b libc.so.7`abort at abort.c:61:8
frame #3: 0x2ac10440 libc.so.7`ehooks_debug_zero_check(addr=<unavailable>, size=<unavailable>) at ehooks.h:0
frame #4: 0x2ac0ccfa libc.so.7`__je_extent_alloc_wrapper [inlined] ehooks_alloc(tsdn=<unavailable>, ehooks=<unavailable>, new_addr=<unavailable>, size=<unavailable>, alignment=<unavailable>, zero=0xffff9977, commit=<unavailable>) at ehooks.h:208:3
frame #5: 0x2ac0cc5a libc.so.7`__je_extent_alloc_wrapper(tsdn=0x2adf90a0, pac=0x2b0015e4, ehooks=0x2b000080, new_addr=0x00000000, size=28672, alignment=4096, zero=true, commit=0xffff99df, growing_retained=<unavailable>) at jemalloc_extent.c:1003:15
frame #6: 0x2ac0c58e libc.so.7`__je_ecache_alloc_grow(tsdn=0x2adf90a0, pac=0x2b0015e4, ehooks=0x2b000080, ecache=0x2b0036d0, expand_edata=0x00000000, size=28672, alignment=4096, zero=<unavailable>, guarded=<unavailable>) at jemalloc_extent.c:126:11
frame #7: 0x2ac3c73f libc.so.7`pac_alloc_impl [inlined] pac_alloc_real(tsdn=<unavailable>, pac=<unavailable>, ehooks=<unavailable>, size=<unavailable>, alignment=4096, zero=<unavailable>, guarded=<unavailable>) at jemalloc_pac.c:124:11
frame #8: 0x2ac3c696 libc.so.7`pac_alloc_impl(tsdn=0x2adf90a0, self=0x2b0015e4, size=28672, alignment=4096, zero=<unavailable>, guarded=<unavailable>, frequent_reuse=<unavailable>, deferred_work_generated=<unavailable>) at jemalloc_pac.c:178:11
frame #9: 0x2ac3afe0 libc.so.7`__je_pa_alloc [inlined] pai_alloc(tsdn=<unavailable>, self=<unavailable>, size=<unavailable>, alignment=<unavailable>, zero=<unavailable>, guarded=<unavailable>, frequent_reuse=<unavailable>, deferred_work_generated=<unavailable>) at pai.h:43:9
frame #10: 0x2ac3afc9 libc.so.7`__je_pa_alloc(tsdn=0x2adf90a0, shard=0x2b0015d8, size=28672, alignment=4096, slab=<unavailable>, szind=19, zero=<unavailable>, guarded=<unavailable>, deferred_work_generated=0xffff9ac3) at jemalloc_pa.c:139:11
frame #11: 0x2abec82b libc.so.7`arena_slab_alloc(tsdn=<unavailable>, arena=<unavailable>, binind=19, binshard=0, bin_info=0x2ac71538) at jemalloc_arena.c:839:18
frame #12: 0x2abebdaa libc.so.7`__je_arena_cache_bin_fill_small(tsdn=0x2adf90a0, arena=0x2b000500, cache_bin=0x2adf9470, cache_bin_info=0x2b0004a6, binind=19, nfill=32) at jemalloc_arena.c:1034:16
frame #13: 0x2ac2b737 libc.so.7`__je_tcache_alloc_small_hard(tsdn=0x2adf90a0, arena=0x2b000500, tcache=0x2adf92f0, cache_bin=0x2adf9470, binind=19, tcache_success=0xffff9b87) at jemalloc_tcache.c:238:2
frame #14: 0x2abe1d81 libc.so.7`iallocztm [inlined] tcache_alloc_small(tsd=<unavailable>, arena=0x2b000500, tcache=<unavailable>, size=<unavailable>, binind=<unavailable>, zero=<unavailable>, slow_path=<unavailable>) at tcache_inlines.h:68:9
frame #15: 0x2abe1cd7 libc.so.7`iallocztm [inlined] arena_malloc(tsdn=<unavailable>, arena=<unavailable>, size=<unavailable>, ind=<unavailable>, zero=<unavailable>, tcache=<unavailable>, slow_path=<unavailable>) at arena_inlines_b.h:151:11
frame #16: 0x2abe1c52 libc.so.7`iallocztm(tsdn=<unavailable>, size=<unavailable>, ind=19, zero=<unavailable>, tcache=0x2adf92f0, is_internal=<unavailable>, arena=0x00000000, slow_path=<unavailable>) at jemalloc_internal_inlines_c.h:55:8
frame #17: 0x2abe7179 libc.so.7`imalloc_body [inlined] imalloc_no_sample(sopts=0xffff9c3c, dopts=0xffff9c1c, tsd=0x2adf90a0, size=864, usize=896, ind=19) at jemalloc_jemalloc.c:2402:9
frame #18: 0x2abe7106 libc.so.7`imalloc_body(sopts=<unavailable>, dopts=<unavailable>, tsd=0x2adf90a0) at jemalloc_jemalloc.c:2577:16
frame #19: 0x2abdae88 libc.so.7`imalloc(sopts=<unavailable>, dopts=<unavailable>) at tsd.h:0:2
frame #20: 0x2abdaddc libc.so.7`__je_malloc_default(size=864) at jemalloc_jemalloc.c:2726:2
frame #21: 0x2abdb27f libc.so.7`__malloc [inlined] imalloc_fastpath(size=864, fallback_alloc=<unavailable>) at jemalloc_internal_inlines_c.h:0:2
frame #22: 0x2abdb149 libc.so.7`__malloc(size=864) at jemalloc_jemalloc.c:2750:9
frame #23: 0x28aa2cce libprivatellvm.so.19`::grow_pod() [inlined] safe_malloc at MemAlloc.h:26:18
frame #24: 0x28aa2cc8 libprivatellvm.so.19`::grow_pod() at SmallVector.cpp:143:15
frame #25: 0x22004f24 libprivateclang.so.19`::resize() [inlined] grow_pod at SmallVector.h:152:11
frame #26: 0x22004f14 libprivateclang.so.19`::resize() [inlined] grow at SmallVector.h:539:41
frame #27: 0x22004f14 libprivateclang.so.19`::resize() [inlined] reserveForParamAndGetAddressImpl<llvm::SmallVectorTemplateBase<unsigned int, true> > at SmallVector.h:257:11
frame #28: 0x22004f14 libprivateclang.so.19`::resize() [inlined] reserveForParamAndGetAddress at SmallVector.h:551:9
frame #29: 0x22004f14 libprivateclang.so.19`::resize() [inlined] append at SmallVector.h:707:29
frame #30: 0x22004f14 libprivateclang.so.19`::resize() at SmallVector.h:674:11
frame #31: 0x22004de0 libprivateclang.so.19`::resize() at BitVector.h:344:10
. . .
===
Mark Millard
marklmi at yahoo.com
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?FA55C060-54AF-4C96-907A-8DB458CD5980>