From nobody Sat Aug 9 08:58:34 2025 X-Original-To: freebsd-pkgbase@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4bzZZY289Wz63nfp; Sat, 09 Aug 2025 08:59:01 +0000 (UTC) (envelope-from freebsd@gushi.org) Received: from prime.gushi.org (prime.gushi.org [IPv6:2620:137:6000:10::142]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (secp384r1) client-digest SHA384) (Client CN "prime.gushi.org", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4bzZZX5whSz4B7D; Sat, 09 Aug 2025 08:59:00 +0000 (UTC) (envelope-from freebsd@gushi.org) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple ([IPv6:2001:500:6b:200:c000:0:0:8]) (authenticated bits=0) by prime.gushi.org (8.18.1/8.18.1) with ESMTPSA id 5798wpxG065840 (version=TLSv1.2 cipher=ECDHE-ECDSA-AES256-GCM-SHA384 bits=256 verify=NOT); Sat, 9 Aug 2025 08:58:52 GMT (envelope-from freebsd@gushi.org) DKIM-Filter: OpenDKIM Filter v2.10.3 prime.gushi.org 5798wpxG065840 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gushi.org; s=prime2014; t=1754729932; bh=N8Je85MjIte6bd2TnljSM6qOHYqBXmsH4yypMEYkxKU=; h=Subject:From:In-Reply-To:Date:Cc:References:To; z=Subject:=20Re:=20HEADS-UP:=20pkgbase=20pkg=20upgrade=20breaks=20s ystems=20Re:=20after=20updating=0D=0A=20to=20latest,=20pkg=20base= 20segfaults=20and=20leaves=20me=20unbootable|From:=20"Dan=20Mahone y=20(Ports)"=20|In-Reply-To:=20<582d802f-da93-4 15c-9dee-1f1f1beb1830@smeets.xyz>|Date:=20Sat,=209=20Aug=202025=20 01:58:34=20-0700|Cc:=20freebsd-pkgbase@freebsd.org,=0D=0A=20freebs d-current@freebsd.org|References:=20=0D=0A=20<582d802f-da93-415c-9dee-1f1f1beb1830@s meets.xyz>|To:=20Florian=20Smeets=20; b=aYOZhldalNn9bIFzUQNwV6wc0HYTKY18emliYdFD68V/GC6KomG3mOgA/42SxWdUW L1lL7QxLA6p6R6Xbb0RpOGX9dKv/XZkEfsdNTsn7bxa5kc/HkQD2kGerXixWZ2bEYE G1tJW6ec0UOIFwDQLsHJjsyarwsnGRhG/W+IO5pEaScO7CoyDd/xRTvNciqVqWKLF4 km3rN9bxfLiTGMgPGAF9cFEK++gfr7tD9Bwc+iI/VixmHJmSFpnyIBgpLhlZP0VABj Rr2EBhuek6c0dmyiADnBo+x+DuEzIDr38/IjQx4tAIOCk2QFh2E5DRrObMxFe1Vi7v v0QtaBv1kTF5w== X-Authentication-Warning: prime.gushi.org: Host [IPv6:2001:500:6b:200:c000:0:0:8] claimed to be smtpclient.apple Content-Type: text/plain; charset=utf-8 List-Id: Packaging the FreeBSD base system List-Archive: https://lists.freebsd.org/archives/freebsd-pkgbase List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-pkgbase@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3863.100.1\)) Subject: Re: HEADS-UP: pkgbase pkg upgrade breaks systems Re: after updating to latest, pkg base segfaults and leaves me unbootable From: "Dan Mahoney (Ports)" In-Reply-To: <582d802f-da93-415c-9dee-1f1f1beb1830@smeets.xyz> Date: Sat, 9 Aug 2025 01:58:34 -0700 Cc: freebsd-pkgbase@freebsd.org, freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <4F4C6FA3-C302-4E23-9236-BA86311FE795@gushi.org> References: <582d802f-da93-415c-9dee-1f1f1beb1830@smeets.xyz> To: Florian Smeets X-Mailer: Apple Mail (2.3863.100.1) X-Rspamd-Queue-Id: 4bzZZX5whSz4B7D X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:393507, ipnet:2620:137:6000::/44, country:US] > On Aug 9, 2025, at 12:55=E2=80=AFAM, Florian Smeets = wrote: >=20 > Adding current@ to CC >=20 > On 09.08.25 01:38, Dan Mahoney wrote: >> =EF=BB=BF >> =EF=BB=BF >> (Resending from phone after realizing my list-specific from: wasn=E2=80= =99t set, apologies for weird formatting) >> Hey all, >> After the recent big sleep in pkgbase, I hit the following trying to = upgrade to whatever snapshot was published today: >> [598/1127] Deleting files for p5-MIME-Base32-1.303: 100% >> [599/1127] Deinstalling p5-MIME-Base64-3.16... >> [599/1127] Deleting files for p5-MIME-Base64-3.16: 100% >> Child process pid=3D21537 terminated abnormally: Segmentation fault >> (oh crap) >> root@poudriere:/home/dmahoney # pkg upgrade >> ELF interpreter /libexec/ld-elf.so.1 not found, error 2 >> Abort >> (double crap) >=20 > Yes, I had the same issue yesterday evening. When the system was back, = I was too tired to summarize and send something to the mailing list. >=20 > FWIW, I revived the system by deleting all newer packages rm = /var/cache/pkg/*snap20250808* and just untaring the stuff in = /var/cache/pkg to / >=20 > cd / ; for i in `/rescue/ls -1 /var/cache/pkg/FreeBSD-* ` ; do = /rescue/tar xvzf $i ; done >=20 > After that, I resorted to building from source and installing to get = the system into a half way consistent state with a chance of surviving a = reboot. >=20 > When starting my upgrade I saw that it wanted to remove a lot of non = pkgbase packages (how are we doing to differentiate pkgbase packages and = "ports" packages in the future?). I thought this might be related to the = krb5 thing, so I created an up to date poudriere jail via pkgbase method = and rebuilt all my pkgs, but even then I saw the same thing as Den, that = pkg wanted to remove a lot of ports pkgs, as this system is not = important I thought I can resolve that after the pkgbase upgrade and = started the upgrade. >=20 > I didn't save scroll back. In my case I saw at the top the first ~100 = pkg transactions were uninstalling pkgbase pkgs, then it upgraded some, = then pkg exited with a segfault. >=20 > Leaving me with ELF interpreter /libexec/ld-elf.so.1 not found, error = 2 >=20 > One thing I checked was /libexec/ was completely empty. >=20 > Florian Florian, I'm sorry you hit this issue as well, but I feel a bit less crazy now. = At least, about this. I'm also glad I was able to capture something you = weren't. Long live "gnu screen" being my primary window manager. I myself had a standby VM from before we converted to pkgbase, so it's a = little old, and we might need to re-create a poudriere jail or two, but = I'm currently building world as well (pkgbase is in time-out, mister!). = Nothing is lost here, but if any devs would like me to run more = commands, or catch more forensics, please let me know. I suspect this = might need to wait for bapt to come back, but I'm not sure. I'm not trying to get into the recent (ahem) lively discussion thread -- = but I am interested in helping solve a problem in any way. Anyone, free = to email me directly, or Paeps has my mobile number and can ping me out = of band. Since I have that other VM, I'm going to leave this VM as-is = other than doing a few ls'es to figure out which jails/ports trees I = need to re-create. Sadly, I don't have a snapshot of just before the = failure to try to reproduce. -Dan=