From nobody Mon Mar 10 07:49:55 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZB8F42x7mz5qVsx for ; Mon, 10 Mar 2025 07:50:00 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZB8F24Dbrz47Nt for ; Mon, 10 Mar 2025 07:49:58 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=unixarea.de header.s=blu3434000 header.b=JezeIGor; dmarc=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=unixarea.de ; s=blu3434000; h=In-Reply-To:Content-Transfer-Encoding:Content-Type: MIME-Version:References:Reply-To:Message-ID:Subject:Cc:To:From:Date:Sender: Content-ID:Content-Description; bh=OgLwm3tQaUQIZQr2doMrCExmxsXisxFyUbLAthTSMog=; b=JezeIGor5tTNHmiGDgSGs3QJOb VDgi5b2iiafFJhzuMpzzsZJJlVsn9uITYwJv3Q6mkxcFIFqodEWhKS2tTEY1ddBMLgVyUInSXW3lI 1UerUIymBUiLjPhBR6dKSSXKkXMPUkQdvXiiPWiNftAaPQTq7pY4xp5P0hqy6MZoeYIP1qw4jc9hD 5OslF5wCz3NaEj20lvFCAmZPxzRUzJtXjnmPowKPe6cdOYLH9y6uFgYv32IYznxgtw40izU35VtW8 wU4rNCc3WmfySjByIpaKWoDPZk3CKbxkcO8ourso+IXLIgYay2a/BwiJFdb3CfrydwPKT6hhhaqdb OeHzEfsA==; Received: from [62.216.210.25] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1trXtb-009kCI-LR; Mon, 10 Mar 2025 08:49:55 +0100 Received: from localhost.my.domain (c720-1400094 [127.0.0.1]) by localhost.unixarea.de (8.17.1/8.14.9) with ESMTP id 52A7ntQf066176; Mon, 10 Mar 2025 08:49:55 +0100 (CET) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.17.1/8.14.9/Submit) id 52A7ntZu066175; Mon, 10 Mar 2025 08:49:55 +0100 (CET) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Mon, 10 Mar 2025 08:49:55 +0100 From: Matthias Apitz To: Robert Clausecker Cc: freebsd-current@freebsd.org Subject: Re: Creating poudriere jail fails with libmd.so.6 not found Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: Robert Clausecker , freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 14.0-CURRENT r1400094 (amd64) X-message-flag: Mails in HTML will not be read! Please, only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 62.216.210.25 X-Spamd-Result: default: False [0.48 / 15.00]; RBL_SENDERSCORE_REPUT_6(1.00)[178.254.4.101:from]; NEURAL_HAM_MEDIUM(-0.76)[-0.757]; MID_RHS_NOT_FQDN(0.50)[]; NEURAL_HAM_SHORT(-0.49)[-0.488]; NEURAL_SPAM_LONG(0.32)[0.324]; RCVD_IN_DNSWL_LOW(-0.10)[178.254.4.101:from]; MIME_GOOD(-0.10)[text/plain]; BAD_REP_POLICIES(0.10)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; R_DKIM_ALLOW(0.00)[unixarea.de:s=blu3434000]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; DMARC_NA(0.00)[unixarea.de]; SUSPICIOUS_AUTH_ORIGIN(0.00)[]; HAS_XAW(0.00)[]; HAS_REPLYTO(0.00)[guru@unixarea.de]; TO_MATCH_ENVRCPT_SOME(0.00)[]; HAS_XOIP(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[unixarea.de:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_ALLOW(0.00)[+ip4:178.254.4.101]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; REPLYTO_EQ_FROM(0.00)[] X-Rspamd-Queue-Id: 4ZB8F24Dbrz47Nt X-Spamd-Bar: / El día lunes, marzo 03, 2025 a las 12:06:41p. m. +0100, Robert Clausecker escribió: > The simplest solution is to clear the object directory and do a fresh world build. > libmd.so.6 was turned into libmd.so.7 as part of a recent API change. It should > also work to link libmd.so.7 to libmd.so.6. > > Yours, > Robert Clausecker I did so and investigated the problem with an installation into DESTDIR. Here are my findings: # make installworld DESTDIR=/home/guru/150.root make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 -------------------------------------------------------------- >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 -------------------------------------------------------------- mkdir -p /tmp/install.H59PpUrQ1d ... Required library libmd.so.7 not found. *** Error code 1 Stop. I investigated the problem (that's why I used DESTDIR to not damage the system to be installed to). The problem is that two tools, 'sort' and 'mtree' require a shared lib libmd.so.7 which is not there in the moment of make installworld: /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort libmd.so.7 => not found (0) libc.so.7 => /lib/libc.so.7 (0xe6e08064000) [vdso] (0xe6e06c75000) /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree libmd.so.7 => not found (0) libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) libc.so.7 => /lib/libc.so.7 (0x106220ca7000) [vdso] (0x10621d82c000) # find /lib /usr/lib -name libmd.so.7 (nothing) This shared libmd.so.7 lib will perhaps be istalled later by the 'make installworld', at least it is in the tree /usr/obj/... # find /usr/obj -name libmd.so.7 /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 a workaround is before 'make installworld' to run:: # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib With this the # make installworld DESTDIR=/home/guru/150.root ... >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 >>> Install world completed in 398 seconds, ncpu: 2 -------------------------------------------------------------- 397,72 real 219,14 user 162,06 sys runs fine. matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Mar 10 10:14:46 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBCSD2Trqz5qgH5 for ; Mon, 10 Mar 2025 10:14:52 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBCSB4F0xz3vLP for ; Mon, 10 Mar 2025 10:14:50 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=unixarea.de header.s=blu3434000 header.b="Bxx/Y34s"; dmarc=none; spf=pass (mx1.freebsd.org: domain of guru@unixarea.de designates 178.254.4.101 as permitted sender) smtp.mailfrom=guru@unixarea.de DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=unixarea.de ; s=blu3434000; h=Content-Transfer-Encoding:Content-Type:MIME-Version: Reply-To:Message-ID:Subject:To:From:Date:Sender:Cc:Content-ID: Content-Description:In-Reply-To:References; bh=+Y7LwmmN7EJbwfB1qpYXob9WqyabG5Kl5jEkNweRJOg=; b=Bxx/Y34sccsUAl0v00Zd+xem5I bKSlq0RaikbD8pchM0sS1HuadPBW+He8HxisKdNpHUDpgRyGPU0uckWNk+lNXNWSofq5L7nf3AsvG GCAIcIe8298l4vj2aqUxvy0E/wRKwZpBvB8//+74PVrPsLBFb7jspDWRwceQUY/RPXzeBvaoBnZ6P C/9ybF3JF7BBYUm7FEDrxKihMajLVEkNNmqz8jbHB6W9oJEneQGrjsdfzYl2f5gfm8grPQhEw+yjr whRXbFnSTzyDQrQo0EPnRCyItsG5lkZuRmfCIlOcH0WegyKr4/uyUeJRp3HSmcGsHM7sV0IX71k9i B0oUvBAQ==; Received: from [212.222.85.178] (helo=pureos) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1tra9o-000Cro-Bo for freebsd-current@freebsd.org; Mon, 10 Mar 2025 11:14:48 +0100 Date: Mon, 10 Mar 2025 11:14:46 +0100 From: Matthias Apitz To: freebsd-current@freebsd.org Subject: make installworld fails due to missing libmd.so.6 or libmd.so.7 Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit X-Operating-System: FreeBSD 14.0-CURRENT 1400094 (amd64) X-message-flag: Mails in HTML will not be read! Send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 212.222.85.178 X-Spamd-Result: default: False [2.52 / 15.00]; RBL_SENDERSCORE_REPUT_6(1.00)[178.254.4.101:from]; NEURAL_SPAM_LONG(1.00)[0.997]; NEURAL_HAM_SHORT(-0.94)[-0.939]; NEURAL_SPAM_MEDIUM(0.86)[0.861]; MID_RHS_NOT_FQDN(0.50)[]; ONCE_RECEIVED(0.20)[]; BAD_REP_POLICIES(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[178.254.4.101:from]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[unixarea.de]; R_DKIM_ALLOW(0.00)[unixarea.de:s=blu3434000]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; SUSPICIOUS_AUTH_ORIGIN(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[unixarea.de:+]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE]; R_SPF_ALLOW(0.00)[+ip4:178.254.4.101]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; HAS_REPLYTO(0.00)[guru@unixarea.de]; MISSING_XM_UA(0.00)[]; HAS_XOIP(0.00)[]; REPLYTO_EQ_FROM(0.00)[] X-Rspamd-Queue-Id: 4ZBCSB4F0xz3vLP X-Spamd-Bar: ++ This problem first came up a the thread: Creating poudriere jail fails with libmd.so.6 not found but it's unrelated to poudriere jails. With a recent CURRENT (March 1) I can reproduce this fine. I investigated it with an installation into DESTDIR to not damage my running system. Here are my findings: # make installworld DESTDIR=/home/guru/150.root make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 -------------------------------------------------------------- >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 -------------------------------------------------------------- mkdir -p /tmp/install.H59PpUrQ1d ... Required library libmd.so.7 not found. *** Error code 1 Stop. I investigated the problem (that's why I used DESTDIR to not damage the system to be installed to). The problem is that two tools, 'sort' and 'mtree' require a shared lib libmd.so.7 which is not there in the moment of make installworld: /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort libmd.so.7 => not found (0) libc.so.7 => /lib/libc.so.7 (0xe6e08064000) [vdso] (0xe6e06c75000) /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree libmd.so.7 => not found (0) libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) libc.so.7 => /lib/libc.so.7 (0x106220ca7000) [vdso] (0x10621d82c000) # find /lib /usr/lib -name libmd.so.7 (nothing) This shared libmd.so.7 lib will perhaps be istalled later by the 'make installworld', at least it is in the tree /usr/obj/... # find /usr/obj -name libmd.so.7 /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 a workaround is before 'make installworld' to run:: # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib With this the # make installworld DESTDIR=/home/guru/150.root ... >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 >>> Install world completed in 398 seconds, ncpu: 2 -------------------------------------------------------------- 397,72 real 219,14 user 162,06 sys runs fine. matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Mar 10 12:14:07 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBG5z5vspz5qnpq for ; Mon, 10 Mar 2025 12:14:15 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (secp384r1) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBG5y26yhz3RgX for ; Mon, 10 Mar 2025 12:14:14 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b=wSjtgxng; dmarc=none; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 94.130.200.20 as permitted sender) smtp.mailfrom=herbert@gojira.at Date: Mon, 10 Mar 2025 13:14:07 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1741608847; bh=pu6eFEkQJqzi3qC5oCguEsgAjod9S2WARTrlFUDdZo8=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=wSjtgxngt+AGZ/bcBGjJTi+dw+IpxnpuV6QLZRoiGVwFYVAZ5uTy+ONuUgcHyjDP1 hjYRcyW8pw1h9ZqpbbkSWJH8pTZn/G24lCqaJR+7Q+68O9Yk2/+S2uvYJUjJ4SfYlx HrF3G445h1xw0aUvut1k3Ubor9av5Gnou4Jtuem6bdl1+2q4B5MWBMDMB2gAWmPMLE qaAK5yWWOP6N8V5xrLP8nIg6TjmZV5dzjYFcAaFhX3b2a3eHypeplVAuCa1OLnYrq0 dzp6cC6LE3p3WgRqmu3imSnn3Mufk1aYwuVFbVRKhcEWeQZn52fVBdpg5qUCt3kcHt pVoG93vDmg+VA== From: "Herbert J. Skuhra" To: freebsd-current@freebsd.org Subject: Re: make installworld fails due to missing libmd.so.6 or libmd.so.7 Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.996]; NEURAL_HAM_SHORT(-0.97)[-0.974]; R_SPF_ALLOW(-0.20)[+ip4:94.130.200.20]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE]; MISSING_XM_UA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; DMARC_NA(0.00)[gojira.at]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gojira.at:+] X-Rspamd-Queue-Id: 4ZBG5y26yhz3RgX X-Spamd-Bar: --- On Mon, Mar 10, 2025 at 11:14:46AM +0100, Matthias Apitz wrote: > This problem first came up a the thread: > > Creating poudriere jail fails with libmd.so.6 not found > > but it's unrelated to poudriere jails. With a recent CURRENT (March 1) > I can reproduce this fine. I investigated it with an installation into > DESTDIR to not damage my running system. > > Here are my findings: > > # make installworld DESTDIR=/home/guru/150.root > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 > -------------------------------------------------------------- > >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 > -------------------------------------------------------------- > mkdir -p /tmp/install.H59PpUrQ1d > ... > Required library libmd.so.7 not found. > *** Error code 1 > > Stop. > > I investigated the problem (that's why I used DESTDIR to not > damage the system to be installed to). > > The problem is that two tools, 'sort' and 'mtree' > require a shared lib libmd.so.7 which is not there in > the moment of make installworld: > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort > libmd.so.7 => not found (0) > libc.so.7 => /lib/libc.so.7 (0xe6e08064000) > [vdso] (0xe6e06c75000) > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree > libmd.so.7 => not found (0) > libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) > libc.so.7 => /lib/libc.so.7 (0x106220ca7000) > [vdso] (0x10621d82c000) > > # find /lib /usr/lib -name libmd.so.7 > (nothing) > > This shared libmd.so.7 lib will perhaps be istalled later by > the 'make installworld', at least it is in the tree /usr/obj/... > > # find /usr/obj -name libmd.so.7 > /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 > /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 > /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 > /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 > > > a workaround is before 'make installworld' to run:: > > # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib > > With this the > > # make installworld DESTDIR=/home/guru/150.root > ... > >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 > >>> Install world completed in 398 seconds, ncpu: 2 > -------------------------------------------------------------- > 397,72 real 219,14 user 162,06 sys > > > runs fine. Did you run buildworld and installworld on different versions (e.g: main vs. stable, or main vs. main pre e7a629c851d7)? This is is the only way I can reproduce this. main built on stable/14: $ ldd /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: libmd.so.6 => /lib/libmd.so.6 (0x311068a44000) libc.so.7 => /lib/libc.so.7 (0x311068df0000) [vdso] (0x3110676f0000) main built on main: $ ldd /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: libmd.so.7 => not found (0) libc.so.7 => /lib/libc.so.7 (0x28eb0e6f000) [vdso] (0x28eafac0000) I think these files (sort, mtree, etc.) are copied from /usr/[s]bin. From nobody Mon Mar 10 12:58:14 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBH4z2Tndz5qqhr for ; Mon, 10 Mar 2025 12:58:27 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBH4z02Htz3npM for ; Mon, 10 Mar 2025 12:58:26 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=unixarea.de ; s=blu3434000; h=In-Reply-To:Content-Transfer-Encoding:Content-Type: MIME-Version:References:Reply-To:Message-ID:Subject:Cc:To:From:Date:Sender: Content-ID:Content-Description; bh=l4N/BvNLFZ+6nYlZx3lLt3gKgC5sEQfIxNoX18tESkM=; b=DTRu/jpJeqqdp/Xn0xZw+537r2 SMJ1jy4AEJC5Hwkel/fnSGJWxxdttH839YyOmZi0i7FVvNYw75569GvbrB57qBo6v9qb1dbHymu0B hLHqBiMVR4sQqwm6hrOUzzYPR7RJQR3VrkI0ijgufWVP941aIZT1xSEdYid36tiVlVZ25Ty1vmxah 8wwEu0iDd8hgWPdDS6NM1IE+tKpYf4onJfw0IeX3gN5dmrnvk26JV371889ZgH/At/DXtAqlllCaB IEi9aL9yMwC8OTj7EfRlX75SfQWiIzU6BnZZ25pVlh2RkdkshbrNtekBrLBp2aZcs64v5J+M2iuPZ KXM0SQNQ==; Received: from [178.254.11.41] (helo=sh4-5.1blu.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1trci9-008GhV-2U; Mon, 10 Mar 2025 13:58:25 +0100 Date: Mon, 10 Mar 2025 13:58:14 +0100 From: Matthias Apitz To: "Herbert J. Skuhra" Cc: freebsd-current@freebsd.org Subject: Re: make installworld fails due to missing libmd.so.6 or libmd.so.7 Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: "Herbert J. Skuhra" , freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 12.0-CURRENT r314251 (amd64) X-message-flag: Mails containing HTML will not be read! Please send only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 178.254.11.41 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4ZBH4z02Htz3npM X-Spamd-Bar: ---- El día Montag, März 10, 2025 a las 01:14:07 +0100, Herbert J. Skuhra escribió: > On Mon, Mar 10, 2025 at 11:14:46AM +0100, Matthias Apitz wrote: > > This problem first came up a the thread: > > > > Creating poudriere jail fails with libmd.so.6 not found > > > > but it's unrelated to poudriere jails. With a recent CURRENT (March 1) > > I can reproduce this fine. I investigated it with an installation into > > DESTDIR to not damage my running system. > > > > Here are my findings: > > > > # make installworld DESTDIR=/home/guru/150.root > > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 > > -------------------------------------------------------------- > > >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 > > -------------------------------------------------------------- > > mkdir -p /tmp/install.H59PpUrQ1d > > ... > > Required library libmd.so.7 not found. > > *** Error code 1 > > > > Stop. > > > > I investigated the problem (that's why I used DESTDIR to not > > damage the system to be installed to). > > > > The problem is that two tools, 'sort' and 'mtree' > > require a shared lib libmd.so.7 which is not there in > > the moment of make installworld: > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort > > libmd.so.7 => not found (0) > > libc.so.7 => /lib/libc.so.7 (0xe6e08064000) > > [vdso] (0xe6e06c75000) > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree > > libmd.so.7 => not found (0) > > libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) > > libc.so.7 => /lib/libc.so.7 (0x106220ca7000) > > [vdso] (0x10621d82c000) > > > > # find /lib /usr/lib -name libmd.so.7 > > (nothing) > > > > This shared libmd.so.7 lib will perhaps be istalled later by > > the 'make installworld', at least it is in the tree /usr/obj/... > > > > # find /usr/obj -name libmd.so.7 > > /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 > > /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 > > /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 > > /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 > > > > > > a workaround is before 'make installworld' to run:: > > > > # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib > > > > With this the > > > > # make installworld DESTDIR=/home/guru/150.root > > ... > > >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 > > >>> Install world completed in 398 seconds, ncpu: 2 > > -------------------------------------------------------------- > > 397,72 real 219,14 user 162,06 sys > > > > > > runs fine. > > Did you run buildworld and installworld on different versions (e.g: main > vs. stable, or main vs. main pre e7a629c851d7)? This is is the only way > I can reproduce this. > > main built on stable/14: > > $ ldd > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > libmd.so.6 => /lib/libmd.so.6 (0x311068a44000) > libc.so.7 => /lib/libc.so.7 (0x311068df0000) > [vdso] (0x3110676f0000) > > main built on main: > > $ ldd > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > libmd.so.7 => not found (0) > libc.so.7 => /lib/libc.so.7 (0x28eb0e6f000) > [vdso] (0x28eafac0000) > > I think these files (sort, mtree, etc.) are copied from /usr/[s]bin. They're copied from /usr/sbin of the system where buildworld is done into the /usr/obj/..../legacy/... tree. The exact history of this is: - I git cloned /usr/src on March 1 - I built kernel and world on the running system (an older 14.0-CURRENT) - I installed kernel and world the usual way without any problem - Then I went to setup a poudriere jail on this now 15.0-CURRENT; this ended up with an error about libmd.so.6 missing; see the other thread about this issue here in this list; one hint was 'rm -f /usr/obj' and rebuild world again; ofc this rebuild was now done on 15.0-CURRENT - the result of this buildworld gives now the issue with the missing libmd.so.7 Thanks matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Mon Mar 10 14:38:04 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBKHz5Bjzz5qxJP for ; Mon, 10 Mar 2025 14:38:07 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (secp384r1) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "E6" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBKHy2tNpz3SP9 for ; Mon, 10 Mar 2025 14:38:06 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gojira.at header.s=mail202005 header.b="f/5PfMmh"; dmarc=none; spf=pass (mx1.freebsd.org: domain of herbert@gojira.at designates 94.130.200.20 as permitted sender) smtp.mailfrom=herbert@gojira.at Date: Mon, 10 Mar 2025 15:38:04 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1741617484; bh=Ee1OteabzRt2FVaBbpbBy23Isml2tVz5SpKPNY3rIIA=; h=Date:From:To:Subject:Message-ID:MIME-Version:Content-Type; b=f/5PfMmhHpF2I/1pyRF/apO7GaIug27jMclfa/RfGfQIEEOc2sqipIanfPV3xh91Z sYBVKgxqvZK/e33iCQVK5LCuN7kEgT+2TPcsPk39E0fLgnhjReFOeNbaGeuAR46/Sz 60pxOiY/f6NPZW8Wk2cRXvCHG3jiRW4HSuUIeIScsWZZSRBzls3h2aehfr3mRN7Vni N1CudPTPs5Dajxce0C4NQVhXWVPB6NSqMdzIPuzkJ5FlnDgjkBHqRovC1XspfuElRJ 22RL8kB3k4YCCOJRlzIbKl+ulnfoRaM4sAMRTxrWnZZcuJSAtWITN6a1UTfNsWxzJ8 jAMBMMTALqFFg== From: "Herbert J. Skuhra" To: freebsd-current@freebsd.org Subject: Re: make installworld fails due to missing libmd.so.6 or libmd.so.7 Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spamd-Result: default: False [-3.38 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.996]; NEURAL_HAM_MEDIUM(-0.97)[-0.971]; NEURAL_HAM_SHORT(-0.91)[-0.910]; R_SPF_ALLOW(-0.20)[+ip4:94.130.200.20]; R_DKIM_ALLOW(-0.20)[gojira.at:s=mail202005]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE]; MISSING_XM_UA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; DMARC_NA(0.00)[gojira.at]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[gojira.at:+] X-Rspamd-Queue-Id: 4ZBKHy2tNpz3SP9 X-Spamd-Bar: --- On Mon, Mar 10, 2025 at 01:58:14PM +0100, Matthias Apitz wrote: > El día Montag, März 10, 2025 a las 01:14:07 +0100, Herbert J. Skuhra escribió: > > > On Mon, Mar 10, 2025 at 11:14:46AM +0100, Matthias Apitz wrote: > > > This problem first came up a the thread: > > > > > > Creating poudriere jail fails with libmd.so.6 not found > > > > > > but it's unrelated to poudriere jails. With a recent CURRENT (March 1) > > > I can reproduce this fine. I investigated it with an installation into > > > DESTDIR to not damage my running system. > > > > > > Here are my findings: > > > > > > # make installworld DESTDIR=/home/guru/150.root > > > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 > > > -------------------------------------------------------------- > > > >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 > > > -------------------------------------------------------------- > > > mkdir -p /tmp/install.H59PpUrQ1d > > > ... > > > Required library libmd.so.7 not found. > > > *** Error code 1 > > > > > > Stop. > > > > > > I investigated the problem (that's why I used DESTDIR to not > > > damage the system to be installed to). > > > > > > The problem is that two tools, 'sort' and 'mtree' > > > require a shared lib libmd.so.7 which is not there in > > > the moment of make installworld: > > > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort > > > libmd.so.7 => not found (0) > > > libc.so.7 => /lib/libc.so.7 (0xe6e08064000) > > > [vdso] (0xe6e06c75000) > > > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree > > > libmd.so.7 => not found (0) > > > libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) > > > libc.so.7 => /lib/libc.so.7 (0x106220ca7000) > > > [vdso] (0x10621d82c000) > > > > > > # find /lib /usr/lib -name libmd.so.7 > > > (nothing) > > > > > > This shared libmd.so.7 lib will perhaps be istalled later by > > > the 'make installworld', at least it is in the tree /usr/obj/... > > > > > > # find /usr/obj -name libmd.so.7 > > > /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 > > > /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 > > > /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 > > > /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 > > > > > > > > > a workaround is before 'make installworld' to run:: > > > > > > # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib > > > > > > With this the > > > > > > # make installworld DESTDIR=/home/guru/150.root > > > ... > > > >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 > > > >>> Install world completed in 398 seconds, ncpu: 2 > > > -------------------------------------------------------------- > > > 397,72 real 219,14 user 162,06 sys > > > > > > > > > runs fine. > > > > Did you run buildworld and installworld on different versions (e.g: main > > vs. stable, or main vs. main pre e7a629c851d7)? This is is the only way > > I can reproduce this. > > > > main built on stable/14: > > > > $ ldd > > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > > libmd.so.6 => /lib/libmd.so.6 (0x311068a44000) > > libc.so.7 => /lib/libc.so.7 (0x311068df0000) > > [vdso] (0x3110676f0000) > > > > main built on main: > > > > $ ldd > > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > > libmd.so.7 => not found (0) > > libc.so.7 => /lib/libc.so.7 (0x28eb0e6f000) > > [vdso] (0x28eafac0000) > > > > I think these files (sort, mtree, etc.) are copied from /usr/[s]bin. > > They're copied from /usr/sbin of the system where buildworld is done into > the /usr/obj/..../legacy/... tree. > > The exact history of this is: > > - I git cloned /usr/src on March 1 > - I built kernel and world on the running system (an older 14.0-CURRENT) > - I installed kernel and world the usual way without any problem This should install /lib/libmd.so.7 and /usr/bin/sort and /usr/sbin/mtree linked against it. e.g: $ ldd /usr/bin/sort |grep md libmd.so.7 => /lib/libmd.so.7 (0x2b71fa352000) $ ldd /usr/sbin/mtree |grep md libmd.so.7 => /lib/libmd.so.7 (0x352bee83e000) > - Then I went to setup a poudriere jail on this now 15.0-CURRENT; this > ended up with an error about libmd.so.6 missing; see the other thread > about this issue here in this list; one hint was 'rm -f /usr/obj' and > rebuild world again; ofc this rebuild was now done on 15.0-CURRENT > - the result of this buildworld gives now the issue with the missing libmd.so.7 What happens if you remove tmp/legacy in /usr/obj/... and run 'make buildworld' again? Can you show 'ls -l' output for mtree and sort in /usr/[s]bin and ...tmp/legacy? From nobody Mon Mar 10 14:59:19 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBKmk4Gt5z5qy1w for ; Mon, 10 Mar 2025 14:59:34 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx-01.divo.sbone.de (mx-01.divo.sbone.de [IPv6:2003:a:140a:2200:6:594:fffe:19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mx-01.divo.sbone.de", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBKmj2GVBz3Zs1 for ; Mon, 10 Mar 2025 14:59:33 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zabbadoz.net header.s=20240622 header.b=Wj6V5PJY; dmarc=pass (policy=none) header.from=zabbadoz.net; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 2003:a:140a:2200:6:594:fffe:19 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx-01.divo.sbone.de (Postfix) with ESMTPS id B7B97A64805 for ; Mon, 10 Mar 2025 14:59:18 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=zabbadoz.net; s=20240622; t=1741618758; bh=ItrvdDPm2SlB2qi+ceOJMSD5ryG6Miv1d6CdbP54xXA=; h=Date:From:To:Subject; b=Wj6V5PJYzDD6XkKs04nAy2f79+ZAUDsbhfa/+4H2LpoS6eDjluodExotmwX5H9mL2 JlfqcGva8CbN4kcE4r5QVkHHFvXs9Z+q5eYLaU8LugS1D4RL11K4Rgn0nUO2A2Od4e 9WnP15R+B7Jznc91+1hN7ycLR/VhLLkXuUJF/9AoY6cJ9sjIAqxo12ulW7Qz+MeBPb g3RHc6Fkb8Uij7gYArBzAVM67y+kP1+kps2v/TopJ38CZZZ+39rbd0g6s33/1kTMv5 W2O6zBEy8qMAD0Q+/JThxQCIzNgh2WkttTgB8LkkVqRrbTk0rHGv3ZjNWGHVGGAQbI MWRXOyQy4XQl+1prypPSHUYheuQ2bXe/T7k0jsOBfhCP0hBS0rLsveo8mSHUKchftg z4gB02vbhFCSNGxruVi3yd8vKx0BB0+TaQYqLKmLAcWMdeMjqMPD9cvL9+SK1uSoom PlEBJJraEqzf+BP3hZCEVD0E3aESGhyVcm1dWqIVNbib3UHuiTI/7KTMsm2lru67Dp TiE9hJA/gHZx/77+etRlFUSbz0jzFw3sffi1NfbV3Jr553JCVkAea7nUBJhAaSw3N3 ioRsIwRNNhpVHwvoXC9Uv3aY9C4ej97G8qX55+doWSoTvYO+KA1ozQAUeAKHtjUeWG Cew0PwafYus45PsvcezXvBhs= Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id AE5542D029E1 for ; Mon, 10 Mar 2025 14:59:20 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id doct0yitYhjt for ; Mon, 10 Mar 2025 14:59:19 +0000 (UTC) Received: from strong-rtwn0.sbone.de (strong-rtwn0.sbone.de [IPv6:fde9:577b:c1a9:4902:da44:89ff:fedd:d5ab]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 8E93B2D029D8 for ; Mon, 10 Mar 2025 14:59:19 +0000 (UTC) Date: Mon, 10 Mar 2025 14:59:19 +0000 (UTC) From: "Bjoern A. Zeeb" To: current@freebsd.org Subject: buildworld tries to write to /etc? Message-ID: <25oo688p-898r-q606-2338-7062s8p57q92@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Spamd-Result: default: False [0.45 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; DMARC_POLICY_ALLOW(-0.50)[zabbadoz.net,none]; NEURAL_SPAM_MEDIUM(0.25)[0.250]; R_DKIM_ALLOW(-0.20)[zabbadoz.net:s=20240622]; R_SPF_ALLOW(-0.20)[+ip6:2003:a:140a:2200:6:594:fffe:19]; NEURAL_SPAM_LONG(0.15)[0.148]; MIME_GOOD(-0.10)[text/plain]; NEURAL_SPAM_SHORT(0.05)[0.053]; ASN(0.00)[asn:3320, ipnet:2003::/19, country:DE]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; MIME_TRACE(0.00)[0:+]; MISSING_XM_UA(0.00)[]; FROM_HAS_DN(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[zabbadoz.net:+] X-Rspamd-Queue-Id: 4ZBKmj2GVBz3Zs1 X-Spamd-Bar: / Hi, I just noticed that the end of a buildworld as user I get: ===> etc (all) make[3]: warning: /etc: Permission denied. ===> etc/termcap (all) What's it trying to do to /etc during build? /bz -- Bjoern A. Zeeb r15:7 From nobody Mon Mar 10 23:13:43 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBXl16QS6z5qJ7s for ; Mon, 10 Mar 2025 23:13:49 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx-01.divo.sbone.de (mx-01.divo.sbone.de [IPv6:2003:a:140a:2200:6:594:fffe:19]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mx-01.divo.sbone.de", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBXl10KVhz3DMQ; Mon, 10 Mar 2025 23:13:48 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zabbadoz.net header.s=20240622 header.b=OEkeNIFs; dmarc=pass (policy=none) header.from=zabbadoz.net; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 2003:a:140a:2200:6:594:fffe:19 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature ECDSA (prime256v1) server-digest SHA256) (No client certificate requested) by mx-01.divo.sbone.de (Postfix) with ESMTPS id 73CC0A64805; Mon, 10 Mar 2025 23:13:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=zabbadoz.net; s=20240622; t=1741648423; bh=5kNTPxTxedHr3BfokpuA9GGBFbrg2nJUVLRq9gwPb9Y=; h=Date:From:To:Subject; b=OEkeNIFsauG84byNG9UrfL6DaJ0osXjLiCyCtGzIqz+qCbl/D+v3uTMxe/5W85W7k gRPYU4kDrAOcG5XWLOLb1dqwzUyUUEbjtlLK+x0bOoBfJ9Ijakfa1gMXWv9b8NX27X Cb30C8jsCw1GY4nJVc91ofMpB6A+sduCCXlofF0eduZGKIcQOW8FjIBlANbG8Tj8D7 /cbUlOQtyGiOiIWcANCB4LZhie0Sc4kELWbSWoh5SySXZ58oL9v9laJyPQkxRmW6tt rbCvPjlqfvF4FYxSYGA2ndw1ctdQuxMUqXUMStUCGkHmuc+3pV2eXk3Jq2YZLUEz6S kvbX+83oENVK+UzEuv7EUQ9odiJVObs9xLwqdxSnj1cn2P9ndbVHAsDlFINaZZSRc8 vlrCLcrN8+ijmKMy8XSyAVsrSt2jD/re1eUb4l9SfKrIZBNIKK4lUNgaOV2aINP+Ps uvVSrcSIpgPQkB6Iu8VVrfHYnrU4eTQMKYVEmpNdntEVV0rpJNPGWY6gUIsKukAQb3 ZouTUw29/ShMwgnZv82cuUOw3bY0BonoO55C1Cnds99s2wJoJLpt5QTcUofSn4tpeA MAjiUB3bYJ27vQfXsEI5NRjSSBYcGUcu35/XJNztUFldp5fVhU7gAE0x+nBOh8LZWm 0pmatTakX95ce/7yFmxWsz3U= Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 5FDB42D029E0; Mon, 10 Mar 2025 23:13:45 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id a_EnW6Fu7ekf; Mon, 10 Mar 2025 23:13:44 +0000 (UTC) Received: from strong-rtwn0.sbone.de (strong-rtwn0.sbone.de [IPv6:fde9:577b:c1a9:4902:da44:89ff:fedd:d5ab]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 4C0152D029D8; Mon, 10 Mar 2025 23:13:44 +0000 (UTC) Date: Mon, 10 Mar 2025 23:13:43 +0000 (UTC) From: "Bjoern A. Zeeb" To: current@freebsd.org Subject: installworld runs git again Message-ID: <3p5pq042-95n8-0s53-178n-n07s8400rs03@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Spamd-Result: default: False [-3.84 / 15.00]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.85)[-0.845]; DMARC_POLICY_ALLOW(-0.50)[zabbadoz.net,none]; R_DKIM_ALLOW(-0.20)[zabbadoz.net:s=20240622]; R_SPF_ALLOW(-0.20)[+ip6:2003:a:140a:2200:6:594:fffe:19]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:3320, ipnet:2003::/19, country:DE]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[zabbadoz.net:+] X-Rspamd-Queue-Id: 4ZBXl10KVhz3DMQ X-Spamd-Bar: --- Hi, make installworld runs git again but if build as user and owning the files as user and installing as root that gives the obvious warning: make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at lab-top on Mon Mar 10 22:35:33 UTC 2025 fatal: detected dubious ownership in repository at '/usr/src' To add an exception for this directory, call: git config --global --add safe.directory /usr/src make[1]: "/usr/src/Makefile.inc1" line 601: warning: Command "/usr/local/bin/git -C /usr/src show -s --format=%ct HEAD" exited with status 128 -------------------------------------------------------------- >>> Install check world started on Mon Mar 10 23:00:45 UTC 2025 -------------------------------------------------------------- fatal: detected dubious ownership in repository at '/usr/src' To add an exception for this directory, call: git config --global --add safe.directory /usr/src make[2]: "/usr/src/Makefile.inc1" line 601: warning: Command "/usr/local/bin/git -C /usr/src show -s --format=%ct HEAD" exited with status 128 -------------------------------------------------------------- >>> Making hierarchy -------------------------------------------------------------- fatal: detected dubious ownership in repository at '/usr/src' To add an exception for this directory, call: git config --global --add safe.directory /usr/src make[3]: "/usr/src/Makefile.inc1" line 601: warning: Command "/usr/local/bin/git -C /usr/src show -s --format=%ct HEAD" exited with status 128 What do we need these timestamps for when doing an installworld? I see they are for pkg base so can they be contraint to that? Is there a reason not to create things during build time? Install should not create any new information anymore. People used to have /usr/src ro and and the obj directories once build is done too. We've long lost that but given we are so much after reproducability maybe people should try this again... /bz -- Bjoern A. Zeeb r15:7 From nobody Tue Mar 11 05:53:28 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBjcD30Xbz5qmDt for ; Tue, 11 Mar 2025 05:53:32 +0000 (UTC) (envelope-from guru@unixarea.de) Received: from ms-10.1blu.de (ms-10.1blu.de [178.254.4.101]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBjcD03sKz4PSm for ; Tue, 11 Mar 2025 05:53:32 +0000 (UTC) (envelope-from guru@unixarea.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=unixarea.de ; s=blu3434000; h=In-Reply-To:Content-Transfer-Encoding:Content-Type: MIME-Version:References:Reply-To:Message-ID:Subject:Cc:To:From:Date:Sender: Content-ID:Content-Description; bh=5hWLTXd7beDuK6jj6We9OZN4YWwFnAANSUGm+s5pOEE=; b=U686sd3E/AoEiOWeQcuFg8WZQ4 LB22JcadcGXAjepZs8Iz3T39qiflvuSdceAOny3FfOYUjv2tJsxvU5jBncONUjC+ywljQLT+FtAxn 77Y92+iMxleSxhaC9r7xLGHpQH426lGAN8jPHGWdqhwT5hhfNZNltI5Iy1yCeRgQjZW1jV6B7r2Hs vZD1NwG3HC9DxSlZHR5w4MKiBi1qIRfya+xvhOf+XTenNYw6Ee0yT5lvdTw2Dk6OsyzEKJ9ciYRPh dYLQdcBAeQjHrueoYFRVRm6ksV8l4zLOdbQBUTwoiDIRfAx2wJklneQtof+r2vYiE/j7DXLNWqqdx hVYqKslg==; Received: from [62.216.210.158] (helo=localhost.unixarea.de) by ms-10.1blu.de with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384 (Exim 4.95) (envelope-from ) id 1trsYT-00Dy7w-9H; Tue, 11 Mar 2025 06:53:29 +0100 Received: from localhost.my.domain (c720-1400094 [127.0.0.1]) by localhost.unixarea.de (8.17.1/8.14.9) with ESMTP id 52B5rSXO001590; Tue, 11 Mar 2025 06:53:28 +0100 (CET) (envelope-from guru@unixarea.de) Received: (from guru@localhost) by localhost.my.domain (8.17.1/8.14.9/Submit) id 52B5rSY5001589; Tue, 11 Mar 2025 06:53:28 +0100 (CET) (envelope-from guru@unixarea.de) X-Authentication-Warning: localhost.my.domain: guru set sender to guru@unixarea.de using -f Date: Tue, 11 Mar 2025 06:53:28 +0100 From: Matthias Apitz To: "Herbert J. Skuhra" Cc: freebsd-current@freebsd.org Subject: Re: make installworld fails due to missing libmd.so.6 or libmd.so.7 Message-ID: Reply-To: Matthias Apitz Mail-Followup-To: "Herbert J. Skuhra" , freebsd-current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Operating-System: FreeBSD 14.0-CURRENT r1400094 (amd64) X-message-flag: Mails in HTML will not be read! Please, only plain text. X-Con-Id: 51246 X-Con-U: 0-guru X-Originating-IP: 62.216.210.158 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:42730, ipnet:178.254.0.0/19, country:DE] X-Rspamd-Queue-Id: 4ZBjcD03sKz4PSm X-Spamd-Bar: ---- El día lunes, marzo 10, 2025 a las 03:38:04p. m. +0100, Herbert J. Skuhra escribió: > On Mon, Mar 10, 2025 at 01:58:14PM +0100, Matthias Apitz wrote: > > El día Montag, März 10, 2025 a las 01:14:07 +0100, Herbert J. Skuhra escribió: > > > > > On Mon, Mar 10, 2025 at 11:14:46AM +0100, Matthias Apitz wrote: > > > > This problem first came up a the thread: > > > > > > > > Creating poudriere jail fails with libmd.so.6 not found > > > > > > > > but it's unrelated to poudriere jails. With a recent CURRENT (March 1) > > > > I can reproduce this fine. I investigated it with an installation into > > > > DESTDIR to not damage my running system. > > > > > > > > Here are my findings: > > > > > > > > # make installworld DESTDIR=/home/guru/150.root > > > > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: Using cached toolchain metadata from build at jet on Mon Mar 3 09:03:29 CET 2025 > > > > -------------------------------------------------------------- > > > > >>> Install check world started on Mon Mar 10 08:16:20 CET 2025 > > > > -------------------------------------------------------------- > > > > mkdir -p /tmp/install.H59PpUrQ1d > > > > ... > > > > Required library libmd.so.7 not found. > > > > *** Error code 1 > > > > > > > > Stop. > > > > > > > > I investigated the problem (that's why I used DESTDIR to not > > > > damage the system to be installed to). > > > > > > > > The problem is that two tools, 'sort' and 'mtree' > > > > require a shared lib libmd.so.7 which is not there in > > > > the moment of make installworld: > > > > > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/sort > > > > libmd.so.7 => not found (0) > > > > libc.so.7 => /lib/libc.so.7 (0xe6e08064000) > > > > [vdso] (0xe6e06c75000) > > > > > > > > /usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin/mtree > > > > libmd.so.7 => not found (0) > > > > libutil.so.9 => /lib/libutil.so.9 (0x10621f601000) > > > > libc.so.7 => /lib/libc.so.7 (0x106220ca7000) > > > > [vdso] (0x10621d82c000) > > > > > > > > # find /lib /usr/lib -name libmd.so.7 > > > > (nothing) > > > > > > > > This shared libmd.so.7 lib will perhaps be istalled later by > > > > the 'make installworld', at least it is in the tree /usr/obj/... > > > > > > > > # find /usr/obj -name libmd.so.7 > > > > /usr/obj/usr/src/amd64.amd64/tmp/usr/lib32/libmd.so.7 > > > > /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 > > > > /usr/obj/usr/src/amd64.amd64/lib/libmd/libmd.so.7 > > > > /usr/obj/usr/src/amd64.amd64/obj-lib32/lib/libmd/libmd.so.7 > > > > > > > > > > > > a workaround is before 'make installworld' to run:: > > > > > > > > # cp -p /usr/obj/usr/src/amd64.amd64/tmp/lib/libmd.so.7 /lib > > > > > > > > With this the > > > > > > > > # make installworld DESTDIR=/home/guru/150.root > > > > ... > > > > >>> Installing everything completed on Mon Mar 10 08:34:13 CET 2025 > > > > >>> Install world completed in 398 seconds, ncpu: 2 > > > > -------------------------------------------------------------- > > > > 397,72 real 219,14 user 162,06 sys > > > > > > > > > > > > runs fine. > > > > > > Did you run buildworld and installworld on different versions (e.g: main > > > vs. stable, or main vs. main pre e7a629c851d7)? This is is the only way > > > I can reproduce this. > > > > > > main built on stable/14: > > > > > > $ ldd > > > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > > > /usr/obj/tmp/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > > > libmd.so.6 => /lib/libmd.so.6 (0x311068a44000) > > > libc.so.7 => /lib/libc.so.7 (0x311068df0000) > > > [vdso] (0x3110676f0000) > > > > > > main built on main: > > > > > > $ ldd > > > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort > > > /usr/obj/home/herbert/source/freebsd/head/src/amd64.amd64/tmp/legacy/bin/sort: > > > libmd.so.7 => not found (0) > > > libc.so.7 => /lib/libc.so.7 (0x28eb0e6f000) > > > [vdso] (0x28eafac0000) > > > > > > I think these files (sort, mtree, etc.) are copied from /usr/[s]bin. > > > > They're copied from /usr/sbin of the system where buildworld is done into > > the /usr/obj/..../legacy/... tree. > > > > The exact history of this is: > > > > - I git cloned /usr/src on March 1 > > - I built kernel and world on the running system (an older 14.0-CURRENT) > > - I installed kernel and world the usual way without any problem > > This should install /lib/libmd.so.7 and /usr/bin/sort and /usr/sbin/mtree linked > against it. e.g: > > $ ldd /usr/bin/sort |grep md > libmd.so.7 => /lib/libmd.so.7 (0x2b71fa352000) > $ ldd /usr/sbin/mtree |grep md > libmd.so.7 => /lib/libmd.so.7 (0x352bee83e000) > > > ... Yes. The installation 'make installworld' puts the new libmd.so.7 to /lib/libmd.so.7, but in the /usr/obj/..../legacy/... are still 'sort' and 'mtree' depending on the old shared lib libmd.so.6. If one now runs the installation a second time, for example to create a poudriere jail, the same /usr/src and /usr/obj are used and one of the first steps of the 'make installworld' is this check for the legacy tools which will faile, as I saw creating the jail. When you run 'make buildworld' again, the new 'sort', 'mtree', ... are copied to /usr/obj/..../legacy/... and they depend on libmd.so.7 That's why the creating of the poudriere jail worked. And one might think: all is fine now. But it isn't fine! If you now make tar archives of /usr/src and /usr/obj to copy them over to a similar system as the just updated with installworld and installkernel, to unpack these tar archives in /usr and run 'make installworld' there, this must fail, because libmd.so.7 is not there, but libmd.so.6, and the tools in /usr/obj/..../legacy/... are looking for libmd.so.7. That's all. Maybe while copying tools like 'sort', 'mtree', ... into /usr/obj/..../legacy/... also the shared libs they depend on should be copied too. matthias -- Matthias Apitz, ✉ guru@unixarea.de, http://www.unixarea.de/ +49-176-38902045 Public GnuPG key: http://www.unixarea.de/key.pub From nobody Tue Mar 11 12:41:35 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZBtgV5vQBz5qVvJ for ; Tue, 11 Mar 2025 12:41:58 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from fhigh-a4-smtp.messagingengine.com (fhigh-a4-smtp.messagingengine.com [103.168.172.155]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZBtgV2BZKz3JdQ for ; Tue, 11 Mar 2025 12:41:58 +0000 (UTC) (envelope-from dch@skunkwerks.at) Authentication-Results: mx1.freebsd.org; none Received: from phl-compute-08.internal (phl-compute-08.phl.internal [10.202.2.48]) by mailfhigh.phl.internal (Postfix) with ESMTP id 510E511400B2; Tue, 11 Mar 2025 08:41:57 -0400 (EDT) Received: from phl-imap-02 ([10.202.2.81]) by phl-compute-08.internal (MEProxy); Tue, 11 Mar 2025 08:41:57 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=skunkwerks.at; h=cc:cc:content-transfer-encoding:content-type:content-type :date:date:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:subject:subject:to:to; s=fm2; t=1741696917; x=1741783317; bh=vOTuyCZ+0gwpas2zks0R3tI64gWdzSB2 FJgUCaQsj1Q=; b=oZ2Ag9HbSgAq99Gpf8fUb7orf3VjY2DENdOX4jD0cg3P9o/x XImw+kMpFDGUdWmCZTNiHsTY42f+sIBw16GHAFCHRBhAcCgxR8k8qU5bmEuDAnyH 2/i2iGdoyZ06rFOC6U4t0R9rC8Uae6oXuqCDT2C7lFiACjbyDnvaOCQbLq/A0ZNP gikznr57xw5MxpQztXiUQovgvsXjS6zw/ETcTWwy+nIp0gJcA/e2n36nZcGLNYPw /gPduVP3oucvdVA3NCFiu5IXHSyorPlYpfb8Gh+4q3S3WwJ2t8SGLt1Afmh5RQ3A b7aFzhjEZWmJi0n/jsLc/JXKcvuRCyiiMjyjRQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-transfer-encoding :content-type:content-type:date:date:feedback-id:feedback-id :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1741696917; x= 1741783317; bh=vOTuyCZ+0gwpas2zks0R3tI64gWdzSB2FJgUCaQsj1Q=; b=j sgS41tmhuvonkaEpVwxH5zDr6mc1J9Y0ZlGJim0lz3qoy5sDVsXtpU5hXlAqkkix HrLO5FEofh8TID5FKdcrlbH749KVH7AZ5QhoC3wunDJOi/bT4uFMu19W5PvkJh2U BgmC6xHOg4bSF1TpTQb2kHE05aDELEG8aJRouNN3fgdSM+PxnUxyDFjBqLWGGIsK 9A5WQaKD32TpFMNLl/wgNX/x+yY9lmLvqOV5YdJ2p6QvqbczwPJ/WM+GSz2CJaeh 1pgec/mHrYYuePGr5xWrm0F6b9DfosEOWjCHrgBxkXDRGcwJ+0Z48nNwqLkkUF1y 0PNlU/DxMDY0h3EeCtrzQ== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgdduvddvvdeiucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefogg ffhffvvefkjghfufgtgfesthejredtredttdenucfhrhhomhepfdffrghvvgcuvehothht lhgvhhhusggvrhdfuceouggthhesshhkuhhnkhifvghrkhhsrdgrtheqnecuggftrfgrth htvghrnhepieffhfdujeelieekueehgfeigeekleeljeeigefgudeuheetgfdtgeffieev uedvnecuffhomhgrihhnpehfrhgvvggsshgurdhorhhgnecuvehluhhsthgvrhfuihiivg eptdenucfrrghrrghmpehmrghilhhfrhhomhepuggthhesshhkuhhnkhifvghrkhhsrdgr thdpnhgspghrtghpthhtohepvddpmhhouggvpehsmhhtphhouhhtpdhrtghpthhtoheptg hurhhrvghnthesfhhrvggvsghsugdrohhrghdprhgtphhtthhopegsiigvvggsqdhlihhs thhssehlihhsthhsrdiirggssggrughoiidrnhgvth X-ME-Proxy: Feedback-ID: ic0e84090:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id EDF6FB0006A; Tue, 11 Mar 2025 08:41:55 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Date: Tue, 11 Mar 2025 12:41:35 +0000 From: "Dave Cottlehuber" To: "Bjoern A. Zeeb" Cc: current@freebsd.org Message-Id: In-Reply-To: <3p5pq042-95n8-0s53-178n-n07s8400rs03@yvfgf.mnoonqbm.arg> References: <3p5pq042-95n8-0s53-178n-n07s8400rs03@yvfgf.mnoonqbm.arg> Subject: Re: installworld runs git again Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:151847, ipnet:103.168.172.0/24, country:AU] X-Rspamd-Queue-Id: 4ZBtgV2BZKz3JdQ X-Spamd-Bar: ---- On Mon, 10 Mar 2025, at 23:13, Bjoern A. Zeeb wrote: > Hi, > > make installworld runs git again but if build as user and owning the > files as user and installing as root that gives the obvious warning: > > make[1]: "/usr/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1: > Using cached toolchain metadata from build at lab-top on Mon Mar 10 > 22:35:33 UTC 2025 > fatal: detected dubious ownership in repository at '/usr/src' > To add an exception for this directory, call: > > git config --global --add safe.directory /usr/src > make[1]: "/usr/src/Makefile.inc1" line 601: warning: Command > "/usr/local/bin/git -C /usr/src show -s --format=%ct HEAD" exited with > status 128 We can use: /usr/local/bin/git -c safe.directory=/usr/src \ -C /usr/src show -s --format=%ct HEAD which would avoid that, https://reviews.freebsd.org/D49316 > What do we need these timestamps for when doing an installworld? I guess its reproducible builds, hence basing it off the commit's timestamp, not the filesystem. > People used to have /usr/src ro and and the obj directories once build > is done too. We've long lost that but given we are so much after > reproducability maybe people should try this again... This works for me today, at least with beinstall.sh its how I upgrade my arm64 router from its bigger server, over RO nfs. A+ Dave From nobody Wed Mar 12 00:21:16 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCBBW56yrz5rGHj for ; Wed, 12 Mar 2025 00:21:23 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:7400:8808:12:4:0:1]) by mx1.freebsd.org (Postfix) with ESMTP id 4ZCBBV5x22z3YDj; Wed, 12 Mar 2025 00:21:22 +0000 (UTC) (envelope-from jamie@catflap.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=catflap.org; spf=pass (mx1.freebsd.org: domain of jamie@catflap.org designates 2001:19f0:7400:8808:12:4:0:1 as permitted sender) smtp.mailfrom=jamie@catflap.org X-Catflap-Envelope-From: Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [209.250.224.51]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 52C0LG9C088610; Wed, 12 Mar 2025 00:21:16 GMT (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 52C0LG7D088609; Wed, 12 Mar 2025 00:21:16 GMT (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> Date: Wed, 12 Mar 2025 00:21:16 +0000 Organization: Dyslexic Fish To: kevans@FreeBSD.org, jamie@catflap.org, freebsd-current@FreeBSD.org Subject: Re: grep(1) bug - duplicate output lines References: <202309280240.38S2esgN015958@donotpassgo.dyslexicfish.net> <8d0658e9-8984-a241-ad1d-e5aa1328d7fa@FreeBSD.org> <202309291629.38TGTU56092229@donotpassgo.dyslexicfish.net> <202309291825.38TIPNN2096338@donotpassgo.dyslexicfish.net> <85039cfe-3c59-173d-f2f2-f0ca8e0fa1c8@FreeBSD.org> <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> In-Reply-To: <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [209.250.224.51]); Wed, 12 Mar 2025 00:21:16 +0000 (GMT) X-Spamd-Result: default: False [0.16 / 15.00]; NEURAL_HAM_SHORT(-0.96)[-0.960]; NEURAL_SPAM_LONG(0.92)[0.922]; NEURAL_SPAM_MEDIUM(0.90)[0.901]; DMARC_POLICY_ALLOW(-0.50)[catflap.org,none]; R_SPF_ALLOW(-0.20)[+mx:dyslexicfish.net]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[jamie]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; HAS_ORG_HEADER(0.00)[]; ASN(0.00)[asn:20473, ipnet:2001:19f0:7400::/38, country:US]; ARC_NA(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@FreeBSD.org]; R_DKIM_NA(0.00)[] X-Rspamd-Queue-Id: 4ZCBBV5x22z3YDj X-Spamd-Bar: / Kyle Evans wrote: > On 9/29/23 15:37, Kyle Evans wrote: > > On 9/29/23 13:25, Jamie Landeg-Jones wrote: > >> Jamie Landeg-Jones wrote: > >> > >>> Brilliant! Thanks for the quick response and fix. It works fine for me - > >>> I've not managed to break it again :-) > >> > >> Famous last words.... > >> > >> "grep -v" now produces duplicate lines! e.g. : > >> > > > > Alright, fine, be that way. :-) Try this on top of the existing patch: > > > > https://people.freebsd.org/~kevans/grep-color.diff > > > > This should be spelled: > > https://people.freebsd.org/~kevans/grep-color-addition.diff > > Sorry Hi Kyle. This is an old thread from 2023. ( https://lists.freebsd.org/archives/freebsd-current/2023-September/004762.html ) I've been running with these two patches since you posted them. I notice that they haven't been commited, and the bug reported in the thread still exists in current, so I'm replying to the original thread, both in the hope that this specific problem can be fixed, and then your overall fixes be submitted to the tree. Everything else has worked fine all this time, but today I noticed a bug that can be triggered like this: | % echo boo | /usr/bin/grep '' | Assertion failed: (pc->matchidx > 0), function procmatch_match, file /usr/src/usr.bin/grep/util.c, line 223. | Abort (core dumped) This is caused by the snippet: | /* Print the matching line, but only if not quiet/binary */ | if (mc->printmatch) { | size_t last_out; | | if (vflag) | assert(pc->matchidx == 0); | else | assert(pc->matchidx > 0); In this case, pc-matchidx is validly 0. However, simply Removing the assert from the src causes the duplicate line issue again. Why grep for '' ? Long story, but it seems to be allowed. Even if it isn't allowed, it shouldn't be dumping core :-) Anything further I can do to assist, please let me know. Cheers, Jamie From nobody Wed Mar 12 02:00:48 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCDPH33xnz5rMNH for ; Wed, 12 Mar 2025 02:00:51 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:7400:8808:12:4:0:1]) by mx1.freebsd.org (Postfix) with ESMTP id 4ZCDPG5b24z3j7b; Wed, 12 Mar 2025 02:00:50 +0000 (UTC) (envelope-from jamie@catflap.org) Authentication-Results: mx1.freebsd.org; none X-Catflap-Envelope-From: Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [209.250.224.51]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 52C20mfu098010; Wed, 12 Mar 2025 02:00:48 GMT (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 52C20m6k098009; Wed, 12 Mar 2025 02:00:48 GMT (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202503120200.52C20m6k098009@donotpassgo.dyslexicfish.net> Date: Wed, 12 Mar 2025 02:00:48 +0000 Organization: Dyslexic Fish To: kevans@FreeBSD.org, jamie@catflap.org, freebsd-current@FreeBSD.org Subject: Re: grep(1) bug - duplicate output lines References: <202309280240.38S2esgN015958@donotpassgo.dyslexicfish.net> <8d0658e9-8984-a241-ad1d-e5aa1328d7fa@FreeBSD.org> <202309291629.38TGTU56092229@donotpassgo.dyslexicfish.net> <202309291825.38TIPNN2096338@donotpassgo.dyslexicfish.net> <85039cfe-3c59-173d-f2f2-f0ca8e0fa1c8@FreeBSD.org> <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> In-Reply-To: <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [209.250.224.51]); Wed, 12 Mar 2025 02:00:48 +0000 (GMT) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:20473, ipnet:2001:19f0:7400::/38, country:US] X-Rspamd-Queue-Id: 4ZCDPG5b24z3j7b X-Spamd-Bar: ---- Jamie Landeg-Jones wrote: > I've been running with these two patches since you posted them. I notice > that they haven't been commited, and the bug reported in the thread still > exists in current, so I'm replying to the original thread, both in the hope > that this specific problem can be fixed, and then your overall fixes be > submitted to the tree. Do you want me to log a PR on this? Cheers! From nobody Wed Mar 12 02:58:23 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCFgh4HQmz5qBnd for ; Wed, 12 Mar 2025 02:58:24 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZCFgh3nLXz3p1m; Wed, 12 Mar 2025 02:58:24 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741748304; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UaLA98G5OkfEU8yUa4o/jf/gMm5nf4eCwDnr/MIVz68=; b=T0T2ssqCT5IkXeFQ+EfdUeKZTfmLY149z3l9asgJjeW8GqDrhPtrXNiuwt6RKZuOcEL9Ya AeL/1PyBfcoPNgJYKIThg+G/ilnwc7nxU2cOfMaSuC+k1c2gXXdhxiFyLVe20i2JUSKylE FCxjYyc1kyhuZnC3VoltM0ZN9h9u0gzckfwF+T4RiFfT4SsPZRiS03BTHtQeDb9yTmTPmv IjxEGquyObJB6U6qiegBSy7J8oUKQR/Kpi1lw4Z2ChoJI0YUxI7FGcnfVMD33zFZDhmUQA QvS+yNPoYyrGY0jxHTkWQr8Ocw+E81vZBDAnsfhNDF+5mQmAJJvhiiSuCZxjew== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1741748304; a=rsa-sha256; cv=none; b=w4NkWU92H51sXuCyJz5fQtIRGrPW2w9fEnM1lPIbgl2wwPP7HJzle5BM+Rro+x2DTgnoEp gPCrdlqSqdwLBVTMcYSPPbbv7gP68WusiTcbNBZYzS6jyY8YLkdK4tLMyRZo+lxy2fkG/D VuQj846GQKvuSwao+E3BFV2zjKPtMVUGFVt+em3nv0qUZCFaXvVuSI9RJ3g9piIQ/KAqxz h8ePQQDcWbDOQMq3J+nTpFNSbL5cPhxbZJgsDlJwGS6T7QSJ7xpAJ4DOoNUuZ5J95xCZlJ 4Ebv4SjOFgTELmcmMH4FWoKsuj1MN2YhKnladfdOdgJ34DDoxJPX+Q4b5+0bSA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741748304; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=UaLA98G5OkfEU8yUa4o/jf/gMm5nf4eCwDnr/MIVz68=; b=yKrnXpnZQeUcySpWgu7/bmgBXd7XtzUmebg/40DYXLzAA1bykXFNb/j1dqK8jWlllnL6qE U0yY8fNTqZdAKR6yt5e+p1V2UwdCSxIGRhUNvjUOKvb5w5u84hj+3K15faVyBP9HfvG8JW gtkKuAkYJ+vcCOPXs616lOJUWqznxm7Q3nXwsVsbZJlEn8aBUpY+hV90jUF0EcsmqlplqF zF42y1gv0ljKBb+6h0/rXA7ldc1d5/ao3oJwqJhgDSrze0V58squ2ltpcw99pj96SPlDb9 T9/vODjMzH/PaAZvpZS9QEmIHwK8/HoCRnA0JMcPmzJ4AcIAgXekgYmVpXmkxw== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4ZCFgh1M7zzx3y; Wed, 12 Mar 2025 02:58:24 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: <503a0ad0-7a03-4979-9faf-d220f7b3c3a5@FreeBSD.org> Date: Tue, 11 Mar 2025 21:58:23 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: grep(1) bug - duplicate output lines To: Jamie Landeg-Jones , freebsd-current@FreeBSD.org References: <202309280240.38S2esgN015958@donotpassgo.dyslexicfish.net> <8d0658e9-8984-a241-ad1d-e5aa1328d7fa@FreeBSD.org> <202309291629.38TGTU56092229@donotpassgo.dyslexicfish.net> <202309291825.38TIPNN2096338@donotpassgo.dyslexicfish.net> <85039cfe-3c59-173d-f2f2-f0ca8e0fa1c8@FreeBSD.org> <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> Content-Language: en-US From: Kyle Evans In-Reply-To: <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 3/11/25 19:21, Jamie Landeg-Jones wrote: > Kyle Evans wrote: > >> On 9/29/23 15:37, Kyle Evans wrote: >>> On 9/29/23 13:25, Jamie Landeg-Jones wrote: >>>> Jamie Landeg-Jones wrote: >>>> >>>>> Brilliant! Thanks for the quick response and fix. It works fine for me - >>>>> I've not managed to break it again :-) >>>> >>>> Famous last words.... >>>> >>>> "grep -v" now produces duplicate lines! e.g. : >>>> >>> >>> Alright, fine, be that way. :-) Try this on top of the existing patch: >>> >>> https://people.freebsd.org/~kevans/grep-color.diff >>> >> >> This should be spelled: >> >> https://people.freebsd.org/~kevans/grep-color-addition.diff >> >> Sorry > > Hi Kyle. This is an old thread from 2023. > ( https://lists.freebsd.org/archives/freebsd-current/2023-September/004762.html ) > Yikes, I completely forgot about this. > I've been running with these two patches since you posted them. I notice > that they haven't been commited, and the bug reported in the thread still > exists in current, so I'm replying to the original thread, both in the hope > that this specific problem can be fixed, and then your overall fixes be > submitted to the tree. > > Everything else has worked fine all this time, but today I noticed a bug > that can be triggered like this: > > | % echo boo | /usr/bin/grep '' > | Assertion failed: (pc->matchidx > 0), function procmatch_match, file /usr/src/usr.bin/grep/util.c, line 223. > | Abort (core dumped) > > This is caused by the snippet: > > | /* Print the matching line, but only if not quiet/binary */ > | if (mc->printmatch) { > | size_t last_out; > | > | if (vflag) > | assert(pc->matchidx == 0); > | else > | assert(pc->matchidx > 0); > > In this case, pc-matchidx is validly 0. However, simply Removing > the assert from the src causes the duplicate line issue again. > > Why grep for '' ? Long story, but it seems to be allowed. > Even if it isn't allowed, it shouldn't be dumping core :-) > > Anything further I can do to assist, please let me know. > If it makes you feel better, I clearly didn't even smoke test the patch against our own regression tests. =( ===> Expected failures grep_test:zgrep_recursive -> expected_failure: unimplemented zgrep wrapper script functionality: atf-check failed; see the output of the test for details [0.029s] ===> Failed tests grep_test:matchall -> failed: atf-check failed; see the output of the test for details [0.037s] grep_test:oflag_zerolen -> failed: atf-check failed; see the output of the test for details [0.074s] grep_test:xflag_emptypat -> failed: atf-check failed; see the output of the test for details [0.044s] grep_test:xflag_emptypat_plus -> failed: atf-check failed; see the output of the test for details [0.047s] grep_test:zgrep_empty_eflag -> failed: atf-check failed; see the output of the test for details [0.047s] ===> Summary Results read from /root/.kyua/store/results.usr_obj_usr_src_arm64.aarch64_usr.bin_grep_tests_checkdir_usr_tests_usr.bin_grep.20250312-025551-841462.db Test cases: 56 total, 0 skipped, 1 expected failures, 0 broken, 5 failed Start time: 2025-03-12T02:55:51.906277Z End time: 2025-03-12T02:55:55.435279Z Total time: 2.930s -- Which would have revealed: Standard output: Executing command [ zgrep -e test ] Standard error: Fail: incorrect exit status: 134, expected: 0 stdout: stderr: Assertion failed: (pc->matchidx > 0), function procmatch_match, file /usr/src/usr.bin/grep/util.c, line 223. Abort trap (core dumped) -- I'll take a little bit to understand the patch I wrote back then, add an extra test to cover the originally-reported bug, fix the patch, then get it into Phabricator ASAP. Sorry for dropping this- Thanks, Kyle Evans From nobody Wed Mar 12 04:53:19 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCJDK6xDmz5qKw7 for ; Wed, 12 Mar 2025 04:53:21 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZCJDK5kvlz49qL; Wed, 12 Mar 2025 04:53:21 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741755201; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AeAEbfFOrDdEmWoUzttgAmMp1PZe+CyEkc3qnPbG9Lk=; b=qyUEKLGQ3+0rymSv07giRfgDhuqXYEHF0aS8729mCb00KQ4ZI4wcEcJi0zfrlHlZP7dUDP 77XhtzPVT8PtYyMO/EXv+xQLnJTMruIV/VXonysyNBBwl/Kon2zLCVCh4JC2FVdjWaw4ls IsHVbJ1ErGnsAejfPrQSO63iJ5ap9DEVEQOXYjq6wlco25kq+THzQcfiNriAR2FOGVE/L3 ExwDCIB2YGHTIzJMh5cKp5mIAOu+p2ngNWssnoLd/dLCLMQL4Su187nwjF9Mj3tqEEwFmB We7bD9R9/E/+VZweeOJpOhxwCLBxWmpnVyY+8mDl2nlE4R3EC94DTf+OTMXjxg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1741755201; a=rsa-sha256; cv=none; b=LHbcAyzuHVhORX8KJaV3TvNMo6f+AniVO57UXIqKSYcZGDyGICEiyLoIR7muJzf77qivur qTMtl31Atr0/s2hu/MGFHSWWMOH9qwGQ/8Urv1gtxSxEx0rw8cO07zp6M7m+9OMz7LjudR 45of+3YkqqMQWP6rWOcuMGuwIluS+yuNPLvLAXSggV+Iqzfd19k9ljNSl9tPu9rvV9g3Vm l8paUB7GVUTwuDjGtSyaU4KYekWdvZa37mLmhZPuFfPjuEaWpIAZeyu5TUQfj5iY78fboD 30oMvAG9HcyBL5wFj6pkXw1pdWkU+Oqn/udbPZLm56tbL4wjZ82KM5j48/gh5A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741755201; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=AeAEbfFOrDdEmWoUzttgAmMp1PZe+CyEkc3qnPbG9Lk=; b=rzhXNiEZTkF0lHOaf4lOKKoV4xipuxn2imIDBmVUZueXiVVOGIHAsZ15j1eUyWPRy/ycA7 WnLpMDAx813ub81+UQKv2MZQjKBoBLwDdF0pdHXXtQHdVVmE3LU2gwBeusHXsDks1l3ZbY TCb/pME25XwVYkyK9tMJn8VDi+gWgMjuB1SiSOtJJODrG4t+6YU5a6KJK96q/jOv+lFr4P 0wdZ/7hIgb3fjvSrKvPWPgy5WhAQhPXKVi4n3BfaJ4t/FAFgRAzuD4RLU2qj4ltTw9Y2// SVfmt9N5BAdUeQtF5mezVHdEjKYe7Z0xcmzuYm+EBp3CnEuhupjq6uOMnobw3w== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4ZCJDK2mtrzyb2; Wed, 12 Mar 2025 04:53:21 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: <4e719f32-7be0-46dd-8113-d8bee17a846e@FreeBSD.org> Date: Tue, 11 Mar 2025 23:53:19 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: grep(1) bug - duplicate output lines From: Kyle Evans To: Jamie Landeg-Jones , freebsd-current@FreeBSD.org References: <202309280240.38S2esgN015958@donotpassgo.dyslexicfish.net> <8d0658e9-8984-a241-ad1d-e5aa1328d7fa@FreeBSD.org> <202309291629.38TGTU56092229@donotpassgo.dyslexicfish.net> <202309291825.38TIPNN2096338@donotpassgo.dyslexicfish.net> <85039cfe-3c59-173d-f2f2-f0ca8e0fa1c8@FreeBSD.org> <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> <503a0ad0-7a03-4979-9faf-d220f7b3c3a5@FreeBSD.org> Content-Language: en-US In-Reply-To: <503a0ad0-7a03-4979-9faf-d220f7b3c3a5@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 3/11/25 21:58, Kyle Evans wrote: > On 3/11/25 19:21, Jamie Landeg-Jones wrote: >> Kyle Evans wrote: >> >>> On 9/29/23 15:37, Kyle Evans wrote: >>>> On 9/29/23 13:25, Jamie Landeg-Jones wrote: >>>>> Jamie Landeg-Jones wrote: >>>>> >>>>>> Brilliant! Thanks for the quick response and fix. It works fine >>>>>> for me - >>>>>> I've not managed to break it again :-) >>>>> >>>>> Famous last words.... >>>>> >>>>> "grep -v" now produces duplicate lines! e.g. : >>>>> >>>> >>>> Alright, fine, be that way. :-) Try this on top of the existing patch: >>>> >>>> https://people.freebsd.org/~kevans/grep-color.diff >>>> >>> >>> This should be spelled: >>> >>> https://people.freebsd.org/~kevans/grep-color-addition.diff >>> >>> Sorry >> >> Hi Kyle. This is an old thread from 2023. >> ( https://lists.freebsd.org/archives/freebsd-current/2023- >> September/004762.html ) >> > > Yikes, I completely forgot about this. > >> I've been running with these two patches since you posted them. I notice >> that they haven't been commited, and the bug reported in the thread still >> exists in current, so I'm replying to the original thread, both in the >> hope >> that this specific problem can be fixed, and then your overall fixes be >> submitted to the tree. >> >> Everything else has worked fine all this time, but today I noticed a bug >> that can be triggered like this: >> >>   | % echo boo | /usr/bin/grep '' >>   | Assertion failed: (pc->matchidx > 0), function procmatch_match, >> file /usr/src/usr.bin/grep/util.c, line 223. >>   | Abort (core dumped) >> >> This is caused by the snippet: >> >>   |        /* Print the matching line, but only if not quiet/binary */ >>   |         if (mc->printmatch) { >>   |                 size_t last_out; >>   | >>   |                 if (vflag) >>   |                         assert(pc->matchidx == 0); >>   |                 else >>   |                         assert(pc->matchidx > 0); >> >> In this case, pc-matchidx is validly 0. However, simply  Removing >> the assert from the src causes the duplicate line issue again. >> >> Why grep for '' ? Long story, but it seems to be allowed. >> Even if it isn't allowed, it shouldn't be dumping core :-) >> >> Anything further I can do to assist, please let me know. >> > > If it makes you feel better, I clearly didn't even smoke test the patch > against our own regression tests. =( > > ===> Expected failures > grep_test:zgrep_recursive  ->  expected_failure: unimplemented zgrep > wrapper script functionality: atf-check failed; see the output of the > test for details  [0.029s] > ===> Failed tests > grep_test:matchall  ->  failed: atf-check failed; see the output of the > test for details  [0.037s] > grep_test:oflag_zerolen  ->  failed: atf-check failed; see the output of > the test for details  [0.074s] > grep_test:xflag_emptypat  ->  failed: atf-check failed; see the output > of the test for details  [0.044s] > grep_test:xflag_emptypat_plus  ->  failed: atf-check failed; see the > output of the test for details  [0.047s] > grep_test:zgrep_empty_eflag  ->  failed: atf-check failed; see the > output of the test for details  [0.047s] > ===> Summary > Results read from /root/.kyua/store/ > results.usr_obj_usr_src_arm64.aarch64_usr.bin_grep_tests_checkdir_usr_tests_usr.bin_grep.20250312-025551-841462.db > Test cases: 56 total, 0 skipped, 1 expected failures, 0 broken, 5 failed > Start time: 2025-03-12T02:55:51.906277Z > End time:   2025-03-12T02:55:55.435279Z > Total time: 2.930s > -- > > Which would have revealed: > > Standard output: > Executing command [ zgrep -e  test ] > > Standard error: > Fail: incorrect exit status: 134, expected: 0 > stdout: > > stderr: > Assertion failed: (pc->matchidx > 0), function procmatch_match, file / > usr/src/usr.bin/grep/util.c, line 223. > Abort trap (core dumped) > -- > > I'll take a little bit to understand the patch I wrote back then, add an > extra test to cover the originally-reported bug, fix the patch, then get > it into Phabricator ASAP.  Sorry for dropping this- > > Thanks, > > Kyle Evans > Here we go: https://reviews.freebsd.org/D49324 Thanks, Kyle Evans From nobody Wed Mar 12 17:07:58 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCcXQ5cbkz5qCQ6 for ; Wed, 12 Mar 2025 17:08:22 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-lj1-f182.google.com (mail-lj1-f182.google.com [209.85.208.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZCcXP5XnPz3YSw for ; Wed, 12 Mar 2025 17:08:21 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.208.182 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com Received: by mail-lj1-f182.google.com with SMTP id 38308e7fff4ca-30bfca745c7so893831fa.0 for ; Wed, 12 Mar 2025 10:08:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1741799298; x=1742404098; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=2umNg1ZTJos2Igti7M67e7HIXUNHBqyK+MXgVosn744=; b=wqXNRcBQ4PiU+YZsZZBqxuBpgradROKpJG904hhFJjmfkQg/Wl24dltUOaR5HN5edd baOOMfuI+mU0oTz3w0lNe5jdSLGx0JFxRSvJr9WbH8WvfkOGPDBaXNR9hDKw6xIktgaL oagooCkktsBh6lyZ2WULepby8Ot5udx6s5W0Dc9CdprMz7oRZmKCwuEDFibO6uzo/0Ve 82JnAsHPXKEWB78ybof6WCsku0dj/akZUKjN369GyRsJsVHRRvEMGhNC1ouCvtjJPkfw QMNkgpaER6ywiL16dQpA+Wb9Sl9ZP43mjbg/+SX2Ja7J9UIDDdAjnLpFlg7uTf6WepMT 3d0Q== X-Gm-Message-State: AOJu0YyCsNUCqP6w9nqqBf7dDOOKo5VsoCehqB2ptU8zjEuI78z3GXLh IZLlnGZRYjuCN9dfN8B6MdOF5J9S7Vi02M5zrsP0MM7O+PNiuUsW0Eme40u+B2rJg5emIW4+SmB cNRwABrhINUTjFcIOEcsom1ViSlcHgv1i X-Gm-Gg: ASbGnctswEZdw/0yj1Ns39Yi8Kl+2WIca02uI8hl5dTttUKJYIKRp/y4M/7rQfntGzk 9PAcOlGzxnQD/wxW/POrXjOmrvPoxZbEubUR3+IS11Ez1ztRrF8tG1J6Q75q7jZ4Tr78crw+BVH eQjNA5iJL6KM1YFzSEjJnbWGl740/+ZqD0v6lbGW8LTvcBGjBBrvYP+iPvFh8= X-Google-Smtp-Source: AGHT+IHipD4orhrt3gUpHPFNmwheilcJRwwj10Q4F1C5d4Px9KWdxTzcYd4RdI4jrtYqdp6128PAuYBpEPJG0Yj1JR0= X-Received: by 2002:a2e:b888:0:b0:308:ec50:e841 with SMTP id 38308e7fff4ca-30bf46098d9mr90630461fa.25.1741799297800; Wed, 12 Mar 2025 10:08:17 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 From: Ed Maste Date: Wed, 12 Mar 2025 13:07:58 -0400 X-Gm-Features: AQ5f1JpULpUCAtL9jecug3hfiJPcw5Efya38QqUdxcbaZAzwboLlChyicAjAHV4 Message-ID: Subject: Heads-up: Kernel module symbol resolution changing To: FreeBSD Current Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [0.19 / 15.00]; RBL_SENDERSCORE_REPUT_9(-1.00)[209.85.208.182:from]; NEURAL_SPAM_LONG(1.00)[0.999]; NEURAL_SPAM_MEDIUM(1.00)[0.999]; NEURAL_HAM_SHORT(-0.91)[-0.909]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; RCVD_IN_DNSWL_NONE(0.00)[209.85.208.182:from]; R_DKIM_NA(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.208.182:from]; TO_DOM_EQ_FROM_DOM(0.00)[]; FREEFALL_USER(0.00)[carpeddiem]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4ZCcXP5XnPz3YSw X-Spamd-Bar: / Our in-kernel module linker currently performs symbol resolution against local symbols from other modules, which is a bug. In commits 95c20faf11a1 and ecd8245e0d77 kib introduced support to have the kernel linker stop resolving local symbols from other files, but did not change it by default to avoid surprises. The debug.link_elf_leak_locals sysctl controls this behaviour, currently defaulting to resolving against local symbols (1). Setting it to 0 turns this off. I plan to flip the default soon, in advance of FreeBSD 15.0. See PR207898 and https://reviews.freebsd.org/D47742 for more information. Next steps: 1. https://github.com/freebsd/drm-kmod/pull/338 needs to land, otherwise drm-kmod will not load. 2. Developers and users can test with debug.link_elf_leak_locals=0 and report any kernel modules that fail to load so that their build systems can be updated. 3. Commit the default change. 4. Address any additional failing kernel modules. From nobody Wed Mar 12 23:19:17 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZCmmd1PNzz5qdyJ for ; Wed, 12 Mar 2025 23:19:29 +0000 (UTC) (envelope-from minsoochoo0122@proton.me) Received: from mail-43166.protonmail.ch (mail-43166.protonmail.ch [185.70.43.166]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZCmmb2b7Pz3D8Y for ; Wed, 12 Mar 2025 23:19:26 +0000 (UTC) (envelope-from minsoochoo0122@proton.me) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=proton.me header.s=protonmail header.b="Hn8FBh2/"; dmarc=pass (policy=quarantine) header.from=proton.me; spf=pass (mx1.freebsd.org: domain of minsoochoo0122@proton.me designates 185.70.43.166 as permitted sender) smtp.mailfrom=minsoochoo0122@proton.me DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=proton.me; s=protonmail; t=1741821563; x=1742080763; bh=6/RNhKHiHzHq8dLq2AKsjMWTb294PS6SiEg9Au8OMmY=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector: List-Unsubscribe:List-Unsubscribe-Post; b=Hn8FBh2/glrAtxxY48ADdaf/8PPe61AXhtC4HJx2Cjns5Qykxd2ZWS9lBErXztEND +8ej/2og620+5oyqeo+XeZVbZNpGHdJsVZZL9YUGfeV7IQ+zs1BD0dR6l0IjW70p0D /pItgtkw6EsVQLGAr85TZCqmWHj9kT6+6DFNW4JOZjte2DBzuHO+3Zo295Li0zwqDh 0OVuy3ySOehnO806OVKI42+tXvximdF3Hm5h3yR6uwdmH9mMHI7q4InQX46nqKiwW1 OYSy/C9m2V5ZQfGsFiJNJNlQPcVveTIqr66RAUQfg65+HPsfa4nOySNtFjDX1PN7GU JBivS9o8T0HdA== Date: Wed, 12 Mar 2025 23:19:17 +0000 To: FreeBSD CURRENT From: Minsoo Choo Subject: Expected OpenSSL versions in 14-stable and 15-current Message-ID: Feedback-ID: 45891198:user:proton X-Pm-Message-ID: 81c1c56ad3608f9161615d4e85b683397e6577db List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1=_d5bygWfUgxB9XE0ohcQYwpzIMw0onfpSDnAEUmJ0QzY" X-Spamd-Result: default: False [-0.84 / 15.00]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_MEDIUM(-0.90)[-0.896]; NEURAL_SPAM_LONG(0.79)[0.790]; NEURAL_HAM_SHORT(-0.73)[-0.734]; DMARC_POLICY_ALLOW(-0.50)[proton.me,quarantine]; R_SPF_ALLOW(-0.20)[+ip4:185.70.43.0/24]; R_DKIM_ALLOW(-0.20)[proton.me:s=protonmail]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_BASE64_TEXT(0.10)[]; RWL_MAILSPIKE_GOOD(-0.10)[185.70.43.166:from]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH]; ARC_NA(0.00)[]; MISSING_XM_UA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; RBL_SENDERSCORE_REPUT_8(0.00)[185.70.43.166:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; RCVD_IN_DNSWL_NONE(0.00)[185.70.43.166:from]; DKIM_TRACE(0.00)[proton.me:+] X-Rspamd-Queue-Id: 4ZCmmb2b7Pz3D8Y X-Spamd-Bar: / --b1=_d5bygWfUgxB9XE0ohcQYwpzIMw0onfpSDnAEUmJ0QzY Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 T3BlblNTTCAzLjUgTFRTIGFscGhhIGhhcyBiZWVuIGp1c3QgcmVsZWFzZWQgWzFdLiBUaGUgZXhw ZWN0ZWQgRU9MIGRhdGUgb2YgT3BlblNTTCAzLjAgTFRTIGlzIFNlcHRlbWJlciA3dGggMjAyNiBb Ml0uIEZyZWVCU0QgMTUgaXMgZXhwZWN0ZWQgdG8gYmUgcmVsZWFzZSBpbiBEZWNlbWJlciAyMDI1 LCBhbmQgRnJlZUJTRCAxNC41IGlzIGV4cGVjdGVkIHRvIGJlIHJlbGVhc2VkIGluIFNlcHRlbWJl ciAyMDI2LiAxNC1zdGFibGUgd2lsbCBiZSBzZWUgaXRzIEVPTCBvbiBOb3ZlbWJlciAzMHRoLCAy MDI4IFszXS4KCldpbGwgRnJlZUJTRCAxNSBjb250YWluIE9wZW5TU0wgMy41IExUUyBpbiB0aGlz IERlY2VtYmVyPyBBbmQgZm9yIDE0LXN0YWJsZSwgd2lsbCBpdCBoYXZlIHVwZ3JhZGUgdG8gT3Bl blNTTCAzLjUgTFRTIGJlZm9yZSBGcmVlQlNEIDE0LjUgb3IganVzdCBtYWludGFpbiAzLjAgTFRT IHdpdGggb3VyIG93biBidWcvc2VjdXJpdHkgZml4ZXMgdW50aWwgMTQtc3RhYmxlJ3MgZW5kLW9m LWxpZmUgZGF0ZT8KClsxXSBodHRwczovL2dpdGh1Yi5jb20vb3BlbnNzbC9vcGVuc3NsL3JlbGVh c2VzL3RhZy9vcGVuc3NsLTMuNS4wLWFscGhhMQpbMl0gaHR0cHM6Ly9lbi53aWtpcGVkaWEub3Jn L3dpa2kvT3BlblNTTCNNYWpvcl92ZXJzaW9uX3JlbGVhc2VzClszXSBodHRwczovL3d3dy5mcmVl YnNkLm9yZy9zZWN1cml0eS8jc3Vw --b1=_d5bygWfUgxB9XE0ohcQYwpzIMw0onfpSDnAEUmJ0QzY Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwg MjU1KTsiPk9wZW5TU0wgMy41IExUUyBhbHBoYSBoYXMgYmVlbiBqdXN0IHJlbGVhc2VkIFsxXS4g VGhlIGV4cGVjdGVkIEVPTCBkYXRlIG9mIE9wZW5TU0wgMy4wIExUUyBpcyBTZXB0ZW1iZXIgN3Ro IDIwMjYgWzJdLiBGcmVlQlNEIDE1IGlzIGV4cGVjdGVkIHRvIGJlIHJlbGVhc2UgaW4gRGVjZW1i ZXIgMjAyNSwgYW5kIEZyZWVCU0QgMTQuNSBpcyBleHBlY3RlZCB0byBiZSByZWxlYXNlZCBpbiBT ZXB0ZW1iZXIgMjAyNi4gMTQtc3RhYmxlIHdpbGwgYmUgc2VlIGl0cyBFT0wgb24gTm92ZW1iZXIg MzB0aCwgMjAyOCBbM10uPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5z LXNlcmlmOyBmb250LXNpemU6IDE0cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQt Y29sb3I6IHJnYigyNTUsIDI1NSwgMjU1KTsiPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZh bWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsgY29sb3I6IHJnYigwLCAw LCAwKTsgYmFja2dyb3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+V2lsbCBGcmVlQlNE IDE1IGNvbnRhaW4gT3BlblNTTCAzLjUgTFRTIGluIHRoaXMgRGVjZW1iZXI/IEFuZCBmb3IgMTQt c3RhYmxlLCB3aWxsIGl0IGhhdmUgdXBncmFkZSB0byBPcGVuU1NMIDMuNSBMVFMgYmVmb3JlIEZy ZWVCU0QgMTQuNSBvciBqdXN0IG1haW50YWluIDMuMCBMVFMgd2l0aCBvdXIgb3duIGJ1Zy9zZWN1 cml0eSBmaXhlcyB1bnRpbCAxNC1zdGFibGUncyBlbmQtb2YtbGlmZSBkYXRlPzwvZGl2PjxkaXYg c3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyBj b2xvcjogcmdiKDAsIDAsIDApOyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAyNTUsIDI1NSk7 Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBm b250LXNpemU6IDE0cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJn YigyNTUsIDI1NSwgMjU1KTsiPlsxXSA8c3Bhbj48YSB0YXJnZXQ9Il9ibGFuayIgcmVsPSJub3Jl ZmVycmVyIG5vZm9sbG93IG5vb3BlbmVyIiBocmVmPSJodHRwczovL2dpdGh1Yi5jb20vb3BlbnNz bC9vcGVuc3NsL3JlbGVhc2VzL3RhZy9vcGVuc3NsLTMuNS4wLWFscGhhMSI+aHR0cHM6Ly9naXRo dWIuY29tL29wZW5zc2wvb3BlbnNzbC9yZWxlYXNlcy90YWcvb3BlbnNzbC0zLjUuMC1hbHBoYTE8 L2E+PC9zcGFuPjxicj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMt c2VyaWY7IGZvbnQtc2l6ZTogMTRweDsgY29sb3I6IHJnYigwLCAwLCAwKTsgYmFja2dyb3VuZC1j b2xvcjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+WzJdIDxzcGFuPjxhIHRhcmdldD0iX2JsYW5rIiBy ZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVuZXIiIGhyZWY9Imh0dHBzOi8vZW4ud2lraXBl ZGlhLm9yZy93aWtpL09wZW5TU0wjTWFqb3JfdmVyc2lvbl9yZWxlYXNlcyI+aHR0cHM6Ly9lbi53 aWtpcGVkaWEub3JnL3dpa2kvT3BlblNTTCNNYWpvcl92ZXJzaW9uX3JlbGVhc2VzPC9hPjwvc3Bh bj48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBm b250LXNpemU6IDE0cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJn YigyNTUsIDI1NSwgMjU1KTsiPlszXSA8c3Bhbj48YSB0YXJnZXQ9Il9ibGFuayIgcmVsPSJub3Jl ZmVycmVyIG5vZm9sbG93IG5vb3BlbmVyIiBocmVmPSJodHRwczovL3d3dy5mcmVlYnNkLm9yZy9z ZWN1cml0eS8jc3VwIj5odHRwczovL3d3dy5mcmVlYnNkLm9yZy9zZWN1cml0eS8jc3VwPC9hPjwv c3Bhbj48YnI+PC9kaXY+ --b1=_d5bygWfUgxB9XE0ohcQYwpzIMw0onfpSDnAEUmJ0QzY-- From nobody Thu Mar 13 10:51:41 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZD47W6prJz5qT44 for ; Thu, 13 Mar 2025 10:51:51 +0000 (UTC) (envelope-from jamie@catflap.org) Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [IPv6:2001:19f0:7400:8808:12:4:0:1]) by mx1.freebsd.org (Postfix) with ESMTP id 4ZD47V0qZ6z3vh0; Thu, 13 Mar 2025 10:51:49 +0000 (UTC) (envelope-from jamie@catflap.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=pass (policy=none) header.from=catflap.org; spf=pass (mx1.freebsd.org: domain of jamie@catflap.org designates 2001:19f0:7400:8808:12:4:0:1 as permitted sender) smtp.mailfrom=jamie@catflap.org X-Catflap-Envelope-From: Received: from donotpassgo.dyslexicfish.net (donotpassgo.dyslexicfish.net [209.250.224.51]) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5) with ESMTP id 52DApfmh079467; Thu, 13 Mar 2025 10:51:41 GMT (envelope-from jamie@donotpassgo.dyslexicfish.net) Received: (from jamie@localhost) by donotpassgo.dyslexicfish.net (8.14.5/8.14.5/Submit) id 52DApfMi079466; Thu, 13 Mar 2025 10:51:41 GMT (envelope-from jamie) From: Jamie Landeg-Jones Message-Id: <202503131051.52DApfMi079466@donotpassgo.dyslexicfish.net> Date: Thu, 13 Mar 2025 10:51:41 +0000 Organization: Dyslexic Fish To: kevans@FreeBSD.org, jamie@catflap.org, freebsd-current@FreeBSD.org Subject: Re: grep(1) bug - duplicate output lines References: <202309280240.38S2esgN015958@donotpassgo.dyslexicfish.net> <8d0658e9-8984-a241-ad1d-e5aa1328d7fa@FreeBSD.org> <202309291629.38TGTU56092229@donotpassgo.dyslexicfish.net> <202309291825.38TIPNN2096338@donotpassgo.dyslexicfish.net> <85039cfe-3c59-173d-f2f2-f0ca8e0fa1c8@FreeBSD.org> <883774ff-c630-72bf-ebc3-cc53e4d40d03@FreeBSD.org> <202503120021.52C0LG7D088609@donotpassgo.dyslexicfish.net> <503a0ad0-7a03-4979-9faf-d220f7b3c3a5@FreeBSD.org> <4e719f32-7be0-46dd-8113-d8bee17a846e@FreeBSD.org> In-Reply-To: <4e719f32-7be0-46dd-8113-d8bee17a846e@FreeBSD.org> User-Agent: Heirloom mailx 12.4 7/29/08 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Greylist: Sender passed SPF test, not delayed by milter-greylist-4.2.7 (donotpassgo.dyslexicfish.net [209.250.224.51]); Thu, 13 Mar 2025 10:51:41 +0000 (GMT) X-Spamd-Result: default: False [0.37 / 15.00]; NEURAL_SPAM_MEDIUM(0.95)[0.949]; NEURAL_SPAM_SHORT(0.60)[0.599]; DMARC_POLICY_ALLOW(-0.50)[catflap.org,none]; NEURAL_HAM_LONG(-0.47)[-0.474]; R_SPF_ALLOW(-0.20)[+mx:dyslexicfish.net]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; HAS_ORG_HEADER(0.00)[]; FREEFALL_USER(0.00)[jamie]; TO_DN_NONE(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20473, ipnet:2001:19f0:7400::/38, country:US]; RCVD_COUNT_TWO(0.00)[2]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-current@FreeBSD.org] X-Rspamd-Queue-Id: 4ZD47V0qZ6z3vh0 X-Spamd-Bar: / Kyle Evans wrote: > > Which would have revealed: > > > > Standard output: > > Executing command [ zgrep -e  test ] > > > > Standard error: > > Fail: incorrect exit status: 134, expected: 0 > > stdout: > > > > stderr: > > Assertion failed: (pc->matchidx > 0), function procmatch_match, file / > > usr/src/usr.bin/grep/util.c, line 223. > > Abort trap (core dumped) > > -- > > > > I'll take a little bit to understand the patch I wrote back then, add an > > extra test to cover the originally-reported bug, fix the patch, then get > > it into Phabricator ASAP.  Sorry for dropping this- > > > > Thanks, > > > > Kyle Evans > > > > Here we go: https://reviews.freebsd.org/D49324 Wow, that was quick! Cheers! Yes, despite my best efforts :-), it works perfectly for me (14-stable) Anyway, not only should I have run the tests, I totally forgot about the original issue too - your patch was in my local patch tree, which is distributed to all my hosts, so I forgot the patch hadn't been commited - so much so, when I stumbled upon the current assert issue, I was initially puzzled where the difference between my copy of util.c and the one in current came from! Thanks for your help! Jamie From nobody Sat Mar 15 00:01:03 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZF1bn4y1kz5r0H2; Sat, 15 Mar 2025 00:01:09 +0000 (UTC) (envelope-from salvadore@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZF1bn1wcMz3n13; Sat, 15 Mar 2025 00:01:09 +0000 (UTC) (envelope-from salvadore@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741996869; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc; bh=MOt3JUbsSwogspikhDU3md59jyyBtFNCoGPaPtNHItw=; b=uskq38tvSvlXkWmyBje1w1Nkju1r9NpylD3oEZc5pT9YQZSI8dRVGDTYIPnuBx1s0axmWr wgopqOJQtwMR0VY1Y09kmYzi3a+VozK8CG78u0Jb6qsONrsWfC2mLqCfaRgjH9ma7fbT/R PJRqvQ6Fu3yP2IKSAYFXIJP0qWB44n7spUNeksP11rY7Jhd2J9nfy0l7o9DIugsC9KCEvR 4y7uqzihqJkJXCNQSd2dgOf7EEXmH5rU78AbNXmuR3X/XdoDoVWZv4IsBwBsEbYi9DDMrF aTnpe8C2p8/V/QORFLFrP46oxRWSJRCjT3oAuDLFd/aAdEkR6NgVT1ciAH7oRg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1741996869; a=rsa-sha256; cv=none; b=TgytjI3WxU5lvALmzRYyTfgCn3wn1Oa0JIlvp70D0IGLSGTpghvztJZ+iiwbh4Wrhy816z YO7NF0A/lm4j0l4w3kvCeadKljJiQnSVKM3G+APV2U6ya4aMv3CH90Gqfyugj6NIzp2e5m zGPF7cOYuuMc2PVyvFD9/S1B8rkqaCx6/Ptfa4KfDkj6zFAN7UidA7MF2vq0gPSEX+JhFn rrX/uD6i1ma/TgbHo8AOGUyNLQMBPmT/5r7P2pCNiGjSkBkeiQKE20dj5MCvdn4KzHStYD HVYj6KiXTuR3xC2GMrli8ifweKI1BFiYJuQVC0jiLD85B3waH1QvXZSADQ8l2g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1741996869; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc; bh=MOt3JUbsSwogspikhDU3md59jyyBtFNCoGPaPtNHItw=; b=q/LoxdCnj3hxSgRC048xoPWC4Wg0BT95jTxbRiLNrZQcdqH79uPua7RIbBb7SvVkrdqzef ofSAkEMMdyZHPir3vR7yhdmCMSSEY6FdNTsuvjM8O7IqmjAZ5QA8dCuovvlcwWJSECDcN/ 5Y4r176Rh3LkMN+s+KxZPExs9Ww9nDQa9tFmbbUCFH5BH5mkxiTNsrIQAbg99c7C2Ck5zg qBE9hwpxWasyYVjDy1QBXb7JSv7GIGCBJxlXCqBZr/ZlqZN/x7LOnH9Xb2rKCbVDF0N1/M IS7o8BdjcT0eIexm4PBynEnKsqEkdmNicbjcjZTS9C19ZicBFDEdZfq76O3WqQ== Received: by freefall.freebsd.org (Postfix, from userid 1472) id F1EB914D51; Sat, 15 Mar 2025 00:01:03 +0000 (UTC) To: freebsd-status-calls@FreeBSD.org Subject: [2 WEEKS LEFT REMINDER] Call for 2025Q1 status reports Cc: freebsd-current@FreeBSD.org,freebsd-hackers@FreeBSD.org,devsummit@FreeBSD.org,secretary@asiabsdcon.org Message-Id: <20250315000108.F1EB914D51@freefall.freebsd.org> Date: Sat, 15 Mar 2025 00:01:03 +0000 (UTC) From: Lorenzo Salvadore List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org Dear FreeBSD Community, The deadline for the next FreeBSD Status Report update is March, 31st 2025 for work done since the last round of quarterly reports: January 2025 - March 2025. I would like to remind you that reports are published on a quarterly basis and are usually collected during the last month of each quarter, You are also welcome to submit them even earlier if you want, and the earlier you submit them, the more time we have for reviewing. Status report submissions do not need to be very long. They may be about anything happening in the FreeBSD project and community, and they provide a great way to inform FreeBSD users and developers about work that is underway or has been completed. Report submissions are not limited to committers; anyone doing anything interesting and FreeBSD related can -- and should -- write one! The following methods are available to submit your reports: * submit a review on Phabricator and add the group "status" to the reviewers list. You should put your reports in the directory doc/website/content/en/status/report-2025-01-2025-03/ (create it if it is missing); * submit a pull request at . You should put your reports in the directory doc/website/content/en/status/report-2025-01-2025-03/ (create it if it is missing); * send an email to status-submissions@FreeBSD.org including your report. An AsciiDoc template is available at . We look forward to seeing your 2025Q1 reports! Thanks, Lorenzo Salvadore (on behalf of status@) From nobody Sat Mar 15 11:26:54 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZFJqk1XXyz5qcdm for ; Sat, 15 Mar 2025 11:27:30 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZFJqh0YNHz3vwy for ; Sat, 15 Mar 2025 11:27:28 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=D9alfuSK; dmarc=pass (policy=quarantine) header.from=leidinger.net; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 89.238.82.207 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1742038040; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ci1WVY/lSAb+5mZsR9xfwuskBdwMGiEABstlteTL0+4=; b=D9alfuSKn4WVatB5gomoTurl4DHdcffSKSw33jUQEoDQqAUUASf45nwKWrG+xQdRjjkUQ3 xgpLymm488NnUw59zMBfhpy/oTqP2KkN1/ee/t1b5iOUg2KkNsnj22JpS9iLgeLxAb+J1O 0jdHZYDRC1kf39sBOUxU472O3fQb5bHXV/oYG+i0dmJTAcuVrnS1k4qnV/owR9qNjfg4MW +vuBrifd8Gu51yYu9NuImnbd6OBh6abxb6gV83AH8HlyMqebqbU2cxnnPrAkWilUxmxu9b aVs+rEq8aGJ5oHVgyAG41gHk4DARbJLTbdJAPNiwABaABDKTGjiQ+dvekFCduQ== Date: Sat, 15 Mar 2025 12:26:54 +0100 From: Alexander Leidinger To: Current FreeBSD Subject: -fstack-clash-protection triggers something in setfstab() (was: Re: Strange file access issue in a recent -current (but not with the previous BE)) In-Reply-To: <5ebbe12dc6cb4e3fc00f0a07c03856e4@Leidinger.net> References: <5ebbe12dc6cb4e3fc00f0a07c03856e4@Leidinger.net> Message-ID: <2400b4d10d4804eef784768d050f6953@Leidinger.net> Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_bea1f836c22f1b8fb7b1bfc7060d4c02"; micalg=pgp-sha256 X-Spamd-Result: default: False [-3.84 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_SPAM_LONG(0.99)[0.994]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_MEDIUM(-0.84)[-0.837]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; ONCE_RECEIVED(0.10)[]; MISSING_XM_UA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE]; HAS_ORG_HEADER(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; HAS_ATTACHMENT(0.00)[] X-Rspamd-Queue-Id: 4ZFJqh0YNHz3vwy X-Spamd-Bar: --- This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_bea1f836c22f1b8fb7b1bfc7060d4c02 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2025-02-26 16:20, schrieb Alexander Leidinger: > Hi, > > the working system is from 2025-01-25-141603, the non working system is > from 2025-02-21-115311. > > I'm not sure what the issue is exactly. I have traced down the change > of behavior to > ---snip--- > if not LIBC.setfstab(fstab_file_path.encode()): > ---snip--- > > In the working case LIBC.setfstab returns true (so with the not it > doesn't take this branch), and in the non-working case it returns false > (so with the not it takes this branch). > > Is someone aware of a change in this area? Searching for it > (https://cgit.freebsd.org/src/log/?qt=grep&q=setfstab) only brings the > initial commit. Interestingly my own commit triggers this issue. I bisected and commit 1c2ae9233b0ed4f6b92c59c0e4026f6ddc073e4a is causing this. This is the first ref which triggers the issue that iocage can not mount filesystems anymore. And the failing call in iocage seems to be the python LIBC.setfstab() call. And this only triggers, when the basesystem is compiled with the stack clash protection. I do not see any obvious issue in our setfstab code. Anyone with an idea? Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_bea1f836c22f1b8fb7b1bfc7060d4c02 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmfVZA4ACgkQEg2wmwP4 2IZ5vw/+JlvBO2JZii5MoFYAVLJSfiXnWnYPENEehJ8pfe4Fpt068M+PXFlf304s K7zYKsJ30PT2c0fogZPKcc35zDlZOZcFeRpMbzEghp9luAJCpVv09m/2C2blQiT5 RWJhowpWijFfrk3prsyD+ZlA1nTx8lmHLKukXRte/s7cbaBZMxd1gcAG7Sd0quYk 7Punq+OXj+P8fth2jUXcu/aeuRroNvitCgAZOYjA0t977f/yjzz5iEsOVIZpitlP GPaUG3qBhA8K41QvFGhcH0Qen/P1WXvdWnNT6Xq7SDwRtBiAo8X7I6LG++WR8MZg 6Q5qLRktDtVpH2bdvJkq2BbRqUg/TsbbCd5GfoZIj6cISUY/qKCn83Mirwf8ben7 lmnuQ9IbzwDwvFOtZ+kXoVgQ/xtwRB8fDoptomjZkePt6sitiguTeualJKsiwZg+ fuZt3SZLL0ngvqTUkqKvtfrsw9jEJaZF8wZ4MZI8dKwtzjyxqh4PE9bfm6Dg2GF2 EmK1DvDYgFxWUykYHs7Eq3v5xN6eVDGoOB2CWdgoXz7AyXaLDBQyicgWVYMWpnep UoqS1JvIzn/MMwQei0B2H9MOR7mxYtW96Nwg7Z/NGHCEvLzCA4DX4einfJbMu7VY 8FWNY2PkzLjNzE2cdTtBvisoq88KcRJq6m8wtRgOSakPTO8yq5M= =Kcuw -----END PGP SIGNATURE----- --=_bea1f836c22f1b8fb7b1bfc7060d4c02-- From nobody Sat Mar 15 13:33:00 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZFMcY5Zy3z5qnmS for ; Sat, 15 Mar 2025 13:33:01 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZFMcY4BtTz3lqs; Sat, 15 Mar 2025 13:33:01 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1742045581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Pbf+4+Hs2V5gcbhSUw3gKAaYIFGZ/1txNBhrsQZ9+9I=; b=es7QZRhxLwzWkT9DjPWSy/+7i0DGor53nB1TjLGYt1bBMrDPlNRnrKckF2Y4uK2/qhqm/s fQVhtwztdfTsEsp3X04TM0bCXQcJCvBuu990Tm438uuDWcdizwbpjuoqsz9d4sJADzjB98 uiKSwWv3surdrEWTk6iLunsHPyLuBzLoOmIAGJP96nR7gkjSdASjA0eJ/j1ddmnhnqpT+a WSKZhDNoBwUgyDzdkzgqrqxII15fECtOyKRmQdXqUTm6wkweIOMjUjnKwv/I+ornSAlrSx DqPE71Rch8SbqyrFdb+mEkXdd3ijiQK9B3U+W/tO7dbnpuGGg10PG8R9vZuNHg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1742045581; a=rsa-sha256; cv=none; b=yCGIZBd9hAtChqmWTba2aTwKiRlM8xiPRCCRlLANFsFTtPwXynR2+dcnJzT9BsnXcoo29C 3i+2EeYZpgcomgefwIuZug1qm9iIpvYV9LUMh1OcJn87OykjamC3gxwfoQ7y3/tlGCKAZt 4vjGgR77QjFK/2x5HA/D0DQC6r+RW+16EIRBCoEn1O/t2krz7JT5PtW9oKyuOG9gJojUB2 P9Zq7CUL4JKqKukZEbQBWjdvRSUsHBQ8j7N+Uh0S5RvPhAKgHSa1gF1jTHEOgeyk5U155f +tqiMJKVgWn1GyAwWfY1TayMSGXyGyIMw6/idYm9jLRnWxQcO6vd7nzPRoSCXA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1742045581; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Pbf+4+Hs2V5gcbhSUw3gKAaYIFGZ/1txNBhrsQZ9+9I=; b=QLsxnLiOvmfgxW+NZ4zLFNwEu2nqzrGf87OgsNclUlNVVqH6rZPgWf9BnrPADnRNhRq2h9 ulRK9egQUCzpcmhRHqorXTfRWIRyUwaiBWwiLMcGk2SQw+MTW8mkIa7Nt6gpuNGXx0cTkF lKzhxvNfMkqydyuT5gPFW3aZZfnaAzedXCWnK1LqftOmEz/uXbstZ5KNBCd7oz7w3iUNpW MqRtb8Q5mKZxAVvHNvjELpK7NzMblv9h9YM6vb/0yEUwd0SHYFFojNC919VDiErCkXsDJq WjR9tiGnqzgCgOK2Ovoe7jq9grHSpxPUIYIliaDdo9Aa1kvE4CfXsz5W6Up8WA== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4ZFMcY20S6zp2h; Sat, 15 Mar 2025 13:33:01 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: Date: Sat, 15 Mar 2025 08:33:00 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: -fstack-clash-protection triggers something in setfstab() To: freebsd-current@freebsd.org References: <5ebbe12dc6cb4e3fc00f0a07c03856e4@Leidinger.net> <2400b4d10d4804eef784768d050f6953@Leidinger.net> Content-Language: en-US Cc: Michael Gmelin From: Kyle Evans In-Reply-To: <2400b4d10d4804eef784768d050f6953@Leidinger.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit [+grembo@ for iocage] On 3/15/25 06:26, Alexander Leidinger wrote: > Am 2025-02-26 16:20, schrieb Alexander Leidinger: >> Hi, >> >> the working system is from 2025-01-25-141603, the non working system >> is from 2025-02-21-115311. >> >> I'm not sure what the issue is exactly. I have traced down the change >> of behavior to >> ---snip--- >> if not LIBC.setfstab(fstab_file_path.encode()): >> ---snip--- >> >> In the working case LIBC.setfstab returns true (so with the not it >> doesn't take this branch), and in the non-working case it returns >> false (so with the not it takes this branch). >> >> Is someone aware of a change in this area? Searching for it (https:// >> cgit.freebsd.org/src/log/?qt=grep&q=setfstab) only brings the initial >> commit. > > Interestingly my own commit triggers this issue. > > I bisected and commit 1c2ae9233b0ed4f6b92c59c0e4026f6ddc073e4a is > causing this. This is the first ref which triggers the issue that iocage > can not mount filesystems anymore. And the failing call in iocage seems > to be the python LIBC.setfstab() call. And this only triggers, when the > basesystem is compiled with the stack clash protection. I do not see any > obvious issue in our setfstab code. Anyone with an idea? > setfstab() implementation seems more or less fine, but it's hard to tell what's going on with iocage there. setfstab(3) doesn't actually have a return value in any version of FreeBSD, so I guess it's picking up some sort of garbage as the return value. Looking at the context, you can only tell if the open failed with the subsequent getfsent()/setfsent(); that branch should probably just be removed entirely, and the initial getfsent() might be worth error-checking for potential error or premature EOF. Thanks, Kyle Evans From nobody Sat Mar 15 14:07:44 2025 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZFNNn1CXQz5qrYt for ; Sat, 15 Mar 2025 14:07:53 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZFNNl3NSQz41vt for ; Sat, 15 Mar 2025 14:07:51 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.18.1/8.18.1) with ESMTP id 52FE7iUI044788 for ; Sat, 15 Mar 2025 14:07:44 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.18.1/8.18.1/Submit) id 52FE7iDE044787 for current@freebsd.org; Sat, 15 Mar 2025 07:07:44 -0700 (PDT) (envelope-from david) Date: Sat, 15 Mar 2025 07:07:44 -0700 From: David Wolfskill To: current@freebsd.org Subject: Possible video driver issue after main-n275966-d2a55e6a9348 -> main-n275975-5963423232e8 Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="3P5bEmw5UtMM5XpS" Content-Disposition: inline X-Spamd-Result: default: False [1.62 / 15.00]; REPLYTO_EQ_TO_ADDR(5.00)[]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-0.999]; NEURAL_SPAM_MEDIUM(0.99)[0.990]; NEURAL_HAM_SHORT(-0.97)[-0.974]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170]; TO_DN_NONE(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; DMARC_NA(0.00)[catwhisker.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; MISSING_XM_UA(0.00)[]; FREEFALL_USER(0.00)[david]; MLMMJ_DEST(0.00)[current@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; HAS_REPLYTO(0.00)[current@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4ZFNNl3NSQz41vt X-Spamd-Bar: + --3P5bEmw5UtMM5XpS Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable No issues with that in-place source update for my headless buld machine, but a couple of laptops blanked out and seem to have locked up on the reboot after the build/install completed. I'm tracking head daily on these machines (1 headless build machine; 2 laptops). And the vast bulk of the time, this "just works." Today wasn't one of thoe times. :-} I keep their sources pretty much in lock-step, and also update installed ports daily. (Though that's actually done under stable/14, which I also track daily.) Once one of the laptops would lock up (didn't even get to display the xdm login banner), I couldn't even ping it, so unfortunately, I have precious little actual information to offer (though I'm happy to experiment, given suitable clues). For the (successful) build machine the last couple of "uname" outputs were: FreeBSD 15.0-CURRENT #151 main-n275966-d2a55e6a9348: Fri Mar 14 11:00:43 UT= C 2025 root@freebeast.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64= /sys/GENERIC amd64 1500034 1500034 FreeBSD 15.0-CURRENT #152 main-n275975-5963423232e8: Sat Mar 15 10:59:14 UT= C 2025 root@freebeast.catwhisker.org:/common/S4/obj/usr/src/amd64.amd64= /sys/GENERIC amd64 1500034 1500034 For the laptops, I was able to reboot using kernel.old (the one =66rom yesterday, main-n275966-d2a55e6a9348), though I didn't exercise the machines much. As the laptops were booting, I had the impression that at the point where the screen normally switched to "graphics" mode, it just blanked out & never displayed anything again (until I power-cycled the machine). Each laptop has an integrated Intel graphics device, and I have: PORTS_MODULES+=3Dgraphics/drm-61-kmod in /etc/src.conf to ensure that that kernel module gets rebuilt whenever the kernel does. Peace, david --=20 David H. Wolfskill david@catwhisker.org Thank you, Claude Malhuret. https://wickedemerald.wordpress.com/2025/03/08/speech-from-claude-malhuret/ See https://www.catwhisker.org/~david/publickey.gpg for my public key. --3P5bEmw5UtMM5XpS Content-Type: application/pgp-signature; name=signature.asc -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSTLzOSbomIK53fjFliipiWhXYx5QUCZ9WJsF8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0OTMy RjMzOTI2RTg5ODgyQjlEREY4QzU5NjI4QTk4OTY4NTc2MzFFNQAKCRBiipiWhXYx 5e16AP44VYYCL/ZwMtmufEKq1qxHGvTHrf1zMdcCpBN9DCZRSgEAuSIqstPpVrqm SFy6JpjlGgygT+UZfNDCE8X1NIPfkAs= =ID8v -----END PGP SIGNATURE----- --3P5bEmw5UtMM5XpS-- From nobody Sun Mar 16 12:10:09 2025 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ZFxlj732hz5qNRl for ; Sun, 16 Mar 2025 12:11:13 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (prime256v1) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "E5" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ZFxlj2N3Sz3v1t; Sun, 16 Mar 2025 12:11:13 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; none List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@FreeBSD.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1742127065; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=du/3TIDxHicJO0PvgfeLxUWQNC9N6SCY6xhaF/pOBcQ=; b=DHgbar8FDMb5/xQRuV8Cd7dD8aRAXdEfHMCoxxU/Hk77/pFgkLXlg19dpUMJ3Nie4O2xrt ZF/VYBRoivavxXIg9COM52JQhBcxQk9IMrjU9ApRiTtkO61BaRsSpaWZTjKd+QRBO/YaOt gQPcKO52ZmD6PIQzJdPf7zEYgXGLx2x1uctjfRo5QF4xUR7wcmrszJGP/v8Tg82qvWbdjC SYa6k1sI/llPXQAGU6PpHN+gIEIf8We3yJJiil05+Dv9US55/PT9kPnRi5gfU0sJ7hjcXc AQ60f/kHhyTpqlmOXwQwV3Fg2UwDS0rgEv3TWHxiCPAcpbfGp8w+l/66AOsEJA== Date: Sun, 16 Mar 2025 13:10:09 +0100 From: Alexander Leidinger To: Kyle Evans Cc: freebsd-current@freebsd.org, Michael Gmelin Subject: Re: -fstack-clash-protection triggers something in setfstab() In-Reply-To: References: <5ebbe12dc6cb4e3fc00f0a07c03856e4@Leidinger.net> <2400b4d10d4804eef784768d050f6953@Leidinger.net> Message-ID: <62ea7e3809ca3146e0868cb06ef1fbdc@Leidinger.net> Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_9f9dd6b77dc32804b898bc206665df1e"; micalg=pgp-sha256 X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE] X-Rspamd-Queue-Id: 4ZFxlj2N3Sz3v1t X-Spamd-Bar: ---- This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_9f9dd6b77dc32804b898bc206665df1e Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2025-03-15 14:33, schrieb Kyle Evans: > [+grembo@ for iocage] > > On 3/15/25 06:26, Alexander Leidinger wrote: >> Am 2025-02-26 16:20, schrieb Alexander Leidinger: >>> Hi, >>> >>> the working system is from 2025-01-25-141603, the non working system >>> is from 2025-02-21-115311. >>> >>> I'm not sure what the issue is exactly. I have traced down the change >>> of behavior to >>> ---snip--- >>> if not LIBC.setfstab(fstab_file_path.encode()): >>> ---snip--- >>> >>> In the working case LIBC.setfstab returns true (so with the not it >>> doesn't take this branch), and in the non-working case it returns >>> false (so with the not it takes this branch). >>> >>> Is someone aware of a change in this area? Searching for it (https:// >>> cgit.freebsd.org/src/log/?qt=grep&q=setfstab) only brings the initial >>> commit. >> >> Interestingly my own commit triggers this issue. >> >> I bisected and commit 1c2ae9233b0ed4f6b92c59c0e4026f6ddc073e4a is >> causing this. This is the first ref which triggers the issue that >> iocage can not mount filesystems anymore. And the failing call in >> iocage seems to be the python LIBC.setfstab() call. And this only >> triggers, when the basesystem is compiled with the stack clash >> protection. I do not see any obvious issue in our setfstab code. >> Anyone with an idea? >> > setfstab() implementation seems more or less fine, but it's hard to > tell what's going on with iocage there. setfstab(3) doesn't actually > have a return value in any version of FreeBSD, so I guess it's picking > up some sort of garbage as the return value. > > Looking at the context, you can only tell if the open failed with the > subsequent getfsent()/setfsent(); that branch should probably just be > removed entirely, and the initial getfsent() might be worth > error-checking for potential error or premature EOF. I tried this, and it works: ---snip--- # diff -u /usr/local/lib/python3.11/site-packages/iocage_lib/ioc_fstab_ok.py /usr/local/lib/python3.11/site-packages/io cage_lib/ioc_fstab.py --- /usr/local/lib/python3.11/site-packages/iocage_lib/ioc_fstab_ok.py 2025-02-26 14:54:37.381812000 +0100 +++ /usr/local/lib/python3.11/site-packages/iocage_lib/ioc_fstab.py 2025-03-16 12:55:30.496569000 +0100 @@ -159,15 +159,16 @@ ) fstab_list = [] with FSTAB_LOCK: - if not LIBC.setfstab(fstab_file_path.encode()): - iocage_lib.ioc_common.logit( - { - 'level': 'EXCEPTION', - 'message': f'Unable to open {fstab_file_path}' - }, - _callback=self.callback, - silent=self.silent - ) + LIBC.setfstab(fstab_file_path.encode()) + #if not LIBC.setfstab(fstab_file_path.encode()): + # iocage_lib.ioc_common.logit( + # { + # 'level': 'EXCEPTION', + # 'message': f'Unable to open {fstab_file_path}' + # }, + # _callback=self.callback, + # silent=self.silent + # ) try: set_fstab_path = ensure_unicode_str(LIBC.getfstab()) if set_fstab_path != fstab_file_path: ---snip--- Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_9f9dd6b77dc32804b898bc206665df1e Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmfWv7EACgkQEg2wmwP4 2IYMOhAAmZBLbDFPFW07EBVdPVAJXwwnTfg3977clqV4TNnkjl+iW5yAS4ebz9Ob Mg9B5uqTZ8EI0fBmOwNxbosLz+y7+5sxtsMq6/0c2sKplBFdBewrZToV7hNytwqb iL+dazFr527pC+OGSgRJLH1wnByqOiEGdTnTqh9kMuRa1GgDJoiUf7UdcZT5OSC/ oSJdHXlMs4ZOGIsTALzsleaU1gEzhdFI8In1CaFLcHgrHSrBgq7QJS645gfMNkF3 hrT64hsMyKtklVNyYSCIwoTeMhN7ZbxSPk8HNSDh1vJeetIVTzDUDIB57jjIAwjx Vuzv7QJaLnNS5+JedVrezSsDV9QquCjhoTQQdtuINBlwaKaix3Mi/EowS6cNhPFQ qzMQ94hvBNsnBMxto4h/anC1kA1NbRzAWcRHxH31xZJHdOIf5u8wKx7SsPCkauYC +1FiP3q1afg3K209P2whCp7uoMg4hlMuVXjK0d+6MvdjhmaJCghqL3Uc96iJsRti Xzl+b+JvkqbmiZiP5QCrZTYDYmRUDqAb05QXn/E1vde+Toge6h81tu0KKCnv8RvU 3p5bLZg06WfGZFbeGorhuvJwSagv3iEN0bwO1KkH/UfD994TWZrutAG0Yvuft3kG xbfnjJBdF5bChNT8fAteG3ivB9aTn2SNFRhDn0W/AuTipsRKiXI= =78Gq -----END PGP SIGNATURE----- --=_9f9dd6b77dc32804b898bc206665df1e--