From nobody Sun Sep 10 03:18:44 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjw6b15DWz4srW9 for ; Sun, 10 Sep 2023 03:18:47 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjw6b0g6Dz4vnd; Sun, 10 Sep 2023 03:18:47 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694315927; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ywyGRPsE67kJSNN8RoJj+XqdB8OiJOg9H6w3oIVwWSI=; b=eBHitE+gV2dARG5csZ/TyM+M8O61b6CFHUmQc8Gi6MufuMvIxCSl0XdN8Wk/NrtOFgAD9C QZzdZZXonQiLyLd0yvk9FNY/zwauNoRfsB/Kr3JYhtn+sotYYYhoe5tL2MquuNwybs2Te3 jwWJtpJ9Mf+ouQqgzPsusmCMQd2mPRgUIxkTbSj8uTkmto8jAmCHTBKLNbFqiIozPRGCCW j02X59kFyS7WIyjSlBIDTIxjvWkMUf4UyQv5NgdtWITRHOeRZaOo0oQLuqfIrOMm3GoVNn OFJK+dFPZ/duG06/jeIfC6eQ9anOaCxnuUDbCQ+EFVD8sfneHhX7Z5PBlVzK5A== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694315927; a=rsa-sha256; cv=none; b=m12WiFEEwHVAjn7Jbj5ZMKHTwdauFUtL+SNkHzB+Fyt/PKUfLbjSgiBbEnUqfpdfiG7eDN 2EKolz3BvA//rVJsf0FYfCSU7CHvyu0tgLSydMsfncVAa4jIUKNDO85Jw8QFaFyXbzWEMB gNiSb7l6x3ZkzyM3uK0NkxUkMrILk3MnBCNDN/HZvgZrj2hbyPIhLVcFE25VyqUUqjAc7p a1hpRZHkzLvafZqgFmlxy0yfjdK0PJg8ITrYFLnvsRHfRmcejANEQ3STMZBqPNkCQnAGZ0 +y2/dtmLna5Aw4cLTwLXpk5sbmAdzfww9AB3qv5Rpq/vfJhdOQ38zi3fEPKkRg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694315927; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ywyGRPsE67kJSNN8RoJj+XqdB8OiJOg9H6w3oIVwWSI=; b=dfhA2AdckHZiE+Md7b/G2xD7TvqrnKUTpYCIGsoM6bD6SfFvdBMWV4U5bgAR35+wiF9RRs ePi5PqWd5Q9FkRolXMuX0h/IZFNM2OYiLYh5f1Yb4C+uspkscrkMQyRogPn7vnRPvutDf/ 7gynQRmbxdVs+doeR8O8Jfl7dOdZD5twZxKiL8zgF05LFonSMxY3pjU332N0X0DZScJDVo dzfaR1igVokPsG8LQBVkH1icMESfHAZaG9mZbbD5dWXJkSiXBK4aTXmO6JFXzN0RSQI+KK YUc6RHmGf5/f17Q+FAjAR0ilD5Z4ulPMNVBVvL0rnej1x6Z+N1WkAyTpVt0ZJQ== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rjw6Z5sktz1NNj; Sun, 10 Sep 2023 03:18:46 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 7D1F24EB4F; Sun, 10 Sep 2023 05:18:44 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Rainer Hurling Cc: Rainer Hurling , current Subject: Re: 15.0-CURRENT build broken in lib/libmagic In-Reply-To: <09885472-d22e-4c1e-b71e-ad0bc24ff6fa@gwdg.de> (Rainer Hurling's message of "Sat, 9 Sep 2023 20:52:04 +0200") References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> <86il8jqnvr.fsf@ltc.des.no> <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> <86a5tvqjza.fsf@ltc.des.no> <09885472-d22e-4c1e-b71e-ad0bc24ff6fa@gwdg.de> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Sun, 10 Sep 2023 05:18:44 +0200 Message-ID: <865y4ira0b.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Rainer Hurling writes: > Unfortunately, here it breaks with: > [...] > /usr/src/lib/libc/gdtoa/machdep_ldisx.c:40:10: fatal error: 'sys/cdefs.h'= file not found That's because you wiped /usr/obj before starting. Try running 'make buildincludes' inside the buildenv before building libc. If that still fails, just run buildworld; it will fail in libmagic as before but it will have built libc before failing, and you can install libc and restart the build. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sun Sep 10 04:51:09 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjy9D079cz4scbd for ; Sun, 10 Sep 2023 04:51:12 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "fuz.su", Issuer "fuz.su" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjy9C1svnz3f7X for ; Sun, 10 Sep 2023 04:51:11 +0000 (UTC) (envelope-from fuz@fuz.su) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of fuz@fuz.su designates 2001:41d0:8:e508::1 as permitted sender) smtp.mailfrom=fuz@fuz.su; dmarc=none Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 38A4p9vQ018206 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 10 Sep 2023 06:51:10 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 38A4p9Fc018205 for current@freebsd.org; Sun, 10 Sep 2023 06:51:09 +0200 (CEST) (envelope-from fuz) Date: Sun, 10 Sep 2023 06:51:09 +0200 From: Robert Clausecker To: current@freebsd.org Subject: Re: sed in CURRENT fails in textproc/jq Message-ID: References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <86edj7qnia.fsf@ltc.des.no> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; R_SPF_ALLOW(-0.20)[+a:c]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; DMARC_NA(0.00)[fuz.su]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; MIME_TRACE(0.00)[0:+]; BLOCKLISTDE_FAIL(0.00)[2001:41d0:8:e508::1:server fail]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[fuz]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rjy9C1svnz3f7X Greetings, I apologise for the inconvenience. The issue seems to boil down to various places calling memchr(buf, c, SIZE_MAX); which causes an overflow when my newly written memchr() computes buf + len to find the end of the buffer. A patch to alleviate this issue can be found here: http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-behaviour-with-ov.patch Please check if it does the trick for you. If yes, I'll go ahead and push it tomorrow-ish. Yours, Robert Clausecker Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Smørgrav: > Antoine Brodin writes: > > Yuri writes: > > > Either something has changed in sed(1) in CURRENT, or sed just fails > > > during the configure stage of textproc/jq: > > > > > > sed: No error: 0 > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > This seems to be a recent issue (less than 5 days). > > Hundreds of configure scripts now fail to run on 15-current due to > > this sed failure: [...] > > Try adding ARCHLEVEL=scalar to CONFIGURE_ENV on one of these. If that > helps, yell at fuz@ :) > > DES > -- > Dag-Erling Smørgrav - des@FreeBSD.org > -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From nobody Sun Sep 10 05:33:35 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjz69742vz4t4Q7 for ; Sun, 10 Sep 2023 05:33:37 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Received: from xmailer.gwdg.de (xmailer.gwdg.de [134.76.10.29]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjz696fHtz4NjK; Sun, 10 Sep 2023 05:33:37 +0000 (UTC) (envelope-from rhurlin@gwdg.de) Authentication-Results: mx1.freebsd.org; none Received: from excmbx-05.um.gwdg.de ([134.76.9.209] helo=email.gwdg.de) by mailer.gwdg.de with esmtp (GWDG Mailer) (envelope-from ) id 1qfD4i-000EnE-TJ; Sun, 10 Sep 2023 07:33:36 +0200 Received: from MBX19-GWD-03.um.gwdg.de (10.108.142.56) by excmbx-05.um.gwdg.de (134.76.9.209) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384_P384) id 15.1.2507.32; Sun, 10 Sep 2023 07:33:36 +0200 Received: from [192.168.178.23] (10.250.9.199) by MBX19-GWD-03.um.gwdg.de (10.108.142.56) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384) id 15.2.1258.25; Sun, 10 Sep 2023 07:33:36 +0200 Message-ID: <62c0b736-33a7-083d-cbdc-875a81883473@gwdg.de> Date: Sun, 10 Sep 2023 07:33:35 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: 15.0-CURRENT build broken in lib/libmagic To: =?UTF-8?Q?Dag-Erling_Sm=c3=b8rgrav?= CC: current References: <9183fcf6-2987-c06c-dbda-49a791e1c004@gwdg.de> <86il8jqnvr.fsf@ltc.des.no> <607c793f-96bf-5244-5e72-574f690b04b4@gwdg.de> <86a5tvqjza.fsf@ltc.des.no> <09885472-d22e-4c1e-b71e-ad0bc24ff6fa@gwdg.de> <865y4ira0b.fsf@ltc.des.no> Content-Language: en-US Reply-To: Rainer Hurling From: Rainer Hurling In-Reply-To: <865y4ira0b.fsf@ltc.des.no> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: 8bit X-Originating-IP: [10.250.9.199] X-ClientProxiedBy: excmbx-14.um.gwdg.de (134.76.9.225) To MBX19-GWD-03.um.gwdg.de (10.108.142.56) X-Virus-Scanned: (clean) by clamav X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:207592, ipnet:134.76.0.0/16, country:DE] X-Rspamd-Queue-Id: 4Rjz696fHtz4NjK Am 10.09.23 um 05:18 schrieb Dag-Erling Smørgrav: > Rainer Hurling writes: >> Unfortunately, here it breaks with: >> [...] >> /usr/src/lib/libc/gdtoa/machdep_ldisx.c:40:10: fatal error: 'sys/cdefs.h' file not found > > That's because you wiped /usr/obj before starting. Try running 'make > buildincludes' inside the buildenv before building libc. If that still > fails, just run buildworld; it will fail in libmagic as before but it > will have built libc before failing, and you can install libc and > restart the build. > > DES Yes, that works! Now I have a working, most recent 15.0-CURRENT again :D I think now I understand how to use the buildenv to build individual parts. Many thanks for that and for your help and patience. Regards, Rainer From nobody Sun Sep 10 07:31:05 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk1k65QDcz4s3Z8 for ; Sun, 10 Sep 2023 07:31:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-23.consmr.mail.gq1.yahoo.com (sonic311-23.consmr.mail.gq1.yahoo.com [98.137.65.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk1k56j3qz3Tpt for ; Sun, 10 Sep 2023 07:31:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=OyiQJDzc; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694331083; bh=KCvBMF0pqUTKBW2rqm2632SPFqJgWu2xcNGGdeGIGr4=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=OyiQJDzc2m5l8PS3UVDr3KzgIhVd/4bfUPEykxfZLs0E90M6pRGWv6ZUgitKS5zoXNDo4h9IPoYp2VSla9eCiCfy5Fzf1ooZn8J5cPgMyJDDQPIYmQLqWh9HHXXqh4at7Pa6nAuYfIoXBiEpgnkt0nZ374Z8oS2PuOtrNGR1BTsuwTzfYWxUeuyr8u8yjTZCu9Gf+K87xnWFOwocaDQSWH+iLUgbDQBYdoMEmKZj3CQz5MoL/hhocBLRHBpIXPyCpDMKRH0JiPfvfhJR6ZuOQGrSuQKcVziRMu+vZ24kUWaen7u/jlKBAr25mHmDMD8eJglCvfXLqMGEKjQsaGYLGQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694331083; bh=hBBEKiPFBMd0Yzko7Q4eGKxVcDPGdV14Oz0Mx3Y/2Zl=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ZubkpRWWlKwteVrRzt191mtd/2UiiXXTe+W9rPBfSWZYTZUrpd/aJ2fL3QJVYN+XcI4NxwVKrYoOh0ncXKCS5f4bQlr1NWB4HFc+iqeDIlR2Vaf6x+a4jWkVBMnGbWe7Cu3h0qvToYQHBBVWBCqNpvWP/99t0QxtPVIOEfQigOURk9rUG+lscnhmWTVgc1G3eYLWfP1UR65nPPwWhb4n8OaxyF3/JUz+1et0QVQsCTGLwWWx8fPPDyaqGzWXdvc5YB1ZUU9kzr3IJjuOtbl+GczY8gzl82L1FVOxU9sD/Lo/2keffBQvkUknncoh58F7S4WnGKo8j3ywgMBg3sI+Pw== X-YMail-OSG: rdHHi_MVM1kQ6oBd89oSNpd99LqEUfMnA_IUFgwpJIon9y1QvQ_Y1amJ79vrsAX oPI7zj0eQTKsdVnddnQPPnoEmoGTSDX4uPk6APmh55LyAH8eho9SPMupLZY_lf25Q1PiVk0cWDT9 uOq_6gwyGRDOoVbccn9DXNCabU4S.VaeZiKJnhO9S7oq2w566dIkUzm8HGGRurJLMLSwPefevWDZ MOhkJOwN.ROwDCj.9wnjednTBSnKNSHr23..5KIZ9Pqbffr_1eKsK.XjtMjukvY7Kv91ZLvDrdRk 4zBT_l8serg8YEJIs2QQkVUCIQMdHr42EOHUq0MZBSq9NZvjEl.wj68SnQGLleFyDJKulCQMQHVL 2KFXGXyCK1S.0ZZ1QB4FKJPrIze.g92Cvzm6_Wn74BBD9E51McETa2lQlbp5sVARZRWjzjgfbT_W I4TZ.Kb.8KZ_mBo9joa.avwWmLJ2ihqHdCDdo4.rVWE8gtG73R4rrYtvix355KBSiaaWeMlv8Vsu sfkbVu3ztY53zeGMorrK.oRjDmBQqa0W3ABphh7X48DwZKpd_XCfbrBB9l_mxPEgsuEeX_kg9BgI 0Cg28TjKE82TfoDPKr6SSLNHYdHI7p9RnSNA6CL6x9FPTBSMvwKk0RMO7vF.qyuTkKZc9aXABLAl UU_YWSyDTvIx1mJYtl7edx8ZYhzEol7K8BuDzp_OBwv_r0X7g_2AKvSPpB7Mh1UgS7bIHtrAqulQ X1x.E9dNNj163nZdLGXyz9IimSwvQbzzuseXGLz0FPsmMYGdWwao69illBR6a6hBlTWH0l_z_QZo pMkEz4cOrInncCwAhxZeeGoikICFw0MMg9mP7p.6GDv3tII1s8KQl3qMz5tC0Yla1gF8VGzwAh1Y 6YS73c3WQX.g_M310VO1UQKA6I3T3fTPS.JsN2uGtn_WIqbGvEybYsP9iJDtwedoD3p0GBtRAg9q VqprJhVYCBiKlmsAcnSklkCmRaGgJro6WsK6szGAziXtCHfnCR24B9HMquzcdTRVuj8C2NU5zHzY vG3TzWiGdBrz1m3WtSqY9V9S9WjwtWicRWuh_1KIgg3f7VuRVj1dqcopw04Eg0s7C5dUdo4DZiiy RKgArx6saU5RcghY1zwbzzA0DgqbJ_C3.u5.vwxD8oaO12OO6Sx5MRrC4UA8aGJs58E12W5g.3HQ ldgecMvD3QcsGXTzKFU05DXQOzGjHZE9n6sFlJYmykiV7C4F40.PdS7z.rxtOUFZZhhdZTrVPbZo qOMVaaJnfGyvS3z2LehaRzJ63NIfiYh9_QQYk92VIPZ0SDUskiwcClsJh.Il46Z2wTM8wWzvVa_Y GIwz0.ezia_UHEJGJoIhlezkeOwXd8rhdBfJvbx2q7dzZQZ4VWPEv.S_Jpdga.Ryy6FLAZHBJit8 brfP3GvNbv_qwOD_NnqkunrO_bFZaAmSsbyPM.o1Iyv8EgWJ5aiR8kPplGrRfOeE.PeTp8V01h7v agqYPJemg2dvnHX1IPkJXTSCD1_l7nKaPjPm3tTCKn_BRg8TGBMKV5n4pStgXSKicWxxW4V7Q1yv cpfQzFDWD1oZmhNUcY.3iFCZkMyhKdqq7GcCtNcM38lx710V9KLPmhRFlNB4Lt4v3LArfzCB_5TV 9F59jHuAPrVxiao2sghbXxYP_qBlMAbO8gb6UhvEe1U0FyH2ODs4K13ikJm03AVD6aUVEQnBjAgu 8cC4uKgmu58f_GoZUVCjCAMrLSipFwe68RsnwmKTJSKFI0JUnzPyC2sJRG2yj77PvuqMLUBoaHb0 r1LfZXS1nR5xI22w8C_C5z2YLt7_T52OEpP4jALqHbbm75WVocmGZvi3T41DK1j2BcykhmwpLtnD T0JBjtkyv5v3Z581wts.4kodWCHun8bItXLvVPYXn1bcM6NXr2yZoC.CCl_tBeGIpdwkteEnprlb C0udG9WRWv144k67zIMCm1hfK6f2qXFMumR6lEtWr_Purt8b49RC3H8LIgW33bmASlg2kJEMllNH 9YbyKgymQBB18W9JMgHSty4saJB3XoefFcFzBiVk5RkGoAzfSixlrj7p3kcB7jsVwK1LajwwQwNe ak749ee.cl4UalsF1sXjBG6X0xhB.kTmuaOBt9UzMYhhNJ8hvIhJuH6lwqApapuZ7NqC5ppw5CIB 9aErzyHpig8tqBXrPN6OmMXsobJ0DaBKRovrWGssHHfN9GSsvtaMTVR.Mo49Rt6gm5tmpLYSBGdb 8rWktTqrbIuXJ0rjswZ2Pu0Fas9sKMn7IouPaZtO5otDwzlHWFm3sP5BDT57Fxlx3chnCbMrjkLW U0KGAaKeRiiQ- X-Sonic-MF: X-Sonic-ID: 013dcad6-56d3-434c-9dd9-8a31b4d942c6 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 07:31:23 +0000 Received: by hermes--production-bf1-865889d799-sjjww (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 5d9bd5503bf1d429fdfe2520d9091de2; Sun, 10 Sep 2023 07:31:18 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char Message-Id: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> Date: Sun, 10 Sep 2023 00:31:05 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm To: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.46 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.961]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rk1k56j3qz3Tpt kyua tests that use the: /usr/tests/sys/cddl/zfs/bin/mkfile program like so (for example): mkfile 500M /testpool.1861/bigfile.0 (which should be valid) end up with mkfile instead reporting: Standard error: Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... which prevent the kyua test involved from working. Turns out this is from expecting char to be always signed (so a -1 vs. 255 distinction, here in an aarch64 context): . . . (gdb) list 179 /* Options. */ 180 while ((ch = getopt(argc, argv, "nv")) != -1) { 181 switch (ch) { 182 case 'n': 183 nofill = 1; 184 break; 185 case 'v': (gdb) print ch $16 = 255 '\377' (gdb) print/x -1 $17 = 0xffffffff (gdb) print/x ch $18 = 0xff . . . With the mix of unsigned and signed it ends up being a 0xffu != 0xffffffffu test, which is always true. So the switch is reached as if a "-" prefix was present (that is not). Then the "option" is classified as invalid and the usage message is produced. Apparently no one had noticed. That, in turn, suggests a lack of inspected testing on aarch64, powerpc64, powerpc64le, armv7, powerpc, and powerpcspe. That, in turn, suggests that kyua test inspection for the likes of aarch64 is not historically a part of the release process for openzfs or for operating systems that include openzfs. === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 11:41:05 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk7GF3GPjz4sDL0 for ; Sun, 10 Sep 2023 11:41:09 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk7GF1BsWz4H62; Sun, 10 Sep 2023 11:41:09 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-99c136ee106so430319066b.1; Sun, 10 Sep 2023 04:41:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694346067; x=1694950867; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=I5GndDcKtLDbLLNgjJPNe+G49Gm7gtImK06PIPseP9w=; b=X5xD7AbWWxHbgbpzjFH40LG9P5HjJgQm6xrYnvvLSaRQ6bHA5+D/6aKLGP5zN1GFpk ZaLrrWZTOFgCuz/UFwAr0d+iVEkc4EnQaGRxi3OcF3wL2rzMF1m7Gw6D/Yi4yL9Xhgeh JIqIvd4BC+FOi3lD6vtct5fBZEoZTsu9MgSM1dkET+iRtEGVM8VkQun7sftFjoB0EjxJ a4hNJbxSPSIBS3Z/5x4zoQg2CKUbZWK4lVf538avvHqKoCUcVKLLPUNonNjekqnijiUq W0ADRc/3+5PE+vNf09PsVYsQCB2nB0WlCnvhsTfpKRub52ivzNYgW2V4MjyWhSOYY5YZ /nYQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694346067; x=1694950867; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=I5GndDcKtLDbLLNgjJPNe+G49Gm7gtImK06PIPseP9w=; b=uxvmyvYW1B4oLxjo9jZJi13LEdjbtMSUeJgvsLfF9o1hO5eumGgIlfMBoJodkMC5PK nbN7SxsLvt1INfPev/9L/PnKlXMilXJ65gjqAuBmoSy1SbZFb/AJTLcrUSGP+Q0rwMio F7UPebVLSEYAeFWVXAC1Q6ghuvc8JOg7rrjGN60K0LniggQt2RryOQBcIaKKFkWTQAX6 MgODFCBOwee+f5w4YzHWKfR5tdEixvlGI7XXy8HpljYzNy5py5ivuZQ434odmT473S/N PNlHF+yBuMi7qd5Du4j82re8artvTkchjdm+uPeBhxct4IdXA9O6A53ZIMyOjDtnkNXn IsaQ== X-Gm-Message-State: AOJu0YxC3rJJ3pNDhLwVkMxRK0bz6joO7iCEuLze0Rx58JM/wzzw/K9E TpwuX0Kd91ZvgxzNe8F1qdgwWqaBHHKeNQ== X-Google-Smtp-Source: AGHT+IE/yqJQXJcy5EBavXqQN8pJEz/2eMkGgPEvG4shqVtHA9ySVuCdpSA3jHYJdeAh2y+Em8rvWA== X-Received: by 2002:a17:907:78d1:b0:9a1:edfd:73bb with SMTP id kv17-20020a17090778d100b009a1edfd73bbmr6102893ejc.47.1694346066804; Sun, 10 Sep 2023 04:41:06 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id lj16-20020a170906f9d000b00992d0de8762sm3686552ejb.216.2023.09.10.04.41.05 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 10 Sep 2023 04:41:06 -0700 (PDT) Message-ID: <1067e373-01fb-4c10-5b97-1c784b3ed895@gmail.com> Date: Sun, 10 Sep 2023 12:41:05 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: /var/db/etcupdate/ in hier(7) (was: user problems when upgrading to v15) To: John Baldwin Cc: "freebsd-current@freebsd.org" , Dimitry Andric References: <5c5c3ea5-5b14-d969-f55f-b894e4983359@sonicboom.org> <46ee9e3b-adeb-4cd1-5fcc-43547c5c7231@gmail.com> <222e96ba-70b6-e976-8e32-d3726dde18b1@sonicboom.org> <7CDB341A-F9E1-4816-8443-E4C349A86C84@FreeBSD.org> <865dc0ef-a19d-876c-b0a5-03b888b531f5@FreeBSD.org> Content-Language: en-US From: Graham Perrin In-Reply-To: <865dc0ef-a19d-876c-b0a5-03b888b531f5@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rk7GF1BsWz4H62 On 09/09/2023 17:02, John Baldwin wrote: > On 9/2/23 7:11 AM, Dimitry Andric wrote: >> … > > … /var/db/etcupdate/conflicts, … Shall I make a simple (non-contentious) pull request for hier(7) to include /var/db/etcupdate/ and the conflicts/ subdirectory? /var/db/etcupdate/ is present by default with a clean installation of 15.0-CURRENT. I guess that conflicts/ appears (and remains after resolution) only after the first conflict is found. True? From nobody Sun Sep 10 11:51:43 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk7Vk1XSyz4sLsD for ; Sun, 10 Sep 2023 11:51:58 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk7Vj5Y9mz4LXg for ; Sun, 10 Sep 2023 11:51:57 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x634.google.com with SMTP id a640c23a62f3a-9a63b2793ecso437676566b.2 for ; Sun, 10 Sep 2023 04:51:57 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694346716; x=1694951516; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=1NWeWAfcSymsvvyk6ucufpv40BJ1XHQxginjnWDH6DQ=; b=R2oWC9UHJqu2Ce5s0ZKGvhmEis1Nm1QfqSbKIFUlAaHmsyKek92J3T0lMMo7nqBpxT qo1oi3ymCjzWsBRRQU9ZTJuIMsbqtZ9V6mAl9GQBnzs6pdQAOQWidRppMmn0rN9YoF7e Kto5piABQFjII274L1MiyocPr4oDJCdgNxUMw92K5LWOd1qk7NdcS3xweM1ecM7aBpVq p7L6Wtz4K7gkMw8LSlt/JQp3fWLTsCa6bNB3q9oZYDOLthjtMhBs89wc34GGg4j8+5FP vfRNw/UsBitXulpnnCOH1lEm69Fym7xkzPYB2B3mmeV1tg+vtQvRMqOPAv2uxlsGrh6V kAbg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694346716; x=1694951516; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=1NWeWAfcSymsvvyk6ucufpv40BJ1XHQxginjnWDH6DQ=; b=Z4L/ghhAisolCtGzULC95VvMHx9tf75EGqkdSO1eEoVlHUm+QO8AoQNGDCHq0+CMOO H9ckrMPXPJOoAmpWt7AHk9ess9d+/KKC+CPMPhEV0Jup9ygM4JkEcYudwiUMirJ4/BcR myXVVLNjZD3M+QB02gx/9OxHs2C0acLzPmOM4EEzdyZ9rx7HyKmS7iQRuPSfciONM43P TYAr/hViL3a0UEDHgG4z+ck+85F9AlpyAKm1Vh8pit14R3imw/Apn1luDUP3CeUgUjEa QgT8BpUJKVvKhsILkBmwP7S+ZMTOUuV7Pc3rx3bdHMKfP9Juo6lTJiwg0EEEDO9jPY5w 4p/A== X-Gm-Message-State: AOJu0Yzgz52bO0e/UW8gIp3I403gucg1LU1JKsnsfGypqfGqjVCGJBcE mRCFoV5tawGoLvxid3HFFlgfHyoRU0N1jLEJfZ5gTTqiCzut6F1D X-Google-Smtp-Source: AGHT+IFhBq3w+dotpLvVedCbYQvQWUluvOKRyDSv0XsPg6j5unZm/2WH31vK6ZdxufC9RRop5nX0oc2Fi81eSRsWzOo= X-Received: by 2002:a17:907:a071:b0:9aa:17c1:c41e with SMTP id ia17-20020a170907a07100b009aa17c1c41emr2540668ejc.29.1694346715137; Sun, 10 Sep 2023 04:51:55 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> In-Reply-To: From: Warner Losh Date: Sun, 10 Sep 2023 05:51:43 -0600 Message-ID: Subject: Re: sed in CURRENT fails in textproc/jq To: Robert Clausecker Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="000000000000151a540604ffd64c" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rk7Vj5Y9mz4LXg --000000000000151a540604ffd64c Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker wrote: > Greetings, > > I apologise for the inconvenience. The issue seems to boil down to > various places calling > > memchr(buf, c, SIZE_MAX); > > which causes an overflow when my newly written memchr() computes buf + > len to find the end of the buffer. A patch to alleviate this issue can > be found here: > > > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-behavi= our-with-ov.patch > > Please check if it does the trick for you. If yes, I'll go ahead and > push it tomorrow-ish. > There are half a dozen or do kyua tests that are likely failing because of this or other reasons related to strings. When you push this fix you'll get the list. They are hidden among about 80 or so networking tests that fail. I plan on disabling those tests soon If no one fixes them. Warner > > Yours, > Robert Clausecker > > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Sm=C3=B8rgrav= : > > Antoine Brodin writes: > > > Yuri writes: > > > > Either something has changed in sed(1) in CURRENT, or sed just fail= s > > > > during the configure stage of textproc/jq: > > > > > > > > sed: No error: 0 > > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > This seems to be a recent issue (less than 5 days). > > > Hundreds of configure scripts now fail to run on 15-current due to > > > this sed failure: [...] > > > > Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of these. If tha= t > > helps, yell at fuz@ :) > > > > DES > > -- > > Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org > > > > -- > () ascii ribbon campaign - for an 8-bit clean world > /\ - against html email - against proprietary attachments > > --000000000000151a540604ffd64c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker <fuz@fuz.su> wrote:
Greetings,

I apologise for the inconvenience.=C2=A0 The issue seems to boil down to various places calling

=C2=A0 =C2=A0 memchr(buf, c, SIZE_MAX);

which causes an overflow when my newly written memchr() computes buf +
len to find the end of the buffer.=C2=A0 A patch to alleviate this issue ca= n
be found here:

=C2=A0 =C2=A0 http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr= .S-fix-behaviour-with-ov.patch

Please check if it does the trick for you.=C2=A0 If yes, I'll go ahead = and
push it tomorrow-ish.


There are half a dozen or = do kyua tests that are likely failing because of this or other reasons rela= ted to strings.=C2=A0 When you push this fix you'll get the list. They = are hidden among about 80 or so networking tests that fail. I plan on disab= ling those tests soon If no one fixes them.

Warner=C2=A0

Yours,
Robert Clausecker

Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Sm=C3=B8rgrav:<= br> > Antoine Brodin <antoine@freebsd.org> writes:
> > Yuri <yuri@freebsd.org> writes:
> > > Either something has changed in sed(1) in CURRENT, or sed ju= st fails
> > > during the configure stage of textproc/jq:
> > >
> > > sed: No error: 0
> > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution=
> > This seems to be a recent issue (less than 5 days).
> > Hundreds of configure scripts now fail to run on 15-current due t= o
> > this sed failure: [...]
>
> Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of these.=C2=A0 = If that
> helps, yell at fuz@ :)
>
> DES
> --
> Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org
>

--
()=C2=A0 ascii ribbon campaign - for an 8-bit clean world
/\=C2=A0 - against html email=C2=A0 - against proprietary attachments

--000000000000151a540604ffd64c-- From nobody Sun Sep 10 12:58:37 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk8zp0bl4z4s65x; Sun, 10 Sep 2023 12:58:46 +0000 (UTC) (envelope-from mike@karels.net) Received: from mail2.karels.net (mail2.karels.net [3.19.118.201]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "freebsd", Issuer "freebsd" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk8zn5mqQz3DCl; Sun, 10 Sep 2023 12:58:45 +0000 (UTC) (envelope-from mike@karels.net) Authentication-Results: mx1.freebsd.org; none Received: from mail2.karels.net (localhost [IPv6:0:0:0:0:0:0:0:1]) by mail2.karels.net (8.17.1/8.17.1) with ESMTP id 38ACwb8u013537; Sun, 10 Sep 2023 07:58:37 -0500 (CDT) (envelope-from mike@karels.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=karels.net; s=mail2; t=1694350718; bh=23LKbuZhxZ330IzoDPq0Rmobyt8gO+qow7yHWojVXl0=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=WNXzCurJFcRFkts/7GiinT6IYHp61r6LTed/6nhXL6wAhht20qoXpi95kUB6gfhSj /RNWxPSWRR/oqf7H5/0g/mMev8Gsi+Q7SYId9B9E7V1IKYY1suqnFc5B/Gk9tH+zZv qv3iUKGf+wb18NMnYZQnxhXWTnpA/sdColhYNF3uMppKMli2p3Cs8rbTyWItaQxNM4 kMXEwsv8oyy7245wQ1Zvhayvyp4/NHT+QQhMRKl5VIgefLXkYJ5V8PsadpR7ou6Slj uZdiM3rUAwPz2QdRkaG15bfHG5CCh2ZBsU0lnv5KCxL6/lT4atroekWi7tqRGXyHlD o4wPVh7fGV0Lw== Received: from [10.0.2.130] ([73.62.165.147]) by mail2.karels.net with ESMTPSA id k6IfLH29/WTfNAAAs/W3XQ (envelope-from ); Sun, 10 Sep 2023 07:58:37 -0500 From: Mike Karels To: Mark Millard Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char Date: Sun, 10 Sep 2023 07:58:37 -0500 X-Mailer: MailMate (1.14r5964) Message-ID: In-Reply-To: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16509, ipnet:3.16.0.0/14, country:US] X-Rspamd-Queue-Id: 4Rk8zn5mqQz3DCl On 10 Sep 2023, at 2:31, Mark Millard wrote: > kyua tests that use the: > > /usr/tests/sys/cddl/zfs/bin/mkfile > > program like so (for example): > > mkfile 500M /testpool.1861/bigfile.0 > > (which should be valid) end up with mkfile > instead reporting: > > Standard error: > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > which prevent the kyua test involved from working. > > Turns out this is from expecting char to be always > signed (so a -1 vs. 255 distinction, here in an > aarch64 context): > > . . . > (gdb) list > 179 /* Options. */ > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > 181 switch (ch) { > 182 case 'n': > 183 nofill = 1; > 184 break; > 185 case 'v': > (gdb) print ch > $16 = 255 '\377' > (gdb) print/x -1 > $17 = 0xffffffff > (gdb) print/x ch > $18 = 0xff > . . . > > With the mix of unsigned and signed it ends up > being a 0xffu != 0xffffffffu test, which is > always true. mkfile is broken. getopt returns an int, and -1 on end. It never returns 0xff. But mkfile declares ch as char, which truncates the return value -1. ch is a bad (misleading) variable name, although getopt(3) uses it as well (but declared as int). Mike > So the switch is reached as if a "-" prefix was > present (that is not). Then the "option" is classified > as invalid and the usage message is produced. > > Apparently no one had noticed. That, in turn, suggests a > lack of inspected testing on aarch64, powerpc64, > powerpc64le, armv7, powerpc, and powerpcspe. That, in > turn, suggests that kyua test inspection for the likes > of aarch64 is not historically a part of the release > process for openzfs or for operating systems that include > openzfs. > > > === > Mark Millard > marklmi at yahoo.com From nobody Sun Sep 10 13:06:36 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk9964203z4sCFl for ; Sun, 10 Sep 2023 13:06:50 +0000 (UTC) (envelope-from developer@lorenzosalvadore.it) Received: from mail-4323.proton.ch (mail-4323.proton.ch [185.70.43.23]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk9961Z5sz3JjP for ; Sun, 10 Sep 2023 13:06:50 +0000 (UTC) (envelope-from developer@lorenzosalvadore.it) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=lorenzosalvadore.it; s=protonmail3; t=1694351207; x=1694610407; bh=8zUjOe66d0CUjubYGOhexfOZTJdQZCKB8ZWZ5s4vBGs=; h=Date:To:From:Cc:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=ZBVu/s2B1zpH70m7hkINa6ElAyNVmtB1H1XNTJFrAHewzSqAoDE4x/GmjyL3Z4KlL 2IZkjUXIqeY3pTW4dFkB9gX2QZ23zAykNOYj3DmeDD+CT9HViD+c7T8Pr4hN6aZP4f 1rKX9XhZe/WGsE6ZVJZYBgwO9OkflIN8gx9VIuRfs8bNtB1OYkw9E+4YFGXotMbcz8 jxVnZZHNjlpJFQRVHxZxs0AzV0NqWr6QftuLHhoMxUVNf4s2rgIaOh8wIAto9wEIxy q3e/pJgBJ2Tq2wqGlqQ/z1KP7uqb0Eu3oq7NCDXk9zLTU5UbeKXeOVNaxVPwIsuDHN /bzBn+7Njm1dw== Date: Sun, 10 Sep 2023 13:06:36 +0000 To: Warner Losh From: Lorenzo Salvadore Cc: Robert Clausecker , FreeBSD Current Subject: Re: sed in CURRENT fails in textproc/jq Message-ID: <0uCAJNKOmP1ftVb8nkaEqKL7B1F8w5PXxHRrSvTVY70xHnF4f2J8k8QNGnwkMWnq8GgSgCDc7Kp27RNKjvZnkDsQdpNpDKqDxlCrkcpfGvE=@lorenzosalvadore.it> In-Reply-To: References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> Feedback-ID: 53711648:user:proton List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH] X-Rspamd-Queue-Id: 4Rk9961Z5sz3JjP ------- Original Message ------- On Sunday, September 10th, 2023 at 13:51, Warner Losh wrot= e: >=20 >=20 > On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker wrote: >=20 > > Greetings, > >=20 > > I apologise for the inconvenience. The issue seems to boil down to > > various places calling > >=20 > > memchr(buf, c, SIZE_MAX); > >=20 > > which causes an overflow when my newly written memchr() computes buf + > > len to find the end of the buffer. A patch to alleviate this issue can > > be found here: > >=20 > > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-beha= viour-with-ov.patch > >=20 > > Please check if it does the trick for you. If yes, I'll go ahead and > > push it tomorrow-ish. >=20 >=20 >=20 > There are half a dozen or do kyua tests that are likely failing because o= f this or other reasons related to strings. When you push this fix you'll g= et the list. They are hidden among about 80 or so networking tests that fai= l. I plan on disabling those tests soon If no one fixes them. >=20 > Warner >=20 > >=20 > > Yours, > > Robert Clausecker > >=20 > > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Sm=C3=B8rgr= av: > > > Antoine Brodin writes: > > > > Yuri writes: > > > > > Either something has changed in sed(1) in CURRENT, or sed just fa= ils > > > > > during the configure stage of textproc/jq: > > > > > > > > > > sed: No error: 0 > > > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > > This seems to be a recent issue (less than 5 days). > > > > Hundreds of configure scripts now fail to run on 15-current due to > > > > this sed failure: [...] > > > > > > Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of these. If th= at > > > helps, yell at fuz@ :) > > > > > > DES > > > -- > > > Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org > > > > >=20 > > -- > > () ascii ribbon campaign - for an 8-bit clean world > > /\ - against html email - against proprietary attachments > >=20 The issue seems to also affect lang/gcc14-devel: https://pkg-status.freebsd.org/beefy18/data/main-amd64-default/pe88937b01dd= 4_s3482f57f0f/logs/gcc14-devel-14.0.0.s20230903.log Cheers, Lorenzo Salvadore From nobody Sun Sep 10 13:36:26 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk9qM1BVHz4sXRX for ; Sun, 10 Sep 2023 13:36:31 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "fuz.su", Issuer "fuz.su" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk9qL586qz3Tvl for ; Sun, 10 Sep 2023 13:36:30 +0000 (UTC) (envelope-from fuz@fuz.su) Authentication-Results: mx1.freebsd.org; none Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 38ADaRKU020176 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 10 Sep 2023 15:36:27 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 38ADaQnE020175; Sun, 10 Sep 2023 15:36:26 +0200 (CEST) (envelope-from fuz) Date: Sun, 10 Sep 2023 15:36:26 +0200 From: Robert Clausecker To: Warner Losh Cc: FreeBSD Current Subject: Re: sed in CURRENT fails in textproc/jq Message-ID: References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR] X-Rspamd-Queue-Id: 4Rk9qL586qz3Tvl Hi Warner, I have pushed a fix. It should hopefully address those failing tests. The same issue should also affect memcmp(), but unlike for memchr(), it is illegal to pass a length to memcmp() that extends past the actual end of the buffer as memcmp() is permitted to examine the whole buffer regardless of where the first mismatch is. I am considering a change to improve the behaviour of memcmp() on such errorneous inputs. There are two options: (a) I could change memcmp() the same way I fixed memchr() and have implausible buffer lengths behave as if the buffer goes to the end of the address space or (b) I could change memcmp() to crash loudly if it detects such a case. I could also (c) leave memcmp() as is. Which of these three choices is preferable? Yours, Robert Clausecker Am Sun, Sep 10, 2023 at 05:51:43AM -0600 schrieb Warner Losh: > On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker wrote: > > > Greetings, > > > > I apologise for the inconvenience. The issue seems to boil down to > > various places calling > > > > memchr(buf, c, SIZE_MAX); > > > > which causes an overflow when my newly written memchr() computes buf + > > len to find the end of the buffer. A patch to alleviate this issue can > > be found here: > > > > > > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-behaviour-with-ov.patch > > > > Please check if it does the trick for you. If yes, I'll go ahead and > > push it tomorrow-ish. > > > > > There are half a dozen or do kyua tests that are likely failing because of > this or other reasons related to strings. When you push this fix you'll > get the list. They are hidden among about 80 or so networking tests that > fail. I plan on disabling those tests soon If no one fixes them. > > Warner > > > > > Yours, > > Robert Clausecker > > > > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Smørgrav: > > > Antoine Brodin writes: > > > > Yuri writes: > > > > > Either something has changed in sed(1) in CURRENT, or sed just fails > > > > > during the configure stage of textproc/jq: > > > > > > > > > > sed: No error: 0 > > > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > > This seems to be a recent issue (less than 5 days). > > > > Hundreds of configure scripts now fail to run on 15-current due to > > > > this sed failure: [...] > > > > > > Try adding ARCHLEVEL=scalar to CONFIGURE_ENV on one of these. If that > > > helps, yell at fuz@ :) > > > > > > DES > > > -- > > > Dag-Erling Smørgrav - des@FreeBSD.org > > > > > > > -- > > () ascii ribbon campaign - for an 8-bit clean world > > /\ - against html email - against proprietary attachments > > > > -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From nobody Sun Sep 10 14:14:18 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkBgB3lw7z4sxKw for ; Sun, 10 Sep 2023 14:14:30 +0000 (UTC) (envelope-from cglogic@protonmail.com) Received: from mail-4324.protonmail.ch (mail-4324.protonmail.ch [185.70.43.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkBg931Qlz4Cx4 for ; Sun, 10 Sep 2023 14:14:29 +0000 (UTC) (envelope-from cglogic@protonmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=protonmail.com header.s=protonmail3 header.b="q22T+x/e"; spf=pass (mx1.freebsd.org: domain of cglogic@protonmail.com designates 185.70.43.24 as permitted sender) smtp.mailfrom=cglogic@protonmail.com; dmarc=pass (policy=quarantine) header.from=protonmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail3; t=1694355264; x=1694614464; bh=OmX44Bo9MxrP1vjQG4BIQgeyFmM/fzR7jWj0Ig4Tqd4=; h=Date:To:From:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=q22T+x/etiYtIjY8UxNaU/BypWRuye9TUrhQAX/L8yxIQ8dFSamTjhObDgebzI0lV yvQaAhJYmGHx+WGdHCXnz6zZJo/yXZvzzl/8cH24lhzwoDH7sIUo/EeyBmTVzeULNg VqWt1rbipznd4uqOUp+ofAvs+V0yTGdaEGPt+jmR+/8DKu7pO2dgxUngFiORXq0u0g usZpw/ovT+KU+xhYiyANoiOgCeTAlU5hxpJUx0ppkjC9Mc948Qy59EvzJ0+NxN2pvN EM4Vk7X9S57f1cMyqlR4A/p2r2iKDzrkIuUtqOCPGbMRRMCp/aSOnG19l/BDjuxjYr Og4zARwf6e1RA== Date: Sun, 10 Sep 2023 14:14:18 +0000 To: "freebsd-current@freebsd.org" From: cglogic Subject: Re: 14-ALPHA2 panic on cold boot Message-ID: In-Reply-To: References: Feedback-ID: 25313618:user:proton List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_ZJqZht46wrt5H6lrDhiKctcgEfPP6DjezQ3z3Bgdk" X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.52 / 15.00]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[protonmail.com,quarantine]; NEURAL_HAM_SHORT(-0.42)[-0.422]; R_SPF_ALLOW(-0.20)[+ip4:185.70.43.0/24]; RWL_MAILSPIKE_VERYGOOD(-0.20)[185.70.43.24:from]; R_DKIM_ALLOW(-0.20)[protonmail.com:s=protonmail3]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MIME_BASE64_TEXT(0.10)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH]; FREEMAIL_ENVFROM(0.00)[protonmail.com]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+,1:+,2:~]; TO_DN_EQ_ADDR_ALL(0.00)[]; DKIM_TRACE(0.00)[protonmail.com:+]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_FROM(0.00)[protonmail.com]; HAS_PHPMAILER_SIG(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4RkBg931Qlz4Cx4 This is a multi-part message in MIME format. --b1_ZJqZht46wrt5H6lrDhiKctcgEfPP6DjezQ3z3Bgdk Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 Rm9yIHRob3NlIHdobyBpbnRlcmVzdGVkIG9yIGFmZmVjdGVkIGJ5IHRoaXMgaXNzdWUuCgpMb29r cyBsaWtlIHRoaXMgcmVncmVzc2lvbiB3YXMgaW50cm9kdWNlZCBieSBodHRwczovL3Jldmlld3Mu ZnJlZWJzZC5vcmcvRDM0MTE3CkN1cnJlbnRseSBhY3RpdmUgUFIgaXMgaHR0cHM6Ly9idWdzLmZy ZWVic2Qub3JnL2J1Z3ppbGxhL3Nob3dfYnVnLmNnaT9pZD0yNjgzOTMKSXQgY29udGFpbnMgYSBw YXRjaCBwcm9wb3NlZCBieSBvbmUgb2YgdXNlcnMuCkJ1dCB0aGUgUFIgY2FuJ3QgbW92ZSBmb3J3 YXJkIHdpdGhvdXQgY29tbWl0dGVycyBhdHRlbnRpb24uCgotLS0tLS0tIE9yaWdpbmFsIE1lc3Nh Z2UgLS0tLS0tLQpPbiBUdWVzZGF5LCBBdWd1c3QgMjl0aCwgMjAyMyBhdCAxMTowOSBBTSwgY2ds b2dpYyA8Y2dsb2dpY0Bwcm90b25tYWlsLmNvbT4gd3JvdGU6Cgo+IEhlbGxvIGRlYXIgRnJlZUJT RCBjb21tdW5pdHksCj4KPiBSZWNlbnRseSBJIHRyaWVkIHRvIGJvb3QgZnJvbSBGcmVlQlNEIDE0 LUFMUEhBMiBpbWFnZSBhbmQgZ290IHBhbmljIG9uIGZpcnN0IGJvb3QgYWZ0ZXIgcG93ZXIgb24u Cj4gTXkgaGFyZHdhcmUgaXMgQU1EIFJ5emVuIDkgNTkwMFggb24gQVNVUyBST0cgU1RSSVggQjU1 MC1FIEdBTUlORy4KPiBJdCdzIHJlbGF0ZWQgdG8gYXVkaW8gY2hpcCBBTEMxMjIwIGluaXRpYWxp emF0aW9uLgo+Cj4gSWYgSSByZW1lbWJlciBjb3JyZWN0bHksIHdoZW4gSSB0cmllZCBGcmVlQlNE IDEzLVNUQUJMRSwgYXJvdW5kIDIgeWVhcnMgYWdvLCBubyBwYW5pYyB3YXMgb2JzZXJ2ZWQuCj4g QnV0IGF0IHRoYXQgdGltZSBteSBHUFUgd2FzIHVuc3VwcG9ydGVkIGJ5IGRybS1rbW9kLiBTbyBJ IGluc3RhbGxlZCBMaW51eCBhbmQgdXNlZCBpdCBmb3IgMiB5ZWFycy4KPiBPbiBMaW51eCwgbm8g c3VjaCBhIHBhbmljIG9ic2VydmVkLiBOb3cgZHJtLWttb2Qgc3VwcG9ydHMgbXkgR1BVIGFuZCBJ IHdhbnQgbW92ZSB0byBGcmVlQlNELgo+Cj4gQWxzbyB0cmllZCAxMy4yLCBnb3QgdGhlIHNhbWUg cGFuaWMuCj4gQ2FuJ3QgdHJ5IGVhcmxpZXIgRnJlZUJTRCAxMyByZWxlYXNlcywgYXMgdGhleSBh cmUgbm90IGF2YWlsYWJsZSBmb3IgZG93bmxvYWQgYW55bW9yZS4KPgo+IEkgZm91bmQgdHdvIHJl bGF0ZWQgYnVnIHJlcG9ydHM6Cj4gaHR0cHM6Ly9idWdzLmZyZWVic2Qub3JnL2J1Z3ppbGxhL3No b3dfYnVnLmNnaT9pZD0yNjQzMDUKPgo+IGh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxs YS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzCj4KPiBNeSBiYWNrdHJhY2UgaXMgdGhlIHNhbWUgYXMg aW4gcmVwb3J0ZWQgaXNzdWVzLiBTbyBJIGRpZCBub3Qgd3JpdGUgaXQgZnJvbSBhIHNjcmVlbiB0 byBhIHBhcGVyLgo+Cj4gQXMgSSB1bmRlcnN0YW5kLCB0aGlzIGJ1ZyBhZmZlY3RzIGFsbCBBTUQg WmVuMiwgWmVuMyBhbmQgWmVuNCBjb21wdXRlcnMgYW5kIGxhcHRvcHMuCj4KPiBXZSBhcmUgbmVh ciBGcmVlQlNEIDE0LjAgcmVsZWFzZSBub3csIG1heWJlIGl0IHdpbGwgYmUgcG9zc2libGUgdG8g Zml4IGl0IGJlZm9yZSByZWxlYXNlLgo+Cj4gVGhhbmtzLg== --b1_ZJqZht46wrt5H6lrDhiKctcgEfPP6DjezQ3z3Bgdk Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7Ij5Gb3IgdGhvc2Ugd2hvIGludGVyZXN0ZWQgb3IgYWZmZWN0ZWQgYnkgdGhpcyBpc3N1ZS48 L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6 ZTogMTRweDsiPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJp ZjsgZm9udC1zaXplOiAxNHB4OyI+TG9va3MgbGlrZSB0aGlzIHJlZ3Jlc3Npb24gd2FzIGludHJv ZHVjZWQgYnkmbmJzcDs8c3Bhbj48YSB0YXJnZXQ9Il9ibGFuayIgcmVsPSJub3JlZmVycmVyIG5v Zm9sbG93IG5vb3BlbmVyIiBocmVmPSJodHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDM0MTE3 Ij5odHRwczovL3Jldmlld3MuZnJlZWJzZC5vcmcvRDM0MTE3PC9hPjwvc3Bhbj48L2Rpdj48ZGl2 IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsi PjxzcGFuIHN0eWxlPSJkaXNwbGF5OiBpbmxpbmUgIWltcG9ydGFudDsgYmFja2dyb3VuZC1jb2xv cjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+Q3VycmVudGx5IGFjdGl2ZSBQUiBpcyZuYnNwOzwvc3Bh bj48c3BhbiBzdHlsZT0iYmFja2dyb3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+PGEg dGFyZ2V0PSJfYmxhbmsiIHJlbD0ibm9yZWZlcnJlciBub2ZvbGxvdyBub29wZW5lciIgaHJlZj0i aHR0cHM6Ly9idWdzLmZyZWVic2Qub3JnL2J1Z3ppbGxhL3Nob3dfYnVnLmNnaT9pZD0yNjgzOTMi IHN0eWxlPSJjb2xvcjogYmx1ZTsiPmh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9z aG93X2J1Zy5jZ2k/aWQ9MjY4MzkzPC9hPjwvc3Bhbj48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9u dC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij5JdCBjb250YWlu cyBhIHBhdGNoIHByb3Bvc2VkIGJ5IG9uZSBvZiB1c2Vycy48L2Rpdj48ZGl2IHN0eWxlPSJmb250 LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPkJ1dCB0aGUgUFIg Y2FuJ3QgbW92ZSBmb3J3YXJkIHdpdGhvdXQgY29tbWl0dGVycyBhdHRlbnRpb24uPC9kaXY+PGRp diBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7 Ij48YnI+PC9kaXY+PGRpdiBjbGFzcz0icHJvdG9ubWFpbF9xdW90ZSI+DQogICAgICAgIC0tLS0t LS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLS0tPGJyPg0KICAgICAgICBPbiBUdWVzZGF5LCBBdWd1 c3QgMjl0aCwgMjAyMyBhdCAxMTowOSBBTSwgY2dsb2dpYyAmbHQ7Y2dsb2dpY0Bwcm90b25tYWls LmNvbSZndDsgd3JvdGU6PGJyPjxicj4NCiAgICAgICAgPGJsb2NrcXVvdGUgY2xhc3M9InByb3Rv bm1haWxfcXVvdGUiIHR5cGU9ImNpdGUiPg0KICAgICAgICAgICAgPGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij5IZWxsbyBkZWFyIEZy ZWVCU0QgY29tbXVuaXR5LDwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fu cy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+PGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFt aWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+UmVjZW50bHkgSSB0cmll ZCB0byBib290IGZyb20gRnJlZUJTRCAxNC1BTFBIQTIgaW1hZ2UgYW5kIGdvdCBwYW5pYyBvbiBm aXJzdCBib290IGFmdGVyIHBvd2VyIG9uLjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBB cmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+TXkgaGFyZHdhcmUgaXMmbmJzcDs8 c3Bhbj5BTUQgUnl6ZW4gOSA1OTAwWCBvbiBBU1VTJm5ic3A7PHNwYW4+Uk9HIFNUUklYIEI1NTAt RSBHQU1JTkcuPC9zcGFuPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJp YWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPkl0J3MgcmVsYXRlZCB0byBhdWRpbyBj aGlwJm5ic3A7PHNwYW4+QUxDMTIyMCBpbml0aWFsaXphdGlvbi48L3NwYW4+PC9kaXY+PGRpdiBz dHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48 c3Bhbj48YnI+PC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fu cy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+PHNwYW4+SWYgSSByZW1lbWJlciBjb3JyZWN0bHks IHdoZW4gSSB0cmllZCBGcmVlQlNEIDEzLVNUQUJMRSwgYXJvdW5kIDIgeWVhcnMgYWdvLCBubyBw YW5pYyB3YXMgb2JzZXJ2ZWQuPC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBB cmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+PHNwYW4+QnV0IGF0IHRoYXQgdGlt ZSBteSBHUFUgd2FzIHVuc3VwcG9ydGVkIGJ5IGRybS1rbW9kLiBTbyBJIGluc3RhbGxlZCBMaW51 eCBhbmQgdXNlZCBpdCBmb3IgMiB5ZWFycy48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48c3Bhbj5PbiBMaW51 eCwgbm8gc3VjaCBhIHBhbmljIG9ic2VydmVkLiBOb3cgZHJtLWttb2Qgc3VwcG9ydHMgbXkgR1BV IGFuZCBJIHdhbnQgbW92ZSB0byBGcmVlQlNELjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250 LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPjxicj48 L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBm b250LXNpemU6IDE0cHg7Ij48c3Bhbj5BbHNvIHRyaWVkIDEzLjIsIGdvdCB0aGUgc2FtZSBwYW5p Yy48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlm OyBmb250LXNpemU6IDE0cHg7Ij48c3Bhbj5DYW4ndCB0cnkgZWFybGllciBGcmVlQlNEIDEzIHJl bGVhc2VzLCBhcyB0aGV5IGFyZSBub3QgYXZhaWxhYmxlIGZvciBkb3dubG9hZCBhbnltb3JlLjwv c3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZv bnQtc2l6ZTogMTRweDsiPjxzcGFuPjxicj48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48c3Bhbj5JIGZvdW5k IHR3byByZWxhdGVkIGJ1ZyByZXBvcnRzOjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZh bWlseTogQXJpYWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPjxzcGFuPjxh IGhyZWY9Imh0dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9 MjY0MzA1IiByZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVuZXIiIHRhcmdldD0iX2JsYW5r Ij5odHRwczovL2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dpP2lkPTI2NDMw NTwvYT48L3NwYW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJp YWwsIHNhbnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPjxzcGFuPjxhIGhyZWY9Imh0 dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzIiBy ZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVuZXIiIHRhcmdldD0iX2JsYW5rIj5odHRwczov L2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dpP2lkPTI2ODM5MzwvYT48L3Nw YW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNhbnMt c2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPjxzcGFuPjxicj48L3NwYW4+PC9kaXY+PGRpdiBzdHls ZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48c3Bh bj48c3BhbiBzdHlsZT0iZGlzcGxheTogaW5saW5lICFpbXBvcnRhbnQ7IGJhY2tncm91bmQtY29s b3I6IHJnYigyNTUsIDI1NSwgMjU1KTsiPk15IGJhY2t0cmFjZSBpcyB0aGUgc2FtZSBhcyBpbiBy ZXBvcnRlZCBpc3N1ZXMuIFNvIEkgZGlkIG5vdCB3cml0ZSBpdCBmcm9tIGEgc2NyZWVuIHRvIGEg cGFwZXIuPC9zcGFuPjxicj48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFy aWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij48c3Bhbj48c3BhbiBzdHlsZT0iZGlz cGxheTogaW5saW5lICFpbXBvcnRhbnQ7IGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwg MjU1KTsiPjxicj48L3NwYW4+PC9zcGFuPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBB cmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+QXMgSSB1bmRlcnN0YW5kLCB0aGlz IGJ1ZyBhZmZlY3RzIGFsbCBBTUQgWmVuMiwgWmVuMyBhbmQgWmVuNCBjb21wdXRlcnMgYW5kIGxh cHRvcHMuPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBm b250LXNpemU6IDE0cHg7Ij48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTogQXJpYWwsIHNh bnMtc2VyaWY7IGZvbnQtc2l6ZTogMTRweDsiPldlIGFyZSBuZWFyIEZyZWVCU0QgMTQuMCByZWxl YXNlIG5vdywgbWF5YmUgaXQgd2lsbCBiZSBwb3NzaWJsZSB0byBmaXggaXQgYmVmb3JlIHJlbGVh c2UuPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250 LXNpemU6IDE0cHg7Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBz YW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7Ij5UaGFua3MuPC9kaXY+PGRpdiBzdHlsZT0iZm9u dC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7IiBjbGFzcz0icHJv dG9ubWFpbF9zaWduYXR1cmVfYmxvY2siPg0KPC9kaXY+DQoNCiAgICAgICAgPC9ibG9ja3F1b3Rl Pjxicj4NCiAgICA8L2Rpdj4= --b1_ZJqZht46wrt5H6lrDhiKctcgEfPP6DjezQ3z3Bgdk-- From nobody Sun Sep 10 15:43:24 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkDf85p1Tz4shGC for ; Sun, 10 Sep 2023 15:43:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkDf837Mzz4gHF for ; Sun, 10 Sep 2023 15:43:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694360621; bh=2rbZTEfWWo8RKoiAhtH6XccZ5H33oAnFblm39qEEt3k=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=OKD5xtPpL8WewSQaoVOf87gSf3MUPLYvU/w03OdXkP1yxKPwfrW9HNmuw2kv2jSoJ1fS2lGD528iinAV3SszMgcDSMv2hUZO3Hwk7939SFKKgPveFng17YDxu2M50yUGO+sn9JhQ3Tf5YVgC2+CGa8IrMKz+W2Jlz1oxqM3jdtRv2gf5zQg74d/erITugHhnkXBrT+UBNPEPXMT2ytS00Y00kNbRsMiIi+zPl0LAqCdcHY1EDbzCj0BGmBkuHI9Z4wDFFzMEk9Fftj+tGKe6efj2NkZnqBHxSRKc77kC3X1Pw7J0vl3IpwwoU56cajy4gGRc53ZqrMJp19WbvoTXSw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694360621; bh=BULofRULbdIiQdtMMG/h7fR4pps1v2stgc2v5E6Nf+y=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=iSTwcJzByjOWvjvP0C/RXL+CP1Jc2WohuT/0KcjMncOTCfW8HAWSOG/vWbyHKoU1Rqt4rwsi4TO/8Fc5QrB1wfdiaLTnlu/YxXgRVyEKx9aZ+UmOnz4pyFCZn8nk6cAEesNxmUKC6TQLuqqB6pLofFAB4vP7dnAbg4uBxBOQcYoCGKIGC5Sc7F600jvwWqJoK5FiWvZJs1A1aaQ5JrJlTqKugFnnQya3IbxZPoE9KfATsMtg4wTVxEIFtBWllXeV7THyU9St+KPtWadoCibDkYkSAI9RneycduyrQ1bw66h+fN36gauGdYySgX0Ry4r+UDG+x2M28g8g+vDvETc+uw== X-YMail-OSG: vUzaD98VM1m41TaBr8bQCWZbnrbdv3aG14bMf_e75Q1DTDhMB1onAB1OOzDe_DL JlTrx4LJExc0IvKZ5zL1UvAniUXYxnbATgFBHyUOvDZ9p_kyvRc4WFRjVBmpmeEIJ_B9wD_LJWxI Gwi6jrT9BctCNfXJg1209UGw047QLYJ9wkykbsnpqFHX6EBca8Z47BgMEDoG9bHYP3aWtNNH6GF8 7.c.Zy05ntotfHnWt3po9Frr7VkNPB43kmbaW0y_9zmpVAbvKGHwB6T3WApLtcnJ38CJwrD1tClK eeEQn5Ztf1sdTHd6IlKbqEI4g2MORX826p0wEP_nXBV5e6EXmMfPv52C85IdOZ3KPv2N5M.eVN4s GIJv.APoScxuVQtiULBIVzWH8eQbRtD9j9L864gpcad4NA0rSDKOXsagzTvIcqv6CRoN4nfd.KcI V1rDP1fY7lNuo7Fxqu3ec8evlWryQ4MFBv5lxRNsVER7xJU9IUJkTHpeKl0l5IuF70JQJPghSFkW FUE9mchuHystif.GYXVoefIl2CiadnspBrD8irpvo8dm3ugpSCojUNjCaa.4LkCcZRftgaVUxRXs ngqN6FYY7JJPLAZw7GbiTnrcESDqQjAHnCeDzxobHC9INV793XUuSrPvLwoQoPHHYCMOMGL0RP7l tRz9hKiVCLWoCARWaU4YDS3rPLfu3i61bsuFyNVMUZ6ZWjInqNigygIKCEdoA20PxnKD8tuzFfGQ HX5iJcMYS7Pl7OUlNjBa0hF9r6e9mi384H5vt8TkyxTP9WqrTc.UEoqe9i_9_pxjyP_ft6apXzQl nzjWySfjeJVo03pLRoTS5D_d_ydsczMgwK_KJqzZjeTdXDP1gfA064rsgMugqkX.jrMbCVm00ATI CoattG4NKVWvPNXFO9aeBI1XAck4g9FQW1y9mxhzfSvkY8003cS3pyfnqekIif2fDZXCxs5qt50k VTyGq8pYUFMwRQIGwQF3Fyr05q3mXHaq.MEpxYBvVjrQ_SfHY6BWEtaGZHh0C39Cllk_GElYyOAf d2IUfcEu.HWoD2R76f13zSe1SHv7XAWIgRpDO9sZbcAXdUEyUuUlD_60wx2HPvwN8RNcxCqVV0L6 sk_5L3lQY0KdYS40KY1muW8sY5H6RTcASIsJoGhMTljCUwCwuYZLxO0Bk9foCqvhnMFKm9oaiPtx vC5r0IAYv6Dtwn_y18ue0on78QVng3ss.6tMqAH4cgST5ZM5M4CnlTzEolnF.BhLcio3T26m6kqG V7rQHrvaM06VT5AW0kefA4r0cMnHNCutRRhzSxtEkO2G3WuNYkTGrukj.3q2hdLGadHVP1wQcorO oPF5QnDAoNrb63vERqmxifWzJml3pmWHt6qULmDMIIUjhlVQefVm2yDzjnbblto3nbQ9wrnSEDkb ZGhxcnDd_FJTxL6Q_.QCKh3LziXd3pGTbBo8F9PEqj2.idfDgQyze9mUOBj09Jt9SoDWwZCVRLyY 98ZhmSk97an7vkfZ_5A5mlA5nXtaJOZyQxoqEvjd087MtMnydMEPCCwZHtjE0ghZdve1yW82qQHj bopwVwfl_CuiZfqz.yXhefF3p7Z.B9.rzuuPM5Xm5hobMnBAhfX.LZTGawkOAjzdPgKaXNImS29z Rt8mNxYTzUmEi5pHbloYRVeNvFANwhVbwqOmmM0.2W08HNrAc9TR1r184739pXE70FKv.uQPE3dq CMI9kGPjK73yHPXVtcWm68ePYIWrhgic.MxTwqcUVz7pWAZWNN0NKsIdQHJoqpnhgGCV2cgHQC0Q eP9gmcwHsCB.l0Um2jR0qfmvqeLLSgM3xh9GiflYMW8HerDAtXiLaTWeahr44QSKCd3r9AeKhZBG ax4laU2vGg_zjFWdMKVgC0zLbkHz_QfMdapq3QrIIiXeRBLVQpPADdcI9_lqBw9KDaMDRHuqTgbS mbFWqzjVCqg3v6wNP9JHzT8pf85hL9aIVIYnLnOPErSkGjY2b0M0uAMUqOPvTINqzSQa2ETdoae2 gHc5FH_7PUP2bh_Pvvbcg5aSCVNxiYzIx4GkDLl8qHWMbsqKHNw4h_wm7_9Pe_Aa2aP18v9_F1_8 0fgaBQtA92P6ps.ETjoyoylrXqxjoApkb9ki44mmIKSc2_3dpyEuNBU.D6mxnZasd9a0CUMbsEHM XjyzVFrpvArSbWu2ugy0mb1IcRzqM5DSY9UedKkYExUZ3tQiSySEVpMYL4C29J3aCF_jthE..0np 89m1.VyCZbBVh9_PxmYAPtwL5XLAO.c9zHgKaZNRq2oUXpoC3IVzSBJPv3pEWhCdGyYhr4uKDCBW OnT4- X-Sonic-MF: X-Sonic-ID: bcd41371-d9aa-47f7-850e-47cc700bab0c Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 15:43:41 +0000 Received: by hermes--production-bf1-865889d799-7vf9r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 40160cf81dc8e6fb3d3dc63f595ff7ec; Sun, 10 Sep 2023 15:43:37 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: Date: Sun, 10 Sep 2023 08:43:24 -0700 Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: 7bit Message-Id: <02F48605-887C-446C-9647-8757D50B4B24@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Mike Karels X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RkDf837Mzz4gHF On Sep 10, 2023, at 05:58, Mike Karels wrote: > On 10 Sep 2023, at 2:31, Mark Millard wrote: > >> kyua tests that use the: >> >> /usr/tests/sys/cddl/zfs/bin/mkfile >> >> program like so (for example): >> >> mkfile 500M /testpool.1861/bigfile.0 >> >> (which should be valid) end up with mkfile >> instead reporting: >> >> Standard error: >> Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... >> >> which prevent the kyua test involved from working. >> >> Turns out this is from expecting char to be always >> signed (so a -1 vs. 255 distinction, here in an >> aarch64 context): >> >> . . . >> (gdb) list >> 179 /* Options. */ >> 180 while ((ch = getopt(argc, argv, "nv")) != -1) { >> 181 switch (ch) { >> 182 case 'n': >> 183 nofill = 1; >> 184 break; >> 185 case 'v': >> (gdb) print ch >> $16 = 255 '\377' >> (gdb) print/x -1 >> $17 = 0xffffffff >> (gdb) print/x ch >> $18 = 0xff >> . . . >> >> With the mix of unsigned and signed it ends up >> being a 0xffu != 0xffffffffu test, which is >> always true. > > mkfile is broken. getopt returns an int, and -1 on end. > It never returns 0xff. But mkfile declares ch as char, > which truncates the return value -1. ch is a bad (misleading) > variable name, although getopt(3) uses it as well (but declared > as int). Yep: for char being signed, the code is still wrong via the char ch use. But the observed behavior is very different than for char being used but being unsigned. In this context, consequences of the unsigned char behavioral results are observable in the kyua run results but went unnoticed. I used to run into examples of the use of unsigned char for holding the getopt result back in my powerpc days as well and dealt with upstreams for a port or 2 for getting it fixed after finding such was the source of odd behavior I'd observed. If I remember right, this is the first example of running into the specific issue in my aarch64 and armv7 time frame. > Mike > >> So the switch is reached as if a "-" prefix was >> present (that is not). Then the "option" is classified >> as invalid and the usage message is produced. >> >> Apparently no one had noticed. That, in turn, suggests a >> lack of inspected testing on aarch64, powerpc64, >> powerpc64le, armv7, powerpc, and powerpcspe. That, in >> turn, suggests that kyua test inspection for the likes >> of aarch64 is not historically a part of the release >> process for openzfs or for operating systems that include >> openzfs. > === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 15:53:03 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkDs32d8Jz4smkS for ; Sun, 10 Sep 2023 15:53:11 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x631.google.com (mail-ej1-x631.google.com [IPv6:2a00:1450:4864:20::631]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkDs31Hh8z3GXr for ; Sun, 10 Sep 2023 15:53:11 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x631.google.com with SMTP id a640c23a62f3a-98377c5d53eso450097666b.0 for ; Sun, 10 Sep 2023 08:53:11 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694361188; x=1694965988; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ZfJK3wAogQjmDvglFZJ70SBIOy2l57NwLuX6SK5uiPk=; b=NYWC19CbSP4BElBMIO/Pf4jhfLUjHcNNYs53DQ27zUTShVISh03dmvkJxuLtiCzJ8g qMZStacaFDwfgNI4Zys7+es7wk2LkYw8dfPhURhAhVeU+XGzcJIkHrOuw9foY3F+6WQJ ltTTQe8Hs243rDjgzPfEjM9i2L5Twu1HZ9wOzi9+ToPWVXpnFHHUdIX9m8w6Lurk+2iX B/LVjT3+u4Y0ZNxW2apP9T3l6LvGkw1uNO+/ReW+qec8+vWcrdf63uqSEgTkIhS258Gd g46GI+2QXS7hT+YXz7TcYYSY9j81zYWre+EvUr5725+Qb8Bhv3dThkTYcw12TvpWctiq Or1A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694361188; x=1694965988; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ZfJK3wAogQjmDvglFZJ70SBIOy2l57NwLuX6SK5uiPk=; b=Lj654T8xHJ8uc7SfIW1xlipYm/nnQAoHq9HYPqVa4r8tZRsjTRLBztp52coZUNEVI+ 9YsHrXSrixXjEWmcFGHcsG0N5R2EilkJo7Hw+EeU/nkqvJNllnFJhd9C6SkLBgjZyDXL YZakZxW6tt+bqfadaheTJaWp9S4lqDFdf0U7hU7BbqAaQo9eBDBjfyStLivAoS8Nl69F JuKGMnEG51RHYyCyL0wIuwSkvXqejT02xDIINnaBjKJFAG9kp+8LK4zNDXhoje0s0qXT 69bOxxBf8pVqPhaQEIAuPTRmfrMarlEGEeRYGABZGwk1cpromyIBBb3bwrBGxjmNuYZb kouA== X-Gm-Message-State: AOJu0Yw4YLNr0iheFFZTlLmBAaDq0W0zRC0qs5O7CT9rnNFh9Ry7hWo7 V66WRTAuqm4onplMNCXXPP39cA4HxqfUQ+NgfXRISxO2RGsd9O3GtFQ= X-Google-Smtp-Source: AGHT+IEYOIIdxgOuKY5Lh7zQ/NNz13tSjNqlH6pCCaqsYN9JoVXUXo9qGOuj5TVeWFSlSjM8HOxsEV4ZB4jNgAp+aZ8= X-Received: by 2002:a17:906:56:b0:9a5:7ade:b5e1 with SMTP id 22-20020a170906005600b009a57adeb5e1mr6369355ejg.70.1694361188414; Sun, 10 Sep 2023 08:53:08 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> In-Reply-To: From: Warner Losh Date: Sun, 10 Sep 2023 09:53:03 -0600 Message-ID: Subject: Re: sed in CURRENT fails in textproc/jq To: Robert Clausecker Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="000000000000c1cb950605033405" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RkDs31Hh8z3GXr --000000000000c1cb950605033405 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sun, Sep 10, 2023, 7:36 AM Robert Clausecker wrote: > Hi Warner, > > I have pushed a fix. It should hopefully address those failing tests. > The same issue should also affect memcmp(), but unlike for memchr(), it i= s > illegal to pass a length to memcmp() that extends past the actual end of > the buffer as memcmp() is permitted to examine the whole buffer regardles= s > of where the first mismatch is. > > I am considering a change to improve the behaviour of memcmp() on such > errorneous inputs. There are two options: (a) I could change memcmp() th= e > same way I fixed memchr() and have implausible buffer lengths behave as i= f > the buffer goes to the end of the address space or (b) I could change > memcmp() to crash loudly if it detects such a case. I could also > (c) leave memcmp() as is. Which of these three choices is preferable? > What does the standard say? I'm highly skeptical that these corner cases ar= e UB behavior. I'd like actual support for this statement, rather than your conjecture that it's illegal. Even if you can come up with that, preserving the old behavior is my first choice. Especially since many of these functions aren't well defined by a standard, but are extensions. As for memchr, https://pubs.opengroup.org/onlinepubs/009696799/functions/memchr.html has no such permission to examine 'the entire buffer at once' nor any restirction as to the length extending beyond the address space. I'm skeptical of your reading that it allows one to examine all of [b, b + len), so please explain where the standard supports reading past the first occurance. Also, all the tests that started failing with your commit, available here, https://ci.freebsd.org/job/FreeBSD-main-amd64-test/24136/ should be fixed at a bare minimum. Yes, there's a lot of other tests that are failing: those should be fixed or disabled also. Have these tests been fixed? They are showing up as failed still in the latest run https://ci.freebsd.org/job/FreeBSD-main-amd64-test/24141/ shows them still failing by my reading. Also, we're several weeks in, and we're still fixing basic, fundamental functions that show breakage. This indicates to me that proper care hasn't been taken to replace the critical functions in the tree. It also indicates to me that a stronger level of rigor is needed given that the problems are trickling in every few days to weeks. This suggests that the unusual step of backing all this work out of stable/14 and releng/14.0 would be indicated until we can go through this process to the point that the new bugs have stopped (which given the decay rate seen so far suggests we won't be done before 14.0 is released). i know this is an enormous pain, but I think the track record so far supports backing these out of the release we're about to do. They just arrived too late for the normal 'cooking' process of FreeBSD to sufficiently cook them in time for 14.0. Warner Yours, > Robert Clausecker > > Am Sun, Sep 10, 2023 at 05:51:43AM -0600 schrieb Warner Losh: > > On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker wrote: > > > > > Greetings, > > > > > > I apologise for the inconvenience. The issue seems to boil down to > > > various places calling > > > > > > memchr(buf, c, SIZE_MAX); > > > > > > which causes an overflow when my newly written memchr() computes buf = + > > > len to find the end of the buffer. A patch to alleviate this issue c= an > > > be found here: > > > > > > > > > > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-behavi= our-with-ov.patch > > > > > > Please check if it does the trick for you. If yes, I'll go ahead and > > > push it tomorrow-ish. > > > > > > > > > There are half a dozen or do kyua tests that are likely failing because > of > > this or other reasons related to strings. When you push this fix you'l= l > > get the list. They are hidden among about 80 or so networking tests tha= t > > fail. I plan on disabling those tests soon If no one fixes them. > > > > Warner > > > > > > > > Yours, > > > Robert Clausecker > > > > > > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Sm=C3=B8r= grav: > > > > Antoine Brodin writes: > > > > > Yuri writes: > > > > > > Either something has changed in sed(1) in CURRENT, or sed just > fails > > > > > > during the configure stage of textproc/jq: > > > > > > > > > > > > sed: No error: 0 > > > > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > > > This seems to be a recent issue (less than 5 days). > > > > > Hundreds of configure scripts now fail to run on 15-current due t= o > > > > > this sed failure: [...] > > > > > > > > Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of these. If > that > > > > helps, yell at fuz@ :) > > > > > > > > DES > > > > -- > > > > Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org > > > > > > > > > > -- > > > () ascii ribbon campaign - for an 8-bit clean world > > > /\ - against html email - against proprietary attachments > > > > > > > > -- > () ascii ribbon campaign - for an 8-bit clean world > /\ - against html email - against proprietary attachments > --000000000000c1cb950605033405 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sun, Sep 10, 2023, 7:36 AM Robert = Clausecker <fuz@fuz.su> wrote:
Hi Warner,

I have pushed a fix.=C2=A0 It should hopefully address those failing tests.=
The same issue should also affect memcmp(), but unlike for memchr(), it is<= br> illegal to pass a length to memcmp() that extends past the actual end of the buffer as memcmp() is permitted to examine the whole buffer regardless<= br> of where the first mismatch is.

I am considering a change to improve the behaviour of memcmp() on such
errorneous inputs.=C2=A0 There are two options: (a) I could change memcmp()= the
same way I fixed memchr() and have implausible buffer lengths behave as if<= br> the buffer goes to the end of the address space or (b) I could change
memcmp() to crash loudly if it detects such a case.=C2=A0 I could also
(c) leave memcmp() as is.=C2=A0 Which of these three choices is preferable?=



has no such per= mission to examine 'the entire buffer at once' nor any restirction<= /div>
as to the length extending beyond the address space. I'm skep= tical of your reading
that it allows one to examine all of [b, b = + len), so please explain where the standard
supports reading pas= t the first occurance.

Also, all the tests tha= t started failing with your commit, available here,


s= hould be fixed at a bare minimum. Yes, there's a lot of other tests
that are failing: those should be fixed or disabled also. Have these=
tests been fixed? They are showing up as failed still in the lat= est run


shows them still failing by my read= ing.

Also, we're several weeks in, and we&= #39;re still fixing basic, fundamental
functions that show breaka= ge. This indicates to me that proper care
hasn't been taken t= o replace the critical functions in the tree. It also
indicates t= o me that a stronger level of rigor is needed given that the
prob= lems are trickling in every few days to weeks. This suggests that
the unusual step of backing all this work out of stable/14 and releng/14.0=
would be indicated until we can go through this process to the p= oint
that the new bugs have stopped (which given the decay rate s= een so
far suggests we won't be done before 14.0 is released)= . i know this is
an enormous pain, but I think the track record s= o far supports backing
these out of the release we're about t= o do. They just arrived too late
for the normal 'cooking'= process of FreeBSD to sufficiently cook them
in time for 14.0.

Warner

Yours,
Robert Clausecker

Am Sun, Sep 10, 2023 at 05:51:43AM -0600 schrieb Warner Losh:
> On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker <fuz@fuz.su> wrote:<= br> >
> > Greetings,
> >
> > I apologise for the inconvenience.=C2=A0 The issue seems to boil = down to
> > various places calling
> >
> >=C2=A0 =C2=A0 =C2=A0memchr(buf, c, SIZE_MAX);
> >
> > which causes an overflow when my newly written memchr() computes = buf +
> > len to find the end of the buffer.=C2=A0 A patch to alleviate thi= s issue can
> > be found here:
> >
> >
> > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-= fix-behaviour-with-ov.patch
> >
> > Please check if it does the trick for you.=C2=A0 If yes, I'll= go ahead and
> > push it tomorrow-ish.
> >
>
>
> There are half a dozen or do kyua tests that are likely failing becaus= e of
> this or other reasons related to strings.=C2=A0 When you push this fix= you'll
> get the list. They are hidden among about 80 or so networking tests th= at
> fail. I plan on disabling those tests soon If no one fixes them.
>
> Warner
>
> >
> > Yours,
> > Robert Clausecker
> >
> > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Sm=C3= =B8rgrav:
> > > Antoine Brodin <antoine@freebsd.org> writes:
> > > > Yuri <yuri@freebsd.org> writes:
> > > > > Either something has changed in sed(1) in CURRENT,= or sed just fails
> > > > > during the configure stage of textproc/jq:
> > > > >
> > > > > sed: No error: 0
> > > > > checking for sys/cygwin.h... eval: ${+...}: Bad su= bstitution
> > > > This seems to be a recent issue (less than 5 days).
> > > > Hundreds of configure scripts now fail to run on 15-cur= rent due to
> > > > this sed failure: [...]
> > >
> > > Try adding ARCHLEVEL=3Dscalar to CONFIGURE_ENV on one of the= se.=C2=A0 If that
> > > helps, yell at fuz@ :)
> > >
> > > DES
> > > --
> > > Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org
> > >
> >
> > --
> > ()=C2=A0 ascii ribbon campaign - for an 8-bit clean world
> > /\=C2=A0 - against html email=C2=A0 - against proprietary attachm= ents
> >
> >

--
()=C2=A0 ascii ribbon campaign - for an 8-bit clean world
/\=C2=A0 - against html email=C2=A0 - against proprietary attachments
--000000000000c1cb950605033405-- From nobody Sun Sep 10 16:41:23 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkFwj40wpz4sH9N for ; Sun, 10 Sep 2023 16:41:25 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkFwj2YVrz3ZZn; Sun, 10 Sep 2023 16:41:25 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694364085; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Pqf4eT6yrsksK/Xb+6EsWHRVApAiBbWMUXvQ78c1f0I=; b=oWbsQfBbUnN6Xl7KEpk6+aOwdoOA8gpe4Dypx28yDlPwYZkuFjeAxdiotmlDhm+v45iZFw cpG26/qeZOH3HEw16PN9aox9pLFjMDHYNr9ZTz2jhh1p8ZFR0ybIMaEAUKOUkKCn6Hyd2M MorF8IT+5MTlYfFuhx23SjftgGBbptZTi2IUZw0Iel/VK9OtKTHI53z/h5xSNiMeuXSvBw OpgSMuB7hXs1KX5UcVaAFPZZ7JYzb5rZAbRNyM7/g8mVs6QxbmnQ7ky7NMU9xROLm/alA0 tB5vfcULHxV0idM6yG30e8um2zYvm1ocruHWmiEwRi5uNsmWV2uZ/Hj4fyX5HQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694364085; a=rsa-sha256; cv=none; b=lP8QG4grEPcR90DjZaMVp2znADaBiN5kUIl/aUs7fUsdYh0tVzTItiJwhfuIWS2EOeDKr9 kMWqrof9WCsD4mmTn3QucqsD+j6U0v+XMQP7y0bocame1vRpye0fj3p4El0fqzC94geEIR /Bj0huv3uMVk8+7ih3Djel/s6UieNfWuMkrC0xkY9QXjtCRMJue5EZdtuefL2wHS2XrQ8F vT7KjocJzSwbFVHBlqXOix8msAohmibIMYV27/B9ablLuhXIt52Jl79qa0J71uC0Ip+3Kf Kkhc+RtfbqRrVy6SMXa5NnSQgy7/318bc3pelq0LgW8zQS1lgGxDEPsLb5lyRg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694364085; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Pqf4eT6yrsksK/Xb+6EsWHRVApAiBbWMUXvQ78c1f0I=; b=Yh/07WENe2Bt3sBsSP6znGjULkfzFnmAZvkOLNaQyhNtVPTkR3Yz2ygkNlMruk5T9Pa/8S PHbpbjU+QwAC+hbGUviWzadj08xvmMs8lDJoa5Dz786s7twZdBDacjHwZkbogRCB3j9Vit LLCpdYjoL7iaSzG7cPSbmcGoP0HqJVFhHb4rAfK9Rr6/Aa0d7G9jEY2NKij0cnbd/z7jhd xpu5tcUHM1cgL8GJfNQtQc00o+VSf4ltKVlDT/Q8fNVvpHvEcdlyQxl3yD3pEaVIdvDjMT BZcplmiAX4X2sHU/1JAZZsYJhlPe++xFGCgqM3SPcQQX+IwJWEjot/Pa595SKw== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RkFwj0tGdz8m5; Sun, 10 Sep 2023 16:41:25 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 962E64ECB2; Sun, 10 Sep 2023 18:41:23 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Warner Losh Cc: Robert Clausecker , FreeBSD Current Subject: Re: sed in CURRENT fails in textproc/jq In-Reply-To: (Warner Losh's message of "Sun, 10 Sep 2023 09:53:03 -0600") References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Sun, 10 Sep 2023 18:41:23 +0200 Message-ID: <861qf6q8uk.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Warner Losh writes: > As for memchr, https://pubs.opengroup.org/onlinepubs/009696799/functions/= memchr.html > has no such permission to examine 'the entire buffer at once' nor any res= tirction > as to the length extending beyond the address space. I'm skeptical of you= r reading > that it allows one to examine all of [b, b + len), so please explain wher= e the standard > supports reading past the first occurance. C11 says: (7.24.4.1 =C2=A72) The memcmp function compares the first n characters = of the object pointed to by s1 to the first n characters of the object pointed to by s2. and (7.24.5.1 =C2=A72) The memchr function locates the first occurrence of c (converted to an unsigned char) in the initial n characters (each interpreted as unsigned char) of the object pointed to by s. The implementation shall behave as if it reads the characters sequentially and stops as soon as a matching character is found. The second sentence in the description of memchr() means a bogus length is allowed as long as we get a match before we read past the end of the object. There is no such provision for memcmp(), so calling memcmp() with a bogus length invokes UB. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sun Sep 10 16:53:46 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkGC26LgQz4sNwq for ; Sun, 10 Sep 2023 16:53:50 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "fuz.su", Issuer "fuz.su" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkGC23K1Fz3fDZ for ; Sun, 10 Sep 2023 16:53:50 +0000 (UTC) (envelope-from fuz@fuz.su) Authentication-Results: mx1.freebsd.org; none Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 38AGrkd5021052 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sun, 10 Sep 2023 18:53:47 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 38AGrkhW021051; Sun, 10 Sep 2023 18:53:46 +0200 (CEST) (envelope-from fuz) Date: Sun, 10 Sep 2023 18:53:46 +0200 From: Robert Clausecker To: Warner Losh Cc: current@freebsd.org Subject: Re: sed in CURRENT fails in textproc/jq Message-ID: References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR] X-Rspamd-Queue-Id: 4RkGC23K1Fz3fDZ Hi Warner, Thank you for your response. Am Sun, Sep 10, 2023 at 09:53:03AM -0600 schrieb Warner Losh: > On Sun, Sep 10, 2023, 7:36 AM Robert Clausecker wrote: > > > Hi Warner, > > > > I have pushed a fix. It should hopefully address those failing tests. > > The same issue should also affect memcmp(), but unlike for memchr(), it is > > illegal to pass a length to memcmp() that extends past the actual end of > > the buffer as memcmp() is permitted to examine the whole buffer regardless > > of where the first mismatch is. > > > > I am considering a change to improve the behaviour of memcmp() on such > > errorneous inputs. There are two options: (a) I could change memcmp() the > > same way I fixed memchr() and have implausible buffer lengths behave as if > > the buffer goes to the end of the address space or (b) I could change > > memcmp() to crash loudly if it detects such a case. I could also > > (c) leave memcmp() as is. Which of these three choices is preferable? > > > > What does the standard say? I'm highly skeptical that these corner cases are > UB behavior. > > I'd like actual support for this statement, rather than your conjecture > that it's > illegal. Even if you can come up with that, preserving the old behavior is > my > first choice. Especially since many of these functions aren't well defined > by > a standard, but are extensions. > > As for memchr, > https://pubs.opengroup.org/onlinepubs/009696799/functions/memchr.html > has no such permission to examine 'the entire buffer at once' nor any > restirction > as to the length extending beyond the address space. I'm skeptical of your > reading > that it allows one to examine all of [b, b + len), so please explain where > the standard > supports reading past the first occurance. memchr() in particular is specified to only examine the input until the matching character is found (ISO/IEC 9899:2011 § 7.24.5.1): *** The memchr function locates the first occurrence of c (converted to an unsigned char) in the initial n characters (each interpreted as unsigned char) of the object pointed to by s. The implementation shall behave as if it reads the characters sequentially and stops as soon as a matching character is found. *** Therefore, it appears reasonable that calls with fake buffer lengths (e.g. SIZE_MAX, to read until a mismatch occurs) must be supported. However, memcmp() has no such language and the text explicitly states that the whole buffer is compared (ISO/IEC 9899:2011 § 7.24.4.1): *** The memcmp function compares the first n characters of the object pointed to by s1 to the first n characters of the object pointed to by s2. *** By omission, this seems to give license to e.g. implement memcmp() like timingsafe_memcmp() where it inspects all n characters of both buffers and only then gives a result. So if n is longer than the actual buffer (e.g. n == SIZE_MAX), behaviour may not be defined (e.g. there could be a crash due to crossing into an unmapped page). Thus I have patched memchr() to behave correctly when length SIZE_MAX is given (commit b2618b65). My memcmp() suffers from similarly flawed logic and may need to be patched. However, as the language I cited above does not indicate that such usage needs to be supported for memcmp() (whereas it must be for memchr(), contrary to my assumptions), I was asking you for how to proceed with memcmp (hence choices (a)--(c)). > Also, all the tests that started failing with your commit, available here, > > https://ci.freebsd.org/job/FreeBSD-main-amd64-test/24136/ > > should be fixed at a bare minimum. Yes, there's a lot of other tests > that are failing: those should be fixed or disabled also. Have these > tests been fixed? They are showing up as failed still in the latest run > > https://ci.freebsd.org/job/FreeBSD-main-amd64-test/24141/ > > shows them still failing by my reading. This run crashed kyua due to an issue that seems to be an instance of bug #273481 and no final report was generated. However, it seems like the unit tests in question do not fail anymore. Let's wait for build 24142. > > Also, we're several weeks in, and we're still fixing basic, fundamental > functions that show breakage. This indicates to me that proper care > hasn't been taken to replace the critical functions in the tree. It also > indicates to me that a stronger level of rigor is needed given that the > problems are trickling in every few days to weeks. This suggests that > the unusual step of backing all this work out of stable/14 and releng/14.0 > would be indicated until we can go through this process to the point > that the new bugs have stopped (which given the decay rate seen so > far suggests we won't be done before 14.0 is released). i know this is > an enormous pain, but I think the track record so far supports backing > these out of the release we're about to do. They just arrived too late > for the normal 'cooking' process of FreeBSD to sufficiently cook them > in time for 14.0. I understand your concerns and will prepare commits to back out the SIMD work from releng/14.0 and stable/14. I apologise for my insufficient testing. I hope I can improve my testing for upcoming changes. > Warner > > Yours, > > Robert Clausecker > > > > Am Sun, Sep 10, 2023 at 05:51:43AM -0600 schrieb Warner Losh: > > > On Sat, Sep 9, 2023, 10:51 PM Robert Clausecker wrote: > > > > > > > Greetings, > > > > > > > > I apologise for the inconvenience. The issue seems to boil down to > > > > various places calling > > > > > > > > memchr(buf, c, SIZE_MAX); > > > > > > > > which causes an overflow when my newly written memchr() computes buf + > > > > len to find the end of the buffer. A patch to alleviate this issue can > > > > be found here: > > > > > > > > > > > > > > http://fuz.su/~fuz/freebsd/0001-lib-libc-amd64-string-memchr.S-fix-behaviour-with-ov.patch > > > > > > > > Please check if it does the trick for you. If yes, I'll go ahead and > > > > push it tomorrow-ish. > > > > > > > > > > > > > There are half a dozen or do kyua tests that are likely failing because > > of > > > this or other reasons related to strings. When you push this fix you'll > > > get the list. They are hidden among about 80 or so networking tests that > > > fail. I plan on disabling those tests soon If no one fixes them. > > > > > > Warner > > > > > > > > > > > Yours, > > > > Robert Clausecker > > > > > > > > Am Sat, Sep 09, 2023 at 07:12:29PM +0200 schrieb Dag-Erling Smørgrav: > > > > > Antoine Brodin writes: > > > > > > Yuri writes: > > > > > > > Either something has changed in sed(1) in CURRENT, or sed just > > fails > > > > > > > during the configure stage of textproc/jq: > > > > > > > > > > > > > > sed: No error: 0 > > > > > > > checking for sys/cygwin.h... eval: ${+...}: Bad substitution > > > > > > This seems to be a recent issue (less than 5 days). > > > > > > Hundreds of configure scripts now fail to run on 15-current due to > > > > > > this sed failure: [...] > > > > > > > > > > Try adding ARCHLEVEL=scalar to CONFIGURE_ENV on one of these. If > > that > > > > > helps, yell at fuz@ :) > > > > > > > > > > DES > > > > > -- > > > > > Dag-Erling Smørgrav - des@FreeBSD.org > > > > > > > > > > > > > -- > > > > () ascii ribbon campaign - for an 8-bit clean world > > > > /\ - against html email - against proprietary attachments > > > > > > > > > > > > -- > > () ascii ribbon campaign - for an 8-bit clean world > > /\ - against html email - against proprietary attachments > > -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments From nobody Sun Sep 10 17:10:26 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkGZZ0fxrz4sXXL for ; Sun, 10 Sep 2023 17:10:46 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-54.consmr.mail.gq1.yahoo.com (sonic316-54.consmr.mail.gq1.yahoo.com [98.137.69.30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkGZX5kgBz4G3n for ; Sun, 10 Sep 2023 17:10:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=itmHyFKj; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.30 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694365841; bh=LXpQfZDkoQ8F64UEC/En2DjHEoPuw0bPXWd/h+8PRCU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=itmHyFKjrKZL5TOUBK+NT31YOq7MWbCjhfOyme5LB+iFIZD4API5rhlypFlmxl9UugnDzR4wA6FDITVnD5OAsirM3kKl1TK5gHgX6kFvXAQfzyLMQ9jr9w3sCcNuR0LRDcfKHIvqYomSwowR1mACRZDOzhKAlT9yH51gO9sz7CSz6Gie84f/vVShx8LoW6Zv35/5Y6vTV7HoYfJDtoHixpFB8CRWgY+Ls4YylKZNNA4wr63Kgs54JdfiPzhIFfhpPln9L21r6FVrJXxnKQcBQ5L2f6M2l7bQYHGTtYGjLafQTctF3zw0i/kpw9oCOI7CNKCWFpDOFQYimvYGl8r5/g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694365841; bh=4a/birP/vkOdArxklt5RsWZAT1YQRzY792jkGMMieI8=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=sCzLrG6aG2RFptj+iMKknnJmb5lBtb0163K4wS17ZFiPE9J1zcnM0RyrC5Lop9axZsPmJgHGTakfQXPowIAbH1ZpFYUStjWG1K8G6GblFWeA2pJzPoq6906HbUmzizBJ068Z45zyA3w00Jbbj6mppudielKhH5GHegI1o91SF4g0sP1csd0twE8deWjKuzKR8ur2MJuFO2c3Zp2oSyewt3GPR8o3HECIHlklpXsUxJvmYqF/FaalWk9RyUAj+yUZWeZDdxdIx6DWFntcShfrtcRJ0tRc4tXpaZZMN8blNeB8lGHQekOvF3ZZgeYkTp7jAQFa5Xvma2GVXGfDUnJELg== X-YMail-OSG: h5poq84VM1kOr3clFq5UPfjBmUhymIkrHs83EIKLGv9bp6egRh.2.RhQyjb6iG2 E8FvmfN8NYuadWUW4M65nuDyK9taebSaC1w0Ir_tT82mD7oUHu0i_XKidUubd43yWEV25HSwPYHg FYIzWgINlViEke3oVqvDufTHXF3Dg4eKl4.khjDyI3Bg1mdlOkmbmaZf5.yBdsLxcmUKI2S16H8N jm68GRiPhuTTC5Hhr2_a2Ot_pkG008gYIzMASo4ryjYBTU_rLngT9cy8xjYSX4jczXLG9WUzDXSJ Yl5_0bCZL_5a2DAVoNK3.Sa6JVT5MIMQ1lRDKY8vlE7dLNK0qmzNW9Iiiz653IjGgvQ_N1puVyai qMt4Eb7YLi72wU2wXV06gimI2afFalHnywCRyNmtnCXPLJ5nsY6mRBIuShGB1K3Fm.nCXWBMjsq0 bwe093iXpZIYJWFszgMzwnAnx5Dy9lRWruxq5C2E949cA28zlaZZGOk0_siH6EXkt6dr4wATiRTA I9Y5rejZAZeM5v8UDpNmzBu7kVxceM8q2MYODdcbDwBjsmN9_pxBoUYSVVRSyEL0JjbH1HV5lLsV b8NLSlcerh9KEh0pezlz9tJZ6nwGPQRuYQizpEiesls1Pp4dOV9MlzbV2wjMT40UyRPnvvdn00PW 9eIdDb.jkeJxOn9J9Lub4eI2KpWO.Rz6EMi2TmcM5su7UsnGUvg88aBW6vON8JwtL2c4nGe0RGrq uJw0wUHqj3ecvxUjOz_jgVrfjUuqTCIHe.uOFLQygzPVMi13udWwMcGqG.oNlIQI6Nbgzrz6L5CF fpaCNjl_A3z2UtmxfcPhPGJHdQ6d5d.iVECWacelbzodRJMgkYi21fWSYv6JuiVk4C4Z.hLTnqTK deACAOLepMTMciwX3y58NPuZfxr_keQzkxbelEXSKs8jvCMyv5e8CzfsBa59GH2xHGVfLUzmoxwp afFqlOqAZUY31kA4cW1sycevTiio0OJZwbocKjo8owioXZboGgCIsSpE54ydGTgAnDvKPZzp.7Fm UmlehQoNukdFygKdFQqI6JntMCZRzUlWV8lKhWnVEOkEC_6AJ1MC6nIdFfEs.IYFEf.vw3FMPs0e MBW.dbOwQ5lXNZZQRrPN.TlBv0Aa_8gToSno6wTRYg78Tu_9eJRBrr_PJi4g5uuSgrSpxQgHpur8 Oxrzy5zjiOWdm2401BzNVUKZMHV120LZYZyYrE6j6Ro4z.xXyUUHhEZUmV2QwEfKjxUQKD05kfDZ gAO6GcWtdTqMLH1qLaeQvuaxVFOTWlsHAz9DqHQT9acT.7xzb6RHkPD6VuAm_3KLWbU7vO2d24HU nt2OB4A4CrXSo8Iw7sjJPYtYsG8lgD5qCZBZnmkpPUojLnJ7Qjkmt_0630t3Us3XtpXPDanLjNQ8 GRVLOrpzuyM26bnhvFpcju1tn3bo_yEhGvqkR6HdXUAIxgZgJfR2okbJNHFfeDabn.YSV3att8A0 3_3yRLNJzKCk8ekjoM7c9UkrTlvbluVtrFkS_CS7UZCo558g2wt_csmrN2ZkCeNXmDN_S2a3I2DG AONcXIZeBbl443KZqMqVhkIQ6fX4pi8AmWmr6Z0FxKkINu1WXqh77eI6JbTC_fnRcrFS8LwyM84R K4eJqblRWzyLEttwz1eLFU7ZZJTVRW_Lf2VilyKdzenldjYC38eou9CjPSIwo9HsqhTk67rifGw8 w1vVVerpNOw8cge59LtbYIAYiBYTuioCgJTsMUi9wp8JD9HPs5rGAPAyRe5Y93HDmZuA_tFgheUh DgpWUbRxFe9979UhH8EvRsq_k54aS3sy0VzyxZ7TxSUC0JtbQevmUazFaEkVU.qYkLAeT0yO4S3U SZgdEiy2dmb.7FMEv83iQfJUlP02DdfY4cG6NLz6WK3dPf7RMOy7zNYZrREtxgkjDby_jilw.QtA zHSEWmSS.5uKqhk943GZhRzxJ7tva_UG59vRrvoUS9avKidnuluT2Ockrgh2YePO783ICvY809tX hDTw3rgOHsi51zsua3gAzmugmDH0qLzAxAoadiFP7wtFCT7okFajXMqPivste4Z2isr0wDcdcsbF a5VwWLw7wi6CocahvwbkLgSZbtrJrFGF5g2SiTJ7PA1xFGxqGeO2PmzYVT.VumIlCtFGNSv5AvMu zuZ1PV2wz8uOvdK1SKWaMlnhN2vgr6dHpdceHjdZ6pN_hmWvqlY7uEy1BHmxjqgL_yBAAJSNh9O0 O0USq.rAUHnCNYeErNdBSaJJV8N5WOulei0OWKb0KAXj2zfalL9Lggn2fBe1sJZUI6WuMU9WmJXI MVtJ_4G3q6dIXx82HXA-- X-Sonic-MF: X-Sonic-ID: e0b07d16-561a-4fb4-a097-dc3f0c467ae3 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 17:10:41 +0000 Received: by hermes--production-gq1-6b7c87dcf5-sv5pn (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID bbc79512b09273d6f9bac26b4e1e9c04; Sun, 10 Sep 2023 17:10:37 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> Date: Sun, 10 Sep 2023 10:10:26 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: 7bit Message-Id: References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.69.30:server fail]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.30:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[8]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkGZX5kgBz4G3n On Sep 10, 2023, at 00:31, Mark Millard wrote: > kyua tests that use the: > > /usr/tests/sys/cddl/zfs/bin/mkfile > > program like so (for example): > > mkfile 500M /testpool.1861/bigfile.0 > > (which should be valid) end up with mkfile > instead reporting: > > Standard error: > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > which prevent the kyua test involved from working. > > Turns out this is from expecting char to be always > signed (so a -1 vs. 255 distinction, here in an > aarch64 context): > > . . . > (gdb) list > 179 /* Options. */ > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > 181 switch (ch) { > 182 case 'n': > 183 nofill = 1; > 184 break; > 185 case 'v': > (gdb) print ch > $16 = 255 '\377' > (gdb) print/x -1 > $17 = 0xffffffff > (gdb) print/x ch > $18 = 0xff > . . . > > With the mix of unsigned and signed it ends up > being a 0xffu != 0xffffffffu test, which is > always true. > > So the switch is reached as if a "-" prefix was > present (that is not). Then the "option" is classified > as invalid and the usage message is produced. > > Apparently no one had noticed. That, in turn, suggests a > lack of inspected testing on aarch64, powerpc64, > powerpc64le, armv7, powerpc, and powerpcspe. That, in > turn, suggests that kyua test inspection for the likes > of aarch64 is not historically a part of the release > process for openzfs or for operating systems that include > openzfs. > Looks like the mkfile.c traces back to a former port sysutils/mkfile that was unfetchable as of 2019. And, looking around, it seems the kyua zfs tests may be a FreeBSD only thing, not adopted in openzfs. So various implicit assumptions when I wrote the note do not actually hold. FreeBSD would have to do additional testing via kyua, beyond what openzfs does for testing, to discover the unsigned char related mis-behavior in the mkfile that FreeBSD's kyua tests use. Only FreeBSD variants are likely to have a similar status, not general openzfs including operating systems. === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 18:21:16 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkJ8C1yH1z4sGD7 for ; Sun, 10 Sep 2023 18:21:31 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62e.google.com (mail-ej1-x62e.google.com [IPv6:2a00:1450:4864:20::62e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkJ8B4Tq9z4fV5 for ; Sun, 10 Sep 2023 18:21:30 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62e.google.com with SMTP id a640c23a62f3a-9a65f9147ccso465022766b.1 for ; Sun, 10 Sep 2023 11:21:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694370088; x=1694974888; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=abD7goBSEuLS/Xh94ZiyPK937DJ64isvmy2QjqmoqzE=; b=RzWaEAndVIAYQtttdx9gLKeGw49er7Ig/IDk18vUaLN/gCBfTbNZWsJvkC40ZAxk9B tAVU4AwSrCw3qhdcrxvAyWQlnuiVOjewGlmqC6Z67aD7v/Q4A7cMqGx2OgKdzYazH+UG H+irUmAG4hjxCdEd2F+KPqVn0Z1TqkGtx4mbgGUT997ubmTyQJbm5ufFpkKOkl/uRJa3 3RJHevkYyxD+68FIP4z5zibh0svQB/3MySsbgNVzlX/973h0NB+dHvv0kwTPEOO9Qe6y ams0DIvc+9YkOSkSgZn5JaokjB4Zx9SzbVlf6XtjnW9MVFey+T7Jw5MC9X/y+/39Oeoq nOxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694370088; x=1694974888; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=abD7goBSEuLS/Xh94ZiyPK937DJ64isvmy2QjqmoqzE=; b=KQebVxH2gyDdj/ZtmO7oukKxEPRU0N3dM410N3C5izMt+C/DSLOpVD1iBBKb7JUf5o u/mMrfSjoAgbgfzOA37/QVDFzeH14mLtqLCEaPHRMAYgRfk3fczAjscNbAs/of5Q6n05 WkUOtj9D5DRvUmwiO8HNjE5512COiQgwVdLWCTLeXkanGE0ytg/WhIW32JPGffsA81hY yxbGvW2G2jpf0l8wcw9YKoTnfD299j6ql8RvzHSW0qpUhR6EgIY4zhAZMuIvhz5tLEIX S9LPmpZkqQ2R+mZqW2Q+TUCR0QITElPYBAA152oXZqdRQuQ1jmvcTlyQ/LCmWSyLAdt6 ySiw== X-Gm-Message-State: AOJu0YxrBuPlH1HYf/T92nhTIg8TWIf6vdpZhOgDguHmihsTiuRiN0L1 cnm8dwGiDmaQ4HRTREJLpyVi+o3gTi62tValKIMLeg== X-Google-Smtp-Source: AGHT+IGO+g+ru/dUmvjmlrKU5ZyNWNccw02kNd6p/f722m/5gR/oMy7qBF4vBvZb0DsmsykODS/iffxjKGqOBOB3pLA= X-Received: by 2002:a17:906:5398:b0:9a1:a916:17c0 with SMTP id g24-20020a170906539800b009a1a91617c0mr6773474ejo.50.1694370088304; Sun, 10 Sep 2023 11:21:28 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> In-Reply-To: From: Warner Losh Date: Sun, 10 Sep 2023 12:21:16 -0600 Message-ID: Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char To: Mark Millard Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Type: multipart/alternative; boundary="0000000000003b54c306050547d8" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RkJ8B4Tq9z4fV5 --0000000000003b54c306050547d8 Content-Type: text/plain; charset="UTF-8" On Sun, Sep 10, 2023, 11:10 AM Mark Millard wrote: > On Sep 10, 2023, at 00:31, Mark Millard wrote: > > > kyua tests that use the: > > > > /usr/tests/sys/cddl/zfs/bin/mkfile > > > > program like so (for example): > > > > mkfile 500M /testpool.1861/bigfile.0 > > > > (which should be valid) end up with mkfile > > instead reporting: > > > > Standard error: > > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > > > which prevent the kyua test involved from working. > > > > Turns out this is from expecting char to be always > > signed (so a -1 vs. 255 distinction, here in an > > aarch64 context): > > > > . . . > > (gdb) list > > 179 /* Options. */ > > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > > 181 switch (ch) { > > 182 case 'n': > > 183 nofill = 1; > > 184 break; > > 185 case 'v': > > (gdb) print ch > > $16 = 255 '\377' > > (gdb) print/x -1 > > $17 = 0xffffffff > > (gdb) print/x ch > > $18 = 0xff > > . . . > > > > With the mix of unsigned and signed it ends up > > being a 0xffu != 0xffffffffu test, which is > > always true. > > > > So the switch is reached as if a "-" prefix was > > present (that is not). Then the "option" is classified > > as invalid and the usage message is produced. > > > > Apparently no one had noticed. That, in turn, suggests a > > lack of inspected testing on aarch64, powerpc64, > > powerpc64le, armv7, powerpc, and powerpcspe. That, in > > turn, suggests that kyua test inspection for the likes > > of aarch64 is not historically a part of the release > > process for openzfs or for operating systems that include > > openzfs. > > > > Looks like the mkfile.c traces back to a former port > sysutils/mkfile that was unfetchable as of 2019. And, > looking around, it seems the kyua zfs tests may be a > FreeBSD only thing, not adopted in openzfs. > > So various implicit assumptions when I wrote the note > do not actually hold. > > FreeBSD would have to do additional testing via kyua, > beyond what openzfs does for testing, to discover the > unsigned char related mis-behavior in the mkfile that > FreeBSD's kyua tests use. Only FreeBSD variants are > likely to have a similar status, not general openzfs > including operating systems. > I wonder how hard ot would be to look for the char = getopt() pattern with coccinelle Warner === > Mark Millard > marklmi at yahoo.com > > > --0000000000003b54c306050547d8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Sep 10, 2023, 11:10 AM Mark Millard <marklmi@yahoo.com> wrote:
On Sep 10, 2023, at 00:31, Mark Millard <mar= klmi@yahoo.com> wrote:

> kyua tests that use the:
>
> /usr/tests/sys/cddl/zfs/bin/mkfile
>
> program like so (for example):
>
> mkfile 500M /testpool.1861/bigfile.0
>
> (which should be valid) end up with mkfile
> instead reporting:
>
> Standard error:
> Usage: mkfile [-nv] <size>[e|p|t|g|m|k|b] <filename> ... >
> which prevent the kyua test involved from working.
>
> Turns out this is from expecting char to be always
> signed (so a -1 vs. 255 distinction, here in an
> aarch64 context):
>
> . . .
> (gdb) list
> 179 /* Options. */
> 180 while ((ch =3D getopt(argc, argv, "nv")) !=3D -1) {
> 181 switch (ch) {
> 182 case 'n':
> 183 nofill =3D 1;
> 184 break;
> 185 case 'v':
> (gdb) print ch
> $16 =3D 255 '\377'
> (gdb) print/x -1
> $17 =3D 0xffffffff
> (gdb) print/x ch
> $18 =3D 0xff
> . . .
>
> With the mix of unsigned and signed it ends up
> being a 0xffu !=3D 0xffffffffu test, which is
> always true.
>
> So the switch is reached as if a "-" prefix was
> present (that is not). Then the "option" is classified
> as invalid and the usage message is produced.
>
> Apparently no one had noticed. That, in turn, suggests a
> lack of inspected testing on aarch64, powerpc64,
> powerpc64le, armv7, powerpc, and powerpcspe. That, in
> turn, suggests that kyua test inspection for the likes
> of aarch64 is not historically a part of the release
> process for openzfs or for operating systems that include
> openzfs.
>

Looks like the mkfile.c traces back to a former port
sysutils/mkfile that was unfetchable as of 2019. And,
looking around, it seems the kyua zfs tests may be a
FreeBSD only thing, not adopted in openzfs.

So various implicit assumptions when I wrote the note
do not actually hold.

FreeBSD would have to do additional testing via kyua,
beyond what openzfs does for testing, to discover the
unsigned char related mis-behavior in the mkfile that
FreeBSD's kyua tests use. Only FreeBSD variants are
likely to have a similar status, not general openzfs
including operating systems.
=
I wonder how hard ot would be to look for the c= har =3D getopt() pattern with coccinelle

<= div dir=3D"auto">Warner

=
=3D=3D=3D
Mark Millard
marklmi at yahoo.com


--0000000000003b54c306050547d8-- From nobody Sun Sep 10 19:24:30 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkKYD46P4z4sxXm for ; Sun, 10 Sep 2023 19:24:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkKYD1jc5z3J5j for ; Sun, 10 Sep 2023 19:24:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694373886; bh=8ZtjGfqWBMRASXm6aSE+S0U378n2i4vQh+HnhmXTTwQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=sG5t2qX6RQcSkc8Du1Cysu5QhjEPLGG4MQNqFDqvMe/mYCJ2HmkoQE8h6prKpc+aEC0+o2v4PD0td0MPNslLI40xyw9s5eckKT/W2Gky8LO1cnypbXMF+yyp1ZHmoVaE4w5kgPstNzt4+UwofsgBP9/Cb6VNKDr1YtOqOyPkf15v7lw69J/0y/1YHHZzpxOVhdeh8CQjJXJL7p1bvJMxHMJI0//lNVFGUE6Vr4ZdO5+gAUwRaDhVckBa8sfFlV8U8RvFCxhXEOcgcW1P7BmdLS7+eNMk0po4Fg4rl13RKclsk0qnso0qj30Pd96ntnyKCHQoRHVhb+hNq3/Bg0MRyg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694373886; bh=VSYp/koO6t7tSTUEOjfhy/Bd3wFrUiOTndwA1/1cDEE=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=NmS+BgfuxTGfGvPNEM77Azu2M2+xMjxQpwManNAaUg2cRmQzTP3JykogSMVdtVqjLFa7NZboyR7z8gTcf9EMC+DUuew+ebkY16W4D0mm9eBelveluui4aKpqvMo5ovXagauUbZavD+e01cNfJerkmV9mGOpH//qW0JksK2+4jYa3DkTiMIfrPQAtWuIwP9A5UYOef4Svl77wEc79199JAi+ewdEved208InFrAfeOraNcueE3oWthjnlSXMWrUelB/RjxIt0tcBMAqrcFXckpt5wN4riae7shqDbA6lNuW2ndvMPmGjYQ+VVkZrNz/AZGlu4k1AdD5tQL26PZD5xkQ== X-YMail-OSG: xZo.fwsVM1ndf2PLpQ_74JFYYqIs5URzouBTlAiAasE4IivYAhsFsmH82Zatww9 n_xESI6xq3OU4qx_tgud5KgdgS94LH_nBOaB.LT_QFu1CAurI5MLNMUOTWs6B.acz_IiBxkSO8h3 jBtch3D3MBW55Ssw3NHdnPpjilUW0MDz_5LDHpatQgr17SQkeWG9o8An1K5_FUNuG3H7d7wOZDMi L0Sp9ypfUQVJAXcdx5n_MWeGGHFBzFnDlgHzPo7uZIWREcy2WfihiDNTyldJ49Mm6eXcZqg4AE34 Y7Dbku6K3806XHxHgVz0vOyY_rmRHZKFOu7iAgcVg5wPkzIAEyTudnZWFNFsUADVTzIRZ5o70407 Za_DfRThJaR_gckSDuW7wCL8p.vSItA8bhBzWhPAu8Rl7C86ID8c.oBpsCQZVtOJMl8KQpreK8h0 D17yrtGVaq9_evD.LVmmIv.gHT_U4fHkmfLwGyN3s2.nKfNm1RkXsFxQoplusJiaZh0tNg4Ug6f7 r53aHKw1VANeYx3M_Kb9UzkNHIca2h.M2tklOFObEfyse_3UJTy0FJhfBomrOAZc6A8VWFXtHb0. cRWbE7xeMbfETTZwTK8h0pkV6yf_5I6XeKPS17Hr4bDbsPq0k0AlGIGeVcspNA4BeVHQACVS95BA xL01k40eZ80.LQ7mzRL6Bx7n6ZPgs.O88zHLYbvTIWeNN3DsgzIr3XWsG4Ne5Hiv0MkO.Gq62fpG 5ym5tUJbA49d7N2zODBzf14i.vaO1km9K6frCgbjxC4PvK4DxyoWTvjQ_OOjUFOniANquprNyrk_ f4vEeEAifkiNngq4NAZGwetf0OyvJmztvxZxg7NAB31Mq3Alvn39vhWcLHxLRly_iZSJvqvpklc0 ULJ2FSVvz3KznJIYGBw6pqiULdC9oXlBfGOLd4mFU7Sg8mFDUiBLBSxXRmAd4nHCSQN5271ADTA7 cC7iln4Dj0zgEyS1gF4GTnBinNuy.UzUYqrOCS67Jevdb_3wVo2gSxM6.ynF72DT74baSdzNxIms xyoal0UNHP3XU36IUiYPCzfQD5rpc1nxDGLUV.PSFd2jDUW5xHE1HkmHF4uj7AmpYnVV8BPQMTDv R.2kr.j3TkXwLzmJubaPW6_wVANMCLc10fkSmsJt0KwIKamU670h_6e9jGfzXWa1efDpFTBZqgOi qSlNJIdSKz0Rbs9GX5Yx5BddZgyHA8dIg92Rb.rCwkXDpOb3t9X5SMPd8cc.o0yHSlE71KGxGpao E4lINhcVbt1BSX8K1j2l5EBHgD3vgxEFX7K5RsH9dfr.eG5Td4fVGYHX3MA1DXuu.US2QfGxZcRj lOZfCbA5PYAUfhZ2KAWJ0_H8DhnclPATKp2VPY_od.ZSN42l7RSR_AUVb95SnlDCwuRJfZqjh2_e G3U3AztqXrk_jhSt4QujBW6jm0jZVRrlKagXt8PffsOQWr2Vxdh1lhMUPyCdRCo.189ZQOlSuOs9 qYE64k4osej439aBWzW1sfHK9i_kLsYpDK4UOWlnlq8SKgooesyyEMFsmWn2CeIzSHgr2QtRnapI AhWWHXSXjZF7GzgaWF1z48VCQWrZQA0IkzaeGwbDjo8xTzR_NgoAdHv0Ppcn__b64Y0UB60Z7Kb4 vZLNlrjE6qX.y8XEbXspMRV4EY4BMgl_0QRT9Xl9bYOilBEkiY_87VLiAA3PzSOG9DNKDEYTfV8v 6mllmmJLIX1Gsob3W6eMIdELxFv80M6_dB4q2Y9y9hvPgJXw3hlPRahNrhQRaynALbWGhVcnb52E _sShm4YtQ2imUGbZqPIhv3gpWUrufrwG2X7C3UQSlchyTPH5IHTVr45DDF92s99e3xXBMtL8_KDZ 42pe7ps11Rb2_dg7sA32PozXUxypB8Ffsf0rPjcHl9yZt9uyzMvNKQ3swxBjO5o3vtBDmGV0zDfE ThYUcPlXvXCDFdnrQtEVLKPMQjFtgcUCaogSxybh6WcWmZoBhlVYiKWEzZd4ez9NTDxr8QM.IKK4 Zq.C8pcGBgf_O0ZKx32Gl8jYJVvonr4Grra7Kj1.isjT8ESyIcvnzZjINTZcWg1VHWoHnJl74SAD YXO1JX1_dmoa9aanwUHse4dIbUra.gG5Yb6mWxp9lkATQXb2Vtj3wKZzmpJvqf8zYF2Gr.DVivTc mCaxWFsb0y5DK2F5eWe48agwRk66sIGtKiCH.1_dFiAWDS1gRuZXNkE50tLCI4Ca1.ev8b37RgHW KMFmLG4k.sYPuHH3HOcbNQ2.VuCuOm1KmZvO69aYmBvxWDR6pXnL5_QkEMmuMaS0Wbafqk8GifTC h9GB.lw-- X-Sonic-MF: X-Sonic-ID: 36a27254-d021-4b83-86c3-8028e509e54e Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 19:24:46 +0000 Received: by hermes--production-gq1-6b7c87dcf5-rj56s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID fd4f49afe0058c6c4d46fac41f729629; Sun, 10 Sep 2023 19:24:41 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: Date: Sun, 10 Sep 2023 12:24:30 -0700 Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Warner Losh X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RkKYD1jc5z3J5j On Sep 10, 2023, at 11:21, Warner Losh wrote: > On Sun, Sep 10, 2023, 11:10 AM Mark Millard wrote: >> On Sep 10, 2023, at 00:31, Mark Millard wrote: >>=20 >> > kyua tests that use the: >> >=20 >> > /usr/tests/sys/cddl/zfs/bin/mkfile >> >=20 >> > program like so (for example): >> >=20 >> > mkfile 500M /testpool.1861/bigfile.0 >> >=20 >> > (which should be valid) end up with mkfile >> > instead reporting: >> >=20 >> > Standard error: >> > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... >> >=20 >> > which prevent the kyua test involved from working. >> >=20 >> > Turns out this is from expecting char to be always >> > signed (so a -1 vs. 255 distinction, here in an >> > aarch64 context): >> >=20 >> > . . . >> > (gdb) list >> > 179 /* Options. */ >> > 180 while ((ch =3D getopt(argc, argv, "nv")) !=3D -1) { >> > 181 switch (ch) { >> > 182 case 'n': >> > 183 nofill =3D 1; >> > 184 break; >> > 185 case 'v': >> > (gdb) print ch >> > $16 =3D 255 '\377' >> > (gdb) print/x -1 >> > $17 =3D 0xffffffff >> > (gdb) print/x ch >> > $18 =3D 0xff >> > . . . >> >=20 >> > With the mix of unsigned and signed it ends up >> > being a 0xffu !=3D 0xffffffffu test, which is >> > always true. >> >=20 >> > So the switch is reached as if a "-" prefix was >> > present (that is not). Then the "option" is classified >> > as invalid and the usage message is produced. >> >=20 >> > Apparently no one had noticed. That, in turn, suggests a >> > lack of inspected testing on aarch64, powerpc64, >> > powerpc64le, armv7, powerpc, and powerpcspe. That, in >> > turn, suggests that kyua test inspection for the likes >> > of aarch64 is not historically a part of the release >> > process for openzfs or for operating systems that include >> > openzfs. >> >=20 >>=20 >> Looks like the mkfile.c traces back to a former port >> sysutils/mkfile that was unfetchable as of 2019. And, >> looking around, it seems the kyua zfs tests may be a >> FreeBSD only thing, not adopted in openzfs. >>=20 >> So various implicit assumptions when I wrote the note >> do not actually hold. >>=20 >> FreeBSD would have to do additional testing via kyua, >> beyond what openzfs does for testing, to discover the >> unsigned char related mis-behavior in the mkfile that >> FreeBSD's kyua tests use. Only FreeBSD variants are >> likely to have a similar status, not general openzfs >> including operating systems. >=20 > I wonder how hard ot would be to look for the char =3D getopt() = pattern with coccinelle >=20 Unsure. But to be sure that the implication that I was also trying to point out is not lost: kyua testing of zfs (and more?) for aarch64 (tier 1) is apparently not being done (or at least the results are not being inspected). Similarly for armv7 and all the powerpc*'s (not tier 1's, however, so not as surprising). Side note: Via other exchanges that have been going on I learned to look in the likes of: https://ci.freebsd.org/job/FreeBSD-main-amd64-testvm/*/consoleText for what to "pkg install" for kyua test runs to use for normal runs (at least the subset compatible with architecture being tested). I'd only figured out a (large) subset previously for aarch64 and armv7. I'm not aware of there being other documentation for what is appropriate for setting up such for kyua runs. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 00:46:58 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkSj268bdz4sjVR; Mon, 11 Sep 2023 00:47:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-oo1-xc30.google.com (mail-oo1-xc30.google.com [IPv6:2607:f8b0:4864:20::c30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkSj16FwQz4LGd; Mon, 11 Sep 2023 00:47:01 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=VAFbChq7; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::c30 as permitted sender) smtp.mailfrom=mavbsd@gmail.com; dmarc=none Received: by mail-oo1-xc30.google.com with SMTP id 006d021491bc7-5735282d713so2503973eaf.2; Sun, 10 Sep 2023 17:47:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694393221; x=1694998021; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=VAFbChq7mZl5fnk/siYjDIvNpyUmwoHma1oNrwz1sil3nREK/hcYBE8Rb/GijhuBDf 02r2+gHvHkkpRthj834Skj3sbgDHmz9hnyo7nBXJSDSI4w1qPPaje1qcrqQT6+HCpKz/ 5XGFE1f+GDh8GaIDXMVGQZ9l3vODoFtLnVXX5TpBEWnxHx11mo4owVeIbF25/gCQCQbV e/x3Ur8h+D7srJYtt64rmasn87M6CWDz/KE1vmbHIj6EVp38St+Ga6myhKmR5o5zp6pJ +Cj19/5H0ivBQjkrnL33A+KEfV66FpGTPYp9r6BWBNiEfcJw7rHka5k/8MZ/ZLkagIh8 A/ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694393221; x=1694998021; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=lTu5dtdddFwBJfX1Jtbc+bXr45wTf6Uqq+vZl+yGepTGDXp1gycCQkSLyEJc69cyz4 kSWwH1YdYJjyIhjP/HHwGUYrZxCuPi69ujNc4oA6rvje6ujKypFQfiY23ry7JtGWXSzd wXFsZj7lqhlxxeDCd1W9lMO2bbFczji1YUnEG9WZkLCsoDjYMaxtYwYpsLJW9bL3xntc sNILgTIfiI9QOoW77qEQh6On1dyxA4YPhbTUV9n3OgZiyL+hiat/yZeGfgUpNWXFSpLa YLD9hS9QX1vByWmibPTyHxjeBavyXx8FLT26rMItWg6FoSlhLYavuOlalq3nAwhEecD3 2wzg== X-Gm-Message-State: AOJu0YwVELk5Nl/cuaYrWRzT/S8VxZftTUqL4YrL3GvTNCV3U0OXMvbl SfqDcbnZtyNEOQDOe5WlLFk= X-Google-Smtp-Source: AGHT+IH+4k+lh0keo1dafVbpLyOX1WKAGn+6LnyTdcrMifsrgzB3c140iu7B5bafB6vd2QzHILVjcQ== X-Received: by 2002:a05:6358:720e:b0:13c:a9c9:c04a with SMTP id h14-20020a056358720e00b0013ca9c9c04amr10006579rwa.20.1694393220750; Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Received: from ?IPV6:2600:1700:3580:3560:228:f8ff:fe04:d12? ([2600:1700:3580:3560:228:f8ff:fe04:d12]) by smtp.gmail.com with ESMTPSA id n128-20020a0de486000000b00589c103d00asm1678719ywe.79.2023.09.10.17.46.59 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Message-ID: Date: Sun, 10 Sep 2023 20:46:58 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Content-Language: en-US To: Mark Millard , Martin Matuska , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> From: Alexander Motin In-Reply-To: <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.19 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c30:from]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2600:1700:3580:3560:228:f8ff:fe04:d12:server fail,2607:f8b0:4864:20::c30:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org]; FREEMAIL_TO(0.00)[yahoo.com,FreeBSD.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkSj16FwQz4LGd On 09.09.2023 12:32, Mark Millard wrote: > On Sep 8, 2023, at 21:54, Mark Millard wrote: >> On Sep 8, 2023, at 18:19, Mark Millard wrote: >>> On Sep 8, 2023, at 17:03, Mark Millard wrote: >>>> On Sep 8, 2023, at 15:30, Martin Matuska wrote: >>>> On 9. 9. 2023 0:09, Alexander Motin wrote: >>>>> Thank you, Martin. I was able to reproduce the issue with your script and found the cause. >>>>> >>>>> I first though the issue is triggered by the `cp`, but it appeared to be triggered by `cat`. It also got copy_file_range() support, but later than `cp`. That is probably why it slipped through testing. This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>>>> >>>>> Mark, could you please try the patch? > > I finally stopped it at 7473 built (a little over 13 hrs elapsed): > > ^C[13:08:30] Error: Signal SIGINT caught, cleaning up and exiting > [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [sigint:] Queued: 34588 Built: 7473 Failed: 23 Skipped: 798 Ignored: 335 Fetched: 0 Tobuild: 25959 Time: 13:08:26 > [13:08:30] Logs: /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_19h51m52s > [13:08:31] Cleaning up > [13:17:10] Unmounting file systems > Exiting with status 1 > > In part that was more evidence for deadlocks at least being fairly > rare as well. > > None of the failed ones looked odd. (A fair portion are because the > bulk -a was mostly doing WITH_DEBUG= builds. Many upstreams change > library names, some other file names, or paths used for debug > builds and ports generally do not cover well building the debug > builds for such. I've used these runs to extend my list of > exceptions that avoid using WITH_DEBUG .) So no evidence of > corruptions. Thank you, Mark. The patch was accepted upstream and merged to both master and zfs-2.2-release branches. -- Alexander Motin From nobody Mon Sep 11 06:26:16 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkcFk4mSZz4snrZ for ; Mon, 11 Sep 2023 06:27:22 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkcFk10Z0z3ff7 for ; Mon, 11 Sep 2023 06:27:22 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; none List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1694413628; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=X7ARjl4FetcyT1uu76QnNv+CHpkSCdmNDGJo0fSy1gQ=; b=SlPj0Sis3swQVvXquJxHGSh2UoJIBMW3Y7KY+2Ylhcxu1HQALe7OSGGL1C6ewWGuxPbEYz kL1BDwZF08yp8YsXd+CMniM7qG5En25nXVolgcXU4mcr4B+EClJmaX640pfsF1vluggCHN VNdmVcR9f8YE6ysh/aJDY+p6d3VuQueS50P58AN1t3+jMJqFAjJehfAK4NZLK1XRVyV+88 BwSzWxQd7/lW2uEmVFuMxzjHDw+kfnUYGq/DDo62PQUlzgLVZZV8c1oJ7/SjlA+PrdygRQ uIzWqgKdWxy6lnEqZcabcG2AMwAsPBY9OPlqQsjm+iAxsBw1Ow7QT50HXLya5A== Date: Mon, 11 Sep 2023 08:26:16 +0200 From: Alexander Leidinger To: Robert Clausecker Cc: Warner Losh , current@freebsd.org Subject: Re: sed in CURRENT fails in textproc/jq In-Reply-To: References: <30a59ac0-28fd-f6ed-505c-9ef6d8e84fc3@tsoft.com> <86edj7qnia.fsf@ltc.des.no> Message-ID: <100f27b9bf542630377af4eae5e8c03c@Leidinger.net> X-Sender: Alexander@Leidinger.net Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_373938dfb81f1ff1d5af74c34b9d4759"; micalg=pgp-sha256 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE] X-Rspamd-Queue-Id: 4RkcFk10Z0z3ff7 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_373938dfb81f1ff1d5af74c34b9d4759 Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8; format=flowed Am 2023-09-10 18:53, schrieb Robert Clausecker: > Hi Warner, > > Thank you for your response. > > Am Sun, Sep 10, 2023 at 09:53:03AM -0600 schrieb Warner Losh: >> On Sun, Sep 10, 2023, 7:36 AM Robert Clausecker wrote: >> >> > Hi Warner, >> > >> > I have pushed a fix. It should hopefully address those failing tests. >> > The same issue should also affect memcmp(), but unlike for memchr(), it is >> > illegal to pass a length to memcmp() that extends past the actual end of >> > the buffer as memcmp() is permitted to examine the whole buffer regardless >> > of where the first mismatch is. >> > >> > I am considering a change to improve the behaviour of memcmp() on such >> > errorneous inputs. There are two options: (a) I could change memcmp() the >> > same way I fixed memchr() and have implausible buffer lengths behave as if >> > the buffer goes to the end of the address space or (b) I could change >> > memcmp() to crash loudly if it detects such a case. I could also >> > (c) leave memcmp() as is. Which of these three choices is preferable? >> > >> >> What does the standard say? I'm highly skeptical that these corner >> cases are >> UB behavior. >> >> I'd like actual support for this statement, rather than your >> conjecture >> that it's >> illegal. Even if you can come up with that, preserving the old >> behavior is >> my >> first choice. Especially since many of these functions aren't well >> defined >> by >> a standard, but are extensions. >> >> As for memchr, >> https://pubs.opengroup.org/onlinepubs/009696799/functions/memchr.html >> has no such permission to examine 'the entire buffer at once' nor any >> restirction >> as to the length extending beyond the address space. I'm skeptical of >> your >> reading >> that it allows one to examine all of [b, b + len), so please explain >> where >> the standard >> supports reading past the first occurance. > > memchr() in particular is specified to only examine the input until the > matching character is found (ISO/IEC 9899:2011 § 7.24.5.1): > > *** > The memchr function locates the first occurrence of c (converted to an > unsigned char) in the initial n characters (each interpreted as > unsigned > char) of the object pointed to by s. The implementation shall behave as > if it reads the characters sequentially and stops as soon as a matching > character is found. > *** > > Therefore, it appears reasonable that calls with fake buffer lengths > (e.g. SIZE_MAX, to read until a mismatch occurs) must be supported. > However, memcmp() has no such language and the text explicitly states > that the whole buffer is compared (ISO/IEC 9899:2011 § 7.24.4.1): > > *** > The memcmp function compares the first n characters of the object > pointed to by s1 to the first n characters of the object pointed to by > s2. > *** > > By omission, this seems to give license to e.g. implement memcmp() like > timingsafe_memcmp() where it inspects all n characters of both buffers > and only then gives a result. So if n is longer than the actual buffer > (e.g. n == SIZE_MAX), behaviour may not be defined (e.g. there could be > a crash due to crossing into an unmapped page). > > Thus I have patched memchr() to behave correctly when length SIZE_MAX > is > given (commit b2618b65). My memcmp() suffers from similarly flawed > logic and may need to be patched. However, as the language I cited > above > does not indicate that such usage needs to be supported for memcmp() > (whereas it must be for memchr(), contrary to my assumptions), I was > asking you for how to proceed with memcmp (hence choices (a)--(c)). My 2ct: What did the previous implementation of memcmp() do in this case? - If it was generous and behaved similar to the requirements of memchr(), POLA requires to have the same now too. - If it was crashing or silently going on (= lurking bugs in 3rd party code), we may have the possibility to do a coredump in case of running past the end of the buffer to prevent malicous use. - In general I go with the robustness principle, "be liberal what you accept, but strict in what you provide" = memcmp() should behave as if it is supported. Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_373938dfb81f1ff1d5af74c34b9d4759 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmT+sxcACgkQEg2wmwP4 2Ib0rRAAgxhAKIefJK9TIYgnC0sIoCH9WJePhu5fV7NIP/dBPrqSrZGZcNpznDQN YSgF6iQ1JNhaKRlKUE5BKdigR2J4ZB/jNbMabloaa2EoMzi6+z6JuQNe7Q2Zxikj 2JWMVSktzWYIsQoLcr0TWIvXTkd0oJ9i28xDyrAFSgPXBwqMNl4miFq5/m5ZfF8q Co56E5y+xL66wXv2Htnltc22Gv959ajD+bVyTOgTMGbLIq8nC//LTyMQDV1LbjGR gMcRYeqMqcHUV+CB1FQBfGS/oOopxhJ9EbDdJvfnS7SSbFtkXxRntKuLFS+KOqi/ FRcmMFvI7FxSNebTa8l2jBADTpbV5q3B8CezqYggLmmCa8M9wo9iZJgeFSLsQf+F QrppvHLASMV55KQUVPuQJt02fqM1XKl8bHKcAznnxGo46tVSiYomHAzHAfDqKGaF FoQI1ok0FH8o7TOG5dcJW73CXL8mBrHoaBT/vjC+cCYslOcE4zD2ao9fpzYcfoL4 KEyORt9XJoRAA7OBtvUILHRGN0CgRrG9wDDb22i/Romvhg2mFK1iIT9kA1LyGeZR 3sfbqTVNdXqmeGf1uU6/YMUTefiPYmV7Uj1FFmOLwsI4LM/njNitslZB+ddkFPHZ zUdGl1sicdD+t6Cj7+Jr5/PE43coFpB3ca1kdnZVlayOtc4u+9A= =S4xN -----END PGP SIGNATURE----- --=_373938dfb81f1ff1d5af74c34b9d4759-- From nobody Mon Sep 11 06:57:30 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkcwY3jltz4t63N; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkcwY3HKMz4R14; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694415453; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qH1UUOoE6KqKKwive9H98zBB2xaGHVj9B6YljdSPJwA=; b=q9GVuy/nue4XJzAYZP8S+zQqdgs8qaZ3ozeFkMq7OdUpdV0s0iR54jEemEllBmxnVtlc4X 6rJazr/c1j3q60oK6AUwNS9mWVKFOFZh+Noeal6rSEDrT4vNvuAIk0AEAn9SGJ93Ib4XAW jMJ0811kVEYgFNVk7CWwdzE13+digdCvSW/x81ZZClxUfZr6c4Ia5qdtLIBKtzdxsvoa6P r4W/M1+GvJCToFuqcXJwSCf7q7Iyfpey22ux3M6Y+Q2um/b4kmeutILjUgHuMcETLSe9vQ nHTRFcJ7rW3c6DpEktTw1s9CHN4dSUpVna6G8aXkdFJsIc2G+ch+QBdLLeMSAA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694415453; a=rsa-sha256; cv=none; b=rLyMWs0RB/2M+JPcaCbwLwihZ+Q0hcXDn6dNT3iNU0QXi9kFVqxcFCo9WT5opQCCrHacMR wXCK89nhJw31TJW9ArxmuGDamqZ2Jle8MgpeY4dbioWt9D7WS+UDBj2bqxlZv/sVbwtTxQ D+koxOGlB9ydZAFKkRXVVQ3gSlt+oLmPQliGNAhuah1aZpi120FU7HeKYyNAzNq+P6Xiii Z6fnCWz0eZ+HrIS83oyXQ7xOjwJABACc9vr8RuL+WY+C/KtnxH0AnXztCS3f1u6crhi/sl FWGJ+pgDjIufrM1sU8p2pH6royxmCMg0HgTUAlfqS9Qh39EDbgbQXXCiah5hOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694415453; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qH1UUOoE6KqKKwive9H98zBB2xaGHVj9B6YljdSPJwA=; b=kbo3heGyZEkpK4epXJ0WTEkba3YGZDyOVXmVdrtbpMam1cVnAyzncc29+i/8hqNC4plSAL 8i52OJoFpvDtXvPdkOeubzFIT+D5X1PHq7loTXTRciz5mZSpEbVYGeRIsghBIKyrdzWpG8 9Fsb8Q3E5AZkZbU9uBo2zTrnCsCg4ST0dlo1NZ8PhjXMuK8Sv6T9mOyQCvoscWeUPkX/eS GaK0DPIEAp4z/Wn6N1R2s+v7Gh1eP9mcdZWcJimLe/AtST7Fk+XggCOmD46gc7e4u6J1ZT z/bbV4YixVTuN9FNT28nvlrJ4TpoV4n5n6zDnltEBCCnvVktR9diP6kUUAsbdw== Received: from ltc.des.no (ti0187a400-1976.bb.online.no [85.166.95.197]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RkcwY1Mq0zvYv; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 089634EAE7; Mon, 11 Sep 2023 08:57:30 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Mark Millard Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char In-Reply-To: (Mark Millard's message of "Sun, 10 Sep 2023 12:24:30 -0700") References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Mon, 11 Sep 2023 08:57:30 +0200 Message-ID: <86wmwxp57p.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mark Millard writes: > I'm not aware of there being other documentation for what > is appropriate for setting up such for kyua runs. https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test_= image-head.sh#L69-L84 DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Mon Sep 11 07:03:48 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkd443pMtz4t9bY for ; Mon, 11 Sep 2023 07:04:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkd440wSWz4Ww9 for ; Mon, 11 Sep 2023 07:04:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694415841; bh=SDmh9PCAEKjilYIYJibKMoeloBKWMj+Ea6g504Q/i6Y=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=nZyshe8tlQ+dhbRqMnCzdXrNS9g/iK+gVuFtNL5PDheVr9Q9XPJB//AXzLlkX/dNxOCWTju4fSc798VnojzD/OqSqeAEKp1N8BH1NkclJLj8uJ4pIC2fzS4K1gr+FSiRq5EAM7s7pvYkHHjWUYvDYt+6XyXzUxCFT5QkDQWETA6g8OO+U2masT9CM285qQLSQxa+RIxIM/CAhQOaNNgxTE2bz51ANQ1v9qriC8VfXsdWd6ty62bPLqNfgnUR+HlkRHvpmbSyl0vRqA+xyL0tHrUboHtICoYLiDm2etAlkHyra0xGvksE5frGFTIcRFOMIPNRHPmlSULQtAoZxdjXKA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694415841; bh=rtbxP/mJF+CWnViYkgJIyeLJjNHUHI0jbel60IC9GX2=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=kcycE+DoPISXrUxdPgxFBghkKeWe7WPplX3Lmk1ARw+n9yTIOTn/jlOqYAMlZ2PrRgQJb3AFLts9fITYVxS8zPF93pd6gtN45hcgmDErU4kX2GsZT0ySCU+bbv5UdWSQIO7QlUQMiR8OP+vlyuz6anJIAAAH2n7XBYPAdmr2uWvdg8xPOXY9FJl7u46L/TOlT0Gb0j4WRix2W3YcAdYJvcu57B0g6GIyUUJv9yw8pLel/20oAtcmwsAz9UgNfrHBuRKyIn5F+EfrMB6BLhcccpU+rdT1g3FXzH3+OAJomVd0iY90//AvVR8t3NprGQGZ77HXNpnMX44R5s3ujeIZZw== X-YMail-OSG: KbxEe1cVM1lYPpbWYrDFGoHijq9FTkXVoQ6boGbijV684fil6udoLbKM8Mo5ta3 r0VkeqBAvw6dqWD2yBQICcRPCza5w0EVLBpL.1aNjGY5apWFf8dF1teHlzAZQKO10Zz1Lk14qY4B 9JOn01_k21RL3T8FNTh92xJqt_RhlyqkW8axECA_Vsw1E_LDWnnkSPm7I06Ckfq4KWE.UjTna.Xi u1E2aNZdxtyiwqf1IWi3J8vMFbKOigLouxG_a9sLtlP5IPiUW7pcEpiaXp.sg2TbUJxew5avLduF A0cCTru69mjxxSf0lPVUUmWZAXUiXeUlvZqF72YAtu5HiHQ1AQZMMT1bU2Po38HxEfF1aCVVZlLY l7DSn4Tj_1FRxes9MvbYEFx81SrxBGrZzO2AFrenEd2Eqofq2L7JZF.tGlGd5H0tzJkfRjN4nCIO jH.Q4PqHTu8BeA7UI8I66KizSau4FeB1x01nR.wCBsaHZqyhxxSzEPvvTqTENM8zDucEhlL4SEfn gflBSc5PvmutA191buZb.J.9QNK9AVjYZ_2KfIgGq_XI45hJOgx_wwW6vTNU2cPPjtb.joM..5Ck TnmvJWahCS127rVVGRnL1DeI5gtY2Npe.cWelyTSMZN5MJFHNYU11MVagEWynzJKeW96s3YNYrg5 A48HBv16HQGjg61u7pKxgPNb11IVovHz9LWEN0UIvbydk121568B.zMvwQ4RPDJa0FGVKkuJp0lx EKPsUEIFIWPt7PJYk43YWe9Ut4DGwYKr_vi2Z97k5QlC0jCwqKM6X.02nnKm5jkc5h9Xo6xx7i5I RdmZo.ax7_ureCOu8uSD8eR6HnMpEyqRJliEd7nWzsGDov9ycOYw2Yr46_QhbebLfwYi5PpD1nbc tJ0jqPjsMKOLKxc1sSaFQznHI7Uhi.Fp3NXbgNr9pk0BU7xC5Z_ydlDs7kSizMu1SSTjJkMGDpEX EDIifhjHTMExFPpL8_jHJkWvX6IXk5P.ZWaxtt36FHzcpvLZYj38HQsCz.MOvtsraxiPoOUNvV4n CKSKZIzWhu7Oc9PY36RRaDcXYe48Rl6hv9biFOeOwi5i1oR0h5Dft7e9HMkGT9MFvkGb7EQL5miJ GZe8dT3HTsgqXqcFK3eRQEB97_f.H548QfknOqSmsVadKEehIT53KCZ.Dw8_RuoN4UlgqJ8DFgau rEViLMr8_gKXzJjIxbJz5AOIJYB8cv5BbpJ_MjVGtIMWlGjvfITe0d7KkXMV3cBmkeklWnQ.Lkxr Xfl0.qB7PMJmNim1C6Gw_0l2J1olgJfYSYVdlshOfEk4iI8tOaVOowgxWUpcJ8MSw2qeGQIDsoZR JpjylGiUkW7hqfwiI3e02XRR_SbtEqXZY9LYX5UdH5tFHWv_3ujYV.eIbQsd5lThV3yHVNsGh6eG I3NSDND1sPnmLpHYfjRZkY4YYSwISV2JeEx4cPU_feEdq6KD0xswW1SqoZopRbrrGF6Tbxm23ysk qg4Auk1OVB2bah2odfrrH5TxY3esV_vbeCF.MEBDs2y_sRwg1ih4mybdGsQqJ8lA.b.ig5hfEkWT tl3jD5mUnOrolhPaJQUuN4aepxLwCvdLRDEkkLL9i91yaylYkOhQ6b4RNGiJhnoxVpEB0l2m7Vz_ zoD2VG4dmagPEvuHcPnbjbdiTjEBs9CxfTvnfgd5qnBegdO98MQKFH8f6gr8POrv5cgfQlIXOlaB RwzDuIgFHfkGvCGyK1KednR2NkPm8.iUSeltDHTkfMrycRl16wo64xVuqMFerUZdktsLLuZ3o6Gt 01jjVDF4Nlf.boH3dmOmLxmP.vnhKVWLQ8sPenjGTbaz3ZW13KB0vPe8KZFZB7MhxSqnIl8ErWQR ITxwjjp5errbHBW8n94U38H0TgLNER4ODDNNCE9GNJ7wvIzdFdaYRVCCoHp3EdAe0Buj1eyzs3vH hm8QLCdthYdLjLWxHEp_SIrh2LB1F6GpYAB51b0NlE4SUGT164u7ofa39rciPCn7LHySHL9t8Kv7 5t_IEydor3oxX4Iq2J93m8VUJ.anUWLflNSk0h7nfI6WV5cKaI_SQB2X_1pKMUYsooJ1Rem_ZSnm V1rj6lSYQNnTiF1saXbLB5lrGx_F1u1_9plIroMLovnk_3kHFi0S1SyhCBBb3V.rlQwFcYPA7Ein 8wg0sPzEVOk6k2mmhxTKv1YF1ftheJaLLcUe.qW5ImqD0Mf4SgZsTrZ46Gs1YxGy.9iwdOjmpswA 40JUeVuY1mBFpyYQRJVPGQhrURd8RmdspCTJ6SVPHlqGxB_W6Hu33QsQtRA2LDC_I9qH0TzeDYA0 robo- X-Sonic-MF: X-Sonic-ID: 70e68cff-1826-407b-ae23-4d1f73f110b7 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 07:04:01 +0000 Received: by hermes--production-gq1-6b7c87dcf5-qfzfj (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f814e30cdf1517bc614c64eeed259891; Mon, 11 Sep 2023 07:03:59 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <86wmwxp57p.fsf@ltc.des.no> Date: Mon, 11 Sep 2023 00:03:48 -0700 Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> <86wmwxp57p.fsf@ltc.des.no> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4Rkd440wSWz4Ww9 On Sep 10, 2023, at 23:57, Dag-Erling Sm=C3=B8rgrav = wrote: > Mark Millard writes: >> I'm not aware of there being other documentation for what >> is appropriate for setting up such for kyua runs. >=20 > = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >=20 Thanks for the reference that does not involve looking at CI log files. Filed away for future references. Side note . . . Turns out that tcptestsuite does not build for aarch64 do to alignment problems via packing in net/packetdrill : In file included from run_packet.c:45: In file included from ./tcp_options_iterator.h:31: ./tcp_options.h:108:2: error: field within 'struct tcp_option' is less = aligned than 'union tcp_option::(anonymous at ./tcp_options.h:108:2)' = and is usually due to 'struct tcp_option' being packed, which can lead = to unaligned accesses [-Werror,-Wunaligned-access] union { ^ --- sctp_iterator.o --- cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c sctp_iterator.c -o sctp_iterator.o --- tcp_options.o --- cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c tcp_options.c -o tcp_options.o --- run_packet.o --- 1 error generated. *** [run_packet.o] Error code 1 make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill --- tcp_options.o --- In file included from tcp_options.c:25: ./tcp_options.h:108:2: error: field within 'struct tcp_option' is less = aligned than 'union tcp_option::(anonymous at ./tcp_options.h:108:2)' = and is usually due to 'struct tcp_option' being packed, which can lead = to unaligned accesses [-Werror,-Wunaligned-access] union { ^ 1 error generated. *** [tcp_options.o] Error code 1 make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill 2 errors =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 08:13:18 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkfcJ44kcz4sxHb for ; Mon, 11 Sep 2023 08:13:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic308-54.consmr.mail.gq1.yahoo.com (sonic308-54.consmr.mail.gq1.yahoo.com [98.137.68.30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkfcH1B5tz3T7s for ; Mon, 11 Sep 2023 08:13:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=W4KrNCQg; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.30 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694420013; bh=SNmkxddGzS2bg40R6camNqdjv0a7N9GV4mPeRzeNHA0=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=W4KrNCQgKC/D5ey3Z6nn7AOQ/IKuMBkPoB4i+iuXTknmTAMGiqQ490VId5LaP+XNE4gze6ku8QTqBkVHjCChOAlfhhHz3UvQjq7PBVC4Q1x1U5zvZbGnp1XT/i7d95BY2atlkeDTffKpE0COmjLeu7dDTe3AFBkaB8WAFP5ckC9tLUgGza+fFBgl6/tzyXrCXnSXKALzdoY8/GUBR/n1PM01rOuy0/nL+TtSl6wgBgpM/AEl9w6jgvuMLMfMqYrstNzIKY+kxVntHJ4IvZkSO3eaSG+gRdzIjTZhcdsxM4DddWUdIgclYXuTPA7oOAhO7JX0vlqdCvP1IfKoWmfwJw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694420013; bh=CZxrPZTyTRKnnWjm+86t/xiw9eZU3Jeg86R4pdbBYGI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=dwj+Y6aVBgqdiHxzllJf4FZiHjLd/K8UROH86C1LIL9Dvev/umsMB5gg13Wuo1vh4UiZEk7VeRaaXZuObwtXGos22H/riLHUuccnkyzT2VP2C7LF6uK2iQDAQbmDDcHr+0YHLEdeFnmf7FLjZ6hR6Bz5l7CS6bl1j30pCiXXFqi/3uDSLpY3wmAJpM49o8g0GkEIcikaKPDNIKAWkNlLn2A6UtCazeaslcUdmA6l9ma+NCWslZxtkbvRZuFOUmBUFSlz9rm3p/C3CcHl2utyfi9SSuzTMyLHb4fIs93Dr846U97Skw3qy5tj9DH+jYjis6jGDt9XTeCcrr3t/6IfWA== X-YMail-OSG: mW9JKFIVM1kkkkTDTP51trPHld0tF2826Jo1YgjPHLNgw9bAhjvFWR0suo6f7x7 CUno5S2Kkch0QrNEUH9b.CmD6jq3LdeZE8zicSUANGORclxqeMcW_WB1WJLkxg6igoGn2RSw_7Te ihUgom0ITaoGJ6iUnD8lCAMOxPWTuiQLv_aUz5LkbVlHyAa9AWTh.Nkbd0GuDJOM8QUxxif0rMJF QvVJZV6g_O97fCmjTu_8s0EIcU2XvNV_NKo.a7MRROraUKcrhWqxfhe_IMFy2V1ktEKwLCgjZM9C w4poFp3l3A.WtYxpp1leoHxVMZhMzuQycGX3sRlWIqabBzHaccx8wSZrlEauo0bmGpdmh3zoZrm. 3obgB1w39JCNmM.7cw5OS0vaOwpvKipD309C20UvBTJX13aF8u045v3Q66dZ2iZlXFq2BwyGc_zW QZKDSQfCgqMNxkKQlJgqDA4GXbpZoISkbiV3.qm3dd6GbWHB7qNOEFZHTbyDf2lW_y6HP3_Ybagb _r9xw1Wo7UsGfBulPqG06dys4DQqrP4lUVywrgxs9lw7CxADe7bMEJhgigxpVXsWbLJIyyqkZzim i_EfgYkXJTzHEszslAjyTNQdkPT3lk58rjFSTEJKajhEsZ_GTbuNdB3swRRH.NUBMg_Q5LowF77E Y4XiDYOB2PJmmGWNViX.hz87KIu3lLMZS_3hR5ByEwNKe10T_2WTPy9KpRUorWkVP9RiYf3cd8jV 0Z5a4YQb_SSTzQywfuFBEAaGPjSZPfA5.v95C8t_x2NuZXpe_jAruIxsx95VTQTwq4ToTz4a32KC dA3ktT3c2d4Z.Mvyef0d8xukWQcqMLDelm1swC7URrDSnYQprvFPco.UqigxRgJZ6OKrbkg4QYAU 0Ve6tlonhAnqQp01entLNyGahK7lHpelRN6UxL466ulmGMGy7eI8tXP7dCoT5ZuVmMBINNSyaBu5 XcbhQj4_0b1cKSEg1YHOMx41jekAi.7PZnA5pTLD1r3KlVb65gnaEseSsKYMxrZd8sHAQhCe_4qo rtfR_cDWugUIXm.lozoSggkK5mIy4ruRHYwbbS8XmFy3InqFqsf4lGnng0lJYy.bzRqzh_.mxi.0 2SVWirDFhIef32ICOv51MrCVRiMppVrpl26OK0zmvYAKuYEVhF_yGe5nyYRwh4DHgIPi3UcYo91Q blsEqrXXKkJapMhdYgB7VeO3h02_eeNn6HD5CfdDtFefWX_xk_zHh7sCouqUfr0hHIQGOPnFcSP. kf.uq9XupHjMCThgXE6nBsigklZOJ.bbcOPB3i7c6eA_WYFQjvR7FdXg7.apaJnG36KqgnkL1vsc 6QCzwiopVebJZPoEsL0dtJCdCCUmL4dz1jK9eSLbzhPlPtOQNl3WwT9VhZNNHfRKqX83qdWOz.9v 1T7KiCNz4YcC3En6PRvikF8rb4tP_VOKc2ADogMzeKxKKSzDZCcX1qILHCz5u1CAxaa84x9q19al ilteopqJSkgC.JJvdqb2Y2uHus4.NkQbc4gVrPhd7uVO1TX2.SAthwJbgjTmZowIx80RhUasHm2k EeUfMNGtzqHo0qDSIdEXGJvXx6WiwlJJ9ClYNKSk8cR4uR2R5uV1mrUWhPM4o.w_r.VEU_8Vqf56 Vz4B9zwWJLxx3_GkiVNQM9Z3KkQU7jxeh9F2isA9cpkPPApgTrd1rTbEf0H4Uix25PrvIWb6_gpq RM.fG.J5CQn4axh_JDp06q2dlciKoR2wfG_REYc0W7X9fGV8CuK_0GtWQDmzomsGLRK1h6RTgqzR KTZIiDiT5YgGYGIA3pKNbBSnkbHkLFqv4aVcp1YaEZ7_Re24q0f3_isW_MxMQpnPW_4GJnmBPRLb g0bPignjhZ9G0_ZCyHF1HE_oQ5DEulRpNNZW609Asc8wZkM0HhfTdxNv_BF0gGSnsIm7oh3105Ou gAZHZqmtO9hr0dy6sZdky2sLfi41th_fdzTcXpCYTSrIG9BDqsOIUo0yybTTnK9BU7xQma.uiK1z zyHsBoFXNzalUyBP8OagAylkBIcAkn4lp92av.yHXB.LkoTbVx0tOjIxtLV3bMooG9Pi._UHcRip dBnZDJBx0XLgV6hxxAz3pHXFLOO8EFypjRvqozWlPsNJF8XW._nYfa4q3jwp.83.Yzi0o38WYiO6 YrDLLKtgjRsTR9T8bvg6zXI0U6nue_QSdT3.bcCvwVOSIKHY1YSouIvmJw0bu4jQK7HDlm.XZ1xd kvY3JDgLZU4kxOHkdyl8Mx9utLIUVsk1dk4MCIt2ls6Zz28G.MNDVUZa0STypl8U7LRV212uBJm6 QQmcP X-Sonic-MF: X-Sonic-ID: 841a8442-cc5b-407c-8e0b-638279886f0e Received: from sonic.gate.mail.ne1.yahoo.com by sonic308.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 08:13:33 +0000 Received: by hermes--production-gq1-6b7c87dcf5-j6k2s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID cf3d50cc1a683e5ae488cebcca2597d6; Mon, 11 Sep 2023 08:13:29 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: aarch64 main [so: 15] panic's in kyua's sys/net/if_lagg_test:status_stress Message-Id: <318444EA-B18D-4A6B-8D74-2A4276E366A8@yahoo.com> Date: Mon, 11 Sep 2023 01:13:18 -0700 Cc: freebsd-arm To: Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <318444EA-B18D-4A6B-8D74-2A4276E366A8.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.22 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.72)[-0.721]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.30:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkfcH1B5tz3T7s It will be some time before I can try this with an official snapshot instead of a personal build. The build is based on b6ce41118bb1 : # uname -apKU FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #17 main-n265279-b6ce41118bb1-dirty: Sun Sep 10 14:36:47 PDT = 2023 = root@CA78C-WDK23-ZFS:/usr/obj/BUILDs/main-CA78C-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA78C arm64 aarch64 1500000 1500000 So it was a non-debug build, although I do not strip symbols and such in my builds. . . . sys/net/if_lagg_test:create -> passed [0.105s] sys/net/if_lagg_test:create_destroy_stress -> skipped: Skipping this = test because it easily panics the machine [0.019s] sys/net/if_lagg_test:lacp_linkstate_destroy_stress -> passed = [60.045s] sys/net/if_lagg_test:set_ether -> passed [0.066s] sys/net/if_lagg_test:status_stress -> =20 The core.txt.5 is not great, unfortunately: panic: vm_fault failed: 0xffff0000006b96dc error 1 GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] . . . Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: (dump_iface + 0x2c0) elr: 0xffff0000006b96dc (dump_sa + 0x1c) spsr: 0x0000000000400045 far: 0x44572d4338374144 esr: 0x0000000096000004 panic: vm_fault failed: 0xffff0000006b96dc error 1 cpuid =3D 2 time =3D 1694414226 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x1a0 panic() at panic+0x44 data_abort() at data_abort+0x304 handle_el1h_sync() at handle_el1h_sync+0x14 --- exception, esr 0x96000004 dump_sa() at dump_sa+0x1c dump_iface() at dump_iface+0x2bc dump_cb() at dump_cb+0x18 if_foreach_sleep() at if_foreach_sleep+0x244 rtnl_handle_getlink() at rtnl_handle_getlink+0xec rtnl_handle_message() at rtnl_handle_message+0x19c nl_taskqueue_handler() at nl_taskqueue_handler+0x674 taskqueue_run_locked() at taskqueue_run_locked+0x194 taskqueue_thread_loop() at taskqueue_thread_loop+0xcc fork_exit() at fork_exit+0x88 fork_trampoline() at fork_trampoline+0x14 KDB: enter: panic get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); (kgdb) #0 get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 #1 doadump (textdump=3D0, textdump@entry=3D4003518992) at /usr/main-src/sys/kern/kern_shutdown.c:405 #2 0xffff0000000f7704 in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) at /usr/main-src/sys/ddb/db_command.c:591 #3 0xffff0000000f74e0 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) at /usr/main-src/sys/ddb/db_command.c:504 #4 0xffff0000000f71b8 in db_command_loop () at /usr/main-src/sys/ddb/db_command.c:551 #5 0xffff0000000fad9c in db_trap (type=3D, = code=3D) at /usr/main-src/sys/ddb/db_main.c:268 #6 0xffff0000004f4ec4 in kdb_trap (type=3D60, code=3D0, tf=3D) at /usr/main-src/sys/kern/subr_kdb.c:790 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 Backtrace stopped: Cannot access memory at address 0x10 (kgdb)=20 So some transcribing of a picture in order to show register values that were reported: Fatal data abort: x0: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) x1: 0x0000000000000001 x2: 0x44572d4338374143 x3: 0xffff0000005d3f90 (ifdead_ioctl + 0x0) x4: 0xffffa00b7f0d185e x5: 0xffffa0023fe4b992 x6: 0x000000006767616c x7: 0x00706174016f7575 x8: 0x00000000000001a4 x9: 0x0000000000210005 x10: 0=C3=970000000000000800 x11: 0xfefefefefefefeff x12: 0x0000000000000008 x13: 0x0000000000000000 x14: 0x00000000000000ff x15: 0x0000000000000700 x16: 0x0000000000000008 x17: 0x0000000000000007 x18: 0xffff0001eea0e500 (_DYNAMIC + 0x6d816358) x19: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) x=EF=BB=BF20: 0xffffa00b7f0d1800 x21: 0xffffa00b7f0d1858 x22: 0x000000000000000c x23: 0X0000000000000005 x24: 0=C3=970000000000000000 x25: 0xffff000000c68000 (sysctl___kern_features_netlink + 0x10) x26: 0x0000000000000000 x27: 0xffff000000ce9000 (cap_linkat_source_rights + 0x8) x28: 0xffff0000006bb0a0 (dump_cb + 0x0) x29: 0xffff0001eea0e520 (_DYNAMIC + 0x6d816378) sp: 0xffff0001eea0e500 lr: 0xffff0000006b8fe0 (dump_iface + 0x2c0) elr: 0xffff0000006b96dc (dump_sa + 0x1c) spsr: 0x0000000000400045 far: 0x44572d4338374144 esr: 0x0000000096000004 panic: m_fault failed: 0xffff0000006b96dc error 1 I expect that this is similar to reports I'd made back in 14.0-CURRENT days. As I remember, snapshot builds of the time also got the panic. I will note that an earlier 14.0-BETA1 snapshot kernel test run did not panic at this point in the sequence (or at any point). But I do not know how repeatable the panics are in the various contexts. I'll note that I've tried to have the various ports installed (poudriere built) that are listed at: = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 (The ones that build for aarch64, anyway.) I had in /etc/kyua/kyua.conf : test_suites.FreeBSD.disks =3D '/dev/md0 /dev/md1 /dev/md2 /dev/md3 = /dev/md4 /dev/md5' and used: # more ~/prekyua-aarch64-mdconfig.sh=20 #! /bin/sh truncate -s 4g /var/tmp/for-md0.dat truncate -s 4g /var/tmp/for-md1.dat truncate -s 4g /var/tmp/for-md2.dat truncate -s 4g /var/tmp/for-md3.dat truncate -s 4g /var/tmp/for-md4.dat truncate -s 4g /var/tmp/for-md5.dat mdconfig -f /var/tmp/for-md0.dat -u md0 mdconfig -f /var/tmp/for-md1.dat -u md1 mdconfig -f /var/tmp/for-md2.dat -u md2 mdconfig -f /var/tmp/for-md3.dat -u md3 mdconfig -f /var/tmp/for-md4.dat -u md4 mdconfig -f /var/tmp/for-md5.dat -u md5 I also did a: # kldload linux64 before doing: # /usr/bin/kyua test -k /usr/tests/Kyuafile (Not true of linux64.ko in 14.0-CURRENT days.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 08:53:55 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkgWF026wz4tMwF for ; Mon, 11 Sep 2023 08:54:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-23.consmr.mail.gq1.yahoo.com (sonic303-23.consmr.mail.gq1.yahoo.com [98.137.64.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkgWC60QCz4CXM for ; Mon, 11 Sep 2023 08:54:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=njvO6y2U; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694422453; bh=tuIdAuRIsZazZe0e/kYk7K/+tud/OzNIrQT2hyIoBJg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=njvO6y2UmT1SZn4qq/k0ArBjvAsY8dTHAR8bQAWJFv0p6WoHYgibxUtz38zwRhtHnAgWqua34gvIFBB6LrqNN/gh+KgEihyR6MQZuIz5hVceWoNvBV/SaXDXxvQelMzuHBw4q00XoAyK93EdLNHemyAUMN0g/0ZtOULK8nz76otdMMNROX8txKX+kexg1iNHOxikkng4q/lEY9727GJFEjrvxskAiMKoVzEuQX2fAdinKTEXxymhTC0olRLgdW5FNM/6NSldDFG3LZBbJPxf6kfQ4PdtiPyE12IuyBZXxxU+Z7xPPEWBpubH7X2qEzP0nnF33/WgQelJxL5u+Lkyjg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694422453; bh=y3XAMzR3phaxQEUgR87Zmh97xHTNHqDdm+ErIZlYN9h=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=byCJun6x28aL406rdpO2ZF9nypUjXF5DCXXlsGKqCOCBEeS+U7hfZkIDggz3t/bCd+zrBMF4NdSsMYNb1dNJD08Fqt/U2Bpl1WlfC6Hdokvbj8jiBEmOZAVA4Q7o+UyVaATsAMLdVgeGTinxMI5DPYBs5cNqHjb11oWQbrkpwejKJZfYKKcNndfl4hN93wpoAOg+2xEJ5foR6k6ZXADeZ7ILnF2ZS01h0ViNJFIYNP8zoLu/QAgF+N+fV7gHPwPgpJ8JxgE58PLhh9sMGeIlPvc88cJj9vhydF6CVPZlEdbT9GuXm38GC7CBjhGP990wiujdUdLpB4a205wgsq6MSw== X-YMail-OSG: 8Ie.nzUVM1mo36WWV03mW4auuK6urW35NN4HSsvd9UH2gj3GSUcDK20r5MBFgeS VievHs3hLgC2TA4Q1jI_hSOk3kIypoJksvC306NxdH2qIutfK5IGO5_aZm8QwLGrqbAIk.phE3V9 HZEx4fIOfEsSnzeyGJNoThx0IO1nMawI3AO9kL6iU285d66aitjLBeRYKQRrrkg7CYkcizHWMoLt NMg7rhX4whEwo2OicCwpqFzZ_NsvXuGyLc3PZtb79BShe3HJh5wXl6XAguoU7vQZ3cuzp3v72JMX KAiB_JfaN5H0DmP2WDbuOm8mOhVr_Z2dNNxKzlTr7WNZDLIl4pm4I4_yzrSc59qg5Y_HDUZy3xu4 2NtjmZH0slFvYfxk0dWeYnJpRtxG_AHQrUCRFJtLJVQ8wcGYInYkFH4BHfJEZnIYuf826GbvZW9P VZKY7kpFBmx3JJF1aqaTmJ0mw.U5Y5IqQrjrF9td5B8fWYRR20ENbtDV8oY7M..sYRxpcZJ7qIC3 5Ow5DjI89uGvr5hpADZ9xXvRMD.9KuDdpInWxAnTWgyczrIsmBbJKc6UyhKbfw5S3jpSZ5bCt5yN 6GO5JIS8NTYp9zgDzqcU7tTpHNupisHtcZskWRq55cGY8IwYct1hMk5mpznTp.KPOIMXq6gGz5n. AvM1rI7VZpfC1FWzi7FLcqMFZif0rEOYh8f1LrP9U750aTP2IMgOr82gJVFq9fFy0b7cQ7AubzII .0KfheM6SGGvJ_7RdG1XUvR4l9ADFN.nPQqJ95exfIAG2QagrKXdWF4e3qqgFWEracEPdCZ7Ob61 DtXyRuQRk6twSoANdWqZTrZhubMnEMASCe1ysv_SHrCQxNUkCPhPjk.jfmwnTRCXlmNAZp3WF1BO pdsKDlHucwWWyg0NqQYrg48QahKQbHcJ7ETSx6lvK0T_0VbVNPb9Mqjvv8Qj0FB.MGP0b0SklRmx 2qAUhb.n3LfP9BlTW2Nf3VgwGZxXwv9fLAmHJXClTYZOgXv9zEs_X8Z4u5fM6Am9x4FGx7VwqHff ht4t4AYBx8ztss45SPIt8ie2vDrdgWNE02FERC1XR4SXRSnMh2B3CaHFKKv3Jcf8ce7ngPElRbQM L9BDU0wARaTx7sNbJHhusTMh.QiENYQs5_JB.z7y2bSyn2TUF2kpQbuzAUkBuvMH_ZUmmxgJq3jf CADQQFUlRGEKKIEojsri_EG5sFdaYBk.GboHDrLl2uWlaqWtDEdsfT5KmLjyAQY8iQVrAYasBZv1 BHZrxP4kC7ARVNsjQQoL_BzayugaPXKo6828s8FkEkvMLzWJucpV.Zxm55cMwN6wltib.CmS18Wp T.P2pu9hjwcTc2vBjdDv9qfZ4P7wHNzyvJSJNSzwLMp09x7BzKvc6fzvSEoxRd.zOyvir6oA4DX5 pdwbZOiQIYvqGr_o2XvQccJklGwl93h6vzNWyYByAiEaWs84lC_bzjItHTUisyjyjrOyY4ot4F2d DDmmGOTDI9d2JTQinJaoQWIP85Pjd1wjU313IbX9yqWC36J5MiqnUC8KmfyBDU6Ew5tUjzWFqSmx oUPbTVtd1MVm7DkwVTE7dQOOjHzc9IdDUnApnhamUs8LN__T3ZCVdn4z_nCc2Ymu7M5MGzB.dldR ZzVd3DqdEpVKYLHBWSP.r6J3jbEmhUi0SawztpcpwN71lNV5rnZDt.APwJBTxrM_SoQDNnNJB5cj C7mdyKO1y1z2HS0gWb4HMIhrfxeGgBcm6G.49bSsoSlFAeP1cKkH32UE_muGe2hfQB8FJh6BKaa3 CKJGXpKwce3Ez0XIsy482_RBfhlfjiqcfFeQ2rNumCCVDEui_0cLTeRSlgnJnsPX20cfggY0AuuW QPlcs6jYMWchj0vftQy2eynrsSVwakV4ScE4D32y9gfSu0enKXUPx7mOFqRMoBFANo5DzJabETYT .8x.omYJzPfzjbxDHkaDixmknu16JNQhMHI7Lq9jbkjYVxciZsrQgcPp9FYQbqNzxVGaPM99UJJz ItkLoFd6rxOilgrQgQ_Da9H1nZdfA4B8MyLqZo.dWs29yjNO6QkRIGpxNo21uuDc6IjIH5lrTFS8 HqNC8Of7pfZtI9Vcz3II3ErFMDdTl3cEg3FxZPDw9Xn9ugbiLrSfDPwOnwQlT9EAQ1iUojq5ZEkG jDRVhE.1sYHyMXcadt1KpwQEpLOH.6Mk_cJGgWTG82GckRVi13CjAN4yQNKmsh4hIdWNiePpoqj_ XJsmgdhJnw_i4FEpzo6Rgle.hyHb5ufFxdT4V3TuhAzxohuO7VuSgT3.oFRg8Ylfis4WpDDCrlgH _YxAS81c- X-Sonic-MF: X-Sonic-ID: 0fa19580-3799-45d2-89e9-c02e78923cb4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 08:54:13 +0000 Received: by hermes--production-ne1-7b767b77cc-fbxjt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID e5c40d4f2efcdd0bed61cc3439eb5b8c; Mon, 11 Sep 2023 08:54:08 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> Date: Mon, 11 Sep 2023 01:53:55 -0700 Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <20C7F20D-8458-4BDE-9E66-F12CD5F2C230@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> <86wmwxp57p.fsf@ltc.des.no> <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.48 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.984]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[10]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkgWC60QCz4CXM On Sep 11, 2023, at 00:03, Mark Millard wrote: > On Sep 10, 2023, at 23:57, Dag-Erling Sm=C3=B8rgrav = wrote: >=20 >> Mark Millard writes: >>> I'm not aware of there being other documentation for what >>> is appropriate for setting up such for kyua runs. >>=20 >> = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >>=20 >=20 > Thanks for the reference that does not involve looking at > CI log files. Filed away for future references. >=20 >=20 > Side note . . . >=20 > Turns out that tcptestsuite does not build for aarch64 > do to alignment problems via packing in net/packetdrill : >=20 > In file included from run_packet.c:45: > In file included from ./tcp_options_iterator.h:31: > ./tcp_options.h:108:2: error: field within 'struct tcp_option' is = less aligned than 'union tcp_option::(anonymous at = ./tcp_options.h:108:2)' and is usually due to 'struct tcp_option' being = packed, which can lead to unaligned accesses = [-Werror,-Wunaligned-access] > union { > ^ > --- sctp_iterator.o --- > cc -O2 -pipe -mcpu=3Dcortex-a7 Looks like I messed up and reported an armv7 context. aarch64 built net/packetdrill and net/tcptestsuite just fine. Sorry for the noise. > -Wno-deprecated -g -fstack-protector-strong -fno-strict-aliasing = -mcpu=3Dcortex-a7 -Wall -Werror -g -c sctp_iterator.c -o sctp_iterator.o > --- tcp_options.o --- > cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c tcp_options.c -o tcp_options.o > --- run_packet.o --- > 1 error generated. > *** [run_packet.o] Error code 1 >=20 > make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill > --- tcp_options.o --- > In file included from tcp_options.c:25: > ./tcp_options.h:108:2: error: field within 'struct tcp_option' is = less aligned than 'union tcp_option::(anonymous at = ./tcp_options.h:108:2)' and is usually due to 'struct tcp_option' being = packed, which can lead to unaligned accesses = [-Werror,-Wunaligned-access] > union { > ^ > 1 error generated. > *** [tcp_options.o] Error code 1 >=20 > make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill > 2 errors >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 13:47:19 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkp1b5BR5z4t3HH for ; Mon, 11 Sep 2023 13:47:31 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (cross.sbone.de [195.201.62.131]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE Root Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkp1Z5PBJz4Txv for ; Mon, 11 Sep 2023 13:47:30 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of bzeeb-lists@lists.zabbadoz.net designates 195.201.62.131 as permitted sender) smtp.mailfrom=bzeeb-lists@lists.zabbadoz.net; dmarc=none Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id C29F38D4A179 for ; Mon, 11 Sep 2023 13:47:22 +0000 (UTC) Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 7421A2D029D1 for ; Mon, 11 Sep 2023 13:47:22 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id NAR-hPHZ03nF for ; Mon, 11 Sep 2023 13:47:21 +0000 (UTC) Received: from strong-aiccu0.sbone.de (strong-aiccu0.sbone.de [IPv6:fde9:577b:c1a9:f491::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 10A862D029D3 for ; Mon, 11 Sep 2023 13:47:20 +0000 (UTC) Date: Mon, 11 Sep 2023 13:47:19 +0000 (UTC) From: "Bjoern A. Zeeb" To: current@FreeBSD.org Subject: kernel trap 12 .. cam_periph_release_locked_buses() panics under panic? Message-ID: <514n7872-pp9r-np6p-q6q3-044q4q90709o@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset=US-ASCII X-Spamd-Bar: / X-Spamd-Result: default: False [-0.96 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_SPAM_LONG(0.34)[0.342]; R_SPF_ALLOW(-0.20)[+ip4:195.201.62.131]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[current@FreeBSD.org]; BLOCKLISTDE_FAIL(0.00)[195.201.62.131:server fail]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[zabbadoz.net]; RCVD_COUNT_THREE(0.00)[4]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:24940, ipnet:195.201.0.0/16, country:DE]; FROM_HAS_DN(0.00)[]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4Rkp1Z5PBJz4Txv Hi, had a kernel hitting an alll-to-known wifi issue and panic (I was actually happy I could reproduce) and then the screen kept scrolling for a while panicing all over again and ddb was unusable (not so happy). I assume the problem is cam_periph_release_locked_buses()? /bz ... --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = 0xfffffe00907fa4a0 --- cam_periph_release_locked_buses() at cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 kernel trap 12 with interrupts disabled Fatal trap 12: page fault while in kernel mode cpuid = 2; apic id = 02 fault virtual address = 0xfffffe00907fa4a8 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff8101f660 stack pointer = 0x0:0xfffffe00907f8f90 frame pointer = 0x0:0xfffffe00907f9020 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = resume, IOPL = 0 current process = 0 (iwlwifi0 net80211 t) rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8 rcx: fffffe00907f9030 r8: 0000000000000000 r9: 0000000000000000 rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020 r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8 r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030 trap number = 12 panic: page fault cpuid = 2 time = 1694439681 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f8c60 vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90 panic() at panic+0x43/frame 0xfffffe00907f8df0 trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50 trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0 calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0 --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f8f90, rbp = 0xfffffe00907f9020 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020 db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0 db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9160 vpanic() at vpanic+0x132/frame 0xfffffe00907f9290 panic() at panic+0x43/frame 0xfffffe00907f92f0 trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350 trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0 calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0 --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9490, rbp = 0xfffffe00907f9520 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520 db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0 db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9660 vpanic() at vpanic+0x132/frame 0xfffffe00907f9790 panic() at panic+0x43/frame 0xfffffe00907f97f0 trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850 trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0 calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0 --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9990, rbp = 0xfffffe00907f9a20 --- db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20 db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60 db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0 db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9b60 vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90 panic() at panic+0x43/frame 0xfffffe00907f9cf0 lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame 0xfffffe00907f9d70 lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9df0 ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame 0xfffffe00907f9e40 taskqueue_run_locked() at taskqueue_run_locked+0xab/frame 0xfffffe00907f9ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame 0xfffffe00907f9ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30 --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = 0xfffffe00907fa4a0 --- cam_periph_release_locked_buses() at cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 kernel trap 12 with interrupts disabled ... -- Bjoern A. Zeeb r15:7 From nobody Mon Sep 11 14:18:36 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkpjk1qzRz4tMD5 for ; Mon, 11 Sep 2023 14:18:50 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkpjk012Jz4fln for ; Mon, 11 Sep 2023 14:18:49 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62d.google.com with SMTP id a640c23a62f3a-986d8332f50so600509966b.0 for ; Mon, 11 Sep 2023 07:18:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694441928; x=1695046728; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=xxo9FTic7ZvdGaZ1CIT6MKozwa7I7RUPf1fgyQ7m5GU=; b=kCF45Ef5xFhw83FPWWDH8JeyTy7um4qQGphs4P9yK+k1GbTLS4o+4sEoy5qIqcDifx BcTB1ALHNrM5FSymZAu8aNBoeN+33pDYS7HvzTMbKPlFfgTxbD2fuHO8Rhi1UZylRRPw jXOkGGC/xeDVypQC3srhQFx2D2lGfHhIG1BGuXRjoB9qAMZgjjVxceApUEDvSXRW0AqW rj/C71T3gLSgCvJrk+J7b5X9qQKqPRfjLtyxLXXzC/917fC9kk/F49KCb8yYCSBpfAwB ahXHMlKJ5s46FK+dbwI3VvO/8h4RV388TNtzo3PCK1gZu45uXvd6OhhSaNpfa1f/AiQ1 Oqtw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694441928; x=1695046728; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=xxo9FTic7ZvdGaZ1CIT6MKozwa7I7RUPf1fgyQ7m5GU=; b=JsxHKh4GZ+O8h5QYVt2kBr7HI45Os3lYwRJaUDfA+GoLoiZSFibUcIJw3h/iYf4UJF rfjzP8VLjQr7qquhRjjnhcAScAbJBxWYAKE4krPyKP4LXbOWUMncc0NxqTWar3/DlP1p ZiHTadYnDcdvFx1cmbmZf2uCtJuc1bOUwsl5P1UfEyMyT524QZb90qDHUxEWMI51Nlnu vugZTbu5TNUH7/31cX05v37L2Y4YLUmh/6rHkho1BEvgPeMssZ5HAompva3+G8YFuqXw tL1/A7iZNr/GosMYzbAMoeR57IT3QPE49jUvH1QuAferi7xNq3+31J3gBgBUfWKO+Byc rT9Q== X-Gm-Message-State: AOJu0Yz4N9SrJqdVQf0IN6tdFIp3VZ9DCeAnmlj4JCgYrY4LDuxJU4La W0OxcBlB3Zh9bh58wxtEZ1R477S/emnSGxYpqNLRsw== X-Google-Smtp-Source: AGHT+IGrsGs+eXF9XXEMjUV7/MJAu8oMjO5kB1YapIjAHPzAF7nRYLKEu2l40LQf/tkfm8+IvnV+jm/X1gew2D43bew= X-Received: by 2002:a17:907:78d1:b0:9a1:f96c:4bb2 with SMTP id kv17-20020a17090778d100b009a1f96c4bb2mr8802938ejc.50.1694441927987; Mon, 11 Sep 2023 07:18:47 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <514n7872-pp9r-np6p-q6q3-044q4q90709o@yvfgf.mnoonqbm.arg> In-Reply-To: <514n7872-pp9r-np6p-q6q3-044q4q90709o@yvfgf.mnoonqbm.arg> From: Warner Losh Date: Mon, 11 Sep 2023 08:18:36 -0600 Message-ID: Subject: Re: kernel trap 12 .. cam_periph_release_locked_buses() panics under panic? To: "Bjoern A. Zeeb" Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="00000000000035eaae06051601e8" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rkpjk012Jz4fln --00000000000035eaae06051601e8 Content-Type: text/plain; charset="UTF-8" That's a crazy traceback. We get a fatal trap and then call into the wifi stack? That makes no sense in the absence of some crazy data corruption or a weird traceback issue. On Mon, Sep 11, 2023, 7:47 AM Bjoern A. Zeeb wrote: > Hi, > > had a kernel hitting an alll-to-known wifi issue and panic (I was actually > happy I could reproduce) and then the screen kept scrolling for a while > panicing all over again and ddb was unusable (not so happy). > > I assume the problem is cam_periph_release_locked_buses()? > Unlikely given the rest of the traceback.... Can you get a core so we can look at it more deeply? Warner > /bz > > ... > --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = > 0xfffffe00907fa4a0 --- > cam_periph_release_locked_buses() at > cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 > kernel trap 12 with interrupts disabled > > > Fatal trap 12: page fault while in kernel mode > cpuid = 2; apic id = 02 > fault virtual address = 0xfffffe00907fa4a8 > fault code = supervisor read data, page not present > instruction pointer = 0x20:0xffffffff8101f660 > stack pointer = 0x0:0xfffffe00907f8f90 > frame pointer = 0x0:0xfffffe00907f9020 > code segment = base 0x0, limit 0xfffff, type 0x1b > = DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags = resume, IOPL = 0 > current process = 0 (iwlwifi0 net80211 t) > rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8 > rcx: fffffe00907f9030 r8: 0000000000000000 r9: 0000000000000000 > rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020 > r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8 > r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030 > trap number = 12 > panic: page fault > cpuid = 2 > time = 1694439681 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe00907f8c60 > vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90 > panic() at panic+0x43/frame 0xfffffe00907f8df0 > trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50 > trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0 > calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0 > --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f8f90, rbp = > 0xfffffe00907f9020 --- > db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020 > db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060 > db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0 > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe00907f9160 > vpanic() at vpanic+0x132/frame 0xfffffe00907f9290 > panic() at panic+0x43/frame 0xfffffe00907f92f0 > trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350 > trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0 > calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0 > --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9490, rbp = > 0xfffffe00907f9520 --- > db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520 > db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560 > db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0 > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe00907f9660 > vpanic() at vpanic+0x132/frame 0xfffffe00907f9790 > panic() at panic+0x43/frame 0xfffffe00907f97f0 > trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850 > trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0 > calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0 > --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9990, rbp = > 0xfffffe00907f9a20 --- > db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20 > db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60 > db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0 > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > 0xfffffe00907f9b60 > vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90 > panic() at panic+0x43/frame 0xfffffe00907f9cf0 > lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame > 0xfffffe00907f9d70 > lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9df0 > ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame > 0xfffffe00907f9e40 > taskqueue_run_locked() at taskqueue_run_locked+0xab/frame > 0xfffffe00907f9ec0 > taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame > 0xfffffe00907f9ef0 > fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30 > --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = > 0xfffffe00907fa4a0 --- > cam_periph_release_locked_buses() at > cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 > kernel trap 12 with interrupts disabled > ... > > -- > Bjoern A. Zeeb r15:7 > > --00000000000035eaae06051601e8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
That's a crazy traceback. We get a fatal trap an= d then call into the wifi stack? That makes no sense in the absence of some= crazy data corruption or a weird traceback issue.=C2=A0

On Mon, Sep 11, 2023= , 7:47 AM Bjoern A. Zeeb <bzeeb-lists@lists.zabbadoz.net> wrote:
Hi,

had a kernel hitting an alll-to-known wifi issue and panic (I was actually<= br> happy I could reproduce) and then the screen kept scrolling for a while
panicing all over again and ddb was unusable (not so happy).

I assume the problem is cam_periph_release_locked_buses()?
=

Unlikely given th= e rest of the traceback....

Can you get a core so we can look at it more deeply?

Warner=C2=A0


/bz

...
--- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6db69f8, rb= p =3D 0xfffffe00907fa4a0 ---
cam_periph_release_locked_buses() at cam_periph_release_locked_buses+0x43/f= rame 0xfffffe00907fa4a0
kernel trap 12 with interrupts disabled


Fatal trap 12: page fault while in kernel mode
cpuid =3D 2; apic id =3D 02
fault virtual address=C2=A0 =C2=A0=3D 0xfffffe00907fa4a8
fault code=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D supervisor r= ead data, page not present
instruction pointer=C2=A0 =C2=A0 =C2=A0=3D 0x20:0xffffffff8101f660
stack pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0x0:0xfffffe00907= f8f90
frame pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0x0:0xfffffe00907= f9020
code segment=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D base 0x0, limit 0= xfffff, type 0x1b
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0=3D DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D resume, IOPL =3D 0
current process=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0 (iwlwifi0 net80211 t= )
rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8
rcx: fffffe00907f9030=C2=A0 r8: 0000000000000000=C2=A0 r9: 0000000000000000=
rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020
r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8
r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030
trap number=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 12
panic: page fault
cpuid =3D 2
time =3D 1694439681
KDB: stack backtrace:
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f8= c60
vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90
panic() at panic+0x43/frame 0xfffffe00907f8df0
trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50
trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0
calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0
--- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f8f90, rbp = =3D 0xfffffe00907f9020 ---
db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020
db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060
db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9= 160
vpanic() at vpanic+0x132/frame 0xfffffe00907f9290
panic() at panic+0x43/frame 0xfffffe00907f92f0
trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350
trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0
calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0
--- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f9490, rbp = =3D 0xfffffe00907f9520 ---
db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520
db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560
db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9= 660
vpanic() at vpanic+0x132/frame 0xfffffe00907f9790
panic() at panic+0x43/frame 0xfffffe00907f97f0
trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850
trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0
calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0
--- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f9990, rbp = =3D 0xfffffe00907f9a20 ---
db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20
db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60
db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0
db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00907f9= b60
vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90
panic() at panic+0x43/frame 0xfffffe00907f9cf0
lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame 0xfffffe00907f= 9d70
lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9df0
ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame 0xfffffe00907f= 9e40
taskqueue_run_locked() at taskqueue_run_locked+0xab/frame 0xfffffe00907f9ec= 0
taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame 0xfffffe00907f9= ef0
fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30
fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30
--- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6db69f8, rb= p =3D 0xfffffe00907fa4a0 ---
cam_periph_release_locked_buses() at cam_periph_release_locked_buses+0x43/f= rame 0xfffffe00907fa4a0
kernel trap 12 with interrupts disabled
...

--
Bjoern A. Zeeb=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r15:7

--00000000000035eaae06051601e8-- From nobody Mon Sep 11 14:26:23 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkptf5FSQz4tRHq for ; Mon, 11 Sep 2023 14:26:34 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Received: from mx1.sbone.de (mx1.sbone.de [IPv6:2a01:4f8:13b:39f::9f:25]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mx1.sbone.de", Issuer "SBone.DE Root Certificate Authority" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkptf0SrCz3Dvq for ; Mon, 11 Sep 2023 14:26:34 +0000 (UTC) (envelope-from bzeeb-lists@lists.zabbadoz.net) Authentication-Results: mx1.freebsd.org; none Received: from mail.sbone.de (mail.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) (using TLSv1.2 with cipher ADH-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.sbone.de (Postfix) with ESMTPS id 5C6518D4A179; Mon, 11 Sep 2023 14:26:26 +0000 (UTC) Received: from content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPS id 0F18E2D029D4; Mon, 11 Sep 2023 14:26:26 +0000 (UTC) X-Virus-Scanned: amavisd-new at sbone.de Received: from mail.sbone.de ([IPv6:fde9:577b:c1a9:4902:0:7404:2:1025]) by content-filter.t4-02.sbone.de (content-filter.t4-02.sbone.de [IPv6:fde9:577b:c1a9:4902:0:7404:2:2742]) (amavisd-new, port 10024) with ESMTP id t0eSmSZrKgT0; Mon, 11 Sep 2023 14:26:24 +0000 (UTC) Received: from strong-aiccu0.sbone.de (strong-aiccu0.sbone.de [IPv6:fde9:577b:c1a9:f491::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by mail.sbone.de (Postfix) with ESMTPSA id 813712D029D2; Mon, 11 Sep 2023 14:26:24 +0000 (UTC) Date: Mon, 11 Sep 2023 14:26:23 +0000 (UTC) From: "Bjoern A. Zeeb" To: Warner Losh cc: FreeBSD Current Subject: Re: kernel trap 12 .. cam_periph_release_locked_buses() panics under panic? In-Reply-To: Message-ID: References: <514n7872-pp9r-np6p-q6q3-044q4q90709o@yvfgf.mnoonqbm.arg> X-OpenPGP-Key-Id: 0x14003F198FEFA3E77207EE8D2B58B8F83CCF1842 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE] X-Rspamd-Queue-Id: 4Rkptf0SrCz3Dvq On Mon, 11 Sep 2023, Warner Losh wrote: > That's a crazy traceback. We get a fatal trap and then call into the wifi > stack? That makes no sense in the absence of some crazy data corruption or > a weird traceback issue. No, we panic in wifi and then iterated again and again. The first one is the lkpi_sta_auth_to_scan() panic. > On Mon, Sep 11, 2023, 7:47 AM Bjoern A. Zeeb > wrote: > >> Hi, >> >> had a kernel hitting an alll-to-known wifi issue and panic (I was actually >> happy I could reproduce) and then the screen kept scrolling for a while >> panicing all over again and ddb was unusable (not so happy). >> >> I assume the problem is cam_periph_release_locked_buses()? >> > > Unlikely given the rest of the traceback.... > > Can you get a core so we can look at it more deeply? No, after iterations. ddb gave up and stopped and power cycle was the only thing I could still do. >> /bz >> >> ... >> --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = >> 0xfffffe00907fa4a0 --- >> cam_periph_release_locked_buses() at >> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 >> kernel trap 12 with interrupts disabled >> >> >> Fatal trap 12: page fault while in kernel mode >> cpuid = 2; apic id = 02 >> fault virtual address = 0xfffffe00907fa4a8 >> fault code = supervisor read data, page not present >> instruction pointer = 0x20:0xffffffff8101f660 >> stack pointer = 0x0:0xfffffe00907f8f90 >> frame pointer = 0x0:0xfffffe00907f9020 >> code segment = base 0x0, limit 0xfffff, type 0x1b >> = DPL 0, pres 1, long 1, def32 0, gran 1 >> processor eflags = resume, IOPL = 0 >> current process = 0 (iwlwifi0 net80211 t) >> rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8 >> rcx: fffffe00907f9030 r8: 0000000000000000 r9: 0000000000000000 >> rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020 >> r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8 >> r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030 >> trap number = 12 >> panic: page fault >> cpuid = 2 >> time = 1694439681 >> KDB: stack backtrace: >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffffe00907f8c60 >> vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90 >> panic() at panic+0x43/frame 0xfffffe00907f8df0 >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50 >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0 >> calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0 >> --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f8f90, rbp = >> 0xfffffe00907f9020 --- >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020 >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060 >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0 >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffffe00907f9160 >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9290 >> panic() at panic+0x43/frame 0xfffffe00907f92f0 >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350 >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0 >> calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0 >> --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9490, rbp = >> 0xfffffe00907f9520 --- >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520 >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560 >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0 >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffffe00907f9660 >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9790 >> panic() at panic+0x43/frame 0xfffffe00907f97f0 >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850 >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0 >> calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0 >> --- trap 0xc, rip = 0xffffffff8101f660, rsp = 0xfffffe00907f9990, rbp = >> 0xfffffe00907f9a20 --- >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20 >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60 >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0 >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame >> 0xfffffe00907f9b60 >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90 >> panic() at panic+0x43/frame 0xfffffe00907f9cf0 >> lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame >> 0xfffffe00907f9d70 >> lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9df0 >> ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame >> 0xfffffe00907f9e40 >> taskqueue_run_locked() at taskqueue_run_locked+0xab/frame >> 0xfffffe00907f9ec0 >> taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame >> 0xfffffe00907f9ef0 >> fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30 >> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30 >> --- trap 0x80bc1f07, rip = 0xffffffff80381e83, rsp = 0x3d7bb6db69f8, rbp = >> 0xfffffe00907fa4a0 --- >> cam_periph_release_locked_buses() at >> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 >> kernel trap 12 with interrupts disabled >> ... >> >> -- >> Bjoern A. Zeeb r15:7 >> >> > -- Bjoern A. Zeeb r15:7 From nobody Mon Sep 11 14:44:40 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkqHp1tmdz4sQDZ for ; Mon, 11 Sep 2023 14:44:54 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkqHn6r4Yz3MbH for ; Mon, 11 Sep 2023 14:44:53 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x535.google.com with SMTP id 4fb4d7f45d1cf-52a23227567so5833059a12.0 for ; Mon, 11 Sep 2023 07:44:53 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694443492; x=1695048292; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=pTEHhSoBSUZdKMO02nFUl8uy8Fv6l906BvKwhZ8L8rw=; b=Kektw/Qhfs8BS8LEH7gXcH7LyC2/aqWxRTN7wr62lIcfJa513K2spqZ1syRkoBEg7c 2nIKuJbnwgZ0WTyfC5nX5qzgYHoeMsD1gHR7bE07U7lXBgnCbVSX3Rhs6wwo8Mcy1bjV WXOtPYzfnCPjJ4qwcmKH/iZGZhBRjcWlHa4kcD757RolYCNhEeec0Smla2TDq1GgExlN yt2bGpBCH6OBi1tYluToCq6MirOACrlRdSXbxHynB8XxJeMkWfzmRnQQ0FzJkU2DypeS lSWV+ZbrE/ZhEU8KyOl5QoYNM1lLBAIglWhp3oBYMj22xRwur0HTcBvKOyMsYw0mLhEq Qm/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694443492; x=1695048292; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=pTEHhSoBSUZdKMO02nFUl8uy8Fv6l906BvKwhZ8L8rw=; b=dGAPZ9XRV7W6ynKbheAanRFYFYmEYCag+KyeHxCPmrZFXX1TX+9t+8RQKuMnMxwnja SqWhso19nAGvJ8E8L503ztxebpZHU0XEj9cXvYF22keZYPApJf538dqCodYI32UxO66a QcPEOg1Z6bpkVy6/NKMOTDxTKpk4VOWGneivAJeUg3l7WHSGAj782yVH/6LMG6Ua3yx1 bZT2gfbGYN26xt2C2rRkN6gilVVyAjtnyuLWJQORU/L4yR8v577E7pkHeOdGNCTuSGIk OBZ+MQhkVjAOBwkHJhhKTssg58d9FfrZ3jSmABSvHh1DfgYPJrvGmDZWPUxMYncVBCAY h39A== X-Gm-Message-State: AOJu0YzvuVeVDiRx5apLleMEVzhnSjKAfD9KsCTaSL9QB7Pr2ywUXWoE uT3TPlRR1+diP1QUkrxikr70y6iWq5+UZxAqc4y2+jlFOBAzfGWi X-Google-Smtp-Source: AGHT+IHmZaLZBDiRsIL5hrBTm9jZdNemsgNfUfnVjSZQq5VRq2guPT9n5Kcijgpv1J0hQyoU1sQh8tqBI5x8LIwQIAg= X-Received: by 2002:a17:907:a0c6:b0:993:d75b:63ea with SMTP id hw6-20020a170907a0c600b00993d75b63eamr8022027ejc.16.1694443491834; Mon, 11 Sep 2023 07:44:51 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <514n7872-pp9r-np6p-q6q3-044q4q90709o@yvfgf.mnoonqbm.arg> In-Reply-To: From: Warner Losh Date: Mon, 11 Sep 2023 08:44:40 -0600 Message-ID: Subject: Re: kernel trap 12 .. cam_periph_release_locked_buses() panics under panic? To: "Bjoern A. Zeeb" Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="0000000000006c56d70605165e89" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RkqHn6r4Yz3MbH --0000000000006c56d70605165e89 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Sep 11, 2023 at 8:26=E2=80=AFAM Bjoern A. Zeeb < bzeeb-lists@lists.zabbadoz.net> wrote: > On Mon, 11 Sep 2023, Warner Losh wrote: > > > That's a crazy traceback. We get a fatal trap and then call into the wi= fi > > stack? That makes no sense in the absence of some crazy data corruption > or > > a weird traceback issue. > > No, we panic in wifi and then iterated again and again. > The first one is the lkpi_sta_auth_to_scan() panic. > Ah. OK. I don't think there's anything in cam_periph_release_locked_buses that could cause this... but if you get a dump I can help look at it. Warner > > On Mon, Sep 11, 2023, 7:47 AM Bjoern A. Zeeb < > bzeeb-lists@lists.zabbadoz.net> > > wrote: > > > >> Hi, > >> > >> had a kernel hitting an alll-to-known wifi issue and panic (I was > actually > >> happy I could reproduce) and then the screen kept scrolling for a whil= e > >> panicing all over again and ddb was unusable (not so happy). > >> > >> I assume the problem is cam_periph_release_locked_buses()? > >> > > > > Unlikely given the rest of the traceback.... > > > > Can you get a core so we can look at it more deeply? > > No, after iterations. ddb gave up and stopped and power cycle was > the only thing I could still do. > > > > >> /bz > >> > >> ... > >> --- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6db69f= 8, > rbp =3D > >> 0xfffffe00907fa4a0 --- > >> cam_periph_release_locked_buses() at > >> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 > >> kernel trap 12 with interrupts disabled > >> > >> > >> Fatal trap 12: page fault while in kernel mode > >> cpuid =3D 2; apic id =3D 02 > >> fault virtual address =3D 0xfffffe00907fa4a8 > >> fault code =3D supervisor read data, page not present > >> instruction pointer =3D 0x20:0xffffffff8101f660 > >> stack pointer =3D 0x0:0xfffffe00907f8f90 > >> frame pointer =3D 0x0:0xfffffe00907f9020 > >> code segment =3D base 0x0, limit 0xfffff, type 0x1b > >> =3D DPL 0, pres 1, long 1, def32 0, gran 1 > >> processor eflags =3D resume, IOPL =3D 0 > >> current process =3D 0 (iwlwifi0 net80211 t) > >> rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8 > >> rcx: fffffe00907f9030 r8: 0000000000000000 r9: 0000000000000000 > >> rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020 > >> r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8 > >> r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030 > >> trap number =3D 12 > >> panic: page fault > >> cpuid =3D 2 > >> time =3D 1694439681 > >> KDB: stack backtrace: > >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > >> 0xfffffe00907f8c60 > >> vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90 > >> panic() at panic+0x43/frame 0xfffffe00907f8df0 > >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50 > >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0 > >> calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0 > >> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f8f90, = rbp =3D > >> 0xfffffe00907f9020 --- > >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020 > >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060 > >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0 > >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > >> 0xfffffe00907f9160 > >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9290 > >> panic() at panic+0x43/frame 0xfffffe00907f92f0 > >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350 > >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0 > >> calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0 > >> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f9490, = rbp =3D > >> 0xfffffe00907f9520 --- > >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520 > >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560 > >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0 > >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > >> 0xfffffe00907f9660 > >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9790 > >> panic() at panic+0x43/frame 0xfffffe00907f97f0 > >> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850 > >> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0 > >> calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0 > >> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f9990, = rbp =3D > >> 0xfffffe00907f9a20 --- > >> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20 > >> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60 > >> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0 > >> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame > >> 0xfffffe00907f9b60 > >> vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90 > >> panic() at panic+0x43/frame 0xfffffe00907f9cf0 > >> lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame > >> 0xfffffe00907f9d70 > >> lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9df0 > >> ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame > >> 0xfffffe00907f9e40 > >> taskqueue_run_locked() at taskqueue_run_locked+0xab/frame > >> 0xfffffe00907f9ec0 > >> taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame > >> 0xfffffe00907f9ef0 > >> fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30 > >> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30 > >> --- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6db69f= 8, > rbp =3D > >> 0xfffffe00907fa4a0 --- > >> cam_periph_release_locked_buses() at > >> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0 > >> kernel trap 12 with interrupts disabled > >> ... > >> > >> -- > >> Bjoern A. Zeeb r15= :7 > >> > >> > > > > -- > Bjoern A. Zeeb r15:7 > --0000000000006c56d70605165e89 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Sep 11, 2023 at 8:26=E2=80=AF= AM Bjoern A. Zeeb <bze= eb-lists@lists.zabbadoz.net> wrote:
On Mon, 11 Sep 2023, Warner Losh wrote:

> That's a crazy traceback. We get a fatal trap and then call into t= he wifi
> stack? That makes no sense in the absence of some crazy data corruptio= n or
> a weird traceback issue.

No, we panic in wifi and then iterated again and again.
The first one is the lkpi_sta_auth_to_scan() panic.
Ah. OK. I don't think there's anything in cam_periph_r= elease_locked_buses
that could cause this... but if you get a dum= p I can help look at it.

Warner
=C2=A0
> On Mon, Sep 11, 2023, 7:47 AM Bjoern A. Zeeb <bzeeb-lists@lists.zabbadoz.n= et>
> wrote:
>
>> Hi,
>>
>> had a kernel hitting an alll-to-known wifi issue and panic (I was = actually
>> happy I could reproduce) and then the screen kept scrolling for a = while
>> panicing all over again and ddb was unusable (not so happy).
>>
>> I assume the problem is cam_periph_release_locked_buses()?
>>
>
> Unlikely given the rest of the traceback....
>
> Can you get a core so we can look at it more deeply?

No, after <n> iterations. ddb gave up and stopped and power cycle was=
the only thing I could still do.



>> /bz
>>
>> ...
>> --- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6d= b69f8, rbp =3D
>> 0xfffffe00907fa4a0 ---
>> cam_periph_release_locked_buses() at
>> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0
>> kernel trap 12 with interrupts disabled
>>
>>
>> Fatal trap 12: page fault while in kernel mode
>> cpuid =3D 2; apic id =3D 02
>> fault virtual address=C2=A0 =C2=A0=3D 0xfffffe00907fa4a8
>> fault code=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D sup= ervisor read data, page not present
>> instruction pointer=C2=A0 =C2=A0 =C2=A0=3D 0x20:0xffffffff8101f660=
>> stack pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0x0:0xff= fffe00907f8f90
>> frame pointer=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0x0:0xff= fffe00907f9020
>> code segment=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D base 0x0= , limit 0xfffff, type 0x1b
>>=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =3D DPL 0, pres 1, long 1, def32 0, gran 1
>> processor eflags=C2=A0 =C2=A0 =C2=A0 =C2=A0 =3D resume, IOPL =3D 0=
>> current process=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 0 (iwlwifi0 n= et80211 t)
>> rdi: fffffe00907f8f90 rsi: 0000000000000008 rdx: fffffe00907fa4a8<= br> >> rcx: fffffe00907f9030=C2=A0 r8: 0000000000000000=C2=A0 r9: 0000000= 000000000
>> rax: 0000000000000000 rbx: fffffe00907f90f0 rbp: fffffe00907f9020<= br> >> r10: 0000000000000000 r11: 0000000000000000 r12: fffffe00907fa4a8<= br> >> r13: 0000000000000008 r14: 0000000000000000 r15: fffffe00907f9030<= br> >> trap number=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0=3D 12<= br> >> panic: page fault
>> cpuid =3D 2
>> time =3D 1694439681
>> KDB: stack backtrace:
>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
>> 0xfffffe00907f8c60
>> vpanic() at vpanic+0x132/frame 0xfffffe00907f8d90
>> panic() at panic+0x43/frame 0xfffffe00907f8df0
>> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f8e50
>> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f8ec0
>> calltrap() at calltrap+0x8/frame 0xfffffe00907f8ec0
>> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f8f= 90, rbp =3D
>> 0xfffffe00907f9020 ---
>> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9020
>> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9060
>> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f90e0
>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
>> 0xfffffe00907f9160
>> vpanic() at vpanic+0x132/frame 0xfffffe00907f9290
>> panic() at panic+0x43/frame 0xfffffe00907f92f0
>> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9350
>> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f93c0
>> calltrap() at calltrap+0x8/frame 0xfffffe00907f93c0
>> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f94= 90, rbp =3D
>> 0xfffffe00907f9520 ---
>> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9520
>> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9560
>> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f95e0
>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
>> 0xfffffe00907f9660
>> vpanic() at vpanic+0x132/frame 0xfffffe00907f9790
>> panic() at panic+0x43/frame 0xfffffe00907f97f0
>> trap_fatal() at trap_fatal+0x40c/frame 0xfffffe00907f9850
>> trap_pfault() at trap_pfault+0xae/frame 0xfffffe00907f98c0
>> calltrap() at calltrap+0x8/frame 0xfffffe00907f98c0
>> --- trap 0xc, rip =3D 0xffffffff8101f660, rsp =3D 0xfffffe00907f99= 90, rbp =3D
>> 0xfffffe00907f9a20 ---
>> db_read_bytes() at db_read_bytes+0xa0/frame 0xfffffe00907f9a20
>> db_get_value() at db_get_value+0x31/frame 0xfffffe00907f9a60
>> db_backtrace() at db_backtrace+0x1d9/frame 0xfffffe00907f9ae0
>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame
>> 0xfffffe00907f9b60
>> vpanic() at vpanic+0x132/frame 0xfffffe00907f9c90
>> panic() at panic+0x43/frame 0xfffffe00907f9cf0
>> lkpi_sta_auth_to_scan() at lkpi_sta_auth_to_scan+0x388/frame
>> 0xfffffe00907f9d70
>> lkpi_iv_newstate() at lkpi_iv_newstate+0x2eb/frame 0xfffffe00907f9= df0
>> ieee80211_newstate_cb() at ieee80211_newstate_cb+0x1e7/frame
>> 0xfffffe00907f9e40
>> taskqueue_run_locked() at taskqueue_run_locked+0xab/frame
>> 0xfffffe00907f9ec0
>> taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame
>> 0xfffffe00907f9ef0
>> fork_exit() at fork_exit+0x82/frame 0xfffffe00907f9f30
>> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe00907f9f30<= br> >> --- trap 0x80bc1f07, rip =3D 0xffffffff80381e83, rsp =3D 0x3d7bb6d= b69f8, rbp =3D
>> 0xfffffe00907fa4a0 ---
>> cam_periph_release_locked_buses() at
>> cam_periph_release_locked_buses+0x43/frame 0xfffffe00907fa4a0
>> kernel trap 12 with interrupts disabled
>> ...
>>
>> --
>> Bjoern A. Zeeb=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r15:7
>>
>>
>

--
Bjoern A. Zeeb=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0r15:7
--0000000000006c56d70605165e89-- From nobody Mon Sep 11 23:17:52 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl2y32jWrz4t5Fg for ; Mon, 11 Sep 2023 23:30:19 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from omta001.cacentral1.a.cloudfilter.net (omta001.cacentral1.a.cloudfilter.net [3.97.99.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl2y23m72z4Wnd; Mon, 11 Sep 2023 23:30:18 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of cy.schubert@cschubert.com has no SPF policy when checking 3.97.99.32) smtp.mailfrom=cy.schubert@cschubert.com; dmarc=none Received: from shw-obgw-4002a.ext.cloudfilter.net ([10.228.9.250]) by cmsmtp with ESMTP id ffa6qWDETLAoIfqAEqoKzC; Mon, 11 Sep 2023 23:17:54 +0000 Received: from spqr.komquats.com ([70.66.152.170]) by cmsmtp with ESMTPA id fqADqtmMMyAOefqAEqrWq2; Mon, 11 Sep 2023 23:17:54 +0000 X-Authority-Analysis: v=2.4 cv=e5oV9Il/ c=1 sm=1 tr=0 ts=64ffa022 a=y8EK/9tc/U6QY+pUhnbtgQ==:117 a=y8EK/9tc/U6QY+pUhnbtgQ==:17 a=kj9zAlcOel0A:10 a=zNV7Rl7Rt7sA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=EkcXrb_YAAAA:8 a=mHWwJs-SP0RyW_hiVBcA:9 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 a=LK5xJRSDVpKd5WXXoEvA:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTP id DE6492A0; Mon, 11 Sep 2023 16:17:52 -0700 (PDT) Received: by slippy.cwsent.com (Postfix, from userid 1000) id B2B8C1AC; Mon, 11 Sep 2023 16:17:52 -0700 (PDT) X-Mailer: exmh version 2.9.0 11/07/2018 with nmh-1.8+dev Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: amotin@freebsd.org, mm@freebsd.org, current@freebsd.org Subject: ZFS Panics Still List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 11 Sep 2023 16:17:52 -0700 Message-Id: <20230911231752.B2B8C1AC@slippy.cwsent.com> X-CMAE-Envelope: MS4xfGNb79UbQVSLsMzNKgAAXye9yoBRuJiwKeFlNzNnQQV/H0IWHhzB+8AMPHIFhn/rcFLi4gpTem+wWIfuxfyudgbsf7ZnSRev5iDce0gp15FFFq3+39my 8tAwSR3d+lx2C5DCoCZx9pJip8WOO+at63dY8j3+JF8TglxBQJjuhwmMpRynXRrDtgMHC+00pfcNdXeaTqF6k1xKfN39lF2JqKkH5Pk97UuvahewNb1nGuOh R3TqnWjENE0jIIBzZ+kf5A== X-Spamd-Bar: + X-Spamd-Result: default: False [1.80 / 15.00]; R_BAD_CTE_7BIT(3.50)[7bit]; AUTH_NA(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; MV_CASE(0.50)[]; RCVD_IN_DNSWL_LOW(-0.10)[3.97.99.32:from]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; DMARC_NA(0.00)[cschubert.com]; FROM_HAS_DN(0.00)[]; REPLYTO_EQ_FROM(0.00)[]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; R_DKIM_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:16509, ipnet:3.96.0.0/15, country:US]; GREYLIST(0.00)[pass,body] X-Rspamd-Queue-Id: 4Rl2y23m72z4Wnd Hi, One of my machines, running poudriere building i386 packges, panics, below, at termination of poudriere while poudriere is cleaning up performing zfs umount. I just happenedto catch the machine to see poudriere just having completed and umounting filesystems. panic: vm_page_dequeue_deferred: page 0xfffffe000b7e9748 has unexpected queue state cpuid = 1 time = 1694472686 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe00bebac7d0 vpanic() at vpanic+0x132/frame 0xfffffe00bebac900 panic() at panic+0x43/frame 0xfffffe00bebac960 vm_page_dequeue_deferred() at vm_page_dequeue_deferred+0xb2/frame 0xfffffe00bebac970 vm_page_free_prep() at vm_page_free_prep+0x11b/frame 0xfffffe00bebac990 vm_page_free_toq() at vm_page_free_toq+0x12/frame 0xfffffe00bebac9c0 vm_object_page_remove() at vm_object_page_remove+0xb6/frame 0xfffffe00bebaca20 bufobj_invalbuf() at bufobj_invalbuf+0x198/frame 0xfffffe00bebaca80 vgonel() at vgonel+0x2ce/frame 0xfffffe00bebacaf0 vflush() at vflush+0x3ad/frame 0xfffffe00bebacc40 zfs_umount() at zfs_umount+0xca/frame 0xfffffe00bebacc80 dounmount() at dounmount+0x7b5/frame 0xfffffe00bebaccf0 kern_unmount() at kern_unmount+0x2eb/frame 0xfffffe00bebace00 amd64_syscall() at amd64_syscall+0x138/frame 0xfffffe00bebacf30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe00bebacf30 --- syscall (22, FreeBSD ELF64, unmount), rip = 0x36bbc3e23dba, rsp = 0x36bbbb4f08e8, rbp = 0x36bbbb4f08f0 --- Uptime: 46m16s Dumping 3452 out of 7996 MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91% __curthread () at /opt/src/git-src/sys/amd64/include/pcpu_aux.h:57 57 __asm("movq %%gs:%P1,%0" : "=r" (td) : "n" (offsetof(struct pcpu, (kgdb) bt #0 __curthread () at /opt/src/git-src/sys/amd64/include/pcpu_aux.h:57 #1 doadump (textdump=textdump@entry=1) at /opt/src/git-src/sys/kern/kern_shutdown.c:405 #2 0xffffffff806c20b0 in kern_reboot (howto=260) at /opt/src/git-src/sys/kern/kern_shutdown.c:526 #3 0xffffffff806c25af in vpanic ( fmt=0xffffffff80b5e2e6 "%s: page %p has unexpected queue state", ap=ap@entry=0xfffffe00bebac940) at /opt/src/git-src/sys/kern/kern_shutdown.c:970 #4 0xffffffff806c2353 in panic (fmt=) at /opt/src/git-src/sys/kern/kern_shutdown.c:894 #5 0xffffffff809db0c2 in vm_page_dequeue_deferred (m=, m@entry=0xfffffe000b7e9748) at /opt/src/git-src/sys/vm/vm_page.c:3790 #6 0xffffffff809de5fb in vm_page_free_prep (m=m@entry=0xfffffe000b7e9748) at /opt/src/git-src/sys/vm/vm_page.c:3928 #7 0xffffffff809d6162 in vm_page_free_toq (m=, m@entry=0xfffffe000b7e9748) at /opt/src/git-src/sys/vm/vm_page.c:3970 #8 0xffffffff809d614b in vm_page_free (m=, m@entry=0xfffffe000b7e9748) at /opt/src/git-src/sys/vm/vm_page.c:1328 #9 0xffffffff809d0f16 in vm_object_page_remove (object=0xfffff8013edc0108, start=0, end=0, options=1) at /opt/src/git-src/sys/vm/vm_object.c:2157 #10 0xffffffff807b6a28 in bufobj_invalbuf (bo=0xfffff800665c50e0, flags=1, slpflag=slpflag@entry=0, slptimeo=slptimeo@entry=0) --Type for more, q to quit, c to continue without paging--c at /opt/src/git-src/sys/kern/vfs_subr.c:2156 #11 0xffffffff807ba2ee in vgonel (vp=vp@entry=0xfffff800665c5000) at /opt/src/git-src/sys/kern/vfs_subr.c:2187 #12 0xffffffff807b999d in vflush (mp=mp@entry=0xfffffe00da21cb00, rootrefs=rootrefs@entry=0, flags=flags@entry=2, td=td@entry=0xfffffe00c4610720) at /opt/src/git-src/sys/kern/vfs_subr.c:3939 #13 0xffffffff83871bea in zfs_umount (vfsp=0xfffffe00da21cb00, vfsp@entry=, fflag=, fflag@entry=) at /opt/src/git-src/sys/contrib/openzfs/module/os/freebsd/zfs/zfs_vfsops.c:1708 #14 0xffffffff807ae405 in dounmount (mp=, mp@entry=0xfffffe00da21cb00, flags=flags@entry=524288, td=td@entry=0xfffffe00c4610720) at /opt/src/git-src/sys/kern/vfs_mount.c:2327 #15 0xffffffff807adbeb in kern_unmount (td=0xfffffe00c4610720, path=0x5a7647a1a3c0 , flags=524288) at /opt/src/git-src/sys/kern/vfs_mount.c:1785 #16 0xffffffff80a741b8 in syscallenter (td=) at /opt/src/git-src/sys/amd64/amd64/../../kern/subr_syscall.c:187 #17 amd64_syscall (td=0xfffffe00c4610720, traced=0) at /opt/src/git-src/sys/amd64/amd64/trap.c:1197 #18 #19 0x000036bbc3e23dba in ?? () Backtrace stopped: Cannot access memory at address 0x36bbbb4f08e8 At frame 6 *m contains: (kgdb) p *m $5 = {plinks = {q = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, s = {ss = { sle_next = 0xffffffffffffffff}}, memguard = {p = 18446744073709551615, v = 18446744073709551615}, uma = {slab = 0xffffffffffffffff, zone = 0xffffffffffffffff}}, listq = {tqe_next = 0xffffffffffffffff, tqe_prev = 0xffffffffffffffff}, object = 0x0, pindex = 14685, phys_addr = 7595216896, md = {pv_list = {tqh_first = 0x0, tqh_last = 0xfffffe000b7e9780}, pv_gen = 20, pat_mode = 6}, ref_count = 0, busy_lock = 4294967294, a = {{flags = 16, queue = 255 '\377', act_count = 0 '\000'}, _bits = 16711696}, order = 13 '\r', pool = 0 '\000', flags = 0 '\000', oflags = 0 '\000', psind = 0 '\000', segind = 5 '\005', valid = 255 '\377', dirty = 0 '\000'} (kgdb) At frame 13 *vfsp contains: $7 = {mnt_vfs_ops = 1, mnt_kern_flag = 1090847177, mnt_flag = 268439568, mnt_pcpu = 0xfffffe010d84cbc0, mnt_rootvnode = 0x0, mnt_vnodecovered = 0xfffff8008dc691c0, mnt_op = 0xffffffff83bb3080 , mnt_vfc = 0xffffffff83bb3228 , mnt_mtx = {lock_object = { lo_name = 0xffffffff80abf68d "struct mount mtx", lo_flags = 16973824, lo_data = 0, lo_witness = 0xfffff8021fd75b00}, mtx_lock = 0}, mnt_gen = 1, mnt_list = {tqe_next = 0x0, tqe_prev = 0xfffffe00c45f2168}, mnt_syncer = 0x0, mnt_ref = 27, mnt_nvnodelist = { tqh_first = 0xfffff800665c5000, tqh_last = 0xfffff8007cc90aa8}, mnt_nvnodelistsize = 24, mnt_writeopcount = 1, mnt_opt = 0xfffff80084d56cd0, mnt_optnew = 0x0, mnt_stat = {f_version = 538182936, f_type = 222, f_flags = 268439568, f_bsize = 512, f_iosize = 131072, f_blocks = 251997486, f_bfree = 248369646, f_bavail = 248369646, f_files = 248516350, f_ffree = 248369646, f_syncwrites = 0, f_asyncwrites = 0, f_syncreads = 0, f_asyncreads = 0, f_nvnodelistsize = 113, f_spare0 = 0, f_spare = {0, 0, 0, 0, 0, 0, 0, 0, 0}, f_namemax = 255, f_owner = 0, f_fsid = {val = {-313067424, 1444670686}}, f_charspare = '\000' , f_fstypename = "zfs", '\000' , f_mntfromname = "bob/poudriere/bob/jails/HEADi386-new-ports-ref/04", '\000' , f_mntonname = "/poudriere/bob/data/.m/HEADi386-new-ports/04", '\000' }, mnt_cred = 0xfffff800c83cb200, mnt_data = 0xfffff800b713e000, mnt_time = 0, mnt_iosize_max = 65536, mnt_export = 0x0, mnt_label = 0x0, mnt_hashseed = 1242221059, mnt_lockref = 0, mnt_secondary_writes = 0, mnt_secondary_accwrites = 0, mnt_susp_owner = 0x0, mnt_exjail = 0x0, mnt_gjprovider = 0x0, mnt_listmtx = {lock_object = { lo_name = 0xffffffff80b1539e "struct mount vlist mtx", lo_flags = 16973824, lo_data = 0, lo_witness = 0xfffff8021fd82a80}, mtx_lock = 0}, mnt_lazyvnodelist = {tqh_first = 0x0, tqh_last = 0xfffffe00da21d550}, mnt_lazyvnodelistsize = 0, mnt_upper_pending = 0, mnt_explock = {lock_object = { lo_name = 0xffffffff80b6167f "explock", lo_flags = 108199936, lo_data = 0, lo_witness = 0xfffff8021fd82880}, lk_lock = 1, lk_exslpfail tqh_first = 0x0, tqh_last = 0xfffffe00da21d590}, mnt_notify = { tqh_first = 0x0, tqh_last = 0xfffffe00da21d5a0}, mnt_taskqueue_link = { stqe_next = 0x0}, mnt_taskqueue_flags = 0, mnt_unmount_retries = 0} -- Cheers, Cy Schubert FreeBSD UNIX: Web: https://FreeBSD.org NTP: Web: https://nwtime.org e^(i*pi)+1=0 From nobody Tue Sep 12 02:40:26 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl79n1HkMz4syG2 for ; Tue, 12 Sep 2023 02:40:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl79l2tbFz3dKQ for ; Tue, 12 Sep 2023 02:40:43 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=OJl13N24; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694486439; bh=j0lQyzOord39lQF22JGgXPFagT7VPC4UgVAJ7r8X2ng=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=OJl13N24jiFaGq9IIOzo8WY3m7xbriNcVSTIWbGsIKdjLip8exP4X64CSL5Jvn0i8A2mrcY/VWJ0hSfSRk3GFN501eXRH+G36WoQqGqwlALdrc/DBapuDvek0+KNAxrP4wPi+lY7/W2+MpM2BJ/RQmUzBDwmTHGiOUB6Klv57ORQGPEW3rUBA4hbQGJIuK/OqavMH3tloCOkV+HejupkHyMCudy56dFapiAazovO7AtZIZTAnQDneulz8jFd5LSDSPCMv3itFz6iv+thJSZlULrqg8XC4t6nI306ESl1HYNg9FnyR0GOzKQUKDoaPG877NWCkY7h48n0Ep7JhMCGFg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694486439; bh=2Y2H6kMMrFaUxTpAICH7T7JuMpRg9Ohf1QfCY3FNXwp=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=P53w2DwJEtCXBsiRXFT3fzcXarsNNc63p89dtltsVw5qMi1n1leZCrbIbCPMbKPWb6ssYv6TmSSRyZj9cEqQvEBqiJ7oovQf9aRhLJb1XmaiM/orNCB1Sl9jnfjxGgkq2vYty594sUJtv7pJFgs7+/e8DZnELOnRC+6xuuIILfYvRFcZ0OQ3Y2KbUPZqbBNth2BACG/NXizr8wNuTXCFCvUbRxNyCKu4DQ3YJ7fZu1Q439aw83E7EX5CWefS4G4UKlcvHKoSJKewXcOERVjBHNMl/2a6eje3NSwV04OT+fWFaB5FePTWWH0ERqXplco7iH8Zv9Ebv6xPT+bpephIEw== X-YMail-OSG: 77_QSFYVM1lkxbLeLuelYUPw8HnuxS0Ipdqd5kmBsrnGhQmKnO8AhMfIdGSaxGk HlmeHL4L7pioH2EYVhmZ4UTZsiRcuiRAKsj3Dh8QcPDI1VaTBhDAhGEvBquaJWKLbVMbHwTQQkLg 7CWX61gARjsejJ9e6SnMTYlMBU2c9m8hDB4V4V2Va2HyQf8SdyoRH93I8ST99Qew0nj4sRrgoYHE 5nglU0MLUZwuVejCEijU7ONuWr54pbiQM6Z0NGJxoGqWrbAWM.cLJ7HlYT3phCMTTXcdtipE4ia9 j83u8lOxUb49fVDAI4TkaECu74evxJ6JX7VB7KrMXcSpaFGrs8b9jXYOArm6dXWj2veHNvZ0XqSQ HASvbM_iVrA9nIP899C023KjsSeN9h74ATejIOEMjYh_LbiDCEA4f2f1uaieDbb1u1GWjzoxmEip 96coxGEdMRKptJy4KJHpKvYcaeLfN8nnsMv9ezWESK1gvMi.PWQTy4rgrG8sXu4WIXnt_WuX1PQe dTPyu3xpNS_T.OwgzjmJv5gus9FZgj6lyfenW.QGiS.kCW5F4LgI_PRukBZptxeac46rCG6NyRZY E7HW4Wq5UGgETDjLcOkH30MQp7WTrbEU.RV.EoLkTjgzSsMMRxs_o7X13zwKpDjj18c3KQ5V.bmM YS.Sce2FkchHZGzSvHe_Kp9lW8J2eWTEoQ.ow5KaMt0MrtGJPfPNz.5ZH9Ke6mwyBc4wOhGnYNSZ 4V_6WqBApR7g0IIqqrdc.m_1PzlF_njDudIUg6bUmh18Z5BCZ6a5yjKdXFy8ZGXDT7Kr_hSthBOz ZvadbAPAkjz2MN5NUOENLcSNTqinIfX_bzd1a37qp_5iN2DbGyoEeZy0xgDv93YMMvMnojTzuSpi BBrPYvnh9IlZyOPE9w9oJtBk1ks.BuuT56XLENV0zyx58.oeUWcUYdeUuldC7zUjHBAJ7jlGev3c 3xtxbeKHJmtM320fehnHyS15bX9e8mEd4UPKW4XNu7GYWEY52IJJDM4c6f2Y5Of1j6B4YajXtNOa hrhTrPkFh4pDrdzJZrkVAgNFt3sD7sbCkT8rx9EcS8uhfgNW4L1VOAhojbmr4XPEROSl5VK0MOda YigfOn90.XJaAlt2uc_vR3_qAk24wE7Wz1drfYIj6jKbYwJ5gAAf6ObuUwJazk.6qZrPNNCXYvPO G06tTZT6_hKYOOHhD1Dl.dK1KSK9cITBMR6StwXyDRW_U6xdt7tW0fRecg.koaV.5ljuKNKqCPHh RZ1zld1PHbhSa.wyJtgnvDHOLtE_nKKfIIlPJLrMGtFtNFms4b5zJek_x9oU0lSjoS9jRSmItcFw 70Mz.25Z388jlRDMtny9T2c4LysEwACO5jDxi6.O4yPD9g4UdvHG6_74FRZV82flndl4DGdXORhp Ar9KCSQVcbUYk9wqlPK5aLEPz6s4L0AcJoaJf5y_weXBa1brzRf8qDP.DYhoeAJojcR91pTms7.K 5at7tbomRDz3ol0AwpsiRsP3vjR8NhP5wURyR76V6uo9sFHKgl1tcCXphiebvzEuwifyR5Fy4rzx Y_3gCLVQiPFGH7Oj9vR9McDHS8YbnP_yXOdhzpJmvNyy2PBn7J0PPXLqb_RSVPUNbNisrx0UV7eP FtuVN7OVrU3YMG5m5FiBQgJ3Hhu0JzDRLu1of64FmmgU9S.CDJkwPt6Hk_n83ol8ORwGc6.BnlDm uds7WZQ.0bYA4bICAVgQoO4zkpxoO4TmUCXm_WG4Jlzw4Vrsw5X7LJT3DvUAiZs5jDmhHHNsj1bZ 9j0RwbwbQ3bT6ZJb49.V8iM6h.Ee84lOisce2F8yg0Uzciuy.W8BvdpL5GdB1ad4stIfg0svDRTF ahJ_IH8mgafSOJxp8RIlWVv9_kOLqTUv202yqbAmDzvwMdZPS2rHlRvbVWIoPMf30ndRk_6a8Lb3 KigVdRZGqxIQ7DsRodykTgI.ohpAOp0G0v.BFpRDh0MCY2yvFIG8CczeGRCqOqyn0c2z_MkTJ8.s 2s7N9r_3M5VrCYzOJ3QyMSB6ph02Ym8Jh.Qp7pkpdRFNdioQ079G9rTjIbLk84D9Y3Yd33XfoTL6 zoxfH0FgnaO4ePWJ5NliB4aIFis2xc9PscM1Vkg4gqaIz.Zykv5MEb1jroNCaFN8HbGficQidYo6 4ewGfgHg2GZJU7RFduuxAAAHh4IwgdaLvfWoX8Qcjp_SMrhPQqKp1WLEfgH4pMaMY.KyiNCdcgvg 6KupB7uv9G.8sqFW_7tW3JztlnGPFlTdyGXBOyr.EbtA4.cdWQWgvrPGOYl8B_s2XLJBwnnrIBlK 0cJoSAA-- X-Sonic-MF: X-Sonic-ID: 78358a2c-d828-47a5-a9a8-43e97c06a62f Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Tue, 12 Sep 2023 02:40:39 +0000 Received: by hermes--production-gq1-6b7c87dcf5-x8vcl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID c89036ca39ef3d65ef2f82a79e9984d4; Tue, 12 Sep 2023 02:40:36 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: aarch64 main [so: 15] panic's in kyua's sys/net/if_lagg_test:status_stress [confirmed with snapshot kernel] From: Mark Millard In-Reply-To: <318444EA-B18D-4A6B-8D74-2A4276E366A8@yahoo.com> Date: Mon, 11 Sep 2023 19:40:26 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <766541C2-D0C3-4886-8779-F959662F59A1@yahoo.com> References: <318444EA-B18D-4A6B-8D74-2A4276E366A8@yahoo.com> To: Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.45 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.95)[-0.951]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from]; BLOCKLISTDE_FAIL(0.00)[98.137.65.148:server fail]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rl79l2tbFz3dKQ On Sep 11, 2023, at 01:13, Mark Millard wrote: > It will be some time before I can try this with > an official snapshot instead of a personal build. > The build is based on b6ce41118bb1 : >=20 > # uname -apKU > FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #17 main-n265279-b6ce41118bb1-dirty: Sun Sep 10 14:36:47 PDT = 2023 = root@CA78C-WDK23-ZFS:/usr/obj/BUILDs/main-CA78C-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA78C arm64 aarch64 1500000 1500000 >=20 > So it was a non-debug build, although I do not > strip symbols and such in my builds. >=20 > . . . > sys/net/if_lagg_test:create -> passed [0.105s] > sys/net/if_lagg_test:create_destroy_stress -> skipped: Skipping this = test because it easily panics the machine [0.019s] > sys/net/if_lagg_test:lacp_linkstate_destroy_stress -> passed = [60.045s] > sys/net/if_lagg_test:set_ether -> passed [0.066s] > sys/net/if_lagg_test:status_stress -> =20 >=20 > The core.txt.5 is not great, unfortunately: >=20 > panic: vm_fault failed: 0xffff0000006b96dc error 1 >=20 > GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] > . . . > Reading symbols from /boot/kernel/kernel... > Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... >=20 > Unread portion of the kernel message buffer: > (dump_iface + 0x2c0) > elr: 0xffff0000006b96dc (dump_sa + 0x1c) > spsr: 0x0000000000400045 > far: 0x44572d4338374144 > esr: 0x0000000096000004 > panic: vm_fault failed: 0xffff0000006b96dc error 1 > cpuid =3D 2 > time =3D 1694414226 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > vpanic() at vpanic+0x1a0 > panic() at panic+0x44 > data_abort() at data_abort+0x304 > handle_el1h_sync() at handle_el1h_sync+0x14 > --- exception, esr 0x96000004 > dump_sa() at dump_sa+0x1c > dump_iface() at dump_iface+0x2bc > dump_cb() at dump_cb+0x18 > if_foreach_sleep() at if_foreach_sleep+0x244 > rtnl_handle_getlink() at rtnl_handle_getlink+0xec > rtnl_handle_message() at rtnl_handle_message+0x19c > nl_taskqueue_handler() at nl_taskqueue_handler+0x674 > taskqueue_run_locked() at taskqueue_run_locked+0x194 > taskqueue_thread_loop() at taskqueue_thread_loop+0xcc > fork_exit() at fork_exit+0x88 > fork_trampoline() at fork_trampoline+0x14 > KDB: enter: panic >=20 > get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 > 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); > (kgdb) #0 get_curthread () at = /usr/main-src/sys/arm64/include/pcpu.h:77 > #1 doadump (textdump=3D0, textdump@entry=3D4003518992) > at /usr/main-src/sys/kern/kern_shutdown.c:405 > #2 0xffff0000000f7704 in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) > at /usr/main-src/sys/ddb/db_command.c:591 > #3 0xffff0000000f74e0 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) > at /usr/main-src/sys/ddb/db_command.c:504 > #4 0xffff0000000f71b8 in db_command_loop () > at /usr/main-src/sys/ddb/db_command.c:551 > #5 0xffff0000000fad9c in db_trap (type=3D, = code=3D) > at /usr/main-src/sys/ddb/db_main.c:268 > #6 0xffff0000004f4ec4 in kdb_trap (type=3D60, code=3D0, tf=3D) > at /usr/main-src/sys/kern/subr_kdb.c:790 > #7 > #8 > #9 > #10 > #11 > #12 > #13 > #14 > #15 > #16 > #17 > #18 > #19 > #20 > #21 > #22 > Backtrace stopped: Cannot access memory at address 0x10 > (kgdb)=20 >=20 >=20 > So some transcribing of a picture in order to > show register values that were reported: >=20 > Fatal data abort: > x0: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) > x1: 0x0000000000000001 > x2: 0x44572d4338374143 > x3: 0xffff0000005d3f90 (ifdead_ioctl + 0x0) > x4: 0xffffa00b7f0d185e > x5: 0xffffa0023fe4b992 > x6: 0x000000006767616c > x7: 0x00706174016f7575 > x8: 0x00000000000001a4 > x9: 0x0000000000210005 > x10: 0=C3=970000000000000800 > x11: 0xfefefefefefefeff > x12: 0x0000000000000008 > x13: 0x0000000000000000 > x14: 0x00000000000000ff > x15: 0x0000000000000700 > x16: 0x0000000000000008 > x17: 0x0000000000000007 > x18: 0xffff0001eea0e500 (_DYNAMIC + 0x6d816358) > x19: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) > x=EF=BB=BF20: 0xffffa00b7f0d1800 > x21: 0xffffa00b7f0d1858 > x22: 0x000000000000000c > x23: 0X0000000000000005 > x24: 0=C3=970000000000000000 > x25: 0xffff000000c68000 (sysctl___kern_features_netlink + 0x10) > x26: 0x0000000000000000 > x27: 0xffff000000ce9000 (cap_linkat_source_rights + 0x8) > x28: 0xffff0000006bb0a0 (dump_cb + 0x0) > x29: 0xffff0001eea0e520 (_DYNAMIC + 0x6d816378) > sp: 0xffff0001eea0e500 > lr: 0xffff0000006b8fe0 (dump_iface + 0x2c0) > elr: 0xffff0000006b96dc (dump_sa + 0x1c) > spsr: 0x0000000000400045 > far: 0x44572d4338374144 > esr: 0x0000000096000004 > panic: m_fault failed: 0xffff0000006b96dc error 1 >=20 > I expect that this is similar to reports I'd made > back in 14.0-CURRENT days. As I remember, snapshot > builds of the time also got the panic. >=20 > I will note that an earlier 14.0-BETA1 snapshot > kernel test run did not panic at this point in the > sequence (or at any point). But I do not know how > repeatable the panics are in the various contexts. >=20 > I'll note that I've tried to have the various ports > installed (poudriere built) that are listed at: >=20 > = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >=20 > (The ones that build for aarch64, anyway.) >=20 > I had in /etc/kyua/kyua.conf : >=20 > test_suites.FreeBSD.disks =3D '/dev/md0 /dev/md1 /dev/md2 /dev/md3 = /dev/md4 /dev/md5' >=20 > and used: >=20 > # more ~/prekyua-aarch64-mdconfig.sh=20 > #! /bin/sh > truncate -s 4g /var/tmp/for-md0.dat > truncate -s 4g /var/tmp/for-md1.dat > truncate -s 4g /var/tmp/for-md2.dat > truncate -s 4g /var/tmp/for-md3.dat > truncate -s 4g /var/tmp/for-md4.dat > truncate -s 4g /var/tmp/for-md5.dat > mdconfig -f /var/tmp/for-md0.dat -u md0 > mdconfig -f /var/tmp/for-md1.dat -u md1 > mdconfig -f /var/tmp/for-md2.dat -u md2 > mdconfig -f /var/tmp/for-md3.dat -u md3 > mdconfig -f /var/tmp/for-md4.dat -u md4 > mdconfig -f /var/tmp/for-md5.dat -u md5 >=20 > I also did a: >=20 > # kldload linux64 >=20 > before doing: >=20 > # /usr/bin/kyua test -k /usr/tests/Kyuafile >=20 > (Not true of linux64.ko in 14.0-CURRENT days.) # uname -apKU FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #0 main-n265205-03a7c36ddbc0: Thu Sep 7 03:05:31 UTC 2023 = root@releng3.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 aarch64 1500000 1500000 # /usr/bin/kyua test -k /usr/tests/Kyuafile = sys/net/if_lagg_test:status_stress sys/net/if_lagg_test:status_stress -> =20 got: panic: vm_fault failed: 0xffff0000006813b4 error 1 GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] . . . Reading symbols from /boot/kernel/kernel... Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... Unread portion of the kernel message buffer: <6>ue0: 3 link states coalesced <6>ue0: link state changed to UP <6>lagg0: link state changed to DOWN <6>ue0: link state changed to DOWN Fatal data abort: x0: 0xffff00015df8d800 (infiniband_input.printedonce + 0x11eff68) x1: 0x0000000000000001 x2: 0xdeadc0dedeadc0de x3: 0xffff000000593e34 (ifdead_ioctl + 0x0) x4: 0xffffa0004fb6285e x5: 0xffffa0004fc00192 x6: 0x000000006767616c x7: 0x6e6d760070617401 x8: 0x00000000000001a4 x9: 0xffffa0004fc00000 x10: 0x0000000000210005 x11: 0x000000007ffffffe x12: 0x0000000000000008 x13: 0x0000000000000000 x14: 0x0000000000010000 x15: 0x0000000000000001 x16: 0x0000000000010000 x17: 0x0000000000000007 x18: 0xffff00015df8d500 <6>ue0: link state changed to UP (infiniband_input.printedonce + 0x11efc68) x19: 0xffff00015df8d800 (infiniband_input.printedonce + 0x11eff68) x20: 0xffffa0004fb62800 x21: 0xffffa0004fb62858 x22: 0x000000000000000c x23: 0x0000000000000005 x24: 0x0000000000000000 x25: 0xffff000000c58000 (sysctl___net_netlink_debug + 0x40) x26: 0x0000000000000000 x27: 0xffff000000cd9000 (sdt_vfs_vop_vop_spare5_return + 0x10) x28: 0xffff000000cd9000 (sdt_vfs_vop_vop_spare5_return + 0x10) x29: 0xffff00015df8d520 (infiniband_input.printedonce + 0x11efc88) sp: 0xffff00015df8d500 lr: 0xffff000000680cbc (dump_iface + 0x2c0) elr: 0xffff0000006813b4 (dump_sa + 0x1c) spsr: 0x0000000000400045 far: 0xdeadc0dedeadc0df esr: 0x0000000096000004 panic: vm_fault failed: 0xffff0000006813b4 error 1 cpuid =3D 3 time =3D 1694485392 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x30 vpanic() at vpanic+0x19c panic() at panic+0x44 data_abort() at data_abort+0x35c handle_el1h_sync() at handle_el1h_sync+0x14 --- exception, esr 0x96000004 dump_sa() at dump_sa+0x1c dump_iface() at dump_iface+0x2bc dump_cb() at dump_cb+0x18 if_foreach_sleep() at if_foreach_sleep+0x254 rtnl_handle_getlink() at rtnl_handle_getlink+0xec rtnl_handle_message() at rtnl_handle_message+0x19c nl_taskqueue_handler() at nl_taskqueue_handler+0x5dc taskqueue_run_locked() at taskqueue_run_locked+0x17c taskqueue_thread_loop() at taskqueue_thread_loop+0xc8 fork_exit() at fork_exit+0x74 fork_trampoline() at fork_trampoline+0x14 KDB: enter: panic get_curthread () at /usr/src/sys/arm64/include/pcpu.h:77 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); (kgdb) #0 get_curthread () at /usr/src/sys/arm64/include/pcpu.h:77 #1 doadump (textdump=3D0, textdump@entry=3D1576585744) at /usr/src/sys/kern/kern_shutdown.c:405 #2 0xffff0000000ec18c in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) at /usr/src/sys/ddb/db_command.c:591 #3 0xffff0000000ebf88 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) at /usr/src/sys/ddb/db_command.c:504 #4 0xffff0000000ebc80 in db_command_loop () at /usr/src/sys/ddb/db_command.c:551 #5 0xffff0000000ef440 in db_trap (type=3D, = code=3D) at /usr/src/sys/ddb/db_main.c:268 #6 0xffff0000004b4860 in kdb_trap (type=3D60, code=3D0, tf=3D) at /usr/src/sys/kern/subr_kdb.c:790 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23 Backtrace stopped: Cannot access memory at address 0x10 (kgdb)=20 (Again, kgdb's stack frames #7 and larger are not particularly useful.) Possibly interesting are the slightly different values: x2: 0xdeadc0dedeadc0de and: far: 0xdeadc0dedeadc0df =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 12 03:11:18 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl7sM2fQ0z4tCDn for ; Tue, 12 Sep 2023 03:11:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl7sL0wHFz4JnH for ; Tue, 12 Sep 2023 03:11:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Wg52S90a; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694488291; bh=eo2+cydr1Tf4BWkrHa5dGagQUQiaKh0epGPzscJzVm4=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Wg52S90a3ZHoOGCXhGDwVIaPJGZnY42aD4ZDlI7hf3v/J0rFEBOUWPFPpHK0fJvM7YRVH4hL2Fx02T3YNTDgpwwnuhQJh3xkzLiICRrnnyAmM/iAiH4uWgaR6O50ic7Uc1epkqKZcFNnzVycrrmgm9TTXyTMxxiK1BhXBfjiZBqn/EINf29WbcU6374ovc3k/G/GloXltyjGR6bB9TuAFx0qXr3QlY0GJAyvej/2Q44i7DKexVWnTJ3HSzjF0SUoc5+2JZIg5THxIfCTrs23ZHsvIk3NOAlI4YaOcOZ7mADtcYNu5tczVRGHLYrkkn+PUwm+xytZ9+naMek2I/ObfA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694488291; bh=AhUomG972jhI/DQlFNX6VFtzVT24upkr0q7V9BxsVGU=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Svrh7bCn9PuKV8qutsLuY2C9kCCQu3psFK8EnkwkdZxb0dmuGRgGgImyvsyI0o0X5C8unMvGT9BqxPhpmd1N3Gq2GriTRGMSnBo+KHcCFU2nzPvHTcjS/d/oq7cia8n6cwuuPLKM5wViSgB4diR5hMUw1Ga+s7V0TKXkyjPHW/ebShXW1fDWqes0Z5/RICm9uEj+mMw+TLlCnlwm7lvhXOwh7PCp8qw8p2+Kz0U5IRV7+rzEuiLUMfWLccDK88HRh8ND+fh2Y0Gm/l3icgKma9bW4U7LfWNmcvBT66C2SZc26f7QjXoXfv++LzxFc1pIHxsgBiHJoA22YDRNHl1ybQ== X-YMail-OSG: 1IuhgOAVM1kovFqET05uuiDMBNFYHQxNbsfCoG4IIdks2jmqA4lWaS7DxO0qave 5IZXx6Dkc9iYaWoVO0m7UUgWS.u2nChGl9DasgO4m0YJKl_gSDAy_DkfZ7XTvkWNb3AvLVDJEfyB BqiiG7we9q4tndknwp56Gx6JYPgFhKNgXzA8hvEVTaOVcwFuwme_nDxj6WmYWypmEdVgMFE2txM2 YpS9AUOsZJLFxt8qzX5rgBA7pwoikyOxeEBevfN3qQ5L5h2zb5MbkGIsg4BtuojJB6.nJ2Tkwp3C uLjFnuCofAKQQudgjftYr6h.6B94ysrcroxE9wzAbpy.92f4hfn3INDdsLT71dHPce_LCZ8kD_iT 5wSO8wTiAx8vginNTGr_0FAXKYdPVIr0XwFBXKA00rfRxJcVBSrYw3C8VK8u9dcvUB4TnsblMmsF TsKMqCzHkp.sziwgrToGUBpeymAjrEvo3MFe5ePGRSmhuQal9QLOeeFL4rmbjHya.lEjRZZAMnr2 10y5r12CONO4bvuiEaTmzendxWC69rm2Ng4jmxa58o5rtNVfhhiBH9_us1P5.7ux3CdjIlSUFJMY UlE1w7kaaFmKR8xWtn_MxODkG.J82IcrfU6kmFfPuIA8P0plSSm7ypPVskjzUikafnw12siKWjjI RSJK82bWWffTy6ju2uTv8nzsqXsLAVfsplUJdEyg24C8lYwurQITr9Fat18.vGRce2OmbxUifv3K ajdED_4N7HLqjccq5ILiuqJORR2lyghUwJ51PfhAwlaUM0Nz1sCfrEOel_lsF02cAXHUroLZrcA1 VxwmxYAA4rnDysRrL91oy2SuLGw4Pye1LQQDndlNmBD2jwbqMug972w6mh38g3Mk4iqjZo.ucbkv GcAfYxAAznsSb_AHJtnQqPfWJlsDvUodksQivYPbOIuSLCrZjck1HPkOrgRiZFt4g4lL4e3An1r2 XF9MsTuC7TqYjBH4zfLVE7mnnO.ohDujjReruJWoUuMqdo3XqvYAjfXapqqOXxsClQGL1xzYl2XO zp1qJE7hK5P1tL.VPnDS_.XWmxJgZ24YSUJacQLdOw3tsZISepcht79jv0LV.NedR1_UI0NsQUZd AkTbpOwRaofcu_kcCMghPhLcbCnsOk3ap7m6G7LE7S97ImmPRiZVJx02Rcrh2sAV.2AWTT8e._Xt .pZi6rzxU6ix4QXjDz6ReEw1hMfahDdDzGtzKNTpzzDuEWaKLSV58mfVFpz71g75WOgNZ5LlhPwI P_YU6ZvPeXwrtwFvMXNi8IifHbAE2DRvvZzLfpLfLhS5G2ICWVi44SfmAPWri5wkbKrH8vyEjIU. 0Ko5WJkA_ptU9h1FcJ55YI5EFdhoWqm1RQXvH1.FvB1DD42n95VnyEkfMDOAixitDbaVDETcsg9v J4dwXXAD4JyDNwiGjhpQBkt6hQbbZxSV2OgSD9awC9.jHFdd5EG2F3x9YNo3LdEOXzKCu9c2M0Yo HjBpqYJA2g_Mnz.PwzqlgzD1EHDPo0cSmgPTW0LRv915JlUgi9ERKGz0Lz8UjCtd8It2Mv_mjzPS jJCsdMc65W7YBEat1nwSsydyL7YPsr2HGRWkWXuMz.Wrjfz9n6AHE7UPQZbCeP9Q_GVodwNR9WPc p5BqUlq.cArKhEZGDPPPYAatuqFfBOi58XA4TlL3V7Z8GHcUcH.zrYMAhA6nok5RjG5XSG6biU_D Stmj9fi_Dl9POS5d.1n7eIbvXrjOi9Jq2qkUezufDCv488OtrHkTaMn64ALVsSGDW9f_lWFYxTpn .VVPcmYLjppBFdlC0v_fG.rzsop2QxQlvpi0ecdCnfnv1dqcJEjNu7RvBIpTSb.5901Tz4Qk9NqN vBZ4.2H4Ff0WN3Ea4gYMV5FvzBX9d8roIrlkayP2gYBQyL2YLU.L50N9qvMfcxxHvaEG1vOPMz2l Vy06vOEBx9o37H1060hFEV9NGDFoi6z6CAQBma7Z9oqCQ_s_yF4WD8GinXypCfXPXLgSiXt_stky owU3mJkJZXjpyanR3bGjCQQ16S0RyV3j7cfjiVCx4U3MaerqEsjBPe45.3eBSpQ5J.IbGV7uCggx 1FnyQSMUNYWEn3GNlQAQqpB2Ly2accmShJq0B5aOZ09j1tAWkVeF5jE45fIZMMdxm8QxY_Y8VIV4 1RxKNgO4E5kqr0LGWW2ywuTG9gP8cyGC59CxX9KE71JBPusAonmtbuSVw5FJ1T_KAz0BciJoCTuY ixoyCeGToPZ6OdH4QC80sJmUTmOYNTG78DxhK8vvXXGWsi6WATxMRB_tBo7i0SVMzjOVI0VHXaP4 T X-Sonic-MF: X-Sonic-ID: 0a0d8062-3194-4839-bf16-01fdaf18787f Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Tue, 12 Sep 2023 03:11:31 +0000 Received: by hermes--production-gq1-6b7c87dcf5-wlch2 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b1e2b114aa16e683569fea2bd99b82c3; Tue, 12 Sep 2023 03:11:28 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: aarch64 main [so: 15] panic's in kyua's sys/net/if_lagg_test:status_stress [confirmed with snapshot kernel] From: Mark Millard In-Reply-To: <766541C2-D0C3-4886-8779-F959662F59A1@yahoo.com> Date: Mon, 11 Sep 2023 20:11:18 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <8FBB9598-262E-4D18-8DAA-B08134A39D81@yahoo.com> References: <318444EA-B18D-4A6B-8D74-2A4276E366A8@yahoo.com> <766541C2-D0C3-4886-8779-F959662F59A1@yahoo.com> To: Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.148:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.148:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rl7sL0wHFz4JnH On Sep 11, 2023, at 19:40, Mark Millard wrote: > On Sep 11, 2023, at 01:13, Mark Millard wrote: >=20 >> It will be some time before I can try this with >> an official snapshot instead of a personal build. >> The build is based on b6ce41118bb1 : >>=20 >> # uname -apKU >> FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #17 main-n265279-b6ce41118bb1-dirty: Sun Sep 10 14:36:47 PDT = 2023 = root@CA78C-WDK23-ZFS:/usr/obj/BUILDs/main-CA78C-nodbg-clang/usr/main-src/a= rm64.aarch64/sys/GENERIC-NODBG-CA78C arm64 aarch64 1500000 1500000 >>=20 >> So it was a non-debug build, although I do not >> strip symbols and such in my builds. >>=20 >> . . . >> sys/net/if_lagg_test:create -> passed [0.105s] >> sys/net/if_lagg_test:create_destroy_stress -> skipped: Skipping = this test because it easily panics the machine [0.019s] >> sys/net/if_lagg_test:lacp_linkstate_destroy_stress -> passed = [60.045s] >> sys/net/if_lagg_test:set_ether -> passed [0.066s] >> sys/net/if_lagg_test:status_stress -> =20 >>=20 >> The core.txt.5 is not great, unfortunately: >>=20 >> panic: vm_fault failed: 0xffff0000006b96dc error 1 >>=20 >> GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] >> . . . >> Reading symbols from /boot/kernel/kernel... >> Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... >>=20 >> Unread portion of the kernel message buffer: >> (dump_iface + 0x2c0) >> elr: 0xffff0000006b96dc (dump_sa + 0x1c) >> spsr: 0x0000000000400045 >> far: 0x44572d4338374144 >> esr: 0x0000000096000004 >> panic: vm_fault failed: 0xffff0000006b96dc error 1 >> cpuid =3D 2 >> time =3D 1694414226 >> KDB: stack backtrace: >> db_trace_self() at db_trace_self >> db_trace_self_wrapper() at db_trace_self_wrapper+0x30 >> vpanic() at vpanic+0x1a0 >> panic() at panic+0x44 >> data_abort() at data_abort+0x304 >> handle_el1h_sync() at handle_el1h_sync+0x14 >> --- exception, esr 0x96000004 >> dump_sa() at dump_sa+0x1c >> dump_iface() at dump_iface+0x2bc >> dump_cb() at dump_cb+0x18 >> if_foreach_sleep() at if_foreach_sleep+0x244 >> rtnl_handle_getlink() at rtnl_handle_getlink+0xec >> rtnl_handle_message() at rtnl_handle_message+0x19c >> nl_taskqueue_handler() at nl_taskqueue_handler+0x674 >> taskqueue_run_locked() at taskqueue_run_locked+0x194 >> taskqueue_thread_loop() at taskqueue_thread_loop+0xcc >> fork_exit() at fork_exit+0x88 >> fork_trampoline() at fork_trampoline+0x14 >> KDB: enter: panic >>=20 >> get_curthread () at /usr/main-src/sys/arm64/include/pcpu.h:77 >> 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); >> (kgdb) #0 get_curthread () at = /usr/main-src/sys/arm64/include/pcpu.h:77 >> #1 doadump (textdump=3D0, textdump@entry=3D4003518992) >> at /usr/main-src/sys/kern/kern_shutdown.c:405 >> #2 0xffff0000000f7704 in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) >> at /usr/main-src/sys/ddb/db_command.c:591 >> #3 0xffff0000000f74e0 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) >> at /usr/main-src/sys/ddb/db_command.c:504 >> #4 0xffff0000000f71b8 in db_command_loop () >> at /usr/main-src/sys/ddb/db_command.c:551 >> #5 0xffff0000000fad9c in db_trap (type=3D, = code=3D) >> at /usr/main-src/sys/ddb/db_main.c:268 >> #6 0xffff0000004f4ec4 in kdb_trap (type=3D60, code=3D0, = tf=3D) >> at /usr/main-src/sys/kern/subr_kdb.c:790 >> #7 >> #8 >> #9 >> #10 >> #11 >> #12 >> #13 >> #14 >> #15 >> #16 >> #17 >> #18 >> #19 >> #20 >> #21 >> #22 >> Backtrace stopped: Cannot access memory at address 0x10 >> (kgdb)=20 >>=20 >>=20 >> So some transcribing of a picture in order to >> show register values that were reported: >>=20 >> Fatal data abort: >> x0: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) >> x1: 0x0000000000000001 >> x2: 0x44572d4338374143 >> x3: 0xffff0000005d3f90 (ifdead_ioctl + 0x0) >> x4: 0xffffa00b7f0d185e >> x5: 0xffffa0023fe4b992 >> x6: 0x000000006767616c >> x7: 0x00706174016f7575 >> x8: 0x00000000000001a4 >> x9: 0x0000000000210005 >> x10: 0=C3=970000000000000800 >> x11: 0xfefefefefefefeff >> x12: 0x0000000000000008 >> x13: 0x0000000000000000 >> x14: 0x00000000000000ff >> x15: 0x0000000000000700 >> x16: 0x0000000000000008 >> x17: 0x0000000000000007 >> x18: 0xffff0001eea0e500 (_DYNAMIC + 0x6d816358) >> x19: 0xffff000leea0e7f0 (_DYNAMIC * 0x6d816648) >> x=EF=BB=BF20: 0xffffa00b7f0d1800 >> x21: 0xffffa00b7f0d1858 >> x22: 0x000000000000000c >> x23: 0X0000000000000005 >> x24: 0=C3=970000000000000000 >> x25: 0xffff000000c68000 (sysctl___kern_features_netlink + 0x10) >> x26: 0x0000000000000000 >> x27: 0xffff000000ce9000 (cap_linkat_source_rights + 0x8) >> x28: 0xffff0000006bb0a0 (dump_cb + 0x0) >> x29: 0xffff0001eea0e520 (_DYNAMIC + 0x6d816378) >> sp: 0xffff0001eea0e500 >> lr: 0xffff0000006b8fe0 (dump_iface + 0x2c0) >> elr: 0xffff0000006b96dc (dump_sa + 0x1c) >> spsr: 0x0000000000400045 >> far: 0x44572d4338374144 >> esr: 0x0000000096000004 >> panic: m_fault failed: 0xffff0000006b96dc error 1 >>=20 >> I expect that this is similar to reports I'd made >> back in 14.0-CURRENT days. As I remember, snapshot >> builds of the time also got the panic. >>=20 >> I will note that an earlier 14.0-BETA1 snapshot >> kernel test run did not panic at this point in the >> sequence (or at any point). But I do not know how >> repeatable the panics are in the various contexts. >>=20 >> I'll note that I've tried to have the various ports >> installed (poudriere built) that are listed at: >>=20 >> = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >>=20 >> (The ones that build for aarch64, anyway.) >>=20 >> I had in /etc/kyua/kyua.conf : >>=20 >> test_suites.FreeBSD.disks =3D '/dev/md0 /dev/md1 /dev/md2 /dev/md3 = /dev/md4 /dev/md5' >>=20 >> and used: >>=20 >> # more ~/prekyua-aarch64-mdconfig.sh=20 >> #! /bin/sh >> truncate -s 4g /var/tmp/for-md0.dat >> truncate -s 4g /var/tmp/for-md1.dat >> truncate -s 4g /var/tmp/for-md2.dat >> truncate -s 4g /var/tmp/for-md3.dat >> truncate -s 4g /var/tmp/for-md4.dat >> truncate -s 4g /var/tmp/for-md5.dat >> mdconfig -f /var/tmp/for-md0.dat -u md0 >> mdconfig -f /var/tmp/for-md1.dat -u md1 >> mdconfig -f /var/tmp/for-md2.dat -u md2 >> mdconfig -f /var/tmp/for-md3.dat -u md3 >> mdconfig -f /var/tmp/for-md4.dat -u md4 >> mdconfig -f /var/tmp/for-md5.dat -u md5 >>=20 >> I also did a: >>=20 >> # kldload linux64 >>=20 >> before doing: >>=20 >> # /usr/bin/kyua test -k /usr/tests/Kyuafile >>=20 >> (Not true of linux64.ko in 14.0-CURRENT days.) >=20 > # uname -apKU > FreeBSD CA78C-WDK23-ZFS 15.0-CURRENT FreeBSD 15.0-CURRENT aarch64 = 1500000 #0 main-n265205-03a7c36ddbc0: Thu Sep 7 03:05:31 UTC 2023 = root@releng3.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 aarch64 1500000 1500000 >=20 > # /usr/bin/kyua test -k /usr/tests/Kyuafile = sys/net/if_lagg_test:status_stress > sys/net/if_lagg_test:status_stress -> =20 >=20 > got: >=20 > panic: vm_fault failed: 0xffff0000006813b4 error 1 >=20 > GNU gdb (GDB) 13.1 [GDB v13.1 for FreeBSD] > . . . > Reading symbols from /boot/kernel/kernel... > Reading symbols from /usr/lib/debug//boot/kernel/kernel.debug... >=20 > Unread portion of the kernel message buffer: > <6>ue0: 3 link states coalesced > <6>ue0: link state changed to UP > <6>lagg0: link state changed to DOWN > <6>ue0: link state changed to DOWN > Fatal data abort: > x0: 0xffff00015df8d800 (infiniband_input.printedonce + 0x11eff68) > x1: 0x0000000000000001 > x2: 0xdeadc0dedeadc0de > x3: 0xffff000000593e34 (ifdead_ioctl + 0x0) > x4: 0xffffa0004fb6285e > x5: 0xffffa0004fc00192 > x6: 0x000000006767616c > x7: 0x6e6d760070617401 > x8: 0x00000000000001a4 > x9: 0xffffa0004fc00000 > x10: 0x0000000000210005 > x11: 0x000000007ffffffe > x12: 0x0000000000000008 > x13: 0x0000000000000000 > x14: 0x0000000000010000 > x15: 0x0000000000000001 > x16: 0x0000000000010000 > x17: 0x0000000000000007 > x18: 0xffff00015df8d500 > <6>ue0: link state changed to UP > (infiniband_input.printedonce + 0x11efc68) > x19: 0xffff00015df8d800 (infiniband_input.printedonce + 0x11eff68) > x20: 0xffffa0004fb62800 > x21: 0xffffa0004fb62858 > x22: 0x000000000000000c > x23: 0x0000000000000005 > x24: 0x0000000000000000 > x25: 0xffff000000c58000 (sysctl___net_netlink_debug + 0x40) > x26: 0x0000000000000000 > x27: 0xffff000000cd9000 (sdt_vfs_vop_vop_spare5_return + 0x10) > x28: 0xffff000000cd9000 (sdt_vfs_vop_vop_spare5_return + 0x10) > x29: 0xffff00015df8d520 (infiniband_input.printedonce + 0x11efc88) > sp: 0xffff00015df8d500 > lr: 0xffff000000680cbc (dump_iface + 0x2c0) > elr: 0xffff0000006813b4 (dump_sa + 0x1c) > spsr: 0x0000000000400045 > far: 0xdeadc0dedeadc0df > esr: 0x0000000096000004 > panic: vm_fault failed: 0xffff0000006813b4 error 1 > cpuid =3D 3 > time =3D 1694485392 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x30 > vpanic() at vpanic+0x19c > panic() at panic+0x44 > data_abort() at data_abort+0x35c > handle_el1h_sync() at handle_el1h_sync+0x14 > --- exception, esr 0x96000004 > dump_sa() at dump_sa+0x1c > dump_iface() at dump_iface+0x2bc > dump_cb() at dump_cb+0x18 > if_foreach_sleep() at if_foreach_sleep+0x254 > rtnl_handle_getlink() at rtnl_handle_getlink+0xec > rtnl_handle_message() at rtnl_handle_message+0x19c > nl_taskqueue_handler() at nl_taskqueue_handler+0x5dc > taskqueue_run_locked() at taskqueue_run_locked+0x17c > taskqueue_thread_loop() at taskqueue_thread_loop+0xc8 > fork_exit() at fork_exit+0x74 > fork_trampoline() at fork_trampoline+0x14 > KDB: enter: panic >=20 > get_curthread () at /usr/src/sys/arm64/include/pcpu.h:77 > 77 __asm __volatile("ldr %0, [x18]" : "=3D&r"(td)); > (kgdb) #0 get_curthread () at /usr/src/sys/arm64/include/pcpu.h:77 > #1 doadump (textdump=3D0, textdump@entry=3D1576585744) > at /usr/src/sys/kern/kern_shutdown.c:405 > #2 0xffff0000000ec18c in db_dump (dummy=3D, = dummy2=3D, dummy3=3D, dummy4=3D) > at /usr/src/sys/ddb/db_command.c:591 > #3 0xffff0000000ebf88 in db_command (last_cmdp=3D, = cmd_table=3D, dopager=3Dtrue) > at /usr/src/sys/ddb/db_command.c:504 > #4 0xffff0000000ebc80 in db_command_loop () > at /usr/src/sys/ddb/db_command.c:551 > #5 0xffff0000000ef440 in db_trap (type=3D, = code=3D) > at /usr/src/sys/ddb/db_main.c:268 > #6 0xffff0000004b4860 in kdb_trap (type=3D60, code=3D0, tf=3D) > at /usr/src/sys/kern/subr_kdb.c:790 > #7 > #8 > #9 > #10 > #11 > #12 > #13 > #14 > #15 > #16 > #17 > #18 > #19 > #20 > #21 > #22 > #23 > Backtrace stopped: Cannot access memory at address 0x10 > (kgdb)=20 >=20 > (Again, kgdb's stack frames #7 and larger are not particularly > useful.) >=20 > Possibly interesting are the slightly different values: >=20 > x2: 0xdeadc0dedeadc0de > and: > far: 0xdeadc0dedeadc0df >=20 So, I again tried the 14.0-BETA1 snapshot: # uname -apKU FreeBSD generic 14.0-BETA1 FreeBSD 14.0-BETA1 aarch64 1400097 #0 = releng/14.0-n265060-4e027ca1514f: Fri Sep 8 11:17:15 UTC 2023 = root@releng1.nyi.freebsd.org:/usr/obj/usr/src/arm64.aarch64/sys/GENERIC = arm64 aarch64 1400097 1400097 and again it did not panic: # /usr/bin/kyua test -k /usr/tests/Kyuafile = sys/net/if_lagg_test:status_stress sys/net/if_lagg_test:status_stress -> passed [60.111s] Results file id is usr_tests.20230909-084231-927014 Results saved to = /root/.kyua/store/results.usr_tests.20230909-084231-927014.db 1/1 passed (0 failed) The problem seems specific in some way to main [so: 15 at this point]. Given that my personal non-debug builds of main [so: 15] get a panic and the debug build in the snapshot does as well, it likely is not a debug vs. non-debug issue. (Although, I do not strip symbols or such in my builds.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Tue Sep 12 04:29:41 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl9bb2NDGz4sfWt for ; Tue, 12 Sep 2023 04:29:47 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-lf1-x131.google.com (mail-lf1-x131.google.com [IPv6:2a00:1450:4864:20::131]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl9bZ4vSmz3D27; Tue, 12 Sep 2023 04:29:46 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-x131.google.com with SMTP id 2adb3069b0e04-501ce655fcbso8306457e87.2; Mon, 11 Sep 2023 21:29:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694492984; x=1695097784; darn=freebsd.org; h=in-reply-to:from:cc:content-language:references:to:subject :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=pio0YFSQ8CdH7sK5uX5XN0gtaDwGcxpftUQGt/kNJIg=; b=CW4DwQGuNLOt8GJnQUJd9q7JXoiEW1PTM56M2LBg0bgQZcOncpnY7P4EdQeoryqBzM Oz3aKPgZOTZn1y93F1GA6Dpl6bb9SFtxs7VBHGm3Nj1VlVszA3XzE2LcOQeGwPk1LZY8 RF3arN2J2rFuUgUcSrq1jF9dqwfFGuuwbWoRrTfilScMXMn5/VmjALXFGVrph4bSU66L dOaxQ1t492tHbcg9ce0hKqHaqwPwFEr82/8l01oOnRm/aW+GlqjUSrgwNomEtZXo3DGS pHEISaLgf/vGXjjyYVUs3QQROVjvtJ1AGM7v/v04gPxhJ7JLsyjHIzH6P0pp20yuCaZm uEog== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694492984; x=1695097784; h=in-reply-to:from:cc:content-language:references:to:subject :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=pio0YFSQ8CdH7sK5uX5XN0gtaDwGcxpftUQGt/kNJIg=; b=tUVFCSGBU7aHNiRKkc9EKfptqmQQVN99fr+6bi+KA6JxiNMvfns2JP9EBosBI36fIX 1b1Kl5Ard+d7eExQeO/A1TOv6mVmM4Uz96CqKIysVoPCe82xADOKETQHLl91YbdrO0Y6 ccMEVZDZg+ljpTknCFyIzqzlOZAQ08BRuQNmcN0TvMiu92bu8J+Ea4XfNlEegOPXoNzm VVT7bNekY1cRxKVjnPpZSgbHGqIR4aoEYWHP3lU6gfSJnEUkroLmPqC/wF9rWJDr0vwP XUumSkfcB40ia6PB3e6Xzmatr53223bIy7gvCTiwRcuyGmY2jFrR0oPcMmVJR2PYqnmi YOwQ== X-Gm-Message-State: AOJu0Yy0vueZghDHUR63xzFUnmWG7241XuAQlauUIAm9dnGx+fegPNJw 1UUNK7eqjpIyi+adp9vTFM9WoiM2YnB/Jw== X-Google-Smtp-Source: AGHT+IEZMCmgcqFdqBktpzYDvCxFsswzsq/o6/izdExreeAA/+6yJNUD69+tNcUy/F3pHddCJFhHig== X-Received: by 2002:a05:6512:3e07:b0:500:920d:1cbd with SMTP id i7-20020a0565123e0700b00500920d1cbdmr10161679lfv.9.1694492983575; Mon, 11 Sep 2023 21:29:43 -0700 (PDT) Received: from ?IPV6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id c2-20020aa7c982000000b0052e2aa1a0fcsm5368006edt.77.2023.09.11.21.29.42 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 11 Sep 2023 21:29:42 -0700 (PDT) Content-Type: multipart/alternative; boundary="------------OAYqQyUS4m4ozS9Ma3s8ntof" Message-ID: <584596c3-58fe-df64-2b23-1ef91ca1bdfd@gmail.com> Date: Tue, 12 Sep 2023 05:29:41 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: ZFS Panics Still To: FreeBSD CURRENT References: <20230911231752.B2B8C1AC@slippy.cwsent.com> Content-Language: en-US Cc: Cy Schubert , mm@freebsd.org, amotin@freebsd.org From: Graham Perrin In-Reply-To: <20230911231752.B2B8C1AC@slippy.cwsent.com> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rl9bZ4vSmz3D27 This is a multi-part message in MIME format. --------------OAYqQyUS4m4ozS9Ma3s8ntof Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 12/09/2023 00:17, Cy Schubert wrote: > … poudriere … > panic: vm_page_dequeue_deferred: page 0xfffffe000b7e9748 has unexpected queue state > … is for arm64. Should we broaden the hardware field, there? --------------OAYqQyUS4m4ozS9Ma3s8ntof Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

On 12/09/2023 00:17, Cy Schubert wrote:

… poudriere …

panic: vm_page_dequeue_deferred: page 0xfffffe000b7e9748 has unexpected queue state
…
<https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=265795> is for arm64. Should we broaden the hardware field, there?
--------------OAYqQyUS4m4ozS9Ma3s8ntof-- From nobody Tue Sep 12 04:45:21 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl9xd5dJhz4sr25 for ; Tue, 12 Sep 2023 04:45:25 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from omta001.cacentral1.a.cloudfilter.net (omta001.cacentral1.a.cloudfilter.net [3.97.99.32]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl9xd3Z0kz3Jjb; Tue, 12 Sep 2023 04:45:25 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Authentication-Results: mx1.freebsd.org; none Received: from shw-obgw-4004a.ext.cloudfilter.net ([10.228.9.227]) by cmsmtp with ESMTP id fgf5qWG5JLAoIfvHAqox6b; Tue, 12 Sep 2023 04:45:24 +0000 Received: from spqr.komquats.com ([70.66.152.170]) by cmsmtp with ESMTPA id fvH8qbQTv3fOSfvH9quDiZ; Tue, 12 Sep 2023 04:45:24 +0000 X-Authority-Analysis: v=2.4 cv=J8G5USrS c=1 sm=1 tr=0 ts=64ffece4 a=y8EK/9tc/U6QY+pUhnbtgQ==:117 a=y8EK/9tc/U6QY+pUhnbtgQ==:17 a=xqWC_Br6kY4A:10 a=IkcTkHD0fZMA:10 a=zNV7Rl7Rt7sA:10 a=pGLkceISAAAA:8 a=6I5d2MoRAAAA:8 a=YxBL1-UpAAAA:8 a=EkcXrb_YAAAA:8 a=jzTp7fNSC9Og4-nQ03kA:9 a=QEXdDO2ut3YA:10 a=IjZwj45LgO3ly-622nXo:22 a=Ia-lj3WSrqcvXOmTRaiG:22 a=LK5xJRSDVpKd5WXXoEvA:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTP id 5202D973; Mon, 11 Sep 2023 21:45:22 -0700 (PDT) Received: from slippy (localhost [IPv6:::1]) by slippy.cwsent.com (Postfix) with ESMTP id 1059B18F; Mon, 11 Sep 2023 21:45:22 -0700 (PDT) Date: Mon, 11 Sep 2023 21:45:21 -0700 From: Cy Schubert To: Graham Perrin Cc: FreeBSD CURRENT , mm@freebsd.org, amotin@freebsd.org Subject: Re: ZFS Panics Still Message-ID: <20230911214521.3beaed53@slippy> In-Reply-To: <584596c3-58fe-df64-2b23-1ef91ca1bdfd@gmail.com> References: <20230911231752.B2B8C1AC@slippy.cwsent.com> <584596c3-58fe-df64-2b23-1ef91ca1bdfd@gmail.com> Organization: KOMQUATS X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-CMAE-Envelope: MS4xfNSgUE2IquBBxYvKA3JqZG2IcG5Zdv0lS5PN+EInrChmnBtvkAQY7BZG/YCMlxL/3DvWPaKQNCRHLO9+PGrBs3vAFGo3U4K02K7ufTtVoB6bMYEuFPeu eFqWeD5aYlfxIfsIkZzos6iXCA3FBEuoEBw65FmCpX9IYIbDTEyCXZUYz3N1fQmmhfBAnDPXud+ew9WlStTrFBZyCzt5IH03Zf/go5nTDyFIGjMIj66VWMGm 0/M69QHx/JCqw79L3NnrztHJF3fvldIkMiLoDVj+NoVUPdNgixkQviz5+duYjiDm X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16509, ipnet:3.96.0.0/15, country:US] X-Rspamd-Queue-Id: 4Rl9xd3Z0kz3Jjb On Tue, 12 Sep 2023 05:29:41 +0100 Graham Perrin wrote: > On 12/09/2023 00:17, Cy Schubert wrote: >=20 > > =E2=80=A6 poudriere =E2=80=A6 =20 >=20 > > panic: vm_page_dequeue_deferred: page 0xfffffe000b7e9748 has unexpected= queue state > > =E2=80=A6 =20 > is for arm64= .=20 > Should we broaden the hardware field, there? Probably. --=20 Cheers, Cy Schubert FreeBSD UNIX: Web: https://FreeBSD.org NTP: Web: https://nwtime.org e^(i*pi)+1=3D0 From nobody Tue Sep 12 06:38:35 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlDSH4YLYz4t3PC for ; Tue, 12 Sep 2023 06:38:39 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlDSH0VZ8z4QpR for ; Tue, 12 Sep 2023 06:38:39 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="ogh/C1Sd"; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::629 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-99c1c66876aso667715066b.2 for ; Mon, 11 Sep 2023 23:38:39 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694500717; x=1695105517; darn=freebsd.org; h=content-transfer-encoding:subject:from:to:content-language :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=8CC1x2jL6XeRKUlsVu1FWL0skOjhde1evmDS796rjWs=; b=ogh/C1Sdq2VnlyD6Fgj1Cuv2Agto7UhVfo3SOYt1qatv1E01J0DatwlISLjM1oX3OW RKloCQG1z68E8+Yum44qN47mMS4vQyyMmrAkaBu49Vb/YlJQAFgQX4tmhFwdJNmgYPod O0lDZZpHmuWU0foSRS8XVPApG7B4YoAsROAo+XcgMe0Mym9pA+BEkeJxJtIozcbWszs1 4mOVOPHbtfbh0pwQXIzIy9j8zt7rAp2x4ZiMBDZk5EzstCf7Y+bYe4sXhUBoEumrOTFM ec7Bay43kuhbzRhDEVrTA2EOF5zS02fPii1JItqw8DiLbEJvMzQx8sMON74ZqnHVDwp/ cgLw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694500717; x=1695105517; h=content-transfer-encoding:subject:from:to:content-language :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=8CC1x2jL6XeRKUlsVu1FWL0skOjhde1evmDS796rjWs=; b=eSKofSSAWNcnaOywe7m64Z4URwGD1A/RxQ5xi7SbPb2s3WX7fNUZjBp/gZO+YQtE0b /+j5lM9nJZcF1qjX/+60HRmw6i/RRjJDyBW/G87Z+XUDyPZKGcVzTsgCAa/6YsXiRmGb KXheqJwTOHHfE2Uq2aoSu4Fit2HAqbjpgS3nz8buMaEKOh8mJtstSQ9FikdoYuQcN7fF dU0lz3cWSP6fSq4XaJFNasyPQuuL3/B+Ermp3uSaAbudHDiJfk/MCNhXNkDzwCF5K0aS Ex72E22c0jGJgjbcF+CQuPiCIgNsex/axQVoyLiLzoO2KrGdiwqa26KUjHhBSR+4sYmE veFw== X-Gm-Message-State: AOJu0Yxbuho8gDu3wyq1speh+MLhgYLyY35yGKcZtaKntcfxV219TqVM yJzm5hW4wYRNiuNJ+Vly6FDlfGK+ZeWNjg== X-Google-Smtp-Source: AGHT+IGwQYOmOZabwKaNJzyHf4o63UdJFvxpSdNX7/pQckL6jHTAiN15nosxrVxQ6mElXETJu2Gy5w== X-Received: by 2002:a17:906:2189:b0:9a9:d5f4:1a0d with SMTP id 9-20020a170906218900b009a9d5f41a0dmr10440067eju.45.1694500716933; Mon, 11 Sep 2023 23:38:36 -0700 (PDT) Received: from ?IPV6:2001:470:1f1c:a0::2? (tunnel642390-pt.tunnel.tserv1.lon2.ipv6.he.net. [2001:470:1f1c:a0::2]) by smtp.gmail.com with ESMTPSA id x24-20020a170906805800b009a198078c53sm6300444ejw.214.2023.09.11.23.38.36 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 11 Sep 2023 23:38:36 -0700 (PDT) Message-ID: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> Date: Tue, 12 Sep 2023 07:38:35 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US To: FreeBSD CURRENT From: Graham Perrin Subject: Continually count the number of open files Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::629:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RlDSH0VZ8z4QpR Can anything like systat(1) present a count, continually? I'd like to monitor, after log in to Plasma (X11), in connection with . From nobody Tue Sep 12 12:19:31 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlN321fNXz4thkK for ; Tue, 12 Sep 2023 12:20:46 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlN321Bjwz3XYT; Tue, 12 Sep 2023 12:20:46 +0000 (UTC) (envelope-from ronald@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694521246; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eZ8p1gXiMOZlczCbPKwnDoPl/h+gOwXHiV81d9JsaE4=; b=pB56RC8rl30LQmJgf5h4Mkw+Lu+rPHxbAPv+jMPdVUPAtLvDckGfeuteU/w1/SScEjBRvn Lq0VxdzbGplBrg/VKueJL1Nlz0rCIaMEXxcHHCzxN6IKSzwXS1EZ4smcax0Bz9uBdnDMps 3GFrgal2Vg8DTcnvYDP40oNsj+4xfEw8AEB0il65PtGNtRTR8swPIpTHiU93xb9657K0Pl y1Vtv/fdNzIfo6GRZQJkzYTJ49a8j9F75kqY3O57lZeqZc4x/UwhkjexJvRMdD0+l2FTZN VrrRqS+gH1P6QcQjg9kLzf7J7b/46kCbzaghzCZrzeusiK4+NGYL8HtQ7wqDlg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694521246; a=rsa-sha256; cv=none; b=uIHQdK81IYW9tK65XeexvBbpMeU6/htjW6iNY4qhOUyUQUN1eOHKS+/rdqEKMy5AloIqCO KKnW/Kmq2QzzCEjwy7zp2QQMJwnyVz5JoMgNWL4DCkRGWC0wbe0n0umH++Sh1dIiG3dzmA /Ge8y9ZQxmvtuYYJWUS8/JJD8ieN020u/QbjKKAfUJn1wrb77qwDD54kHU6Td+SzrwSRyt XhB85iuv3f2W69jIpVhbFBbCh8H9MTCLsB/dq9Lh1Zs55A1D+MHr952jXyQOIzXtDRhgxZ SJraLeATaG5coRRxeGmMOG4Iwicbjz/g5tJ+gUQaMJ+Kpg9J6CU3g1BFx8BgSQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694521246; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eZ8p1gXiMOZlczCbPKwnDoPl/h+gOwXHiV81d9JsaE4=; b=miRW4Yh+4IIg1bufEGu7DbLXvg1Nh++v46l5LijIoMJj4Bl5C++M+LvcaFvjbSPFYdWkB0 dWt2YpwUhe/lq2IEL0Rc6FeH+d1CtK3sW2Qj9CYHdp0N0VcbOnylRF+gy2Kl8G6q2fej7C tt+FA3xZ8111sDS4v7PkY1PHGcFfBKkhf76bWjV9nf65BL+ow8x4d0wYWnUAKaU5m6GW5t 9v0Ow3Af8NrmjEAPaMlBMlzgLcUOYzObgoYZU8kbzogfahSuw/2579DMLTgBflssTZac0S lK2uCcdCCRNdXP2oWC0Fp53KClwsVtpn0RVLTHQE2KOkp33ACsDRlp3HZ77OWw== Received: from [192.168.1.109] (84-105-120-103.cable.dynamic.v4.ziggo.nl [84.105.120.103]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: ronald/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RlN314YGfz1QFv; Tue, 12 Sep 2023 12:20:45 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Message-ID: Date: Tue, 12 Sep 2023 14:19:31 +0200 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: Continually count the number of open files To: Graham Perrin , FreeBSD CURRENT References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> Content-Language: en-US From: Ronald Klop In-Reply-To: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 9/12/23 08:38, Graham Perrin wrote: > Can anything like systat(1) present a count, continually? > > I'd like to monitor, after log in to Plasma (X11), in connection with . > > I don't think you mean: # sysctl -d kern.openfiles kern.openfiles: System-wide number of open files It is more like a gauge than a counter. Regards, Ronald. From nobody Tue Sep 12 16:19:35 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlTLr0MCcz4sgdC for ; Tue, 12 Sep 2023 16:19:48 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlTLq6rJpz3RjJ for ; Tue, 12 Sep 2023 16:19:47 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pl1-x62a.google.com with SMTP id d9443c01a7336-1c0db66af1bso39774315ad.2 for ; Tue, 12 Sep 2023 09:19:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1694535587; x=1695140387; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=tSPRojQqaJpfgB3X65tCl6RaMDyGxtENjRn9+PPSOSE=; b=B15TjVg/1Wq4QQroF/lUcbFT0D5pFnjVC6oDGldq5fVnRuyu7rz8Ha0cplKDFFBk0f w9Xsp8TQdUOVJaxySY4lxQOH64nXGxVKazbPwW4T2khzgecfTcGQ/yO7LdA9uf+DPwQp tV+7exNRtkKw1gfvA8+jcAZno3iVxTRwJ1offpT1hnKmBbplwS9YldeGrzhGvMPFDFe6 vf5kSGoJT9ixmr3MQJuqwhRG394COv9yrgt91P4qtMxuNbBmbcwaz4KSyMuNszRfbUEp JzDcIiU14AaRMzv7DJaKiSlkF8Ckeyq2/FZ0G/zWvJ/AbrlQFlFY5zNmAnpYLIEZ8vAq +SiQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694535587; x=1695140387; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=tSPRojQqaJpfgB3X65tCl6RaMDyGxtENjRn9+PPSOSE=; b=dT+VanJ3AR93E25nK64P0YpUnBxGnPOrOnTn47Dgy7EKR+WAtSsO8SZJwHvbjmg4UG KUgg2fUxMUkzWPfs36CPdZxpB5fS/VYSJdauJQOK+4DH/03Y0MiIoSiEARx8Tb3Qpml0 dJSc9bo4VakMhzuBAupNOFNzZ4DcNeFDS89b1L3bEbfq7vSy6c143eBXpeoKX/wAO49d AHKv7XaTOsPT4QBN1p4q8Xt6X8lCN3N4e1IrNJs5SbQL8i2ACpZiGLs8oA5AeZMdDNnj 2Dc0dDqAQ20JHPhIDNF9/rLb0pNM9edTucNurmy+pdKN8nFp9Z8jRmcD4O4BhM1ggWwE MJ9A== X-Gm-Message-State: AOJu0YykOgZrHxfNdkMWnKfhm3b7REfT6i7hg22pj4WhV7+bqG72yKZr nQfd4vNDUoXzpNaY0NzEtsDS5A== X-Google-Smtp-Source: AGHT+IH/jXY3all+ANIv3udzcafH92WGmgiQGS7kU5V3PU89HOliqAbgkAqSU47onTCA/BcG7xTTOA== X-Received: by 2002:a17:902:8ec6:b0:1bd:bba1:be7b with SMTP id x6-20020a1709028ec600b001bdbba1be7bmr220338plo.39.1694535586876; Tue, 12 Sep 2023 09:19:46 -0700 (PDT) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id ja19-20020a170902efd300b001c32fd9e412sm8717975plb.58.2023.09.12.09.19.45 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 12 Sep 2023 09:19:46 -0700 (PDT) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Continually count the number of open files From: Bakul Shah In-Reply-To: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> Date: Tue, 12 Sep 2023 09:19:35 -0700 Cc: FreeBSD CURRENT Content-Transfer-Encoding: quoted-printable Message-Id: <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> To: Graham Perrin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RlTLq6rJpz3RjJ On Sep 11, 2023, at 11:38 PM, Graham Perrin = wrote: >=20 > Can anything like systat(1) present a count, continually? How about=20 while sleep 0.1; do sysctl -n kern.openfiles; done Or you can write a small program using sysctl(3). >=20 > I'd like to monitor, after log in to Plasma (X11), in connection with = . Not sure checking how many files are open will help you. Looks like "baloo" is using inotify to watch changes on every file & directory or something. Simulating inotify with kqueue under FreeBSD doesn't scale well. FreeBSD should add inotify.= From nobody Wed Sep 13 06:59:21 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rlrsr2NRKz4smHY for ; Wed, 13 Sep 2023 06:59:28 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rlrsr080Nz4bvZ for ; Wed, 13 Sep 2023 06:59:28 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62d.google.com with SMTP id a640c23a62f3a-99c93638322so131806866b.1 for ; Tue, 12 Sep 2023 23:59:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694588364; x=1695193164; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=hqSbdIrkFivVRliQdSGrergR61SSu3nhOfoFBMJpvb4=; b=iwHBs4CZtb6xLwEGY8WYJCDFibxWutsYlyD9RivgEspSm+FMuO3MXMzqbKbFrjxzD+ /V3ndkzxRuL6dFKdyata4X0j6gJ1kRdipiQcisfUykxVu6R0S8kyHRNr2TEACjIRunGJ LG3gN78+2l+Tp0SzchNgs1Ux4VeQHx5WrPc36TntBauSleE6g+wKMPT87PJTJyp2BSg/ 59Zar2pdJaVoqn9DPiHZY6WHW4oyD3JER2v+FuqMIrOSqc38jMgRLLDghqe+Wu6gNW/Q t75akFb6hi01xfYk6sgcAYWgVzyiwO8Qol3RnuSdU17kQZK7QOehDhoCAJ5nPjWA3aVe HilA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694588364; x=1695193164; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=hqSbdIrkFivVRliQdSGrergR61SSu3nhOfoFBMJpvb4=; b=pAgvfiFXZmh1FbkGETdpVZgwh+cviloSQcem5TOh8bVMzb7m3B+wCJ/dAVGNzUXKn4 ZvPADfsPYSBb7S0tvuKOBQjj9OuV5LqmpFdJ87g2PIPu2jZ5CBbv7Ka2+bzAvFOVp/+l q+X7vcaL/WUmeoMr5gd0jKWsVSn1mGLuOY8tbLAUpoJhoL++frkpam+LuGtQkiDGCnoH s+HpULjFwl14XzJzGU3atuEirMAfrJVEsNyodhG5EpbOGJ94WGzZ/h8I3CL4XP11NjIQ 3gvrPTlewzTAEDPwQOw1gK9mONJ0qOktpUu7Gk2b+3ubhwJrA2R6GJBknO8hET4GYeiu 3WuA== X-Gm-Message-State: AOJu0YzNSfR3N4YzFjghwKeO22ynzZAwTPApogxOtRU8DSPRrPmiOBnA chBpktbwcV1kOW0eSNtXhnKUCUKGO0IuYcge X-Google-Smtp-Source: AGHT+IGFj91Y0xRm24eW46i/tltmL7M/8edududzILpRfRR/+ap209NC4LwYXNHnQJuz6DtORXP6Jw== X-Received: by 2002:a17:907:94d1:b0:9a1:e0b1:e919 with SMTP id dn17-20020a17090794d100b009a1e0b1e919mr6960808ejc.4.1694588364160; Tue, 12 Sep 2023 23:59:24 -0700 (PDT) Received: from [192.168.1.10] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id q18-20020a170906a09200b0099b8234a9fesm7939032ejy.1.2023.09.12.23.59.22 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 12 Sep 2023 23:59:23 -0700 (PDT) Message-ID: Date: Wed, 13 Sep 2023 07:59:21 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US To: FreeBSD CURRENT Cc: Bakul Shah References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> From: Graham Perrin Subject: Re: Continually count the number of open files In-Reply-To: <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4Rlrsr080Nz4bvZ On 12/09/2023 17:19, Bakul Shah wrote: > On Sep 11, 2023, at 11:38 PM, Graham Perrin wrote: >> Can anything like systat(1) present a count, continually? > How about > > while sleep 0.1; do sysctl -n kern.openfiles; done That's ideal, thanks. I knew about the sysctl, but not how to form a command like the one above. (I'm a tcsh user, I can easily 'sh' before running the command.) > > Or you can write a small program using sysctl(3). > >> I'd like to monitor, after log in to Plasma (X11), in connection with . > Not sure checking how many files are open will help you. > Looks like "baloo" is using inotify to watch changes on > every file & directory or something. Simulating inotify > with kqueue under FreeBSD doesn't scale well. FreeBSD > should add inotify. baloo is not used in 273669. I'm beginning to investigate something unrelated to KDE that has bugged me, on FreeBSD, for a very long time. Thanks From nobody Wed Sep 13 07:02:18 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlrxV5lw4z4sng7 for ; Wed, 13 Sep 2023 07:02:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-8.consmr.mail.gq1.yahoo.com (sonic315-8.consmr.mail.gq1.yahoo.com [98.137.65.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlrxT1wCqz4dnf for ; Wed, 13 Sep 2023 07:02:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=iMx1nUWp; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694588554; bh=8WnwXGqlTO6ByGXYEXzfq4bS0+cp5quVmcpGUyCcjIk=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=iMx1nUWpQ+K8TUw+DxSfbBtsbv9v2EaADDvtH24QElTK3EqzzOAXZDNJ5GRC5S6MoKejQAcybGoPPOhEN7R9LEH7JYI9qWeQ8XwYdTkNnAg/Oo0RyTAJhCDy9VDwoTbMlAdPq51QDAvCpoIAtxnioXu803DFxCYwVxmfiJRed68mbI2W+nIfg5Rmji3/93ilqH5aseOa/zNxoloNmJPjYrgHDo4RAz3zqY0aN2qWMLSm5jDTN/ro0glS5jlJnPyM+baHHiX4FQwUiki1+V1NKs3Bpk//UCI+lciSCFutpZV+QjFNpLzyhMv9EMfb8M5EKQiMEchwQCrxuoqz1B8f8A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694588554; bh=6S8EaBTDKv6xJ+wNpCLsVaJM7gwyrPSYsQpnc1jHfbi=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=SN7/XTlmn/35fpPlFL3Ulit+HraC+rhtdRs0sRNluYOK7z+MRGcmVzf6+eTrDSuAmb/tY0H1eT/FR/tdWTdP2bLIuLQiXEANBWynv/JAuJRLAbNozVur70hylqYRQAygW132IUqgmslnUOKe0OF/DImI94oHuJyg/igLKFd1KeDHHL3yy8QZRiYxqZuai2acIPwRDzbpLOVo4iJJ5ZnW6FEjffWzQrBkixv0cNJs41RjXadx0oKyIWYO2Cw9514u5kg+83BnwSInZHyPp/1B92cQwv2hgfZ3fCxRLNXk0vE8i/ylNVNhu/PbmZmhrcdfQHEfgoe5ZPACvu0YnU3n1A== X-YMail-OSG: iPhTAXIVM1kYaObdyqTkqzYu7X3.g.kjtLOBWSfYGDeDu4gdAYLg51G4m_164VJ IjZqQaOfHc2_lN.9sEWmS7UMbJQ_3aFH7txvq_gdp3oSnkkug77l5Z3WPYyJ42uu52y57Eef5g6l QLzG3pyU.7jms93rhc7sNEyHORqyt0jfnPJHPMeQ4WOwy0.7BEEPndXvUb6jVWzoJ8OM3Zaz.Rg6 seyTbcNvDqAaEu1Utps7Da5CsCJiFtU5nvUGA4Wlr23dmOP0Ak8oo5_jliMBuQk_2psjKzanRP5t xb160hrtHLAPV1MelD0pHPtav1bazCmmg_wWDt0K3rHNFT4blHCRZqtf6Waf7c8fomvo425DHtUb rz1h.xRkx_WbmIjZjUJOUMwSx6ooO197sAUSIlMfnESn054b_LdcVg1uiny9uuEu8ETZzVMeN7U4 mcD_ZsfVsUvqC.pUPg01u8mjmADoxtmU395y1dUcykI8J8YA5Z.LPNDjWn60VtkYS1R.j_KeHAwt .KivAv1YlHEArM8qozUISH6w7Jwpx5Mh0VQz2l9UFEmqkN7I2XFkLQqgR1cK_Bi8Y22rWRSb7hD3 MbjPY0aDzpa.rn7501bZ7mqe2mUcl_KoBLEADCAPhvyJAOMX3k5P6M4LCL8JrF3g4d0rX8rjgU8M NIEcKMzNqRBly8IQ5itrwAlTzUEQjw5utfjuB_TXG0AgqYpXkuXQq4_u5QIXIp2zZO5.TCprwrCP _S_9wf873KchWFMWCj5vtxaIdEiay.6jPXAuh8IrSmBhb.YXTmi0RNDpAOWmvNRkLOf_LHLTPa4i 3nW74VF47Yk94eYJAhpE.GY5m9q7Hg6pELu93PipEAc9uUb84EL813Lyscv3qs5E_E28jYrJPpIi Ff6l1wwRCrS1OmE.hKizzfXzFGUuGPUi5NBAdqezcpYaO296jDS6q7x7adSs1.1brzsHoLbAfbRn Ykt7qEWCO.g7UOlXiJ5TK3oeQAYTROGshl8Q7PMqO8uGZ2ux892VroRtMHJ.A9VGqdVvymUsjQNV m2hPX6pNMVYDOwpo80GRGPbJKrvvV8MOaXdwNwg9uDHuxm4i54tfJP5ANR2SxxjBwG94s7nummvh LD8Igfq0EYTn2Utkd_ozRHCNvIaon90pAsA8QMA7ShGWpGwU8B5kJ.Q.m2BRZBox1XG4xtm.IDeO euIe2pJW21gVUn0TF0CeMPkCk_PEXsJ.32vgQa_e0QakbMkiHJreuxkSfJ8NVieN86w0h7TR43CA bhdp3hwyGkoZCkopliZdurx1WBbcug1rlTnfwtACN8d5UW5JR._AmOrQRZazDtbInYzF7mX9v3mb urvXQe.djGqRYTYn.8esHnT4Htox6P_nz7I4hPnLpjBwUOca.QVsTCH2Lq0hfKYlIQ2kDsmg1ZEL XVhuaN7a6tlISsKLJniLLUviUS4FEZLgM66AqlGM.17hu1WiHy7JrLDBZYdeBlu5pSs3mCEoPhls CpIKqP7VKj7RXPNumRLEDvizgcTx1w7hun.vUH1VKUo5LMTdxU350fZIp4oivIHAksrXSsbWBVw_ e5nE1E7c3VVM3ccN3JpKcocGr2qXn9s6HgJ0R9fiMNHxugZC5Mi7oGKM0joy_lXNCOwNyD2988V4 kguGcYpgcquUD47Hv7KMIFhA_ItZBJOSni.LaR509KVq1kprHIC9wKnblMZc.OFx_Wcj8CCqH.wi f1XDnh7xpO4NTML7kzc768VOdSw9ZA81CfNy44eTCCzy_.svnqViEBBUm6RBnyCFPKnef1RGMTMu vUF41XXKYGSYrgxxqq1zH8TkVAnXmlIfxQnrE._zTg6H5s6N5dXigIzynrR0QqV7DdUILhIKfHjs 9WtlpNbeXf9QSMqkCrijAQTjhcbMyIevGUu2dTb71PxW9snbec57yxeOh8IFBhB5m.w8u5EKSyxo LQ.0gP4ova2W2xKsyTPzAewob2wSm1NYV.YQyYdT90jeGJNvVgTBmiXjQOQAdu4.r06Xg1eK5_I4 AFOf44F8kncq_w1b8iHU0DK37mzqkKO6cMDTZWwqqbbuPzQ8BteosTxVGCH2uFii9HsSAIEpkEtI zhQRd66llCjEFfIfwgkUHETBrRn8lCcbO3AuwGbupwrBUiZuyjrP_sv5YsTx48_QkcGLJcUayUpL Hu7CiCbar29OKH.QE.BhRySPqQFfUliSe5Vc2dnG.KDDJlaKVztpMG_SxodWQyLdMgyp2BRIjAVB W4zs2_3Qw3fvAXpUV8HoXH5CztcFEU8aeytPNaE9UlX8xZLor2Ij0eDDt4EVMp5woD41i0CWSWIo bvw-- X-Sonic-MF: X-Sonic-ID: 00f8e2f0-2b7c-4fb8-aed6-75a68224b770 Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Wed, 13 Sep 2023 07:02:34 +0000 Received: by hermes--production-gq1-6b7c87dcf5-j6k2s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3c2bde0f40e44c60cd58c2760d82d8c3; Wed, 13 Sep 2023 07:02:29 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: sys/net/if_lagg_test:status_stress can lead to use-after-free in main (both before and after stable/14 was created), at least on aarch64 Message-Id: <1A90A03B-0B48-4A74-A10C-BD871514460D@yahoo.com> Date: Wed, 13 Sep 2023 00:02:18 -0700 Cc: Current FreeBSD , Kyle Evans To: FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: <1A90A03B-0B48-4A74-A10C-BD871514460D.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.32:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.32:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RlrxT1wCqz4dnf See https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273081#c5 and the backtrace in the prior comment. The test context is aarch64. Kyle Evans provided a kgdb patch for devel/gdb for aarch64 that that finally let me track this down to the level of detail on how to interpret the register values reported vs. what code involved using the value. I will say that I've not managed to produce the crash with 14.0-BETA1. But I have produced the crash in my personal non-debug kernel builds and with the main snapshots dd'd to media and booted and used. === Mark Millard marklmi at yahoo.com From nobody Wed Sep 13 08:46:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlvFQ36bvz4thL6 for ; Wed, 13 Sep 2023 08:46:34 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlvFQ2gT4z3cd1; Wed, 13 Sep 2023 08:46:34 +0000 (UTC) (envelope-from theraven@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694594794; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kWHV2pDdCDq1WWBha9AXloR9JMiEtubA8JItTiyYPqo=; b=BZcUnKt7KzwaoDsEsKezARmnnJFo6vXo4C4J8eNkU+b3MBTaVjkju3UbBe+ILcbHGmynK6 qgmxmEqo1EnsmE/vjfBoVav5X9KYMNR6gQ5lhKyWnTPbrbIJSs1vIl76b72dIaeJWmQgqa E4bGxJ7+WWLrcA2vw9VRoVJhWvQM28I5cpO4b1zweujLnORWQ+2okDeJXRVLEmjp4e1X1G fM1aZPU57JKvGcNHf9+QW131ukcZSnOmQd7xi97DiphNiSKz/UanbzTNpQV5lSotCLUZGS NmQNfFsHjmpaX9AlaQ6qsq6rxt0XkmiMaCJBapV/QaLFecrmAvlcQ7Wc6WH1ZA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694594794; a=rsa-sha256; cv=none; b=uL2VEdyL3vZiC/lethJvOUkpLYdpvyOwflhjNXP0v0v9jGVy6anW4v+rwUcJVn12ZjgXo3 VAVtZD9foEz8ODokdumXNiVpSNESt3KZblTnFjH3uy3IpCbT1I4cQ0co+jU+1QsPjHGYuQ uhRVS5gaCZaO2uE6J5r8crHRUVTgDXEF+YuWGvcNPQ2Hjni6gD+kMxxqHWR7sefQyiaqSE SGLwqA/oRzk1dUH55xcvVaIDKWfBhcP3890NCLxWNK/mLtjKyIYIx1a+VGHf8XKHT2CIpe zeFU269nmIjPNpc72uUJX7BVU3QYM5ftysWbY22T/wzuNZgD1Dnh4yqL1i+AGg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694594794; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=kWHV2pDdCDq1WWBha9AXloR9JMiEtubA8JItTiyYPqo=; b=K40hb5RjBTWptbHxsPUFJgp/Pxdk1jSgaBLBujffYOM2pHYgToJLUnCvs+JqPghGwK/LsZ TPWYYnaHvx30HQwLFx31Gy5WsKbIWsnVhfzUXhpodVcNZTTqIVMSNWYdfXHOExkwk9XomJ B9b4XeH6WRi0QdEyS3DSVZzdhwxvGyEYNgdCUCnYaOObcFYV4aIpWzJfgNh1jiwahRj4fs jM8lP6mP6xeklLtXjO538/8rDN/cXmF7mW6+Tv3AjLp0ftlHyQ/sJsfHaTGwO7a9TTFO+Z yx54zcTafJrzUu0lIECpauXtSRK20Yr9rnJset0mJIAq9hb+Dcd4MiJjHqXzOA== Received: from smtp.theravensnest.org (smtp.theravensnest.org [45.77.103.195]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: theraven) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RlvFQ1bYVzrkS; Wed, 13 Sep 2023 08:46:34 +0000 (UTC) (envelope-from theraven@FreeBSD.org) Received: from smtpclient.apple (host81-156-206-121.range81-156.btcentralplus.com [81.156.206.121]) by smtp.theravensnest.org (Postfix) with ESMTPSA id 651239C8E; Wed, 13 Sep 2023 09:46:33 +0100 (BST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Continually count the number of open files From: David Chisnall In-Reply-To: <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> Date: Wed, 13 Sep 2023 09:46:22 +0100 Cc: Graham Perrin , FreeBSD CURRENT Content-Transfer-Encoding: quoted-printable Message-Id: <1D86A8FB-ACC6-427E-ABB0-2E1A5989170E@FreeBSD.org> References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> To: Bakul Shah X-Mailer: Apple Mail (2.3731.700.6) On 12 Sep 2023, at 17:19, Bakul Shah wrote: >=20 > FreeBSD > should add inotify. inotify is also probably not the right thing. If someone is interested = in adding this, Apple=E2=80=99s fsevents API is a better inspiration. = It is carefully designed to ensure that the things monitoring for events = can=E2=80=99t ever block filesystem operations from making progress. I = think there=E2=80=99s a nice design possible with a bloom filter in the = kernel of events that ensures that monitors may get spurious events but = don=E2=80=99t miss out on anything. =20 On macOS because files have a stronger idea of which directory they live = in and so it=E2=80=99s easier to have an API that notifies for changes = to files in a directory. inotify monitors individual files but loses = notifications if you write through the wrong hard link to a file (hard = link foo from a/foo to b/foo, use inotify to watch a, write though = b/foo, observe no notification). I think the right kernel API would = walk the directory and add the vnodes to a bloom filter and trigger a = notification on a match in the filter. You=E2=80=99d then have = occasional spurious notifications but you=E2=80=99d have something that = could be monitored via kqueue and could be made to not block anything = else in the kernel. If anyone is interested in improving the current kqueue code here: = there=E2=80=99s currently no mechanism for tracking when the last = writable file descriptor for a file has been closed, which is useful for = consuming files that are dropped via sftp or similar. NOTE_CLOSED_WRITE = is hard to use without race conditions and tells you only that *a* file = descriptor with write permission has closed, not that the last one has = closed. I=E2=80=99m currently resorting to a process that runs as root = that uses libprocstat to walk the entire list of open file descriptors = and report that they=E2=80=99re closed, which is incredibly suboptimal. David From nobody Wed Sep 13 18:52:19 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rm8hd6DpPz4ssnt for ; Wed, 13 Sep 2023 18:52:33 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pf1-x42e.google.com (mail-pf1-x42e.google.com [IPv6:2607:f8b0:4864:20::42e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rm8hd0WZgz4cKS for ; Wed, 13 Sep 2023 18:52:32 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pf1-x42e.google.com with SMTP id d2e1a72fcca58-68fc9a4ebe9so73755b3a.2 for ; Wed, 13 Sep 2023 11:52:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1694631151; x=1695235951; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=l/wkQ8HOWumEWr7nkAyVDppjN9h6s54tXbOmNqxvX/8=; b=EmeIwVQ4dC10PijxUouc4p45ukOYL0a0qQtd5W6KmAiubEMMm+NrM7oXClIfrQHIV3 PReaPzuTr0QFV7koLNunPaXOoQ6mwxaTQFwgd2BJj5XqPdEo4ULtt95VgbY6gmshYtzp Est+ty67QmHutxJp36f2xxCrpbF8CLQswW1k9UhuCRFdL99w7Gof3oU+HxG4tsIcLXaU j2rs8T6+86biCLav1wCLE7LiwRujRp/b9B2Y/h5cucBsAdgQMZjhYk6hos7ikUH+eBqB v1osh7RV69yWfT8LvlksrL50RtzXc2Ji1iOFDdbwrw19c1Qaj+jzAjm1DX6LoPRxALoa GGVA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694631151; x=1695235951; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=l/wkQ8HOWumEWr7nkAyVDppjN9h6s54tXbOmNqxvX/8=; b=dEPxmUwsMTgqxcjQPFcoZeFGe8XDCfd0dQwraYVxm8ijduSHYsbUFJzM1dLtB2iy+j QWQdYNLgbTIVWX2l4KjiDDiovsyWOAzvmAVZFQ8RkuHNNwe3Fb3AGmESj9NfDImzzHmN qj4Td81G0fUQTi2xBZJyLOBOTX1em/CWuitPdswgcMn7I6nMdxaC7OE/3sIr3VJryozp 1PrPTrVXf4+OGdexI5nsdHWP38us7ErYoA1GweAH4SkB+S0NyfXMwefeIbGWqak7lDxO JKJqWEsFq+0zEJoI1H2cC8DOt7mwamEBGpy+uzxctqJZUF8Yhpzeo8uyEnGMuqIBWMbS FXxA== X-Gm-Message-State: AOJu0YyfVVhO3yg//GvGggUY1fAzbVcB7jqQiOPTgh5WpTa4McLarddy Yg7lnYAyuUehdWtHF/Dker49NQ== X-Google-Smtp-Source: AGHT+IHpYGi/2YDuqRfAQ1f9EGtnp4FXAwDU/DjKsGmFfC8Vl0D3FskbZt+jxoalaAAtq/vq8rzHPw== X-Received: by 2002:a05:6a00:812:b0:68f:cb69:8e63 with SMTP id m18-20020a056a00081200b0068fcb698e63mr3923920pfk.4.1694631151099; Wed, 13 Sep 2023 11:52:31 -0700 (PDT) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id i20-20020aa79094000000b00687260020b1sm9446693pfa.72.2023.09.13.11.52.30 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 13 Sep 2023 11:52:30 -0700 (PDT) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Continually count the number of open files From: Bakul Shah In-Reply-To: Date: Wed, 13 Sep 2023 11:52:19 -0700 Cc: FreeBSD CURRENT Content-Transfer-Encoding: 7bit Message-Id: References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> To: Graham Perrin X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4Rm8hd0WZgz4cKS On Sep 12, 2023, at 11:59 PM, Graham Perrin wrote: > > (I'm a tcsh user, I can easily 'sh' before running the command.) You can switch to zsh. Most of csh/tcsh + sh + many more features. > baloo is not used in 273669. It certainly feels like an inotify like use or a file-descr leak. The bug reporter can try "procstat fd " on running processes to see which one has all those open files. Another thing worth trying is to run under ktrace -di to see which syscalls were made. From nobody Wed Sep 13 22:03:39 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmDxN0d41z4sx5Y for ; Wed, 13 Sep 2023 22:03:52 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmDxL22mGz4Dld for ; Wed, 13 Sep 2023 22:03:49 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of junchoon@dec.sakura.ne.jp has no SPF policy when checking 153.125.133.21) smtp.mailfrom=junchoon@dec.sakura.ne.jp; dmarc=none Received: from kalamity.joker.local (123-1-88-210.area1b.commufa.jp [123.1.88.210]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 38DM3dGo026105 for ; Thu, 14 Sep 2023 07:03:39 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Thu, 14 Sep 2023 07:03:39 +0900 From: Tomoaki AOKI To: freebsd-current@freebsd.org Subject: Re: Continually count the number of open files Message-Id: <20230914070339.dc311c4f9638b8443528bc0f@dec.sakura.ne.jp> In-Reply-To: References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: - X-Spamd-Result: default: False [-1.50 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; R_DKIM_NA(0.00)[]; HAS_ORG_HEADER(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[sakura.ne.jp]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RmDxL22mGz4Dld On Wed, 13 Sep 2023 11:52:19 -0700 Bakul Shah wrote: > On Sep 12, 2023, at 11:59 PM, Graham Perrin wrote: > > > > (I'm a tcsh user, I can easily 'sh' before running the command.) > > You can switch to zsh. Most of csh/tcsh + sh + many more features. > > > baloo is not used in 273669. > > It certainly feels like an inotify like use or a file-descr leak. > The bug reporter can try "procstat fd " on running processes > to see which one has all those open files. Another thing worth > trying is to run under ktrace -di to see which syscalls were made. Additional note. For emergency I heve a line below in ~/.tcshrc.mine and a flag file ~/.Use_zsh. This way, you can switch back to tcsh by deleting the flag file whenever you want. No need to update master.passwd entry, as the login shell itself is still tcsh and zsh is `exec`'ed from tcsh. if ( -X zsh && -f ~/.Use_zsh ) exec zsh -- Tomoaki AOKI From nobody Thu Sep 14 06:37:29 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmSLM3Lcxz4tSM8 for ; Thu, 14 Sep 2023 06:37:47 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-19.consmr.mail.gq1.yahoo.com (sonic305-19.consmr.mail.gq1.yahoo.com [98.137.64.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmSLK6TXMz3Mfd for ; Thu, 14 Sep 2023 06:37:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HfFAqLuA; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694673464; bh=K9h9a85mle8TGmI4DemmOrCWcsHhKo6H5pH4mbKiMdE=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=HfFAqLuAo5MghorozPPge6rmGrGJ+5dCWoij3rr6MKrZiZe397rk+5Eh1ayiT4LToPBc7O+jbSOHmJCFigHEsXWS0WxeHinOLYFctRb6rP1NwWAaASM6vH9P9T8ulDzDrXd5Tt8ig0+OCqZElkjjqmyOLlJl9DrIswH/kAtlyQ9CjwSbFzQjAmRsk+aZ8saUsDZw3T2T3q3rMzZvmVYutWCnfQ8ZruPtFmA4rCEHn8pptresApDFtOttjLKMom/SOv9hEkIXuRQbuVt9j5SR+5NjMvYMYhYc4tMuMAU52jo/J/Hf0ZJx8amRCPABOICFnjTH5BMyzGr19braDOteGA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694673464; bh=DsX/VzOgliiE70+0cw2eC5oQ/Tq7yD1gpD6yLfLkJE4=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=QgpUKP++d4OMR5aWvTMYdbz/0800B3eoA3EXfowsf/d/qrqo5CJlE18U3o0CGVpvBtFrVtpxVifIjN7+6zy/LgqjyEaBB4zh97l3k4BTugnk5DnGX0yDZZbrihBfCHz+zLTPIE5BwQaKL0OY1erqIsVyF2OFWPn2vJs1Z9Mt7/K7K+GOO6ArVDK3qx6vi1tl5iw+6+thepdsG7PMz9hWOrQHOc6dotoOI1f7VHN/BUlhs0BS5CN/0v1qvt+dYk7j09IeuFK3a6fdQIG9tuweDZhdVS1ie4WfxyJ8Hljuyf1NauNi78GCDa60FwV5F5ZOQGVQUSzntavlYJIhTWERcQ== X-YMail-OSG: bRhAA0IVM1mzs0j01mxGqmjTrM.xdwvXcnFOLUsG0TckIPpnxHlLqoFXN2_CMQu Ysh9zjHsBcORuaN_hob81oAolWpT8yCuVEm26r9sD3ej.rpV5BV9YqcVDYt.WECTGsYQmNosjSs1 VHpemdwAHhQLBv4N03MzjJWF3MdYEbl79g77k0SskpcDxuGdqrGLbU6qvFetI4fti32NWtjr3QRF fKI2Hyjsv3Sr6i4ShM9YKlJYoa3d3a3zI4J1dvZaAEvfrAI.Gay5OFCsWs5fo.wQZ0_QQV.aDzPt 05V10WvhNg.U0b.qqy0RLTpmHIU9tTtKrml3hhD8EG_GhSk36C3apQqjcbw.rTJ1QX5UftYW9EEr 45XvN.3cLNC5THspg7T8dfotjMTV6scq3tlf.i_SyFVHnvLkUo3IjYpxzYxo5vgbVuFJ_Dkc3Hgg tuQSDs5KkbsCJP8uJtnu5.TtGyK2c97TBXiA7SbaiYlKe8c_ij4uRPFft9Mrikwt6kj8m4oumJ4j Ov.SanK241NwHcQM6D_o.vzGQuXspoVBzxrfRGiJ_vjZGeehaAi4MYnmjep29JnfF.6P4OVhkEcN IIKtO6SLoIC4552kXI0zMi1YF2COTNgT0NRU8dWSejMoCyK4viZjX4H6VmSBXveO9krBdnVSyROU DeQQBDNznRpszAHRxUXxxitcol0TVYv7NEFvpBoTAi4koLHz3hoJ0hJDK9GL4TjhM8hqKAwngmwP KRlIV8GdOE9Ozl4nKWpuCIUcLERfxJq5Qr5OtC0wNYXcfjIY6j6pG0nu_yGhz3Es62U2WgOUAhLP xOZxcEP7trDqHFujfnuYl9tFclV4anwnjXmvamJdTi8..zQFZ8aeYdC8rImR4DkMPVU3YobAw5EV QfJv7L4lpZpbsvwG1XKzNQRmzsm9_._1GB.HkaQbjVyO5cI96wciV60P3et0B4wbIoW4li6RAEIG JVl8PI_prS6a8btvcY50GIgGXwPHUsefgcJs9msvaYWorvtclAFKKX6zST8BescMKwZ2evbaOk7u g9z0rWol2tukt6yruzjyGzLPCbP6Y.C_1UeKN6L5ZtfqJLNWKFiTfZpo4QXIp.GtFRv9AUhO.jYA MCxh10ue5QRQ_QmmVXHG9NelsEdLg3w56BhugGBajL8DKLKMTzjQvniw.LMJbqzefIfvG92g.l3R ZNlel6I_Yjguj6uolfkweiZ5PuTbWCDeg_9NmfWf.Ng6Qny4hXsrkNx9NiSJ6kff4Orb.gM.ro5x rHskSPN9_WhCD4.8ZrhASUtWWnYhHX9NNvHw1hy2LlljcoQg3_Kwr7AorQefuMB6tTVBmwONSA3E .yfPP2NUkEmSKzcNpKyHuabg4oaZxYhgHkDT._mhRpJlCC4odfBppgTbkoXOAsT_d5BFfgHTRsaR 3oc4qjYwSKv6UXM9HmsnUY_foeGifxMmVPkjgp8yWuRmK.7551W46U2rpXNxIQ6W7OZrnNnAtlRO rjWuQFajLfQ6mRKIlWKcvGJwla_t1owViqeOaxwuY5DMuLWXbI.V0iKqcOAE8_Dc6CxLl13dFnO_ TN08Oou2JfcWFIwOmfgmLC.FWSrsqSjbYqrFZZxWcUvLuifJ_RLRnTelM8Mhfm551EoSs8ObCEWv wd43Avg6b8rx0EBkwqEQRg9SZ6Hazf1q3B.aFlmVWthjTpSEdN4f_xCt2GDWflax3rC55V7lqHuI dYx7_QBpQxWBF1leamuVzEK3FwYTMLs2SM.hlDyys2F5yiTD6h9KrFnQcgi3chIj3e5dsgOVZAbe nOVpagMONT.MLJwYK.WQi58WJ_6XdA7WIbIawRlq2heF.pa6xeJr2bT3A5FmvgM85Nkzl3FmicMG 0fsmpSytqEKSNENQLJIhy5dmzhHvSVXwlxs5rcEZQVX8cwjgAqlQGehqRxcRHM4E1EuVyZKW9Ew0 WqLP76uC6u2gD_8gDbmt0AFK9EjZ9jGisnF3ulLV2.0coxL2ce_zhpCK18a1qW09LFlMFK1iLsFa 3QFXiy6kiHEFicmPcAEVnq4IjsVBfxiLJOxgXrf9BchN4tCOYpytfBvjEOsyAzsz0t_Y8OOY8exV rNinhdLJkTWYu3HgLK2uzOiySlc1_nqEABUDonCpz2BRTEpNKuLqlCnlkXJNgZ7ScKZAoNZSIZma 4iJ7IaPt7RtfOvUTb7yD72G2GISvcBCIK2N1sbpHzwzWnanGLrAL7vClkRRa3d8boz6rFeOYmnnT z_Vux.K.ZDDXoDfJW0skbN8MHB4qpp7dsDnE2STNLoaINB4yucZzvbP0vOOrkckcnVYa1YdUWaCE - X-Sonic-MF: X-Sonic-ID: db629c45-df1a-4461-91d5-6474b1e94a28 Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Thu, 14 Sep 2023 06:37:44 +0000 Received: by hermes--production-ne1-6cbd549489-84thk (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 1bb71c63d7427fb41a44ffeaa45ed438; Thu, 14 Sep 2023 06:37:40 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: git: 8d49fd7331bc - main - pf: remove DIOCGETRULE and DIOCGETSTATUS : net/py-libdnet and net/scapy now broken, kyua test suite damaged Message-Id: <86F9198D-5B52-4B59-A44D-DA249643B864@yahoo.com> Date: Wed, 13 Sep 2023 23:37:29 -0700 To: "kp@freebsd.org" , Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <86F9198D-5B52-4B59-A44D-DA249643B864.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.45 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.95)[-0.950]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.82:from]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.82:from]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RmSLK6TXMz3Mfd This change leads the port net/py-libdnet to be broken: --- fw-pf.lo --- fw-pf.c:212:22: error: use of undeclared identifier 'DIOCGETRULE' if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && ^ fw-pf.c:252:22: error: use of undeclared identifier 'DIOCGETRULE' if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && ^ --- intf.lo --- for (cnt =3D 0; !matched && cnt < (int) entry->intf_alias_num; cnt++) { ^ intf.c:571:2: note: previous statement is here if (entry->intf_addr.addr_type =3D=3D ADDR_TYPE_IP && ^ --- fw-pf.lo --- fw-pf.c:296:28: error: use of undeclared identifier 'DIOCGETRULE' if ((ret =3D ioctl(fw->fd, DIOCGETRULE, &pr)) < 0) ^ 3 errors generated. That leads to: [00:00:41] [29] [00:00:26] Finished net/py-libdnet@py39 | = py39-libdnet-1.13_4: Failed: build [00:00:42] [29] [00:00:27] Skipping net/scapy@py39 | py39-scapy-2.5.0_1: = Dependent port net/py-libdnet@py39 | py39-libdnet-1.13_4 failed net/scapy is used by parts of the kyua testsuite (when installed, anyway). So the kyua testsuite is now has damaged functionality on main [so: 15]. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 14 09:02:38 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmWYY2vV4z4t1pF for ; Thu, 14 Sep 2023 09:02:41 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmWYY2LgKz4X6s; Thu, 14 Sep 2023 09:02:41 +0000 (UTC) (envelope-from kp@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694682161; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4alNtE8l0nJ8kBjJFa/HCbnTyuxi63eaxp5aefSAOqs=; b=K6m+PyzYlz/UUEdY9hPjbknWO9ZReJnvQkas4P0rudU9cs/rc26kS2C+5PwcwfZR0IZTpU bQqNww4vWnaKS9WoSwnhfCHXUEk/9zdJscQ+tZgZXwyHHkjrAKVCwbL2bHLA/+A1yONSyO fGr2elIuoYpmu8dFX202I1szamijEWT3yklHHsm/jaf68MHZugNFDzkcDJVrahyj0+uuPC X6vIGFhJqaXYcIM9HGPsnrQyeLB+XNyc+xVx9yqsnqoyjyBmojI54u4YFbFjDC6oVs8ipn IlcbcgrTaA+D1uID5/z0iAhRCiMmXswDLYu2POKx4g+Nc9zRnuubZvnHvDCN8g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694682161; a=rsa-sha256; cv=none; b=pPZ0n8BFf6WQ9SgIUb6Zp4YZirkZXe3vz7AmsevACITs5UDhFBw/FhVl6s55Mq58x3uDOn uZ4OXumj1vXRiP8HFdIqI0CKH5REw+ckJokNc27Qg/NftXp4p+NO17R4FuynCWx3Kc7D5S 5nfUOurrR33+A5yBJhOJRAkiJoJNMVat5AItsRmQPkKh6bAktdHVLXf+U0TPP6sYmzW6CR 6qGMF7Fpm3EzT/lANxDhNf05+xIY3JEwzAvb8uHxE1Y+rdKLaXgMiZNehLDgGmpDZOTay3 1Fize/JfttLjw+YjfsApY7Gdw11I6joYUO1HmjnsdgPFZgbcN7a5n3L/8qVJbw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694682161; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4alNtE8l0nJ8kBjJFa/HCbnTyuxi63eaxp5aefSAOqs=; b=Fwtae3PoRUNT+8RSBdYmI8GLIDMK+OvoHm6988GbXU2oJW0KcfIloCaZzf05uJDA9qgLiV SCt6Wy3EsY1caBnAD9Yf3xalFirtzefMhwPeJpZhfIg81GbjnnzucocmpSnF5mEltQQOhE nKojWsMT/nLf6g0zxyV9bEpN9syuRAWrX3XZhMm5PsZhb0b49MZxVUm4NvDD8RE3ic8hUx R8WpKLdvF8Saa8O7tzeAHvHNa51afCMmFfWfCFvAK1aB3NS7yGJdN0LX9yQqotoZ8XcyE4 oUjs+aA+fA9iC1L7GFFeSZTIcz/M9PgFgq2YAqKOUbud0GPwFAqLJBmXtVa8Iw== Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx1.codepro.be", Issuer "R3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RmWYY0pkYz1L5W; Thu, 14 Sep 2023 09:02:41 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id 8881C77E8; Thu, 14 Sep 2023 11:02:39 +0200 (CEST) From: Kristof Provost To: Mark Millard Cc: Current FreeBSD Subject: Re: git: 8d49fd7331bc - main - pf: remove DIOCGETRULE and DIOCGETSTATUS : net/py-libdnet and net/scapy now broken, kyua test suite damaged Date: Thu, 14 Sep 2023 10:02:38 +0100 X-Mailer: MailMate (1.14r5937) Message-ID: <9A0C699C-78DA-4EB9-945D-A7C3B29EF31D@FreeBSD.org> In-Reply-To: <86F9198D-5B52-4B59-A44D-DA249643B864@yahoo.com> References: <86F9198D-5B52-4B59-A44D-DA249643B864.ref@yahoo.com> <86F9198D-5B52-4B59-A44D-DA249643B864@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hi Mark, On 14 Sep 2023, at 7:37, Mark Millard wrote: > This change leads the port net/py-libdnet to be broken: > > --- fw-pf.lo --- > fw-pf.c:212:22: error: use of undeclared identifier 'DIOCGETRULE' > if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && > ^ > fw-pf.c:252:22: error: use of undeclared identifier 'DIOCGETRULE' > if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && > ^ > --- intf.lo --- > for (cnt =3D 0; !matched && cnt < (int) entry->intf_alias_num; cnt++) {= > ^ > intf.c:571:2: note: previous statement is here > if (entry->intf_addr.addr_type =3D=3D ADDR_TYPE_IP && > ^ > --- fw-pf.lo --- > fw-pf.c:296:28: error: use of undeclared identifier 'DIOCGETRULE' > if ((ret =3D ioctl(fw->fd, DIOCGETRULE, &pr)) < 0) > ^ > 3 errors generated. > > That leads to: > > [00:00:41] [29] [00:00:26] Finished net/py-libdnet@py39 | py39-libdnet-= 1.13_4: Failed: build > [00:00:42] [29] [00:00:27] Skipping net/scapy@py39 | py39-scapy-2.5.0_1= : Dependent port net/py-libdnet@py39 | py39-libdnet-1.13_4 failed > The commit removed those ioctls because they=E2=80=99ve been superseded b= y newer (nvlist-based) versions. Ports are strongly advised to use libpfctl rather than trying to deal wit= h nvlists themselves. See https://lists.freebsd.org/archives/freebsd-pf/2023-April/000345.html = for an example of what the ports will have to do. It=E2=80=99s generally = a trivial change. Best regards, Kristof From nobody Thu Sep 14 13:46:13 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rmdrm12xvz4tXgc for ; Thu, 14 Sep 2023 13:46:16 +0000 (UTC) (envelope-from mjguzik@gmail.com) Received: from mail-oo1-xc2d.google.com (mail-oo1-xc2d.google.com [IPv6:2607:f8b0:4864:20::c2d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rmdrl477bz4Fct; Thu, 14 Sep 2023 13:46:15 +0000 (UTC) (envelope-from mjguzik@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b="i6Kvgn/T"; spf=pass (mx1.freebsd.org: domain of mjguzik@gmail.com designates 2607:f8b0:4864:20::c2d as permitted sender) smtp.mailfrom=mjguzik@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-oo1-xc2d.google.com with SMTP id 006d021491bc7-573429f5874so530579eaf.0; Thu, 14 Sep 2023 06:46:15 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694699174; x=1695303974; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=DQbnGYGC1tWpJ5gmQaVkx06bk3fBiDHM6OlO+9oCV9U=; b=i6Kvgn/Tsng+gvBYSE4HMeXovNDJypffGAYXIP7oGit/D/3q1biupD8yDfvBYRfkZi OYg6Ah4sCPpDDpXtIBdZJDTr8LCo3b8WU45ZrkaUpG/4IVbKuAKvpOeGXLYE9qauoJ2A SP1+PvniFlsZO41flUn2UpY8hOEMSYEqitUlHZOqHBEYIGRMkogcv1geSCtFuc5Ycwi1 doOhiYqG3uWrHWmPP4k6PuphGuqjlEaIlVENgfyo3Po6Ug565WaaX9NSQkVqYwgDgccR Bl0IUZfQJxZoOqSTcYrRubZGcUeLB+AfcMKszD03yS1zs6Qc43ueGtIJrrOFd3y7zkEP TmCQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694699174; x=1695303974; h=content-transfer-encoding:cc:to:subject:message-id:date:from :references:in-reply-to:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=DQbnGYGC1tWpJ5gmQaVkx06bk3fBiDHM6OlO+9oCV9U=; b=ujirS33B7qSS0703G8+PS8RSdZe1GgjkDCoiQ0DOddF3kY7zZpI3RGHTpEba7L+Rd0 rfQNkNBkzvm9DpPKWLzQXrPLOA8UDdYH87/ySHDqfRN9SSd9i/Gf8JOmExcQDDTAUtfL hkeqwStPhv0bHEwz2HU+Qb54igGmovHcAsZCVgZS4qrPKTOsnKnrdiKD0Z+dsMJp7vjm 01oYLi+CFZr49nsmfhZXJXHsEaJ6/Jg5cTTom2fsLuwxP9GhgfApIoJrAqqQUSLrzg9M mH2X1qf1gMvhE3OaNHR+yurPuk9BLuM//aefmTrICuFj3jhU+w2vqSDymfWBC3SFYHgd HHgA== X-Gm-Message-State: AOJu0YxIPNW8qBVQo9Eg/HJUiwmUkcRkWiJjqDgjWv1SeCuDteA5BJSp hFc6vd7hGRoeJMmlCWAs3o+kN0SNcHyxeRqBVLYf7ot/ X-Google-Smtp-Source: AGHT+IHKXmaFN3hmiyFxmcbdPmAm+4eA1dWCSSASy3n1x7WnaOrrmC5XFIGi41T1PC8qpS4RvfeUjjb7zkAGpcLLJ/s= X-Received: by 2002:a05:6870:9111:b0:1cd:249a:690c with SMTP id o17-20020a056870911100b001cd249a690cmr5959150oae.20.1694699174368; Thu, 14 Sep 2023 06:46:14 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Received: by 2002:ac9:5750:0:b0:4f0:1250:dd51 with HTTP; Thu, 14 Sep 2023 06:46:13 -0700 (PDT) In-Reply-To: <1D86A8FB-ACC6-427E-ABB0-2E1A5989170E@FreeBSD.org> References: <291ad2de-ba0e-4bdf-786a-19614eacec49@gmail.com> <592123F4-E610-446E-82B4-ACC519C0BA3E@iitbombay.org> <1D86A8FB-ACC6-427E-ABB0-2E1A5989170E@FreeBSD.org> From: Mateusz Guzik Date: Thu, 14 Sep 2023 15:46:13 +0200 Message-ID: Subject: Re: Continually count the number of open files To: David Chisnall Cc: Bakul Shah , Graham Perrin , FreeBSD CURRENT Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.83 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.83)[-0.832]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c2d:from]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_ALL(0.00)[]; FREEMAIL_CC(0.00)[iitbombay.org,gmail.com,freebsd.org]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_THREE(0.00)[4]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rmdrl477bz4Fct On 9/13/23, David Chisnall wrote: > On 12 Sep 2023, at 17:19, Bakul Shah wrote: >> >> FreeBSD >> should add inotify. > > inotify is also probably not the right thing. If someone is interested i= n > adding this, Apple=E2=80=99s fsevents API is a better inspiration. It is= carefully > designed to ensure that the things monitoring for events can=E2=80=99t ev= er block > filesystem operations from making progress. I'm not sure what you mean here specifically and I don't see anything careful about what they did. >From userspace POV the API is allowed to drop events, which makes life easy on this front and is probably the right call. The implementation is utterly horrid. For one, the non-blocking aspect starts with the obvious equivalent of uma_zalloc(..., M_NOWAIT) and bailing if it fails, except if you read past that to actual registration it can perform an alloc which can block indefinitely while holding on to some vnodes: // if we haven't gotten the path yet, get it. if (pathbuff =3D=3D NULL) { pathbuff =3D get_pathbuff(); pathbuff_len =3D MAXPATHLEN; where get_pathbuf is: return zalloc(ZV_NAMEI); So the notification routine can block indefinitely in a low-memory condition. I tried to figure out if this is ever called without other vnodes write-locked (as opposed to "just" refed), but their code is such a mess that my level of curiosity was dwarfed by difficulty of getting a definitive answer. Other than that it is terribly inefficient and artificially limited to 8 processes which can do anything. That is to say it is unfit for anything but laptop-scale usage. Perhaps you meant it does not block if the watchers decide to not process any events, but that's almost inherently true if one allows for lossy notifications. > I think there=E2=80=99s a nice design > possible with a bloom filter in the kernel of events that ensures that > monitors may get spurious events but don=E2=80=99t miss out on anything. > [snip] > I think the right kernel API would walk the directory and add the vnodes= to > a bloom filter and trigger a notification on a match in the filter. You= =E2=80=99d > then have occasional spurious notifications but you=E2=80=99d have someth= ing that > could be monitored via kqueue and could be made to not block anything els= e > in the kernel. > I don't see how this can work. A directory can have more inodes than you can have vnodes at any point. So if you add vnodes to a list as you go, they may fall off of so that you can continue adding other entries. But perhaps you mean you could store the inode number as opposed to holding to the vnode? Even then, the number of entries to scan to make it happen is so big that it is going to be impractical on anything but laptop-scale. What can be fast is checking if the parent dir wants notifications, but this ignores changes to hardlinks. Except *currently* the VFS layer does not reliably track who the parent is (and in fact it can fail to spot one). The VFS layer contains a lot of cruft and design decisions which at least today are questionable at best, but fixable. A big chunk of this concerns name caching, which currently is entirely optional. Should someone want to propose an API for file notification changes, they need to state something which if implemented does not result in unfixable drag on the layer, even if initial implementation would be suboptimal. Handling arbitrary hardlinks looks like a drag to me, but I'm happy to review an implementation which avoids being a problem. That is to say, a laptop-scale API can probably be implemented as is, but solution which can provide reliable events (not to be confused with reliably notifying about all events) would require numerous changes. --=20 Mateusz Guzik From nobody Thu Sep 14 14:34:21 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmfwZ2xzWz4sTnj for ; Thu, 14 Sep 2023 14:34:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmfwY2107z4Nqw for ; Thu, 14 Sep 2023 14:34:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=aoQKe9Q5; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694702075; bh=D4FBVWoN+XcugFrrbTd2xObj1xd1Kv/okUXaSClpT14=; h=From:Subject:Date:References:Cc:To:From:Subject:Reply-To; b=aoQKe9Q5PAcISANhh2FfPB2Fe8Da6pmN8TL1jjCYqP3OpGn5/k93Zo0Y2ci/PCr+NJ+w6mPRD1SihVooCGHK8PFEXilgPHuHvdhr/FpMuCHFl4IWl8fo3F5YkzVKs14Dg9A1fMI9x+KWk1l5YpNlR9B3Fkg+NHyLpAzrmxl0MR7BBTBm5U5RIa0VTxo7Iutw1hbuhwlB2Vgr2YxUUBK48bMSgA+dhqCB+89JMCNvI/s1nW8zWQkt4OIiXYGnVnwvsiZNgaOY9j3/nQP0/Fh3iOlDARlqZIQ4MYfCJZ0dtQDwg5g2l0Luvnu3+gqhUfD9WLb+zG8KetUZwcIBW8HqHA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694702075; bh=aO0shoYe1Xp3LXkrDZu68ENc16LCjUktDtMF/eibbcL=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=SQh9jiV3tKD2nDdVLbs4d8okeWzzEe881tgKQZcpkMHueF6zeT1aYhiqDSX3yyrOIYjLFgx3AZRll8VbjUyQ5VsOtlLIDi0wuRPMtCcag/4dMHaC0oQ2yIhvQQ0h0l4LHNUMJp4Wbxa3bKuGi9Dyk+ApFw63u29070NucUse8fK0v32ij+wwhn7PR+MyVTGZ3Gws5VKT8k6RDoUxzRo+0EPz/WTzObVkRA+gp65gyje2CgUgXr8fqzZi93HMeEO2DhOxtSTFPQnv97SO5nVBjBCmFq1GgerzHtNEbS8M2B7UDO+RV1mLQ5NuvGeDlv6/jnOZQkINealhGvpjH0Tp8A== X-YMail-OSG: qkFI9WMVM1mLCNT0IOLGBv3qIVR1zRI2LdoXoefLSbRoITUyaInlwpm97PaWli. jqppktmdGbnhvfUc7DMNSaw5aTVnoAnCBuL1mg1W4LztwjYjcDemGha7QUDTe_JK5DMGr4ukDuJE cNCS71fo2x4CuSpSlD1fSB7xw4dHMXBnIotWCJVLQ0KSXluqqqK0wlOwi8sDucs87o9uXXpzdP1i .1BPosgocFPowO9qBqbxqVxPfyMcJ8tgURDFyzes5hdRvwP_dhXlWLhwI504KqN_5bxRLGUGvuFS _GXFHcwsfZkXhVnG1m1Zx5sxSq.KAFBWLCy4BAtvEUUKe.LLsP4Boaur6h2Uzni3XX2pm5f2bUZS ziE9qOQOtJGnylekQ4j12sRQ1fXx6QSB9qM8pZxa5Sx739mBfJFmdR5kIP69RVldH_bOCp_x8Zmd aA1R36v.s36VTRwGDspy0K6_wRcI8jApc2EyyUsP6pMFlLS3HYGTRyXN3clQQ07DebP7qOZwlJSz gYwyav.y8E8DuADqc7Esp_2wuZNyIQFk.vELm4f27zc_IWPtDVQ9pcOSNfcEz.ziWzB6SvmnCFF9 6ALPxoQW.UxYqFyWYjMlOxB9EO9BpKpFAfp6dqukshLGnGeq9WRnVMfN9n.LGpr465Wj23Xr4xnV aKlORLO6hKBAAsG6yxP9xDZt20xQKa5SRK1qPlIm53uWetcFkxMHxf1ivvd9ujsOE_jz2T6dxq5r ePcJpnHaOtRduN8Fx6E.PYwXYk53cz9DYY4.eXckB5k4JvU2DYV3nPZ66nvf3P8XU.5Kxh91nGD_ 5trOrWqhmj5kS5372.W0Nr3UQIhRodA8VgbJl9Q8edjWOYHya2EU1wqMgl2vJvbEkRba76YSjYA2 CaFcLZpPD5tldnYmZt1ATpDMuZWQInTwEU.pjxmQhWctF.vtQQ369Quemv1xCDO.7bHkvwjkwNvx qhN3Nuns4yB58IS5lo0KJLietQBxXvysWQjnVwf15V98DOQCXBrefO5MblADsfabHWjCOqEE4xub XPV62UKcBrUCLOGvHWWnONw7.0PTYTN4X0vHmsxhwsvfxTjQI_TWnSliac8YEcb5WPNDi4Fg15S2 gZ3dNFoiMmuG.mjPwp22oU5Yid7HdRro4jfgcZ53AFVPNWnud1gwsqFVhvN24RF6ZioXZtUMJvO6 PsyHei5RbUgtjiAuj6ziaICIZDnJ20JbH9Nk00ErcCM.sEr94FdAkz8Y7XY9NaBbxEpwSNWY_ShZ Lz0jqTrBec1G_zIsKTiXxXN8W3NZD4lvAe7GVrn0px4ZQJI6V_k06r4U30cnbIuxLejp7ncLev7B Alhjp07RaX7Kzi.Fs8COvPtxzsn8qPGvUgEE67J.2fpRgMjH0WXC5RP30JSWtFS8KZ0ImhCYEYXR dflWiFZ.vj9FJ9kSqbrRWs1p1ts6qPxTEFY3ob_Mbo7EsN7vEa5WrixiFLqn9eslWTe0h.BDjmT4 98.lTTugnWFsNrz_Y5f384voR6Q4ljiwG1SXfWqvrIKjVwzLdXpJ0xMS6F8kqbWQi12kU_Nf2liI 9eCHYmW4ftKyh31UNaa7btGh1H0sG8wWmW67CeeRVYs0pptBvlGbQ3B7ZQgOE_KXVgggOKCWn_Hc PxqoDo4mkhjGAr5IgU4Pd9Bthe3ludan5tNYGSGxz7aw9Dg6_4TdtJ1eVoBV6Bjd0ck9_bSnFv_k I09KZsqdPlqzvYpp4SJY_nFefGDHhJeaXMe8vFBmzdMMY9QYyX4hx2ytZrS9uqRm66ltoX_xEkQW zk4LkrHNW4xkVGTBko6JxiqD.OwLjX1HtlA6HZuMJXDj_ItdP7gKltT1d2L.25TaVr.p2tmcoxDy or2SbThBUjdJ.8jnXJ313ksg1BRvk5pZU.2721_2Zhx1QP94bNb0YGjIVpVXWuJMWimGQEn4wPdx o6DMQbKx28EH65WCXPWBztEO3J3TVaWL9Ey91VRjax_fUHNk3Nc8jiuozGiP1q646qgAXa8x4Mvu egA4IXpLwpe4.qyW7aEAc0zcr.CRodpgkfUWatfZvtycB9Snlx6egHYzJlD0C2i1OeeYm1CpuNWk JUVqZ6o4x4fb0__G05iH7C1MtJ.qUxU8vwjqyeVVd6eomnCmUTZG4Pymj6OlVGakJDufrTvbG2wp l808Zd6BXCceqqXbNwKhOzG9Mdjvcr1QvbomY0j5UmK1S6k2l1ZDKw4HXjwur.fEQEntNBqNyJWt kVDQc8R39.ZCE4sm3lZzp1Uaut_bOhAJyZDttzBbgs9RyUtF.GthLSLmU8tKvuO6dCrOMDW3lCLB mUOCZPvqS X-Sonic-MF: X-Sonic-ID: 4614b549-ccec-4405-b38f-194c6c329dae Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Thu, 14 Sep 2023 14:34:35 +0000 Received: by hermes--production-gq1-77657878bb-wlcsw (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 7c3f476af6c1f68121d8c6c1a7b1f713; Thu, 14 Sep 2023 14:34:32 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Fwd: git: 8d49fd7331bc - main - pf: remove DIOCGETRULE and DIOCGETSTATUS : net/py-libdnet and net/scapy now broken, kyua test suite damaged Date: Thu, 14 Sep 2023 07:34:21 -0700 References: <9A0C699C-78DA-4EB9-945D-A7C3B29EF31D@FreeBSD.org> Cc: Current FreeBSD To: "bofh@freebsd.org" , "eugen@freebsd.org" , FreeBSD Mailing List Message-Id: <56BB4EAF-E9C8-42E3-A7FB-3F6988D745B0@yahoo.com> X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.31:from]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RmfwY2107z4Nqw [I've cc'd a couple of folks that have dealt with fixing breakage in the past.] From: Kristof Provost Subject: Re: git: 8d49fd7331bc - main - pf: remove DIOCGETRULE and = DIOCGETSTATUS : net/py-libdnet and net/scapy now broken, kyua test suite = damaged Date: September 14, 2023 at 02:02:38 PDT To: Mark Millard Cc: Current FreeBSD >=20 > Hi Mark, >=20 > On 14 Sep 2023, at 7:37, Mark Millard wrote: >> This change leads the port net/py-libdnet to be broken: >>=20 >> --- fw-pf.lo --- >> fw-pf.c:212:22: error: use of undeclared identifier 'DIOCGETRULE' >> if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && >> ^ >> fw-pf.c:252:22: error: use of undeclared identifier 'DIOCGETRULE' >> if (ioctl(fw->fd, DIOCGETRULE, &pcr) =3D=3D 0 && >> ^ >> --- intf.lo --- >> for (cnt =3D 0; !matched && cnt < (int) entry->intf_alias_num; cnt++) = { >> ^ >> intf.c:571:2: note: previous statement is here >> if (entry->intf_addr.addr_type =3D=3D ADDR_TYPE_IP && >> ^ >> --- fw-pf.lo --- >> fw-pf.c:296:28: error: use of undeclared identifier 'DIOCGETRULE' >> if ((ret =3D ioctl(fw->fd, DIOCGETRULE, &pr)) < 0) >> ^ >> 3 errors generated. >>=20 >> That leads to: >>=20 >> [00:00:41] [29] [00:00:26] Finished net/py-libdnet@py39 | = py39-libdnet-1.13_4: Failed: build >> [00:00:42] [29] [00:00:27] Skipping net/scapy@py39 | = py39-scapy-2.5.0_1: Dependent port net/py-libdnet@py39 | = py39-libdnet-1.13_4 failed >>=20 >=20 > The commit removed those ioctls because they=E2=80=99ve been = superseded by newer (nvlist-based) versions. > Ports are strongly advised to use libpfctl rather than trying to deal = with nvlists themselves. >=20 > See = https://lists.freebsd.org/archives/freebsd-pf/2023-April/000345.html for = an example of what the ports will have to do. It=E2=80=99s generally a = trivial change. >=20 > Best regards, > Kristof =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Sep 14 15:11:02 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rmgkw06xZz4sdsG for ; Thu, 14 Sep 2023 15:11:20 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-20.consmr.mail.gq1.yahoo.com (sonic317-20.consmr.mail.gq1.yahoo.com [98.137.66.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rmgkt65HYz4cV9 for ; Thu, 14 Sep 2023 15:11:18 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ZcTBCSO8; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.66.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694704276; bh=Olq4ASIGLE7QZZHPlIdCccQdXHFlisVPbYkl/FFD2nE=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=ZcTBCSO8l5BxbwMwgAcdpiU5q2s1NLJxsyTBGF+0i4cRBlAWt4D3XU1qymOxRPcRBNLklDROTpPYj6GldZA8WtGJPX/WnjCwg0xyIxQs7FI8S3G90jrxoEn7fKUi3y8WEaD5CB8BQ190ezWl1s2jE23lMWtaqn0P30LpkYgSqq8Tc8Orsz0aBc+NGL5Zyfgpd7gmsfc+ZSIHTGSHkkGcwKaEoHexP9P6WxBE3z6pc3PFsZEe0vM+ZPC4HSKTGK2JZVz3MbYUo9zjFHLwVm1elsa1Zns+RmqUeQtrcbg5RjIRL8VbwqG1VurXTxQ/K+s2EJbReeOQ1BpupgeftGRS0g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694704276; bh=QbgC4G8YvCs5eHwCVUOcfnxYxc1CSldr4lm240zKjZZ=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=XZMkGFSnP2axSqolVx6gGgU7F2NhGWOIlWiYwmOkxiusn1WnMxWwSNa8Hau2lrxYt1guYs/DBRjyrm16mjCsEv8aVj0nUkJtSyWTL70RULmvq7BCSV5QtevgaQ5SmMb8Ut3T4YMD9gq6aaL2XwEGjDc2c1sw3N+Bj3AZOhmj3fjZeB3IXwouWp4DSx0qxWjPVbRiseiGz7WNtUIy5DOIU5YVL041x2LSb0vIYADnFDl8f/+pz5xw0bGfwuTuxf0RQBPgPhIOt1wNnjsRtXaj2Gmfx4waKR8XMJXO/l4N/FNjB5BkxrrFCY8NOjaPF6cGziKME/fyGPMvMIdHp0dajQ== X-YMail-OSG: cXIlUHgVM1lpcaKuQUOIUzmzNKUoM85iA7M9JtUZEkyXZwPuHCOaCje1VKrRqvx T2p4kxfhxxwRmOvKjd0n8WdaDirRBZy4RS0dvB_HKtOA8Q1myEfrHyeIiGW4RQEiaiD3tvcmE08f vzZAXYjD7JAVEN4slylt_xSD8l_g1Q5wx7OZDRZxBPZkbqoBK.Lviw6RI16nSD1w855_7sTOQBZV RE5Qy3oGWEgqSpDVpGRYgdbdSm4tf4TY0SN4giH4o.e6rzqBXr8HcPiKdaT1sKEtf4vYFpRBWllL 7Sq8cRl.c83JJZuNY4qfjOIc_9WyMMhNA23y1i9.DOCkPt53dqAUxL0pWcHjueTyOCOonYmpnlWl Cl7BJUL_CAZwU13eRf9oZXpgZpnWbQ.oSb.rKB14LOcRRdRIuYZ6hh9tVR5eS_QZkpO15RxultSF DboLuJQ2QJPwPtstsZxogr9mhSij.sEaWJaTfBNdzCJFkDkXdmkANFoEtCJ2BMjJHDAMygqoDKiZ oCZvV9uNUsA3LHSXpHgXwp9gy9_EHgh6VcePcNee3NIs88RlWQ1R7zN_Cu7eoUXSOqmUw5ftyZkW UGqH5FI0467P1yL89FEDNuBp2idgdGI_gqfkpFTbre7mU2eLh.1piSLyilMAxfIA0_ycOygfH3PL w3jhEEtMLjyHoBQ_PQontjXwNAZTU.Fy6GjLn7xjgEzzY5OurydMqjIcCOrqIZyf0ftwGITjdpWa n1cbFs2w48nsKAR3SDmTLGVuPbzz3rJIc2XWSEWzQTFSwVxVqzXb3h1QjCPfbn9GFxcgDo3lxudt kxDAFSZ7I4xCVdHdX06XarNImwNJFl2QyyIz_6Tn371jApEw5.sybxgI_.m31tjH71EMjv.V2gZA 3wxHj1QS6qfDPP2xa_iEplei6JqKw36tGAw1NpDNZ0K4qgxBXFNpZwzDUStRBweYULgK.8ytF77s ANw2sQe03i9YJp42DGThl7FgzhOpzI7azryAx3qoNYFe_qmA7myDdzCmIStUQdMysdiO5ya1ma.W kRs677w0pUwQymT7IcjXQJAE8LWfSyfpE_dQUxHZyvuhosSSgw6j7iSGkhGyhDWhZTbOAjVFrRLA aGQAvQCokquccWulxL0EvpzvDFlJfjlprx1LWpKKo.EqRNKXv7ykQSobL1FstXkH.MiVdpzweFLH 87uP0zMq.5SYJ4v.q_yHScuDtIzPWsVqRiucdQ_lNI8xT.J3VIMNM2zqX0OqG1rvEWn9PzQAscBX .13HR3JTExB3EeXzE.65St.h2K0aNIdhPlMke56CnE.niJ2jONg0CF8b5spzRQc9Z1J1e0C74E1r LYXJYr6XpZUTseIL_6M3wZduR8vQVvzDNra85miQ5LFMsG8YrLk4GlT4AufdoyeLDYXiefzHHRXC ObydW8NiUzG7DLk5m9plgtu5hFinIUKOpBI1nqFTYwKhi3Ti7NHGGLnxAgyIJC_MnCQTQD8qQLat oayP6kx1uyBfiDAfgPfAGog06Wo03ntBdUERV2w.MBP7Z4lQCRlC3jCita3Se.Oni7BdG.50tP62 W5CkYlXtHoSW7.ZtKBqIfhp.qvFd8F_Iy2MN3FuM8dNQoXHJ.L1wMj1xgW.hxDz1L7N5PKjZY5H8 jOk3qWMBA11EsSFftnvwf2OX4M4xZRJsz.JHAUCE5RHf_PhCsx2ZiRrx_SNdhh6FFveY10sHelmc 3StPjJZubWvxBPmLBFlmApNt_JyqECT54aquZ9fsoQbjXKEmqVE_Pso2X4dpt.UZIPqKwtOizq96 m4YcMgDT45LrWdnXHj3zuPNPNnzq6X8ASCYritCcnI7UErquimNcNO4ZbHN5GrhZkLM0__NnxrU1 8Xg41dTJvSZ5G4IGkFJLk41QkvWjxJQ9GuYQ72Gv21cwYO8Oxf.J57CTv3RXbrJbdoURdpZZ.2.s KrIfbzdEoh3nq3j_XOn5lmXfcskAx8dnoAcOXsehAT1Apm5_EU_96M9oJmvRFN2jmrwozahlS_8g 05uNDOS5dgzMecHMT7.2OCcMnAw8kLtiS3WDZiovUFUxX.iBHKOJRvzEeYXGEha1dTINhgvhd86k BMyW6p7u298oV3L0dSYWtc4Ed9JLiiSqBntv3C9H8SngR3VCXXyTo_8OASYxBlAiEsYG5nWD2DoO rI0P0YYY6B93k1Vx8BWvKcLUMUGxXCKJw3XIAsv1AkMgR3Fh0cAarg.urfJPHafnRa3ocBkG1NPw F8h8nm8aaxyx0uXEm2s_ZjUDE2xe.mf8ZfRXyOhl.3RGU_lMvsCXwYAeuY.bherbdz2ch1W7lrT9 J X-Sonic-MF: X-Sonic-ID: 09ee3cf0-8f8a-45da-8014-6872d03ef9ff Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Thu, 14 Sep 2023 15:11:16 +0000 Received: by hermes--production-ne1-6cbd549489-fvhzw (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 8c264cfef135ee8efba4f3fe0ee6109a; Thu, 14 Sep 2023 15:11:14 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: A lock order reversal that I've not seen before (zfs and tmpfs during poudriere bulk using USE_TMPFS=all) Message-Id: Date: Thu, 14 Sep 2023 08:11:02 -0700 To: Current FreeBSD , FreeBSD Hackers X-Mailer: Apple Mail (2.3731.700.6) References: X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.11 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.61)[-0.608]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.146:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.146:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rmgkt65HYz4cV9 I've never figured out how to tell important lock order reversal notices from unimportant ones. So I mostly report only unfamiliar ones. (But I normally do not do poudriere bulk builds with a debug kernel in use.) During a poudriere bulk that is using USE_TMPFS=3Dall it reported: lock order reversal: 1st 0xffffa0027b7e83f0 zfs (zfs, lockmgr) @ = /usr/src/sys/kern/vfs_mount.c:2240 2nd 0xffffa0023db44070 tmpfs (tmpfs, lockmgr) @ = /usr/src/sys/kern/vfs_subr.c:3886 lock order tmpfs -> zfs established at: #0 0xffff0000004d7824 at witness_checkorder+0x304 #1 0xffff000000435bfc at lockmgr_xlock+0x50 #2 0xffff00015d0ce814 at null_lock+0xb0 #3 0xffff00000056cdf0 at _vn_lock+0x54 #4 0xffff000000557170 at vflush+0x12c #5 0xffff00015d0cd6b0 at nullfs_unmount+0x40 #6 0xffff00000054c318 at dounmount+0x714 #7 0xffff00000054bb94 at kern_unmount+0x298 #8 0xffff0000007fe6ac at do_el0_sync+0x520 #9 0xffff0000007da110 at handle_el0_sync+0x44 lock order zfs -> tmpfs attempted at: #0 0xffff0000004d7fb8 at witness_checkorder+0xa98 #1 0xffff000000434140 at lockmgr_lock_flags+0x1ec #2 0xffff00000056cdf0 at _vn_lock+0x54 #3 0xffff000000557170 at vflush+0x12c #4 0xffff0000003964d0 at tmpfs_unmount+0x60 #5 0xffff00000054c318 at dounmount+0x714 #6 0xffff00000054bb94 at kern_unmount+0x298 #7 0xffff0000007fe6ac at do_el0_sync+0x520 #8 0xffff0000007da110 at handle_el0_sync+0x44 It happens to be on aarch64, in case that matters for some odd reason. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Fri Sep 15 00:00:24 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmvTN2Q8Zz4t6xJ; Fri, 15 Sep 2023 00:00:24 +0000 (UTC) (envelope-from salvadore@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmvTN17grz3dCS; Fri, 15 Sep 2023 00:00:24 +0000 (UTC) (envelope-from salvadore@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694736024; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc; bh=uxm8M3vDBP5+TYcFpoGJwp4tMFUO7XjSZkedYQJCFpg=; b=MKDkhCCFKpPfCVv12x/YbjT/KdHrCGN7GnpBF3MzJA5lCm9axS/fvZy5UI+EbTOKEvwAdu /4gGZVn9kgkCk/FMGxv05vmSDFuUgAdrfCaxlWopkmk7YW31g/KDVrQ7RK8cs2JpIa34AD LzStcBD+N0dM62e2wmpaMRVg2ZEjJDy9X6LhLbT8fuItbunAfOatCTE8j1QYt25jSxbjtD U7WqFyVRruongsbf2QUlFoyyMIa8jFTB1R0PZttOQoMugr4+lSmmjGQQmLfbGzPT+0MdCL 5dIkyRuoXC1Md9i4O9u30ozPi0C5OAGHsgg3yAF7rEGegefG2BV+i+Z5JIRrcA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694736024; a=rsa-sha256; cv=none; b=Ny3gv9ZLge4Mkjc9y4u0Liu0MfnYgANXOm52VSgeLNAg3gRbI97LpNguinCM9co2PoP0c0 wP57XC1svKkx0+0Ed6HS3uGWnz9YcEA77LEUMmqTMJUyji5jRwAWBbN3sm4dLeGxw6LQy0 ODVNJ2jWycp4dt+1P//5CLCWx/ZEuJs/+IAAvZ3SwpQxyQFdA9uBBQPM8TaDy7ldGkoLfR uj8AKKwDwbV1MOTRgDTg1LWW9cU+OEbsxtNfX06DRqwJDabAh1fMyuj33Ceb3SlEDW9u2/ DEdtlaRG3ah+YuJZa5n7i6NYSaH8+B0KozSVFVWE3k1TFjNUdrQIZlkf9OHbCg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694736024; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc; bh=uxm8M3vDBP5+TYcFpoGJwp4tMFUO7XjSZkedYQJCFpg=; b=XZCD9h8vCXNJHQ67m96uBcNBV87qlgZlXwAa2EhjDbRiXaNcQYxOluRYjD+C2YS8b8Ynnd RbcB7mstgxpwPWmAB+oRXlACBEE+rUMgCObqP2ygG5JvMY+Nf44sVK4chnPVeJLxlHD/B4 DaXJ8MoJzmiMMA0DUFW+sFa1EhDaToHrQk+g7KrKVhpGvQxd6GS4fcJg/DippIax6oyzcD wfZx5hL9l4jq5vourT13H3N88r9rYR2BH0TgGbJ/+pkpU9uANOWWrhLOuKXraarfA6tL4v J8FghED0ihwCc0Ad2XPovfVh+cPPQptlvUJrQPwzqKqZh+8PKOj/ENG+ywLgRw== Received: by freefall.freebsd.org (Postfix, from userid 1472) id 18201DF7B; Fri, 15 Sep 2023 00:00:24 +0000 (UTC) To: freebsd-status-calls@FreeBSD.org Subject: [2 WEEKS LEFT REMINDER] Call for 2023Q3 status reports Cc: freebsd-current@FreeBSD.org,freebsd-hackers@FreeBSD.org,devsummit@FreeBSD.org,soc-students@FreeBSD.org,soc-mentors@FreeBSD.org Message-Id: <20230915000024.18201DF7B@freefall.freebsd.org> Date: Fri, 15 Sep 2023 00:00:24 +0000 (UTC) From: Lorenzo Salvadore List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Dear FreeBSD Community, The deadline for the next FreeBSD Status Report update is September, 30th 2023 for work done since the last round of quarterly reports: July 2023 - September 2023. I would like to remind you that reports are published on a quarterly basis and are usually collected during the last month of each quarter, You are also welcome to submit them even earlier if you want, and the earlier you submit them, the more time we have for reviewing. Status report submissions do not need to be very long. They may be about anything happening in the FreeBSD project and community, and they provide a great way to inform FreeBSD users and developers about work that is underway or has been completed. Report submissions are not limited to committers; anyone doing anything interesting and FreeBSD related can -- and should -- write one! The following methods are available to submit your reports: * submit a review on Phabricator and add the group "status" to the reviewers list. You should put your reports in the directory doc/website/content/en/status/report-2023-07-2023-09/ (create it if it is missing); * submit a pull request at . You should put your reports in the directory doc/website/content/en/status/report-2023-07-2023-09/ (create it if it is missing); * send an email to status-submissions@FreeBSD.org including your report. An AsciiDoc template is available at . We look forward to seeing your 2023Q3 reports! Thanks, Lorenzo Salvadore (on behalf of status@) From nobody Fri Sep 15 10:09:29 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rn91N5MFJz4shjf for ; Fri, 15 Sep 2023 10:10:32 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rn91M3FrQz4kX0 for ; Fri, 15 Sep 2023 10:10:31 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b="X/QwiLlz"; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 2a00:1828:2000:313::1:5 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1694772618; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=YY4vdbKi+wnZcGrHjOF2idrZ/rWxkDKcTqGgs1JsmDg=; b=X/QwiLlzbm6j/Y2dyRUEIzUBnj46QCbkNjCaAURXifpfhf0fgRtKKCgE+1PCQX2BgkCX3b 77uHqBOlgPO2zQOT5SLXBIkPzspnGAQmx0iMYDv3rE1SGvR4rqomSXGXcTNuautkNqDLBU XwehCUCEPRRszTS4T87qcYjukq35dguTxP0kxfCBt9NZHumwiwkVtmWAS1ffMGBfPxuNk3 iEjTsee0azy52kYfXaC6pjNQyGd/XzJ3Ozmt9oHkslXwYdtii5KW1bKLYBlyMXcFIAa1NL uhKcp9zyVYV9QBFBbTWP1mQhO8VfRYN1kARfR1lOD6Io2v+dFYjBKndW7gi0PQ== Date: Fri, 15 Sep 2023 12:09:29 +0200 From: Alexander Leidinger To: Mateusz Guzik Cc: Konstantin Belousov , current@freebsd.org Subject: Re: Speed improvements in ZFS In-Reply-To: References: <88e837aeb5a65c1f001de2077fb7bcbd@Leidinger.net> <4d60bd12b482e020fd4b186a9ec1a250@Leidinger.net> <73f7c9d3db8f117deb077fb17b1e352a@Leidinger.net> <58493b568dbe9fb52cc55de86e01f5e2@Leidinger.net> <58ac6211235c52d744666e8ae2ec7568@Leidinger.net> <444770b977b02b98985928bea450e4ce@Leidinger.net> <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> Message-ID: X-Sender: Alexander@Leidinger.net Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_b9e4cb8aef91aebe3093101cb46b82bc"; micalg=pgp-sha256 X-Spamd-Bar: ------ X-Spamd-Result: default: False [-6.07 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.972]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; R_SPF_ALLOW(-0.20)[+mx]; FREEMAIL_TO(0.00)[gmail.com]; MLMMJ_DEST(0.00)[current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FREEMAIL_CC(0.00)[gmail.com,freebsd.org]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; TO_DN_SOME(0.00)[]; HAS_ORG_HEADER(0.00)[]; HAS_ATTACHMENT(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rn91M3FrQz4kX0 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_b9e4cb8aef91aebe3093101cb46b82bc Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2023-09-04 14:26, schrieb Mateusz Guzik: > On 9/4/23, Alexander Leidinger wrote: >> Am 2023-08-28 22:33, schrieb Alexander Leidinger: >>> Am 2023-08-22 18:59, schrieb Mateusz Guzik: >>>> On 8/22/23, Alexander Leidinger wrote: >>>>> Am 2023-08-21 10:53, schrieb Konstantin Belousov: >>>>>> On Mon, Aug 21, 2023 at 08:19:28AM +0200, Alexander Leidinger >>>>>> wrote: >>>>>>> Am 2023-08-20 23:17, schrieb Konstantin Belousov: >>>>>>> > On Sun, Aug 20, 2023 at 11:07:08PM +0200, Mateusz Guzik wrote: >>>>>>> > > On 8/20/23, Alexander Leidinger wrote: >>>>>>> > > > Am 2023-08-20 22:02, schrieb Mateusz Guzik: >>>>>>> > > >> On 8/20/23, Alexander Leidinger >>>>>>> > > >> wrote: >>>>>>> > > >>> Am 2023-08-20 19:10, schrieb Mateusz Guzik: >>>>>>> > > >>>> On 8/18/23, Alexander Leidinger >>>>>>> > > >>>> wrote: >>>>>>> > > >>> >>>>>>> > > >>>>> I have a 51MB text file, compressed to about 1MB. Are you >>>>>>> > > >>>>> interested >>>>>>> > > >>>>> to >>>>>>> > > >>>>> get it? >>>>>>> > > >>>>> >>>>>>> > > >>>> >>>>>>> > > >>>> Your problem is not the vnode limit, but nullfs. >>>>>>> > > >>>> >>>>>>> > > >>>> https://people.freebsd.org/~mjg/netchild-periodic-find.svg >>>>>>> > > >>> >>>>>>> > > >>> 122 nullfs mounts on this system. And every jail I setup has >>>>>>> > > >>> several >>>>>>> > > >>> null mounts. One basesystem mounted into every jail, and then >>>>>>> > > >>> shared >>>>>>> > > >>> ports (packages/distfiles/ccache) across all of them. >>>>>>> > > >>> >>>>>>> > > >>>> First, some of the contention is notorious VI_LOCK in order >>>>>>> > > >>>> to >>>>>>> > > >>>> do >>>>>>> > > >>>> anything. >>>>>>> > > >>>> >>>>>>> > > >>>> But more importantly the mind-boggling off-cpu time comes >>>>>>> > > >>>> from >>>>>>> > > >>>> exclusive locking which should not be there to begin with -- >>>>>>> > > >>>> as >>>>>>> > > >>>> in >>>>>>> > > >>>> that xlock in stat should be a slock. >>>>>>> > > >>>> >>>>>>> > > >>>> Maybe I'm going to look into it later. >>>>>>> > > >>> >>>>>>> > > >>> That would be fantastic. >>>>>>> > > >>> >>>>>>> > > >> >>>>>>> > > >> I did a quick test, things are shared locked as expected. >>>>>>> > > >> >>>>>>> > > >> However, I found the following: >>>>>>> > > >> if ((xmp->nullm_flags & NULLM_CACHE) != 0) { >>>>>>> > > >> mp->mnt_kern_flag |= >>>>>>> > > >> lowerrootvp->v_mount->mnt_kern_flag & >>>>>>> > > >> (MNTK_SHARED_WRITES | MNTK_LOOKUP_SHARED | >>>>>>> > > >> MNTK_EXTENDED_SHARED); >>>>>>> > > >> } >>>>>>> > > >> >>>>>>> > > >> are you using the "nocache" option? it has a side effect of >>>>>>> > > >> xlocking >>>>>>> > > > >>>>>>> > > > I use noatime, noexec, nosuid, nfsv4acls. I do NOT use nocache. >>>>>>> > > > >>>>>>> > > >>>>>>> > > If you don't have "nocache" on null mounts, then I don't see how >>>>>>> > > this >>>>>>> > > could happen. >>>>>>> > >>>>>>> > There is also MNTK_NULL_NOCACHE on lower fs, which is currently set >>>>>>> > for >>>>>>> > fuse and nfs at least. >>>>>>> >>>>>>> 11 of those 122 nullfs mounts are ZFS datasets which are also NFS >>>>>>> exported. >>>>>>> 6 of those nullfs mounts are also exported via Samba. The NFS >>>>>>> exports >>>>>>> shouldn't be needed anymore, I will remove them. >>>>>> By nfs I meant nfs client, not nfs exports. >>>>> >>>>> No NFS client mounts anywhere on this system. So where is this >>>>> exclusive >>>>> lock coming from then... >>>>> This is a ZFS system. 2 pools: one for the root, one for anything I >>>>> need >>>>> space for. Both pools reside on the same disks. The root pool is a >>>>> 3-way >>>>> mirror, the "space-pool" is a 5-disk raidz2. All jails are on the >>>>> space-pool. The jails are all basejail-style jails. >>>>> >>>> >>>> While I don't see why xlocking happens, you should be able to dtrace >>>> or printf your way into finding out. >>> >>> dtrace looks to me like a faster approach to get to the root than >>> printf... my first naive try is to detect exclusive locks. I'm not >>> 100% >>> sure I got it right, but at least dtrace doesn't complain about it: >>> ---snip--- >>> #pragma D option dynvarsize=32m >>> >>> fbt:nullfs:null_lock:entry >>> /args[0]->a_flags & 0x080000 != 0/ >>> { >>> stack(); >>> } >>> ---snip--- >>> >>> In which direction should I look with dtrace if this works in >>> tonights >>> run of periodic? I don't have enough knowledge about VFS to come up >>> with some immediate ideas. >> >> After your sysctl fix for maxvnodes I increased the amount of vnodes >> 10 >> times compared to the initial report. This has increased the speed of >> the operation, the find runs in all those jails finished today after >> ~5h >> (@~8am) instead of in the afternoon as before. Could this suggest that >> in parallel some null_reclaim() is running which does the exclusive >> locks and slows down the entire operation? >> > > That may be a slowdown to some extent, but the primary problem is > exclusive vnode locking for stat lookup, which should not be > happening. With -current as of 2023-09-03 (and right now 2023-09-11), the periodic daily runs are down to less than an hour... and this didn't happen directly after switching to 2023-09-13. First it went down to 4h, then down to 1h without any update of the OS. The only thing what I did was modifying the number of maxfiles. First to some huge amount after your commit in the sysctl affecting part. Then after noticing way more freevnodes than configured down to 500000000. Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_b9e4cb8aef91aebe3093101cb46b82bc Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmUELWkACgkQEg2wmwP4 2IbAdRAAqAbVmZ7tcAbSY6BZzSbNkL+ubmkBYwD+HizeJYQCP8DO5EqHs5WgncqW CCSCkeViIU26JYB3ZPpKWwdT/b29oL8PdSeGvxhHgTLXaicRGbuZr/cSV8exaGX3 WLGeMqrzMRqihztQDEe90uL9RVgMfWkzF+sWALXxLPq7r+LQ7oM2wQr1noqrml3+ 5Oihwnw09rC0uKyaucxSfTZvvNbskCqcedxs5BVgVdkSd2PBKKO1CU1d0j8I86nU aTcMUZV7CGXmIbjfBk89iXe0Bsyl0T0cncyDrrbzappitunNO0AD4E+vP3RY3Fgp CTZ3oqjbG5rZksa17mXTxO65NB75xL/4Prmu06OAjjCGdfU9+4YB2B2E68+562yV hOWTKPtK+8yjDZC4Q2Gz4qDq8KXvBVDQvN9fo7tYFSxFlkpDTq6qAx3i6eI3qWcr O0fKC+BM43j9f1JLaLk+skYCXKiYUtmpKwayK82FQovp4uKcjuujMwiDjAyUn1Oz Yohw8wsPxHBUdUvXC8MxjfVHHD4+kBwPd/RMquQkiQRvbjKoE8ZYHvGkhnmevKeK zsAKj243OqUhX8J72XCi8HaNG0JrVdyb1o6n6dIrJ+ynbXDEQOM3acpcKtULwUDm J0XDBHSIJ4WwHnDvfZJHF8dNFFcs5+M77BATtn+dRdKjfBCCsms= =EU2g -----END PGP SIGNATURE----- --=_b9e4cb8aef91aebe3093101cb46b82bc-- From nobody Fri Sep 15 11:40:20 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnC1F41qDz4t5kM for ; Fri, 15 Sep 2023 11:40:33 +0000 (UTC) (envelope-from ggm@algebras.org) Received: from mail-oi1-x233.google.com (mail-oi1-x233.google.com [IPv6:2607:f8b0:4864:20::233]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnC1F1Nb3z3DtB for ; Fri, 15 Sep 2023 11:40:32 +0000 (UTC) (envelope-from ggm@algebras.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-oi1-x233.google.com with SMTP id 5614622812f47-3a9b41ffe12so1259563b6e.3 for ; Fri, 15 Sep 2023 04:40:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=algebras-org.20230601.gappssmtp.com; s=20230601; t=1694778031; x=1695382831; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=iaAjslgxRu4XmK7+ZP9bpztap1vcdo4A7qfTQpGyMy4=; b=PFCIxxQWrG5AHHaUNx6AeDvVVENDxQPm6qkCJlq+UMyumCBeA5H1IgC7ySOp86BGLE JdfJPcMaqj3UVa3jEF52rMX9hvWr7g5Z/k1wtdfd7th1oEJlghR6sBIRDYGg7OqH0ITw cayUgeMFqXNFspmy/mgud+poHGbHdFI9kffpOjcCuEfiOdyZ0o1ltdoOYR9hDdFkfNO0 3HwS52LkoLq9v+mLUx7ePBXMO0ilw6LhjObd1rFI00gJEeqQfSnJd0KShJC5ja34m6/m ir1uuhHBu26eHbsWEDJlQ6kvNJAQWxKZP3/NiPcOFG2SFQoIfOwWWsj2j6PDek/ryXvO H3mg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694778031; x=1695382831; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=iaAjslgxRu4XmK7+ZP9bpztap1vcdo4A7qfTQpGyMy4=; b=COZt2SCYPCBxfwYyPoCS8okzBNvthTMD2Z2jyKSp2XGmRK7Sy/bPe9xx7cP4wfdzlt RFFcMfvqeWajfPY8DtVaH6ST/r+Uq4Sl/ScIG+hV0cnexxUh3Z/JEbuLwaJGH1ccwKcR 5pm1LqhyJjZH7/cDAJzk86YWiA569lYznbUbrdqcYWHjZ9pn6WEgL4zhtVE6g7vnADUm 0cA2YgV4xvQeRcPKtCoGLkUq01u0vXzj5Jn0jrgH35q/Yj3quKTGLUurmQlT3GiLs9UY wN4MZFwzsZjM8pXIPf1YzrLQqARJZox/E3gGSI0LiJIkX0r2N6Nhg7FCn8W1v7Y1PGAL K/gg== X-Gm-Message-State: AOJu0YzSFIzOCPnH9MlKlq8VE68bMVin3bdDmh3Y5xqb3J12aKToDf3O Ta16oSZ176jGWJREusc5wOybATranXiKj4/ajxGLUA== X-Google-Smtp-Source: AGHT+IFb8AfD17DV8e5udTgU5APM6Z97eK8Z7Qb6EtoT+U2WGxvjPftuHdSx1uNeBJP74Yjx9S35KtZgn8Jf9YHkz7s= X-Received: by 2002:a05:6870:9a1c:b0:1be:ccce:7991 with SMTP id fo28-20020a0568709a1c00b001beccce7991mr1635163oab.13.1694778031344; Fri, 15 Sep 2023 04:40:31 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <88e837aeb5a65c1f001de2077fb7bcbd@Leidinger.net> <4d60bd12b482e020fd4b186a9ec1a250@Leidinger.net> <73f7c9d3db8f117deb077fb17b1e352a@Leidinger.net> <58493b568dbe9fb52cc55de86e01f5e2@Leidinger.net> <58ac6211235c52d744666e8ae2ec7568@Leidinger.net> <444770b977b02b98985928bea450e4ce@Leidinger.net> <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> In-Reply-To: From: George Michaelson Date: Fri, 15 Sep 2023 21:40:20 +1000 Message-ID: Subject: Re: Speed improvements in ZFS To: Alexander Leidinger Cc: Mateusz Guzik , Konstantin Belousov , current@freebsd.org Content-Type: multipart/alternative; boundary="00000000000088298e06056442b0" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RnC1F1Nb3z3DtB --00000000000088298e06056442b0 Content-Type: text/plain; charset="UTF-8" Not wanting to hijack threads I am interested if any of this can translate back up tree and make Linux ZFS faster. And, if there are simple sysctl tuning worth trying in large (tb) memory model pre 14 FreeBSD systems with slow zfs. Older freebsd alas. --00000000000088298e06056442b0 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Not wanting to hijack threads I am interested if any of t= his can translate back up tree and make Linux ZFS faster.=C2=A0

And, if there are simple sysctl tuning wo= rth trying in large (tb) memory model pre 14 FreeBSD systems with slow zfs.= Older freebsd alas.
--00000000000088298e06056442b0-- From nobody Fri Sep 15 11:55:20 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnCM31FnMz4t9RD for ; Fri, 15 Sep 2023 11:55:59 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (bastille.leidinger.net [89.238.82.207]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnCM25JL3z3JS8 for ; Fri, 15 Sep 2023 11:55:58 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; none List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1694778940; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=gz/K573+uN0bGyxFvQctnILdctG72odrEaW5NjYq0k0=; b=DLKDMQ7ZhPO93MMpELJjbeEQMpWojNBPONg0aVocvfoVXqYskX0hG1WQ1fHWzc7PRulHaw 377kOPw2iNWAglR5se0z7DHIrALGjxpHq4wKbRrXYJjmKQKq5Zv4o8qPDDnlG87w8r6Jev PVRQJLjuXNDZw5b6XyxG0gNt7PAxleWumcfjPACNHLt5HpWiRGn6KIMsvbPObMtR+FhwpW RWPMTUd6DGydlFa80f8WohJGhG5miLoyf8ohySXKOtXMh+KHKLBtK825fYXHzIKXKNXuyN HhLrpPeWm6bqj7j6jU3SqFfFBN3obXciCfUUUKqZLFyhtpAte1nxc/4ADcTJLw== Date: Fri, 15 Sep 2023 13:55:20 +0200 From: Alexander Leidinger To: George Michaelson Cc: Mateusz Guzik , Konstantin Belousov , current@freebsd.org Subject: Re: Speed improvements in ZFS In-Reply-To: References: <88e837aeb5a65c1f001de2077fb7bcbd@Leidinger.net> <4d60bd12b482e020fd4b186a9ec1a250@Leidinger.net> <73f7c9d3db8f117deb077fb17b1e352a@Leidinger.net> <58493b568dbe9fb52cc55de86e01f5e2@Leidinger.net> <58ac6211235c52d744666e8ae2ec7568@Leidinger.net> <444770b977b02b98985928bea450e4ce@Leidinger.net> <076f09cc0b99643072d8b80a6ec5b03b@Leidinger.net> <1d0d37f27e4898f1604c6ddc6ad3e831@Leidinger.net> Message-ID: <6107c0b30c80625467ad3d3b10f79be2@Leidinger.net> X-Sender: Alexander@Leidinger.net Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_8c53d5bafc13c998a610677978dffbc0"; micalg=pgp-sha256 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:34240, ipnet:89.238.64.0/18, country:DE] X-Rspamd-Queue-Id: 4RnCM25JL3z3JS8 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_8c53d5bafc13c998a610677978dffbc0 Content-Type: multipart/alternative; boundary="=_901e2a62eec775052deb185dcd1f4a0c" --=_901e2a62eec775052deb185dcd1f4a0c Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2023-09-15 13:40, schrieb George Michaelson: > Not wanting to hijack threads I am interested if any of this can > translate back up tree and make Linux ZFS faster. > > And, if there are simple sysctl tuning worth trying in large (tb) > memory model pre 14 FreeBSD systems with slow zfs. Older freebsd alas. The current part of the discussion is not really about ZFS (I use a lot of nullfs on top of ZFS). So no to the first part. The tuning I did (maxvnodes) doesn't really depend on the FreeBSD version, but on the number of files touched/contained in the FS. The only other change I made is updating the OS itself, so this part doesn't apply to pre 14 systems. If you think your ZFS (with a large ARC) is slow, you need to review your primary cache settings per dataset, check the arcstats, and maybe think about a 2nd level arc on fast storage (cache device on nvm or ssd). IF you have a read-once workload, nothing of this will help. So all depends on your workload. Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_901e2a62eec775052deb185dcd1f4a0c Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=UTF-8

Am 2023-09-15 13:40, schrieb George Michaelson:

Not wanting to hijack threads I am interested if any of t= his can translate back up tree and make Linux ZFS faster. 
 
And, if there are simple sysctl tuning worth trying in la= rge (tb) memory model pre 14 FreeBSD systems with slow zfs. Older freebsd a= las.

The current part of the discussion is not really about ZFS (I use a lot = of nullfs on top of ZFS). So no to the first part.

The tuning I did (maxvnodes) doesn't really depend on the FreeBSD versio= n, but on the number of files touched/contained in the FS. The only other c= hange I made is updating the OS itself, so this part doesn't apply to pre 1= 4 systems.

If you think your ZFS (with a large ARC) is slow, you need to review you= r primary cache settings per dataset, check the arcstats, and maybe think a= bout a 2nd level arc on fast storage (cache device on nvm or ssd). IF you h= ave a read-once workload, nothing of this will help. So all depends on your= workload.

Bye,
Alexander.

--
= http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF
http:/= /www.FreeBSD.org    n= etchild@FreeBSD.org  : PGP 0x8F31830F9F2772BF
--=_901e2a62eec775052deb185dcd1f4a0c-- --=_8c53d5bafc13c998a610677978dffbc0 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmUERjgACgkQEg2wmwP4 2IbvrhAAiAvPgtZQ7QxH9+6twK9dF0aDz8dIUKVXSKH/DwzJoOINifRxAMv5TOEq Gd/vM+Y9WRyUWPZDYoz6ryHtY5+1W4tVd50e6F3/e6sfJm+CGwiaxCXzjyM+9zdc ftRVQTiypexUa9m/gvHCiUkoH8UKMYRuEYmV3qa72XASCljEQiht5o4nipAXXVmI Z5A0d4nRoxQP4v7Nm2JTlcYQ7N75ZRAUEtRY10XkK4QsuCdXIDHloDT19tDlEuSz Pf6HAi+st9s6R8mFO9onSrcCk4qNVNI5Tu54K3XUT/a/IRxIboVs0leAEMhjWaUR PgqmBldMJDZgTFMoL3mJUY2dUl8fN8zrM3yURCg9i+0NujZ0eCTISN0S8alu+yHd k2PoHz3J5U8JZwWSITebFfmTXbue+C1YVC7tJu8aLPul1nkCYu8IJmXzlOEKJOFZ ih0wVIiLQ4XBaCsJjeLltfnw46fdH8xTWa7dp7Cg35yLtZXJ74GkMy9aVGTuPtQa bqI33m0AyST0w9PY8nlb9ehBriBMqyIRWqISWsGvgdUFybQJtHKdMpM3re2Snnb/ lJjfG3EpF9pAcePYTtllSRsBa3SLBd5gzAjwnyHqdm0dxV5nGWMYuHq3eIvGNTfj dnnsMv0XMbaJ/MHCpmLOsCoDPYmRVthKkv5Lyqxm63iQxFkBw28= =PGXX -----END PGP SIGNATURE----- --=_8c53d5bafc13c998a610677978dffbc0-- From nobody Sat Sep 16 00:28:31 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnX3T52HBz4t0wB; Sat, 16 Sep 2023 00:28:37 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnX3T4cZBz3PJ0; Sat, 16 Sep 2023 00:28:37 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694824117; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=0c6Qa0S2V9+e4D/F0YtyDmGe5m1NHMp8xWzhlsYf4f8=; b=iu4O66GxaoDPavBKB/aDBwksJ2nQXmXP/JPpw83e1zi91Ev/t1qYz+IpglBLl53JZgkTON y4GxgnoUOxw7u578Cl6ZneVVKQwTloUCv/L6a1fcMX1RxOq09Knku+LqVjkBeVwpk+bddb 6MlOGa7ONPi1OvNFNSY3o5ZzkPou46XdnJNYY5eq/7LjbVAWp486sNaeVVnoT7u4aCdXN/ vXJd2mk9iwnt6pzvHjZ9ABs/CL1ZKzc3GUDKWDzjHebhtNATxqtgiDxc27d5EyoJwpBwyV ZQsrLtUE4Lf9a/wBYOlVN97XUA7cIHiccAKUoaaRQ0kj/4h8dHKDIizSAT/HSg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694824117; a=rsa-sha256; cv=none; b=DuoSKurfR+9YebltHM7Au3ZHUP/lUdNHeWCQm6c5EhaoWCXVcdv48bbB3Fk5HJSc6kUP9p cLgYXYPLGltHdCWUBGC2uE8Y9DG1m/thrl+rq7ErSu/45P+33r9WPhC4mxByblDgaPXzoq Ce/mHTqXPlB2zyxrRzX1AbUGx3onI529NqpzTZSbgoS/ZstZzBU/cf5ddFx8K4Gs/jZ0PJ ODPWLJGFSU4FYs5NUJn0xDoQpXa2hX1V4VIpu5f2rnDkdy3orrbGX0pkMvVEhrr4WF5pnA Mlv0B/qYWyyl1W6Lk3aNI3FYpe1ifpBWfMc6XNl9NaY3B+n34lhskCkC4GjHyg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694824117; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=0c6Qa0S2V9+e4D/F0YtyDmGe5m1NHMp8xWzhlsYf4f8=; b=GYkuadoBs6HcV8YY3E96s3WrixaqCDmgiTE+DMnOsFDG7JnFEMATofiSxacYsPAkQavzdm gP3esyLGhYiyZIj/AwThFDRiN4+WKyPHnpEuA6173yDRPH0a5uo2Jguw1A0z+DDnYZAU+Z tVuOxZSbZ/O/11TeqW/o4fvwzZ3FfuVvPZuue9Z90LTThaWsWqunJcrRiCA6R6l1sfLj6K lLoYH9FWSNqH6rhsEBXlW/OtCBR0pLNtKoAGSjQODMHyrYSg7pGEkPxMtNnnI2V9rlbpJi NLXkDwE2lc6j5MiAMsXpe5nT3T7XGoun4JnNAV9fnfP4JLElbs7Dcc5Rnu0wgA== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 50B0B10BCD; Sat, 16 Sep 2023 00:28:37 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Sat, 16 Sep 2023 00:28:31 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 14.0-BETA2 Now Available Message-ID: <20230916002831.GU52318@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The second BETA build of the 14.0-RELEASE release cycle is now available. Installation images are available for: o 14.0-BETA2 amd64 GENERIC o 14.0-BETA2 i386 GENERIC o 14.0-BETA2 powerpc GENERIC o 14.0-BETA2 powerpc64 GENERIC64 o 14.0-BETA2 powerpc64le GENERIC64LE o 14.0-BETA2 powerpcspe MPC85XXSPE o 14.0-BETA2 armv7 GENERICSD o 14.0-BETA2 aarch64 GENERIC o 14.0-BETA2 aarch64 RPI o 14.0-BETA2 aarch64 PINE64 o 14.0-BETA2 aarch64 PINE64-LTS o 14.0-BETA2 aarch64 PINEBOOK o 14.0-BETA2 aarch64 ROCK64 o 14.0-BETA2 aarch64 ROCKPRO64 o 14.0-BETA2 riscv64 GENERIC o 14.0-BETA2 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.0" branch. A summary of changes since 14.0-BETA1 includes: o The Areca RAID driver has been updated to version 1.50.00.06. o The libarchive library has been updated. o A fix for the ZFS block_cloning feature has been implemented. o Several linux(4) updates. o Several manual page updates. A list of changes since 13.x is available in the releng/14.0 release notes: https://www.freebsd.org/releases/14.0R/relnotes/ Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 14.0-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, and aarch64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA2/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.0-BETA2/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.0/BETA2 /aws/service/freebsd/amd64/base/zfs/14.0/BETA2 FreeBSD/arm64 EC2 AMIs are not available for this BETA build. === Vagrant Images === FreeBSD/amd64 images are not available for this BETA build. === Upgrading === IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT Due to an issue where an existing file had been replaced by a directory with the same name, binary upgrades from 13.2 and earlier using the freebsd-update(8) utility will not work. The issue is being investigated. IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT The freebsd-update(8) utility supports binary upgrades of amd64, i386, and aarch64 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 14.0-BETA2 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 14.0-BETA2 amd64 GENERIC: SHA512 (FreeBSD-14.0-BETA2-amd64-bootonly.iso) = 47a8634c3870655d32fabd4a5c6004fbfe1b84857eede8b81d4d0d41a8b47bf6653ac67ad7f39d11df2940197d6fefa25db2d7d52d68f27a7d22fd79aa0d893a SHA512 (FreeBSD-14.0-BETA2-amd64-bootonly.iso.xz) = e5076b538263e636fed06cdec9cf7b6370c7207d896c0fe7d87d1b980bd4d8b0ca35b0e5e6a73fbc0643fefcc160fc258b4eae0cb3aead75c7c057b107f30266 SHA512 (FreeBSD-14.0-BETA2-amd64-disc1.iso) = 0a297cbbfc7c41d90deccc2d79d8054c169d766df153db2517301c40c6609061fc7bfe8eee6f70304b3d0a6cdf745cf6bd7293a5a1ec8dce8594e9f11a1ed2ac SHA512 (FreeBSD-14.0-BETA2-amd64-disc1.iso.xz) = 7fefc5e1e349b5cf5c7dbc78f62740cf16765ec04c8e51edfdb0d5a523bf17428955b071aedf000c443896af3923541f606b2a5569681afb5a10470d466d71b6 SHA512 (FreeBSD-14.0-BETA2-amd64-dvd1.iso) = 326718136de2cd583f3978c9cc31d0b10cb8a4d88efae0da9fc9a9dbeffbde69c339d1dcf881341417377d44aa51885de6c9a0808d5db2c5ec8aeaecf7904ba8 SHA512 (FreeBSD-14.0-BETA2-amd64-dvd1.iso.xz) = 6ea2ca3864698cb222eda47a39503868d41b5a2cb7385f3445a98256dd25f978cdc2cd03322f420e8d7413d0faca5fad135dba4c151937e2d61d938be8a1b872 SHA512 (FreeBSD-14.0-BETA2-amd64-memstick.img) = 327d45c1f2c6830fdbe21ad49dd51122f692cce4ab8653714a7c724c72d979d92ab98c51cddaba6a075bef745fdbcde15f24d5a899342023121a0b173e802e8e SHA512 (FreeBSD-14.0-BETA2-amd64-memstick.img.xz) = 6394d05f539561cc2b207d58e4c48d6e0d65c1806c8140c0834d468fdcebeab19e2b0719adda47c7a9cd8ad62a6a7c562442b89636f852de2dfba11fe847c012 SHA512 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img) = dbf64964c0d2a1ca522c8d44275682d5606177f57013f5dde73c0e357b3853155a5ca35e0a3df9d1717d0af74fd18a65dddcfde552dde05c505191d8f3266f03 SHA512 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img.xz) = 4706c36fec911757ffb30f2474d9a03f2ffbea826989a4487a2a9d2f2aa1a517ec8f095012348fa114a1297c296a1701f9362d8fb81bf40dd65b1ff1445fac08 SHA256 (FreeBSD-14.0-BETA2-amd64-bootonly.iso) = ac63aa79dbfe728e2a33563ca93f24644de17f5a8dac7191f6f434083defea99 SHA256 (FreeBSD-14.0-BETA2-amd64-bootonly.iso.xz) = 65cfda966fe6a87f862c6946e43a32ae7a653610338d9b65f46f7ab023f9532e SHA256 (FreeBSD-14.0-BETA2-amd64-disc1.iso) = 8e19b661821a7dff9d1f1e2f352acbeefdc5d1f828c4e9c1b6c5a84369d9ac0d SHA256 (FreeBSD-14.0-BETA2-amd64-disc1.iso.xz) = 138217e65091a07270c4ed216baf9133aee76bfb92c266b747a7b60b8b34191b SHA256 (FreeBSD-14.0-BETA2-amd64-dvd1.iso) = 2b0bf12830ad82cd8eae4e17323b5113316993d176389ae017893b2c5250a000 SHA256 (FreeBSD-14.0-BETA2-amd64-dvd1.iso.xz) = 1ed2a491d06f58a88ef860ee90cb96827f4eb756c0298dd34df3de978be8ccf8 SHA256 (FreeBSD-14.0-BETA2-amd64-memstick.img) = 5fd713f55b1ffb435b734b1d0abf7dd9ad65ea366d8ff2a7f920642d8445d0bb SHA256 (FreeBSD-14.0-BETA2-amd64-memstick.img.xz) = e74d59d3b4db590000d76c7150cf0f67a4e8e723e1e9521a46378ff38b71e0b1 SHA256 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img) = 5dfb262e6bef1be1806ea40cd806d0b8aa5da7700b28f489654541a92598daf8 SHA256 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img.xz) = d491ad2a9945b0bef05b3eace610d172a0d0999571ed045a801e5f6aaf86316d o 14.0-BETA2 i386 GENERIC: SHA512 (FreeBSD-14.0-BETA2-i386-bootonly.iso) = a0b65b92035059514114b41ba33f5fd94e8292e52ae51c64d1ea2f632b7afc5335bde77bd706d44f0f6eb74fa55ce19256cbba22bb141631c3fc12106befb35d SHA512 (FreeBSD-14.0-BETA2-i386-bootonly.iso.xz) = 9d7afb8aa64d85468a3b3c392050027f07bd0589d67423cab04c1081f1ff6c3b1d11d57cd6b47dd4c981c0212335ea101ca4eec9c4c9ee8a880d7313cd2e28ef SHA512 (FreeBSD-14.0-BETA2-i386-disc1.iso) = e4f256f29a558da63defa1da39e8cf782d90dceae4ad2cf05781001d9f050333e809e998b6d392d4aaf8409981caf499fa60ab143132649c3b4c6fff355dc626 SHA512 (FreeBSD-14.0-BETA2-i386-disc1.iso.xz) = 0f367fd32bd149399502c5020a18e33b597220ec4a88e32b39a6f69a2e35f9157b827b858a4045b3e6784fc513b76fea475432e70f711233c63f64c5349df307 SHA512 (FreeBSD-14.0-BETA2-i386-dvd1.iso) = 09edb86b580c4fda01a186d656079c206ad3c37447a409efb9e148a508481807e4f806ad546c97f43fef50b6b7c3b0780db7e13231a1c4ca193d16f15394fa25 SHA512 (FreeBSD-14.0-BETA2-i386-dvd1.iso.xz) = 9f6547d9213616564eb66a523d81671de68a76d38edb05a80b0bc5eb1753fde8baae8cbd84ea50e49e6ad9657d861429453f5818793b26edd36be5132f3a9c08 SHA512 (FreeBSD-14.0-BETA2-i386-memstick.img) = 676327e21b2c21845e90e61f7673c79e918ae855da8c13943ec1fb28b0525eb964c198219add11891bf0a063647652c16022669a135094f460100789cb0f4a96 SHA512 (FreeBSD-14.0-BETA2-i386-memstick.img.xz) = 34975bc88d9376d3ebac130d477d9a2db039be0a5e5d29e6c81e87d03cdccc2c4195e9185934578a9670d8eedcdd99c57a06c70031e8d5c145e7d7c301e7817e SHA512 (FreeBSD-14.0-BETA2-i386-mini-memstick.img) = ba5b0566224b26e1dc59afb1e2584f4db3dbc9fc69bd0f31f50debbab7ae395ad7fc5f5db7786e7afb414120a7e1c3b43ef8248a6a7e94ba948c50c3142fb516 SHA512 (FreeBSD-14.0-BETA2-i386-mini-memstick.img.xz) = 60440306096761d7dd2e40d960d1d625a529de8df639d76466dd8a9a0a7295aafb53d0943f6d2862b454bb90a7ab0af40116dc96fbb6648a875c54b7ce7edb2e SHA256 (FreeBSD-14.0-BETA2-i386-bootonly.iso) = 1f513699bfb6f61804e4b456249cd3f4fb1c07eb74b66ac2cfcac3bbebe23f2f SHA256 (FreeBSD-14.0-BETA2-i386-bootonly.iso.xz) = 346586e72afb12306e234b12faa8ac1edaa2f0f4fa9d1a8e396ba1a18c16be50 SHA256 (FreeBSD-14.0-BETA2-i386-disc1.iso) = 98ecce04874bd08a2d1665abb9d6d97e846ecbf3848b2eb11e1906c8bee091ae SHA256 (FreeBSD-14.0-BETA2-i386-disc1.iso.xz) = 52b7b39a816fa6e59eace7f88893684799c15d7b5ce1a3e7f6f2856ea8af18c7 SHA256 (FreeBSD-14.0-BETA2-i386-dvd1.iso) = c6f2ecd647db425b766410a9383a7288fd6a329698b79ce9f34532803a8a678a SHA256 (FreeBSD-14.0-BETA2-i386-dvd1.iso.xz) = a34240ac481525303ce43a803c6f0eae5e77bc04781a30fc8732da5d7cd20724 SHA256 (FreeBSD-14.0-BETA2-i386-memstick.img) = d9749073a96b092ab5401f51305867843b32214bf7c2cc36a7353b3b06e5f2a2 SHA256 (FreeBSD-14.0-BETA2-i386-memstick.img.xz) = e4e11fdb5667acdd04a0e9cdef361feb387b1a3f58a3c9af017648f753f212a0 SHA256 (FreeBSD-14.0-BETA2-i386-mini-memstick.img) = 43fef9b8eb39535e19029016f63238477ad03b4d642d3167cd57580d453264aa SHA256 (FreeBSD-14.0-BETA2-i386-mini-memstick.img.xz) = 804a105d3ef25cc037d1f9069da4b80b31d22b18678ae07a98b43cd392c85560 o 14.0-BETA2 powerpc GENERIC: SHA512 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso) = e919520faef666bd16d64370b5a240c088203546fb60697a6c623c28ae74ea4ca31fee1341c86a7d9499b34c221e9cc95b3b29891479ccf8e584dce5992cf201 SHA512 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso.xz) = 855b02074144c7fcca939de0fed597187c98a0e31523539121bd4bca65bb5d2a1b608bbcc5c599d1331eeb49486c9a2737610c2f56603476f01b7810e34d42f0 SHA512 (FreeBSD-14.0-BETA2-powerpc-disc1.iso) = 1fc05e4be200cbf1c271b449a0f69140d77f25d9d66ba289cf7a489902120f1be57c1425b4888da3164af610f7709ff1376d669351a3df17f309f9a0eec0a1c9 SHA512 (FreeBSD-14.0-BETA2-powerpc-disc1.iso.xz) = f0d8ae042a6cd06b15e0a45aa1d976333722abf3e4601ad7cb7b2f66ab218f3b65844eee285408334597b7c79c04e630d841b23e6e59cf5c5d8db4fa9e1b9a50 SHA256 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso) = b64cbfcd02652e82cfb91948ce630d6d457f9d9101e11a9bc259df5d36551701 SHA256 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso.xz) = 79fac9332c230d1c259c9cc21ead7fe1f3dfeeb73933112dc44ae061c0306496 SHA256 (FreeBSD-14.0-BETA2-powerpc-disc1.iso) = 535f3cd2dc98667c9a800f99c9121c9fa566e9abda5c01feec935dc9061b5542 SHA256 (FreeBSD-14.0-BETA2-powerpc-disc1.iso.xz) = 8c1e96cad81d542dcbd13a09e998c151e2a32520dee1a3def91afda7bedb1b09 o 14.0-BETA2 powerpc64 GENERIC64: SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso) = 08ca109d8cae1959b81d23fcb33b0f709e7ad64bec02f7649db5a03d1cce3a701eabe6586f531e83f41e08937727e49a3ae7d7ec1de54ae5582d0d4d840b4865 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso.xz) = d273a9e2ea6bf9611cce9d5edc5fa1a960f577de1601e0f4472313dd2f309f87d47fe048d85b7047d43241a9e2a87ad27d8e17192e2686c149d85cbccd5f8a1c SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso) = 5d221dcf52c080ab6010c364c582114f6950ccc896548dcb9b7026113aa8ed16e2f39ed9fcb5fc4bba84fd023845de3ffc1cbc171a7dcb3f1403c2afbe9cda12 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso.xz) = 92ce1aed7362f6a438beb0bf54c837470b247fda2abf62c4233e23427f180d77cf69be552e5b82a32d2d8c6ac67544e57218300ded7ae76e6989cc9d70c372e2 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso) = 7cc1ac48d50a2919f912c474a43fbe8dad4e19e57463389ea44e18322a9b870f SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso.xz) = 48066962424687e25e89752dbffc8566be0adf829fb9be76902327758d178d2d SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso) = d10fbeaea5d6f846704009eccc30c012bea0dd29c22ef9f014c95e80faef33ea SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso.xz) = fdcdc52b1eb24da3a675523d2ce9cbd5f06dfad667100b1f0bde1dcf230fcb92 o 14.0-BETA2 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso) = 0b1818676eeb5840a2e1970cf1fb117cc5841d459aef04e364cf44f41cc389a6876be4d7d84e5e11665bd42c4aa45a9542deffa0896c136473022936fa95ba93 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = 2eaf99a9620522f497be95c7bfaad570e2edc45107b690859517fa929852cf40183b93a8a43dbd0784cd947b05930c0b4d4cf4219488b03fb76fc578e40fd863 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso) = cd1c534dd600661b2fb3ccbf06b28eec88b920a16933268a5b9f7a5e9788b5fd66e9fa32c919cdfb9eba62cc2dd6cec31dcf0349e5f2aebb8382a2d20116a5a7 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 5b313b5fa99530ea0969aa65152ed2d0a88b999c70e9e1ae753f0c967828df1c01935b4d03d14bde7659f9d8285903b499d2459e40c71eca76252dd6748b6155 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso) = 600b43c075fbd8227a952f00d71f000b378f250601396e263c199feccace5931 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = dbd1337a4c5840f6ad1b332138fb0c735f7e5160c0bbd4b678e3462c872c9601 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso) = bcc6131731ab355a76f95ed52f17883ecd6a28358f2ec2587d9ec385b20360ed SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 901b48c2c850ed6688224129d0dfe3470f0fc86a24bdf8cafb6b04cc8e775ffc o 14.0-BETA2 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso) = 9d66beed15be6c9846dbcfab56110dec30f6f3697751954f11f955669e6c0fe35a048f0095f65c2c2f73b26bde00efca809611c8ab1fc09bf245a9cac8578c63 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = 7e766c11a936a924082637e96897dff7979f15ca59e718453a0d414ffffd63f797aa43d59e8347cac5198b7ec81ff41bb7f734e789e933956e7b81e0fba17696 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso) = 0ad6c3fe818e2769b132bc65a4c2b660e02ace292a914c8aabeb920d52fb246be27cf7033cc65723d7f7a4b008678b7a603a2aea4272cbee5167bf45a94b19e2 SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso.xz) = b7193ae73a745e17f450be4c943a15491922ee85a755ec552b9bbe3bb7881f9c4a562dd3149c139daa2fafc6cffebfcbc25b4ebb801b722d668b1503b87072d9 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso) = 3d507e9f33cb208c26c9e7423f02d7114a739855d9823d6c0da4fc806f434fc4 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = 31d5edee57ef286058fdeae793d4dd04442313837bc5f3bf6a68f29361e43d4d SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso) = 73fd26fdee8f4e538071ddb4ecbaad25dc56b5b470b6d49c8977efddf3703ef3 SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso.xz) = 5852d9c53647a9a7fa2a2ca04bf3cefb35797ab5cf4b7a9c28116be1c9e7b080 o 14.0-BETA2 armv7 GENERICSD: SHA512 (FreeBSD-14.0-BETA2-arm-armv7-GENERICSD.img.xz) = 32945a2f101db27fac609479a68d48ab475529ba529cdfa7f775373d9dae050335b27501b2911470ea027df2c9648258a223e5ecea2db8d2f0e70c3f874165e1 SHA256 (FreeBSD-14.0-BETA2-arm-armv7-GENERICSD.img.xz) = 3ce32c7d08212dd59677f3c67b394bf52a872dc371c8e1b719e83b4a3d302d77 o 14.0-BETA2 aarch64 GENERIC: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso) = 1b3267c31553a909aafc772e21b90e09da66af82352719b94f895f31f0b0b19be2cc58a1577f72d9e3b4552cc6aefdf12df6b9f96e68292d56de94a6c1132903 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso.xz) = 1dc0a9354cbb79d4af8de88c95d923ad5e0aa6b700feeb5d6c4f5b8baf572cef066acbe2e8fd51bb36edfe4906e554aba4e86d7712b0e5a1b539b55dd5010a42 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso) = c4dc3cefe668654fa1d4454b5633fdaf26beedbcc15b316b55080039f9aac27ecb266f8ff24b0edd628de11fa765403f743cfa2d93c245d3ae86bdff10d14e3b SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso.xz) = 3cdde79fb1f8dac84fc1479c05f6bdef7fd51dc3982cfd8b7f388065c613b9a23acb52c21feac6d81769c69f11e125b6f44350fd30d2183c191e2ce4efb077d6 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso) = ce649d0f1db12d8dbf396972e6dbe34d7d07594cfaa83a1e4b7abc212458b73480cd6fbbd6714d92f013e3b90fe5049abcdccbbf8c7b349fa99fd047fef5f6ae SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso.xz) = ea8be16a9b8751814611441ec25cae7bd590bb6b44739c9e690bcee1432fd61d0b7f01197ff8067580d0861ff488979b83887e25c779559085c9dacd3d52fe29 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img) = fb3a22ac0007d3e404b6a3b6c6b44044be17bd6e14e9cf19c4f0eab0965fec4515da79b3ea6e360eae9c67472f9b39084817b1a45cc38f1cf6bf2d72556fb6f4 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img.xz) = 3faf083e54c77a3cabaa76e3a943f723d3f1d31a356b04b7d88370e1d51c712ffb82a642b2faa531fc03695f5104f0b8004804612554f91d22fda87c8bfd86ae SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img) = c0a2678ccff83ab8486fbbfa79d4f94575882d8a0d361dcbda7c9f150a8e3fe51585d58669ab742e9ca113d62a20f3ed37017da415a517751b15a7060e4b758e SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img.xz) = a9cfe49970477adb51cc7c8b20161dccc43662873f051541ca898087d148ac9cef2c8d10ff15b9d35fc836552a47384c32da99c0e70e19d2d1461313bc1cd26a SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso) = 5c4612ac675988b53cc813146f4b8bc5dca23d1c2ec0973a219764efdab6744c SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso.xz) = 47ea5ade09cf3bd07f75e8d0358fbf044a940c127db242b54e25af21dcdc0929 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso) = 8bc09649f801b23b135979e39811fe3183b4727d94e0fd80a890c8560ff487b7 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso.xz) = b829b775a847daf298e90dd3e5eeafb91da1497b62fe0e1eb4ad5f5a2ec10a76 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso) = 63e0b73ad9b1d0f2ca1add081064a059db6fb483599e2d1a05dc9053e2f7ccad SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso.xz) = 28b14ddd1a7ab0cd4d5a99c677fb6a528d0a92f5805c38f1c0e6377fe9a7fa85 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img) = a00a9a7f105574c42e102c2aeba294401ac1811fd28f9c760b60f2d1b94390ea SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img.xz) = 9adcca1a46c0be99c2a336122e28b536f5e36dee4642834758a952038487e8f9 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img) = 26d909f2413514a939c0ed9d9d6dcbf6289ec3d8ad9ea5710a0277890ceb25de SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img.xz) = 7a7149ad3c208e0475570ddd5b830e62074c15118aa4eaaa8fa14df009502a7a o 14.0-BETA2 aarch64 RPI: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-RPI.img.xz) = 38bcee5a3cbf10124107b097e7eb79eda0b7812a08b5941ee12e567d4c18be961e59e8dbcc8a102f585e2dffa82e8a714306e96fd3e0ec421f8f531eda01a2fd SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-RPI.img.xz) = 7283c7ad72620684aefce7521c3116304cf64f0312a4664cdf2e85e74c714d1b o 14.0-BETA2 aarch64 PINE64: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64.img.xz) = d01eaaccb80b764582789cbaadff7d961c1ae2f93a5b8430b29c991ad9a7d0471453c23346e739df7fb05e2fc0d2e76e47032ba9f081d6270cb79cc713ee5126 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64.img.xz) = bacdaaf95689858580f0fbddb13d449b4f9a13fb0486408b2fe9e6cf9c13271d o 14.0-BETA2 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = 9ad41edf92f702b42e2b2aef333fefc9a2ca3c2a2ccb869a39dc074743495693e75d6cb8d3c01124e99093685f2f5d9e0f0b199c05f3d7672665a00b0b067af2 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = 5194879353ab2f8754310bb43d32420d0d502209a7987efa2636179aa9b40541 o 14.0-BETA2 aarch64 PINEBOOK: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINEBOOK.img.xz) = fcf8415e9ca8dded55ea75b99c3ab221cedba80bcf96099b90f466691fc20bfbf347d668bd0e0fe75852009ef70e21986ce1086ef42e7c7997e0220dba2c9485 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINEBOOK.img.xz) = 0c339a94addd82bbcf7533dba528457cfcfc5297b45ee32f84d1484540106702 o 14.0-BETA2 aarch64 ROCK64: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCK64.img.xz) = b8ccb3b3b41b3ca393c0ed4884a2a8902af041b187c0b73c82d58e1bfc06b9fd2b7185c28a7449133a6d69d0283df7eb7daf2f3a9e56330aa75debe3a3190ac3 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCK64.img.xz) = 5c5da293d5548d4e8fd475a03d03e2c66c870f167af69bc85ab8581a080d153c o 14.0-BETA2 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = a5771cc04bbf3cf83059e7af1fbfec810b1d14f43a417cdaadf558ed10b7e1000e80ab6a93b44261030d0ed65825e62637987832af9c3c9acf5812072042f36d SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = 0b66603ca23509415eb35bb09dca1f589d5f1e25f1cb7282c5bfc3ea56077770 o 14.0-BETA2 riscv64 GENERIC: SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso) = 64bbadea7e515b8e2d2a9cb9a97607409c3275d39abc8b5ad868c46314501220391502796773338fdbed93af0d8837384c64e4f76f7f4a3b7d5cbc9a90fe92a1 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso.xz) = 1d3457623a3f7a76e38db6c4bf178a545d2e1c54dd81a60f152f0ad32644d68aab83657af892fa3dba68ca03b6bcf8d9a95f7f4047bcd60039ea1732437fe94b SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso) = 4a35e4e36eb4c1294f09a70910e3db60fae3bfc1b57784f64375d282f39a0ad84068d08bbde82128462ef5cd0fdc77362f19b3518597e1cd17bd145862b47a45 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso.xz) = ec99283100c191b861ad9ec731bc7a7664f899fea342f9cea402ae9cbe07c6b7e2b724a186f3b8789f116b93993ef5293e15a6e6c79e60a3295f674f3f565c10 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img) = 5788022ce8e7924f011d709d6598188ac7c96e3c9737990bd03a20d104e3207828e67e7cc435d13acb127035bfc3c49cca6715f92eb658ffd0f25b23ba259f85 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img.xz) = 250b01d3dc1b2f36aeb702022f27074b7e5e549c3998b015a30c7c36e2df4a3455b573ae962cf5ffbb22bfddcf41ee2aeebea34b2bd2b3a5ce1db711a7f8d4b3 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img) = 634d3463c227ad5679c2f402e9deb2e078e3c0b06f312da5584047329a56667b83ff4d3155bf68e41b1a34018a54de8f8a021bd6834224c0750451ac10de7eb4 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img.xz) = a8ee5c48e81ea003de93d71a9c3efdbb52e650b3ebcd92eb85bd4ff3682905f89732d05265d0487c19a335e145a90e2b8d3e23dd79ff8b8b64a3d926c6e881ab SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso) = 27c82c435602fdc307fb4aed4680b17c483a3eca26e2f792f07a28ae6ef136ce SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso.xz) = 2d9b44724e3c7613c90600e1d97189c3e6b80b03993192ed6975898c30f3e43c SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso) = a4d428e3ddbec40a84d6e20c18393b5fe8e5f371a13ad8079dfa89357f92f96b SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso.xz) = 92d4e12c0a753f3c3beb2dde3fe74cdf30770c1c927c021cb3d44a104f299e73 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img) = d15375ed4fbb7bcd7997e8ae314a2c957716c8c4b0fcb5ea3e02df1453ed7201 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img.xz) = 310bbdd1f44c5b9c39ac7e56977d4a10dda7069b0561f408c5a4cb2e56e9eee6 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img) = 2e09cad2d24a57c39d308e5acc0515615371ad8e959c8f3739602d8a89dc7877 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img.xz) = ff51d5af63deb7f6a009558a3e11637dd64365301db2dedd94546de65682d5c0 o 14.0-BETA2 riscv64 GENERICSD: SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-GENERICSD.img.xz) = d11ac9fd563a74bc412814b0bbddc46545a76207dfc18eefe5f71a9f4989011d94471b8cf9e5759f81b2d4dab0139c537066a87222e2120cb85920689614be5d SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-GENERICSD.img.xz) = 966a2c2408d89b8d7d93ad8711fbe766f14d7a2a21fda91e8f6b908d9edb3276 == VM IMAGE CHECKSUMS == o 14.0-BETA2 amd64: SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.qcow2.xz) = 2cd542fb62f02f9a394794c0dd98df8d73e3734f226e232aa85a9d79cc8c365e696f151e631caa2084e9f7d3b1fa2c1aa045ebb7e883b5082de7300fbfad907b SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.raw.xz) = 6ca883703eec62087b0034afe16c705af72403a2657b18f874a1120307b06aaba2fc432167e43535bf570d26f698724d66543bbc7276522f53fcf922165e7cfe SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.vhd.xz) = f710995e9513da403cf78f9eee0075d8ebd29e01831beefc45620a8674e543bd26e49ba2c4177b891e406fcb1cc042e834f202ef5f13eab18476663f945ba985 SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.vmdk.xz) = 5beb787da1b03913c39fd18fa44c889471485213e390f0107f0cbd7638a64ab403716592fc9dd9d6967845bbfc7803976c9466ff61e4aed41ef67532a7c67f4b SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.qcow2.xz) = fa11dcee9d3f8456f90becc76e8081bc03bcbc46855a326d95819527f3c891c440458f2a9e40dd17cc9316c014815f4c459a3a32e6c6aec9bae79c137fc29d5a SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.raw.xz) = 6800edc1a92088759dbd834129ad5b235d8d45124eee72dfe62be91497caa0d493ab76c8f9b81feea265672d4bc664a120b755ba5fd4a8dbd589d6765ec85978 SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.vhd.xz) = 074838d9a6577d8e2d51f21fe753cebe9b505c48cfbe7e728776fc6d1891f481b0bf8b53f22890da339f6c957256bc61179d4aba1f3d9ebde95e7753437fdc9d SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.vmdk.xz) = 0f4943a9047f8ddbb0a9522914e212ffad30c27f1d9633545292ae38136697dcd7260934b8e763f20ff31071a24d820efa6a1dad0fece0900dbd97008ed13d6b SHA512 (FreeBSD-14.0-BETA2-amd64.qcow2.xz) = 2cd542fb62f02f9a394794c0dd98df8d73e3734f226e232aa85a9d79cc8c365e696f151e631caa2084e9f7d3b1fa2c1aa045ebb7e883b5082de7300fbfad907b SHA512 (FreeBSD-14.0-BETA2-amd64.raw.xz) = 6ca883703eec62087b0034afe16c705af72403a2657b18f874a1120307b06aaba2fc432167e43535bf570d26f698724d66543bbc7276522f53fcf922165e7cfe SHA512 (FreeBSD-14.0-BETA2-amd64.vhd.xz) = f710995e9513da403cf78f9eee0075d8ebd29e01831beefc45620a8674e543bd26e49ba2c4177b891e406fcb1cc042e834f202ef5f13eab18476663f945ba985 SHA512 (FreeBSD-14.0-BETA2-amd64.vmdk.xz) = 5beb787da1b03913c39fd18fa44c889471485213e390f0107f0cbd7638a64ab403716592fc9dd9d6967845bbfc7803976c9466ff61e4aed41ef67532a7c67f4b SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.qcow2.xz) = e09ab51f7e4d763a7eb1e8be6116599264708ce91f6c9482b8b47d4b8d637464 SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.raw.xz) = aa6859412a993d9085bc10978f796e8d570cff6d34bc05784930069127a8010f SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.vhd.xz) = 2f66f81d29a8d3a827e3672ec61c63572c86519960e083dcab0da5c5f7d244f3 SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.vmdk.xz) = 508bb0c122fb642b33902ccda678b5dd25d1d60a4a15b2a53b029ec4e6146608 SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.qcow2.xz) = 36d89448f4eb0ad533bb092d2e3ad4c55622e95e9e67f9761c038780450f1018 SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.raw.xz) = 7838f1c56a86a280cd034c7417ba4ca3c87d46dfb3b212e1f36632978d6fcb78 SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.vhd.xz) = 8f4d02a21ebcb5f931fd0ff87187568dd8c68ccd75d118ba184e5d12b5db8788 SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.vmdk.xz) = 898ec37563718967f4cd59ac6fbe802ba4a7f49fd6d7fa363ba1c7e7b98b17a8 SHA256 (FreeBSD-14.0-BETA2-amd64.qcow2.xz) = e09ab51f7e4d763a7eb1e8be6116599264708ce91f6c9482b8b47d4b8d637464 SHA256 (FreeBSD-14.0-BETA2-amd64.raw.xz) = aa6859412a993d9085bc10978f796e8d570cff6d34bc05784930069127a8010f SHA256 (FreeBSD-14.0-BETA2-amd64.vhd.xz) = 2f66f81d29a8d3a827e3672ec61c63572c86519960e083dcab0da5c5f7d244f3 SHA256 (FreeBSD-14.0-BETA2-amd64.vmdk.xz) = 508bb0c122fb642b33902ccda678b5dd25d1d60a4a15b2a53b029ec4e6146608 o 14.0-BETA2 i386: SHA512 (FreeBSD-14.0-BETA2-i386-ufs.qcow2.xz) = 23764bbaf8f07274ed119d87d47707454abed2d1ea01ea824ded042a8ab6af32103074982538e6910fe84eaa5b7545150ac9cf4cfcc2ac2a277e35e2e62cccdc SHA512 (FreeBSD-14.0-BETA2-i386-ufs.raw.xz) = e302a3d96c124bdd5eec30699efe9e1e7727b1ef573dc7ef365d63fef6026bae7530b32511672b629164255937566de8296f4f136bf6e8a7bfd5a3907de2b98d SHA512 (FreeBSD-14.0-BETA2-i386-ufs.vhd.xz) = f0b4c13e7937db273827837b86079b6c22ffa03ed8ff3b76f25ec480a970f3227b71c5b86aa2fbbdc23f7135b564b9ec8e986994847985ca5f0b53ad20d305a7 SHA512 (FreeBSD-14.0-BETA2-i386-ufs.vmdk.xz) = 8306c5327fb088783e9c53836327c2510faf472ce6894d118da7577a4efd9c163627b94910c4395d680f7134b89ad2bdea33e560a984dbaae654f2f58a4c5672 SHA512 (FreeBSD-14.0-BETA2-i386-zfs.qcow2.xz) = 78ca4d28a9e826e4bd93a1fd966785b122115d5259336fc8a43ca96564b2ae5b3ae5c85e73bd56fa510050d8f569047030b5107549bed2601bf4a3c9f7d207c6 SHA512 (FreeBSD-14.0-BETA2-i386-zfs.raw.xz) = 80d4ad71074a3e4346a0d890555217f3689708dfb042c7832ab9e65ae358618eb5cf176ca16c7671fdc10882ae8fd258a20af516c8a5c2807976e2d96c4fc04a SHA512 (FreeBSD-14.0-BETA2-i386-zfs.vhd.xz) = 19969317bb51388de333478a786a9d1d048c9cfd39118af437cad64366493bfff123105abf1b8d5d79b3732218b70beb32ccbb67181be7318b4d49301e77a796 SHA512 (FreeBSD-14.0-BETA2-i386-zfs.vmdk.xz) = f9062710491dea8e73f3ba476841f36ae68f5c6888bcc2965b0dc89fd6db1ea641c1a810193a8fdc2b0b604575b37bcf6728868c53131e9c5fa3cdff70332220 SHA512 (FreeBSD-14.0-BETA2-i386.qcow2.xz) = 23764bbaf8f07274ed119d87d47707454abed2d1ea01ea824ded042a8ab6af32103074982538e6910fe84eaa5b7545150ac9cf4cfcc2ac2a277e35e2e62cccdc SHA512 (FreeBSD-14.0-BETA2-i386.raw.xz) = e302a3d96c124bdd5eec30699efe9e1e7727b1ef573dc7ef365d63fef6026bae7530b32511672b629164255937566de8296f4f136bf6e8a7bfd5a3907de2b98d SHA512 (FreeBSD-14.0-BETA2-i386.vhd.xz) = f0b4c13e7937db273827837b86079b6c22ffa03ed8ff3b76f25ec480a970f3227b71c5b86aa2fbbdc23f7135b564b9ec8e986994847985ca5f0b53ad20d305a7 SHA512 (FreeBSD-14.0-BETA2-i386.vmdk.xz) = 8306c5327fb088783e9c53836327c2510faf472ce6894d118da7577a4efd9c163627b94910c4395d680f7134b89ad2bdea33e560a984dbaae654f2f58a4c5672 SHA256 (FreeBSD-14.0-BETA2-i386-ufs.qcow2.xz) = e346364bc5cb0391c49b6825fb180124965cd3574bbe4c87ad70bef31cc01661 SHA256 (FreeBSD-14.0-BETA2-i386-ufs.raw.xz) = ce7535519051e10ca48077c9ef41000640c365f6dcb09f4fa4b2669771f66b0f SHA256 (FreeBSD-14.0-BETA2-i386-ufs.vhd.xz) = c95ac0f87962d5932af5b7e718adbf1356387bc4a40fcaebc3899366383a5cc7 SHA256 (FreeBSD-14.0-BETA2-i386-ufs.vmdk.xz) = 62492a41cb28457b2d7faee833a7ad9f6b11024cb14afc5183bf50de58d5b13b SHA256 (FreeBSD-14.0-BETA2-i386-zfs.qcow2.xz) = 180b39b8e5cc11e9f1d2cd13a637ded0156a82fd068debb9ca1f9ac762b4cdcb SHA256 (FreeBSD-14.0-BETA2-i386-zfs.raw.xz) = ec6ecb9a10e87e172ce05941307bef54ba38949d832bb887fea5681a2e356043 SHA256 (FreeBSD-14.0-BETA2-i386-zfs.vhd.xz) = f33cbadba5ff120a1f9d70a1eb08a87ab04ae90ae2461c92c7ad349d1760be43 SHA256 (FreeBSD-14.0-BETA2-i386-zfs.vmdk.xz) = 4bd6fe1b59801a69a120870888ce45abd96f59260b905c521b622cc343626489 SHA256 (FreeBSD-14.0-BETA2-i386.qcow2.xz) = e346364bc5cb0391c49b6825fb180124965cd3574bbe4c87ad70bef31cc01661 SHA256 (FreeBSD-14.0-BETA2-i386.raw.xz) = ce7535519051e10ca48077c9ef41000640c365f6dcb09f4fa4b2669771f66b0f SHA256 (FreeBSD-14.0-BETA2-i386.vhd.xz) = c95ac0f87962d5932af5b7e718adbf1356387bc4a40fcaebc3899366383a5cc7 SHA256 (FreeBSD-14.0-BETA2-i386.vmdk.xz) = 62492a41cb28457b2d7faee833a7ad9f6b11024cb14afc5183bf50de58d5b13b o 14.0-BETA2 aarch64: SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.qcow2.xz) = 00bf4bc2e63eabbfaa83f98e24e91344bc542c14721fbc194a43a12d6ac4d53aa3fd3e3274dbac7800d3a6c99877eb8bbdec8e38b66aaee14860babf6105d48f SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.raw.xz) = 25875161bf0e6a0532bd176aa06340dedefb6679bfb5509dc2980a46b3ec230ed0cbfb814b3cfbb6108b0e9164e981c90290a3eab6c026b8f9ee7e3a57cc7f12 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vhd.xz) = 359859524348a2cb2887c51ffb1a3a12567f2acfbb045708cf73fc08d7b2e2bc1b3a70d94aa17f3589c2b2831e94eda8684d09a3057d3420a1c7b896aa5532d5 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vmdk.xz) = 5f909b37809614b8dda0b9f4f18148c744f3d27f4bff4bb7a164d08237ac6181018f235d53eafdf32cdc480843e35174a22cc7cc4823b4341090badc74510858 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.qcow2.xz) = 1121a62164a087f7ed397a5c2817322fe8082a2fea514c0f6079b422220d360e03f5d05566a2c407c0ed23fc16ccd646b8947d3856799c260446a70086d085de SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.raw.xz) = 368d7af537e2e21b7cc7b563a9645524eed9ce9486a2356ccc28e52c65e331f8243c2739ba73f6c407a8753de04953f514531cd1b04059256273d5d79085f0de SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vhd.xz) = b16efe94c68117ed5dc9526f1b1b6532eb70989e1a2a70bbb043e3d6751058bf510365519b462c7945767ddf2c33f279d2cb1bf4cfbbb78c7276bf6971880da2 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vmdk.xz) = 9a77119dd9aa2af63b4f5328cf8ac6f71a3a7434ad3f5480e972c8b80c50e4a5da86ab00730bd30c964056a4b1b355b123725266e383f1d20bee17c02fef0e83 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.qcow2.xz) = 00bf4bc2e63eabbfaa83f98e24e91344bc542c14721fbc194a43a12d6ac4d53aa3fd3e3274dbac7800d3a6c99877eb8bbdec8e38b66aaee14860babf6105d48f SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.raw.xz) = 25875161bf0e6a0532bd176aa06340dedefb6679bfb5509dc2980a46b3ec230ed0cbfb814b3cfbb6108b0e9164e981c90290a3eab6c026b8f9ee7e3a57cc7f12 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.vhd.xz) = 359859524348a2cb2887c51ffb1a3a12567f2acfbb045708cf73fc08d7b2e2bc1b3a70d94aa17f3589c2b2831e94eda8684d09a3057d3420a1c7b896aa5532d5 SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.vmdk.xz) = 5f909b37809614b8dda0b9f4f18148c744f3d27f4bff4bb7a164d08237ac6181018f235d53eafdf32cdc480843e35174a22cc7cc4823b4341090badc74510858 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.qcow2.xz) = 55e68fea7daff5ec916fc49ebbe7854abbe35f10aeded0a4f28ee0be871e442e SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.raw.xz) = 09ba9e5af71d4db4fae77a3e4ba6b8281bd188a24229164a11476c1efc8dbe02 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vhd.xz) = f59b4a83f11fa849032e9c9b1eee63d5f77d4ff04ea0eb09e4367b0438f0fdd3 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vmdk.xz) = 1acd0857ec7b97382efa85994aa4fe4bdabecf641d5f9d42950fd52cb74da6d6 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.qcow2.xz) = eedf5851de047dcd959adac2736e503039a65cf555c4bdae39ea8b9a4a5e0444 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.raw.xz) = 2146d88aaaa98bbfc838f24fa9057e4adf0a1da54eab53c883fbce7028441afe SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vhd.xz) = 7e819d385cc077142f4019b6fe20413a877e32977828ea932296149dbd3f7a69 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vmdk.xz) = 1bd1d344d2d95827a38eb4a942f560639d5c1c73ae6afd2f66fa3197e35b911b SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.qcow2.xz) = 55e68fea7daff5ec916fc49ebbe7854abbe35f10aeded0a4f28ee0be871e442e SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.raw.xz) = 09ba9e5af71d4db4fae77a3e4ba6b8281bd188a24229164a11476c1efc8dbe02 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.vhd.xz) = f59b4a83f11fa849032e9c9b1eee63d5f77d4ff04ea0eb09e4367b0438f0fdd3 SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.vmdk.xz) = 1acd0857ec7b97382efa85994aa4fe4bdabecf641d5f9d42950fd52cb74da6d6 o 14.0-BETA2 riscv64: SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.qcow2.xz) = 530c1ce40e81eade8ffe19bfd5c3761f0fb9b5ef9f4f618489bb0450b116dcf984a7fea75059565a6d534cc98aa7154c6b783683faaccb226050d53ca679b97e SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.raw.xz) = 4d62be9167dda86ad2b0341ddf68ee151ac3f1a007be7fc29f9f2575d2962f01934edea2bf3ca3f2f827082272bab73dfa11db58ca735363df5e689c7031f4da SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vhd.xz) = 56cb81bd589a41140100c099f62a084ab7943958ce7d7178b8753b2495dd275a6d263a6e56ea0cef86647fc802dca69d523158f17f3179e2756e3856eb8683f5 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vmdk.xz) = 60e4b040af68e07e476658745196ab3eace5f30929728ee7f87dc4b3ce5964e052e7a413eca28b9c4e88c8662ffbaee871b7302bafe7199ad0b9f084349d0572 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.qcow2.xz) = 42356be29d964ce06dec37fe6b96a046f6ca18efd1dff2746ec5503936b5c5ace28aa7ac86afb9763553fbddd7de386662417036260f3601c3af6df2ef41f89b SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.raw.xz) = 873482fc4144bb2814483ade5f0339618110ad295ee1bec4a3863decf97fb41ba384e7a33a7033a45db99dca8aa9e2f57f72435fcb9b8ffe85e4736ad4473160 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vhd.xz) = d37e44fc4ba899db3f41450b1c4a78e2834882d32a6d3f7ae8d9b032fe021e1faacfd9f99ecaa18e1ec4d806914a90efa2d42db741df8bb662800dc408fa8db0 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vmdk.xz) = 4d4660deec67ede3dbdcf57ae228243542f1d7c138e4551acd55873b4feaaf21c1f1d3363eda093061c27aaf00c24d4bb436932617225463068fd723327485f2 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.qcow2.xz) = 530c1ce40e81eade8ffe19bfd5c3761f0fb9b5ef9f4f618489bb0450b116dcf984a7fea75059565a6d534cc98aa7154c6b783683faaccb226050d53ca679b97e SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.raw.xz) = 4d62be9167dda86ad2b0341ddf68ee151ac3f1a007be7fc29f9f2575d2962f01934edea2bf3ca3f2f827082272bab73dfa11db58ca735363df5e689c7031f4da SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.vhd.xz) = 56cb81bd589a41140100c099f62a084ab7943958ce7d7178b8753b2495dd275a6d263a6e56ea0cef86647fc802dca69d523158f17f3179e2756e3856eb8683f5 SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.vmdk.xz) = 60e4b040af68e07e476658745196ab3eace5f30929728ee7f87dc4b3ce5964e052e7a413eca28b9c4e88c8662ffbaee871b7302bafe7199ad0b9f084349d0572 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.qcow2.xz) = 7afc20d01c355864c7980a65345d5ef0f2c9821341ef673aba8fe7ef86280c79 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.raw.xz) = 86cc5805c3c2490e042d6c26f81782cb396b39d4a64bea3868acd9d2de2bfda4 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vhd.xz) = 8d9aa4cae43527393fa4d410a9be642cd9026cf1b4f319a170c5c83b92372cae SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vmdk.xz) = 077013f930b844ef7386ecd775f20f7563ef028be0e1202eea17101ea8bbfa78 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.qcow2.xz) = c519957239f7fbe40ab9e4b192e36416431d8747599227c0995f3bb5bfa5acac SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.raw.xz) = 13b8492fcb524c3ba3f88a62b61a122f4c390436de791504d8a8280f9386b663 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vhd.xz) = 5d57379dc82cc338ef6961281972be2833716d21598bc4f791457ba81df82876 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vmdk.xz) = 56947a7aeba70ea15b92c8201a4528382df4ba08209aaf0614631e661701e4c8 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.qcow2.xz) = 7afc20d01c355864c7980a65345d5ef0f2c9821341ef673aba8fe7ef86280c79 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.raw.xz) = 86cc5805c3c2490e042d6c26f81782cb396b39d4a64bea3868acd9d2de2bfda4 SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.vhd.xz) = 8d9aa4cae43527393fa4d410a9be642cd9026cf1b4f319a170c5c83b92372cae SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.vmdk.xz) = 077013f930b844ef7386ecd775f20f7563ef028be0e1202eea17101ea8bbfa78 o 14.0-BETA2 amd64 BASIC-CI: SHA512 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = 4a4fb9b68b1417c20b125d46e4cb2ef5d999b3e0babf351230dc253ec8d60bb1dfab899f97d42b137254f53367d2d04ec191b152110897a9b8407b52352a339a SHA256 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = c8f74db4180477967f7ef86d1a05c904195872532df49c3138cb9df1af2def4c Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUE9q8ACgkQAxRYpUeP 4pMkzBAAktkgk+iDikgm7dSEmxv5QfNrXn/WfJFAtlh9OmuRrvkZVmhP42zQ1NfM hbXJK1QIRLNuqfBgD6JNa+q2mItvnELNfSr7iHKdVwckriKuxs1MRGkGJR4uOwxj SrO2QbBeIY2gn6P1qlairiwg8fikgvUx3B3j9WdpGDejV6J4caeq8kS4HF8y4KCm /wifyBNWQu58fCda2A5fCRjRuPGC4LyRWNwoStbbjGoeI8+hZXiotD9prK7R/sMp qQ6B9NaIB11REwuzP4/YgbCJuXk1dYTnBDXS3rsKTj9hTDIwo7lqpDzHCPxvNBho Zi9d/NTCz7JB+AUeBtVK7cmHrCN2l7Qp4GQ2bsd4qEm/YkRK/s0k2Xi5TuQ2II/E RlIOOAP2xc9doWhNTIxOg5W1EtLjsuKFqevijc6DP2XCs3RI9/exqYgs9NWfp6kD FLMVSUODMWQIKrbgIbEIICLNsLW6RVh64IUwwcvjNzVBTuPIBcaRqhQMuyBi3Pnu eCGphLKLkfS8vUQKbSm3f35hxvZTdVV4iDFsp+F5rL1pLj7L5AKo6L7q71fwEenJ S9ajicIOrgR5UcycvF2v2sryGoPRG+oz0R4WVm3iMxuqb7VONPMK3orcxmi08ItF HZwIblvRWLVrOXShplsuEeFgaTZOkBzH9Rx9SafZiH1lfBNiM1w= =wCQk -----END PGP SIGNATURE----- From nobody Sat Sep 16 03:31:23 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnc6Y0YmSz4sXRB for ; Sat, 16 Sep 2023 03:31:33 +0000 (UTC) (envelope-from madis555@hot.ee) Received: from SMTPOUT02.DKA.mailcore.net (smtpout02.dka.mailcore.net [81.7.169.175]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtpout02.dka.mailcore.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnc6W2vcZz4RfS for ; Sat, 16 Sep 2023 03:31:30 +0000 (UTC) (envelope-from madis555@hot.ee) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=online.ee header.s=mailcore header.b=fU89r7Bc; spf=pass (mx1.freebsd.org: domain of madis555@hot.ee designates 81.7.169.175 as permitted sender) smtp.mailfrom=madis555@hot.ee; dmarc=pass (policy=reject) header.from=hot.ee Received: from SMTP.DKA.mailcore.net (DKA-SMTP01.mailcore.local [10.1.0.51]) by SMTPOUT05.DKA.mailcore.net (Postfix) with ESMTP id 4D5AFE0089; Sat, 16 Sep 2023 05:31:26 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=online.ee; s=mailcore; t=1694835086; bh=JUIOjmiLLO2bPC9yMfYW0MfjegurNQrELUmORqskPZc=; h=Date:From:To:Subject:From; b=fU89r7BcWSMJYmlCD0plnZmOezbukAxDKNmvBXx5p6o4Nr70FOmmUFZass5Xjr/Lh ttuvb4eo8cToS6egDLb4C2qFT6VYgzmMnCVDzjKAoErXO+QtAih740HxQSfjlTaGkJ 47HUhfjlhPgteUi7bRYcRYF7t0A4WLQ79jw4Q21KNgnIHCu6wdYQ6LHi2J+j6seiFf adEM6bdYxW3bljKqeIhaeIZoYMNLRsLHpkAUqqGeHSzGtt4xxGaNj1nc2rR5Q7AH7a 8OeryiA+qppDRTaPxMHTsX9D+n3KCDxyyamMmDGayzpNaVkRPO0+y1vnv3YAq0Q8ty rVCNwGOxazlyg== Received: from [127.0.0.1] (111-190-35-213.dyn.estpak.ee [213.35.190.111]) by SMTP.DKA.mailcore.net (Postfix) with ESMTPSA id 61B7F400B6; Sat, 16 Sep 2023 05:31:27 +0200 (CEST) Date: Sat, 16 Sep 2023 06:31:23 +0300 From: Sulev-Madis Silber To: freebsd-current@freebsd.org Subject: time instability User-Agent: K-9 Mail for Android Message-ID: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[hot.ee,reject]; R_SPF_ALLOW(-0.20)[+ip4:81.7.169.128/25]; R_DKIM_ALLOW(-0.20)[online.ee:s=mailcore]; MIME_GOOD(-0.10)[text/plain]; ASN(0.00)[asn:47292, ipnet:81.7.128.0/18, country:DK]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[hot.ee]; DKIM_TRACE(0.00)[online.ee:+]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[hot.ee]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4Rnc6W2vcZz4RfS there's something between (working): 47d997021fbc and (not working): 03bfee175269 that causes this to happen: # date +%s 1694821998 # date +%s 1694822034 # date +%s 1694822036 # date +%s 1694822003 it's armv7 allwinner h3 board this issue happens in=2E i have no clue wher= e to look except to brute force it maybe tomorrow what was committed in past two weeks that might cause this? running ntpd and powerd were killed, it didn't help a bit was real fun too, as time machine seems to have been invented, but, wtf! From nobody Sat Sep 16 05:25:14 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnfdp5Sgdz4t3vp; Sat, 16 Sep 2023 05:25:18 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnfdn5J2Tz3G5G; Sat, 16 Sep 2023 05:25:17 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b="cpRUukU/"; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::62a as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ej1-x62a.google.com with SMTP id a640c23a62f3a-99c3c8adb27so357783466b.1; Fri, 15 Sep 2023 22:25:17 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694841916; x=1695446716; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:from:to:cc :subject:date:message-id:reply-to; bh=BBYsQ7EMpknNBljIkOg0VXbOMa7Ec4WJbpq0L+r91lQ=; b=cpRUukU/sFnELkfiCdnDz8tzFFO85kmUo6eE9nnoi+S6prcawX6ODk87w4MO3yFp/L tOtyBZavCy9SbwBkGJpQNZYOLPrqSHB9DtBHZjRX6fy2sQmggyR03wZ32DiV2/FxSkn4 ElU0L2QfpHQzLd6IwUOIA7uli6jWsu9jyfljl1g4ZMo6jQt+DRs5SibrSZgfW41h46Ca d7gBRlAlSUleCr7mmg0z/Omf6E9prdG4fC8upJctku9o0IERRvHea0ZLBYcxyAIDsWPq YGQMq1ynYav81cTfcJAKWQE3pR2GtEbmN7gDrQW+Pqu+MMu5LQOVriKh2QuGoQpd04j8 x84w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694841916; x=1695446716; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=BBYsQ7EMpknNBljIkOg0VXbOMa7Ec4WJbpq0L+r91lQ=; b=guK/1bjh1hRkE+x22MmEQvDXWS01iUBRZz0MZlQI645vdKlHMVLLgxj4BsArjikthP SmTx9aZwTeopTjFH+HgSbRKtNtdlyJyUN3IQf7/cGUkxO2Hc1axlzY/rK95Wt9tHdoI2 FUzPaXgcf+MNXBJAOmq2yu5oaQGrAw73eN1zljg7/9ol95eaKqL9dC/G77hXfMIjtWPD lrLg1AX50yX2aRqKiCQDCCJ48z0pQY8wlyY6oPtV77jUQgIIfTGMTkrk6EJXX/uWrSL4 HkvmRLb05rnOYMHPWso1nHZoy6FhDP+gQ0Z/WHFgTmfe8LgFHRVmP5OIv79Qmbl0FfhJ Gvpg== X-Gm-Message-State: AOJu0YwwuPgKZw9QF8AlgUUgYuWcvZ5JHKOiFcXYIjQcHAaq42petKZB Q8xqCUxrFJSmP0BNimmz0zXgPgh4r9w= X-Google-Smtp-Source: AGHT+IFOFNPHFUIiFrrFAi/iCXIqJJxlF39ywwpoG5dVVLczxvcENTEeI2gfWPe5Jx7teLdCh2AC1Q== X-Received: by 2002:a17:906:8a76:b0:9a2:86b:bb18 with SMTP id hy22-20020a1709068a7600b009a2086bbb18mr2930484ejc.26.1694841915885; Fri, 15 Sep 2023 22:25:15 -0700 (PDT) Received: from [192.168.1.6] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id z21-20020a170906241500b0099b76c3041csm3278797eja.7.2023.09.15.22.25.15 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 15 Sep 2023 22:25:15 -0700 (PDT) Message-ID: <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> Date: Sat, 16 Sep 2023 06:25:14 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Content-Language: en-US To: freebsd-current@freebsd.org Cc: freebsd-stable@freebsd.org References: <20230916002831.GU52318@FreeBSD.org> From: Graham Perrin Subject: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) In-Reply-To: <20230916002831.GU52318@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; FREEFALL_USER(0.00)[grahamperrin]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62a:from]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rnfdn5J2Tz3G5G On 16/09/2023 01:28, Glen Barber wrote: > o A fix for the ZFS block_cloning feature has been implemented. Thanks I see , with in stable/14. As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT n265350-72d97e1dd9cc): should we assume that additional fixes, not necessarily in time for 14.0-RELEASE, will be required before vfs.zfs.bclone_enabled can default to 1? From nobody Sat Sep 16 05:30:30 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnflw2g1nz4t4mY for ; Sat, 16 Sep 2023 05:30:36 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-ej1-x62b.google.com (mail-ej1-x62b.google.com [IPv6:2a00:1450:4864:20::62b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnflt5Fhtz3Jxr for ; Sat, 16 Sep 2023 05:30:34 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=mtqjemRI; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::62b as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-ej1-x62b.google.com with SMTP id a640c23a62f3a-9ad8bba8125so364446466b.3 for ; Fri, 15 Sep 2023 22:30:34 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694842232; x=1695447032; darn=freebsd.org; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:from:to:cc:subject:date :message-id:reply-to; bh=GvIkd4HpTMuM3a3zDlG5KWIXuxNrU7wzSgs4XJI/xAg=; b=mtqjemRI0M37xCoiVLUCeqmheKLdUX4zV5VGLNhG5MnXksYmgwnNssWmGnvCS7K8fN ktgLWPlcwtErEIeDMKH/EVW3+PWMXZQljxbVy4zXfvQ2ij14CQWCwSsKN4yAlsZhMhQH uTFelUHgeMTYhtxq4BQcapyyHMMVg4E2FJl1QQN9FHp7eWzEBRxjuqvQzoD8wv/zI9Mu kyvF4ocqYTC7KaSiOGch7aU9Iw+72L1OVhREbV6siL0KTtcBCKD/iXKt4Rzf8xHSwHBX 7p+n7kf/dy36UgU1/vEizv5931GunYO/YC0efkhIPzlafMylxIqPs9IYC9v6XvZBqHc9 xeMg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694842232; x=1695447032; h=content-transfer-encoding:subject:from:content-language:to :user-agent:mime-version:date:message-id:x-gm-message-state:from:to :cc:subject:date:message-id:reply-to; bh=GvIkd4HpTMuM3a3zDlG5KWIXuxNrU7wzSgs4XJI/xAg=; b=KY059Yj/6N58OyuzaubZixcagGJ/EZau/96rVWt1+vWS6h4EqMjqts4q0IPf45uoRA ZW5trjP1GviXsygXVXFlwQLlcDxak7O28Nhsl8ziw0xQqk6v/ft/Eehobq2Rmyp616DB sYyJQQzCflgm9r5iE1AoPzXlmzYq5z3d54Izd9CQj1j6v3Y8hNW/KQt/S+0zw3qTi/8i fMaEEWco1WWYVrz9RV4FIKuJEdbyrcSPxLiiJ23lfaBRa5rv5G69pXk+91BdHjyN/Tfu KeEsM7zGaJJtMj4tMYvx8GAT/ZvS0GY6S164+4TIS59enKALFkRWitOJ4ACl2kQo4d// jz3Q== X-Gm-Message-State: AOJu0YwF6bKCGfa5bJOD+jsYNfPXZBa2PKgZUADXJCpcnv6YzaCSWfpC CzyUmbFhXMNFFNx02M4yiBo59B4Ukoo= X-Google-Smtp-Source: AGHT+IEy+goJjBsEawcaStOumySyDn+LnrXlQZjMjmZALLgAGd4DjKozVia86gHbwfWB+5O5JYgHtw== X-Received: by 2002:a17:906:cc4b:b0:9a1:d0bb:d215 with SMTP id mm11-20020a170906cc4b00b009a1d0bbd215mr2684624ejb.5.1694842232217; Fri, 15 Sep 2023 22:30:32 -0700 (PDT) Received: from [192.168.1.6] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id u14-20020a170906068e00b0099ce025f8ccsm3261961ejb.186.2023.09.15.22.30.31 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 15 Sep 2023 22:30:31 -0700 (PDT) Message-ID: <619a6249-da56-8638-00cd-a689f47a64a3@gmail.com> Date: Sat, 16 Sep 2023 06:30:30 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 To: freebsd-current@freebsd.org Content-Language: en-US From: Graham Perrin Subject: buildkernel: Cleaning for nvidia-driver-470-470.161.03: [all] Stopped -- signal 22 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62b:from]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rnflt5Fhtz3Jxr The tail of a log: … Building /usr/obj/usr/src/amd64.amd64/sys/GENERIC/kernel.full --- kernel.full --- linking kernel.full ctfmerge -L VERSION -g -o kernel.full ...       text      data        bss        dec         hex   filename   20670038   1677321   19288064   41635423   0x27b4e5f kernel.full Building /usr/obj/usr/src/amd64.amd64/sys/GENERIC/kernel.debug Building /usr/obj/usr/src/amd64.amd64/sys/GENERIC/kernel --- all --- ===> Ports module x11/nvidia-driver-470 (all) cd /usr/ports/x11/nvidia-driver-470; env  -u CC  -u CXX  -u CPP -u MAKESYSPATH  -u MK_AUTO_OBJ  -u MAKEOBJDIR  MAKEFLAGS="-j 32 -J 15,16 -j 32 -J 15,16 -D NO_MODULES_OBJ DISABLE_VULNERABILITIES=yes KERNEL=kernel TARGET=amd64 TARGET_ARCH=amd64" SYSDIR=/usr/src/sys PATH=/usr/obj/usr/src/amd64.amd64/tmp/bin:/usr/obj/usr/src/amd64.amd64/tmp/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/usr/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/sbin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/bin:/usr/obj/usr/src/amd64.amd64/tmp/legacy/usr/libexec::/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/bin:/usr/local/sbin SRC_BASE=/usr/src  OSVERSION=1500000 WRKDIRPREFIX=/usr/obj/usr/src/amd64.amd64/sys/GENERIC make -B clean build ===>  Cleaning for nvidia-driver-470-470.161.03 *** [all] Stopped -- signal 22 ---- Why might a stop occur, with that signal? My src.conf included: PORTS_MODULES+=x11/nvidia-driver-470 From nobody Sat Sep 16 11:06:31 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnpCd24fwz4tJ1r for ; Sat, 16 Sep 2023 11:06:37 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnpCb4nJMz3K7G for ; Sat, 16 Sep 2023 11:06:35 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=nMBr4Tn8; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="egDQh//Z"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id BEBBA5C014F for ; Sat, 16 Sep 2023 07:06:34 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Sat, 16 Sep 2023 07:06:34 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694862394; x=1694948794; bh=bi xzdj5hS2UaD/l7qGfJffSgh1BNMkfqsXsMZittR/k=; b=nMBr4Tn80v0le7PNQ2 UCn8N7Fw8auWCkcezM/np7k2oWKneE/v/KLXX+NuWYs96I37YAfHW7EqVALaasI4 exhCSTDi1tbISSywum3XINVqNWoMn7qZtCtOENs89OUngDIxDsyKOcQxQh7z3+5F /pzEbm32zeCXmjRfceHmQx5PikcD0sE8eMq+KAokLdeGuaatE5kQSpqfp5qs+ZJy K1Z8iZL/QwkOTaqSJ/t0FDNdMu2rmTDeb6yak/dBesMvIcRVidFppaPbI4Yi9a6k gFseMIliClxZhQmupVYWuorFKlb4AqatJkU1evbBio0kj81sDCz4l3Bybspsu+S2 aUJg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694862394; x=1694948794; bh=bixzdj5hS2UaD /l7qGfJffSgh1BNMkfqsXsMZittR/k=; b=egDQh//ZrOp94q29Vp59FQ37p1Fno 7YGMj6ljKjFJDtV18QFUGmaXM1Vpk3I9e1wZMjqKjrAyCeAIh93Tsu1xu1Z/wXpU /bJFFsy1W4k6QwhGwXlovl5vcEDm93njnvTY8vjuD0FbPi4/7cBD34jSm3AUpAJ6 YvmKCbo4lxUeq9qhirfxVBNyFaSd8X6fDbkfD8agOEvCWa385s62Z2k3WtKeKroW 8Nq284hAezSUmnPWl/MjddXDa9GkvlVJfLMt4tDAgdEHkE6HrGWU05/RTfrsT4Ky sctTONCT2MYFnUVAeHF7vvAUBzeXjIABb1grW0QrG87XAob8A+CLqQ7FA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedgfeeiucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 07:06:34 -0400 (EDT) Date: Sat, 16 Sep 2023 12:06:31 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20230608181115.7c97ea19.grembo@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20230608181115.7c97ea19.grembo@freebsd.org> X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.61 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.91)[-0.912]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RnpCb4nJMz3K7G On Thu, Jun 08, 2023 at 06:11:15PM +0200, Michael Gmelin wrote: >Hi, > >I didn't dig into this yet. > >After installing the current 14-snapshot (June 1st) in a bhyve-vm, I >get this on boot: > > ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 > >(booting stops at this point) > >Seems like the boot loader is missing this recently added feature. This is still happening in the following context: host: stable/13-n256033 bhyve guest was installed from FreeBSD-14.0-BETA2-amd64-bootonly.iso error on booting the guest ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 ERROR: cannot open /boot/lua/loader.lua: no such file or directory. This used to work with earlier -current (14-current) bhyve guests. Is there a workaround? Does this mean that any bhyve host needs to be either at or above the guest version in future? In other words, is having host version less than guest not meant to work? -- From nobody Sat Sep 16 11:55:19 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnqJ55fGFz4sWPJ for ; Sat, 16 Sep 2023 11:55:33 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnqJ50MxCz3SVZ for ; Sat, 16 Sep 2023 11:55:33 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20230601.gappssmtp.com header.s=20230601 header.b=1uybr2Xh; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::629) smtp.mailfrom=wlosh@bsdimp.com; dmarc=none Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-9936b3d0286so394723866b.0 for ; Sat, 16 Sep 2023 04:55:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694865331; x=1695470131; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=wtiujuOLHHgpsJyQ5JLY3ELxHl4FcFrZlbdhD97Xh3I=; b=1uybr2XhLjhOVH9X52P6nPozCqlN+Xh/ZZUF2zkEDag4bZ4Lvv10RiuASFUYPn4CRp q5uIRW6GeM85wDnt79xgtdR/OhATo2FPskrvEYaJ57KuL7/1Lfh/M7X4qiiTPH+f1csA VxXpQFUaHW5SBwQOKzPLjj6HztosOBQUTNMUsp2NAM0K44mS48KZcSYp2v6jnuFbTion Tf9iMj+ItqwiKkdXrQZVIRUJu5brZGG/BHlIuBXv6DpcfAgiBKvGuW4BX6i44kWIbEHC cUCWfJz7ruDxf89u/CaJziFxuoVyCk67LZ7+ltAX1WYkx11bUHLfqjRdlHHam6doUOFq X2Ow== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694865331; x=1695470131; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=wtiujuOLHHgpsJyQ5JLY3ELxHl4FcFrZlbdhD97Xh3I=; b=Rj5MgxtWrsJ0UZQuJ9DEhnO+NyL0cb9H8S7lOkG6cT5ZpgrNEe7nu0toikmXRbNb75 imHZJ99fDDX35lHALmk+FVS3uwCnrwq5J4JSuFhUr5N9SHGqcvr7WD88WYIiMRrbh/zj yf/snM4WAWR8K2MxJiasRD+9P7EHlhKR/kVR33Cao9nUtwcbfiimXCSO5nlS6bs3mhuN v59QcBACJ8lWG8dCyCLCQ7XsbJE/rNSuQ14Rmh+RTo083QF/StvnRSbTkYE7FDc2+Dlb FBsNXKkK/2j1qDDC2qB+BnMPxx3sX/leqyqho4usa30xtj4WtA2oOOuz+JcxRlWgrdXo tlDg== X-Gm-Message-State: AOJu0YxsNcQE5XVNf4huDyHkxKkg1u2ZUjP3UWzSkRNHj/YWykZrG2fg GlH94NzqDw3QfY1HE2ufbxi9uiOFehR149LYgb1Rz3ufyMeTTGyQqg0= X-Google-Smtp-Source: AGHT+IHxK6V1SC4B12lFEBlERb2+8EFELw/BN3vg3Ml2sw9fNrXM1zY+O3cLx4TxOhyvHqJ163oppAjW2o90Iltqq2s= X-Received: by 2002:a17:906:18a1:b0:9a5:c401:85e9 with SMTP id c1-20020a17090618a100b009a5c40185e9mr3560233ejf.27.1694865331233; Sat, 16 Sep 2023 04:55:31 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <20230608181115.7c97ea19.grembo@freebsd.org> In-Reply-To: From: Warner Losh Date: Sat, 16 Sep 2023 12:55:19 +0100 Message-ID: Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature To: FreeBSD Current Content-Type: multipart/alternative; boundary="00000000000002c4a506057896bb" X-Spamd-Bar: -- X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20230601.gappssmtp.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::629:from]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_ONE(0.00)[1]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20230601.gappssmtp.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[bsdimp.com]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com] X-Rspamd-Queue-Id: 4RnqJ50MxCz3SVZ --00000000000002c4a506057896bb Content-Type: text/plain; charset="UTF-8" On Sat, Sep 16, 2023, 12:06 PM void wrote: > On Thu, Jun 08, 2023 at 06:11:15PM +0200, Michael Gmelin wrote: > >Hi, > > > >I didn't dig into this yet. > > > >After installing the current 14-snapshot (June 1st) in a bhyve-vm, I > >get this on boot: > > > > ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 > > > >(booting stops at this point) > > > >Seems like the boot loader is missing this recently added feature. > > This is still happening in the following context: > > host: stable/13-n256033 > bhyve guest was installed from FreeBSD-14.0-BETA2-amd64-bootonly.iso > > error on booting the guest > ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2 > ERROR: cannot open /boot/lua/loader.lua: no such file or directory. > > This used to work with earlier -current (14-current) bhyve guests. > Is there a workaround? > > Does this mean that any bhyve host needs to be either at or above > the guest version in future? In other words, is having host > version less than guest not meant to work? > Yes. The boot loader comes from the host. It must know how to read ZFS. So either your bootable partitions must not have com.klarasystems:vdev_zaps_v2 in your BEs or you must have a new user boot. I think you can just install the one from 14, but haven't tried it. Warner -- > > --00000000000002c4a506057896bb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sat, Sep 16, 2023, 12:06 PM void <void@f-m.fm> wrote:
On Thu, Jun 08, 2023 at 06:11:15PM +0200, Michael Gmelin wrote: >Hi,
>
>I didn't dig into this yet.
>
>After installing the current 14-snapshot (June 1st) in a bhyve-vm, I >get this on boot:
>
>=C2=A0 ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2
>
>(booting stops at this point)
>
>Seems like the boot loader is missing this recently added feature.

This is still happening in the following context:

host: stable/13-n256033
bhyve guest was installed from FreeBSD-14.0-BETA2-amd64-bootonly.iso

error on booting the guest
ZFS: unsupported feature: com.klarasystems:vdev_zaps_v2
ERROR: cannot open /boot/lua/loader.lua: no such file or directory.

This used to work with earlier -current (14-current) bhyve guests.
Is there a workaround?

Does this mean that any bhyve host needs to be either at or above
the guest version in future? In other words, is having host
version less than guest not meant to work?

Yes. The boot loader comes from t= he host. It must know how to read ZFS. So either your bootable partitions m= ust not have com.klarasystems:vdev_zaps_v2 in your BEs or you must have a n= ew user boot. I think you can just install the one from 14, but haven't= tried it.

Warner=C2=A0<= /div>


--

--00000000000002c4a506057896bb-- From nobody Sat Sep 16 12:12:02 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnqg951Jnz4sZyp for ; Sat, 16 Sep 2023 12:12:05 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnqg91Tmqz3WW2 for ; Sat, 16 Sep 2023 12:12:04 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=QfO0WyzH; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=WgrzW0wY; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute5.internal (compute5.nyi.internal [10.202.2.45]) by mailout.nyi.internal (Postfix) with ESMTP id 6D3295C012B for ; Sat, 16 Sep 2023 08:12:04 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute5.internal (MEProxy); Sat, 16 Sep 2023 08:12:04 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694866324; x=1694952724; bh=K8 gpzlOAiOayXpv3b5cTMs4DAjLgZge7sS0/E2GLUjM=; b=QfO0WyzHbo2wZ7YlgV opDkuKGOV8UPg+gFgPjyokzJVFnJURCPxjXeyIw2AedO+oVmpeKpuPPo9vtYx81F vKX/zuznmUJs+Wm3aWAzfPNhT391g8N2zHMknHyoZqf2iLzT4SN1hv846eYM/cwy ETOPO8VaflxOuVI8AzM1cnnznXJ6ucuN5IbBaQblM604jIxveOTaqyV4EZjDgtFP 2WSLZ8F5lNUWxZsqbphx4dGAT51r0lKr1pvgdtgHSu2gLV2Mx7cp6mLqdN0iRU7e VlpO3ZgYZlmsU9K8pbKA2IEqUuOiHuGwqjHWsRMCd6fJbhvfUOvx6TDQCHNQ/Bxf jzcA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694866324; x=1694952724; bh=K8gpzlOAiOayX pv3b5cTMs4DAjLgZge7sS0/E2GLUjM=; b=WgrzW0wYjbcx84SIi+Kw8IVXSdCDQ CIB2g79LSLyS3Elj3kmdRxDmgUGesqSpmGHrUJuw7h97B3CIWDAvXlO+EIs5+QRz Ultt7Tzk2KhYUB0bUIDea6JDnpjHDWQCY8MDDZEVtxYJvwehIF0hkS2gCAAn6/YO HxnQiscey6/rdBY3N+l/v80vWKIdBQYMsxR3j6h2N+K/4UuLSlucACQD7kNx82Vt 6uLfKQ8J+BJNWTjHyytqFcdJRtj2OVKab6t2niiBQ78TYUAwfsmpERy6FRPLa0qM 4e0n4DSbPVflKP+tzJHk7bdpc09An1hgbFezYqy3voK5K2MDlflbiNUMA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedggeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 08:12:03 -0400 (EDT) Date: Sat, 16 Sep 2023 13:12:02 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20230608181115.7c97ea19.grembo@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.51 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.81)[-0.806]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rnqg91Tmqz3WW2 On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: >Yes. The boot loader comes from the host. It must know how to read ZFS. It knows how to read zfs. On the host in question, there are many guests, some with zfs-boot, some not, just file-based. What the host is not, is zfs-on-root. It boots from ssd (ada0). The vdevs are on a sas disk array. >So either your bootable partitions must not have com.klarasystems:vdev_zaps_v2 >in your BEs or you must have a new user boot. I think you can just install >the one from 14, but haven't tried it. Can you briefly explain how I'd install the one from 14 please? -- From nobody Sat Sep 16 12:32:59 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnr7L6Fhfz4sh5L for ; Sat, 16 Sep 2023 12:33:02 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnr7L1kvZz3ZTF for ; Sat, 16 Sep 2023 12:33:02 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=KzMH2BBp; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=S43Vaa67; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id E0BE65C00E8 for ; Sat, 16 Sep 2023 08:33:01 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Sat, 16 Sep 2023 08:33:01 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694867581; x=1694953981; bh=vm mNFDed1OTZH/g3ehsP3Jt8YIrsh9izM+ZpKcpk+hQ=; b=KzMH2BBpW9Bq0JtlYW luc+WBSZwqAKSYm+fxRA5X2WXn+yMDh7adptmjBC4893QTfSga05UpCmxYzsjbNv b+784UiFUvvTW9TcoQ+QPuSVQK2QGs0FKAT6B8finQuKBcvG7ireKjZFYFtZHTkF /TZvfQK2Ck4N6H3yt6raJKC4jqUYkWTfGWXQ/1XE75epFV5gji8VjA44x6qDSTwW p9zZA5yDPGf44U1UO3hseCDwMRpVlDyDxC5I4JMozVPqKXvfY3a41/MK6WZIyQ8k wtuxPcvkjQosSgn8OH8Qb2IELZ6xg15x8QDMdO5lLEKTQoioQIF3u+GqsJ0TQWWN Y7Zg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694867581; x=1694953981; bh=vmmNFDed1OTZH /g3ehsP3Jt8YIrsh9izM+ZpKcpk+hQ=; b=S43Vaa67qSRtkE/tZfs31fu5dOX44 xLW01onSzvhr9Rx3sEfHhQ++IV4Ow5v5xiFmG8YRibi2E/0Vs4tdxDSIjpbU4DDg AqrFiUuFou5LArEnIx53Yu4acaRZXYYiDy54XPXE3Xqhvhhcm8BK3t55bpFo5V0g G2VggeQelVSJQ06uu6NNRpPjwcMFMboYm+CBO0Afg4+6ttC5o7x5wDHRcqVgz2qy 7rTuiYSgG1IimppgkGeWCgTB3lqefGqe48K6A+r48xqrlySKhjN8e31ZD4A9cN/I vpXuPZJkf37RnjRm27JXV9ia5V6RvY/Tw4lfonCQZOeM3WK2pnUJK7GvQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedgheefucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 08:33:01 -0400 (EDT) Date: Sat, 16 Sep 2023 13:32:59 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20230608181115.7c97ea19.grembo@freebsd.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.68 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.979]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28:c]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rnr7L1kvZz3ZTF On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: >Yes. The boot loader comes from the host. How does this work for non-zfs aware hosts? -- From nobody Sat Sep 16 15:43:49 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnwMs1M74z4tW0N for ; Sat, 16 Sep 2023 15:44:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-21.consmr.mail.gq1.yahoo.com (sonic310-21.consmr.mail.gq1.yahoo.com [98.137.69.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnwMq67gsz4cgB for ; Sat, 16 Sep 2023 15:44:07 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HcgJC1aK; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694879045; bh=aoKPLPM5y3dPHQYJCXshWiGtAMorY2twpx3KSBwS6hc=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=HcgJC1aK7Y239nATgfVVKbSolYVO/IFlL5tY2Mf5eXyfntugKAXTPvCe/lv4TTcWqRxoX3Ft+tgpcy6SBbsijpsFHj4ht2Pk2fmxMCKrrW1aOiUuLfD1TMkMlAk8oqIhMOOdC5SGdThqpP05uarWSPWbdD4IEvMB32IJz5LwVAuEI5nIlcuixjuD9B5slcKG+Dz3gBMD5RcJOavzj+re3xSfLCIwXc/bOi0RH5v7/BYWT8+j6BgNODE8ZfDfxHTBU/W78lnN/TzF9B52+0iKufd4FVWzbtQ8SEJaPVvpChatGhh9+dj/9zTWZVPk3iQ3Ms0cskD39D65ozXaTHlt2A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694879045; bh=XDCl9GSAjv8r+3NLLhL+1EU39Fo9p9Nx3OMPfeH2NWH=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Mbbgyya3So48QuU80CBWnM98vt/IjIRzdUWIlBE+nkeba9EylCWLtetlFy9XXkxc7bLCR+iqrrSaLqY1pf1F61KYXLrFM9T1EvLeUfQXRSC8NAYsTecnNxJ/6CJyAM+mAIsRTxZuMlJI0i6CW+YvBuzOctHMW1P/ffHW34Slb1oht6cXWZtSCLGiK06CI0JNcyAcBQfyUQ0i8F1MvNh4MmwCrPmUKLxFIM7G0TWmqaf0wJUp49i4ZrRSbQeRJVytuke3X/oE+GLkAS9J5vkZA9bsLlA6BgQotctaWYzbxqK5d4dbtEYng+AxeYbw0Foc7j1eUUhzyk2Onl7GP6uOzA== X-YMail-OSG: C.b5LOwVM1kvbcz.Ogad41gnxldPkxwzlKFBR8BDGdcgcszELzzNs_2cKpwxb7_ .HRJy6IWLLpVrxSuFsSnL_.xJdYsRRDwfYBqjvERXUfjY.iFrSyNOvEew2UalPEdvDaJ75eNvq_J WfBZM1BMt0OScorZRMGjGqDfq5G2zPVdgCejc6ofVHlkaoGZkRTu.O8ZRaWGqD_FQjrFb_yuqAu9 ZnF6RshvSfCcZASX_3nwj8jXXBiD2PxF2oh7Dadt6Ztmtvqt1KJZzi9Ue30dUmEZtVg2vWhtx9dJ bcT0ThBa1sHCpHZoooBgf8VN.gCpBiMcaKIw9YpRzZAMIndsCYm3Ujea_6k6vTdMETqavyqWfQUj TVQ4HEsvSmJAJrngDGfsoAkgr3CN5L9D0faDRzGv06IB_kLBoXTYYpE2YeSozLqsvqANDmBxseJu rPabB977UPRzCg40OaQMaxfu4uRJPTbs0OU5tPAEkI16xkgDKF5a5Jv649Kw0e6SQrj4J3VilMal giCzVVfixg4ywW0nKtyEHZq_ip0h8m6c.yGhkUAdbnRlZ9iJiL_T3aSnBO8CoGjvL8bhFvzd8iWm X6jWdKrU7a.lFdxgvSdAVr.02BU2fDxSmZks6B74rXOKEVUfh0RVwnjHQkYgXkmrZnLPZOhmaAN_ O_XriilIfyQHlbgik42C6sVS.Yf4YegrWQwuTeYsvjctB5qKRsCrNn2sIqEnVROAkJnbpSaB9LS3 .yEiM.iMYLXkIKeoE.C8av6jL85zS8PhG_wOxK2L1PDUMEm75T.144jPqyDSNhk7wdWih4AoXR0l zK1Q2gclgYsrDa6X1Lfr6hrZ1mRhUNwfO1IO8ooOgE2RfwIUIwxjTrtST1yk1WHEJpQTiGJ16QBi 9NULNu.D9i9xt2oJuD9hFNDBahcfdzs2ugl.c3W8Fntpf4IkQzpI2gCdAU9W0OmwJSb6BcPNDjIz HZ2MuIonik2bGbMLVwCo.e6P1nr0G2Ue_Djeqk.6TEh99dRV3fbbGUIp7_qjQjmAiY6YOuwryeye l4TQuiPn2kQqJbFqdvpPEZjby.In0KgJROZZWnWUeJ81yYKK9w1RWEoW0xVqBTk5y4vRXOEg5VvO dvMaW8YS8Bs74RchrdgyMrwgFateBHP5KmnBf1G47uoJNpsPLjqG.9dYl3htKpm1K99bHbPXIals Y._lPEkUJfk7H13Ksxs.lQIgQJgVoHCQ3cliG0bPsb_TT_1jDmLZeAza7WiMazoRuq4pO2tg0_Pe UQ3Tj1B_JKrwBtbSyZ2KueekLOq4_zeMHwzDEs7ewaSsPLW1oihALPsRf_zAos5Ls818eDAI_PoS xOKSl0emvvCpu0yrL6dbtJ_M8QUvg0KWTHM0uUSGLLvFPQ2xRZKwMkae5aTpx.xkSwRBbc16KjwR 3XZFDgIlq9uHLCoU6qElfOMCunl_7AVM6qpG_T.xj2I5xU.c1MG8PdFgtx5g.WqGr1jTAjFoBfQi oQr_PWF3PzgrgWK1jAz4GC5XI8Gfv_rUmrJ2VhEx6yTdScxR8DO26J7NIE6OVL4aJ.7KXhUPVWHe sC3R7DjaMq3pXFl9MO0SwyNzZz90louwoiqoAOoPxTaPbDsA4WQFWPV2Y1LKYuqY5Ih1.uO66NxN kY5TQtFYLhgZ9Z5y9kNi9AHbMoEA80OJZv8ZZXoZPrqhgdeqfwx9mnBUvdWY_v_rPKvXisaesR1m cNQcj6yfQ.r4ezZGxnsMxfNlnT8t2elsTCL9xrGvpHQGHg3b2Pe.Fo9tDCtXK7BjagNsbZdyjpR8 Wj2ayoPpkrjjgC94kNrSeVipgv3VZ93B0Z2cleKqw_lXlGXA1V49mLOC152wvygrtuYELv.42iN_ .uDSFQY3FsNp2YJoP2zjRb213G3eq_qdBpCCpmwPQv1diRgW.po3DyynaRckGgoaEzOZGsMSLCrh S.p13ot0kSiTSk2iJeVFH7y5.82AsXnWhK4daIvuz7hw4DsH1mHPJPsNO__B2x9uAgZPMekmNUsz tohQxOk0dymErok3nnIQHr4WJ78C86Ypo3O2sS3VehKD3k_GX8Hcaiep7LMhkJlO_pPT5mLG9RW5 lCh0Cv1LblelBBam3_1l3ZvYlqqbCB3CczCNwsU3fDPEf6AYugSU9d5LpPQJNTR1bbutd7r5MR1c 6v1rl0QWyVbwKPxmLp8oMvZMzB_ZPeEgLe_zrG1oyX28tLp09MiY0Mat8_Ct8C.jl8b99uy5TOO2 _dpbK9C6djE.qy3CzwtnHEtyH4qZA6N5gekNqy5CdiHru7D7XAGNAcpj32y7UkOKyo90Xrq3P5Kz 6 X-Sonic-MF: X-Sonic-ID: 62f9fbd5-9b11-44a5-ae17-32416568eece Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Sat, 16 Sep 2023 15:44:05 +0000 Received: by hermes--production-gq1-77657878bb-9z6zl (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d26a89bd86f7a9014c2ff8b232463fd3; Sat, 16 Sep 2023 15:44:00 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-Id: <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> Date: Sat, 16 Sep 2023 08:43:49 -0700 To: void , Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.973]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.147:from]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.147:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[f-m.fm,freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RnwMq67gsz4cgB void wrote on Date: Sat, 16 Sep 2023 12:12:02 UTC : > On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: >=20 > >Yes. The boot loader comes from the host. It must know how to read = ZFS.=20 >=20 > It knows how to read zfs. I expect Warner was indicating: you have a (efi?) loader that knows how to deal with the features listed in: sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-freebsd being active but not with some new feature(s) listed in: sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 being active. The following are the "read-only-compatibile no" features that are new in openzfs-2.2 compared to openzfs-2.1-freebsd : blake3 ednor head_errlog vdev_zaps_v2 So any of those being active leads to lack of even read-only activity being compatible. (Although, the loader's subset of the potential overall activity might allow ignoring some specific "read-only-compatibile no" status examples.) For reference: # diff -u99 = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-fr= eebsd = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 --- = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-fr= eebsd 2021-06-24 20:08:57.206621000 -0700 +++ = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 = 2023-06-10 15:59:25.354999000 -0700 @@ -1,34 +1,40 @@ -# Features supported by OpenZFS 2.1 on FreeBSD +# Features supported by OpenZFS 2.2 on Linux and FreeBSD allocation_classes async_destroy +blake3 +block_cloning bookmark_v2 bookmark_written bookmarks device_rebuild device_removal draid +edonr embedded_data empty_bpobj enabled_txg encryption extensible_dataset filesystem_limits +head_errlog hole_birth large_blocks large_dnode livelist log_spacemap lz4_compress multi_vdev_crash_dump obsolete_counts project_quota redacted_datasets redaction_bookmarks resilver_defer sha512 skein spacemap_histogram spacemap_v2 userobj_accounting +vdev_zaps_v2 +zilsaxattr zpool_checkpoint zstd_compress (Last I checked, /usr/share/zfs/compatibility.d/openzfs-2.2 does not exist yet. Thus were I had the diff look.) > On the host in question, there are many guests, > some with zfs-boot, some not, just file-based. But with what openzfs features active vs. not active in each case? > What the host is not, is zfs-on-root. It boots from ssd (ada0). > The vdevs are on a sas disk array. >=20 > >So either your bootable partitions must not have = com.klarasystems:vdev_zaps_v2 > >in your BEs or you must have a new user boot. I think you can just = install > >the one from 14, but haven't tried it. >=20 > Can you briefly explain how I'd install the one from 14 please? I do not use bhyve so I do not even know if the context is using the efi loader from a msdosfs vs. not. For efi loaders, copying from one msdosfs with a sufficient vintage to the one with the wrong vintage (replacing) is sufficient. For reference (from an aarch64 context): # find /boot/efi/EFI/ -print /boot/efi/EFI/ /boot/efi/EFI/FREEBSD /boot/efi/EFI/FREEBSD/loader.efi /boot/efi/EFI/BOOT /boot/efi/EFI/BOOT/bootaa64.efi There may well be only: EFI/BOOT/bootaa64.efi for all I know. =46rom an amd64 context: # find /boot/efi/EFI/ -print /boot/efi/EFI/ /boot/efi/EFI/FREEBSD /boot/efi/EFI/FREEBSD/loader.efi /boot/efi/EFI/BOOT /boot/efi/EFI/BOOT/bootx64.efi There may well be only: EFI/BOOT/bootx64.efi for all I know. (I set things up to have the EFI capitalization so that referencing efi/ vs. EFI/ in my context is unique for the mount point. vs. the msdosfs directory.) =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 16 16:11:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnwzZ1NlCz4tcS2 for ; Sat, 16 Sep 2023 16:11:38 +0000 (UTC) (envelope-from tsoome@me.com) Received: from mr85p00im-zteg06023901.me.com (mr85p00im-zteg06023901.me.com [17.58.23.192]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnwzY60Whz4kgJ for ; Sat, 16 Sep 2023 16:11:37 +0000 (UTC) (envelope-from tsoome@me.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=1a1hai; t=1694880696; bh=w5TZeyWFAjqbr1TvYMTijvsoZkBpQbrLTUXkUK1qQEI=; h=Content-Type:Mime-Version:Subject:From:Date:Message-Id:To; b=cSDQakUARcfhF1o5rQD5u+6k951K9dPNtWYiftz3aabinN0I+msMeLU6HoeVRKjvF P2an/cg2MpYzQ2Ihjh/eIjDH8MuoRdb2+75I2aEzcDDPeJYiYoildsjiwbMNpMnpZf qWDUlukwypB6iGOg8GWsMw6u1jReD7EWEshn+p5wRGngOMwU8/d3FJBSUyHsbcHfSI Q202YQQnIl3W3y0pc5QLpYqb7aiiw7Kesi5Gru6b7snjYKZfNpq/mb4xaf3nh+eUG6 LfoEVZowRyKAHc44IBNLFI9Y1Fxry/FtgMWYbSTKab9V8KpTJGvyegAAJUexpQPmks SQ8u/lrYEiBMw== Received: from smtpclient.apple (mr38p00im-dlb-asmtp-mailmevip.me.com [17.57.152.18]) by mr85p00im-zteg06023901.me.com (Postfix) with ESMTPSA id 855306E0276; Sat, 16 Sep 2023 16:11:35 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature From: Toomas Soome In-Reply-To: <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> Date: Sat, 16 Sep 2023 19:11:22 +0300 Cc: void , Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> To: Mark Millard X-Mailer: Apple Mail (2.3731.700.6) X-Proofpoint-GUID: 1RvliQvTGvCA9AZPx4EnlUBqcoowHAs- X-Proofpoint-ORIG-GUID: 1RvliQvTGvCA9AZPx4EnlUBqcoowHAs- X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.816,17.11.62.513.0000000_definitions?= =?UTF-8?Q?=3D2022-01-18=5F01:2020-02-14=5F02,2022-01-18=5F01,2021-12-02?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 bulkscore=0 mlxscore=0 spamscore=0 clxscore=1011 mlxlogscore=999 malwarescore=0 suspectscore=0 phishscore=0 adultscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2212070000 definitions=main-2309160139 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:714, ipnet:17.58.16.0/20, country:US] X-Rspamd-Queue-Id: 4RnwzY60Whz4kgJ > On 16. Sep 2023, at 18:43, Mark Millard wrote: >=20 > void wrote on > Date: Sat, 16 Sep 2023 12:12:02 UTC : >=20 >> On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: >>=20 >>> Yes. The boot loader comes from the host. It must know how to read = ZFS.=20 >>=20 >> It knows how to read zfs. >=20 > I expect Warner was indicating: you have a (efi?) loader that knows > how to deal with the features listed in: >=20 > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-freebsd >=20 > being active but not with some new feature(s) listed in: >=20 > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 >=20 > being active. >=20 > The following are the "read-only-compatibile no" features > that are new in openzfs-2.2 compared to openzfs-2.1-freebsd : >=20 > blake3 > ednor > head_errlog > vdev_zaps_v2 >=20 > So any of those being active leads to lack of even read-only > activity being compatible. (Although, the loader's subset > of the potential overall activity might allow ignoring some > specific "read-only-compatibile no" status examples.) >=20 > For reference: >=20 > # diff -u99 = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-fr= eebsd = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > --- = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-fr= eebsd 2021-06-24 20:08:57.206621000 -0700 > +++ = /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 = 2023-06-10 15:59:25.354999000 -0700 > @@ -1,34 +1,40 @@ > -# Features supported by OpenZFS 2.1 on FreeBSD > +# Features supported by OpenZFS 2.2 on Linux and FreeBSD > allocation_classes > async_destroy > +blake3 > +block_cloning > bookmark_v2 > bookmark_written > bookmarks > device_rebuild > device_removal > draid > +edonr > embedded_data > empty_bpobj > enabled_txg > encryption > extensible_dataset > filesystem_limits > +head_errlog > hole_birth > large_blocks > large_dnode > livelist > log_spacemap > lz4_compress > multi_vdev_crash_dump > obsolete_counts > project_quota > redacted_datasets > redaction_bookmarks > resilver_defer > sha512 > skein > spacemap_histogram > spacemap_v2 > userobj_accounting > +vdev_zaps_v2 > +zilsaxattr > zpool_checkpoint > zstd_compress >=20 > (Last I checked, /usr/share/zfs/compatibility.d/openzfs-2.2 does > not exist yet. Thus were I had the diff look.) >=20 >> On the host in question, there are many guests, >> some with zfs-boot, some not, just file-based. >=20 > But with what openzfs features active vs. not active > in each case? >=20 >> What the host is not, is zfs-on-root. It boots from ssd (ada0). >> The vdevs are on a sas disk array. >>=20 >>> So either your bootable partitions must not have = com.klarasystems:vdev_zaps_v2 >>> in your BEs or you must have a new user boot. I think you can just = install >>> the one from 14, but haven't tried it. >>=20 >> Can you briefly explain how I'd install the one from 14 please? >=20 >=20 > I do not use bhyve so I do not even know if the > context is using the efi loader from a msdosfs > vs. not. For efi loaders, copying from one msdosfs > with a sufficient vintage to the one with the wrong > vintage (replacing) is sufficient. bhyve in freebsd is traditionally using /boot/userboot.so, I believe. rgds, toomas >=20 > For reference (from an aarch64 context): >=20 > # find /boot/efi/EFI/ -print > /boot/efi/EFI/ > /boot/efi/EFI/FREEBSD > /boot/efi/EFI/FREEBSD/loader.efi > /boot/efi/EFI/BOOT > /boot/efi/EFI/BOOT/bootaa64.efi >=20 > There may well be only: >=20 > EFI/BOOT/bootaa64.efi >=20 > for all I know. >=20 > =46rom an amd64 context: >=20 > # find /boot/efi/EFI/ -print > /boot/efi/EFI/ > /boot/efi/EFI/FREEBSD > /boot/efi/EFI/FREEBSD/loader.efi > /boot/efi/EFI/BOOT > /boot/efi/EFI/BOOT/bootx64.efi >=20 > There may well be only: >=20 > EFI/BOOT/bootx64.efi >=20 > for all I know. >=20 > (I set things up to have the EFI capitalization > so that referencing efi/ vs. EFI/ in my context > is unique for the mount point. vs. the msdosfs > directory.) >=20 > =3D=3D=3D > Mark Millard > marklmi at yahoo.com >=20 >=20 From nobody Sat Sep 16 16:22:20 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnxDC6Krgz4tg9r for ; Sat, 16 Sep 2023 16:22:35 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ed1-x530.google.com (mail-ed1-x530.google.com [IPv6:2a00:1450:4864:20::530]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnxDC36lnz4n42 for ; Sat, 16 Sep 2023 16:22:35 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ed1-x530.google.com with SMTP id 4fb4d7f45d1cf-52683da3f5cso3937083a12.3 for ; Sat, 16 Sep 2023 09:22:35 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694881351; x=1695486151; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=a+yBHB7NxTpsynDoEBqNFk6YAWtINqaaQmccUbmFZv8=; b=bQP9BRreat9mdXOdBmhMagJKhZ3xs6TN5I9Z7htU5vlMAjlygBnqjjZccOSoWK/8HF JE20Zax+4y1G/oeBiX6HuzPry8bk2cxzy2sN9PO2mz4MhYv7LZ8EN6ue8wUitmDXfIv7 iwdgXKyHmT98nNGwNB86OGG7jUD25/+eIJKE2XdtVQE8mWqrBuy1BXSyk7SvcGZLy1/F hWrru/juBeE/4FUcOxTZrbejz0CWMwEX1cBFtiAVm+g7n5aHNG+dO5uJUW3GtpbxNIKn zhO8GKREp8h4CWmd2TFpM4ENVI6PJYCf26pUzcjvnfJLFuNU2xpTNgtltgVDjMeC/hYD 6+6g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694881351; x=1695486151; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=a+yBHB7NxTpsynDoEBqNFk6YAWtINqaaQmccUbmFZv8=; b=hrx7X91W50jWdN/fNoLPUwcloXDcQYsN5a4s4F9r4lxsEnjoooQM2SliaO/efcNEEp +ZH+ZtW7QcupqLzGFaHY8JcPi2tr8xSba8Mz3Lg0m72kraG+MKBZArGA79r/dDaGmeiW 5St+39ZMHxpgGD1qc1N96aX2eSWPop9j7PVtfvPEdSOuP5Hs9ty7WaDwTuz8H6FD8Zxf GmrJ92PghdXkwEqGohq6Gm9CDCJHas5UoQ1qUF6PBtYfk4q/tgSCdZKiYjiA2z0V1wnk BqJpg++3P03y4gtgpyq7N1M6SMQlJKwjkiVO0Mu5WeS1UJIipqSHA8xJ+pKeNLyxQKmJ RhGQ== X-Gm-Message-State: AOJu0YzixiIROV2Yln34hPqR9N7Kjsn5FcUOX1wQjfGHQLD8ixGMcvI6 COBOymF6WtMQu5316WKejfEEaGCIzCQcbtMWiisW7Q== X-Google-Smtp-Source: AGHT+IFXG6kDtuHO0ywP9hnaSxY0gbcylQZ8lAkMCJgPh25xhL2boeIGj7bDB8U9v8j79aC0R0vdXoqM5jtaVlG7Spg= X-Received: by 2002:aa7:c05a:0:b0:52d:25df:e8c3 with SMTP id k26-20020aa7c05a000000b0052d25dfe8c3mr3895863edo.27.1694881351349; Sat, 16 Sep 2023 09:22:31 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> In-Reply-To: <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> From: Warner Losh Date: Sat, 16 Sep 2023 17:22:20 +0100 Message-ID: Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature To: Toomas Soome Cc: Mark Millard , void , Current FreeBSD Content-Type: multipart/alternative; boundary="000000000000e24f0206057c50cf" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RnxDC36lnz4n42 --000000000000e24f0206057c50cf Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Sat, Sep 16, 2023 at 5:11=E2=80=AFPM Toomas Soome wrote: > > > > On 16. Sep 2023, at 18:43, Mark Millard wrote: > > > > void wrote on > > Date: Sat, 16 Sep 2023 12:12:02 UTC : > > > >> On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: > >> > >>> Yes. The boot loader comes from the host. It must know how to read > ZFS. > >> > >> It knows how to read zfs. > > > > I expect Warner was indicating: you have a (efi?) loader that knows > > how to deal with the features listed in: > > > > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-freebsd > > > > being active but not with some new feature(s) listed in: > > > > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > > > > being active. > > > > The following are the "read-only-compatibile no" features > > that are new in openzfs-2.2 compared to openzfs-2.1-freebsd : > > > > blake3 > > ednor > > head_errlog > > vdev_zaps_v2 > > > > So any of those being active leads to lack of even read-only > > activity being compatible. (Although, the loader's subset > > of the potential overall activity might allow ignoring some > > specific "read-only-compatibile no" status examples.) > > > > For reference: > > > > # diff -u99 > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-f= reebsd > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > > --- > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-f= reebsd > 2021-06-24 20:08:57.206621000 -0700 > > +++ > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > 2023-06-10 15:59:25.354999000 -0700 > > @@ -1,34 +1,40 @@ > > -# Features supported by OpenZFS 2.1 on FreeBSD > > +# Features supported by OpenZFS 2.2 on Linux and FreeBSD > > allocation_classes > > async_destroy > > +blake3 > > +block_cloning > > bookmark_v2 > > bookmark_written > > bookmarks > > device_rebuild > > device_removal > > draid > > +edonr > > embedded_data > > empty_bpobj > > enabled_txg > > encryption > > extensible_dataset > > filesystem_limits > > +head_errlog > > hole_birth > > large_blocks > > large_dnode > > livelist > > log_spacemap > > lz4_compress > > multi_vdev_crash_dump > > obsolete_counts > > project_quota > > redacted_datasets > > redaction_bookmarks > > resilver_defer > > sha512 > > skein > > spacemap_histogram > > spacemap_v2 > > userobj_accounting > > +vdev_zaps_v2 > > +zilsaxattr > > zpool_checkpoint > > zstd_compress > > > > (Last I checked, /usr/share/zfs/compatibility.d/openzfs-2.2 does > > not exist yet. Thus were I had the diff look.) > > > >> On the host in question, there are many guests, > >> some with zfs-boot, some not, just file-based. > > > > But with what openzfs features active vs. not active > > in each case? > > > >> What the host is not, is zfs-on-root. It boots from ssd (ada0). > >> The vdevs are on a sas disk array. > >> > >>> So either your bootable partitions must not have > com.klarasystems:vdev_zaps_v2 > >>> in your BEs or you must have a new user boot. I think you can just > install > >>> the one from 14, but haven't tried it. > >> > >> Can you briefly explain how I'd install the one from 14 please? > > > > > > I do not use bhyve so I do not even know if the > > context is using the efi loader from a msdosfs > > vs. not. For efi loaders, copying from one msdosfs > > with a sufficient vintage to the one with the wrong > > vintage (replacing) is sufficient. > > bhyve in freebsd is traditionally using /boot/userboot.so, I believe. Yes. We use the *HOSTS* (running FreeBSD 13) /boot/userboot.so to boot the FreeBSD 14 image. Since we're not using the boot loader from the target image to load it for bhyve, the loader we're using has to understand the ZFS dataset that it's booting off of. FreeBSD 13's userboot.so doesn't support all the bells and whistles that the ZFS folks have added to 14. So, either you have to turn off those features (which I got no clue how to do in the normal installer), or you have to update userboot.so to the FreeBSD 14 version (which I think had a good chance of actually running on FreeBSD 13 since it has no 'system' references, which are confined to bhyveload). Warner > > > > # find /boot/efi/EFI/ -print > > /boot/efi/EFI/ > > /boot/efi/EFI/FREEBSD > > /boot/efi/EFI/FREEBSD/loader.efi > > /boot/efi/EFI/BOOT > > /boot/efi/EFI/BOOT/bootaa64.efi > > > > There may well be only: > > > > EFI/BOOT/bootaa64.efi > > > > for all I know. > > > > From an amd64 context: > > > > # find /boot/efi/EFI/ -print > > /boot/efi/EFI/ > > /boot/efi/EFI/FREEBSD > > /boot/efi/EFI/FREEBSD/loader.efi > > /boot/efi/EFI/BOOT > > /boot/efi/EFI/BOOT/bootx64.efi > > > > There may well be only: > > > > EFI/BOOT/bootx64.efi > > > > for all I know. > > > > (I set things up to have the EFI capitalization > > so that referencing efi/ vs. EFI/ in my context > > is unique for the mount point. vs. the msdosfs > > directory.) > > > > =3D=3D=3D > > Mark Millard > > marklmi at yahoo.com > > > > > > > --000000000000e24f0206057c50cf Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Sat, Sep 16, 2023 at 5:11=E2=80=AF= PM Toomas Soome <tsoome@me.com> = wrote:


> On 16. Sep 2023, at 18:43, Mark Millard <marklmi@yahoo.com> wrote:
>
> void <void_at_f-m.fm> wrote on
> Date: Sat, 16 Sep 2023 12:12:02 UTC :
>
>> On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote:
>>
>>> Yes. The boot loader comes from the host. It must know how to = read ZFS.
>>
>> It knows how to read zfs.
>
> I expect Warner was indicating: you have a (efi?) loader that knows > how to deal with the features listed in:
>
> sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-freebsd
>
> being active but not with some new feature(s) listed in:
>
> sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2
>
> being active.
>
> The following are the "read-only-compatibile no" features > that are new in openzfs-2.2 compared to openzfs-2.1-freebsd :
>
> blake3
> ednor
> head_errlog
> vdev_zaps_v2
>
> So any of those being active leads to lack of even read-only
> activity being compatible. (Although, the loader's subset
> of the potential overall activity might allow ignoring some
> specific "read-only-compatibile no" status examples.)
>
> For reference:
>
> # diff -u99 /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.= d/openzfs-2.1-freebsd /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibi= lity.d/openzfs-2.2
> --- /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzf= s-2.1-freebsd 2021-06-24 20:08:57.206621000 -0700
> +++ /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzf= s-2.2 2023-06-10 15:59:25.354999000 -0700
> @@ -1,34 +1,40 @@
> -# Features supported by OpenZFS 2.1 on FreeBSD
> +# Features supported by OpenZFS 2.2 on Linux and FreeBSD
> allocation_classes
> async_destroy
> +blake3
> +block_cloning
> bookmark_v2
> bookmark_written
> bookmarks
> device_rebuild
> device_removal
> draid
> +edonr
> embedded_data
> empty_bpobj
> enabled_txg
> encryption
> extensible_dataset
> filesystem_limits
> +head_errlog
> hole_birth
> large_blocks
> large_dnode
> livelist
> log_spacemap
> lz4_compress
> multi_vdev_crash_dump
> obsolete_counts
> project_quota
> redacted_datasets
> redaction_bookmarks
> resilver_defer
> sha512
> skein
> spacemap_histogram
> spacemap_v2
> userobj_accounting
> +vdev_zaps_v2
> +zilsaxattr
> zpool_checkpoint
> zstd_compress
>
> (Last I checked, /usr/share/zfs/compatibility.d/openzfs-2.2 does
> not exist yet. Thus were I had the diff look.)
>
>> On the host in question, there are many guests,
>> some with zfs-boot, some not, just file-based.
>
> But with what openzfs features active vs. not active
> in each case?
>
>> What the host is not, is zfs-on-root. It boots from ssd (ada0). >> The vdevs are on a sas disk array.
>>
>>> So either your bootable partitions must not have com.klarasyst= ems:vdev_zaps_v2
>>> in your BEs or you must have a new user boot. I think you can = just install
>>> the one from 14, but haven't tried it.
>>
>> Can you briefly explain how I'd install the one from 14 please= ?
>
>
> I do not use bhyve so I do not even know if the
> context is using the efi loader from a msdosfs
> vs. not. For efi loaders, copying from one msdosfs
> with a sufficient vintage to the one with the wrong
> vintage (replacing) is sufficient.

bhyve in freebsd is traditionally using /boot/userboot.so, I believe.

Yes. We use the *HOSTS* (running FreeBSD 13) /bo= ot/userboot.so to boot the FreeBSD 14
image. Since we're not = using the boot loader from the target image to load it for bhyve,
the loader we're using has to understand the ZFS dataset that it's= booting off of. FreeBSD
13's userboot.so doesn't support= all the bells and whistles that the ZFS folks have added
to 14.<= /div>

So, either you have to turn off those features (wh= ich I got no clue how to do in the=C2=A0
normal installer), or yo= u have to update userboot.so to the FreeBSD 14 version (which
I t= hink had a good chance of actually running on FreeBSD 13 since it has no &#= 39;system'
references, which are confined to bhyveload).

Warner
=C2=A0
>
> # find /boot/efi/EFI/ -print
> /boot/efi/EFI/
> /boot/efi/EFI/FREEBSD
> /boot/efi/EFI/FREEBSD/loader.efi
> /boot/efi/EFI/BOOT
> /boot/efi/EFI/BOOT/bootaa64.efi
>
> There may well be only:
>
> EFI/BOOT/bootaa64.efi
>
> for all I know.
>
> From an amd64 context:
>
> # find /boot/efi/EFI/ -print
> /boot/efi/EFI/
> /boot/efi/EFI/FREEBSD
> /boot/efi/EFI/FREEBSD/loader.efi
> /boot/efi/EFI/BOOT
> /boot/efi/EFI/BOOT/bootx64.efi
>
> There may well be only:
>
> EFI/BOOT/bootx64.efi
>
> for all I know.
>
> (I set things up to have the EFI capitalization
> so that referencing efi/ vs. EFI/ in my context
> is unique for the mount point. vs. the msdosfs
> directory.)
>
> =3D=3D=3D
> Mark Millard
> marklmi at yahoo.com
>
>


--000000000000e24f0206057c50cf-- From nobody Sat Sep 16 16:35:01 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnxVp5jxqz4sTVk for ; Sat, 16 Sep 2023 16:35:14 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnxVp3nhCz4qYb for ; Sat, 16 Sep 2023 16:35:14 +0000 (UTC) (envelope-from freebsd@grem.de) Authentication-Results: mx1.freebsd.org; none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id d0c572b3; Sat, 16 Sep 2023 16:35:12 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=grem.de; h=date:from:to:cc :subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; s=20180501; bh=hZk1t5hh ur30LcmUzCYapMB4uaw=; b=puH1lzBN3aVs5D7UG0i5UmwIl4psAR26f3vY+Wre A7WqCJWEP0+tCuF09INQkU0iLxIPGZHs9eV/2PuPtjHFOmQpp4U57KYPhiIMFV+O b/k1FFJGJ+Y6H8f54AviphWs77uRLW/zxRUNL4qBXlJ3biuJSTdaTO0csV5jPvD1 x48OcGgJ4/xAQ3vy6xmrtt6USfs/IKMu4YqJoakmiQJfToyhT7FPbar+64fVwdel 5KyaXxV1jVVPi6BPUxK1sVt09D2I/M7S9Crg+5TAULY5N6811MIZRuwZhTi6wjXX pADBjPdBVz08gpzW+g3g0HEQOxFAbdruPir61d1jEiaGFw== DomainKey-Signature: a=rsa-sha1; c=nofws; d=grem.de; h=date:from:to:cc :subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; q=dns; s=20180501; b=j6 TEGrli7BjUL9bWCyYyXvrAz4/usR7Y7QfbY07TUCOCdIG66ol5LTyKWfAwNPhDqI xrpGN/qS6CyzENR+kQZaZdtvAQf2E18sSh5cbCHLpcKsfQd9xEXs1Mf7+WcvvywH TCVYD82YdtVhIKn8VRP1+cz6WcjlgQdWLAn1D/MgQ7zCZ0WhUJhCTK1mwQ0RU5rj ZezAKOunaddG5XKGpDy4J+NoA1/v6La1exOd4tx4JJTYZKg3FR01ifZdJLVmDnj2 rsGpYD/smMBJKBVo5qF9g6KCpbT/PcLAP7zH207Y6sm7JhA1lFhHUg7mxOOUB5V8 gk9MSydGrOjj4WGZ8rEg== Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id 2e59e5e8 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sat, 16 Sep 2023 16:35:12 +0000 (UTC) Date: Sat, 16 Sep 2023 18:35:01 +0200 From: Michael Gmelin To: Warner Losh Cc: Toomas Soome , Mark Millard , void , Current FreeBSD Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: <20230916183501.1e4a131e@bsd64.grem.de> In-Reply-To: References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE] X-Rspamd-Queue-Id: 4RnxVp3nhCz4qYb As this is the continuation of a thread I started in June, let me top post again the solution I used back then: """ For completeness sake, this is how I boot 14.0 on 13.2 using sysutils/vm-bhyve: ISO=3DFreeBSD-14.0-CURRENT-amd64-20230608-653738e895ba-263444-bootonly.iso export ISO cd /mountpoint/for/pool/vm vm iso https://download.freebsd.org/snapshots/ISO-IMAGES/14.0/$ISO mkdir .loaders tar --strip-components 1 -C .loaders -xf .iso/$ISO boot/userboot.so mv .loaders/userboot.so .loaders/userboot14.so vm create test14 sysrc -f test14/test14.conf memory=3D1G sysrc -f test14/test14.conf \ bhyveload_loader=3D"$(realpath .loaders/userboot14.so)" OS installation is done the usual way (using tmux instead of cu in this example): pkg install -y tmux sysrc -f .config/system.conf console=3Dtmux vm install test14 $ISO tmux attach -t test14 """ You can find thew whole thread here: https://lists.freebsd.org/archives/freebsd-current/2023-June/003835.html Best Michael On Sat, 16 Sep 2023 17:22:20 +0100 Warner Losh wrote: > On Sat, Sep 16, 2023 at 5:11=E2=80=AFPM Toomas Soome wrot= e: >=20 > > > > =20 > > > On 16. Sep 2023, at 18:43, Mark Millard wrote: > > > > > > void wrote on > > > Date: Sat, 16 Sep 2023 12:12:02 UTC : > > > =20 > > >> On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: > > >> =20 > > >>> Yes. The boot loader comes from the host. It must know how to > > >>> read =20 > > ZFS. =20 > > >> > > >> It knows how to read zfs. =20 > > > > > > I expect Warner was indicating: you have a (efi?) loader that > > > knows how to deal with the features listed in: > > > > > > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1-freebsd > > > > > > being active but not with some new feature(s) listed in: > > > > > > sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > > > > > > being active. > > > > > > The following are the "read-only-compatibile no" features > > > that are new in openzfs-2.2 compared to openzfs-2.1-freebsd : > > > > > > blake3 > > > ednor > > > head_errlog > > > vdev_zaps_v2 > > > > > > So any of those being active leads to lack of even read-only > > > activity being compatible. (Although, the loader's subset > > > of the potential overall activity might allow ignoring some > > > specific "read-only-compatibile no" status examples.) > > > > > > For reference: > > > > > > # diff -u99 =20 > > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1= -freebsd > > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > > =20 > > > --- =20 > > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.1= -freebsd > > 2021-06-24 20:08:57.206621000 -0700 =20 > > > +++ =20 > > /usr/main-src/sys/contrib/openzfs/cmd/zpool/compatibility.d/openzfs-2.2 > > 2023-06-10 15:59:25.354999000 -0700 =20 > > > @@ -1,34 +1,40 @@ > > > -# Features supported by OpenZFS 2.1 on FreeBSD > > > +# Features supported by OpenZFS 2.2 on Linux and FreeBSD > > > allocation_classes > > > async_destroy > > > +blake3 > > > +block_cloning > > > bookmark_v2 > > > bookmark_written > > > bookmarks > > > device_rebuild > > > device_removal > > > draid > > > +edonr > > > embedded_data > > > empty_bpobj > > > enabled_txg > > > encryption > > > extensible_dataset > > > filesystem_limits > > > +head_errlog > > > hole_birth > > > large_blocks > > > large_dnode > > > livelist > > > log_spacemap > > > lz4_compress > > > multi_vdev_crash_dump > > > obsolete_counts > > > project_quota > > > redacted_datasets > > > redaction_bookmarks > > > resilver_defer > > > sha512 > > > skein > > > spacemap_histogram > > > spacemap_v2 > > > userobj_accounting > > > +vdev_zaps_v2 > > > +zilsaxattr > > > zpool_checkpoint > > > zstd_compress > > > > > > (Last I checked, /usr/share/zfs/compatibility.d/openzfs-2.2 does > > > not exist yet. Thus were I had the diff look.) > > > =20 > > >> On the host in question, there are many guests, > > >> some with zfs-boot, some not, just file-based. =20 > > > > > > But with what openzfs features active vs. not active > > > in each case? > > > =20 > > >> What the host is not, is zfs-on-root. It boots from ssd (ada0). > > >> The vdevs are on a sas disk array. > > >> =20 > > >>> So either your bootable partitions must not have =20 > > com.klarasystems:vdev_zaps_v2 =20 > > >>> in your BEs or you must have a new user boot. I think you can > > >>> just =20 > > install =20 > > >>> the one from 14, but haven't tried it. =20 > > >> > > >> Can you briefly explain how I'd install the one from 14 please? =20 > > > > > > > > > I do not use bhyve so I do not even know if the > > > context is using the efi loader from a msdosfs > > > vs. not. For efi loaders, copying from one msdosfs > > > with a sufficient vintage to the one with the wrong > > > vintage (replacing) is sufficient. =20 > > > > bhyve in freebsd is traditionally using /boot/userboot.so, I > > believe. =20 >=20 >=20 > Yes. We use the *HOSTS* (running FreeBSD 13) /boot/userboot.so to > boot the FreeBSD 14 > image. Since we're not using the boot loader from the target image to > load it for bhyve, > the loader we're using has to understand the ZFS dataset that it's > booting off of. FreeBSD > 13's userboot.so doesn't support all the bells and whistles that the > ZFS folks have added > to 14. >=20 > So, either you have to turn off those features (which I got no clue > how to do in the > normal installer), or you have to update userboot.so to the FreeBSD 14 > version (which > I think had a good chance of actually running on FreeBSD 13 since it > has no 'system' > references, which are confined to bhyveload). >=20 > Warner >=20 >=20 > > > > > > # find /boot/efi/EFI/ -print > > > /boot/efi/EFI/ > > > /boot/efi/EFI/FREEBSD > > > /boot/efi/EFI/FREEBSD/loader.efi > > > /boot/efi/EFI/BOOT > > > /boot/efi/EFI/BOOT/bootaa64.efi > > > > > > There may well be only: > > > > > > EFI/BOOT/bootaa64.efi > > > > > > for all I know. > > > > > > From an amd64 context: > > > > > > # find /boot/efi/EFI/ -print > > > /boot/efi/EFI/ > > > /boot/efi/EFI/FREEBSD > > > /boot/efi/EFI/FREEBSD/loader.efi > > > /boot/efi/EFI/BOOT > > > /boot/efi/EFI/BOOT/bootx64.efi > > > > > > There may well be only: > > > > > > EFI/BOOT/bootx64.efi > > > > > > for all I know. > > > > > > (I set things up to have the EFI capitalization > > > so that referencing efi/ vs. EFI/ in my context > > > is unique for the mount point. vs. the msdosfs > > > directory.) > > > > > > =3D=3D=3D > > > Mark Millard > > > marklmi at yahoo.com > > > > > > =20 > > > > > > =20 --=20 Michael Gmelin From nobody Sat Sep 16 17:02:57 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rny6t6j6jz4sc7N for ; Sat, 16 Sep 2023 17:03:02 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rny6r5txMz3C9t for ; Sat, 16 Sep 2023 17:03:00 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=bUsK5HMN; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="VAQ8BW/i"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 729565C008B for ; Sat, 16 Sep 2023 13:02:59 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute2.internal (MEProxy); Sat, 16 Sep 2023 13:02:59 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694883779; x=1694970179; bh=3B v8aenFoiUIIR56NCF/Gv7wxR/qPwazxhmZ8zy9EHA=; b=bUsK5HMNKXpV2fS3xS 8g6CDTSqBtok2YlflRstCyjc3OvAQx+Fgm5jecE3auEw4mtEQpcQNsWBlU5Gr7nL M0YUl7hyZcdN5872bs35ztnPZBsDriiWXSklAB5wPyo9cGymv6d73SGnm0qiHXzd eXgwcILdHrBf7JdZODHcBpzeMT2IfIKldWmeeOI9P946VssRJ0uevL8Pn2Jrjk+K gIMuH/FSgWKey25lar859bV97AzbqCdkVT9BEo8N+RJKU1xUGUYHay50qfmyeeo7 WKlF7PcHYWSHVbUN5nEYUL7BeSLecAMSUBsq3Yg7q9pdKbM1jzuQaXu4caHStffu 4r+w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694883779; x=1694970179; bh=3Bv8aenFoiUII R56NCF/Gv7wxR/qPwazxhmZ8zy9EHA=; b=VAQ8BW/isLyCOAx5WtvWu4dF64ohM J0fMK27Qbn3Pod6UFRM8CFlLKG4aQDgFMpO5GjRnit8Px9pgf15Ri6dFbecgNsSX Y+INpB7kpXksefYeAXAy2PECDlDA/ks0lNTBaUpIqkcTSQU4CgcWcYV+31ZE05lX waFgVYtTPQsll0k0ZxKZy0x6gZ8618PWR6xhCxKbnSSDAcnYzJCJKV/MlZRsf14K AWtsFq13U7vGMv9bsnmWPczwP3HSvZfcFjxhqrdvaeVHfpf4JO/deTiTdimpEg4M rA/tF36COWHDwGG0mi+gm7NO7dUZ6kSnD03u7r8C6aopS59gAzNsHJhqg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedguddtjecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttd ertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutd ehhefgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 13:02:58 -0400 (EDT) Date: Sat, 16 Sep 2023 18:02:57 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> X-Spamd-Bar: ---- X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rny6r5txMz3C9t On Sat, Sep 16, 2023 at 08:43:49AM -0700, Mark Millard wrote: >void wrote on >Date: Sat, 16 Sep 2023 12:12:02 UTC : > >> On Sat, Sep 16, 2023 at 12:55:19PM +0100, Warner Losh wrote: >> >> >Yes. The boot loader comes from the host. It must know how to read ZFS. >> >> It knows how to read zfs. > >I expect Warner was indicating: you have a (efi?) loader that knows >how to deal with the features listed in: What I'm astonished with is this part about the boot loader for the guest coming from the host, with respect to zfs, needing zfs properties the guest has but the host hasn't. I have some freebsd zfs guests on linux (redhat) hosts as well. They're using KVM. A few on Azure. These hosts (as I understand it) don't have zfs at all. None of the guests are root-on-zfs. So I guess the issue is with bhyve and the new zfs exposes it? If it's not happening with other hypervisors. Does the issue affect root-on-zfs guests only on freebsd zfs hosts or would it also affect those booting to ufs but then loading zfs for their data? I'm doing some testing now with a zfs-on-root 13.2 guest, will try src upgrading it to 14-stable, on this openzfs-2.1(?) host. -- From nobody Sat Sep 16 17:05:14 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rny9T4PGCz4scZp for ; Sat, 16 Sep 2023 17:05:17 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rny9S6GNCz3DGD for ; Sat, 16 Sep 2023 17:05:16 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=e1TMzxA7; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=PX2rdkkN; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 8D4D75C00E7 for ; Sat, 16 Sep 2023 13:05:16 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Sat, 16 Sep 2023 13:05:16 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694883916; x=1694970316; bh=6+ rjKKAAt5E/Y/L/wyFAgc9h4iLRf2JYXI3D1lkSSxQ=; b=e1TMzxA76s90J8J8qR akUQATr/BmmRCCk3OhgDI8v6WWXwRGc0xwKP5azcemdiw1oH3kH7izMNPWPwhYPs r2xCisQy+OPBHb5nkL9UHAvYSKUXtFZW9T/eg6IwiIBR1nDYXo4K/OCSh29xlTi+ QoS7EsXs9qy+ejj4JfdohzXurAti8jeikNlzTdh8TPofE8/g7KQHsupeXOz8TsSE R7zyN1oDWV4P7PdRoxcOkJH2BfqefRPtW5Qv1Kfa9mC5SqdBStYzt1sp7h2Zsq0f LYk5qL1np0n9jiPAGCrwXrCZYIA5HuYpy2jSGDCQ4ITS1pSCwo09Udzfbj3DAUW+ Zdlg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694883916; x=1694970316; bh=6+rjKKAAt5E/Y /L/wyFAgc9h4iLRf2JYXI3D1lkSSxQ=; b=PX2rdkkNGfivg6YcYTXGiNetuhUek YY9Ms6SYkip7nMYg20Y3pLa43Yt5xU8FUrM1nuY0UpXW5vshB+41V97KjamNzVFk uqaWdbd89TpuVkSz6RJ/1Cs4cGUIiFzjyvtYZfCdH8UrrxUUAZF6gs6GzNWsgBa8 V7TzeatXwRJ2Ui8kOcN05zIqRlBPuhMUTJRcL/XDT6Ts6wqwu0jkzNw7eS/bbhp/ DiZ1z2vrM4MA+Cj/gkdbvXYBUlBE+vxX3ppL0tfirZck4qPJgg8Bu2JY4ZN9MJmr p9tmnOezrnaoz1dHVeLwlkh7UZoUiYXfA8UwpaT3TMt1UBNw2v1f8lUfg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedguddtkecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttd ertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutd ehhefgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 13:05:16 -0400 (EDT) Date: Sat, 16 Sep 2023 18:05:14 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-5.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rny9S6GNCz3DGD On Sat, Sep 16, 2023 at 05:22:20PM +0100, Warner Losh wrote: >So, either you have to turn off those features (which I got no clue how to >do in the >normal installer), or you have to update userboot.so to the FreeBSD 14 >version (which >I think had a good chance of actually running on FreeBSD 13 since it has no >'system' >references, which are confined to bhyveload). OK thanks I'll try that too -- From nobody Sat Sep 16 17:07:31 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnyD62Sfzz4sd2s for ; Sat, 16 Sep 2023 17:07:34 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnyD55dz0z3FT4 for ; Sat, 16 Sep 2023 17:07:33 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=JoRTHpJP; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=Qu5RO8yU; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 873E15C00D5 for ; Sat, 16 Sep 2023 13:07:33 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Sat, 16 Sep 2023 13:07:33 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694884053; x=1694970453; bh=is b/DDKV+iZpAVUYXkciUns97sK5ihzXhCxrxoPOS80=; b=JoRTHpJP+yLrzeM1tG 4faMQrv7Yi2UMQi/eYhd/cYFsH9OJk+FY1ht6+vKEFd0b3OFOSbAKpdkEHDGR8RK pV5/2pKbExdXi9wWSytRH+afEtDSGdq58YrfQEm0/kq/emKXZ/lxTEWAwQpWo/N/ 3kojPVQdP9nvfmRH/7P29WqWZ0MS7S7E91+Vp5DwE4MoChgdsRP9XpWmv6TIiRmJ kR/PPfFHlxNhe0ARhKdvDYiBpaniLtMGXbkjGPrJmB+BqL4Jq0h065eVQ5NquGcp KC22mF1KGmi/Vsk69F9VOV55xg+bnmGHbn9cA+2t9t5r6yO9LVdsQwaH2prJLdGN cTgQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694884053; x=1694970453; bh=isb/DDKV+iZpA VUYXkciUns97sK5ihzXhCxrxoPOS80=; b=Qu5RO8yUEEZINhYTCT44+VwfDwiIL l1gh2U2N1V7aW6hVAdajXT7fU9KpirG3VUpQrt66rF3/YPzH1TJ1UgUvPm/FA6D5 lh49YADTwhA0OEnMqc5xZMKLtEhEPqMv5LGQ8+8yCfD9KT/JNADPTG8ojuv3ifxe 0UXUaLQIFQjT9amxOHtzwVvL9nE14lPCfP1qsrfrx5EDNVOOLwnRDMs5JGOkWmrJ 8pTKHHvfh7KpLuOKsAjhvfLogtSS4Zmnd26ObnHWdBFfuZoQC1dh1B9hsVxVHOAP xyWyBjrMNhvt6ONYq5cUTaZnhsnAveTxAYMr2xiCxibU7MYvXvd2jcX3Q== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedguddtkecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttd ertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutd ehhefgueenucevlhhushhtvghrufhiiigvpedunecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 13:07:33 -0400 (EDT) Date: Sat, 16 Sep 2023 18:07:31 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> <20230916183501.1e4a131e@bsd64.grem.de> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20230916183501.1e4a131e@bsd64.grem.de> X-Spamd-Bar: ---- X-Spamd-Result: default: False [-5.00 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RnyD55dz0z3FT4 On Sat, Sep 16, 2023 at 06:35:01PM +0200, Michael Gmelin wrote: >As this is the continuation of a thread I started in June, >let me top post again the solution I used back then: Hi, I saw your fix but vm-bhyve is unavailable for me to use for a variety of reasons. -- From nobody Sat Sep 16 17:14:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnyNd4xp8z4sflS; Sat, 16 Sep 2023 17:14:57 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-yw1-x1136.google.com (mail-yw1-x1136.google.com [IPv6:2607:f8b0:4864:20::1136]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnyNc44Jbz3Gqd; Sat, 16 Sep 2023 17:14:56 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x1136.google.com with SMTP id 00721157ae682-59c0d002081so16054567b3.2; Sat, 16 Sep 2023 10:14:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1694884495; x=1695489295; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=fQ9bOO3jPkXaUBACxHDOo6s968XDMr7hg5qMZ69kCA0=; b=GDFkTQsCPaymiOaZbQ8iFZBcBCEX7rNbNxIWr262srnHJU56+igse7+y9T5QuBVzoI lslEbaVjM9ea4IZKDxKEd0WxD41LvMP5W4zozEVqGj+AXiMlZNc8BfqM2R/EY7gWXZ40 /xrnjY7YboCQpJ5/ihA9A04r3ThA3hrZPSXrQgPIltqkj1Uy1IuC5K+L5EirPOZmM/e6 6G6fiOBTDroMMyePZXrpVMrgrwgMbIUGOwVwkKDlSDWsCAj2vt4RxKOTzo4ZvZXzSUpm DwNmsaM7SQSH9O8aW2HnFyzToyPcqLkdHOw1CtEWQRGx6NtbhT9Ir1DAVIvefg3rMyz/ lnJA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694884495; x=1695489295; h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to :content-language:user-agent:mime-version:date:message-id:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=fQ9bOO3jPkXaUBACxHDOo6s968XDMr7hg5qMZ69kCA0=; b=gkiTbWyX8p2PybPBEYaluwVaKRoicVVe1tTahDY9jaqBKXhNksU7GU43lsnPLQf9lI lvb9JErNy03yOefv3En8/nx95HO5GCBHn5VMfYlcZOCKvtzjMYWXRNOCYWtGHPu1qemu dzJJoaF5ga5BEo5DvpJq8QAqDyIKnkCp/f4dsKo/INLm3bXhssGHQfxis56Qw5xvxV9j U5Nxw13OLmY50vB9t150+5cfFLbWwi3WloI0S5G87ljZbv9DRhjeU2SqnH2JQf+w0s8Y YUNIGQVhKTu1nWHSXhhdc1RR0PPb2EZp1LX+0E2O3hdPND6Dc96aGpsh3GNC+tXlCMkq OYXQ== X-Gm-Message-State: AOJu0Yx5OhptaAIOWxNejHGDEpODIi1DbflSrzysSRqQMGjem7ax6B1+ mpRrFXXoL5M25nE+ZYqJVxBCeXvEjkp9dQ== X-Google-Smtp-Source: AGHT+IHlPL+HL399ksotIWmpMUfyt9pRagypKE8rVzmOAPKeTYCRr/kXzvsyM7j8tfKn/bIr08BTWQ== X-Received: by 2002:a0d:c806:0:b0:595:9770:6914 with SMTP id k6-20020a0dc806000000b0059597706914mr5284315ywd.35.1694884495366; Sat, 16 Sep 2023 10:14:55 -0700 (PDT) Received: from [10.230.45.5] ([38.32.73.2]) by smtp.gmail.com with ESMTPSA id d185-20020a0ddbc2000000b0058419c57c66sm1490803ywe.4.2023.09.16.10.14.54 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 16 Sep 2023 10:14:54 -0700 (PDT) Message-ID: <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org> Date: Sat, 16 Sep 2023 13:14:09 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: Graham Perrin , freebsd-current@freebsd.org Cc: freebsd-stable@freebsd.org References: <20230916002831.GU52318@FreeBSD.org> <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> From: Alexander Motin Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available) In-Reply-To: <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4RnyNc44Jbz3Gqd On 16.09.2023 01:25, Graham Perrin wrote: > On 16/09/2023 01:28, Glen Barber wrote: >> o A fix for the ZFS block_cloning feature has been implemented. > > Thanks > > I see > , with in stable/14. > > As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT > n265350-72d97e1dd9cc): should we assume that additional fixes, not > necessarily in time for 14.0-RELEASE, will be required before > vfs.zfs.bclone_enabled can default to 1? I am not aware of any block cloning issues now. All this thread about bclone_enabled actually started after I asked why it is still disabled. Thanks to Mark Millard for spotting this issue I could fix, but now we are back at the point of re-enabling it again. Since the tunable does not even exist anywhere outside of FreeBSD base tree, I'd propose to give this code another try here too. I see no point to have it disabled at least in main unless somebody needs time to run some specific tests first. -- Alexander Motin From nobody Sat Sep 16 17:15:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnyPY68YJz4sfxR for ; Sat, 16 Sep 2023 17:15:45 +0000 (UTC) (envelope-from freebsd@grem.de) Received: from mail.evolve.de (mail.evolve.de [213.239.217.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA512 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.evolve.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RnyPY37VPz3Jtn for ; Sat, 16 Sep 2023 17:15:45 +0000 (UTC) (envelope-from freebsd@grem.de) Authentication-Results: mx1.freebsd.org; none Received: by mail.evolve.de (OpenSMTPD) with ESMTP id 0596f586; Sat, 16 Sep 2023 17:15:43 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=grem.de; h=date:from:to:cc :subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; s=20180501; bh=J/4iFstU 5mB83ZwP7fR7uB3c2AQ=; b=jN45Gm9Fl0YaZvlbDT+0W6Faz3cQy8+S6P7htBwK kNAf3Yd0+BLe7bZ/PXreW8GO1w15x3uZ+qYWLdFw0oZBS32CYCXse8dE2yBetps/ LbnNPorMdjH5KMd0a/xsBrka538C5pGWjNn5ocfMOo5D2T/OB7vPTWnLBRrgz+gX aqwv4Dzz9FO4UP6A3cr+jycxbGKtPCoDLGobHLM+2LqelqRjOsazEpep4S9geeeH lc5d0ogKQ2/8nDgN4yAZKycQHApcS1XJu8WxZln6AmSHu6MwZI8jXnS9pRL+uZpq fPkLY7QFXsiPO2h9n1+RKT6stek6EcJvOWtXAxOysgeFmQ== DomainKey-Signature: a=rsa-sha1; c=nofws; d=grem.de; h=date:from:to:cc :subject:message-id:in-reply-to:references:mime-version :content-type:content-transfer-encoding; q=dns; s=20180501; b=ma frSpJpX/Km6+gsjbL9Thbh/hSm+zcGXLv1YEwQtTAq6E/vpdNN70f17LDwW1gask 0XPJ+YN/VdePGAV/Ttw0RrX7K+77PifwtRzVt2bFTFxGO7AnIJ4M6JRfHDVChpUE lG0ZTlN85rJ/xa5+GNwbrPQ7nkD97h83K5Y3rbEB4tmfZqRmNsBpWHF5KaTWIP+c iIKdMjlZgmxUcvrAZhFFj95OhutpnkC2fM0yyBJJd1dk8F3skS8NnG9MHl1OUI82 QXZogjJh9kbPABDHKbZbjVXVetBh4uxTcR3CjjO/lUMbOg3KW87Pz81epMc6F+Ex m+NpIjeqpKSdzUYehv/A== Received: by mail.evolve.de (OpenSMTPD) with ESMTPSA id bcfa31cf (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Sat, 16 Sep 2023 17:15:43 +0000 (UTC) Date: Sat, 16 Sep 2023 19:15:32 +0200 From: Michael Gmelin To: void Cc: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: <20230916191532.00cb62ea@bsd64.grem.de> In-Reply-To: References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> <20230916183501.1e4a131e@bsd64.grem.de> X-Face: $wrgCtfdVw_H9WAY?S&9+/F"!41z'L$uo*WzT8miX?kZ~W~Lr5W7v?j0Sde\mwB&/ypo^}> +a'4xMc^^KroE~+v^&^#[B">soBo1y6(TW6#UZiC]o>C6`ej+i Face: iVBORw0KGgoAAAANSUhEUgAAADAAAAAwBAMAAAClLOS0AAAAJFBMVEWJBwe5BQDl LASZU0/LTEWEfHbyj0Txi32+sKrp1Mv944X8/fm1rS+cAAAACXBIWXMAAAsTAAAL EwEAmpwYAAAAB3RJTUUH3wESCxwC7OBhbgAAACFpVFh0Q29tbWVudAAAAAAAQ3Jl YXRlZCB3aXRoIFRoZSBHSU1QbbCXAAAAAghJREFUOMu11DFvEzEUAGCfEhBVFzuq AKkLd0O6VrIQsLXVSZXoWE5N1K3DobBBA9fQpRWc8OkWouaIjedWKiyREOKs+3PY fvalCNjgLVHeF7/3bMtBzV8C/VsQ8tecEgCcDgrzjekwKZ7TwsJZd/ywEKwwP+ZM 8P3drTsAwWn2mpWuDDuYiK1bFs6De0KUUFw0tWxm+D4AIhuuvZqtyWYeO7jQ4Aea 7jUqI+ixhQoHex4WshEvSXdood7stlv4oSuFOC4tqGcr0NjEqXgV4mMJO38nld4+ xKNxRDon7khyKVqY7YR4d+Cg0OMrkWXZOM7YDkEfKiilCn1qYv4mighZiynuHHOA Wq9QJq+BIES7lMFUtcikMnkDGHUoncA+uHgrP0ctIEqfwLHzeSo+eUA66AqzwN6n 2ZHJhw6Qh/PoyC/QENyEyC/AyNjq74Bs+3UH0xYwzDUC4B97HgLocg1QLYgDDO1v f3UX9Y307Ew4AHh67YAFFsxEpkXwpXY3eIgMhAAE3R19L919nNnuD2wlPcDE3UeT L2ytEICQib9BXgS2fU8PrD82ToYO1OEmMSnYTjSqSv9wdC0tPYC+rQRQD9ESnldF CyqfmiYW+tlALt8gH2xrMdC/youbjzPXEun+/ReXsMCDyve3dZc09fn2Oas8oXGc Jj6/fOeK5UmSMPmf/jL+GD8BEj0k/Fn6IO4AAAAASUVORK5CYII= List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:213.239.192.0/18, country:DE] X-Rspamd-Queue-Id: 4RnyPY37VPz3Jtn On Sat, 16 Sep 2023 18:07:31 +0100 void wrote: > On Sat, Sep 16, 2023 at 06:35:01PM +0200, Michael Gmelin wrote: > >As this is the continuation of a thread I started in June, > >let me top post again the solution I used back then: > > Hi, I saw your fix but vm-bhyve is unavailable for me to use > for a variety of reasons. Well, you can do essentially the same without vm-bhyve by downloading/extracting the loader from a 14.0 ISO like described and passing it to bhyveload(5) using `-l /path/to/userboot14.so`. Cheers p.s. from https://man.freebsd.org/cgi/man.cgi?query=bhyveload&sektion=8 -l os-loader Specify a different OS loader. By default bhyveload will use /boot/userboot.so, which presents a standard FreeBSD loader. (that path is on the host system, which the man page doesn't state explicitly) -- Michael Gmelin From nobody Sat Sep 16 18:25:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnzxj1Q9Gz4t00T for ; Sat, 16 Sep 2023 18:25:13 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out5-smtp.messagingengine.com (out5-smtp.messagingengine.com [66.111.4.29]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnzxh3S1rz3b3l for ; Sat, 16 Sep 2023 18:25:12 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=pUPPfXqW; dkim=pass header.d=messagingengine.com header.s=fm2 header.b="p/fgv6u6"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.29 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 9E7F85C0079 for ; Sat, 16 Sep 2023 14:25:11 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Sat, 16 Sep 2023 14:25:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1694888711; x=1694975111; bh=+O 5IR0/xSI7QS52OCaT3HLgK005agpTiEW1RU6StjH8=; b=pUPPfXqWwonSdAUqoO Fykf2hvBVPt9KhbEn1PB0WJRxPz59MPyL60YQG+BTLdI8PlbYwoj+14L5vkYuq8t kx1td7VlKbbKa6qsIY43id2h+3KnawMTsrVGQRFkxMUWL7eyiIKgUgmRXKOjKRJM 8nFWZ9w5E3e5vGWScai8WK7bH4HjHE4YRYDnCP+Xt40QClkZIrZOtDSz1g10MkZQ AgtlnVvj+q7f8GoPJey7T4Td86icMy7TMJpUHUFzXfVa0rmd5XgsSdizD6g00I5o rpXa4yVcNes2NPPLGmQ4SCjdvI8zI2K97icw8iv/6pj/89GDwXUqQOWKcF33/9oB YlYA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1694888711; x=1694975111; bh=+O5IR0/xSI7QS 52OCaT3HLgK005agpTiEW1RU6StjH8=; b=p/fgv6u6sCCxNPeWFx68BbkC3olWJ y3WSVEYZqpR0K1E+reChm/x6nEl+W3Pq1EG2/bHrJ8MZg0PvQKimPatvWC09PtUM atv4TXlxH6kzrJoMc4Pji6WoxFW44ILMHYZGSCvZMT2exwWL7JkdiqHeXP62SZZe kewW1qaKNU9xRl+YSWX+bOf6cnaA2+yNfnlfIbsxKyEy4YH9ugB03b0ka3C3l9Ch Xt9gYxPwlDlm7wlP3/+cOSNzQTj26fJaaJ+nvr9eOzArMgsqtfGPbGfen6cAzebd 3IbX0auivO1oDPISXAJprfswT0IBEbRhEf8v47Ao7+Zux1NY6fhg5B2JQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedrudejgedguddvgecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh necuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttd ertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffr rghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutd ehhefgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhm pehvohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Sat, 16 Sep 2023 14:25:11 -0400 (EDT) Date: Sat, 16 Sep 2023 19:25:09 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: CURRRENT snapshot won't boot due missing ZFS feature Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <7EEF3435-064D-4C3C-98E4-2B27A788DB43.ref@yahoo.com> <7EEF3435-064D-4C3C-98E4-2B27A788DB43@yahoo.com> <4D51E8E6-8AF0-4773-A9BA-D53C08B744EA@me.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.92 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.92)[-0.922]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.29:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.29]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.29:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rnzxh3S1rz3b3l On Sat, Sep 16, 2023 at 06:05:14PM +0100, void wrote: >On Sat, Sep 16, 2023 at 05:22:20PM +0100, Warner Losh wrote: > >>So, either you have to turn off those features (which I got no clue how to >>do in the >>normal installer), or you have to update userboot.so to the FreeBSD 14 >>version (which >>I think had a good chance of actually running on FreeBSD 13 since it has no >>'system' >>references, which are confined to bhyveload). > >OK thanks I'll try that too OK this works TYVM Warner 1. mount the 14-beta image with mdconfig 2. find within it boot/userboot.so 3. copy it across to 13-stable host 4. start 14-beta vm 5. additionally, start a 13.2 vm zpool status on both guests doesn't report any errors --