From nobody Sun Sep 10 02:28:04 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rjv0J1MzLz4sMWR for ; Sun, 10 Sep 2023 02:28:16 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (tunnel82308-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "garrett.wollman.name", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rjv0H0YTLz4hCl for ; Sun, 10 Sep 2023 02:28:14 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of wollman@hergotha.csail.mit.edu designates 2001:470:1f06:ccb::2 as permitted sender) smtp.mailfrom=wollman@hergotha.csail.mit.edu; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=bimajority.org (policy=none) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.17.1/8.17.1) with ESMTPS id 38A2S4oe076506 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 9 Sep 2023 22:28:06 -0400 (EDT) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.17.1/8.17.1/Submit) id 38A2S4Lc076505; Sat, 9 Sep 2023 22:28:04 -0400 (EDT) (envelope-from wollman) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <25853.10676.45028.623279@hergotha.csail.mit.edu> Date: Sat, 9 Sep 2023 22:28:04 -0400 From: Garrett Wollman To: Mateusz Guzik Cc: freebsd-stable@freebsd.org Subject: Re: Did something change with ZFS and vnode caching? In-Reply-To: References: <25827.33600.611577.665054@hergotha.csail.mit.edu> <25831.30103.446606.733311@hergotha.csail.mit.edu> <25840.58487.468791.344785@hergotha.csail.mit.edu> X-Mailer: VM 8.2.0b under 28.2 (amd64-portbld-freebsd13.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.4 (hergotha.csail.mit.edu [0.0.0.0]); Sat, 09 Sep 2023 22:28:06 -0400 (EDT) X-Spam-Status: No, score=-4.9 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS,NICE_REPLY_A autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on hergotha.csail.mit.edu X-Spamd-Bar: - X-Spamd-Result: default: False [-1.90 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FORGED_SENDER(0.30)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f06:ccb::2]; DMARC_POLICY_SOFTFAIL(0.10)[bimajority.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; R_DKIM_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; FREEFALL_USER(0.00)[wollman]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2001:470:1f06:ccb::2:server fail]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rjv0H0YTLz4hCl < said: > zfs lock arrays are a known problem, bumping them is definitely an option. This is the thing I tried next. It took a few attempts (mostly I think due to my errors) but I'm now running with 512 (instead of 64) and plan to deploy 1024 soon, as the results are significant: while we still see significant loads and kmem pressure during the backup window, backups are able to complete some 5 to 8 hours sooner, and nfsd remains responsive. > dtrace is rather funky with stack unwinding sometimes, hence possibly > misplaced lock_delay. > What you should do here is recompile the kernel with LOCK_PROFILING. > Then: > sysctl debug.lock.prof.contested_only=1 > sysctl debug.lock.prof.enable=1 > And finally sysctl debug.lock.prof.stats > out.lockprof I do not know if I will get around to doing this, since my users have a limited tolerance for outages that I'm probably nearing the end of, but it does seem likely to be the next step if we continue to have problems. Last night I was able to get a new dtrace capture, and I made a flame graph *excluding* stacks involving sleepq_catch_signals (which indicate threads that are idle). I redid the previous flame graph with a similar filter. Unfortunately, this cannot be an entirely apples-to-apples comparison, because the traces ran for different times and both the NFS clients do different (unpredictable) work every night. Last night's trace was conducted during a period when four backup processes were running simultaneously, each with up to 110 threads, but a much shorter capture overall than the previous trace. Last week: Yesterday: The one thing that stands out to me is that _sx_xlock_hard *barely* shows up in the yesterday's graph -- it's there, but you have to know where to search for it. On the other hand, lock_delay is still there, and still missing its immediate caller's stack frame, and the vnode list mutex is still obviously quite contended. The fact that __mtx_lock_hard is relatively a larger fraction of zfs_zget now suggests that increating the number of ZFS object locks has substantially reduced the amount of self-contention the backup client creates during its scan. Tonight, I took a similar trace on a stock 13.2-RELEASE system: . Note that this system has very different activity patterns, and is much newer and higher capacity but has a different (capacity-optimized) zpool setup; at times, there were as many as eight backup processes running, and on this machine it takes about 21 hours to complete nightly incrementals. What stands out, aside from the additional time waiting for I/O to complete, is the appearance of rms_rlock_fallback. The path for this is the ZFS_ENTER macro called at ZFS vnode entry points to interlock with unmount operations. Once I have the new kernel deployed on this server (and 15 others) I'll be able to collect more data and see if it's worth investigating those lock_delay() stacks. -GAWollman From nobody Sun Sep 10 05:40:47 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RjzGS6Y3fz4t7YF for ; Sun, 10 Sep 2023 05:40:48 +0000 (UTC) (envelope-from lojas@arroway.org) Received: from hobbes.arroway.org (hobbes.arroway.org [173.199.118.77]) by mx1.freebsd.org (Postfix) with ESMTP id 4RjzGS1rTkz4RXP for ; Sun, 10 Sep 2023 05:40:48 +0000 (UTC) (envelope-from lojas@arroway.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of lojas@arroway.org designates 173.199.118.77 as permitted sender) smtp.mailfrom=lojas@arroway.org; dmarc=none Received: from [10.1.7.91] (unknown [179.190.219.20]) by hobbes.arroway.org (Postfix) with ESMTPA id 9C6F514D1B5 for ; Sun, 10 Sep 2023 02:40:47 -0300 (-03) Received: from 10.1.4.57 (SquirrelMail authenticated user matheus) by 10.1.7.91 with HTTP; Sun, 10 Sep 2023 05:40:47 -0000 Message-ID: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> Date: Sun, 10 Sep 2023 05:40:47 -0000 Subject: Update to BETA1 can't login: pam_opie.so not found From: "Nenhum_de_Nos" To: freebsd-stable@freebsd.org User-Agent: SquirrelMail/1.4.23 [SVN] List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Spamd-Bar: - X-Spamd-Result: default: False [-1.20 / 15.00]; MID_BARE_IP(2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+a:c]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ASN(0.00)[asn:20473, ipnet:173.199.116.0/22, country:US]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; HAS_X_PRIO_THREE(0.00)[3]; R_DKIM_NA(0.00)[]; DMARC_NA(0.00)[arroway.org]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; ARC_NA(0.00)[] X-Rspamd-Queue-Id: 4RjzGS1rTkz4RXP Hi, just updated my nanopi R5S to BETA1: FreeBSD 14.0-BETA1 FreeBSD 14.0-BETA1 aarch64 1400097 #0 releng/14.0-n265061-5e5854520ee6: Sat Sep 9 20:20:11 -03 2023 root@NanopiR5S-nvme:/usr/obj/usr/src-14/arm64.aarch64/sys/GENERIC.pfndb arm64 the config just has PF builtin. git checkout releng/14.0 and the default make buildworld/make buildkernel; make installworld;make installkernel stuff. No I can't login, ssh or locally. When locally by serial, I get the pam_opie.so not found. I read UPDATING on git for releng/14.0 and saw nothing about PAM. I can get to it by choosing single user on boot. I did a find for this module, and none are found. I saw this: /etc/pam.d/sshd:auth sufficient pam_opie.so no_warn no_fake_prompts Then I commented all lines for ssh, other and system files in /etc/pam.d. Now I can login again. Is this a expected behaviour? My old kernel and world was: FreeBSD NanopiR5S-nvme 14.0-CURRENT FreeBSD 14.0-CURRENT #0: Sun Jul 16 05:15:49 -03 2023 root@NanopiR5S-nvme:/usr/obj/usr/src-main/arm64.aarch64/sys/GENERIC.pfndb a rm64 Thanks, matheus From nobody Sun Sep 10 06:29:50 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk0MR2F0Hz4sQnR for ; Sun, 10 Sep 2023 06:30:11 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "plan-b.pwste.edu.pl", Issuer "GEANT OV RSA CA 4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk0MK4rk1z4fcp for ; Sun, 10 Sep 2023 06:30:05 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=plan-b.pwste.edu.pl header.s=plan-b-mailer header.b="Ln7XCHn/"; spf=none (mx1.freebsd.org: domain of zarychtam@plan-b.pwste.edu.pl has no SPF policy when checking 2001:678:618::40) smtp.mailfrom=zarychtam@plan-b.pwste.edu.pl; dmarc=pass (policy=none) header.from=plan-b.pwste.edu.pl Received: from [IPV6:2a02:22e0:cf00:1ff:1584:3563:b9b7:f2cf] (mzar@[IPv6:2a02:22e0:cf00:1ff:1584:3563:b9b7:f2cf]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.17.2/8.17.1) with ESMTPSA id 38A6TqIK088069 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Sun, 10 Sep 2023 08:29:52 +0200 (CEST) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1694327393; bh=gHH+OqBpVqxXrh8g9Pi9XASzGhn6LLdl9NVcXc2NXW4=; h=Date:Subject:To:References:From:In-Reply-To; b=Ln7XCHn/dznbKj0Hh6X3j/cHlt5FvwhpJJ0v23sYvGSXxJwz+qyjaveLSH8QsU3zo 9NQkczFeL66aQ4NjACI2+5AJKieWUf79VPdyiuGpr9WbVwH2VplTsq5UA9GAmvopVz YNW3M5rbgLqB9QaQIpVSvYPW0uuLkFUn80fFjWQGr9jetAFPHftKkoRdXBUMB7BxWv 9+mp9UTr2dXFkca2f391g8384T0ka/ff58fx4jefQNSg0kYAz8xxiTyQpRfQlFNEGp oFcjwd9lccwFEKcTUVE3TEaY4qC+rZhY0515cTPbDnuBvB4uJx+fYBTDuVnKsytQRe oNt1ID+6hPBbA== Message-ID: <0eebfd74-f849-1f9b-6a0b-b25fbbcc7907@plan-b.pwste.edu.pl> Date: Sun, 10 Sep 2023 08:29:50 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: Update to BETA1 can't login: pam_opie.so not found To: stable@freebsd.org References: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> Content-Language: en-US From: Marek Zarychta In-Reply-To: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.70 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[plan-b.pwste.edu.pl,none]; R_DKIM_ALLOW(-0.20)[plan-b.pwste.edu.pl:s=plan-b-mailer]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL]; MLMMJ_DEST(0.00)[stable@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[2001:678:618::40:query timed out,2a02:22e0:cf00:1ff:1584:3563:b9b7:f2cf:query timed out]; RCVD_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[plan-b.pwste.edu.pl:+]; R_SPF_NA(0.00)[no SPF record]; TO_DN_NONE(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rk0MK4rk1z4fcp W dniu 10.09.2023 o 07:40, Nenhum_de_Nos pisze: > Hi, > > just updated my nanopi R5S to BETA1: > > FreeBSD 14.0-BETA1 FreeBSD 14.0-BETA1 aarch64 1400097 #0 > releng/14.0-n265061-5e5854520ee6: Sat Sep 9 20:20:11 -03 2023 > root@NanopiR5S-nvme:/usr/obj/usr/src-14/arm64.aarch64/sys/GENERIC.pfndb > arm64 > > the config just has PF builtin. > > git checkout releng/14.0 and the default make buildworld/make buildkernel; > make installworld;make installkernel stuff. Hello, you skipped running etcupdate(8) or mergemaster(8) in this chain. > > No I can't login, ssh or locally. When locally by serial, I get the > pam_opie.so not found. I read UPDATING on git for releng/14.0 and saw > nothing about PAM. I can get to it by choosing single user on boot. I did > a find for this module, and none are found. > > I saw this: > > /etc/pam.d/sshd:auth sufficient pam_opie.so no_warn no_fake_prompts > > Then I commented all lines for ssh, other and system files in /etc/pam.d. > Now I can login again. Is this a expected behaviour? It's 100% expected. Please get rid or comment lines including pam_opie.so in the files in /etc/pam.d/ directory. > > My old kernel and world was: > > FreeBSD NanopiR5S-nvme 14.0-CURRENT FreeBSD 14.0-CURRENT #0: Sun Jul 16 > 05:15:49 -03 2023 > root@NanopiR5S-nvme:/usr/obj/usr/src-main/arm64.aarch64/sys/GENERIC.pfndb > a rm64 > > > Thanks, > > matheus > > Cheers -- Marek Zarychta From nobody Sun Sep 10 07:31:05 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk1k65V8Dz4s3nG for ; Sun, 10 Sep 2023 07:31:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-23.consmr.mail.gq1.yahoo.com (sonic311-23.consmr.mail.gq1.yahoo.com [98.137.65.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk1k56j5Pz3TbJ for ; Sun, 10 Sep 2023 07:31:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=OyiQJDzc; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694331083; bh=KCvBMF0pqUTKBW2rqm2632SPFqJgWu2xcNGGdeGIGr4=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=OyiQJDzc2m5l8PS3UVDr3KzgIhVd/4bfUPEykxfZLs0E90M6pRGWv6ZUgitKS5zoXNDo4h9IPoYp2VSla9eCiCfy5Fzf1ooZn8J5cPgMyJDDQPIYmQLqWh9HHXXqh4at7Pa6nAuYfIoXBiEpgnkt0nZ374Z8oS2PuOtrNGR1BTsuwTzfYWxUeuyr8u8yjTZCu9Gf+K87xnWFOwocaDQSWH+iLUgbDQBYdoMEmKZj3CQz5MoL/hhocBLRHBpIXPyCpDMKRH0JiPfvfhJR6ZuOQGrSuQKcVziRMu+vZ24kUWaen7u/jlKBAr25mHmDMD8eJglCvfXLqMGEKjQsaGYLGQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694331083; bh=hBBEKiPFBMd0Yzko7Q4eGKxVcDPGdV14Oz0Mx3Y/2Zl=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ZubkpRWWlKwteVrRzt191mtd/2UiiXXTe+W9rPBfSWZYTZUrpd/aJ2fL3QJVYN+XcI4NxwVKrYoOh0ncXKCS5f4bQlr1NWB4HFc+iqeDIlR2Vaf6x+a4jWkVBMnGbWe7Cu3h0qvToYQHBBVWBCqNpvWP/99t0QxtPVIOEfQigOURk9rUG+lscnhmWTVgc1G3eYLWfP1UR65nPPwWhb4n8OaxyF3/JUz+1et0QVQsCTGLwWWx8fPPDyaqGzWXdvc5YB1ZUU9kzr3IJjuOtbl+GczY8gzl82L1FVOxU9sD/Lo/2keffBQvkUknncoh58F7S4WnGKo8j3ywgMBg3sI+Pw== X-YMail-OSG: rdHHi_MVM1kQ6oBd89oSNpd99LqEUfMnA_IUFgwpJIon9y1QvQ_Y1amJ79vrsAX oPI7zj0eQTKsdVnddnQPPnoEmoGTSDX4uPk6APmh55LyAH8eho9SPMupLZY_lf25Q1PiVk0cWDT9 uOq_6gwyGRDOoVbccn9DXNCabU4S.VaeZiKJnhO9S7oq2w566dIkUzm8HGGRurJLMLSwPefevWDZ MOhkJOwN.ROwDCj.9wnjednTBSnKNSHr23..5KIZ9Pqbffr_1eKsK.XjtMjukvY7Kv91ZLvDrdRk 4zBT_l8serg8YEJIs2QQkVUCIQMdHr42EOHUq0MZBSq9NZvjEl.wj68SnQGLleFyDJKulCQMQHVL 2KFXGXyCK1S.0ZZ1QB4FKJPrIze.g92Cvzm6_Wn74BBD9E51McETa2lQlbp5sVARZRWjzjgfbT_W I4TZ.Kb.8KZ_mBo9joa.avwWmLJ2ihqHdCDdo4.rVWE8gtG73R4rrYtvix355KBSiaaWeMlv8Vsu sfkbVu3ztY53zeGMorrK.oRjDmBQqa0W3ABphh7X48DwZKpd_XCfbrBB9l_mxPEgsuEeX_kg9BgI 0Cg28TjKE82TfoDPKr6SSLNHYdHI7p9RnSNA6CL6x9FPTBSMvwKk0RMO7vF.qyuTkKZc9aXABLAl UU_YWSyDTvIx1mJYtl7edx8ZYhzEol7K8BuDzp_OBwv_r0X7g_2AKvSPpB7Mh1UgS7bIHtrAqulQ X1x.E9dNNj163nZdLGXyz9IimSwvQbzzuseXGLz0FPsmMYGdWwao69illBR6a6hBlTWH0l_z_QZo pMkEz4cOrInncCwAhxZeeGoikICFw0MMg9mP7p.6GDv3tII1s8KQl3qMz5tC0Yla1gF8VGzwAh1Y 6YS73c3WQX.g_M310VO1UQKA6I3T3fTPS.JsN2uGtn_WIqbGvEybYsP9iJDtwedoD3p0GBtRAg9q VqprJhVYCBiKlmsAcnSklkCmRaGgJro6WsK6szGAziXtCHfnCR24B9HMquzcdTRVuj8C2NU5zHzY vG3TzWiGdBrz1m3WtSqY9V9S9WjwtWicRWuh_1KIgg3f7VuRVj1dqcopw04Eg0s7C5dUdo4DZiiy RKgArx6saU5RcghY1zwbzzA0DgqbJ_C3.u5.vwxD8oaO12OO6Sx5MRrC4UA8aGJs58E12W5g.3HQ ldgecMvD3QcsGXTzKFU05DXQOzGjHZE9n6sFlJYmykiV7C4F40.PdS7z.rxtOUFZZhhdZTrVPbZo qOMVaaJnfGyvS3z2LehaRzJ63NIfiYh9_QQYk92VIPZ0SDUskiwcClsJh.Il46Z2wTM8wWzvVa_Y GIwz0.ezia_UHEJGJoIhlezkeOwXd8rhdBfJvbx2q7dzZQZ4VWPEv.S_Jpdga.Ryy6FLAZHBJit8 brfP3GvNbv_qwOD_NnqkunrO_bFZaAmSsbyPM.o1Iyv8EgWJ5aiR8kPplGrRfOeE.PeTp8V01h7v agqYPJemg2dvnHX1IPkJXTSCD1_l7nKaPjPm3tTCKn_BRg8TGBMKV5n4pStgXSKicWxxW4V7Q1yv cpfQzFDWD1oZmhNUcY.3iFCZkMyhKdqq7GcCtNcM38lx710V9KLPmhRFlNB4Lt4v3LArfzCB_5TV 9F59jHuAPrVxiao2sghbXxYP_qBlMAbO8gb6UhvEe1U0FyH2ODs4K13ikJm03AVD6aUVEQnBjAgu 8cC4uKgmu58f_GoZUVCjCAMrLSipFwe68RsnwmKTJSKFI0JUnzPyC2sJRG2yj77PvuqMLUBoaHb0 r1LfZXS1nR5xI22w8C_C5z2YLt7_T52OEpP4jALqHbbm75WVocmGZvi3T41DK1j2BcykhmwpLtnD T0JBjtkyv5v3Z581wts.4kodWCHun8bItXLvVPYXn1bcM6NXr2yZoC.CCl_tBeGIpdwkteEnprlb C0udG9WRWv144k67zIMCm1hfK6f2qXFMumR6lEtWr_Purt8b49RC3H8LIgW33bmASlg2kJEMllNH 9YbyKgymQBB18W9JMgHSty4saJB3XoefFcFzBiVk5RkGoAzfSixlrj7p3kcB7jsVwK1LajwwQwNe ak749ee.cl4UalsF1sXjBG6X0xhB.kTmuaOBt9UzMYhhNJ8hvIhJuH6lwqApapuZ7NqC5ppw5CIB 9aErzyHpig8tqBXrPN6OmMXsobJ0DaBKRovrWGssHHfN9GSsvtaMTVR.Mo49Rt6gm5tmpLYSBGdb 8rWktTqrbIuXJ0rjswZ2Pu0Fas9sKMn7IouPaZtO5otDwzlHWFm3sP5BDT57Fxlx3chnCbMrjkLW U0KGAaKeRiiQ- X-Sonic-MF: X-Sonic-ID: 013dcad6-56d3-434c-9dd9-8a31b4d942c6 Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 07:31:23 +0000 Received: by hermes--production-bf1-865889d799-sjjww (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 5d9bd5503bf1d429fdfe2520d9091de2; Sun, 10 Sep 2023 07:31:18 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char Message-Id: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> Date: Sun, 10 Sep 2023 00:31:05 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm To: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber X-Mailer: Apple Mail (2.3731.700.6) References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.46 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.961]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[7]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rk1k56j5Pz3TbJ kyua tests that use the: /usr/tests/sys/cddl/zfs/bin/mkfile program like so (for example): mkfile 500M /testpool.1861/bigfile.0 (which should be valid) end up with mkfile instead reporting: Standard error: Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... which prevent the kyua test involved from working. Turns out this is from expecting char to be always signed (so a -1 vs. 255 distinction, here in an aarch64 context): . . . (gdb) list 179 /* Options. */ 180 while ((ch = getopt(argc, argv, "nv")) != -1) { 181 switch (ch) { 182 case 'n': 183 nofill = 1; 184 break; 185 case 'v': (gdb) print ch $16 = 255 '\377' (gdb) print/x -1 $17 = 0xffffffff (gdb) print/x ch $18 = 0xff . . . With the mix of unsigned and signed it ends up being a 0xffu != 0xffffffffu test, which is always true. So the switch is reached as if a "-" prefix was present (that is not). Then the "option" is classified as invalid and the usage message is produced. Apparently no one had noticed. That, in turn, suggests a lack of inspected testing on aarch64, powerpc64, powerpc64le, armv7, powerpc, and powerpcspe. That, in turn, suggests that kyua test inspection for the likes of aarch64 is not historically a part of the release process for openzfs or for operating systems that include openzfs. === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 12:28:07 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk8JV03rfz4slH6 for ; Sun, 10 Sep 2023 12:28:10 +0000 (UTC) (envelope-from lojas@arroway.org) Received: from hobbes.arroway.org (hobbes.arroway.org [173.199.118.77]) by mx1.freebsd.org (Postfix) with ESMTP id 4Rk8JS6RdJz4Wnc for ; Sun, 10 Sep 2023 12:28:08 +0000 (UTC) (envelope-from lojas@arroway.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of lojas@arroway.org designates 173.199.118.77 as permitted sender) smtp.mailfrom=lojas@arroway.org; dmarc=none Received: from [10.1.7.91] (unknown [179.190.151.251]) by hobbes.arroway.org (Postfix) with ESMTPA id A237C14D3F4 for ; Sun, 10 Sep 2023 09:28:06 -0300 (-03) Received: from 10.1.4.57 (SquirrelMail authenticated user matheus) by 10.1.7.91 with HTTP; Sun, 10 Sep 2023 12:28:07 -0000 Message-ID: <315098c3253939c22badef914be218d6.squirrel@10.1.7.91> In-Reply-To: <0eebfd74-f849-1f9b-6a0b-b25fbbcc7907@plan-b.pwste.edu.pl> References: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> <0eebfd74-f849-1f9b-6a0b-b25fbbcc7907@plan-b.pwste.edu.pl> Date: Sun, 10 Sep 2023 12:28:07 -0000 Subject: Re: Update to BETA1 can't login: pam_opie.so not found From: "Nenhum_de_Nos" To: stable@freebsd.org User-Agent: SquirrelMail/1.4.23 [SVN] List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain;charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Priority: 3 (Normal) Importance: Normal X-Spamd-Bar: - X-Spamd-Result: default: False [-1.19 / 15.00]; MID_BARE_IP(2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_MEDIUM(-0.99)[-0.989]; R_SPF_ALLOW(-0.20)[+a]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; HAS_X_PRIO_THREE(0.00)[3]; ASN(0.00)[asn:20473, ipnet:173.199.116.0/22, country:US]; R_DKIM_NA(0.00)[]; DMARC_NA(0.00)[arroway.org]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4Rk8JS6RdJz4Wnc > W dniu 10.09.2023 o 07:40, Nenhum_de_Nos pisze: >> Hi, >> >> just updated my nanopi R5S to BETA1: >> >> FreeBSD 14.0-BETA1 FreeBSD 14.0-BETA1 aarch64 1400097 #0 >> releng/14.0-n265061-5e5854520ee6: Sat Sep 9 20:20:11 -03 2023 >> root@NanopiR5S-nvme:/usr/obj/usr/src-14/arm64.aarch64/sys/GENERIC.pfndb >> arm64 >> >> the config just has PF builtin. >> >> git checkout releng/14.0 and the default make buildworld/make >> buildkernel; >> make installworld;make installkernel stuff. > Hello, you skipped running etcupdate(8) or mergemaster(8) in this chain. Hi, sorry I forgot to say here. I did run mergamaster -p before installworld, and mergamaster -Ui after. >> >> No I can't login, ssh or locally. When locally by serial, I get the >> pam_opie.so not found. I read UPDATING on git for releng/14.0 and saw >> nothing about PAM. I can get to it by choosing single user on boot. I >> did >> a find for this module, and none are found. >> >> I saw this: >> >> /etc/pam.d/sshd:auth sufficient pam_opie.so no_warn no_fake_prompts >> >> Then I commented all lines for ssh, other and system files in >> /etc/pam.d. >> Now I can login again. Is this a expected behaviour? > It's 100% expected. Please get rid or comment lines including > pam_opie.so in the files in /etc/pam.d/ directory. Ok, I will, thanks! matheus >> >> My old kernel and world was: >> >> FreeBSD NanopiR5S-nvme 14.0-CURRENT FreeBSD 14.0-CURRENT #0: Sun Jul 16 >> 05:15:49 -03 2023 >> root@NanopiR5S-nvme:/usr/obj/usr/src-main/arm64.aarch64/sys/GENERIC.pfndb >> a rm64 >> >> >> Thanks, >> >> matheus >> >> > Cheers > > -- > Marek Zarychta > > > From nobody Sun Sep 10 12:58:37 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rk8zp0bl4z4s65x; Sun, 10 Sep 2023 12:58:46 +0000 (UTC) (envelope-from mike@karels.net) Received: from mail2.karels.net (mail2.karels.net [3.19.118.201]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "freebsd", Issuer "freebsd" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rk8zn5mqQz3DCl; Sun, 10 Sep 2023 12:58:45 +0000 (UTC) (envelope-from mike@karels.net) Authentication-Results: mx1.freebsd.org; none Received: from mail2.karels.net (localhost [IPv6:0:0:0:0:0:0:0:1]) by mail2.karels.net (8.17.1/8.17.1) with ESMTP id 38ACwb8u013537; Sun, 10 Sep 2023 07:58:37 -0500 (CDT) (envelope-from mike@karels.net) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=karels.net; s=mail2; t=1694350718; bh=23LKbuZhxZ330IzoDPq0Rmobyt8gO+qow7yHWojVXl0=; h=From:To:Cc:Subject:Date:In-Reply-To:References; b=WNXzCurJFcRFkts/7GiinT6IYHp61r6LTed/6nhXL6wAhht20qoXpi95kUB6gfhSj /RNWxPSWRR/oqf7H5/0g/mMev8Gsi+Q7SYId9B9E7V1IKYY1suqnFc5B/Gk9tH+zZv qv3iUKGf+wb18NMnYZQnxhXWTnpA/sdColhYNF3uMppKMli2p3Cs8rbTyWItaQxNM4 kMXEwsv8oyy7245wQ1Zvhayvyp4/NHT+QQhMRKl5VIgefLXkYJ5V8PsadpR7ou6Slj uZdiM3rUAwPz2QdRkaG15bfHG5CCh2ZBsU0lnv5KCxL6/lT4atroekWi7tqRGXyHlD o4wPVh7fGV0Lw== Received: from [10.0.2.130] ([73.62.165.147]) by mail2.karels.net with ESMTPSA id k6IfLH29/WTfNAAAs/W3XQ (envelope-from ); Sun, 10 Sep 2023 07:58:37 -0500 From: Mike Karels To: Mark Millard Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char Date: Sun, 10 Sep 2023 07:58:37 -0500 X-Mailer: MailMate (1.14r5964) Message-ID: In-Reply-To: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:16509, ipnet:3.16.0.0/14, country:US] X-Rspamd-Queue-Id: 4Rk8zn5mqQz3DCl On 10 Sep 2023, at 2:31, Mark Millard wrote: > kyua tests that use the: > > /usr/tests/sys/cddl/zfs/bin/mkfile > > program like so (for example): > > mkfile 500M /testpool.1861/bigfile.0 > > (which should be valid) end up with mkfile > instead reporting: > > Standard error: > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > which prevent the kyua test involved from working. > > Turns out this is from expecting char to be always > signed (so a -1 vs. 255 distinction, here in an > aarch64 context): > > . . . > (gdb) list > 179 /* Options. */ > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > 181 switch (ch) { > 182 case 'n': > 183 nofill = 1; > 184 break; > 185 case 'v': > (gdb) print ch > $16 = 255 '\377' > (gdb) print/x -1 > $17 = 0xffffffff > (gdb) print/x ch > $18 = 0xff > . . . > > With the mix of unsigned and signed it ends up > being a 0xffu != 0xffffffffu test, which is > always true. mkfile is broken. getopt returns an int, and -1 on end. It never returns 0xff. But mkfile declares ch as char, which truncates the return value -1. ch is a bad (misleading) variable name, although getopt(3) uses it as well (but declared as int). Mike > So the switch is reached as if a "-" prefix was > present (that is not). Then the "option" is classified > as invalid and the usage message is produced. > > Apparently no one had noticed. That, in turn, suggests a > lack of inspected testing on aarch64, powerpc64, > powerpc64le, armv7, powerpc, and powerpcspe. That, in > turn, suggests that kyua test inspection for the likes > of aarch64 is not historically a part of the release > process for openzfs or for operating systems that include > openzfs. > > > === > Mark Millard > marklmi at yahoo.com From nobody Sun Sep 10 15:43:24 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkDf85pnvz4shYm for ; Sun, 10 Sep 2023 15:43:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkDf835KTz4fxZ for ; Sun, 10 Sep 2023 15:43:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694360621; bh=2rbZTEfWWo8RKoiAhtH6XccZ5H33oAnFblm39qEEt3k=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=OKD5xtPpL8WewSQaoVOf87gSf3MUPLYvU/w03OdXkP1yxKPwfrW9HNmuw2kv2jSoJ1fS2lGD528iinAV3SszMgcDSMv2hUZO3Hwk7939SFKKgPveFng17YDxu2M50yUGO+sn9JhQ3Tf5YVgC2+CGa8IrMKz+W2Jlz1oxqM3jdtRv2gf5zQg74d/erITugHhnkXBrT+UBNPEPXMT2ytS00Y00kNbRsMiIi+zPl0LAqCdcHY1EDbzCj0BGmBkuHI9Z4wDFFzMEk9Fftj+tGKe6efj2NkZnqBHxSRKc77kC3X1Pw7J0vl3IpwwoU56cajy4gGRc53ZqrMJp19WbvoTXSw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694360621; bh=BULofRULbdIiQdtMMG/h7fR4pps1v2stgc2v5E6Nf+y=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=iSTwcJzByjOWvjvP0C/RXL+CP1Jc2WohuT/0KcjMncOTCfW8HAWSOG/vWbyHKoU1Rqt4rwsi4TO/8Fc5QrB1wfdiaLTnlu/YxXgRVyEKx9aZ+UmOnz4pyFCZn8nk6cAEesNxmUKC6TQLuqqB6pLofFAB4vP7dnAbg4uBxBOQcYoCGKIGC5Sc7F600jvwWqJoK5FiWvZJs1A1aaQ5JrJlTqKugFnnQya3IbxZPoE9KfATsMtg4wTVxEIFtBWllXeV7THyU9St+KPtWadoCibDkYkSAI9RneycduyrQ1bw66h+fN36gauGdYySgX0Ry4r+UDG+x2M28g8g+vDvETc+uw== X-YMail-OSG: vUzaD98VM1m41TaBr8bQCWZbnrbdv3aG14bMf_e75Q1DTDhMB1onAB1OOzDe_DL JlTrx4LJExc0IvKZ5zL1UvAniUXYxnbATgFBHyUOvDZ9p_kyvRc4WFRjVBmpmeEIJ_B9wD_LJWxI Gwi6jrT9BctCNfXJg1209UGw047QLYJ9wkykbsnpqFHX6EBca8Z47BgMEDoG9bHYP3aWtNNH6GF8 7.c.Zy05ntotfHnWt3po9Frr7VkNPB43kmbaW0y_9zmpVAbvKGHwB6T3WApLtcnJ38CJwrD1tClK eeEQn5Ztf1sdTHd6IlKbqEI4g2MORX826p0wEP_nXBV5e6EXmMfPv52C85IdOZ3KPv2N5M.eVN4s GIJv.APoScxuVQtiULBIVzWH8eQbRtD9j9L864gpcad4NA0rSDKOXsagzTvIcqv6CRoN4nfd.KcI V1rDP1fY7lNuo7Fxqu3ec8evlWryQ4MFBv5lxRNsVER7xJU9IUJkTHpeKl0l5IuF70JQJPghSFkW FUE9mchuHystif.GYXVoefIl2CiadnspBrD8irpvo8dm3ugpSCojUNjCaa.4LkCcZRftgaVUxRXs ngqN6FYY7JJPLAZw7GbiTnrcESDqQjAHnCeDzxobHC9INV793XUuSrPvLwoQoPHHYCMOMGL0RP7l tRz9hKiVCLWoCARWaU4YDS3rPLfu3i61bsuFyNVMUZ6ZWjInqNigygIKCEdoA20PxnKD8tuzFfGQ HX5iJcMYS7Pl7OUlNjBa0hF9r6e9mi384H5vt8TkyxTP9WqrTc.UEoqe9i_9_pxjyP_ft6apXzQl nzjWySfjeJVo03pLRoTS5D_d_ydsczMgwK_KJqzZjeTdXDP1gfA064rsgMugqkX.jrMbCVm00ATI CoattG4NKVWvPNXFO9aeBI1XAck4g9FQW1y9mxhzfSvkY8003cS3pyfnqekIif2fDZXCxs5qt50k VTyGq8pYUFMwRQIGwQF3Fyr05q3mXHaq.MEpxYBvVjrQ_SfHY6BWEtaGZHh0C39Cllk_GElYyOAf d2IUfcEu.HWoD2R76f13zSe1SHv7XAWIgRpDO9sZbcAXdUEyUuUlD_60wx2HPvwN8RNcxCqVV0L6 sk_5L3lQY0KdYS40KY1muW8sY5H6RTcASIsJoGhMTljCUwCwuYZLxO0Bk9foCqvhnMFKm9oaiPtx vC5r0IAYv6Dtwn_y18ue0on78QVng3ss.6tMqAH4cgST5ZM5M4CnlTzEolnF.BhLcio3T26m6kqG V7rQHrvaM06VT5AW0kefA4r0cMnHNCutRRhzSxtEkO2G3WuNYkTGrukj.3q2hdLGadHVP1wQcorO oPF5QnDAoNrb63vERqmxifWzJml3pmWHt6qULmDMIIUjhlVQefVm2yDzjnbblto3nbQ9wrnSEDkb ZGhxcnDd_FJTxL6Q_.QCKh3LziXd3pGTbBo8F9PEqj2.idfDgQyze9mUOBj09Jt9SoDWwZCVRLyY 98ZhmSk97an7vkfZ_5A5mlA5nXtaJOZyQxoqEvjd087MtMnydMEPCCwZHtjE0ghZdve1yW82qQHj bopwVwfl_CuiZfqz.yXhefF3p7Z.B9.rzuuPM5Xm5hobMnBAhfX.LZTGawkOAjzdPgKaXNImS29z Rt8mNxYTzUmEi5pHbloYRVeNvFANwhVbwqOmmM0.2W08HNrAc9TR1r184739pXE70FKv.uQPE3dq CMI9kGPjK73yHPXVtcWm68ePYIWrhgic.MxTwqcUVz7pWAZWNN0NKsIdQHJoqpnhgGCV2cgHQC0Q eP9gmcwHsCB.l0Um2jR0qfmvqeLLSgM3xh9GiflYMW8HerDAtXiLaTWeahr44QSKCd3r9AeKhZBG ax4laU2vGg_zjFWdMKVgC0zLbkHz_QfMdapq3QrIIiXeRBLVQpPADdcI9_lqBw9KDaMDRHuqTgbS mbFWqzjVCqg3v6wNP9JHzT8pf85hL9aIVIYnLnOPErSkGjY2b0M0uAMUqOPvTINqzSQa2ETdoae2 gHc5FH_7PUP2bh_Pvvbcg5aSCVNxiYzIx4GkDLl8qHWMbsqKHNw4h_wm7_9Pe_Aa2aP18v9_F1_8 0fgaBQtA92P6ps.ETjoyoylrXqxjoApkb9ki44mmIKSc2_3dpyEuNBU.D6mxnZasd9a0CUMbsEHM XjyzVFrpvArSbWu2ugy0mb1IcRzqM5DSY9UedKkYExUZ3tQiSySEVpMYL4C29J3aCF_jthE..0np 89m1.VyCZbBVh9_PxmYAPtwL5XLAO.c9zHgKaZNRq2oUXpoC3IVzSBJPv3pEWhCdGyYhr4uKDCBW OnT4- X-Sonic-MF: X-Sonic-ID: bcd41371-d9aa-47f7-850e-47cc700bab0c Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 15:43:41 +0000 Received: by hermes--production-bf1-865889d799-7vf9r (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 40160cf81dc8e6fb3d3dc63f595ff7ec; Sun, 10 Sep 2023 15:43:37 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: Date: Sun, 10 Sep 2023 08:43:24 -0700 Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: 7bit Message-Id: <02F48605-887C-446C-9647-8757D50B4B24@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A.ref@yahoo.com> <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Mike Karels X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RkDf835KTz4fxZ On Sep 10, 2023, at 05:58, Mike Karels wrote: > On 10 Sep 2023, at 2:31, Mark Millard wrote: > >> kyua tests that use the: >> >> /usr/tests/sys/cddl/zfs/bin/mkfile >> >> program like so (for example): >> >> mkfile 500M /testpool.1861/bigfile.0 >> >> (which should be valid) end up with mkfile >> instead reporting: >> >> Standard error: >> Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... >> >> which prevent the kyua test involved from working. >> >> Turns out this is from expecting char to be always >> signed (so a -1 vs. 255 distinction, here in an >> aarch64 context): >> >> . . . >> (gdb) list >> 179 /* Options. */ >> 180 while ((ch = getopt(argc, argv, "nv")) != -1) { >> 181 switch (ch) { >> 182 case 'n': >> 183 nofill = 1; >> 184 break; >> 185 case 'v': >> (gdb) print ch >> $16 = 255 '\377' >> (gdb) print/x -1 >> $17 = 0xffffffff >> (gdb) print/x ch >> $18 = 0xff >> . . . >> >> With the mix of unsigned and signed it ends up >> being a 0xffu != 0xffffffffu test, which is >> always true. > > mkfile is broken. getopt returns an int, and -1 on end. > It never returns 0xff. But mkfile declares ch as char, > which truncates the return value -1. ch is a bad (misleading) > variable name, although getopt(3) uses it as well (but declared > as int). Yep: for char being signed, the code is still wrong via the char ch use. But the observed behavior is very different than for char being used but being unsigned. In this context, consequences of the unsigned char behavioral results are observable in the kyua run results but went unnoticed. I used to run into examples of the use of unsigned char for holding the getopt result back in my powerpc days as well and dealt with upstreams for a port or 2 for getting it fixed after finding such was the source of odd behavior I'd observed. If I remember right, this is the first example of running into the specific issue in my aarch64 and armv7 time frame. > Mike > >> So the switch is reached as if a "-" prefix was >> present (that is not). Then the "option" is classified >> as invalid and the usage message is produced. >> >> Apparently no one had noticed. That, in turn, suggests a >> lack of inspected testing on aarch64, powerpc64, >> powerpc64le, armv7, powerpc, and powerpcspe. That, in >> turn, suggests that kyua test inspection for the likes >> of aarch64 is not historically a part of the release >> process for openzfs or for operating systems that include >> openzfs. > === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 17:10:26 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkGZZ0flTz4sXXK for ; Sun, 10 Sep 2023 17:10:46 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-54.consmr.mail.gq1.yahoo.com (sonic316-54.consmr.mail.gq1.yahoo.com [98.137.69.30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkGZX5kcqz4G1N for ; Sun, 10 Sep 2023 17:10:44 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=itmHyFKj; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.30 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694365841; bh=LXpQfZDkoQ8F64UEC/En2DjHEoPuw0bPXWd/h+8PRCU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=itmHyFKjrKZL5TOUBK+NT31YOq7MWbCjhfOyme5LB+iFIZD4API5rhlypFlmxl9UugnDzR4wA6FDITVnD5OAsirM3kKl1TK5gHgX6kFvXAQfzyLMQ9jr9w3sCcNuR0LRDcfKHIvqYomSwowR1mACRZDOzhKAlT9yH51gO9sz7CSz6Gie84f/vVShx8LoW6Zv35/5Y6vTV7HoYfJDtoHixpFB8CRWgY+Ls4YylKZNNA4wr63Kgs54JdfiPzhIFfhpPln9L21r6FVrJXxnKQcBQ5L2f6M2l7bQYHGTtYGjLafQTctF3zw0i/kpw9oCOI7CNKCWFpDOFQYimvYGl8r5/g== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694365841; bh=4a/birP/vkOdArxklt5RsWZAT1YQRzY792jkGMMieI8=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=sCzLrG6aG2RFptj+iMKknnJmb5lBtb0163K4wS17ZFiPE9J1zcnM0RyrC5Lop9axZsPmJgHGTakfQXPowIAbH1ZpFYUStjWG1K8G6GblFWeA2pJzPoq6906HbUmzizBJ068Z45zyA3w00Jbbj6mppudielKhH5GHegI1o91SF4g0sP1csd0twE8deWjKuzKR8ur2MJuFO2c3Zp2oSyewt3GPR8o3HECIHlklpXsUxJvmYqF/FaalWk9RyUAj+yUZWeZDdxdIx6DWFntcShfrtcRJ0tRc4tXpaZZMN8blNeB8lGHQekOvF3ZZgeYkTp7jAQFa5Xvma2GVXGfDUnJELg== X-YMail-OSG: h5poq84VM1kOr3clFq5UPfjBmUhymIkrHs83EIKLGv9bp6egRh.2.RhQyjb6iG2 E8FvmfN8NYuadWUW4M65nuDyK9taebSaC1w0Ir_tT82mD7oUHu0i_XKidUubd43yWEV25HSwPYHg FYIzWgINlViEke3oVqvDufTHXF3Dg4eKl4.khjDyI3Bg1mdlOkmbmaZf5.yBdsLxcmUKI2S16H8N jm68GRiPhuTTC5Hhr2_a2Ot_pkG008gYIzMASo4ryjYBTU_rLngT9cy8xjYSX4jczXLG9WUzDXSJ Yl5_0bCZL_5a2DAVoNK3.Sa6JVT5MIMQ1lRDKY8vlE7dLNK0qmzNW9Iiiz653IjGgvQ_N1puVyai qMt4Eb7YLi72wU2wXV06gimI2afFalHnywCRyNmtnCXPLJ5nsY6mRBIuShGB1K3Fm.nCXWBMjsq0 bwe093iXpZIYJWFszgMzwnAnx5Dy9lRWruxq5C2E949cA28zlaZZGOk0_siH6EXkt6dr4wATiRTA I9Y5rejZAZeM5v8UDpNmzBu7kVxceM8q2MYODdcbDwBjsmN9_pxBoUYSVVRSyEL0JjbH1HV5lLsV b8NLSlcerh9KEh0pezlz9tJZ6nwGPQRuYQizpEiesls1Pp4dOV9MlzbV2wjMT40UyRPnvvdn00PW 9eIdDb.jkeJxOn9J9Lub4eI2KpWO.Rz6EMi2TmcM5su7UsnGUvg88aBW6vON8JwtL2c4nGe0RGrq uJw0wUHqj3ecvxUjOz_jgVrfjUuqTCIHe.uOFLQygzPVMi13udWwMcGqG.oNlIQI6Nbgzrz6L5CF fpaCNjl_A3z2UtmxfcPhPGJHdQ6d5d.iVECWacelbzodRJMgkYi21fWSYv6JuiVk4C4Z.hLTnqTK deACAOLepMTMciwX3y58NPuZfxr_keQzkxbelEXSKs8jvCMyv5e8CzfsBa59GH2xHGVfLUzmoxwp afFqlOqAZUY31kA4cW1sycevTiio0OJZwbocKjo8owioXZboGgCIsSpE54ydGTgAnDvKPZzp.7Fm UmlehQoNukdFygKdFQqI6JntMCZRzUlWV8lKhWnVEOkEC_6AJ1MC6nIdFfEs.IYFEf.vw3FMPs0e MBW.dbOwQ5lXNZZQRrPN.TlBv0Aa_8gToSno6wTRYg78Tu_9eJRBrr_PJi4g5uuSgrSpxQgHpur8 Oxrzy5zjiOWdm2401BzNVUKZMHV120LZYZyYrE6j6Ro4z.xXyUUHhEZUmV2QwEfKjxUQKD05kfDZ gAO6GcWtdTqMLH1qLaeQvuaxVFOTWlsHAz9DqHQT9acT.7xzb6RHkPD6VuAm_3KLWbU7vO2d24HU nt2OB4A4CrXSo8Iw7sjJPYtYsG8lgD5qCZBZnmkpPUojLnJ7Qjkmt_0630t3Us3XtpXPDanLjNQ8 GRVLOrpzuyM26bnhvFpcju1tn3bo_yEhGvqkR6HdXUAIxgZgJfR2okbJNHFfeDabn.YSV3att8A0 3_3yRLNJzKCk8ekjoM7c9UkrTlvbluVtrFkS_CS7UZCo558g2wt_csmrN2ZkCeNXmDN_S2a3I2DG AONcXIZeBbl443KZqMqVhkIQ6fX4pi8AmWmr6Z0FxKkINu1WXqh77eI6JbTC_fnRcrFS8LwyM84R K4eJqblRWzyLEttwz1eLFU7ZZJTVRW_Lf2VilyKdzenldjYC38eou9CjPSIwo9HsqhTk67rifGw8 w1vVVerpNOw8cge59LtbYIAYiBYTuioCgJTsMUi9wp8JD9HPs5rGAPAyRe5Y93HDmZuA_tFgheUh DgpWUbRxFe9979UhH8EvRsq_k54aS3sy0VzyxZ7TxSUC0JtbQevmUazFaEkVU.qYkLAeT0yO4S3U SZgdEiy2dmb.7FMEv83iQfJUlP02DdfY4cG6NLz6WK3dPf7RMOy7zNYZrREtxgkjDby_jilw.QtA zHSEWmSS.5uKqhk943GZhRzxJ7tva_UG59vRrvoUS9avKidnuluT2Ockrgh2YePO783ICvY809tX hDTw3rgOHsi51zsua3gAzmugmDH0qLzAxAoadiFP7wtFCT7okFajXMqPivste4Z2isr0wDcdcsbF a5VwWLw7wi6CocahvwbkLgSZbtrJrFGF5g2SiTJ7PA1xFGxqGeO2PmzYVT.VumIlCtFGNSv5AvMu zuZ1PV2wz8uOvdK1SKWaMlnhN2vgr6dHpdceHjdZ6pN_hmWvqlY7uEy1BHmxjqgL_yBAAJSNh9O0 O0USq.rAUHnCNYeErNdBSaJJV8N5WOulei0OWKb0KAXj2zfalL9Lggn2fBe1sJZUI6WuMU9WmJXI MVtJ_4G3q6dIXx82HXA-- X-Sonic-MF: X-Sonic-ID: e0b07d16-561a-4fb4-a097-dc3f0c467ae3 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 17:10:41 +0000 Received: by hermes--production-gq1-6b7c87dcf5-sv5pn (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID bbc79512b09273d6f9bac26b4e1e9c04; Sun, 10 Sep 2023 17:10:37 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> Date: Sun, 10 Sep 2023 10:10:26 -0700 Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: 7bit Message-Id: References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; BLOCKLISTDE_FAIL(0.00)[98.137.69.30:server fail]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.30:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.30:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[8]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkGZX5kcqz4G1N On Sep 10, 2023, at 00:31, Mark Millard wrote: > kyua tests that use the: > > /usr/tests/sys/cddl/zfs/bin/mkfile > > program like so (for example): > > mkfile 500M /testpool.1861/bigfile.0 > > (which should be valid) end up with mkfile > instead reporting: > > Standard error: > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > which prevent the kyua test involved from working. > > Turns out this is from expecting char to be always > signed (so a -1 vs. 255 distinction, here in an > aarch64 context): > > . . . > (gdb) list > 179 /* Options. */ > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > 181 switch (ch) { > 182 case 'n': > 183 nofill = 1; > 184 break; > 185 case 'v': > (gdb) print ch > $16 = 255 '\377' > (gdb) print/x -1 > $17 = 0xffffffff > (gdb) print/x ch > $18 = 0xff > . . . > > With the mix of unsigned and signed it ends up > being a 0xffu != 0xffffffffu test, which is > always true. > > So the switch is reached as if a "-" prefix was > present (that is not). Then the "option" is classified > as invalid and the usage message is produced. > > Apparently no one had noticed. That, in turn, suggests a > lack of inspected testing on aarch64, powerpc64, > powerpc64le, armv7, powerpc, and powerpcspe. That, in > turn, suggests that kyua test inspection for the likes > of aarch64 is not historically a part of the release > process for openzfs or for operating systems that include > openzfs. > Looks like the mkfile.c traces back to a former port sysutils/mkfile that was unfetchable as of 2019. And, looking around, it seems the kyua zfs tests may be a FreeBSD only thing, not adopted in openzfs. So various implicit assumptions when I wrote the note do not actually hold. FreeBSD would have to do additional testing via kyua, beyond what openzfs does for testing, to discover the unsigned char related mis-behavior in the mkfile that FreeBSD's kyua tests use. Only FreeBSD variants are likely to have a similar status, not general openzfs including operating systems. === Mark Millard marklmi at yahoo.com From nobody Sun Sep 10 18:21:16 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkJ8C1x7Yz4sGHY for ; Sun, 10 Sep 2023 18:21:31 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x636.google.com (mail-ej1-x636.google.com [IPv6:2a00:1450:4864:20::636]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkJ8B4STcz4fsQ for ; Sun, 10 Sep 2023 18:21:30 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x636.google.com with SMTP id a640c23a62f3a-99bcc0adab4so463043866b.2 for ; Sun, 10 Sep 2023 11:21:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1694370088; x=1694974888; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=abD7goBSEuLS/Xh94ZiyPK937DJ64isvmy2QjqmoqzE=; b=RzWaEAndVIAYQtttdx9gLKeGw49er7Ig/IDk18vUaLN/gCBfTbNZWsJvkC40ZAxk9B tAVU4AwSrCw3qhdcrxvAyWQlnuiVOjewGlmqC6Z67aD7v/Q4A7cMqGx2OgKdzYazH+UG H+irUmAG4hjxCdEd2F+KPqVn0Z1TqkGtx4mbgGUT997ubmTyQJbm5ufFpkKOkl/uRJa3 3RJHevkYyxD+68FIP4z5zibh0svQB/3MySsbgNVzlX/973h0NB+dHvv0kwTPEOO9Qe6y ams0DIvc+9YkOSkSgZn5JaokjB4Zx9SzbVlf6XtjnW9MVFey+T7Jw5MC9X/y+/39Oeoq nOxA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694370088; x=1694974888; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=abD7goBSEuLS/Xh94ZiyPK937DJ64isvmy2QjqmoqzE=; b=iwfCDtM5F18o7EWS/jG35q1Fx5VOhkSv3QUrEhDUfyN0ev3OX2ToCdQltbroT23WIA CZ9C5iOXwzujnzgI1k/oS8KmF4bjt9edjqMHkPqW4uA/tqsSDX/Ge/ctIVvQuci/Br2d rjkCHOfF570wNbA2PgYkuu8eKD9SdgutqiQfhmGtl62bDKmpYFqo0YxY/nMDQ9Tzgtrn MQvhZACO/KgBl4ciDpNaK2FiLogm/Ghhg1oxpFFoPSBye5Nrb3tayRu/GGQTivnwouOu k+emzbVWgco0mn/fONm/J+FE9lopSR0tacTrgcth4hlbyWrm7GLsfFLmFivSoWPap2jv LEBw== X-Gm-Message-State: AOJu0YxyXEfJx6RnxEggEgVCdaa30shamN2rAfBGV6zPqs0k5zqamL1I AKnoDsxKshnz2HDxSN5nIXArKcDLN5tXj+VpN40E+A== X-Google-Smtp-Source: AGHT+IGO+g+ru/dUmvjmlrKU5ZyNWNccw02kNd6p/f722m/5gR/oMy7qBF4vBvZb0DsmsykODS/iffxjKGqOBOB3pLA= X-Received: by 2002:a17:906:5398:b0:9a1:a916:17c0 with SMTP id g24-20020a170906539800b009a1a91617c0mr6773474ejo.50.1694370088304; Sun, 10 Sep 2023 11:21:28 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> In-Reply-To: From: Warner Losh Date: Sun, 10 Sep 2023 12:21:16 -0600 Message-ID: Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char To: Mark Millard Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Type: multipart/alternative; boundary="0000000000003b54c306050547d8" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4RkJ8B4STcz4fsQ --0000000000003b54c306050547d8 Content-Type: text/plain; charset="UTF-8" On Sun, Sep 10, 2023, 11:10 AM Mark Millard wrote: > On Sep 10, 2023, at 00:31, Mark Millard wrote: > > > kyua tests that use the: > > > > /usr/tests/sys/cddl/zfs/bin/mkfile > > > > program like so (for example): > > > > mkfile 500M /testpool.1861/bigfile.0 > > > > (which should be valid) end up with mkfile > > instead reporting: > > > > Standard error: > > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... > > > > which prevent the kyua test involved from working. > > > > Turns out this is from expecting char to be always > > signed (so a -1 vs. 255 distinction, here in an > > aarch64 context): > > > > . . . > > (gdb) list > > 179 /* Options. */ > > 180 while ((ch = getopt(argc, argv, "nv")) != -1) { > > 181 switch (ch) { > > 182 case 'n': > > 183 nofill = 1; > > 184 break; > > 185 case 'v': > > (gdb) print ch > > $16 = 255 '\377' > > (gdb) print/x -1 > > $17 = 0xffffffff > > (gdb) print/x ch > > $18 = 0xff > > . . . > > > > With the mix of unsigned and signed it ends up > > being a 0xffu != 0xffffffffu test, which is > > always true. > > > > So the switch is reached as if a "-" prefix was > > present (that is not). Then the "option" is classified > > as invalid and the usage message is produced. > > > > Apparently no one had noticed. That, in turn, suggests a > > lack of inspected testing on aarch64, powerpc64, > > powerpc64le, armv7, powerpc, and powerpcspe. That, in > > turn, suggests that kyua test inspection for the likes > > of aarch64 is not historically a part of the release > > process for openzfs or for operating systems that include > > openzfs. > > > > Looks like the mkfile.c traces back to a former port > sysutils/mkfile that was unfetchable as of 2019. And, > looking around, it seems the kyua zfs tests may be a > FreeBSD only thing, not adopted in openzfs. > > So various implicit assumptions when I wrote the note > do not actually hold. > > FreeBSD would have to do additional testing via kyua, > beyond what openzfs does for testing, to discover the > unsigned char related mis-behavior in the mkfile that > FreeBSD's kyua tests use. Only FreeBSD variants are > likely to have a similar status, not general openzfs > including operating systems. > I wonder how hard ot would be to look for the char = getopt() pattern with coccinelle Warner === > Mark Millard > marklmi at yahoo.com > > > --0000000000003b54c306050547d8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Sun, Sep 10, 2023, 11:10 AM Mark Millard <marklmi@yahoo.com> wrote:
On Sep 10, 2023, at 00:31, Mark Millard <mar= klmi@yahoo.com> wrote:

> kyua tests that use the:
>
> /usr/tests/sys/cddl/zfs/bin/mkfile
>
> program like so (for example):
>
> mkfile 500M /testpool.1861/bigfile.0
>
> (which should be valid) end up with mkfile
> instead reporting:
>
> Standard error:
> Usage: mkfile [-nv] <size>[e|p|t|g|m|k|b] <filename> ... >
> which prevent the kyua test involved from working.
>
> Turns out this is from expecting char to be always
> signed (so a -1 vs. 255 distinction, here in an
> aarch64 context):
>
> . . .
> (gdb) list
> 179 /* Options. */
> 180 while ((ch =3D getopt(argc, argv, "nv")) !=3D -1) {
> 181 switch (ch) {
> 182 case 'n':
> 183 nofill =3D 1;
> 184 break;
> 185 case 'v':
> (gdb) print ch
> $16 =3D 255 '\377'
> (gdb) print/x -1
> $17 =3D 0xffffffff
> (gdb) print/x ch
> $18 =3D 0xff
> . . .
>
> With the mix of unsigned and signed it ends up
> being a 0xffu !=3D 0xffffffffu test, which is
> always true.
>
> So the switch is reached as if a "-" prefix was
> present (that is not). Then the "option" is classified
> as invalid and the usage message is produced.
>
> Apparently no one had noticed. That, in turn, suggests a
> lack of inspected testing on aarch64, powerpc64,
> powerpc64le, armv7, powerpc, and powerpcspe. That, in
> turn, suggests that kyua test inspection for the likes
> of aarch64 is not historically a part of the release
> process for openzfs or for operating systems that include
> openzfs.
>

Looks like the mkfile.c traces back to a former port
sysutils/mkfile that was unfetchable as of 2019. And,
looking around, it seems the kyua zfs tests may be a
FreeBSD only thing, not adopted in openzfs.

So various implicit assumptions when I wrote the note
do not actually hold.

FreeBSD would have to do additional testing via kyua,
beyond what openzfs does for testing, to discover the
unsigned char related mis-behavior in the mkfile that
FreeBSD's kyua tests use. Only FreeBSD variants are
likely to have a similar status, not general openzfs
including operating systems.
=
I wonder how hard ot would be to look for the c= har =3D getopt() pattern with coccinelle

<= div dir=3D"auto">Warner

=
=3D=3D=3D
Mark Millard
marklmi at yahoo.com


--0000000000003b54c306050547d8-- From nobody Sun Sep 10 19:24:30 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkKYD46MLz4sxmQ for ; Sun, 10 Sep 2023 19:24:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkKYD1Vzcz3HyG for ; Sun, 10 Sep 2023 19:24:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694373886; bh=8ZtjGfqWBMRASXm6aSE+S0U378n2i4vQh+HnhmXTTwQ=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=sG5t2qX6RQcSkc8Du1Cysu5QhjEPLGG4MQNqFDqvMe/mYCJ2HmkoQE8h6prKpc+aEC0+o2v4PD0td0MPNslLI40xyw9s5eckKT/W2Gky8LO1cnypbXMF+yyp1ZHmoVaE4w5kgPstNzt4+UwofsgBP9/Cb6VNKDr1YtOqOyPkf15v7lw69J/0y/1YHHZzpxOVhdeh8CQjJXJL7p1bvJMxHMJI0//lNVFGUE6Vr4ZdO5+gAUwRaDhVckBa8sfFlV8U8RvFCxhXEOcgcW1P7BmdLS7+eNMk0po4Fg4rl13RKclsk0qnso0qj30Pd96ntnyKCHQoRHVhb+hNq3/Bg0MRyg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694373886; bh=VSYp/koO6t7tSTUEOjfhy/Bd3wFrUiOTndwA1/1cDEE=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=NmS+BgfuxTGfGvPNEM77Azu2M2+xMjxQpwManNAaUg2cRmQzTP3JykogSMVdtVqjLFa7NZboyR7z8gTcf9EMC+DUuew+ebkY16W4D0mm9eBelveluui4aKpqvMo5ovXagauUbZavD+e01cNfJerkmV9mGOpH//qW0JksK2+4jYa3DkTiMIfrPQAtWuIwP9A5UYOef4Svl77wEc79199JAi+ewdEved208InFrAfeOraNcueE3oWthjnlSXMWrUelB/RjxIt0tcBMAqrcFXckpt5wN4riae7shqDbA6lNuW2ndvMPmGjYQ+VVkZrNz/AZGlu4k1AdD5tQL26PZD5xkQ== X-YMail-OSG: xZo.fwsVM1ndf2PLpQ_74JFYYqIs5URzouBTlAiAasE4IivYAhsFsmH82Zatww9 n_xESI6xq3OU4qx_tgud5KgdgS94LH_nBOaB.LT_QFu1CAurI5MLNMUOTWs6B.acz_IiBxkSO8h3 jBtch3D3MBW55Ssw3NHdnPpjilUW0MDz_5LDHpatQgr17SQkeWG9o8An1K5_FUNuG3H7d7wOZDMi L0Sp9ypfUQVJAXcdx5n_MWeGGHFBzFnDlgHzPo7uZIWREcy2WfihiDNTyldJ49Mm6eXcZqg4AE34 Y7Dbku6K3806XHxHgVz0vOyY_rmRHZKFOu7iAgcVg5wPkzIAEyTudnZWFNFsUADVTzIRZ5o70407 Za_DfRThJaR_gckSDuW7wCL8p.vSItA8bhBzWhPAu8Rl7C86ID8c.oBpsCQZVtOJMl8KQpreK8h0 D17yrtGVaq9_evD.LVmmIv.gHT_U4fHkmfLwGyN3s2.nKfNm1RkXsFxQoplusJiaZh0tNg4Ug6f7 r53aHKw1VANeYx3M_Kb9UzkNHIca2h.M2tklOFObEfyse_3UJTy0FJhfBomrOAZc6A8VWFXtHb0. cRWbE7xeMbfETTZwTK8h0pkV6yf_5I6XeKPS17Hr4bDbsPq0k0AlGIGeVcspNA4BeVHQACVS95BA xL01k40eZ80.LQ7mzRL6Bx7n6ZPgs.O88zHLYbvTIWeNN3DsgzIr3XWsG4Ne5Hiv0MkO.Gq62fpG 5ym5tUJbA49d7N2zODBzf14i.vaO1km9K6frCgbjxC4PvK4DxyoWTvjQ_OOjUFOniANquprNyrk_ f4vEeEAifkiNngq4NAZGwetf0OyvJmztvxZxg7NAB31Mq3Alvn39vhWcLHxLRly_iZSJvqvpklc0 ULJ2FSVvz3KznJIYGBw6pqiULdC9oXlBfGOLd4mFU7Sg8mFDUiBLBSxXRmAd4nHCSQN5271ADTA7 cC7iln4Dj0zgEyS1gF4GTnBinNuy.UzUYqrOCS67Jevdb_3wVo2gSxM6.ynF72DT74baSdzNxIms xyoal0UNHP3XU36IUiYPCzfQD5rpc1nxDGLUV.PSFd2jDUW5xHE1HkmHF4uj7AmpYnVV8BPQMTDv R.2kr.j3TkXwLzmJubaPW6_wVANMCLc10fkSmsJt0KwIKamU670h_6e9jGfzXWa1efDpFTBZqgOi qSlNJIdSKz0Rbs9GX5Yx5BddZgyHA8dIg92Rb.rCwkXDpOb3t9X5SMPd8cc.o0yHSlE71KGxGpao E4lINhcVbt1BSX8K1j2l5EBHgD3vgxEFX7K5RsH9dfr.eG5Td4fVGYHX3MA1DXuu.US2QfGxZcRj lOZfCbA5PYAUfhZ2KAWJ0_H8DhnclPATKp2VPY_od.ZSN42l7RSR_AUVb95SnlDCwuRJfZqjh2_e G3U3AztqXrk_jhSt4QujBW6jm0jZVRrlKagXt8PffsOQWr2Vxdh1lhMUPyCdRCo.189ZQOlSuOs9 qYE64k4osej439aBWzW1sfHK9i_kLsYpDK4UOWlnlq8SKgooesyyEMFsmWn2CeIzSHgr2QtRnapI AhWWHXSXjZF7GzgaWF1z48VCQWrZQA0IkzaeGwbDjo8xTzR_NgoAdHv0Ppcn__b64Y0UB60Z7Kb4 vZLNlrjE6qX.y8XEbXspMRV4EY4BMgl_0QRT9Xl9bYOilBEkiY_87VLiAA3PzSOG9DNKDEYTfV8v 6mllmmJLIX1Gsob3W6eMIdELxFv80M6_dB4q2Y9y9hvPgJXw3hlPRahNrhQRaynALbWGhVcnb52E _sShm4YtQ2imUGbZqPIhv3gpWUrufrwG2X7C3UQSlchyTPH5IHTVr45DDF92s99e3xXBMtL8_KDZ 42pe7ps11Rb2_dg7sA32PozXUxypB8Ffsf0rPjcHl9yZt9uyzMvNKQ3swxBjO5o3vtBDmGV0zDfE ThYUcPlXvXCDFdnrQtEVLKPMQjFtgcUCaogSxybh6WcWmZoBhlVYiKWEzZd4ez9NTDxr8QM.IKK4 Zq.C8pcGBgf_O0ZKx32Gl8jYJVvonr4Grra7Kj1.isjT8ESyIcvnzZjINTZcWg1VHWoHnJl74SAD YXO1JX1_dmoa9aanwUHse4dIbUra.gG5Yb6mWxp9lkATQXb2Vtj3wKZzmpJvqf8zYF2Gr.DVivTc mCaxWFsb0y5DK2F5eWe48agwRk66sIGtKiCH.1_dFiAWDS1gRuZXNkE50tLCI4Ca1.ev8b37RgHW KMFmLG4k.sYPuHH3HOcbNQ2.VuCuOm1KmZvO69aYmBvxWDR6pXnL5_QkEMmuMaS0Wbafqk8GifTC h9GB.lw-- X-Sonic-MF: X-Sonic-ID: 36a27254-d021-4b83-86c3-8028e509e54e Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 10 Sep 2023 19:24:46 +0000 Received: by hermes--production-gq1-6b7c87dcf5-rj56s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID fd4f49afe0058c6c4d46fac41f729629; Sun, 10 Sep 2023 19:24:41 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: Date: Sun, 10 Sep 2023 12:24:30 -0700 Cc: Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> To: Warner Losh X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RkKYD1Vzcz3HyG On Sep 10, 2023, at 11:21, Warner Losh wrote: > On Sun, Sep 10, 2023, 11:10 AM Mark Millard wrote: >> On Sep 10, 2023, at 00:31, Mark Millard wrote: >>=20 >> > kyua tests that use the: >> >=20 >> > /usr/tests/sys/cddl/zfs/bin/mkfile >> >=20 >> > program like so (for example): >> >=20 >> > mkfile 500M /testpool.1861/bigfile.0 >> >=20 >> > (which should be valid) end up with mkfile >> > instead reporting: >> >=20 >> > Standard error: >> > Usage: mkfile [-nv] [e|p|t|g|m|k|b] ... >> >=20 >> > which prevent the kyua test involved from working. >> >=20 >> > Turns out this is from expecting char to be always >> > signed (so a -1 vs. 255 distinction, here in an >> > aarch64 context): >> >=20 >> > . . . >> > (gdb) list >> > 179 /* Options. */ >> > 180 while ((ch =3D getopt(argc, argv, "nv")) !=3D -1) { >> > 181 switch (ch) { >> > 182 case 'n': >> > 183 nofill =3D 1; >> > 184 break; >> > 185 case 'v': >> > (gdb) print ch >> > $16 =3D 255 '\377' >> > (gdb) print/x -1 >> > $17 =3D 0xffffffff >> > (gdb) print/x ch >> > $18 =3D 0xff >> > . . . >> >=20 >> > With the mix of unsigned and signed it ends up >> > being a 0xffu !=3D 0xffffffffu test, which is >> > always true. >> >=20 >> > So the switch is reached as if a "-" prefix was >> > present (that is not). Then the "option" is classified >> > as invalid and the usage message is produced. >> >=20 >> > Apparently no one had noticed. That, in turn, suggests a >> > lack of inspected testing on aarch64, powerpc64, >> > powerpc64le, armv7, powerpc, and powerpcspe. That, in >> > turn, suggests that kyua test inspection for the likes >> > of aarch64 is not historically a part of the release >> > process for openzfs or for operating systems that include >> > openzfs. >> >=20 >>=20 >> Looks like the mkfile.c traces back to a former port >> sysutils/mkfile that was unfetchable as of 2019. And, >> looking around, it seems the kyua zfs tests may be a >> FreeBSD only thing, not adopted in openzfs. >>=20 >> So various implicit assumptions when I wrote the note >> do not actually hold. >>=20 >> FreeBSD would have to do additional testing via kyua, >> beyond what openzfs does for testing, to discover the >> unsigned char related mis-behavior in the mkfile that >> FreeBSD's kyua tests use. Only FreeBSD variants are >> likely to have a similar status, not general openzfs >> including operating systems. >=20 > I wonder how hard ot would be to look for the char =3D getopt() = pattern with coccinelle >=20 Unsure. But to be sure that the implication that I was also trying to point out is not lost: kyua testing of zfs (and more?) for aarch64 (tier 1) is apparently not being done (or at least the results are not being inspected). Similarly for armv7 and all the powerpc*'s (not tier 1's, however, so not as surprising). Side note: Via other exchanges that have been going on I learned to look in the likes of: https://ci.freebsd.org/job/FreeBSD-main-amd64-testvm/*/consoleText for what to "pkg install" for kyua test runs to use for normal runs (at least the subset compatible with architecture being tested). I'd only figured out a (large) subset previously for aarch64 and armv7. I'm not aware of there being other documentation for what is appropriate for setting up such for kyua runs. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 00:46:58 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkSj268bdz4sjVR; Mon, 11 Sep 2023 00:47:02 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-oo1-xc30.google.com (mail-oo1-xc30.google.com [IPv6:2607:f8b0:4864:20::c30]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkSj16FwQz4LGd; Mon, 11 Sep 2023 00:47:01 +0000 (UTC) (envelope-from mavbsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=VAFbChq7; spf=pass (mx1.freebsd.org: domain of mavbsd@gmail.com designates 2607:f8b0:4864:20::c30 as permitted sender) smtp.mailfrom=mavbsd@gmail.com; dmarc=none Received: by mail-oo1-xc30.google.com with SMTP id 006d021491bc7-5735282d713so2503973eaf.2; Sun, 10 Sep 2023 17:47:01 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694393221; x=1694998021; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:from:to:cc:subject:date:message-id:reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=VAFbChq7mZl5fnk/siYjDIvNpyUmwoHma1oNrwz1sil3nREK/hcYBE8Rb/GijhuBDf 02r2+gHvHkkpRthj834Skj3sbgDHmz9hnyo7nBXJSDSI4w1qPPaje1qcrqQT6+HCpKz/ 5XGFE1f+GDh8GaIDXMVGQZ9l3vODoFtLnVXX5TpBEWnxHx11mo4owVeIbF25/gCQCQbV e/x3Ur8h+D7srJYtt64rmasn87M6CWDz/KE1vmbHIj6EVp38St+Ga6myhKmR5o5zp6pJ +Cj19/5H0ivBQjkrnL33A+KEfV66FpGTPYp9r6BWBNiEfcJw7rHka5k/8MZ/ZLkagIh8 A/ag== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694393221; x=1694998021; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :sender:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=buJAsJJVHxKaYmZsgABtVavZ3eRTKrJqcejeMpZLNT4=; b=lTu5dtdddFwBJfX1Jtbc+bXr45wTf6Uqq+vZl+yGepTGDXp1gycCQkSLyEJc69cyz4 kSWwH1YdYJjyIhjP/HHwGUYrZxCuPi69ujNc4oA6rvje6ujKypFQfiY23ry7JtGWXSzd wXFsZj7lqhlxxeDCd1W9lMO2bbFczji1YUnEG9WZkLCsoDjYMaxtYwYpsLJW9bL3xntc sNILgTIfiI9QOoW77qEQh6On1dyxA4YPhbTUV9n3OgZiyL+hiat/yZeGfgUpNWXFSpLa YLD9hS9QX1vByWmibPTyHxjeBavyXx8FLT26rMItWg6FoSlhLYavuOlalq3nAwhEecD3 2wzg== X-Gm-Message-State: AOJu0YwVELk5Nl/cuaYrWRzT/S8VxZftTUqL4YrL3GvTNCV3U0OXMvbl SfqDcbnZtyNEOQDOe5WlLFk= X-Google-Smtp-Source: AGHT+IH+4k+lh0keo1dafVbpLyOX1WKAGn+6LnyTdcrMifsrgzB3c140iu7B5bafB6vd2QzHILVjcQ== X-Received: by 2002:a05:6358:720e:b0:13c:a9c9:c04a with SMTP id h14-20020a056358720e00b0013ca9c9c04amr10006579rwa.20.1694393220750; Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Received: from ?IPV6:2600:1700:3580:3560:228:f8ff:fe04:d12? ([2600:1700:3580:3560:228:f8ff:fe04:d12]) by smtp.gmail.com with ESMTPSA id n128-20020a0de486000000b00589c103d00asm1678719ywe.79.2023.09.10.17.46.59 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sun, 10 Sep 2023 17:47:00 -0700 (PDT) Message-ID: Date: Sun, 10 Sep 2023 20:46:58 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.12.0 Subject: Re: main [and, likely, stable/14]: do not set vfs.zfs.bclone_enabled=1 with that zpool feature enabled because it still leads to panics Content-Language: en-US To: Mark Millard , Martin Matuska , Glen Barber Cc: Current FreeBSD , FreeBSD-STABLE Mailing List , Pawel Jakub Dawidek References: <7CE2CAAF-8BB0-4422-B194-4A6B0A4BC12C@yahoo.com> <08B7E72B-78F1-4ACA-B09D-E8C34BCE2335@yahoo.com> <20230907184823.GC4090@FreeBSD.org> <4f4e2b68-57e0-a475-e2bd-1f2b8844ebfe@FreeBSD.org> <354C5B8C-4216-4171-B8C2-8E827817F8E5@yahoo.com> <8B8B3707-4B37-4621-8124-D6A77CAF6879@yahoo.com> <15df58d3-4603-132f-112e-d10a6d4419bf@FreeBSD.org> <2a25427c-5a61-3f72-4e31-b7666741d38d@FreeBSD.org> <63717d32-f340-1320-3335-85135d1b62bc@FreeBSD.org> <05C47E15-640D-41AD-9C4C-73A1D5041CF4@yahoo.com> <8746A218-F83A-40E7-95F8-5EC1E36411C1@yahoo.com> <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> From: Alexander Motin In-Reply-To: <1B343698-6865-4761-B514-1539AAE291BC@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.19 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.992]; FORGED_SENDER(0.30)[mav@FreeBSD.org,mavbsd@gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; DMARC_NA(0.00)[freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::c30:from]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2600:1700:3580:3560:228:f8ff:fe04:d12:server fail,2607:f8b0:4864:20::c30:server fail]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FROM_NEQ_ENVFROM(0.00)[mav@FreeBSD.org,mavbsd@gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; TO_DN_ALL(0.00)[]; RCPT_COUNT_FIVE(0.00)[6]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org]; FREEMAIL_TO(0.00)[yahoo.com,FreeBSD.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkSj16FwQz4LGd On 09.09.2023 12:32, Mark Millard wrote: > On Sep 8, 2023, at 21:54, Mark Millard wrote: >> On Sep 8, 2023, at 18:19, Mark Millard wrote: >>> On Sep 8, 2023, at 17:03, Mark Millard wrote: >>>> On Sep 8, 2023, at 15:30, Martin Matuska wrote: >>>> On 9. 9. 2023 0:09, Alexander Motin wrote: >>>>> Thank you, Martin. I was able to reproduce the issue with your script and found the cause. >>>>> >>>>> I first though the issue is triggered by the `cp`, but it appeared to be triggered by `cat`. It also got copy_file_range() support, but later than `cp`. That is probably why it slipped through testing. This patch fixes it for me: https://github.com/openzfs/zfs/pull/15251 . >>>>> >>>>> Mark, could you please try the patch? > > I finally stopped it at 7473 built (a little over 13 hrs elapsed): > > ^C[13:08:30] Error: Signal SIGINT caught, cleaning up and exiting > [main-amd64-bulk_a-default] [2023-09-08_19h51m52s] [sigint:] Queued: 34588 Built: 7473 Failed: 23 Skipped: 798 Ignored: 335 Fetched: 0 Tobuild: 25959 Time: 13:08:26 > [13:08:30] Logs: /usr/local/poudriere/data/logs/bulk/main-amd64-bulk_a-default/2023-09-08_19h51m52s > [13:08:31] Cleaning up > [13:17:10] Unmounting file systems > Exiting with status 1 > > In part that was more evidence for deadlocks at least being fairly > rare as well. > > None of the failed ones looked odd. (A fair portion are because the > bulk -a was mostly doing WITH_DEBUG= builds. Many upstreams change > library names, some other file names, or paths used for debug > builds and ports generally do not cover well building the debug > builds for such. I've used these runs to extend my list of > exceptions that avoid using WITH_DEBUG .) So no evidence of > corruptions. Thank you, Mark. The patch was accepted upstream and merged to both master and zfs-2.2-release branches. -- Alexander Motin From nobody Mon Sep 11 01:08:21 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkT9v3Hswz4sxLW for ; Mon, 11 Sep 2023 01:08:35 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkT9v2W24z4TD8; Mon, 11 Sep 2023 01:08:35 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694394515; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v1vUkvEIAZMtRcss6EtN1JvKq/72dqPQ7HH5wUdZKT4=; b=CDrd/J1GkQz9WU9TKe45sRfnpcmpMcopB0GqKVlDZk7d5ZGLoRKIv5CwpjPMfGoATj2Low X88EjZygmScCEgzDewM7kkqZYt8MpHOZF8yUXd4ll0F3kylumu8W119aRL85OQXhAf14gP 3kcVh6yuYHc3+R1oDYmLDQ+zxW22iAMlb209zmByx3SYOsl8N3UWjd2SqmQU03gVCSvX8N YvS732cTPMPJW8+Jw/DCCY4PaDAkf6F9j1Shbwtt+dtJal1VKq4EZyZ7aK1UZY/Q8sc5ge 2fBrnYixxOKcuoGgGbupLSWeqz5/24rH8aPboLLdG7EEVpn+xsRjrnCL3lteYQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694394515; a=rsa-sha256; cv=none; b=SdIruUNtJcqTukQwq52Y/WmwsJ9jrDq4lE8Okb+h0PRXZNKKq3DT3yGW+dfJuDk6HzcR6k nwjUGice+eLEmY5L7+PaE0AbHwoRzsVASlAahoK6lj9hNONetPSWh+Pl2vIPBmk59BJFxh NPqz/tb+k1OTgjBoRy69eccDwF2iNqw9VvN4DC37gNBVV4hZ7sA58aROBDmC6bJ8hhZDJW xbQU+H2Pegh8+mEfPDuZukNOUkmuS1kV8bNhg/Ewi0ciFSTqMhbkVnCN+pqVj/3jy0CPou MgKjyQWa53FpmxtXbMQ3qiqInZhDQZeH/aPjaHUQ2PSZ2yzZdFOJZKt1rVlvaw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694394515; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v1vUkvEIAZMtRcss6EtN1JvKq/72dqPQ7HH5wUdZKT4=; b=k2yUMAYrwGVPZtLdT+rJdvAHj4zOoBcUCfBB+4OGjLTLAhNYpKVQpcacM8F4NM8Qv/0aVV 8/hJOSVrWMPnz4unaUWgzKuvFTWkSO7F4ESKVq5f8SGrlWr98G6DejnKcgEKYACK66zKin X8eAacph42nAcAcpr6UOPfE6SLfxwx7O/XdqBuRPqoOR59O16nNNUgpfBbm9fKLZcjT02x dkYuWQzF1EyH0B1N9Bg5j53vg9aVV9Algjx0hGH4q0GYezx1hcR4MRdhC1ABZmL1auzeY2 kUcxjKbQBlqLNoFYAvOVoBo3eSWig0OI+MV2m99TRtkm3B6hlDmNUKiHrnBCfg== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RkT9t1gBpznBY; Mon, 11 Sep 2023 01:08:33 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.4\)) Subject: Re: Update to BETA1 can't login: pam_opie.so not found From: Zhenlei Huang X-Priority: 3 (Normal) In-Reply-To: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> Date: Mon, 11 Sep 2023 09:08:21 +0800 Cc: FreeBSD-STABLE Mailing List , =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= Content-Transfer-Encoding: quoted-printable Message-Id: <065AA732-90B7-4B9F-AC48-9368AA53D130@FreeBSD.org> References: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> To: Nenhum_de_Nos X-Mailer: Apple Mail (2.3696.120.41.1.4) > On Sep 10, 2023, at 1:40 PM, Nenhum_de_Nos wrote: >=20 > Hi, >=20 > just updated my nanopi R5S to BETA1: >=20 > FreeBSD 14.0-BETA1 FreeBSD 14.0-BETA1 aarch64 1400097 #0 > releng/14.0-n265061-5e5854520ee6: Sat Sep 9 20:20:11 -03 2023 =20 > = root@NanopiR5S-nvme:/usr/obj/usr/src-14/arm64.aarch64/sys/GENERIC.pfndb > arm64 >=20 > the config just has PF builtin. >=20 > git checkout releng/14.0 and the default make buildworld/make = buildkernel; > make installworld;make installkernel stuff. >=20 > No I can't login, ssh or locally. When locally by serial, I get the > pam_opie.so not found. I read UPDATING on git for releng/14.0 and saw > nothing about PAM. I can get to it by choosing single user on boot. I = did > a find for this module, and none are found. >=20 > I saw this: >=20 > /etc/pam.d/sshd:auth sufficient pam_opie.so no_warn no_fake_prompts >=20 > Then I commented all lines for ssh, other and system files in = /etc/pam.d. > Now I can login again. Is this a expected behaviour? >=20 > My old kernel and world was: >=20 > FreeBSD NanopiR5S-nvme 14.0-CURRENT FreeBSD 14.0-CURRENT #0: Sun Jul = 16 > 05:15:49 -03 2023 > = root@NanopiR5S-nvme:/usr/obj/usr/src-main/arm64.aarch64/sys/GENERIC.pfndb > a rm64 >=20 >=20 > Thanks, >=20 > matheus >=20 >=20 OPIE is deprecated and has been removed from 14. See announcement [1]. So I think it is expected not to work. CC the author @Dag-Erling 1. = https://lists.freebsd.org/archives/freebsd-security/2022-September/000081.= html Best regards, Zhenlei From nobody Mon Sep 11 04:26:15 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkYZC0h1Nz4sc9l for ; Mon, 11 Sep 2023 04:26:27 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (tunnel82308-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "garrett.wollman.name", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkYZ95XP0z4ZNV for ; Mon, 11 Sep 2023 04:26:25 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of wollman@hergotha.csail.mit.edu designates 2001:470:1f06:ccb::2 as permitted sender) smtp.mailfrom=wollman@hergotha.csail.mit.edu; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=bimajority.org (policy=none) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.17.1/8.17.1) with ESMTPS id 38B4QGhX085080 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Mon, 11 Sep 2023 00:26:16 -0400 (EDT) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.17.1/8.17.1/Submit) id 38B4QGGh085079; Mon, 11 Sep 2023 00:26:16 -0400 (EDT) (envelope-from wollman) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <25854.38631.998872.484927@hergotha.csail.mit.edu> Date: Mon, 11 Sep 2023 00:26:15 -0400 From: Garrett Wollman To: Mateusz Guzik Cc: freebsd-stable@freebsd.org Subject: Re: Did something change with ZFS and vnode caching? In-Reply-To: References: <25827.33600.611577.665054@hergotha.csail.mit.edu> <25831.30103.446606.733311@hergotha.csail.mit.edu> <25840.58487.468791.344785@hergotha.csail.mit.edu> <25853.10676.45028.623279@hergotha.csail.mit.edu> X-Mailer: VM 8.2.0b under 28.2 (amd64-portbld-freebsd13.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.4 (hergotha.csail.mit.edu [0.0.0.0]); Mon, 11 Sep 2023 00:26:16 -0400 (EDT) X-Spam-Status: No, score=-4.9 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS,NICE_REPLY_A autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on hergotha.csail.mit.edu X-Spamd-Bar: - X-Spamd-Result: default: False [-1.90 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.998]; FORGED_SENDER(0.30)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f06:ccb::2]; DMARC_POLICY_SOFTFAIL(0.10)[bimajority.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_TO(0.00)[gmail.com]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FREEFALL_USER(0.00)[wollman]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkYZ95XP0z4ZNV < said: > Not perfect but you can probably narrow it down with dtrace as is: > dtrace -n 'lockstat:::adaptive-spin,lockstat:::rw-spin,lockstat:::sx-spin > { @[stack(), stringof(args[0]->lock_object.lo_name)] = count(); }' That was ... interesting. It took a bit of postprocessing, but I was able to make a flame chart from that: Unsurprisingly, the heaviest hitter is the vnode_list mutex, although it's only about 35% of contention events. After that it seems to be UMA locks in the ZFS I/O path. You can barely see vnlru in here, and most of the contention events are in UMA or the VM system, not the vnode_list. -GAWollman From nobody Mon Sep 11 05:03:03 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkZNd5P7fz4sw7x for ; Mon, 11 Sep 2023 05:03:13 +0000 (UTC) (envelope-from jonc@chen.org.nz) Received: from egress.chen.org.nz (egress.chen.org.nz [170.75.172.82]) by mx1.freebsd.org (Postfix) with ESMTP id 4RkZNc3jQJz3FNZ for ; Mon, 11 Sep 2023 05:03:12 +0000 (UTC) (envelope-from jonc@chen.org.nz) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of jonc@chen.org.nz designates 170.75.172.82 as permitted sender) smtp.mailfrom=jonc@chen.org.nz; dmarc=none Received: from mail.chen.org.nz (unknown [210.54.37.164]) by egress.chen.org.nz (Postfix) with ESMTP id 733CDEAE6C; Mon, 11 Sep 2023 17:03:05 +1200 (NZST) Received: from mail.chen.org.nz (localhost [127.0.0.1]) by filter.inside.chen.org.nz (Postfix) with ESMTP id AD5F880C91; Mon, 11 Sep 2023 17:03:03 +1200 (NZST) X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on ametrine.inside.chen.org.nz Received: from [192.168.1.10] (jade.inside.chen.org.nz [192.168.1.10]) by mail.chen.org.nz (Postfix) with ESMTPS id A24BB80C90; Mon, 11 Sep 2023 17:03:03 +1200 (NZST) Message-ID: <9c818d6e-e1d1-fae2-2dc6-6d472d837c60@chen.org.nz> Date: Mon, 11 Sep 2023 17:03:03 +1200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: Did something change with ZFS and vnode caching? To: Garrett Wollman References: <25827.33600.611577.665054@hergotha.csail.mit.edu> <25831.30103.446606.733311@hergotha.csail.mit.edu> <25840.58487.468791.344785@hergotha.csail.mit.edu> <25853.10676.45028.623279@hergotha.csail.mit.edu> Content-Language: en-US Cc: freebsd-stable@freebsd.org From: Jonathan Chen In-Reply-To: <25853.10676.45028.623279@hergotha.csail.mit.edu> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.19 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; NEURAL_HAM_SHORT(-0.99)[-0.990]; R_SPF_ALLOW(-0.20)[+a:egress.chen.org.nz]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:174, ipnet:170.75.160.0/20, country:US]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[170.75.172.82:server fail,210.54.37.164:server fail]; MIME_TRACE(0.00)[0:+]; TO_DN_SOME(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; DMARC_NA(0.00)[chen.org.nz]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4RkZNc3jQJz3FNZ Hi, On 10/09/23 14:28, Garrett Wollman wrote: > < said: > >> zfs lock arrays are a known problem, bumping them is definitely an option. > > This is the thing I tried next. It took a few attempts (mostly I > think due to my errors) but I'm now running with 512 (instead of 64) > and plan to deploy 1024 soon, as the results are significant: while we > still see significant loads and kmem pressure during the backup > window, backups are able to complete some 5 to 8 hours sooner, and > nfsd remains responsive. How did you bump up the zfs lock array value? Is this a sysctl-tweakable value? I'm currently running a recent version of stable/13 on a 24-CPU machine. It runs Postgresql 15. If I slam the system with a "pg_restore -j 20 ...", the system will freeze more often than not. This issue does not seem to appear if I use UFS as my backing store, so I'm left to assume that it's ZFS related. I'm wondering whether your tweaks will affect my system's behaviour. Cheers. -- Jonathan Chen From nobody Mon Sep 11 06:57:30 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkcwY3jltz4t63N; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkcwY3HKMz4R14; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694415453; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qH1UUOoE6KqKKwive9H98zBB2xaGHVj9B6YljdSPJwA=; b=q9GVuy/nue4XJzAYZP8S+zQqdgs8qaZ3ozeFkMq7OdUpdV0s0iR54jEemEllBmxnVtlc4X 6rJazr/c1j3q60oK6AUwNS9mWVKFOFZh+Noeal6rSEDrT4vNvuAIk0AEAn9SGJ93Ib4XAW jMJ0811kVEYgFNVk7CWwdzE13+digdCvSW/x81ZZClxUfZr6c4Ia5qdtLIBKtzdxsvoa6P r4W/M1+GvJCToFuqcXJwSCf7q7Iyfpey22ux3M6Y+Q2um/b4kmeutILjUgHuMcETLSe9vQ nHTRFcJ7rW3c6DpEktTw1s9CHN4dSUpVna6G8aXkdFJsIc2G+ch+QBdLLeMSAA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694415453; a=rsa-sha256; cv=none; b=rLyMWs0RB/2M+JPcaCbwLwihZ+Q0hcXDn6dNT3iNU0QXi9kFVqxcFCo9WT5opQCCrHacMR wXCK89nhJw31TJW9ArxmuGDamqZ2Jle8MgpeY4dbioWt9D7WS+UDBj2bqxlZv/sVbwtTxQ D+koxOGlB9ydZAFKkRXVVQ3gSlt+oLmPQliGNAhuah1aZpi120FU7HeKYyNAzNq+P6Xiii Z6fnCWz0eZ+HrIS83oyXQ7xOjwJABACc9vr8RuL+WY+C/KtnxH0AnXztCS3f1u6crhi/sl FWGJ+pgDjIufrM1sU8p2pH6royxmCMg0HgTUAlfqS9Qh39EDbgbQXXCiah5hOg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694415453; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=qH1UUOoE6KqKKwive9H98zBB2xaGHVj9B6YljdSPJwA=; b=kbo3heGyZEkpK4epXJ0WTEkba3YGZDyOVXmVdrtbpMam1cVnAyzncc29+i/8hqNC4plSAL 8i52OJoFpvDtXvPdkOeubzFIT+D5X1PHq7loTXTRciz5mZSpEbVYGeRIsghBIKyrdzWpG8 9Fsb8Q3E5AZkZbU9uBo2zTrnCsCg4ST0dlo1NZ8PhjXMuK8Sv6T9mOyQCvoscWeUPkX/eS GaK0DPIEAp4z/Wn6N1R2s+v7Gh1eP9mcdZWcJimLe/AtST7Fk+XggCOmD46gc7e4u6J1ZT z/bbV4YixVTuN9FNT28nvlrJ4TpoV4n5n6zDnltEBCCnvVktR9diP6kUUAsbdw== Received: from ltc.des.no (ti0187a400-1976.bb.online.no [85.166.95.197]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RkcwY1Mq0zvYv; Mon, 11 Sep 2023 06:57:33 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 089634EAE7; Mon, 11 Sep 2023 08:57:30 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Mark Millard Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char In-Reply-To: (Mark Millard's message of "Sun, 10 Sep 2023 12:24:30 -0700") References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Mon, 11 Sep 2023 08:57:30 +0200 Message-ID: <86wmwxp57p.fsf@ltc.des.no> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mark Millard writes: > I'm not aware of there being other documentation for what > is appropriate for setting up such for kyua runs. https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test_= image-head.sh#L69-L84 DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Mon Sep 11 07:03:48 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkd443pfBz4t9f4 for ; Mon, 11 Sep 2023 07:04:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkd440wH7z4Wyt for ; Mon, 11 Sep 2023 07:04:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694415841; bh=SDmh9PCAEKjilYIYJibKMoeloBKWMj+Ea6g504Q/i6Y=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=nZyshe8tlQ+dhbRqMnCzdXrNS9g/iK+gVuFtNL5PDheVr9Q9XPJB//AXzLlkX/dNxOCWTju4fSc798VnojzD/OqSqeAEKp1N8BH1NkclJLj8uJ4pIC2fzS4K1gr+FSiRq5EAM7s7pvYkHHjWUYvDYt+6XyXzUxCFT5QkDQWETA6g8OO+U2masT9CM285qQLSQxa+RIxIM/CAhQOaNNgxTE2bz51ANQ1v9qriC8VfXsdWd6ty62bPLqNfgnUR+HlkRHvpmbSyl0vRqA+xyL0tHrUboHtICoYLiDm2etAlkHyra0xGvksE5frGFTIcRFOMIPNRHPmlSULQtAoZxdjXKA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694415841; bh=rtbxP/mJF+CWnViYkgJIyeLJjNHUHI0jbel60IC9GX2=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=kcycE+DoPISXrUxdPgxFBghkKeWe7WPplX3Lmk1ARw+n9yTIOTn/jlOqYAMlZ2PrRgQJb3AFLts9fITYVxS8zPF93pd6gtN45hcgmDErU4kX2GsZT0ySCU+bbv5UdWSQIO7QlUQMiR8OP+vlyuz6anJIAAAH2n7XBYPAdmr2uWvdg8xPOXY9FJl7u46L/TOlT0Gb0j4WRix2W3YcAdYJvcu57B0g6GIyUUJv9yw8pLel/20oAtcmwsAz9UgNfrHBuRKyIn5F+EfrMB6BLhcccpU+rdT1g3FXzH3+OAJomVd0iY90//AvVR8t3NprGQGZ77HXNpnMX44R5s3ujeIZZw== X-YMail-OSG: KbxEe1cVM1lYPpbWYrDFGoHijq9FTkXVoQ6boGbijV684fil6udoLbKM8Mo5ta3 r0VkeqBAvw6dqWD2yBQICcRPCza5w0EVLBpL.1aNjGY5apWFf8dF1teHlzAZQKO10Zz1Lk14qY4B 9JOn01_k21RL3T8FNTh92xJqt_RhlyqkW8axECA_Vsw1E_LDWnnkSPm7I06Ckfq4KWE.UjTna.Xi u1E2aNZdxtyiwqf1IWi3J8vMFbKOigLouxG_a9sLtlP5IPiUW7pcEpiaXp.sg2TbUJxew5avLduF A0cCTru69mjxxSf0lPVUUmWZAXUiXeUlvZqF72YAtu5HiHQ1AQZMMT1bU2Po38HxEfF1aCVVZlLY l7DSn4Tj_1FRxes9MvbYEFx81SrxBGrZzO2AFrenEd2Eqofq2L7JZF.tGlGd5H0tzJkfRjN4nCIO jH.Q4PqHTu8BeA7UI8I66KizSau4FeB1x01nR.wCBsaHZqyhxxSzEPvvTqTENM8zDucEhlL4SEfn gflBSc5PvmutA191buZb.J.9QNK9AVjYZ_2KfIgGq_XI45hJOgx_wwW6vTNU2cPPjtb.joM..5Ck TnmvJWahCS127rVVGRnL1DeI5gtY2Npe.cWelyTSMZN5MJFHNYU11MVagEWynzJKeW96s3YNYrg5 A48HBv16HQGjg61u7pKxgPNb11IVovHz9LWEN0UIvbydk121568B.zMvwQ4RPDJa0FGVKkuJp0lx EKPsUEIFIWPt7PJYk43YWe9Ut4DGwYKr_vi2Z97k5QlC0jCwqKM6X.02nnKm5jkc5h9Xo6xx7i5I RdmZo.ax7_ureCOu8uSD8eR6HnMpEyqRJliEd7nWzsGDov9ycOYw2Yr46_QhbebLfwYi5PpD1nbc tJ0jqPjsMKOLKxc1sSaFQznHI7Uhi.Fp3NXbgNr9pk0BU7xC5Z_ydlDs7kSizMu1SSTjJkMGDpEX EDIifhjHTMExFPpL8_jHJkWvX6IXk5P.ZWaxtt36FHzcpvLZYj38HQsCz.MOvtsraxiPoOUNvV4n CKSKZIzWhu7Oc9PY36RRaDcXYe48Rl6hv9biFOeOwi5i1oR0h5Dft7e9HMkGT9MFvkGb7EQL5miJ GZe8dT3HTsgqXqcFK3eRQEB97_f.H548QfknOqSmsVadKEehIT53KCZ.Dw8_RuoN4UlgqJ8DFgau rEViLMr8_gKXzJjIxbJz5AOIJYB8cv5BbpJ_MjVGtIMWlGjvfITe0d7KkXMV3cBmkeklWnQ.Lkxr Xfl0.qB7PMJmNim1C6Gw_0l2J1olgJfYSYVdlshOfEk4iI8tOaVOowgxWUpcJ8MSw2qeGQIDsoZR JpjylGiUkW7hqfwiI3e02XRR_SbtEqXZY9LYX5UdH5tFHWv_3ujYV.eIbQsd5lThV3yHVNsGh6eG I3NSDND1sPnmLpHYfjRZkY4YYSwISV2JeEx4cPU_feEdq6KD0xswW1SqoZopRbrrGF6Tbxm23ysk qg4Auk1OVB2bah2odfrrH5TxY3esV_vbeCF.MEBDs2y_sRwg1ih4mybdGsQqJ8lA.b.ig5hfEkWT tl3jD5mUnOrolhPaJQUuN4aepxLwCvdLRDEkkLL9i91yaylYkOhQ6b4RNGiJhnoxVpEB0l2m7Vz_ zoD2VG4dmagPEvuHcPnbjbdiTjEBs9CxfTvnfgd5qnBegdO98MQKFH8f6gr8POrv5cgfQlIXOlaB RwzDuIgFHfkGvCGyK1KednR2NkPm8.iUSeltDHTkfMrycRl16wo64xVuqMFerUZdktsLLuZ3o6Gt 01jjVDF4Nlf.boH3dmOmLxmP.vnhKVWLQ8sPenjGTbaz3ZW13KB0vPe8KZFZB7MhxSqnIl8ErWQR ITxwjjp5errbHBW8n94U38H0TgLNER4ODDNNCE9GNJ7wvIzdFdaYRVCCoHp3EdAe0Buj1eyzs3vH hm8QLCdthYdLjLWxHEp_SIrh2LB1F6GpYAB51b0NlE4SUGT164u7ofa39rciPCn7LHySHL9t8Kv7 5t_IEydor3oxX4Iq2J93m8VUJ.anUWLflNSk0h7nfI6WV5cKaI_SQB2X_1pKMUYsooJ1Rem_ZSnm V1rj6lSYQNnTiF1saXbLB5lrGx_F1u1_9plIroMLovnk_3kHFi0S1SyhCBBb3V.rlQwFcYPA7Ein 8wg0sPzEVOk6k2mmhxTKv1YF1ftheJaLLcUe.qW5ImqD0Mf4SgZsTrZ46Gs1YxGy.9iwdOjmpswA 40JUeVuY1mBFpyYQRJVPGQhrURd8RmdspCTJ6SVPHlqGxB_W6Hu33QsQtRA2LDC_I9qH0TzeDYA0 robo- X-Sonic-MF: X-Sonic-ID: 70e68cff-1826-407b-ae23-4d1f73f110b7 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 07:04:01 +0000 Received: by hermes--production-gq1-6b7c87dcf5-qfzfj (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f814e30cdf1517bc614c64eeed259891; Mon, 11 Sep 2023 07:03:59 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <86wmwxp57p.fsf@ltc.des.no> Date: Mon, 11 Sep 2023 00:03:48 -0700 Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> <86wmwxp57p.fsf@ltc.des.no> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4Rkd440wH7z4Wyt On Sep 10, 2023, at 23:57, Dag-Erling Sm=C3=B8rgrav = wrote: > Mark Millard writes: >> I'm not aware of there being other documentation for what >> is appropriate for setting up such for kyua runs. >=20 > = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >=20 Thanks for the reference that does not involve looking at CI log files. Filed away for future references. Side note . . . Turns out that tcptestsuite does not build for aarch64 do to alignment problems via packing in net/packetdrill : In file included from run_packet.c:45: In file included from ./tcp_options_iterator.h:31: ./tcp_options.h:108:2: error: field within 'struct tcp_option' is less = aligned than 'union tcp_option::(anonymous at ./tcp_options.h:108:2)' = and is usually due to 'struct tcp_option' being packed, which can lead = to unaligned accesses [-Werror,-Wunaligned-access] union { ^ --- sctp_iterator.o --- cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c sctp_iterator.c -o sctp_iterator.o --- tcp_options.o --- cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c tcp_options.c -o tcp_options.o --- run_packet.o --- 1 error generated. *** [run_packet.o] Error code 1 make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill --- tcp_options.o --- In file included from tcp_options.c:25: ./tcp_options.h:108:2: error: field within 'struct tcp_option' is less = aligned than 'union tcp_option::(anonymous at ./tcp_options.h:108:2)' = and is usually due to 'struct tcp_option' being packed, which can lead = to unaligned accesses [-Werror,-Wunaligned-access] union { ^ 1 error generated. *** [tcp_options.o] Error code 1 make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill 2 errors =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 08:53:55 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RkgWF01Hcz4tMwD for ; Mon, 11 Sep 2023 08:54:17 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-23.consmr.mail.gq1.yahoo.com (sonic303-23.consmr.mail.gq1.yahoo.com [98.137.64.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RkgWC5qlqz3gt7 for ; Mon, 11 Sep 2023 08:54:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=njvO6y2U; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694422453; bh=tuIdAuRIsZazZe0e/kYk7K/+tud/OzNIrQT2hyIoBJg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=njvO6y2UmT1SZn4qq/k0ArBjvAsY8dTHAR8bQAWJFv0p6WoHYgibxUtz38zwRhtHnAgWqua34gvIFBB6LrqNN/gh+KgEihyR6MQZuIz5hVceWoNvBV/SaXDXxvQelMzuHBw4q00XoAyK93EdLNHemyAUMN0g/0ZtOULK8nz76otdMMNROX8txKX+kexg1iNHOxikkng4q/lEY9727GJFEjrvxskAiMKoVzEuQX2fAdinKTEXxymhTC0olRLgdW5FNM/6NSldDFG3LZBbJPxf6kfQ4PdtiPyE12IuyBZXxxU+Z7xPPEWBpubH7X2qEzP0nnF33/WgQelJxL5u+Lkyjg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694422453; bh=y3XAMzR3phaxQEUgR87Zmh97xHTNHqDdm+ErIZlYN9h=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=byCJun6x28aL406rdpO2ZF9nypUjXF5DCXXlsGKqCOCBEeS+U7hfZkIDggz3t/bCd+zrBMF4NdSsMYNb1dNJD08Fqt/U2Bpl1WlfC6Hdokvbj8jiBEmOZAVA4Q7o+UyVaATsAMLdVgeGTinxMI5DPYBs5cNqHjb11oWQbrkpwejKJZfYKKcNndfl4hN93wpoAOg+2xEJ5foR6k6ZXADeZ7ILnF2ZS01h0ViNJFIYNP8zoLu/QAgF+N+fV7gHPwPgpJ8JxgE58PLhh9sMGeIlPvc88cJj9vhydF6CVPZlEdbT9GuXm38GC7CBjhGP990wiujdUdLpB4a205wgsq6MSw== X-YMail-OSG: 8Ie.nzUVM1mo36WWV03mW4auuK6urW35NN4HSsvd9UH2gj3GSUcDK20r5MBFgeS VievHs3hLgC2TA4Q1jI_hSOk3kIypoJksvC306NxdH2qIutfK5IGO5_aZm8QwLGrqbAIk.phE3V9 HZEx4fIOfEsSnzeyGJNoThx0IO1nMawI3AO9kL6iU285d66aitjLBeRYKQRrrkg7CYkcizHWMoLt NMg7rhX4whEwo2OicCwpqFzZ_NsvXuGyLc3PZtb79BShe3HJh5wXl6XAguoU7vQZ3cuzp3v72JMX KAiB_JfaN5H0DmP2WDbuOm8mOhVr_Z2dNNxKzlTr7WNZDLIl4pm4I4_yzrSc59qg5Y_HDUZy3xu4 2NtjmZH0slFvYfxk0dWeYnJpRtxG_AHQrUCRFJtLJVQ8wcGYInYkFH4BHfJEZnIYuf826GbvZW9P VZKY7kpFBmx3JJF1aqaTmJ0mw.U5Y5IqQrjrF9td5B8fWYRR20ENbtDV8oY7M..sYRxpcZJ7qIC3 5Ow5DjI89uGvr5hpADZ9xXvRMD.9KuDdpInWxAnTWgyczrIsmBbJKc6UyhKbfw5S3jpSZ5bCt5yN 6GO5JIS8NTYp9zgDzqcU7tTpHNupisHtcZskWRq55cGY8IwYct1hMk5mpznTp.KPOIMXq6gGz5n. AvM1rI7VZpfC1FWzi7FLcqMFZif0rEOYh8f1LrP9U750aTP2IMgOr82gJVFq9fFy0b7cQ7AubzII .0KfheM6SGGvJ_7RdG1XUvR4l9ADFN.nPQqJ95exfIAG2QagrKXdWF4e3qqgFWEracEPdCZ7Ob61 DtXyRuQRk6twSoANdWqZTrZhubMnEMASCe1ysv_SHrCQxNUkCPhPjk.jfmwnTRCXlmNAZp3WF1BO pdsKDlHucwWWyg0NqQYrg48QahKQbHcJ7ETSx6lvK0T_0VbVNPb9Mqjvv8Qj0FB.MGP0b0SklRmx 2qAUhb.n3LfP9BlTW2Nf3VgwGZxXwv9fLAmHJXClTYZOgXv9zEs_X8Z4u5fM6Am9x4FGx7VwqHff ht4t4AYBx8ztss45SPIt8ie2vDrdgWNE02FERC1XR4SXRSnMh2B3CaHFKKv3Jcf8ce7ngPElRbQM L9BDU0wARaTx7sNbJHhusTMh.QiENYQs5_JB.z7y2bSyn2TUF2kpQbuzAUkBuvMH_ZUmmxgJq3jf CADQQFUlRGEKKIEojsri_EG5sFdaYBk.GboHDrLl2uWlaqWtDEdsfT5KmLjyAQY8iQVrAYasBZv1 BHZrxP4kC7ARVNsjQQoL_BzayugaPXKo6828s8FkEkvMLzWJucpV.Zxm55cMwN6wltib.CmS18Wp T.P2pu9hjwcTc2vBjdDv9qfZ4P7wHNzyvJSJNSzwLMp09x7BzKvc6fzvSEoxRd.zOyvir6oA4DX5 pdwbZOiQIYvqGr_o2XvQccJklGwl93h6vzNWyYByAiEaWs84lC_bzjItHTUisyjyjrOyY4ot4F2d DDmmGOTDI9d2JTQinJaoQWIP85Pjd1wjU313IbX9yqWC36J5MiqnUC8KmfyBDU6Ew5tUjzWFqSmx oUPbTVtd1MVm7DkwVTE7dQOOjHzc9IdDUnApnhamUs8LN__T3ZCVdn4z_nCc2Ymu7M5MGzB.dldR ZzVd3DqdEpVKYLHBWSP.r6J3jbEmhUi0SawztpcpwN71lNV5rnZDt.APwJBTxrM_SoQDNnNJB5cj C7mdyKO1y1z2HS0gWb4HMIhrfxeGgBcm6G.49bSsoSlFAeP1cKkH32UE_muGe2hfQB8FJh6BKaa3 CKJGXpKwce3Ez0XIsy482_RBfhlfjiqcfFeQ2rNumCCVDEui_0cLTeRSlgnJnsPX20cfggY0AuuW QPlcs6jYMWchj0vftQy2eynrsSVwakV4ScE4D32y9gfSu0enKXUPx7mOFqRMoBFANo5DzJabETYT .8x.omYJzPfzjbxDHkaDixmknu16JNQhMHI7Lq9jbkjYVxciZsrQgcPp9FYQbqNzxVGaPM99UJJz ItkLoFd6rxOilgrQgQ_Da9H1nZdfA4B8MyLqZo.dWs29yjNO6QkRIGpxNo21uuDc6IjIH5lrTFS8 HqNC8Of7pfZtI9Vcz3II3ErFMDdTl3cEg3FxZPDw9Xn9ugbiLrSfDPwOnwQlT9EAQ1iUojq5ZEkG jDRVhE.1sYHyMXcadt1KpwQEpLOH.6Mk_cJGgWTG82GckRVi13CjAN4yQNKmsh4hIdWNiePpoqj_ XJsmgdhJnw_i4FEpzo6Rgle.hyHb5ufFxdT4V3TuhAzxohuO7VuSgT3.oFRg8Ylfis4WpDDCrlgH _YxAS81c- X-Sonic-MF: X-Sonic-ID: 0fa19580-3799-45d2-89e9-c02e78923cb4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.gq1.yahoo.com with HTTP; Mon, 11 Sep 2023 08:54:13 +0000 Received: by hermes--production-ne1-7b767b77cc-fbxjt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID e5c40d4f2efcdd0bed61cc3439eb5b8c; Mon, 11 Sep 2023 08:54:08 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Looks like the kyua zfs tests likely are not used on aarch64 or other contexts with unsigned char From: Mark Millard In-Reply-To: <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> Date: Mon, 11 Sep 2023 01:53:55 -0700 Cc: Warner Losh , Martin Matuska , Alexander Motin , Pawel Jakub Dawidek , Glen Barber , Mike Karels , Current FreeBSD , FreeBSD-STABLE Mailing List , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <20C7F20D-8458-4BDE-9E66-F12CD5F2C230@yahoo.com> References: <96C2F8F3-D3F0-48FC-BEEC-E3C983BD680A@yahoo.com> <86wmwxp57p.fsf@ltc.des.no> <16DE542C-D0D1-473A-B1BB-64A732265EC7@yahoo.com> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.48 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.984]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_SEVEN(0.00)[10]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RkgWC5qlqz3gt7 On Sep 11, 2023, at 00:03, Mark Millard wrote: > On Sep 10, 2023, at 23:57, Dag-Erling Sm=C3=B8rgrav = wrote: >=20 >> Mark Millard writes: >>> I'm not aware of there being other documentation for what >>> is appropriate for setting up such for kyua runs. >>=20 >> = https://github.com/freebsd/freebsd-ci/blob/master/scripts/build/build-test= _image-head.sh#L69-L84 >>=20 >=20 > Thanks for the reference that does not involve looking at > CI log files. Filed away for future references. >=20 >=20 > Side note . . . >=20 > Turns out that tcptestsuite does not build for aarch64 > do to alignment problems via packing in net/packetdrill : >=20 > In file included from run_packet.c:45: > In file included from ./tcp_options_iterator.h:31: > ./tcp_options.h:108:2: error: field within 'struct tcp_option' is = less aligned than 'union tcp_option::(anonymous at = ./tcp_options.h:108:2)' and is usually due to 'struct tcp_option' being = packed, which can lead to unaligned accesses = [-Werror,-Wunaligned-access] > union { > ^ > --- sctp_iterator.o --- > cc -O2 -pipe -mcpu=3Dcortex-a7 Looks like I messed up and reported an armv7 context. aarch64 built net/packetdrill and net/tcptestsuite just fine. Sorry for the noise. > -Wno-deprecated -g -fstack-protector-strong -fno-strict-aliasing = -mcpu=3Dcortex-a7 -Wall -Werror -g -c sctp_iterator.c -o sctp_iterator.o > --- tcp_options.o --- > cc -O2 -pipe -mcpu=3Dcortex-a7 -Wno-deprecated -g = -fstack-protector-strong -fno-strict-aliasing -mcpu=3Dcortex-a7 -Wall = -Werror -g -c tcp_options.c -o tcp_options.o > --- run_packet.o --- > 1 error generated. > *** [run_packet.o] Error code 1 >=20 > make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill > --- tcp_options.o --- > In file included from tcp_options.c:25: > ./tcp_options.h:108:2: error: field within 'struct tcp_option' is = less aligned than 'union tcp_option::(anonymous at = ./tcp_options.h:108:2)' and is usually due to 'struct tcp_option' being = packed, which can lead to unaligned accesses = [-Werror,-Wunaligned-access] > union { > ^ > 1 error generated. > *** [tcp_options.o] Error code 1 >=20 > make[1]: stopped in = /wrkdirs/usr/ports/net/packetdrill/work/packetdrill-aebdc35/gtests/net/pac= ketdrill > 2 errors >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Mon Sep 11 18:20:32 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rkw4l6tN4z4t33m for ; Mon, 11 Sep 2023 18:20:39 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Received: from hergotha.csail.mit.edu (tunnel82308-pt.tunnel.tserv4.nyc4.ipv6.he.net [IPv6:2001:470:1f06:ccb::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "garrett.wollman.name", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rkw4l1NvFz3Ft0 for ; Mon, 11 Sep 2023 18:20:39 +0000 (UTC) (envelope-from wollman@hergotha.csail.mit.edu) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of wollman@hergotha.csail.mit.edu designates 2001:470:1f06:ccb::2 as permitted sender) smtp.mailfrom=wollman@hergotha.csail.mit.edu; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=bimajority.org (policy=none) Received: from hergotha.csail.mit.edu (localhost [127.0.0.1]) by hergotha.csail.mit.edu (8.17.1/8.17.1) with ESMTPS id 38BIKZjN089416 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Mon, 11 Sep 2023 14:20:35 -0400 (EDT) (envelope-from wollman@hergotha.csail.mit.edu) Received: (from wollman@localhost) by hergotha.csail.mit.edu (8.17.1/8.17.1/Submit) id 38BIKZok089415; Mon, 11 Sep 2023 14:20:35 -0400 (EDT) (envelope-from wollman) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Message-ID: <25855.23152.374580.98787@hergotha.csail.mit.edu> Date: Mon, 11 Sep 2023 14:20:32 -0400 From: Garrett Wollman To: freebsd-stable@freebsd.org Subject: Re: Did something change with ZFS and vnode caching? In-Reply-To: <25854.38631.998872.484927@hergotha.csail.mit.edu> References: <25827.33600.611577.665054@hergotha.csail.mit.edu> <25831.30103.446606.733311@hergotha.csail.mit.edu> <25840.58487.468791.344785@hergotha.csail.mit.edu> <25853.10676.45028.623279@hergotha.csail.mit.edu> <25854.38631.998872.484927@hergotha.csail.mit.edu> X-Mailer: VM 8.2.0b under 28.2 (amd64-portbld-freebsd13.2) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.6.4 (hergotha.csail.mit.edu [0.0.0.0]); Mon, 11 Sep 2023 14:20:36 -0400 (EDT) X-Spam-Status: No, score=-4.9 required=5.0 tests=ALL_TRUSTED, HEADER_FROM_DIFFERENT_DOMAINS,NICE_REPLY_A autolearn=disabled version=4.0.0 X-Spam-Checker-Version: SpamAssassin 4.0.0 (2022-12-14) on hergotha.csail.mit.edu X-Spamd-Bar: - X-Spamd-Result: default: False [-1.89 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.99)[-0.991]; FORGED_SENDER(0.30)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:1f06:ccb::2]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[bimajority.org : SPF not aligned (relaxed), No valid DKIM,none]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; TO_DN_NONE(0.00)[]; FREEFALL_USER(0.00)[wollman]; ARC_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[wollman@bimajority.org,wollman@hergotha.csail.mit.edu]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rkw4l1NvFz3Ft0 < That was ... interesting. It took a bit of postprocessing, but I was > able to make a flame chart from that: > When I originally did this I thought that it made the most sense to organize by the stack and then the lock name, but after staring at it for a few hours, I decided that it might be more helpful to see it aggregated by lock first and then stacks, so I switched it around: Note that in order to reproduce these flame graphs, you'll have to make a new version of Gregg's stackcollapse.pl that removes the weird behavior the original version has for names with "->" in them, as well as doing some additional postprocessing. -GAWollman From nobody Tue Sep 12 04:08:26 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rl97056Blz4tgQT for ; Tue, 12 Sep 2023 04:08:28 +0000 (UTC) (envelope-from grarpamp@gmail.com) Received: from mail-vs1-xe33.google.com (mail-vs1-xe33.google.com [IPv6:2607:f8b0:4864:20::e33]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rl96z5JzLz4b5P for ; Tue, 12 Sep 2023 04:08:27 +0000 (UTC) (envelope-from grarpamp@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20221208 header.b=FZxhLATP; spf=pass (mx1.freebsd.org: domain of grarpamp@gmail.com designates 2607:f8b0:4864:20::e33 as permitted sender) smtp.mailfrom=grarpamp@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-vs1-xe33.google.com with SMTP id ada2fe7eead31-44e8f9f3cceso2051894137.1 for ; Mon, 11 Sep 2023 21:08:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1694491707; x=1695096507; darn=freebsd.org; h=to:subject:message-id:date:from:references:in-reply-to:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=hYPjgDXZZSicBN6nOgiFqyc7r40T1vaq8Sb0PrkGpog=; b=FZxhLATP3uF5fsVF66fhlTS9V3EXa5Ft4VhoQ/B25NFdN8CEKajAcmZMJZcFIaQ9Hc geZ68GT0mmt44k/grVN5dpqH/sfnBpEtNup1hKBmDES5IWFFRRRtjqWCR7M6//4oD+h8 N3lDqyy5JapmQUycjfL92mb7rhN9dECYE4RnWNOi19CL1cehSSjHdVtjro31GCmmAMvc j/FPUsPXuPUtFblKe0aWRk7Fl2Ix+imh5B9Ax59eIVcnEg4zIF/6DahhQKzI1EmfP4oL ztVt2krsuVYk9FNQ1bj9NuBX5YtVbkWQGcnd0QFtumUG/meC6qNg2Oi1tUyLW4HwEYmr 1k1Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1694491707; x=1695096507; h=to:subject:message-id:date:from:references:in-reply-to:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=hYPjgDXZZSicBN6nOgiFqyc7r40T1vaq8Sb0PrkGpog=; b=cZJ2XO9H3DZpIxehCmAu3eiKAy2loKJv8xZ5VuiLSwzcfx2CLvWEWtjNDqx1Xmm1c3 vMwp1W5GXzp5waPtcRaIdjRL3UMBKxMh7BgkarH3gMVm/LQAyfa/LVT47uAaAlJ33P6J /mU52Oa2pMHMsFNnb+CxcHKPb8RXLIR2hmYAWYFvau66SdWQNgKmo68MhR/4SAMI+NKV cdWXz6JQ2NyaaE/Mr5+qcpEiXOTq9e9wJ9VPFMi1ngE1grZg+747yrYpPVcjvxKWe7Fs fHlVFjPgBkXmLtmfJx3VcP1WGh6S5vL//p5PAzXEUK9RJvVZPfj24Sg7UuDxNhJufAEo YWNQ== X-Gm-Message-State: AOJu0YxCdmz0qQdcMEKw5t7tJpRIa0UPjwS9okYTwKFn+rd5qbXWdBtC mEcfXIamFAxVdOhcC5BwhI1ZLVtIFJPoSYKnY+UGUuILegHcvQ== X-Google-Smtp-Source: AGHT+IF+4lgHDpdeJDlQyjLu+pxupgIqvgLnTOY8NJJvlz5on6uU9vEiEZWcENZcFrwFnhnVdUvkCugA3b4ToqBTLzg= X-Received: by 2002:a67:e94f:0:b0:44d:3aba:b03d with SMTP id p15-20020a67e94f000000b0044d3abab03dmr9633303vso.17.1694491706869; Mon, 11 Sep 2023 21:08:26 -0700 (PDT) List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Received: by 2002:a59:be71:0:b0:3ed:209f:4d2d with HTTP; Mon, 11 Sep 2023 21:08:26 -0700 (PDT) In-Reply-To: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> References: <4f89250407720bc127d1283bee0a0d7f.squirrel@10.1.7.91> From: grarpamp Date: Tue, 12 Sep 2023 00:08:26 -0400 Message-ID: Subject: Re: Update to BETA1 can't login: pam_opie.so not found To: freebsd-stable@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.99)[-0.995]; NEURAL_HAM_SHORT(-0.99)[-0.986]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20221208]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::e33:from]; BLOCKLISTDE_FAIL(0.00)[2607:f8b0:4864:20::e33:server fail]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; REDIRECTOR_URL(0.00)[twitter.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4Rl96z5JzLz4b5P On 9/10/23, Nenhum_de_Nos wrote: > No I can't login > pam_opie.so not found Users of opie will want to use this port and package... https://cgit.freebsd.org/ports/tree/security/opie Search lists for "opie" to find how volunteers could improve opie. -- https://www.youtube.com/watch?v=xWAwK2fHArc https://www.youtube.com/watch?v=_U3lEc-IFr8 https://duckduckgo.com/?ia=videos&iax=videos&q=voluntaryism https://odysee.com/@Anarchast:2 https://bitchute.com/ || https://rumble.com/ || https://odysee.com/ https://twitter.com/NameRedacted247 https://libertarianinstitute.org/books/voluntaryist-handbook/ From ml@ft-c.de Wed Sep 13 03:10:12 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RllnV5y17z4t2C8 for ; Wed, 13 Sep 2023 03:10:22 +0000 (UTC) (envelope-from ml@ft-c.de) Received: from einhorn-mail-out.in-berlin.de (einhorn.in-berlin.de [192.109.42.8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mail.in-berlin.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RllnT1jpGz4Yhn for ; Wed, 13 Sep 2023 03:10:21 +0000 (UTC) (envelope-from ml@ft-c.de) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of ml@ft-c.de designates 192.109.42.8 as permitted sender) smtp.mailfrom=ml@ft-c.de; dmarc=none X-Envelope-From: ml@ft-c.de X-Envelope-To: Received: from authenticated.user (localhost [127.0.0.1]) by einhorn.in-berlin.de with ESMTPSA id 38D3AHs21669863 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT) for ; Wed, 13 Sep 2023 05:10:17 +0200 Message-ID: <777dbb239c8c5b39168c1f75beeb499c56953b3c.camel@ft-c.de> Subject: Re: postgresql pg_curl bug? (solved) From: ft Reply-To: ml@ft-c.de To: stable@FreeBSD.org Date: Wed, 13 Sep 2023 05:10:12 +0200 In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.44.4 FreeBSD GNOME Team List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.30 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-0.91)[-0.906]; R_SPF_ALLOW(-0.20)[+ip4:192.109.42.0/24]; RWL_MAILSPIKE_GOOD(-0.10)[192.109.42.8:from]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[192.109.42.8:from]; ONCE_RECEIVED(0.10)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[ft-c.de]; MIME_TRACE(0.00)[0:+]; HAS_REPLYTO(0.00)[ml@ft-c.de]; SUBJECT_HAS_QUESTION(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; REPLYTO_ADDR_EQ_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[stable@FreeBSD.org]; RCVD_COUNT_ONE(0.00)[1]; R_DKIM_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:29670, ipnet:192.109.42.0/24, country:DE]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4RllnT1jpGz4Yhn Hallo,=20 the solution: today I have deinstall all dependencies and=C2=A0 reinstall the package libidn2 from ports. On Sun, 2023-09-03 at 05:54 +0200, ft wrote: > Hello, >=20 > I have install postgresql15 in jail. > I need the postgresql extension pg_curl. >=20 > cd pg_curl-2.1.1/ > gmake install > cc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after- > statement -Werror=3Dvla -Werror=3Dunguarded-availability-new -Wendif- > labels > -Wmissing-format-attribute -Wcast-function-type -Wformat-security - > fno- > strict-aliasing -fwrapv -Wno-unused-command-line-argument -Wno- > compound-token-split-by-macro -O2 -pipe=C2=A0 -fstack-protector-strong - > fno- > strict-aliasing=C2=A0 -fPIC -DPIC -I. -I./ - > I/usr/local/include/postgresql/server - > I/usr/local/include/postgresql/internal=C2=A0 -I/usr/local/include - > I/usr/local/include -I/usr/local/include=C2=A0 -c -o pg_curl.o pg_curl.c > cc -Wall -Wmissing-prototypes -Wpointer-arith -Wdeclaration-after- > statement -Werror=3Dvla -Werror=3Dunguarded-availability-new -Wendif- > labels > -Wmissing-format-attribute -Wcast-function-type -Wformat-security - > fno- > strict-aliasing -fwrapv -Wno-unused-command-line-argument -Wno- > compound-token-split-by-macro -O2 -pipe=C2=A0 -fstack-protector-strong - > fno- > strict-aliasing=C2=A0 -fPIC -DPIC -shared -o pg_curl.so pg_curl.o - > L/usr/local/lib=C2=A0=C2=A0 -L/usr/local/lib -lpthread -L/usr/local/lib= =C2=A0 - > fstack- > protector-strong=C2=A0=C2=A0 -L/usr/local/lib -Wl,--as-needed -Wl,- > R'/usr/local/lib'=C2=A0 -lcurl > /bin/mkdir -p '/usr/local/lib/postgresql' > /bin/mkdir -p '/usr/local/share/postgresql/extension' > /bin/mkdir -p '/usr/local/share/postgresql/extension' > /usr/bin/install -c -m 755=C2=A0 pg_curl.so > '/usr/local/lib/postgresql/pg_curl.so' > /usr/bin/install -c -m 644 .//pg_curl.control > '/usr/local/share/postgresql/extension/' > /usr/bin/install -c -m 644 .//pg_curl--1.0--2.0.sql .//pg_curl-- > 1.0.sql > .//pg_curl--2.0--2.1.sql .//pg_curl--2.0.sql .//pg_curl--2.1.sql=20 > '/usr/local/share/postgresql/extension/' >=20 > find /usr -name "*pg_curl*" > /usr/local/share/postgresql/extension/pg_curl--2.0.sql > /usr/local/share/postgresql/extension/pg_curl.control > /usr/local/share/postgresql/extension/pg_curl--2.1.sql > /usr/local/share/postgresql/extension/pg_curl--2.0--2.1.sql > /usr/local/share/postgresql/extension/pg_curl--1.0.sql > /usr/local/share/postgresql/extension/pg_curl--1.0--2.0.sql >=20 >=20 > In postgresql, the command: > =C2=A0create extension pg_curl; > get the errormessage: >=20 > ftc=3D# create extension pg_curl; > FEHLER:=C2=A0 konnte Bibliothek =C2=BB/usr/local/lib/postgresql/pg_curl.s= o=C2=AB > nicht > laden: /usr/local/lib/libidn2.so.0: Undefined symbol "strversc > mp@FBSD_1.7" >=20 > libidn2 is installed: >=20 > ls -l /usr/local/lib/libidn2* > root=C2=A0 wheel=C2=A0 281986 Feb=C2=A0 9=C2=A0 2023 /usr/local/lib/libid= n2.a > root=C2=A0 wheel=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 16 Feb=C2=A0 9=C2=A0 2023 = /usr/local/lib/libidn2.so -> > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 libidn2.so.0.3.8 > root=C2=A0 wheel=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 16 Feb=C2=A0 9=C2=A0 2023 = /usr/local/lib/libidn2.so.0 -> > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 libidn2.so.0.3.8 > root=C2=A0 wheel=C2=A0 202256 Feb=C2=A0 9=C2=A0 2023 /usr/local/lib/libid= n2.so.0.3.8 >=20 > uname -a > FreeBSD ftc 13.2-RELEASE-p2 FreeBSD 13.2-RELEASE-p2 GENERIC amd64 >=20 > Do you need more information? > What should I do? >=20 > Franz >=20 >=20 >=20 >=20 From nobody Wed Sep 13 07:02:18 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RlrxV5lxnz4sp7G for ; Wed, 13 Sep 2023 07:02:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-8.consmr.mail.gq1.yahoo.com (sonic315-8.consmr.mail.gq1.yahoo.com [98.137.65.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RlrxT1lhbz4dw3 for ; Wed, 13 Sep 2023 07:02:37 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=iMx1nUWp; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694588554; bh=8WnwXGqlTO6ByGXYEXzfq4bS0+cp5quVmcpGUyCcjIk=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=iMx1nUWpQ+K8TUw+DxSfbBtsbv9v2EaADDvtH24QElTK3EqzzOAXZDNJ5GRC5S6MoKejQAcybGoPPOhEN7R9LEH7JYI9qWeQ8XwYdTkNnAg/Oo0RyTAJhCDy9VDwoTbMlAdPq51QDAvCpoIAtxnioXu803DFxCYwVxmfiJRed68mbI2W+nIfg5Rmji3/93ilqH5aseOa/zNxoloNmJPjYrgHDo4RAz3zqY0aN2qWMLSm5jDTN/ro0glS5jlJnPyM+baHHiX4FQwUiki1+V1NKs3Bpk//UCI+lciSCFutpZV+QjFNpLzyhMv9EMfb8M5EKQiMEchwQCrxuoqz1B8f8A== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1694588554; bh=6S8EaBTDKv6xJ+wNpCLsVaJM7gwyrPSYsQpnc1jHfbi=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=SN7/XTlmn/35fpPlFL3Ulit+HraC+rhtdRs0sRNluYOK7z+MRGcmVzf6+eTrDSuAmb/tY0H1eT/FR/tdWTdP2bLIuLQiXEANBWynv/JAuJRLAbNozVur70hylqYRQAygW132IUqgmslnUOKe0OF/DImI94oHuJyg/igLKFd1KeDHHL3yy8QZRiYxqZuai2acIPwRDzbpLOVo4iJJ5ZnW6FEjffWzQrBkixv0cNJs41RjXadx0oKyIWYO2Cw9514u5kg+83BnwSInZHyPp/1B92cQwv2hgfZ3fCxRLNXk0vE8i/ylNVNhu/PbmZmhrcdfQHEfgoe5ZPACvu0YnU3n1A== X-YMail-OSG: iPhTAXIVM1kYaObdyqTkqzYu7X3.g.kjtLOBWSfYGDeDu4gdAYLg51G4m_164VJ IjZqQaOfHc2_lN.9sEWmS7UMbJQ_3aFH7txvq_gdp3oSnkkug77l5Z3WPYyJ42uu52y57Eef5g6l QLzG3pyU.7jms93rhc7sNEyHORqyt0jfnPJHPMeQ4WOwy0.7BEEPndXvUb6jVWzoJ8OM3Zaz.Rg6 seyTbcNvDqAaEu1Utps7Da5CsCJiFtU5nvUGA4Wlr23dmOP0Ak8oo5_jliMBuQk_2psjKzanRP5t xb160hrtHLAPV1MelD0pHPtav1bazCmmg_wWDt0K3rHNFT4blHCRZqtf6Waf7c8fomvo425DHtUb rz1h.xRkx_WbmIjZjUJOUMwSx6ooO197sAUSIlMfnESn054b_LdcVg1uiny9uuEu8ETZzVMeN7U4 mcD_ZsfVsUvqC.pUPg01u8mjmADoxtmU395y1dUcykI8J8YA5Z.LPNDjWn60VtkYS1R.j_KeHAwt .KivAv1YlHEArM8qozUISH6w7Jwpx5Mh0VQz2l9UFEmqkN7I2XFkLQqgR1cK_Bi8Y22rWRSb7hD3 MbjPY0aDzpa.rn7501bZ7mqe2mUcl_KoBLEADCAPhvyJAOMX3k5P6M4LCL8JrF3g4d0rX8rjgU8M NIEcKMzNqRBly8IQ5itrwAlTzUEQjw5utfjuB_TXG0AgqYpXkuXQq4_u5QIXIp2zZO5.TCprwrCP _S_9wf873KchWFMWCj5vtxaIdEiay.6jPXAuh8IrSmBhb.YXTmi0RNDpAOWmvNRkLOf_LHLTPa4i 3nW74VF47Yk94eYJAhpE.GY5m9q7Hg6pELu93PipEAc9uUb84EL813Lyscv3qs5E_E28jYrJPpIi Ff6l1wwRCrS1OmE.hKizzfXzFGUuGPUi5NBAdqezcpYaO296jDS6q7x7adSs1.1brzsHoLbAfbRn Ykt7qEWCO.g7UOlXiJ5TK3oeQAYTROGshl8Q7PMqO8uGZ2ux892VroRtMHJ.A9VGqdVvymUsjQNV m2hPX6pNMVYDOwpo80GRGPbJKrvvV8MOaXdwNwg9uDHuxm4i54tfJP5ANR2SxxjBwG94s7nummvh LD8Igfq0EYTn2Utkd_ozRHCNvIaon90pAsA8QMA7ShGWpGwU8B5kJ.Q.m2BRZBox1XG4xtm.IDeO euIe2pJW21gVUn0TF0CeMPkCk_PEXsJ.32vgQa_e0QakbMkiHJreuxkSfJ8NVieN86w0h7TR43CA bhdp3hwyGkoZCkopliZdurx1WBbcug1rlTnfwtACN8d5UW5JR._AmOrQRZazDtbInYzF7mX9v3mb urvXQe.djGqRYTYn.8esHnT4Htox6P_nz7I4hPnLpjBwUOca.QVsTCH2Lq0hfKYlIQ2kDsmg1ZEL XVhuaN7a6tlISsKLJniLLUviUS4FEZLgM66AqlGM.17hu1WiHy7JrLDBZYdeBlu5pSs3mCEoPhls CpIKqP7VKj7RXPNumRLEDvizgcTx1w7hun.vUH1VKUo5LMTdxU350fZIp4oivIHAksrXSsbWBVw_ e5nE1E7c3VVM3ccN3JpKcocGr2qXn9s6HgJ0R9fiMNHxugZC5Mi7oGKM0joy_lXNCOwNyD2988V4 kguGcYpgcquUD47Hv7KMIFhA_ItZBJOSni.LaR509KVq1kprHIC9wKnblMZc.OFx_Wcj8CCqH.wi f1XDnh7xpO4NTML7kzc768VOdSw9ZA81CfNy44eTCCzy_.svnqViEBBUm6RBnyCFPKnef1RGMTMu vUF41XXKYGSYrgxxqq1zH8TkVAnXmlIfxQnrE._zTg6H5s6N5dXigIzynrR0QqV7DdUILhIKfHjs 9WtlpNbeXf9QSMqkCrijAQTjhcbMyIevGUu2dTb71PxW9snbec57yxeOh8IFBhB5m.w8u5EKSyxo LQ.0gP4ova2W2xKsyTPzAewob2wSm1NYV.YQyYdT90jeGJNvVgTBmiXjQOQAdu4.r06Xg1eK5_I4 AFOf44F8kncq_w1b8iHU0DK37mzqkKO6cMDTZWwqqbbuPzQ8BteosTxVGCH2uFii9HsSAIEpkEtI zhQRd66llCjEFfIfwgkUHETBrRn8lCcbO3AuwGbupwrBUiZuyjrP_sv5YsTx48_QkcGLJcUayUpL Hu7CiCbar29OKH.QE.BhRySPqQFfUliSe5Vc2dnG.KDDJlaKVztpMG_SxodWQyLdMgyp2BRIjAVB W4zs2_3Qw3fvAXpUV8HoXH5CztcFEU8aeytPNaE9UlX8xZLor2Ij0eDDt4EVMp5woD41i0CWSWIo bvw-- X-Sonic-MF: X-Sonic-ID: 00f8e2f0-2b7c-4fb8-aed6-75a68224b770 Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Wed, 13 Sep 2023 07:02:34 +0000 Received: by hermes--production-gq1-6b7c87dcf5-j6k2s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3c2bde0f40e44c60cd58c2760d82d8c3; Wed, 13 Sep 2023 07:02:29 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: sys/net/if_lagg_test:status_stress can lead to use-after-free in main (both before and after stable/14 was created), at least on aarch64 Message-Id: <1A90A03B-0B48-4A74-A10C-BD871514460D@yahoo.com> Date: Wed, 13 Sep 2023 00:02:18 -0700 Cc: Current FreeBSD , Kyle Evans To: FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: <1A90A03B-0B48-4A74-A10C-BD871514460D.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[3]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.32:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.32:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RlrxT1lhbz4dw3 See https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273081#c5 and the backtrace in the prior comment. The test context is aarch64. Kyle Evans provided a kgdb patch for devel/gdb for aarch64 that that finally let me track this down to the level of detail on how to interpret the register values reported vs. what code involved using the value. I will say that I've not managed to produce the crash with 14.0-BETA1. But I have produced the crash in my personal non-debug kernel builds and with the main snapshots dd'd to media and booted and used. === Mark Millard marklmi at yahoo.com From nobody Thu Sep 14 16:24:45 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmjMn1X7jz4sxhT for ; Thu, 14 Sep 2023 16:24:53 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmjMm0Pflz3Kw5 for ; Thu, 14 Sep 2023 16:24:52 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net; dmarc=none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38EGOjGA075106 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL) for ; Thu, 14 Sep 2023 12:24:45 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:78ee:a8e2:1849:8ab] ([IPv6:2607:f3e0:0:4:78ee:a8e2:1849:8ab]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38EGOii5004973 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Thu, 14 Sep 2023 12:24:44 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Thu, 14 Sep 2023 12:24:45 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: FreeBSD-STABLE Mailing List From: mike tancsa Subject: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13) Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.08 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.69)[-0.691]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; XM_UA_NO_VERSION(0.01)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FREEFALL_USER(0.00)[mike]; TO_DN_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[sentex.net]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4RmjMm0Pflz3Kw5 Just starting to play around with RELENG_14 and noticed one odd thing I didnt see in the UPDATING notes.  The server's Timezone is set to EDT (GMT-4), but tcpdumping the pflogs show it in UTC. # date Thu Sep 14 12:22:11 EDT 2023 # tcpdump -ner /var/log/pflog | tail -1 reading from file /var/log/pflog, link-type PFLOG (OpenBSD pflog file), snapshot length 200 16:21:18.848111 rule 0/0(match): block in on vtnet0: 185.11.61.68.52750 > xxx.yyy.zzz.141.33428: Flags [S], seq 4237808372, win 1024, length 0 # Same with dumping pflog0 in real time # tcpdump -nei pflog0 action block tcpdump: verbose output suppressed, use -v[v]... for full protocol decode listening on pflog0, link-type PFLOG (OpenBSD pflog file), snapshot length 262144 bytes 16:22:59.205362 rule 0/0(match): block in on vtnet0: 198.12.88.139.58870 > xxx.yyy.zzz.141.4963: Flags [S], seq 3991681664, win 1024, length 0 Is there a way to change this behavior ? Is it expected ?     ---Mike From nobody Thu Sep 14 19:21:56 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmnJ546b9z4sFTc for ; Thu, 14 Sep 2023 19:21:57 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmnJ44Xcvz4PdX for ; Thu, 14 Sep 2023 19:21:56 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net; dmarc=none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38EJLtU5097185 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL) for ; Thu, 14 Sep 2023 15:21:55 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:78ee:a8e2:1849:8ab] ([IPv6:2607:f3e0:0:4:78ee:a8e2:1849:8ab]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38EJLsHU023860 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO) for ; Thu, 14 Sep 2023 15:21:55 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Thu, 14 Sep 2023 15:21:56 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13) Content-Language: en-US From: mike tancsa To: FreeBSD-STABLE Mailing List References: Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.94 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.55)[-0.546]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; XM_UA_NO_VERSION(0.01)[]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; FREEFALL_USER(0.00)[mike]; TO_DN_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[sentex.net]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4RmnJ44Xcvz4PdX On 9/14/2023 12:24 PM, mike tancsa wrote: > Just starting to play around with RELENG_14 and noticed one odd thing > I didnt see in the UPDATING notes.  The server's Timezone is set to > EDT (GMT-4), but tcpdumping the pflogs show it in UTC. > > # date > Thu Sep 14 12:22:11 EDT 2023 > # tcpdump -ner /var/log/pflog | tail -1 > reading from file /var/log/pflog, link-type PFLOG (OpenBSD pflog > file), snapshot length 200 > 16:21:18.848111 rule 0/0(match): block in on vtnet0: > 185.11.61.68.52750 > xxx.yyy.zzz.141.33428: Flags [S], seq 4237808372, > win 1024, length 0 > > # > > Same with dumping pflog0 in real time > > # tcpdump -nei pflog0 action block > tcpdump: verbose output suppressed, use -v[v]... for full protocol decode > listening on pflog0, link-type PFLOG (OpenBSD pflog file), snapshot > length 262144 bytes > > 16:22:59.205362 rule 0/0(match): block in on vtnet0: > 198.12.88.139.58870 > xxx.yyy.zzz.141.4963: Flags [S], seq 3991681664, > win 1024, length 0 > > Is there a way to change this behavior ? Is it expected ? > I tried tcpdump from ports and the same thing. If I set my server's timezone to UTC, the tcpdump at least matches the server's timezone.  If I copy the pcap file to a releng13 box that has localtime set to EDT, tcpdump on it shows the correct time. Its almost as if tcpdump does not see /etc/localtime ? Perms look right root@nano14:~ # ls -l /etc/localtime -r--r--r--  1 root wheel 3494 Aug 26 08:11 /etc/localtime root@nano14:~ # From nobody Thu Sep 14 20:49:11 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmqDp6PF0z4sNNc for ; Thu, 14 Sep 2023 20:49:14 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmqDp5tnpz4Yys; Thu, 14 Sep 2023 20:49:14 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694724554; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NnfnWY7TIshJsnXy7292d9g9RofuwJzHymMjmOUebjE=; b=Bt95akc235Nj7cMdKDiEwbYzxDa2BMUvar4FHCrYEGzZB9Jdaz6zxXfdbaq69kY72Zm9Ov M3knfWbO+FX50cltO/fei0Ajc62f2SmW/0Jqr+b5lAyFqi8h4W6A8/3drGkJUySJDv5NFp etgz7mIMsc6pV59urlskBjiZwuOkTJhruoOLuF0LrDDwc/OB6yp2fgJuaNHHxxyGbLPHvC KuQWpicazcyPjiDnJxjH1Fnl+jGhNNqPYBqy6lCCU1zrpE1UM9FE4VQbgGQQaZaRclwrEI ZL8MXhghpqmJ1eJvcDe6De7i0rzPMoWJ4CVxCYIzFSZJHLLi1g6p2tPxcM47hA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694724554; a=rsa-sha256; cv=none; b=XkLIYDXA/FjHE4sWSN3RbU0bDK6UtA+uzqrr4s9aqWl0Cp9O/2X6AUnmnhfC3of3/wfU37 AzbLl80fhEowpcz0QPeaiyg3ibB/yHQVJ1Ri+WbqwtXEt7MRGi7gIYcogptOmu8Es7YKXU F/mQU6tZ1M9mL1qTsxIwfsO56A2Wi0kCZaNgIMJrPwHk62BVdNyCqdpIeWw0oEAWiHrlEe jdnkBV2tWrJSeRgD/+SBADrYEhEmAvVYrozbmNOz1nUxOW4Cm9y2Eo1PxaN4U5Q7Src5zc WFEz6ImByriwyIklMcDAFTGfqLp5hbVuUFRUurCIHzcGdKolowcOqCkXqFrVog== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1694724554; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NnfnWY7TIshJsnXy7292d9g9RofuwJzHymMjmOUebjE=; b=DSUHR43vqTttiDkNO98Q+pAhUuLzGCRFtkwX5dFq52sXcWhPL4EHNBlUbDLThf6zzSUQ2L O7+4mw3g8IKB98rkP1n08N3JpCR8hNQ4IIUeyyPbB3+eSGYRZ2uTYNI/9GjZWAI66Ia7p/ uySW7StX4y6eLnWhfbeiO8Rl56GNi5KS4kb9G7VHzovyEXUX3b/2O1ZbTkiX76G3qp+bnt rskkn0TCU7dXHfBtXyDGiO0K1sV242wtn0kpdzyfyun145jJQqm+MkTQeB6u4enPt/qytH Z6Hblsg+PiHN8CLeBztOe+mZ6RxDyCbfj4xsUmZgP9ilNpqzF1sAS51B4HMfVA== Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RmqDp448jz4B3; Thu, 14 Sep 2023 20:49:14 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id DAA2B78B94; Thu, 14 Sep 2023 22:49:11 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: mike tancsa Cc: FreeBSD-STABLE Mailing List , jrm@FreeBSD.org Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13) In-Reply-To: (mike tancsa's message of "Thu, 14 Sep 2023 12:24:45 -0400") References: User-Agent: Gnus/5.13 (Gnus v5.13) Date: Thu, 14 Sep 2023 22:49:11 +0200 Message-ID: <86edj0pjjs.fsf@ltc.des.no> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable mike tancsa writes: > Just starting to play around with RELENG_14 and noticed one odd thing > I didnt see in the UPDATING notes. The server's Timezone is set to > EDT (GMT-4), but tcpdumping the pflogs show it in UTC. In stable/13, tcpdump reads /etc/localtime very early, and long before entering capability mode: 72111 tcpdump 0.007527 NAMI "/etc/localtime" 72111 tcpdump 0.007541 RET open 3 72111 tcpdump 0.007549 CALL read(0x3,0x1a9058bb78c0,0xd6b8) 72111 tcpdump 0.007627 RET read 2298/0x8fa 72111 tcpdump 0.007634 CALL close(0x3) 72111 tcpdump 0.007642 RET close 0 [...] 72111 tcpdump 0.024369 CALL cap_enter 72111 tcpdump 0.024381 RET cap_enter 0 In main and stable/14, it enters capability mode immediately before the first attempt to read /etc/localtime, which fails: 745 tcpdump 0.069967829 CALL cap_enter 745 tcpdump 0.070015646 RET cap_enter 0 745 tcpdump 0.070139522 CALL fstatat(AT_FDCWD,0x1c377723d38e,0x1c37734= 30d00 ,0) 745 tcpdump 0.070196299 NAMI "/etc/localtime" 745 tcpdump 0.070240578 RET fstatat -1 errno 94 Not permitted in capa= bility mode 745 tcpdump 0.070487574 CALL fstatat(AT_FDCWD,0x1c377723d38e,0x1c37734= 30cd0,0) 745 tcpdump 0.070550458 NAMI "/etc/localtime" 745 tcpdump 0.070593003 RET fstatat -1 errno 94 Not permitted in capa= bility mode The simplest workaround is to call tzset(3) before entering capability mode. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Thu Sep 14 20:58:39 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmqRg2CD6z4sNr2 for ; Thu, 14 Sep 2023 20:58:39 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RmqRg1d9sz4cYK; Thu, 14 Sep 2023 20:58:39 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38EKwcnb011971 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Thu, 14 Sep 2023 16:58:38 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:78ee:a8e2:1849:8ab] ([IPv6:2607:f3e0:0:4:78ee:a8e2:1849:8ab]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38EKwcOF035587 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Thu, 14 Sep 2023 16:58:38 -0400 (EDT) (envelope-from mike@sentex.net) Content-Type: multipart/alternative; boundary="------------wLNxPGC13RgLzW2mz5PUR8QS" Message-ID: Date: Thu, 14 Sep 2023 16:58:39 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13) Content-Language: en-US To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= Cc: FreeBSD-STABLE Mailing List , jrm@FreeBSD.org References: <86edj0pjjs.fsf@ltc.des.no> From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <86edj0pjjs.fsf@ltc.des.no> X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4RmqRg1d9sz4cYK This is a multi-part message in MIME format. --------------wLNxPGC13RgLzW2mz5PUR8QS Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 9/14/2023 4:49 PM, Dag-Erling Smørgrav wrote: > mike tancsa writes: > In main and stable/14, it enters capability mode immediately before the > first attempt to read /etc/localtime, which fails: > > 745 tcpdump 0.069967829 CALL cap_enter > 745 tcpdump 0.070015646 RET cap_enter 0 > 745 tcpdump 0.070139522 CALL fstatat(AT_FDCWD,0x1c377723d38e,0x1c3773430d00 > ,0) > 745 tcpdump 0.070196299 NAMI "/etc/localtime" > 745 tcpdump 0.070240578 RET fstatat -1 errno 94 Not permitted in capability mode > 745 tcpdump 0.070487574 CALL fstatat(AT_FDCWD,0x1c377723d38e,0x1c3773430cd0,0) > 745 tcpdump 0.070550458 NAMI "/etc/localtime" > 745 tcpdump 0.070593003 RET fstatat -1 errno 94 Not permitted in capability mode > > The simplest workaround is to call tzset(3) before entering capability > mode. Thanks!     Should open a PR about this ?     ---Mike --------------wLNxPGC13RgLzW2mz5PUR8QS Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit
On 9/14/2023 4:49 PM, Dag-Erling Smørgrav wrote:
mike tancsa <mike@sentex.net> writes:

In main and stable/14, it enters capability mode immediately before the
first attempt to read /etc/localtime, which fails:

   745 tcpdump  0.069967829 CALL  cap_enter
   745 tcpdump  0.070015646 RET   cap_enter 0
   745 tcpdump  0.070139522 CALL  fstatat(AT_FDCWD,0x1c377723d38e,0x1c3773430d00
,0)
   745 tcpdump  0.070196299 NAMI  "/etc/localtime"
   745 tcpdump  0.070240578 RET   fstatat -1 errno 94 Not permitted in capability mode
   745 tcpdump  0.070487574 CALL  fstatat(AT_FDCWD,0x1c377723d38e,0x1c3773430cd0,0)
   745 tcpdump  0.070550458 NAMI  "/etc/localtime"
   745 tcpdump  0.070593003 RET   fstatat -1 errno 94 Not permitted in capability mode

The simplest workaround is to call tzset(3) before entering capability
mode.

Thanks!

    Should open a PR about this ?

    ---Mike



    

  


--------------wLNxPGC13RgLzW2mz5PUR8QS--

From nobody Thu Sep 14 21:08:14 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rmqfn3B4tz4sPwG
	for ; Thu, 14 Sep 2023 21:08:17 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4Rmqfn2V2dz4f7L;
	Thu, 14 Sep 2023 21:08:17 +0000 (UTC)
	(envelope-from des@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1694725697;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=nfmUWvalBo7+FUIAZk/K+gFkvPeqS5h1LVLmuHkSD40=;
	b=c7XSt5Y86Ebds8jU3pKCNBgHquAuMJMY326I9NUp+kLPv5Z0bV6EWgWWeM5GV0l2R4z+qD
	V5VaGPINIVznsNW6TIf/LSzXQ7y7Nnq2NBVRqZM6IG2hXS3W2dXJr7PL6f0GHtM8VmdHC3
	OWYqvE0WWrbW7WjnfoQ4hFdaWthYOYcNFzB5BHDKIVApiph5J/6bRZ36hUpyYWUPW10SE8
	uC8u8lJl8NSkXcVzp2Y6PKXFKhBhk9i6y6WJUkNSeIkaNwir4YNm3eCaKa/9OpdqruVdHP
	2jdrWr7PbvkdBsMjGjXsz7Ok2Uwsl93QAmY1aIh5ruDuM7BLHsuQtuiSswEjAA==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694725697; a=rsa-sha256; cv=none;
	b=a6SNilnPyJd726FMPSUP36GU+JNjTb1y7P/OuoMgozjProOqM0DRBH7Ooi6qiEzOLSsdah
	IVGySE73H0h/Mznuas1gZ6Md6jDBTBL5zjr0XUaFmIDfg7I38lrgpkrJN8zV8BfKDpOcUY
	TbR2yeoIcQh/0QOWZ+SuXUCb0/q61K/YoMR32iIoOftNheyRtkRfYr7UBP4S7lZrTShXNJ
	JaKgYpwDUBj9ymB/ATONy1hooa0FodKe04D33VD5WDzX5pMCH60IwLUCRfTkSNNYbrHt3F
	csyNSeboUuPd7cmnS+eNJffuoBklX2wq7gO72vbYyOZ06ppZQ8WfxFOXx7Cjnw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1694725697;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 content-transfer-encoding:content-transfer-encoding:
	 in-reply-to:in-reply-to:references:references;
	bh=nfmUWvalBo7+FUIAZk/K+gFkvPeqS5h1LVLmuHkSD40=;
	b=pulkjgOnLOtDSlDNmFAFTSfBAvM9GNsTfWGnmCrU5R3Q5/uMPDgyZ2+2XtNEPQWz5lmrKw
	a/oh5DFmSwLf1MIlZjlckIO4A77SV+B/G4Qce3ubryRzRIsOtyE/b1PdfPHfo5fafOrgJ7
	zqBR1rWN51r6gOHIttOCTQfpuwtslLUG5Dj2LFDRJi+vKkWj1QwPS+OrVv3QJeJejRv4au
	r5bj7qFEUA4YPMmhSdSt4D20EW/DIQPd8a1CM4p5zb+UUXa6PFjLBYkI88PPSUQnEtwJLv
	qbqbER88tnF8z5JvG+7HHDXJqsZQTOcTTgp1TxYdqRB0aQHt+DmZKgzMUctCKg==
Received: from ltc.des.no (unknown [IPv6:2001:4647:d671:0:36e8:94ff:feca:9834])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	(Authenticated sender: des)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rmqfn0VnLz4tT;
	Thu, 14 Sep 2023 21:08:17 +0000 (UTC)
	(envelope-from des@freebsd.org)
Received: by ltc.des.no (Postfix, from userid 1001)
	id E180678B95; Thu, 14 Sep 2023 23:08:14 +0200 (CEST)
From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
To: mike tancsa 
Cc: FreeBSD-STABLE Mailing List ,  jrm@FreeBSD.org
Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13)
In-Reply-To:  (mike tancsa's
	message of "Thu, 14 Sep 2023 16:58:39 -0400")
References: 
	<86edj0pjjs.fsf@ltc.des.no>
	
User-Agent: Gnus/5.13 (Gnus v5.13)
Date: Thu, 14 Sep 2023 23:08:14 +0200
Message-ID: <86a5topio1.fsf@ltc.des.no>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

mike tancsa  writes:
> Should open a PR about this ?

Feel free to open a PR, I already cc:ed the maintainer (jrm@).

DES
--=20
Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org

From nobody Thu Sep 14 23:55:40 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RmvMy09Tfz4t5qX
	for ; Thu, 14 Sep 2023 23:55:42 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RmvMx4p3Jz3c1v;
	Thu, 14 Sep 2023 23:55:41 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	none
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38ENtdwR030738
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Thu, 14 Sep 2023 19:55:39 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:d5ca:4c08:f5b:b035] ([IPv6:2607:f3e0:0:4:d5ca:4c08:f5b:b035])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38ENtd8m053064
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Thu, 14 Sep 2023 19:55:39 -0400 (EDT)
	(envelope-from mike@sentex.net)
Message-ID: <33bc21be-d637-4413-88d1-c388a76a25b2@sentex.net>
Date: Thu, 14 Sep 2023 19:55:40 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13)
Content-Language: en-US
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List , jrm@FreeBSD.org
References: 
 <86edj0pjjs.fsf@ltc.des.no> 
 <86a5topio1.fsf@ltc.des.no>
From: mike tancsa 
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <86a5topio1.fsf@ltc.des.no>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Scanned-By: MIMEDefang 2.84
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]
X-Rspamd-Queue-Id: 4RmvMx4p3Jz3c1v

On 9/14/2023 5:08 PM, Dag-Erling Smørgrav wrote:
> mike tancsa  writes:
>> Should open a PR about this ?
> Feel free to open a PR, I already cc:ed the maintainer (jrm@).
>
Thanks, I have submitted

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273807

     ---Mike


> DES

From nobody Fri Sep 15 20:16:03 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnQSC31Pgz4ssL2
	for ; Fri, 15 Sep 2023 20:16:11 +0000 (UTC)
	(envelope-from mike@sentex.net)
Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RnQSB1sDqz4Fjh;
	Fri, 15 Sep 2023 20:16:10 +0000 (UTC)
	(envelope-from mike@sentex.net)
Authentication-Results: mx1.freebsd.org;
	dkim=none;
	spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net;
	dmarc=none
Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19])
	by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38FKG39x052766
	(version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL);
	Fri, 15 Sep 2023 16:16:03 -0400 (EDT)
	(envelope-from mike@sentex.net)
Received: from [IPV6:2607:f3e0:0:4:d5ca:4c08:f5b:b035] ([IPv6:2607:f3e0:0:4:d5ca:4c08:f5b:b035])
	by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38FKG3ff064543
	(version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO);
	Fri, 15 Sep 2023 16:16:03 -0400 (EDT)
	(envelope-from mike@sentex.net)
Message-ID: <6fdc941a-49cd-49ec-8c4e-43b393956580@sentex.net>
Date: Fri, 15 Sep 2023 16:16:03 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13)
Content-Language: en-US
From: mike tancsa 
To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= 
Cc: FreeBSD-STABLE Mailing List , jrm@FreeBSD.org
References: 
 <86edj0pjjs.fsf@ltc.des.no> 
 <86a5topio1.fsf@ltc.des.no> <33bc21be-d637-4413-88d1-c388a76a25b2@sentex.net>
Autocrypt: addr=mike@sentex.net; keydata=
 xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP
 xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s
 +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW
 yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH
 VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB
 AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs
 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W
 rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS
 j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ
 cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R
 yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw
 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk
 AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1
 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt
 RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO
 l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7
 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB
 CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8
 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM
 aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X
 rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB
 Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0
 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg==
In-Reply-To: <33bc21be-d637-4413-88d1-c388a76a25b2@sentex.net>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Scanned-By: MIMEDefang 2.84
X-Spamd-Bar: ---
X-Spamd-Result: default: False [-3.39 / 15.00];
	NEURAL_HAM_MEDIUM(-1.00)[-1.000];
	NEURAL_HAM_LONG(-1.00)[-1.000];
	NEURAL_HAM_SHORT(-1.00)[-0.999];
	R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32];
	MIME_GOOD(-0.10)[text/plain];
	RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received];
	XM_UA_NO_VERSION(0.01)[];
	R_DKIM_NA(0.00)[];
	FROM_EQ_ENVFROM(0.00)[];
	RCPT_COUNT_THREE(0.00)[3];
	MIME_TRACE(0.00)[0:+];
	RCVD_COUNT_TWO(0.00)[2];
	ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA];
	MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org];
	ARC_NA(0.00)[];
	FREEFALL_USER(0.00)[mike];
	FROM_HAS_DN(0.00)[];
	TO_DN_SOME(0.00)[];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	RCVD_TLS_ALL(0.00)[];
	DMARC_NA(0.00)[sentex.net];
	MID_RHS_MATCH_FROM(0.00)[]
X-Rspamd-Queue-Id: 4RnQSB1sDqz4Fjh

On 9/14/2023 7:55 PM, mike tancsa wrote:
> On 9/14/2023 5:08 PM, Dag-Erling Smørgrav wrote:
>> mike tancsa  writes:
>>> Should open a PR about this ?
>> Feel free to open a PR, I already cc:ed the maintainer (jrm@).
>>
> Thanks, I have submitted
>
> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=273807
>
Not sure if I should open one for the port, but it too has the same issue

     ---Mike



From nobody Sat Sep 16 00:28:31 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnX3T52HBz4t0wB;
	Sat, 16 Sep 2023 00:28:37 +0000 (UTC)
	(envelope-from gjb@freebsd.org)
Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "freefall.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RnX3T4cZBz3PJ0;
	Sat, 16 Sep 2023 00:28:37 +0000 (UTC)
	(envelope-from gjb@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1694824117;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type;
	bh=0c6Qa0S2V9+e4D/F0YtyDmGe5m1NHMp8xWzhlsYf4f8=;
	b=iu4O66GxaoDPavBKB/aDBwksJ2nQXmXP/JPpw83e1zi91Ev/t1qYz+IpglBLl53JZgkTON
	y4GxgnoUOxw7u578Cl6ZneVVKQwTloUCv/L6a1fcMX1RxOq09Knku+LqVjkBeVwpk+bddb
	6MlOGa7ONPi1OvNFNSY3o5ZzkPou46XdnJNYY5eq/7LjbVAWp486sNaeVVnoT7u4aCdXN/
	vXJd2mk9iwnt6pzvHjZ9ABs/CL1ZKzc3GUDKWDzjHebhtNATxqtgiDxc27d5EyoJwpBwyV
	ZQsrLtUE4Lf9a/wBYOlVN97XUA7cIHiccAKUoaaRQ0kj/4h8dHKDIizSAT/HSg==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694824117; a=rsa-sha256; cv=none;
	b=DuoSKurfR+9YebltHM7Au3ZHUP/lUdNHeWCQm6c5EhaoWCXVcdv48bbB3Fk5HJSc6kUP9p
	cLgYXYPLGltHdCWUBGC2uE8Y9DG1m/thrl+rq7ErSu/45P+33r9WPhC4mxByblDgaPXzoq
	Ce/mHTqXPlB2zyxrRzX1AbUGx3onI529NqpzTZSbgoS/ZstZzBU/cf5ddFx8K4Gs/jZ0PJ
	ODPWLJGFSU4FYs5NUJn0xDoQpXa2hX1V4VIpu5f2rnDkdy3orrbGX0pkMvVEhrr4WF5pnA
	Mlv0B/qYWyyl1W6Lk3aNI3FYpe1ifpBWfMc6XNl9NaY3B+n34lhskCkC4GjHyg==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1694824117;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type;
	bh=0c6Qa0S2V9+e4D/F0YtyDmGe5m1NHMp8xWzhlsYf4f8=;
	b=GYkuadoBs6HcV8YY3E96s3WrixaqCDmgiTE+DMnOsFDG7JnFEMATofiSxacYsPAkQavzdm
	gP3esyLGhYiyZIj/AwThFDRiN4+WKyPHnpEuA6173yDRPH0a5uo2Jguw1A0z+DDnYZAU+Z
	tVuOxZSbZ/O/11TeqW/o4fvwzZ3FfuVvPZuue9Z90LTThaWsWqunJcrRiCA6R6l1sfLj6K
	lLoYH9FWSNqH6rhsEBXlW/OtCBR0pLNtKoAGSjQODMHyrYSg7pGEkPxMtNnnI2V9rlbpJi
	NLXkDwE2lc6j5MiAMsXpe5nT3T7XGoun4JnNAV9fnfP4JLElbs7Dcc5Rnu0wgA==
Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84])
	(using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
	(Client did not present a certificate)
	by freefall.freebsd.org (Postfix) with ESMTPS id 50B0B10BCD;
	Sat, 16 Sep 2023 00:28:37 +0000 (UTC)
	(envelope-from gjb@freebsd.org)
Date: Sat, 16 Sep 2023 00:28:31 +0000
From: Glen Barber 
To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org
Cc: FreeBSD Release Engineering Team 
Subject: FreeBSD 14.0-BETA2 Now Available
Message-ID: <20230916002831.GU52318@FreeBSD.org>
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

The second BETA build of the 14.0-RELEASE release cycle is now
available.

Installation images are available for:

o 14.0-BETA2 amd64 GENERIC
o 14.0-BETA2 i386 GENERIC
o 14.0-BETA2 powerpc GENERIC
o 14.0-BETA2 powerpc64 GENERIC64
o 14.0-BETA2 powerpc64le GENERIC64LE
o 14.0-BETA2 powerpcspe MPC85XXSPE
o 14.0-BETA2 armv7 GENERICSD
o 14.0-BETA2 aarch64 GENERIC
o 14.0-BETA2 aarch64 RPI
o 14.0-BETA2 aarch64 PINE64
o 14.0-BETA2 aarch64 PINE64-LTS
o 14.0-BETA2 aarch64 PINEBOOK
o 14.0-BETA2 aarch64 ROCK64
o 14.0-BETA2 aarch64 ROCKPRO64
o 14.0-BETA2 riscv64 GENERIC
o 14.0-BETA2 riscv64 GENERICSD

Note regarding arm SD card images: For convenience for those without
console access to the system, a freebsd user with a password of
freebsd is available by default for ssh(1) access.  Additionally,
the root user password is set to root.  It is strongly recommended
to change the password for both users after gaining access to the
system.

Installer images and memory stick images are available here:

    https://download.freebsd.org/releases/ISO-IMAGES/14.0/

The image checksums follow at the end of this e-mail.

If you notice problems you can report them through the Bugzilla PR
system or on the -stable mailing list.

If you would like to use Git to do a source based update of an existing
system, use the "releng/14.0" branch.

A summary of changes since 14.0-BETA1 includes:

o The Areca RAID driver has been updated to version 1.50.00.06.

o The libarchive library has been updated.

o A fix for the ZFS block_cloning feature has been implemented.

o Several linux(4) updates.

o Several manual page updates.

A list of changes since 13.x is available in the releng/14.0
release notes:

    https://www.freebsd.org/releases/14.0R/relnotes/

Please note, the release notes page is not yet complete, and will be
updated on an ongoing basis as the 14.0-RELEASE cycle progresses.

=== Virtual Machine Disk Images ===

VM disk images are available for the amd64, i386, and aarch64
architectures.  Disk images may be downloaded from the following URL
(or any of the FreeBSD download mirrors):

    https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA2/

BASIC-CI images can be found at:

    https://download.freebsd.org/releases/CI-IMAGES/14.0-BETA2/

The partition layout is:

    ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label)
    ~ 1 GB  - freebsd-swap GPT partition type (swapfs GPT label)
    ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label)

The disk images are available in QCOW2, VHD, VMDK, and raw disk image
formats.  The image download size is approximately 135 MB and 165 MB
respectively (amd64/i386), decompressing to a 21 GB sparse image.

Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI
loader file is needed for qemu-system-aarch64 to be able to boot the
virtual machine images.  See this page for more information:

    https://wiki.freebsd.org/arm64/QEMU

To boot the VM image, run:

    % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt  \
	-bios QEMU_EFI.fd -serial telnet::4444,server -nographic \
	-drive if=none,file=VMDISK,id=hd0 \
	-device virtio-blk-device,drive=hd0 \
	-device virtio-net-device,netdev=net0 \
	-netdev user,id=net0

Be sure to replace "VMDISK" with the path to the virtual machine image.

=== Amazon EC2 AMI Images ===

FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager
Parameter Store in each region using the keys:

	/aws/service/freebsd/amd64/base/ufs/14.0/BETA2
	/aws/service/freebsd/amd64/base/zfs/14.0/BETA2

FreeBSD/arm64 EC2 AMIs are not available for this BETA build.

=== Vagrant Images ===

FreeBSD/amd64 images are not available for this BETA build.

=== Upgrading ===

IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT

Due to an issue where an existing file had been replaced by a directory
with the same name, binary upgrades from 13.2 and earlier using the 
freebsd-update(8) utility will not work.  The issue is being
investigated.

IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT

The freebsd-update(8) utility supports binary upgrades of amd64, i386,
and aarch64 systems running earlier FreeBSD releases.  Systems running
earlier FreeBSD releases can upgrade as follows:

	# freebsd-update upgrade -r 14.0-BETA2

During this process, freebsd-update(8) may ask the user to help by
merging some configuration files or by confirming that the automatically
performed merging was done correctly.

	# freebsd-update install

The system must be rebooted with the newly installed kernel before
continuing.

	# shutdown -r now

After rebooting, freebsd-update needs to be run again to install the new
userland components:

	# freebsd-update install

It is recommended to rebuild and install all applications if possible,
especially if upgrading from an earlier FreeBSD release, for example,
FreeBSD 12.x.  Alternatively, the user can install misc/compat12x and
other compatibility libraries, afterwards the system must be rebooted
into the new userland:

	# shutdown -r now

Finally, after rebooting, freebsd-update needs to be run again to remove
stale files:

	# freebsd-update install

== ISO CHECKSUMS ==

o 14.0-BETA2 amd64 GENERIC:
  SHA512 (FreeBSD-14.0-BETA2-amd64-bootonly.iso) = 47a8634c3870655d32fabd4a5c6004fbfe1b84857eede8b81d4d0d41a8b47bf6653ac67ad7f39d11df2940197d6fefa25db2d7d52d68f27a7d22fd79aa0d893a
  SHA512 (FreeBSD-14.0-BETA2-amd64-bootonly.iso.xz) = e5076b538263e636fed06cdec9cf7b6370c7207d896c0fe7d87d1b980bd4d8b0ca35b0e5e6a73fbc0643fefcc160fc258b4eae0cb3aead75c7c057b107f30266
  SHA512 (FreeBSD-14.0-BETA2-amd64-disc1.iso) = 0a297cbbfc7c41d90deccc2d79d8054c169d766df153db2517301c40c6609061fc7bfe8eee6f70304b3d0a6cdf745cf6bd7293a5a1ec8dce8594e9f11a1ed2ac
  SHA512 (FreeBSD-14.0-BETA2-amd64-disc1.iso.xz) = 7fefc5e1e349b5cf5c7dbc78f62740cf16765ec04c8e51edfdb0d5a523bf17428955b071aedf000c443896af3923541f606b2a5569681afb5a10470d466d71b6
  SHA512 (FreeBSD-14.0-BETA2-amd64-dvd1.iso) = 326718136de2cd583f3978c9cc31d0b10cb8a4d88efae0da9fc9a9dbeffbde69c339d1dcf881341417377d44aa51885de6c9a0808d5db2c5ec8aeaecf7904ba8
  SHA512 (FreeBSD-14.0-BETA2-amd64-dvd1.iso.xz) = 6ea2ca3864698cb222eda47a39503868d41b5a2cb7385f3445a98256dd25f978cdc2cd03322f420e8d7413d0faca5fad135dba4c151937e2d61d938be8a1b872
  SHA512 (FreeBSD-14.0-BETA2-amd64-memstick.img) = 327d45c1f2c6830fdbe21ad49dd51122f692cce4ab8653714a7c724c72d979d92ab98c51cddaba6a075bef745fdbcde15f24d5a899342023121a0b173e802e8e
  SHA512 (FreeBSD-14.0-BETA2-amd64-memstick.img.xz) = 6394d05f539561cc2b207d58e4c48d6e0d65c1806c8140c0834d468fdcebeab19e2b0719adda47c7a9cd8ad62a6a7c562442b89636f852de2dfba11fe847c012
  SHA512 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img) = dbf64964c0d2a1ca522c8d44275682d5606177f57013f5dde73c0e357b3853155a5ca35e0a3df9d1717d0af74fd18a65dddcfde552dde05c505191d8f3266f03
  SHA512 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img.xz) = 4706c36fec911757ffb30f2474d9a03f2ffbea826989a4487a2a9d2f2aa1a517ec8f095012348fa114a1297c296a1701f9362d8fb81bf40dd65b1ff1445fac08

  SHA256 (FreeBSD-14.0-BETA2-amd64-bootonly.iso) = ac63aa79dbfe728e2a33563ca93f24644de17f5a8dac7191f6f434083defea99
  SHA256 (FreeBSD-14.0-BETA2-amd64-bootonly.iso.xz) = 65cfda966fe6a87f862c6946e43a32ae7a653610338d9b65f46f7ab023f9532e
  SHA256 (FreeBSD-14.0-BETA2-amd64-disc1.iso) = 8e19b661821a7dff9d1f1e2f352acbeefdc5d1f828c4e9c1b6c5a84369d9ac0d
  SHA256 (FreeBSD-14.0-BETA2-amd64-disc1.iso.xz) = 138217e65091a07270c4ed216baf9133aee76bfb92c266b747a7b60b8b34191b
  SHA256 (FreeBSD-14.0-BETA2-amd64-dvd1.iso) = 2b0bf12830ad82cd8eae4e17323b5113316993d176389ae017893b2c5250a000
  SHA256 (FreeBSD-14.0-BETA2-amd64-dvd1.iso.xz) = 1ed2a491d06f58a88ef860ee90cb96827f4eb756c0298dd34df3de978be8ccf8
  SHA256 (FreeBSD-14.0-BETA2-amd64-memstick.img) = 5fd713f55b1ffb435b734b1d0abf7dd9ad65ea366d8ff2a7f920642d8445d0bb
  SHA256 (FreeBSD-14.0-BETA2-amd64-memstick.img.xz) = e74d59d3b4db590000d76c7150cf0f67a4e8e723e1e9521a46378ff38b71e0b1
  SHA256 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img) = 5dfb262e6bef1be1806ea40cd806d0b8aa5da7700b28f489654541a92598daf8
  SHA256 (FreeBSD-14.0-BETA2-amd64-mini-memstick.img.xz) = d491ad2a9945b0bef05b3eace610d172a0d0999571ed045a801e5f6aaf86316d


o 14.0-BETA2 i386 GENERIC:
  SHA512 (FreeBSD-14.0-BETA2-i386-bootonly.iso) = a0b65b92035059514114b41ba33f5fd94e8292e52ae51c64d1ea2f632b7afc5335bde77bd706d44f0f6eb74fa55ce19256cbba22bb141631c3fc12106befb35d
  SHA512 (FreeBSD-14.0-BETA2-i386-bootonly.iso.xz) = 9d7afb8aa64d85468a3b3c392050027f07bd0589d67423cab04c1081f1ff6c3b1d11d57cd6b47dd4c981c0212335ea101ca4eec9c4c9ee8a880d7313cd2e28ef
  SHA512 (FreeBSD-14.0-BETA2-i386-disc1.iso) = e4f256f29a558da63defa1da39e8cf782d90dceae4ad2cf05781001d9f050333e809e998b6d392d4aaf8409981caf499fa60ab143132649c3b4c6fff355dc626
  SHA512 (FreeBSD-14.0-BETA2-i386-disc1.iso.xz) = 0f367fd32bd149399502c5020a18e33b597220ec4a88e32b39a6f69a2e35f9157b827b858a4045b3e6784fc513b76fea475432e70f711233c63f64c5349df307
  SHA512 (FreeBSD-14.0-BETA2-i386-dvd1.iso) = 09edb86b580c4fda01a186d656079c206ad3c37447a409efb9e148a508481807e4f806ad546c97f43fef50b6b7c3b0780db7e13231a1c4ca193d16f15394fa25
  SHA512 (FreeBSD-14.0-BETA2-i386-dvd1.iso.xz) = 9f6547d9213616564eb66a523d81671de68a76d38edb05a80b0bc5eb1753fde8baae8cbd84ea50e49e6ad9657d861429453f5818793b26edd36be5132f3a9c08
  SHA512 (FreeBSD-14.0-BETA2-i386-memstick.img) = 676327e21b2c21845e90e61f7673c79e918ae855da8c13943ec1fb28b0525eb964c198219add11891bf0a063647652c16022669a135094f460100789cb0f4a96
  SHA512 (FreeBSD-14.0-BETA2-i386-memstick.img.xz) = 34975bc88d9376d3ebac130d477d9a2db039be0a5e5d29e6c81e87d03cdccc2c4195e9185934578a9670d8eedcdd99c57a06c70031e8d5c145e7d7c301e7817e
  SHA512 (FreeBSD-14.0-BETA2-i386-mini-memstick.img) = ba5b0566224b26e1dc59afb1e2584f4db3dbc9fc69bd0f31f50debbab7ae395ad7fc5f5db7786e7afb414120a7e1c3b43ef8248a6a7e94ba948c50c3142fb516
  SHA512 (FreeBSD-14.0-BETA2-i386-mini-memstick.img.xz) = 60440306096761d7dd2e40d960d1d625a529de8df639d76466dd8a9a0a7295aafb53d0943f6d2862b454bb90a7ab0af40116dc96fbb6648a875c54b7ce7edb2e

  SHA256 (FreeBSD-14.0-BETA2-i386-bootonly.iso) = 1f513699bfb6f61804e4b456249cd3f4fb1c07eb74b66ac2cfcac3bbebe23f2f
  SHA256 (FreeBSD-14.0-BETA2-i386-bootonly.iso.xz) = 346586e72afb12306e234b12faa8ac1edaa2f0f4fa9d1a8e396ba1a18c16be50
  SHA256 (FreeBSD-14.0-BETA2-i386-disc1.iso) = 98ecce04874bd08a2d1665abb9d6d97e846ecbf3848b2eb11e1906c8bee091ae
  SHA256 (FreeBSD-14.0-BETA2-i386-disc1.iso.xz) = 52b7b39a816fa6e59eace7f88893684799c15d7b5ce1a3e7f6f2856ea8af18c7
  SHA256 (FreeBSD-14.0-BETA2-i386-dvd1.iso) = c6f2ecd647db425b766410a9383a7288fd6a329698b79ce9f34532803a8a678a
  SHA256 (FreeBSD-14.0-BETA2-i386-dvd1.iso.xz) = a34240ac481525303ce43a803c6f0eae5e77bc04781a30fc8732da5d7cd20724
  SHA256 (FreeBSD-14.0-BETA2-i386-memstick.img) = d9749073a96b092ab5401f51305867843b32214bf7c2cc36a7353b3b06e5f2a2
  SHA256 (FreeBSD-14.0-BETA2-i386-memstick.img.xz) = e4e11fdb5667acdd04a0e9cdef361feb387b1a3f58a3c9af017648f753f212a0
  SHA256 (FreeBSD-14.0-BETA2-i386-mini-memstick.img) = 43fef9b8eb39535e19029016f63238477ad03b4d642d3167cd57580d453264aa
  SHA256 (FreeBSD-14.0-BETA2-i386-mini-memstick.img.xz) = 804a105d3ef25cc037d1f9069da4b80b31d22b18678ae07a98b43cd392c85560


o 14.0-BETA2 powerpc GENERIC:
  SHA512 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso) = e919520faef666bd16d64370b5a240c088203546fb60697a6c623c28ae74ea4ca31fee1341c86a7d9499b34c221e9cc95b3b29891479ccf8e584dce5992cf201
  SHA512 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso.xz) = 855b02074144c7fcca939de0fed597187c98a0e31523539121bd4bca65bb5d2a1b608bbcc5c599d1331eeb49486c9a2737610c2f56603476f01b7810e34d42f0
  SHA512 (FreeBSD-14.0-BETA2-powerpc-disc1.iso) = 1fc05e4be200cbf1c271b449a0f69140d77f25d9d66ba289cf7a489902120f1be57c1425b4888da3164af610f7709ff1376d669351a3df17f309f9a0eec0a1c9
  SHA512 (FreeBSD-14.0-BETA2-powerpc-disc1.iso.xz) = f0d8ae042a6cd06b15e0a45aa1d976333722abf3e4601ad7cb7b2f66ab218f3b65844eee285408334597b7c79c04e630d841b23e6e59cf5c5d8db4fa9e1b9a50

  SHA256 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso) = b64cbfcd02652e82cfb91948ce630d6d457f9d9101e11a9bc259df5d36551701
  SHA256 (FreeBSD-14.0-BETA2-powerpc-bootonly.iso.xz) = 79fac9332c230d1c259c9cc21ead7fe1f3dfeeb73933112dc44ae061c0306496
  SHA256 (FreeBSD-14.0-BETA2-powerpc-disc1.iso) = 535f3cd2dc98667c9a800f99c9121c9fa566e9abda5c01feec935dc9061b5542
  SHA256 (FreeBSD-14.0-BETA2-powerpc-disc1.iso.xz) = 8c1e96cad81d542dcbd13a09e998c151e2a32520dee1a3def91afda7bedb1b09


o 14.0-BETA2 powerpc64 GENERIC64:
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso) = 08ca109d8cae1959b81d23fcb33b0f709e7ad64bec02f7649db5a03d1cce3a701eabe6586f531e83f41e08937727e49a3ae7d7ec1de54ae5582d0d4d840b4865
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso.xz) = d273a9e2ea6bf9611cce9d5edc5fa1a960f577de1601e0f4472313dd2f309f87d47fe048d85b7047d43241a9e2a87ad27d8e17192e2686c149d85cbccd5f8a1c
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso) = 5d221dcf52c080ab6010c364c582114f6950ccc896548dcb9b7026113aa8ed16e2f39ed9fcb5fc4bba84fd023845de3ffc1cbc171a7dcb3f1403c2afbe9cda12
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso.xz) = 92ce1aed7362f6a438beb0bf54c837470b247fda2abf62c4233e23427f180d77cf69be552e5b82a32d2d8c6ac67544e57218300ded7ae76e6989cc9d70c372e2

  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso) = 7cc1ac48d50a2919f912c474a43fbe8dad4e19e57463389ea44e18322a9b870f
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-bootonly.iso.xz) = 48066962424687e25e89752dbffc8566be0adf829fb9be76902327758d178d2d
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso) = d10fbeaea5d6f846704009eccc30c012bea0dd29c22ef9f014c95e80faef33ea
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64-disc1.iso.xz) = fdcdc52b1eb24da3a675523d2ce9cbd5f06dfad667100b1f0bde1dcf230fcb92


o 14.0-BETA2 powerpc64le GENERIC64LE:
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso) = 0b1818676eeb5840a2e1970cf1fb117cc5841d459aef04e364cf44f41cc389a6876be4d7d84e5e11665bd42c4aa45a9542deffa0896c136473022936fa95ba93
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = 2eaf99a9620522f497be95c7bfaad570e2edc45107b690859517fa929852cf40183b93a8a43dbd0784cd947b05930c0b4d4cf4219488b03fb76fc578e40fd863
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso) = cd1c534dd600661b2fb3ccbf06b28eec88b920a16933268a5b9f7a5e9788b5fd66e9fa32c919cdfb9eba62cc2dd6cec31dcf0349e5f2aebb8382a2d20116a5a7
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 5b313b5fa99530ea0969aa65152ed2d0a88b999c70e9e1ae753f0c967828df1c01935b4d03d14bde7659f9d8285903b499d2459e40c71eca76252dd6748b6155

  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso) = 600b43c075fbd8227a952f00d71f000b378f250601396e263c199feccace5931
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-bootonly.iso.xz) = dbd1337a4c5840f6ad1b332138fb0c735f7e5160c0bbd4b678e3462c872c9601
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso) = bcc6131731ab355a76f95ed52f17883ecd6a28358f2ec2587d9ec385b20360ed
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpc64le-disc1.iso.xz) = 901b48c2c850ed6688224129d0dfe3470f0fc86a24bdf8cafb6b04cc8e775ffc


o 14.0-BETA2 powerpcspe MPC85XXSPE:
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso) = 9d66beed15be6c9846dbcfab56110dec30f6f3697751954f11f955669e6c0fe35a048f0095f65c2c2f73b26bde00efca809611c8ab1fc09bf245a9cac8578c63
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = 7e766c11a936a924082637e96897dff7979f15ca59e718453a0d414ffffd63f797aa43d59e8347cac5198b7ec81ff41bb7f734e789e933956e7b81e0fba17696
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso) = 0ad6c3fe818e2769b132bc65a4c2b660e02ace292a914c8aabeb920d52fb246be27cf7033cc65723d7f7a4b008678b7a603a2aea4272cbee5167bf45a94b19e2
  SHA512 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso.xz) = b7193ae73a745e17f450be4c943a15491922ee85a755ec552b9bbe3bb7881f9c4a562dd3149c139daa2fafc6cffebfcbc25b4ebb801b722d668b1503b87072d9

  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso) = 3d507e9f33cb208c26c9e7423f02d7114a739855d9823d6c0da4fc806f434fc4
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-bootonly.iso.xz) = 31d5edee57ef286058fdeae793d4dd04442313837bc5f3bf6a68f29361e43d4d
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso) = 73fd26fdee8f4e538071ddb4ecbaad25dc56b5b470b6d49c8977efddf3703ef3
  SHA256 (FreeBSD-14.0-BETA2-powerpc-powerpcspe-disc1.iso.xz) = 5852d9c53647a9a7fa2a2ca04bf3cefb35797ab5cf4b7a9c28116be1c9e7b080


o 14.0-BETA2 armv7 GENERICSD:
  SHA512 (FreeBSD-14.0-BETA2-arm-armv7-GENERICSD.img.xz) = 32945a2f101db27fac609479a68d48ab475529ba529cdfa7f775373d9dae050335b27501b2911470ea027df2c9648258a223e5ecea2db8d2f0e70c3f874165e1

  SHA256 (FreeBSD-14.0-BETA2-arm-armv7-GENERICSD.img.xz) = 3ce32c7d08212dd59677f3c67b394bf52a872dc371c8e1b719e83b4a3d302d77


o 14.0-BETA2 aarch64 GENERIC:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso) = 1b3267c31553a909aafc772e21b90e09da66af82352719b94f895f31f0b0b19be2cc58a1577f72d9e3b4552cc6aefdf12df6b9f96e68292d56de94a6c1132903
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso.xz) = 1dc0a9354cbb79d4af8de88c95d923ad5e0aa6b700feeb5d6c4f5b8baf572cef066acbe2e8fd51bb36edfe4906e554aba4e86d7712b0e5a1b539b55dd5010a42
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso) = c4dc3cefe668654fa1d4454b5633fdaf26beedbcc15b316b55080039f9aac27ecb266f8ff24b0edd628de11fa765403f743cfa2d93c245d3ae86bdff10d14e3b
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso.xz) = 3cdde79fb1f8dac84fc1479c05f6bdef7fd51dc3982cfd8b7f388065c613b9a23acb52c21feac6d81769c69f11e125b6f44350fd30d2183c191e2ce4efb077d6
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso) = ce649d0f1db12d8dbf396972e6dbe34d7d07594cfaa83a1e4b7abc212458b73480cd6fbbd6714d92f013e3b90fe5049abcdccbbf8c7b349fa99fd047fef5f6ae
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso.xz) = ea8be16a9b8751814611441ec25cae7bd590bb6b44739c9e690bcee1432fd61d0b7f01197ff8067580d0861ff488979b83887e25c779559085c9dacd3d52fe29
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img) = fb3a22ac0007d3e404b6a3b6c6b44044be17bd6e14e9cf19c4f0eab0965fec4515da79b3ea6e360eae9c67472f9b39084817b1a45cc38f1cf6bf2d72556fb6f4
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img.xz) = 3faf083e54c77a3cabaa76e3a943f723d3f1d31a356b04b7d88370e1d51c712ffb82a642b2faa531fc03695f5104f0b8004804612554f91d22fda87c8bfd86ae
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img) = c0a2678ccff83ab8486fbbfa79d4f94575882d8a0d361dcbda7c9f150a8e3fe51585d58669ab742e9ca113d62a20f3ed37017da415a517751b15a7060e4b758e
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img.xz) = a9cfe49970477adb51cc7c8b20161dccc43662873f051541ca898087d148ac9cef2c8d10ff15b9d35fc836552a47384c32da99c0e70e19d2d1461313bc1cd26a

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso) = 5c4612ac675988b53cc813146f4b8bc5dca23d1c2ec0973a219764efdab6744c
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-bootonly.iso.xz) = 47ea5ade09cf3bd07f75e8d0358fbf044a940c127db242b54e25af21dcdc0929
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso) = 8bc09649f801b23b135979e39811fe3183b4727d94e0fd80a890c8560ff487b7
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-disc1.iso.xz) = b829b775a847daf298e90dd3e5eeafb91da1497b62fe0e1eb4ad5f5a2ec10a76
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso) = 63e0b73ad9b1d0f2ca1add081064a059db6fb483599e2d1a05dc9053e2f7ccad
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-dvd1.iso.xz) = 28b14ddd1a7ab0cd4d5a99c677fb6a528d0a92f5805c38f1c0e6377fe9a7fa85
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img) = a00a9a7f105574c42e102c2aeba294401ac1811fd28f9c760b60f2d1b94390ea
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-memstick.img.xz) = 9adcca1a46c0be99c2a336122e28b536f5e36dee4642834758a952038487e8f9
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img) = 26d909f2413514a939c0ed9d9d6dcbf6289ec3d8ad9ea5710a0277890ceb25de
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-mini-memstick.img.xz) = 7a7149ad3c208e0475570ddd5b830e62074c15118aa4eaaa8fa14df009502a7a


o 14.0-BETA2 aarch64 RPI:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-RPI.img.xz) = 38bcee5a3cbf10124107b097e7eb79eda0b7812a08b5941ee12e567d4c18be961e59e8dbcc8a102f585e2dffa82e8a714306e96fd3e0ec421f8f531eda01a2fd

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-RPI.img.xz) = 7283c7ad72620684aefce7521c3116304cf64f0312a4664cdf2e85e74c714d1b


o 14.0-BETA2 aarch64 PINE64:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64.img.xz) = d01eaaccb80b764582789cbaadff7d961c1ae2f93a5b8430b29c991ad9a7d0471453c23346e739df7fb05e2fc0d2e76e47032ba9f081d6270cb79cc713ee5126

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64.img.xz) = bacdaaf95689858580f0fbddb13d449b4f9a13fb0486408b2fe9e6cf9c13271d


o 14.0-BETA2 aarch64 PINE64-LTS:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = 9ad41edf92f702b42e2b2aef333fefc9a2ca3c2a2ccb869a39dc074743495693e75d6cb8d3c01124e99093685f2f5d9e0f0b199c05f3d7672665a00b0b067af2

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINE64-LTS.img.xz) = 5194879353ab2f8754310bb43d32420d0d502209a7987efa2636179aa9b40541


o 14.0-BETA2 aarch64 PINEBOOK:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-PINEBOOK.img.xz) = fcf8415e9ca8dded55ea75b99c3ab221cedba80bcf96099b90f466691fc20bfbf347d668bd0e0fe75852009ef70e21986ce1086ef42e7c7997e0220dba2c9485

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-PINEBOOK.img.xz) = 0c339a94addd82bbcf7533dba528457cfcfc5297b45ee32f84d1484540106702


o 14.0-BETA2 aarch64 ROCK64:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCK64.img.xz) = b8ccb3b3b41b3ca393c0ed4884a2a8902af041b187c0b73c82d58e1bfc06b9fd2b7185c28a7449133a6d69d0283df7eb7daf2f3a9e56330aa75debe3a3190ac3

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCK64.img.xz) = 5c5da293d5548d4e8fd475a03d03e2c66c870f167af69bc85ab8581a080d153c


o 14.0-BETA2 aarch64 ROCKPRO64:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = a5771cc04bbf3cf83059e7af1fbfec810b1d14f43a417cdaadf558ed10b7e1000e80ab6a93b44261030d0ed65825e62637987832af9c3c9acf5812072042f36d

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ROCKPRO64.img.xz) = 0b66603ca23509415eb35bb09dca1f589d5f1e25f1cb7282c5bfc3ea56077770


o 14.0-BETA2 riscv64 GENERIC:
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso) = 64bbadea7e515b8e2d2a9cb9a97607409c3275d39abc8b5ad868c46314501220391502796773338fdbed93af0d8837384c64e4f76f7f4a3b7d5cbc9a90fe92a1
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso.xz) = 1d3457623a3f7a76e38db6c4bf178a545d2e1c54dd81a60f152f0ad32644d68aab83657af892fa3dba68ca03b6bcf8d9a95f7f4047bcd60039ea1732437fe94b
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso) = 4a35e4e36eb4c1294f09a70910e3db60fae3bfc1b57784f64375d282f39a0ad84068d08bbde82128462ef5cd0fdc77362f19b3518597e1cd17bd145862b47a45
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso.xz) = ec99283100c191b861ad9ec731bc7a7664f899fea342f9cea402ae9cbe07c6b7e2b724a186f3b8789f116b93993ef5293e15a6e6c79e60a3295f674f3f565c10
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img) = 5788022ce8e7924f011d709d6598188ac7c96e3c9737990bd03a20d104e3207828e67e7cc435d13acb127035bfc3c49cca6715f92eb658ffd0f25b23ba259f85
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img.xz) = 250b01d3dc1b2f36aeb702022f27074b7e5e549c3998b015a30c7c36e2df4a3455b573ae962cf5ffbb22bfddcf41ee2aeebea34b2bd2b3a5ce1db711a7f8d4b3
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img) = 634d3463c227ad5679c2f402e9deb2e078e3c0b06f312da5584047329a56667b83ff4d3155bf68e41b1a34018a54de8f8a021bd6834224c0750451ac10de7eb4
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img.xz) = a8ee5c48e81ea003de93d71a9c3efdbb52e650b3ebcd92eb85bd4ff3682905f89732d05265d0487c19a335e145a90e2b8d3e23dd79ff8b8b64a3d926c6e881ab

  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso) = 27c82c435602fdc307fb4aed4680b17c483a3eca26e2f792f07a28ae6ef136ce
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-bootonly.iso.xz) = 2d9b44724e3c7613c90600e1d97189c3e6b80b03993192ed6975898c30f3e43c
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso) = a4d428e3ddbec40a84d6e20c18393b5fe8e5f371a13ad8079dfa89357f92f96b
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-disc1.iso.xz) = 92d4e12c0a753f3c3beb2dde3fe74cdf30770c1c927c021cb3d44a104f299e73
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img) = d15375ed4fbb7bcd7997e8ae314a2c957716c8c4b0fcb5ea3e02df1453ed7201
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-memstick.img.xz) = 310bbdd1f44c5b9c39ac7e56977d4a10dda7069b0561f408c5a4cb2e56e9eee6
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img) = 2e09cad2d24a57c39d308e5acc0515615371ad8e959c8f3739602d8a89dc7877
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-mini-memstick.img.xz) = ff51d5af63deb7f6a009558a3e11637dd64365301db2dedd94546de65682d5c0


o 14.0-BETA2 riscv64 GENERICSD:
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-GENERICSD.img.xz) = d11ac9fd563a74bc412814b0bbddc46545a76207dfc18eefe5f71a9f4989011d94471b8cf9e5759f81b2d4dab0139c537066a87222e2120cb85920689614be5d

  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-GENERICSD.img.xz) = 966a2c2408d89b8d7d93ad8711fbe766f14d7a2a21fda91e8f6b908d9edb3276


== VM IMAGE CHECKSUMS ==

o 14.0-BETA2 amd64:
  SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.qcow2.xz) = 2cd542fb62f02f9a394794c0dd98df8d73e3734f226e232aa85a9d79cc8c365e696f151e631caa2084e9f7d3b1fa2c1aa045ebb7e883b5082de7300fbfad907b
  SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.raw.xz) = 6ca883703eec62087b0034afe16c705af72403a2657b18f874a1120307b06aaba2fc432167e43535bf570d26f698724d66543bbc7276522f53fcf922165e7cfe
  SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.vhd.xz) = f710995e9513da403cf78f9eee0075d8ebd29e01831beefc45620a8674e543bd26e49ba2c4177b891e406fcb1cc042e834f202ef5f13eab18476663f945ba985
  SHA512 (FreeBSD-14.0-BETA2-amd64-ufs.vmdk.xz) = 5beb787da1b03913c39fd18fa44c889471485213e390f0107f0cbd7638a64ab403716592fc9dd9d6967845bbfc7803976c9466ff61e4aed41ef67532a7c67f4b
  SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.qcow2.xz) = fa11dcee9d3f8456f90becc76e8081bc03bcbc46855a326d95819527f3c891c440458f2a9e40dd17cc9316c014815f4c459a3a32e6c6aec9bae79c137fc29d5a
  SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.raw.xz) = 6800edc1a92088759dbd834129ad5b235d8d45124eee72dfe62be91497caa0d493ab76c8f9b81feea265672d4bc664a120b755ba5fd4a8dbd589d6765ec85978
  SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.vhd.xz) = 074838d9a6577d8e2d51f21fe753cebe9b505c48cfbe7e728776fc6d1891f481b0bf8b53f22890da339f6c957256bc61179d4aba1f3d9ebde95e7753437fdc9d
  SHA512 (FreeBSD-14.0-BETA2-amd64-zfs.vmdk.xz) = 0f4943a9047f8ddbb0a9522914e212ffad30c27f1d9633545292ae38136697dcd7260934b8e763f20ff31071a24d820efa6a1dad0fece0900dbd97008ed13d6b
  SHA512 (FreeBSD-14.0-BETA2-amd64.qcow2.xz) = 2cd542fb62f02f9a394794c0dd98df8d73e3734f226e232aa85a9d79cc8c365e696f151e631caa2084e9f7d3b1fa2c1aa045ebb7e883b5082de7300fbfad907b
  SHA512 (FreeBSD-14.0-BETA2-amd64.raw.xz) = 6ca883703eec62087b0034afe16c705af72403a2657b18f874a1120307b06aaba2fc432167e43535bf570d26f698724d66543bbc7276522f53fcf922165e7cfe
  SHA512 (FreeBSD-14.0-BETA2-amd64.vhd.xz) = f710995e9513da403cf78f9eee0075d8ebd29e01831beefc45620a8674e543bd26e49ba2c4177b891e406fcb1cc042e834f202ef5f13eab18476663f945ba985
  SHA512 (FreeBSD-14.0-BETA2-amd64.vmdk.xz) = 5beb787da1b03913c39fd18fa44c889471485213e390f0107f0cbd7638a64ab403716592fc9dd9d6967845bbfc7803976c9466ff61e4aed41ef67532a7c67f4b

  SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.qcow2.xz) = e09ab51f7e4d763a7eb1e8be6116599264708ce91f6c9482b8b47d4b8d637464
  SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.raw.xz) = aa6859412a993d9085bc10978f796e8d570cff6d34bc05784930069127a8010f
  SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.vhd.xz) = 2f66f81d29a8d3a827e3672ec61c63572c86519960e083dcab0da5c5f7d244f3
  SHA256 (FreeBSD-14.0-BETA2-amd64-ufs.vmdk.xz) = 508bb0c122fb642b33902ccda678b5dd25d1d60a4a15b2a53b029ec4e6146608
  SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.qcow2.xz) = 36d89448f4eb0ad533bb092d2e3ad4c55622e95e9e67f9761c038780450f1018
  SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.raw.xz) = 7838f1c56a86a280cd034c7417ba4ca3c87d46dfb3b212e1f36632978d6fcb78
  SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.vhd.xz) = 8f4d02a21ebcb5f931fd0ff87187568dd8c68ccd75d118ba184e5d12b5db8788
  SHA256 (FreeBSD-14.0-BETA2-amd64-zfs.vmdk.xz) = 898ec37563718967f4cd59ac6fbe802ba4a7f49fd6d7fa363ba1c7e7b98b17a8
  SHA256 (FreeBSD-14.0-BETA2-amd64.qcow2.xz) = e09ab51f7e4d763a7eb1e8be6116599264708ce91f6c9482b8b47d4b8d637464
  SHA256 (FreeBSD-14.0-BETA2-amd64.raw.xz) = aa6859412a993d9085bc10978f796e8d570cff6d34bc05784930069127a8010f
  SHA256 (FreeBSD-14.0-BETA2-amd64.vhd.xz) = 2f66f81d29a8d3a827e3672ec61c63572c86519960e083dcab0da5c5f7d244f3
  SHA256 (FreeBSD-14.0-BETA2-amd64.vmdk.xz) = 508bb0c122fb642b33902ccda678b5dd25d1d60a4a15b2a53b029ec4e6146608


o 14.0-BETA2 i386:
  SHA512 (FreeBSD-14.0-BETA2-i386-ufs.qcow2.xz) = 23764bbaf8f07274ed119d87d47707454abed2d1ea01ea824ded042a8ab6af32103074982538e6910fe84eaa5b7545150ac9cf4cfcc2ac2a277e35e2e62cccdc
  SHA512 (FreeBSD-14.0-BETA2-i386-ufs.raw.xz) = e302a3d96c124bdd5eec30699efe9e1e7727b1ef573dc7ef365d63fef6026bae7530b32511672b629164255937566de8296f4f136bf6e8a7bfd5a3907de2b98d
  SHA512 (FreeBSD-14.0-BETA2-i386-ufs.vhd.xz) = f0b4c13e7937db273827837b86079b6c22ffa03ed8ff3b76f25ec480a970f3227b71c5b86aa2fbbdc23f7135b564b9ec8e986994847985ca5f0b53ad20d305a7
  SHA512 (FreeBSD-14.0-BETA2-i386-ufs.vmdk.xz) = 8306c5327fb088783e9c53836327c2510faf472ce6894d118da7577a4efd9c163627b94910c4395d680f7134b89ad2bdea33e560a984dbaae654f2f58a4c5672
  SHA512 (FreeBSD-14.0-BETA2-i386-zfs.qcow2.xz) = 78ca4d28a9e826e4bd93a1fd966785b122115d5259336fc8a43ca96564b2ae5b3ae5c85e73bd56fa510050d8f569047030b5107549bed2601bf4a3c9f7d207c6
  SHA512 (FreeBSD-14.0-BETA2-i386-zfs.raw.xz) = 80d4ad71074a3e4346a0d890555217f3689708dfb042c7832ab9e65ae358618eb5cf176ca16c7671fdc10882ae8fd258a20af516c8a5c2807976e2d96c4fc04a
  SHA512 (FreeBSD-14.0-BETA2-i386-zfs.vhd.xz) = 19969317bb51388de333478a786a9d1d048c9cfd39118af437cad64366493bfff123105abf1b8d5d79b3732218b70beb32ccbb67181be7318b4d49301e77a796
  SHA512 (FreeBSD-14.0-BETA2-i386-zfs.vmdk.xz) = f9062710491dea8e73f3ba476841f36ae68f5c6888bcc2965b0dc89fd6db1ea641c1a810193a8fdc2b0b604575b37bcf6728868c53131e9c5fa3cdff70332220
  SHA512 (FreeBSD-14.0-BETA2-i386.qcow2.xz) = 23764bbaf8f07274ed119d87d47707454abed2d1ea01ea824ded042a8ab6af32103074982538e6910fe84eaa5b7545150ac9cf4cfcc2ac2a277e35e2e62cccdc
  SHA512 (FreeBSD-14.0-BETA2-i386.raw.xz) = e302a3d96c124bdd5eec30699efe9e1e7727b1ef573dc7ef365d63fef6026bae7530b32511672b629164255937566de8296f4f136bf6e8a7bfd5a3907de2b98d
  SHA512 (FreeBSD-14.0-BETA2-i386.vhd.xz) = f0b4c13e7937db273827837b86079b6c22ffa03ed8ff3b76f25ec480a970f3227b71c5b86aa2fbbdc23f7135b564b9ec8e986994847985ca5f0b53ad20d305a7
  SHA512 (FreeBSD-14.0-BETA2-i386.vmdk.xz) = 8306c5327fb088783e9c53836327c2510faf472ce6894d118da7577a4efd9c163627b94910c4395d680f7134b89ad2bdea33e560a984dbaae654f2f58a4c5672

  SHA256 (FreeBSD-14.0-BETA2-i386-ufs.qcow2.xz) = e346364bc5cb0391c49b6825fb180124965cd3574bbe4c87ad70bef31cc01661
  SHA256 (FreeBSD-14.0-BETA2-i386-ufs.raw.xz) = ce7535519051e10ca48077c9ef41000640c365f6dcb09f4fa4b2669771f66b0f
  SHA256 (FreeBSD-14.0-BETA2-i386-ufs.vhd.xz) = c95ac0f87962d5932af5b7e718adbf1356387bc4a40fcaebc3899366383a5cc7
  SHA256 (FreeBSD-14.0-BETA2-i386-ufs.vmdk.xz) = 62492a41cb28457b2d7faee833a7ad9f6b11024cb14afc5183bf50de58d5b13b
  SHA256 (FreeBSD-14.0-BETA2-i386-zfs.qcow2.xz) = 180b39b8e5cc11e9f1d2cd13a637ded0156a82fd068debb9ca1f9ac762b4cdcb
  SHA256 (FreeBSD-14.0-BETA2-i386-zfs.raw.xz) = ec6ecb9a10e87e172ce05941307bef54ba38949d832bb887fea5681a2e356043
  SHA256 (FreeBSD-14.0-BETA2-i386-zfs.vhd.xz) = f33cbadba5ff120a1f9d70a1eb08a87ab04ae90ae2461c92c7ad349d1760be43
  SHA256 (FreeBSD-14.0-BETA2-i386-zfs.vmdk.xz) = 4bd6fe1b59801a69a120870888ce45abd96f59260b905c521b622cc343626489
  SHA256 (FreeBSD-14.0-BETA2-i386.qcow2.xz) = e346364bc5cb0391c49b6825fb180124965cd3574bbe4c87ad70bef31cc01661
  SHA256 (FreeBSD-14.0-BETA2-i386.raw.xz) = ce7535519051e10ca48077c9ef41000640c365f6dcb09f4fa4b2669771f66b0f
  SHA256 (FreeBSD-14.0-BETA2-i386.vhd.xz) = c95ac0f87962d5932af5b7e718adbf1356387bc4a40fcaebc3899366383a5cc7
  SHA256 (FreeBSD-14.0-BETA2-i386.vmdk.xz) = 62492a41cb28457b2d7faee833a7ad9f6b11024cb14afc5183bf50de58d5b13b


o 14.0-BETA2 aarch64:
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.qcow2.xz) = 00bf4bc2e63eabbfaa83f98e24e91344bc542c14721fbc194a43a12d6ac4d53aa3fd3e3274dbac7800d3a6c99877eb8bbdec8e38b66aaee14860babf6105d48f
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.raw.xz) = 25875161bf0e6a0532bd176aa06340dedefb6679bfb5509dc2980a46b3ec230ed0cbfb814b3cfbb6108b0e9164e981c90290a3eab6c026b8f9ee7e3a57cc7f12
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vhd.xz) = 359859524348a2cb2887c51ffb1a3a12567f2acfbb045708cf73fc08d7b2e2bc1b3a70d94aa17f3589c2b2831e94eda8684d09a3057d3420a1c7b896aa5532d5
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vmdk.xz) = 5f909b37809614b8dda0b9f4f18148c744f3d27f4bff4bb7a164d08237ac6181018f235d53eafdf32cdc480843e35174a22cc7cc4823b4341090badc74510858
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.qcow2.xz) = 1121a62164a087f7ed397a5c2817322fe8082a2fea514c0f6079b422220d360e03f5d05566a2c407c0ed23fc16ccd646b8947d3856799c260446a70086d085de
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.raw.xz) = 368d7af537e2e21b7cc7b563a9645524eed9ce9486a2356ccc28e52c65e331f8243c2739ba73f6c407a8753de04953f514531cd1b04059256273d5d79085f0de
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vhd.xz) = b16efe94c68117ed5dc9526f1b1b6532eb70989e1a2a70bbb043e3d6751058bf510365519b462c7945767ddf2c33f279d2cb1bf4cfbbb78c7276bf6971880da2
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vmdk.xz) = 9a77119dd9aa2af63b4f5328cf8ac6f71a3a7434ad3f5480e972c8b80c50e4a5da86ab00730bd30c964056a4b1b355b123725266e383f1d20bee17c02fef0e83
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.qcow2.xz) = 00bf4bc2e63eabbfaa83f98e24e91344bc542c14721fbc194a43a12d6ac4d53aa3fd3e3274dbac7800d3a6c99877eb8bbdec8e38b66aaee14860babf6105d48f
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.raw.xz) = 25875161bf0e6a0532bd176aa06340dedefb6679bfb5509dc2980a46b3ec230ed0cbfb814b3cfbb6108b0e9164e981c90290a3eab6c026b8f9ee7e3a57cc7f12
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.vhd.xz) = 359859524348a2cb2887c51ffb1a3a12567f2acfbb045708cf73fc08d7b2e2bc1b3a70d94aa17f3589c2b2831e94eda8684d09a3057d3420a1c7b896aa5532d5
  SHA512 (FreeBSD-14.0-BETA2-arm64-aarch64.vmdk.xz) = 5f909b37809614b8dda0b9f4f18148c744f3d27f4bff4bb7a164d08237ac6181018f235d53eafdf32cdc480843e35174a22cc7cc4823b4341090badc74510858

  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.qcow2.xz) = 55e68fea7daff5ec916fc49ebbe7854abbe35f10aeded0a4f28ee0be871e442e
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.raw.xz) = 09ba9e5af71d4db4fae77a3e4ba6b8281bd188a24229164a11476c1efc8dbe02
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vhd.xz) = f59b4a83f11fa849032e9c9b1eee63d5f77d4ff04ea0eb09e4367b0438f0fdd3
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-ufs.vmdk.xz) = 1acd0857ec7b97382efa85994aa4fe4bdabecf641d5f9d42950fd52cb74da6d6
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.qcow2.xz) = eedf5851de047dcd959adac2736e503039a65cf555c4bdae39ea8b9a4a5e0444
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.raw.xz) = 2146d88aaaa98bbfc838f24fa9057e4adf0a1da54eab53c883fbce7028441afe
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vhd.xz) = 7e819d385cc077142f4019b6fe20413a877e32977828ea932296149dbd3f7a69
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64-zfs.vmdk.xz) = 1bd1d344d2d95827a38eb4a942f560639d5c1c73ae6afd2f66fa3197e35b911b
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.qcow2.xz) = 55e68fea7daff5ec916fc49ebbe7854abbe35f10aeded0a4f28ee0be871e442e
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.raw.xz) = 09ba9e5af71d4db4fae77a3e4ba6b8281bd188a24229164a11476c1efc8dbe02
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.vhd.xz) = f59b4a83f11fa849032e9c9b1eee63d5f77d4ff04ea0eb09e4367b0438f0fdd3
  SHA256 (FreeBSD-14.0-BETA2-arm64-aarch64.vmdk.xz) = 1acd0857ec7b97382efa85994aa4fe4bdabecf641d5f9d42950fd52cb74da6d6


o 14.0-BETA2 riscv64:
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.qcow2.xz) = 530c1ce40e81eade8ffe19bfd5c3761f0fb9b5ef9f4f618489bb0450b116dcf984a7fea75059565a6d534cc98aa7154c6b783683faaccb226050d53ca679b97e
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.raw.xz) = 4d62be9167dda86ad2b0341ddf68ee151ac3f1a007be7fc29f9f2575d2962f01934edea2bf3ca3f2f827082272bab73dfa11db58ca735363df5e689c7031f4da
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vhd.xz) = 56cb81bd589a41140100c099f62a084ab7943958ce7d7178b8753b2495dd275a6d263a6e56ea0cef86647fc802dca69d523158f17f3179e2756e3856eb8683f5
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vmdk.xz) = 60e4b040af68e07e476658745196ab3eace5f30929728ee7f87dc4b3ce5964e052e7a413eca28b9c4e88c8662ffbaee871b7302bafe7199ad0b9f084349d0572
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.qcow2.xz) = 42356be29d964ce06dec37fe6b96a046f6ca18efd1dff2746ec5503936b5c5ace28aa7ac86afb9763553fbddd7de386662417036260f3601c3af6df2ef41f89b
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.raw.xz) = 873482fc4144bb2814483ade5f0339618110ad295ee1bec4a3863decf97fb41ba384e7a33a7033a45db99dca8aa9e2f57f72435fcb9b8ffe85e4736ad4473160
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vhd.xz) = d37e44fc4ba899db3f41450b1c4a78e2834882d32a6d3f7ae8d9b032fe021e1faacfd9f99ecaa18e1ec4d806914a90efa2d42db741df8bb662800dc408fa8db0
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vmdk.xz) = 4d4660deec67ede3dbdcf57ae228243542f1d7c138e4551acd55873b4feaaf21c1f1d3363eda093061c27aaf00c24d4bb436932617225463068fd723327485f2
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.qcow2.xz) = 530c1ce40e81eade8ffe19bfd5c3761f0fb9b5ef9f4f618489bb0450b116dcf984a7fea75059565a6d534cc98aa7154c6b783683faaccb226050d53ca679b97e
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.raw.xz) = 4d62be9167dda86ad2b0341ddf68ee151ac3f1a007be7fc29f9f2575d2962f01934edea2bf3ca3f2f827082272bab73dfa11db58ca735363df5e689c7031f4da
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.vhd.xz) = 56cb81bd589a41140100c099f62a084ab7943958ce7d7178b8753b2495dd275a6d263a6e56ea0cef86647fc802dca69d523158f17f3179e2756e3856eb8683f5
  SHA512 (FreeBSD-14.0-BETA2-riscv-riscv64.vmdk.xz) = 60e4b040af68e07e476658745196ab3eace5f30929728ee7f87dc4b3ce5964e052e7a413eca28b9c4e88c8662ffbaee871b7302bafe7199ad0b9f084349d0572

  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.qcow2.xz) = 7afc20d01c355864c7980a65345d5ef0f2c9821341ef673aba8fe7ef86280c79
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.raw.xz) = 86cc5805c3c2490e042d6c26f81782cb396b39d4a64bea3868acd9d2de2bfda4
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vhd.xz) = 8d9aa4cae43527393fa4d410a9be642cd9026cf1b4f319a170c5c83b92372cae
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-ufs.vmdk.xz) = 077013f930b844ef7386ecd775f20f7563ef028be0e1202eea17101ea8bbfa78
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.qcow2.xz) = c519957239f7fbe40ab9e4b192e36416431d8747599227c0995f3bb5bfa5acac
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.raw.xz) = 13b8492fcb524c3ba3f88a62b61a122f4c390436de791504d8a8280f9386b663
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vhd.xz) = 5d57379dc82cc338ef6961281972be2833716d21598bc4f791457ba81df82876
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64-zfs.vmdk.xz) = 56947a7aeba70ea15b92c8201a4528382df4ba08209aaf0614631e661701e4c8
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.qcow2.xz) = 7afc20d01c355864c7980a65345d5ef0f2c9821341ef673aba8fe7ef86280c79
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.raw.xz) = 86cc5805c3c2490e042d6c26f81782cb396b39d4a64bea3868acd9d2de2bfda4
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.vhd.xz) = 8d9aa4cae43527393fa4d410a9be642cd9026cf1b4f319a170c5c83b92372cae
  SHA256 (FreeBSD-14.0-BETA2-riscv-riscv64.vmdk.xz) = 077013f930b844ef7386ecd775f20f7563ef028be0e1202eea17101ea8bbfa78


o 14.0-BETA2 amd64 BASIC-CI:
  SHA512 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = 4a4fb9b68b1417c20b125d46e4cb2ef5d999b3e0babf351230dc253ec8d60bb1dfab899f97d42b137254f53367d2d04ec191b152110897a9b8407b52352a339a

  SHA256 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = c8f74db4180477967f7ef86d1a05c904195872532df49c3138cb9df1af2def4c

Regards,

Glen

Please consider donating to help support my FreeBSD work:
https://www.gofundme.com/f/gjbbsd
https://paypal.me/gjbbsd

Love FreeBSD?  Support this and future releases with a donation to
the FreeBSD Foundation!  https://www.freebsdfoundation.org/donate/

-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUE9q8ACgkQAxRYpUeP
4pMkzBAAktkgk+iDikgm7dSEmxv5QfNrXn/WfJFAtlh9OmuRrvkZVmhP42zQ1NfM
hbXJK1QIRLNuqfBgD6JNa+q2mItvnELNfSr7iHKdVwckriKuxs1MRGkGJR4uOwxj
SrO2QbBeIY2gn6P1qlairiwg8fikgvUx3B3j9WdpGDejV6J4caeq8kS4HF8y4KCm
/wifyBNWQu58fCda2A5fCRjRuPGC4LyRWNwoStbbjGoeI8+hZXiotD9prK7R/sMp
qQ6B9NaIB11REwuzP4/YgbCJuXk1dYTnBDXS3rsKTj9hTDIwo7lqpDzHCPxvNBho
Zi9d/NTCz7JB+AUeBtVK7cmHrCN2l7Qp4GQ2bsd4qEm/YkRK/s0k2Xi5TuQ2II/E
RlIOOAP2xc9doWhNTIxOg5W1EtLjsuKFqevijc6DP2XCs3RI9/exqYgs9NWfp6kD
FLMVSUODMWQIKrbgIbEIICLNsLW6RVh64IUwwcvjNzVBTuPIBcaRqhQMuyBi3Pnu
eCGphLKLkfS8vUQKbSm3f35hxvZTdVV4iDFsp+F5rL1pLj7L5AKo6L7q71fwEenJ
S9ajicIOrgR5UcycvF2v2sryGoPRG+oz0R4WVm3iMxuqb7VONPMK3orcxmi08ItF
HZwIblvRWLVrOXShplsuEeFgaTZOkBzH9Rx9SafZiH1lfBNiM1w=
=wCQk
-----END PGP SIGNATURE-----

From nobody Sat Sep 16 05:25:14 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnfdp5Sgdz4t3vp;
	Sat, 16 Sep 2023 05:25:18 +0000 (UTC)
	(envelope-from grahamperrin@gmail.com)
Received: from mail-ej1-x62a.google.com (mail-ej1-x62a.google.com [IPv6:2a00:1450:4864:20::62a])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnfdn5J2Tz3G5G;
	Sat, 16 Sep 2023 05:25:17 +0000 (UTC)
	(envelope-from grahamperrin@gmail.com)
Authentication-Results: mx1.freebsd.org;
	dkim=pass header.d=gmail.com header.s=20230601 header.b="cpRUukU/";
	spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::62a as permitted sender) smtp.mailfrom=grahamperrin@gmail.com;
	dmarc=pass (policy=none) header.from=gmail.com
Received: by mail-ej1-x62a.google.com with SMTP id a640c23a62f3a-99c3c8adb27so357783466b.1;
        Fri, 15 Sep 2023 22:25:17 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20230601; t=1694841916; x=1695446716; darn=freebsd.org;
        h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to
         :content-language:user-agent:mime-version:date:message-id:from:to:cc
         :subject:date:message-id:reply-to;
        bh=BBYsQ7EMpknNBljIkOg0VXbOMa7Ec4WJbpq0L+r91lQ=;
        b=cpRUukU/sFnELkfiCdnDz8tzFFO85kmUo6eE9nnoi+S6prcawX6ODk87w4MO3yFp/L
         tOtyBZavCy9SbwBkGJpQNZYOLPrqSHB9DtBHZjRX6fy2sQmggyR03wZ32DiV2/FxSkn4
         ElU0L2QfpHQzLd6IwUOIA7uli6jWsu9jyfljl1g4ZMo6jQt+DRs5SibrSZgfW41h46Ca
         d7gBRlAlSUleCr7mmg0z/Omf6E9prdG4fC8upJctku9o0IERRvHea0ZLBYcxyAIDsWPq
         YGQMq1ynYav81cTfcJAKWQE3pR2GtEbmN7gDrQW+Pqu+MMu5LQOVriKh2QuGoQpd04j8
         x84w==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20230601; t=1694841916; x=1695446716;
        h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to
         :content-language:user-agent:mime-version:date:message-id
         :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
        bh=BBYsQ7EMpknNBljIkOg0VXbOMa7Ec4WJbpq0L+r91lQ=;
        b=guK/1bjh1hRkE+x22MmEQvDXWS01iUBRZz0MZlQI645vdKlHMVLLgxj4BsArjikthP
         SmTx9aZwTeopTjFH+HgSbRKtNtdlyJyUN3IQf7/cGUkxO2Hc1axlzY/rK95Wt9tHdoI2
         FUzPaXgcf+MNXBJAOmq2yu5oaQGrAw73eN1zljg7/9ol95eaKqL9dC/G77hXfMIjtWPD
         lrLg1AX50yX2aRqKiCQDCCJ48z0pQY8wlyY6oPtV77jUQgIIfTGMTkrk6EJXX/uWrSL4
         HkvmRLb05rnOYMHPWso1nHZoy6FhDP+gQ0Z/WHFgTmfe8LgFHRVmP5OIv79Qmbl0FfhJ
         Gvpg==
X-Gm-Message-State: AOJu0YwwuPgKZw9QF8AlgUUgYuWcvZ5JHKOiFcXYIjQcHAaq42petKZB
	Q8xqCUxrFJSmP0BNimmz0zXgPgh4r9w=
X-Google-Smtp-Source: AGHT+IFOFNPHFUIiFrrFAi/iCXIqJJxlF39ywwpoG5dVVLczxvcENTEeI2gfWPe5Jx7teLdCh2AC1Q==
X-Received: by 2002:a17:906:8a76:b0:9a2:86b:bb18 with SMTP id hy22-20020a1709068a7600b009a2086bbb18mr2930484ejc.26.1694841915885;
        Fri, 15 Sep 2023 22:25:15 -0700 (PDT)
Received: from [192.168.1.6] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93])
        by smtp.gmail.com with ESMTPSA id z21-20020a170906241500b0099b76c3041csm3278797eja.7.2023.09.15.22.25.15
        (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
        Fri, 15 Sep 2023 22:25:15 -0700 (PDT)
Message-ID: <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com>
Date: Sat, 16 Sep 2023 06:25:14 +0100
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101
 Thunderbird/102.15.0
Content-Language: en-US
To: freebsd-current@freebsd.org
Cc: freebsd-stable@freebsd.org
References: <20230916002831.GU52318@FreeBSD.org>
From: Graham Perrin 
Subject: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available)
In-Reply-To: <20230916002831.GU52318@FreeBSD.org>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spamd-Bar: ---
X-Spamd-Result: default: False [-4.00 / 15.00];
	NEURAL_HAM_LONG(-1.00)[-1.000];
	NEURAL_HAM_MEDIUM(-1.00)[-1.000];
	NEURAL_HAM_SHORT(-1.00)[-1.000];
	DMARC_POLICY_ALLOW(-0.50)[gmail.com,none];
	R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36];
	R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601];
	MIME_GOOD(-0.10)[text/plain];
	FREEFALL_USER(0.00)[grahamperrin];
	FROM_HAS_DN(0.00)[];
	RCVD_VIA_SMTP_AUTH(0.00)[];
	TO_MATCH_ENVRCPT_ALL(0.00)[];
	ARC_NA(0.00)[];
	RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::62a:from];
	DWL_DNSWL_NONE(0.00)[gmail.com:dkim];
	ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US];
	MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org];
	DKIM_TRACE(0.00)[gmail.com:+];
	TO_DN_NONE(0.00)[];
	FREEMAIL_FROM(0.00)[gmail.com];
	MID_RHS_MATCH_FROM(0.00)[];
	RCPT_COUNT_TWO(0.00)[2];
	RCVD_TLS_LAST(0.00)[];
	FROM_EQ_ENVFROM(0.00)[];
	FREEMAIL_ENVFROM(0.00)[gmail.com];
	MIME_TRACE(0.00)[0:+];
	RCVD_COUNT_TWO(0.00)[2]
X-Rspamd-Queue-Id: 4Rnfdn5J2Tz3G5G

On 16/09/2023 01:28, Glen Barber wrote:
> o A fix for the ZFS block_cloning feature has been implemented.

Thanks

I see 
, 
with 
 
in stable/14.

As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT 
n265350-72d97e1dd9cc): should we assume that additional fixes, not 
necessarily in time for 14.0-RELEASE, will be required before 
vfs.zfs.bclone_enabled can default to 1?


From nobody Sat Sep 16 11:47:21 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rnq703NHQz4sTSd
	for ; Sat, 16 Sep 2023 11:47:40 +0000 (UTC)
	(envelope-from jrm@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R3" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4Rnq702rQhz3QkJ;
	Sat, 16 Sep 2023 11:47:40 +0000 (UTC)
	(envelope-from jrm@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1694864860;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=gMJEIx+zDeUfqP3BGdpyu0zdit11a6Kr0mRBVXkIgDs=;
	b=qCQtBI6PyMW12wfTNRy0kEPSgwN3rXj4Q9jLnmacJc76Hi+jiOL5NrJcLCmszsE0NK7MM5
	08jAKSwit9maF/XrxSIJrXg3DSZ1g3jjvA2UmaIxA/wF1A2z5wk2tW2Jkry/Bdu5Kp9SVN
	COvrsPKlHs26GqjaBA9RU2SRnyZw5xXzy9KOSpuE6pDLh8swIDDNr57mobqs/B3ftu1FUO
	wD14sc0/1g/0jtMuHZyhSgYOyuc2WxPww63yr2W9LLbgDEfCg5AGjQj/toZKNdv0CvMqRA
	Uom+6dlNgCo+9pMlgTLL/gySXzNL+dLZop/zdXz2RUxBbw/2Zh2MfRqB16heMw==
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1694864860; a=rsa-sha256; cv=none;
	b=i6a6qCWISx8V96VUzqVoP4YUjl5FQim/JlLG13PuHYaZJn14sR/a7MfRGazf7r6sxn/Wsd
	IhiqMbcU1TuPx8HfhDfmV+Jd15Kq8eTmAUqWkihOCzmqVwjVpAhvbPVU6zeLHVQ8UW3Kqc
	Iu5SEVPMyrKj6onAnSzFcVWfdjH3rB1y0lTTQwq+CeVvM2r6RIua3uTBCglYzXG8MbPdIZ
	9qSqIIaIHoUGjNnX1P0psTZgHIPBR9byFjYqqSummENyyx6b5nOlsLypZFvy9JbgF0rDXd
	I/vCHbg7UX6LX7dQsnFMgaTOpB5T7HYhTeKJ0Pq9HFMxTwRpWi7fd+zCEBqq2A==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1694864860;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=gMJEIx+zDeUfqP3BGdpyu0zdit11a6Kr0mRBVXkIgDs=;
	b=Ua0Bu6C9y6o+Q0Ht3FBTMfFhk0XXOkkolbn8Qdj8m461JPlo1ip8HxOvpXLYLMF6iCZSmv
	Db8d+qnmrHG6hMGgyJK0XfAkO4vfKjK5ciLyO9EATVsM7d1441O05mlPVG6qHvkP2/zkC7
	+iCKRklF3/Ex4A99+datGskIlDO0vBJI/4m3UyYv6Bn3VHomGxhBHd9cPzUX2L8usRoVDz
	kP4T2ffleABoB3FG6jnXbj9RexU3RRYOL5DOyKaNS71OSqM/Yg0cdrZvEUAxBgBJgRmqqG
	w9JNixh3tnVVoq06EJ8d0p6rkC+Rzl0yuHEWbG0o1OMLRIg4uzI4PwkeSyfatA==
Received: from phe.ftfl.ca.ftfl.ca (unknown [193.137.208.100])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(Client did not present a certificate)
	(Authenticated sender: jrm/mail)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rnq6z3zlsz1JqJ;
	Sat, 16 Sep 2023 11:47:39 +0000 (UTC)
	(envelope-from jrm@freebsd.org)
From: Joseph Mingrone 
To: mike tancsa 
Cc: Dag-Erling =?utf-8?Q?Sm=C3=B8rgrav?= ,  FreeBSD-STABLE
 Mailing List
 
Subject: Re: tcpdump and timezone mismatch (STABLE 14 vs STABLE 13)
In-Reply-To: <6fdc941a-49cd-49ec-8c4e-43b393956580@sentex.net> (mike tancsa's
	message of "Fri, 15 Sep 2023 16:16:03 -0400")
References: 
	<86edj0pjjs.fsf@ltc.des.no>
	
	<86a5topio1.fsf@ltc.des.no>
	<33bc21be-d637-4413-88d1-c388a76a25b2@sentex.net>
	<6fdc941a-49cd-49ec-8c4e-43b393956580@sentex.net>
Date: Sat, 16 Sep 2023 12:47:21 +0100
Message-ID: <86ttru49x2.fsf@phe.ftfl.ca>
User-Agent: Gnus/5.13 (Gnus v5.13)
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
	micalg=pgp-sha512; protocol="application/pgp-signature"

--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

On Fri, 2023-09-15 at 16:16, mike tancsa  wrote:

> On 9/14/2023 7:55 PM, mike tancsa wrote:
>> On 9/14/2023 5:08 PM, Dag-Erling Sm=C3=B8rgrav wrote:
>>> mike tancsa  writes:
>>>> Should open a PR about this ?
>>> Feel free to open a PR, I already cc:ed the maintainer (jrm@).

>> Thanks, I have submitted

>> https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D273807

> Not sure if I should open one for the port, but it too has the same issue

Hi Mike,

I submitted a review to patch the port.

https://reviews.freebsd.org/D41886

Joe

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQKkBAEBCgCOFiEEVbCTpybDiFVxIrrVNqQMg7DW754FAmUFlctfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDU1
QjA5M0E3MjZDMzg4NTU3MTIyQkFENTM2QTQwQzgzQjBENkVGOUUQHGpybUBmcmVl
YnNkLm9yZwAKCRA2pAyDsNbvnkwqD/9IJONDiQvVxT5u+o4Zj1/h68f/Ftolkt6D
UbKHH1JdCuFMx+TfvHsyAARkR9hHma3XXWW2YsZdPO2dqan5IKNL4dC02r6FWAIY
QPfA9rTWO/NL6bgWuJCumTmJPKQydqtSMwuaxdaMid9/u3Gg7HINO6FamUvmAjMu
n7h/OXFUi9vN0j82t/1sCLbSch6CY6sxzTgxl1XoILblGkvrp8CfRUYIshWuajxn
Qdy3KJY2l4/OAtV+ogBik4dWhQ6OA7/UJdeevN33q10TXI5gqsD/xNrufDDq59Lq
Nx9sCbrr/sCeS/6RiNTBtSl0VDCYTWf63erKTdENKcb4keXHH/9yyYbznKfFuTd9
+fjq+kxOizYFT5LB8QB799EtomclBXU7nSSCFJibEJ7iQkMf1mR58iEoOyr6XyHz
fNWy3QOap+dd12VSq93m2ytyDLoQoy8imUQzvtOQ5kOyTrC/crOe6P15pUFIVDWd
V6WvSqMMrBVRxdicJR7yqTodndUK/ElTKGnyXgji8ZRKk5QJ/IK8QRL572qX89+w
Iyf0tSma9XIeP2uB8l4NwKpZy0E7iNS/JRmmI374einyXWITVh+VGk+Ydq9jLpzt
OmGFauwFnPb42xv0oQTCOsLmUYIAeADg5gB7zdseBNJbtWnIbJSaZo5sgAj9jewA
UM4PQ33oow==
=ab02
-----END PGP SIGNATURE-----
--=-=-=--

From nobody Sat Sep 16 17:14:09 2023
X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RnyNd4xp8z4sflS;
	Sat, 16 Sep 2023 17:14:57 +0000 (UTC)
	(envelope-from mavbsd@gmail.com)
Received: from mail-yw1-x1136.google.com (mail-yw1-x1136.google.com [IPv6:2607:f8b0:4864:20::1136])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4RnyNc44Jbz3Gqd;
	Sat, 16 Sep 2023 17:14:56 +0000 (UTC)
	(envelope-from mavbsd@gmail.com)
Authentication-Results: mx1.freebsd.org;
	none
Received: by mail-yw1-x1136.google.com with SMTP id 00721157ae682-59c0d002081so16054567b3.2;
        Sat, 16 Sep 2023 10:14:56 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20230601; t=1694884495; x=1695489295; darn=freebsd.org;
        h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to
         :content-language:user-agent:mime-version:date:message-id:sender
         :from:to:cc:subject:date:message-id:reply-to;
        bh=fQ9bOO3jPkXaUBACxHDOo6s968XDMr7hg5qMZ69kCA0=;
        b=GDFkTQsCPaymiOaZbQ8iFZBcBCEX7rNbNxIWr262srnHJU56+igse7+y9T5QuBVzoI
         lslEbaVjM9ea4IZKDxKEd0WxD41LvMP5W4zozEVqGj+AXiMlZNc8BfqM2R/EY7gWXZ40
         /xrnjY7YboCQpJ5/ihA9A04r3ThA3hrZPSXrQgPIltqkj1Uy1IuC5K+L5EirPOZmM/e6
         6G6fiOBTDroMMyePZXrpVMrgrwgMbIUGOwVwkKDlSDWsCAj2vt4RxKOTzo4ZvZXzSUpm
         DwNmsaM7SQSH9O8aW2HnFyzToyPcqLkdHOw1CtEWQRGx6NtbhT9Ir1DAVIvefg3rMyz/
         lnJA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20230601; t=1694884495; x=1695489295;
        h=content-transfer-encoding:in-reply-to:subject:from:references:cc:to
         :content-language:user-agent:mime-version:date:message-id:sender
         :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to;
        bh=fQ9bOO3jPkXaUBACxHDOo6s968XDMr7hg5qMZ69kCA0=;
        b=gkiTbWyX8p2PybPBEYaluwVaKRoicVVe1tTahDY9jaqBKXhNksU7GU43lsnPLQf9lI
         lvb9JErNy03yOefv3En8/nx95HO5GCBHn5VMfYlcZOCKvtzjMYWXRNOCYWtGHPu1qemu
         dzJJoaF5ga5BEo5DvpJq8QAqDyIKnkCp/f4dsKo/INLm3bXhssGHQfxis56Qw5xvxV9j
         U5Nxw13OLmY50vB9t150+5cfFLbWwi3WloI0S5G87ljZbv9DRhjeU2SqnH2JQf+w0s8Y
         YUNIGQVhKTu1nWHSXhhdc1RR0PPb2EZp1LX+0E2O3hdPND6Dc96aGpsh3GNC+tXlCMkq
         OYXQ==
X-Gm-Message-State: AOJu0Yx5OhptaAIOWxNejHGDEpODIi1DbflSrzysSRqQMGjem7ax6B1+
	mpRrFXXoL5M25nE+ZYqJVxBCeXvEjkp9dQ==
X-Google-Smtp-Source: AGHT+IHlPL+HL399ksotIWmpMUfyt9pRagypKE8rVzmOAPKeTYCRr/kXzvsyM7j8tfKn/bIr08BTWQ==
X-Received: by 2002:a0d:c806:0:b0:595:9770:6914 with SMTP id k6-20020a0dc806000000b0059597706914mr5284315ywd.35.1694884495366;
        Sat, 16 Sep 2023 10:14:55 -0700 (PDT)
Received: from [10.230.45.5] ([38.32.73.2])
        by smtp.gmail.com with ESMTPSA id d185-20020a0ddbc2000000b0058419c57c66sm1490803ywe.4.2023.09.16.10.14.54
        (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128);
        Sat, 16 Sep 2023 10:14:54 -0700 (PDT)
Message-ID: <7a6692de-f096-637d-fe48-d5fb93e54f8b@FreeBSD.org>
Date: Sat, 16 Sep 2023 13:14:09 -0400
List-Id: Production branch of FreeBSD source code 
List-Archive: https://lists.freebsd.org/archives/freebsd-stable
List-Help: 
List-Post: 
List-Subscribe: 
List-Unsubscribe: 
Sender: owner-freebsd-stable@freebsd.org
X-BeenThere: freebsd-stable@freebsd.org
MIME-Version: 1.0
User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101
 Thunderbird/102.11.0
Content-Language: en-US
To: Graham Perrin , freebsd-current@freebsd.org
Cc: freebsd-stable@freebsd.org
References: <20230916002831.GU52318@FreeBSD.org>
 <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com>
From: Alexander Motin 
Subject: Re: vfs.zfs.bclone_enabled (was: FreeBSD 14.0-BETA2 Now Available)
In-Reply-To: <02c53c2e-127b-33b4-e13d-f6f6589dd5fe@gmail.com>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]
X-Rspamd-Queue-Id: 4RnyNc44Jbz3Gqd

On 16.09.2023 01:25, Graham Perrin wrote:
> On 16/09/2023 01:28, Glen Barber wrote:
>> o A fix for the ZFS block_cloning feature has been implemented.
> 
> Thanks
> 
> I see 
> , with  in stable/14.
> 
> As vfs.zfs.bclone_enabled is still 0 (at least, with 15.0-CURRENT 
> n265350-72d97e1dd9cc): should we assume that additional fixes, not 
> necessarily in time for 14.0-RELEASE, will be required before 
> vfs.zfs.bclone_enabled can default to 1?

I am not aware of any block cloning issues now.  All this thread about 
bclone_enabled actually started after I asked why it is still disabled. 
Thanks to Mark Millard for spotting this issue I could fix, but now we 
are back at the point of re-enabling it again.  Since the tunable does 
not even exist anywhere outside of FreeBSD base tree, I'd propose to 
give this code another try here too.  I see no point to have it disabled 
at least in main unless somebody needs time to run some specific tests 
first.

-- 
Alexander Motin