From nobody Sat Sep 23 22:20:02 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RtNqm5lzpz4vKNZ for ; Sat, 23 Sep 2023 22:20:20 +0000 (UTC) (envelope-from bc979@lafn.org) Received: from mail.sermon-archive.info (sermon-archive.info [47.181.130.121]) by mx1.freebsd.org (Postfix) with ESMTP id 4RtNql2sRQz3b9P; Sat, 23 Sep 2023 22:20:19 +0000 (UTC) (envelope-from bc979@lafn.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of bc979@lafn.org designates 47.181.130.121 as permitted sender) smtp.mailfrom=bc979@lafn.org; dmarc=none Received: from smtpclient.apple (mini [10.0.1.251]) by mail.sermon-archive.info (Postfix) with ESMTPSA id 4RtNqd0JgJz2fjSh; Sat, 23 Sep 2023 15:20:13 -0700 (PDT) Content-Type: text/plain; charset=utf-8 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: local-unbound stopped working after upgrade to 13.2 From: Doug Hardie In-Reply-To: <86v8c6qwhv.fsf@ltc.des.no> Date: Sat, 23 Sep 2023 15:20:02 -0700 Cc: Doug Hardie , Alain Zscheile , freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> <867comscqv.fsf@ltc.des.no> <86B400F5-01AB-4623-BAF0-6332E3B0CA2F@sermon-archive.info> <86v8c6qwhv.fsf@ltc.des.no> To: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= X-Mailer: Apple Mail (2.3731.700.6) X-Virus-Scanned: clamav-milter 1.1.2 at mail X-Virus-Status: Clean X-Spamd-Bar: / X-Spamd-Result: default: False [-0.94 / 15.00]; SUSPICIOUS_RECIPS(1.50)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.84)[-0.844]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+mx]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; DMARC_NA(0.00)[lafn.org: no valid DMARC record]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:5650, ipnet:47.181.128.0/18, country:US]; MIME_TRACE(0.00)[0:+]; TAGGED_RCPT(0.00)[fbsd]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCPT_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RtNql2sRQz3b9P > On Sep 19, 2023, at 03:37, Dag-Erling Sm=C3=B8rgrav = wrote: >=20 > Doug Hardie writes: >> The only issue I encountered with local unbound some years ago was it >> didn't support local-zone which I needed. >=20 > It does. Just put it in a separate file in /var/unbound/conf.d/. You > may need to adjust your access control settings as well. For = instance, > I use this to allow local-unbound on my desktop computer to also serve > NATed bhyve VMs: >=20 > % cat /var/unbound/conf.d/access-control.conf > server: > interface: 127.0.0.1 > access-control: 127.0.0.0/24 allow > interface: 192.168.144.1 > access-control: 192.168.144.0/24 allow >=20 Interesting. That was not apparent when I setup DNS. I found the = unbound port to be easy to setup and maintain. Not the least of which = is that it has a consistent name. Local unbound sometimes is = local_unbound and sometime local-unbound. I found it difficult to = remember which form to use and usually had to try a couple times to get = it right. -- Doug From nobody Mon Sep 25 03:38:15 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rv7rs0xKlz4tx5l for ; Mon, 25 Sep 2023 03:38:53 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rv7rs06cHz3XRQ; Mon, 25 Sep 2023 03:38:53 +0000 (UTC) (envelope-from yasu@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695613133; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=pMYjqJROQt/hmb9o1WBoVKcQ4L7pX77Zv7dlJ2cU+Kc=; b=sF0/JSKXErScBXMWmALkpuF/H3OxnK4lgfBLYffLHPGXt/UKUZg6zZdDXZVYFt5ObRyN/z T7xFCMw2dGV/z8ezWg0tlYH57K5imr0o3C76smdrBu5JIoz2SetE7SHeb6s8e6dY/ypKL9 OgjieY8+FE8Blwv+jaMID6sKGeth8Crfq8t/W9OmV6Qt7fs70UfdO226rZ6c/s49p/IXLy y2PvgkRbhPWI9kAslb9PPMsSMcXtDlcK681lWFv7AJ6oXxQz6BLl78ylvm3gacypA3LEc5 hc+BhC+qqkyxkt1fzZ5aFMVijcgCI5H3JoGENPgS9SwtOs6H/g+xFQQ3FylUHg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695613133; a=rsa-sha256; cv=none; b=wily0pFqjLfveSSjduoqp5d+l56zBuaI1+8r7tCjLfWCUuhrnzM7fRmUHt3FJfsvPLA5cA vQ7LY2NFYZhI7O8Lz1oYz/EHH+fzUDMDUC6uZHhvhO89Qdp1YZUR0nZMv7I702b7/mbQ5G BKwf9hg4EXuYpHEKm7fLanleL7nsICHjE7Gp2aYep78PPLxdrG3UXe2/gIeDcZXxmzyGVv YJDChZa12CeDIKRxnE+xclz405qkV51nz68+Sr8E8kjvXTUn8woUeR1kKNeibxcZyssxT4 DEZhJs52bRJynYEzlO3z4H7YOGwj5maRH1xXNYb5luDi2cO5ZPYYWIlMFz7dfw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695613133; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=pMYjqJROQt/hmb9o1WBoVKcQ4L7pX77Zv7dlJ2cU+Kc=; b=R+07m2l4xsNfFtsHSP8c15W6ZsRIejFbecsrg3xo0HiRiUCj+vzb5u+U4/qFWzw7/nUhAR FkCkQQ68415GNiOsA9sm/ONtQyaAKANyFJfDJso4eY+Qjoya57nu4bXJ4UZKdSNjKlHc9d 36064dfH3GgzPiRVaQV5yYx/VRinjgFgbYgbpWzPg/HBXYrLGGfwm2wjArIQhYKKXJadDY vcJzMpcLVZEmKZPTu6PiGr97ZjbmIh+3tbdFS5bNvOIQilGPF2b4tjw5Gg7iCLjVuE0lB/ nU76x1lrU6yuPYPNQsPvxd6fLFZ5Vxh07LE5UbFYRdujxsj/2q8S8es3EPZZyA== Received: from localhost (unknown [IPv6:240b:11:220:fe00::174:11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: yasu/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rv7rr1zbSz13yG; Mon, 25 Sep 2023 03:38:52 +0000 (UTC) (envelope-from yasu@FreeBSD.org) Date: Mon, 25 Sep 2023 12:38:15 +0900 (JST) Message-Id: <20230925.123815.2240162787251781859.yasu@FreeBSD.org> To: freebsd-stable@freebsd.org Subject: 14.0-BETA3 amd64: panic while building packages with poudriere From: Yasuhiro Kimura X-Mailer: Mew version 6.9 on Emacs 30.0.50 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 Content-Type: Text/Plain; charset=us-ascii Content-Transfer-Encoding: 7bit yasu@rolling-vm-freebsd4[1028]% uname -a ~ FreeBSD rolling-vm-freebsd4.home.utahime.org 14.0-BETA3 FreeBSD 14.0-BETA3 #0 releng/14.0-n265111-c429a0425dc4: Sun Sep 24 02:28:13 JST 2023 rootz@rolling-vm-freebsd4.home.utahime.org:/usr/obj/usr/src/amd64.amd64/sys/GENERIC-DEBUG amd64 yasu@rolling-vm-freebsd4[1029]% cat /usr/src/sys/amd64/conf/GENERIC-DEBUG ~ include GENERIC ident GENERIC-DEBUG # For full debugger support use (turn off in stable branch): options BUF_TRACKING # Track buffer history options DDB # Support DDB. options FULL_BUF_TRACKING # Track more buffer history options GDB # Support remote GDB. options DEADLKRES # Enable the deadlock resolver options INVARIANTS # Enable calls of extra sanity checking options INVARIANT_SUPPORT # Extra sanity checks of internal structures, required by INVARIANTS options QUEUE_MACRO_DEBUG_TRASH # Trash queue(2) internal pointers on invalidation options WITNESS # Enable checks to detect deadlocks and cycles options WITNESS_SKIPSPIN # Don't run witness on spinlocks for speed options MALLOC_DEBUG_MAXZONES=8 # Separate malloc(9) zones options VERBOSE_SYSINIT=0 # Support debug.verbose_sysinit, off by default yasu@rolling-vm-freebsd4[1030]% Panic happened while building packages with poudriere. Screen shot: https://people.freebsd.org/~yasu/FreeBSD-14.0-BETA3-amd64.20230925.panic.png --- Yasuhiro Kimura From nobody Mon Sep 25 04:04:50 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rv8R10CXtz4v05R for ; Mon, 25 Sep 2023 04:05:01 +0000 (UTC) (envelope-from jake@technologyfriends.net) Received: from ci74p00im-qukt09082102.me.com (ci74p00im-qukt09082102.me.com [17.57.156.11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rv8R05WqDz3Zqm for ; Mon, 25 Sep 2023 04:05:00 +0000 (UTC) (envelope-from jake@technologyfriends.net) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=technologyfriends.net; s=sig1; t=1695614698; bh=oI5pwrxB3KVacwEhqwHBu0VnkrmFOYh4vlClJjjpgIg=; h=Content-Type:Mime-Version:Subject:From:Date:Message-Id:To; b=gw+v9blxKYOuDNbFQqbCddMBt86zUVPaxUr38SWcGt8T/Jb2nrH7EvJhMBKZINha4 xmqWoqEtnc6H110lnMcYhsUl3Q5WacGsvAG8pax6tPzfX130hQluHixcCnyFXIadRM 5xLiL6YObCsMXOztBo9pbrMaHIIr9ZwNqb47+4AqyluhtZRwu1QXvf/1yjffsEqK6V a+q0dWKROK06VhYSL8AWIgShUQtxykF2aNQGky6XwFidyg4Zjk5i3lAaj0U0cPDrN2 jQg5GlK4t2PZMm4L8DOeedHg89Sw3Pz/Swzky/YnpwBr48Z/eJ/5atkSXLXN7Lr5O8 s/UnhdZ8Mh71g== Received: from smtpclient.apple (ci77p00im-dlb-asmtp-mailmevip.me.com [17.57.156.26]) by ci74p00im-qukt09082102.me.com (Postfix) with ESMTPSA id A926619C00AF; Mon, 25 Sep 2023 04:04:57 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: 14.0-BETA3 amd64: panic while building packages with poudriere From: Jake Freeland In-Reply-To: <20230925.123815.2240162787251781859.yasu@FreeBSD.org> Date: Sun, 24 Sep 2023 23:04:50 -0500 Cc: freebsd-stable@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <063AFEA5-88C7-4567-8DFC-207D3387436F@technologyfriends.net> References: <20230925.123815.2240162787251781859.yasu@FreeBSD.org> To: Yasuhiro Kimura , "imp@freebsd.org" X-Mailer: Apple Mail (2.3731.700.6) X-Proofpoint-ORIG-GUID: S1mvzCaEajuh2wWnIEcwEWBjHUwHqSPY X-Proofpoint-GUID: S1mvzCaEajuh2wWnIEcwEWBjHUwHqSPY X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.138,18.0.572,17.11.62.513.0000000_definitions?= =?UTF-8?Q?=3D2020-02-14=5F11:2020-02-14=5F02,2020-02-14=5F11,2021-12-02?= =?UTF-8?Q?=5F01_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 clxscore=1030 malwarescore=0 phishscore=0 mlxlogscore=923 adultscore=0 spamscore=0 suspectscore=0 mlxscore=0 bulkscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2309250027 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:714, ipnet:17.57.156.0/24, country:US] X-Rspamd-Queue-Id: 4Rv8R05WqDz3Zqm > On Sep 24, 2023, at 22:38, Yasuhiro Kimura wrote: >=20 > yasu@rolling-vm-freebsd4[1028]% uname -a = ~ > FreeBSD rolling-vm-freebsd4.home.utahime.org 14.0-BETA3 FreeBSD = 14.0-BETA3 #0 releng/14.0-n265111-c429a0425dc4: Sun Sep 24 02:28:13 JST = 2023 = rootz@rolling-vm-freebsd4.home.utahime.org:/usr/obj/usr/src/amd64.amd64/sy= s/GENERIC-DEBUG amd64 > yasu@rolling-vm-freebsd4[1029]% cat = /usr/src/sys/amd64/conf/GENERIC-DEBUG = ~ > include GENERIC > ident GENERIC-DEBUG >=20 > # For full debugger support use (turn off in stable branch): > options BUF_TRACKING # Track buffer history > options DDB # Support DDB. > options FULL_BUF_TRACKING # Track more buffer history > options GDB # Support remote GDB. > options DEADLKRES # Enable the deadlock resolver > options INVARIANTS # Enable calls of extra sanity = checking > options INVARIANT_SUPPORT # Extra sanity checks of = internal structures, required by INVARIANTS > options QUEUE_MACRO_DEBUG_TRASH # Trash queue(2) internal = pointers on invalidation > options WITNESS # Enable checks to detect = deadlocks and cycles > options WITNESS_SKIPSPIN # Don't run witness on = spinlocks for speed > options MALLOC_DEBUG_MAXZONES=3D8 # Separate malloc(9) zones > options VERBOSE_SYSINIT=3D0 # Support = debug.verbose_sysinit, off by default > yasu@rolling-vm-freebsd4[1030]% >=20 >=20 > Panic happened while building packages with poudriere. >=20 > Screen shot: > = https://people.freebsd.org/~yasu/FreeBSD-14.0-BETA3-amd64.20230925.panic.p= ng That panic was fixed by commit f4296cfb409a48de00bfa60e76f686c2b031876f. The fix has been merged into stable/14, but not releng/14.0 yet. Warner might have more to say about this. Jake Freeland >=20 > --- > Yasuhiro Kimura >=20 From nobody Mon Sep 25 06:42:08 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvCwK5YRxz4v7v3 for ; Mon, 25 Sep 2023 06:42:09 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Received: from post.behrens.de (post.behrens.de [IPv6:2a01:170:1023::1:2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "post.behrens.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvCwJ5Qmgz4JmX for ; Mon, 25 Sep 2023 06:42:08 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=harz2023.behrens.de header.s=pinky2 header.b="VcBfY/1D"; spf=pass (mx1.freebsd.org: domain of frank@harz2023.behrens.de designates 2a01:170:1023::1:2 as permitted sender) smtp.mailfrom=frank@harz2023.behrens.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= harz2023.behrens.de; h=message-id:date:mime-version:from:subject :to:references:in-reply-to:content-type :content-transfer-encoding; s=pinky2; bh=SZ32ODnMJFaOWTS7Mlauf04 Qxf+H4yQehayRYfu+OWc=; b=VcBfY/1DJTh/gjpw0v6QEXfth1np+tzWemLUDh8 HQRVPlpB8ahXu9UbMDxwlwr9Te54PW5wiBpN08dQ6FE9/+NJieCjSRZRSPhHQaAp W7Wi0aJIciLN6sbEihoUPkIJu2joZYeYOKjW1LxwqkUXDKw2GpXwczbQD1TB3Y/N yTIM= Received: from [IPV6:fdfb:1999:428:bb80:17b:8d:64b2:74db] ([IPv6:fdfb:1999:428:bb80:17b:8d:64b2:74db]) (authenticated bits=0) by post.behrens.de (8.17.1/8.17.1) with ESMTPSA(MSP) id 38P6g5Nh053133 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO cn=) for ; Mon, 25 Sep 2023 08:42:05 +0200 (CEST) (envelope-from frank@harz2023.behrens.de) Message-ID: Date: Mon, 25 Sep 2023 08:42:08 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 From: Frank Behrens Subject: Re: nvd->nda switch and blocksize changes for ZFS To: stable@freebsd.org References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> Content-Language: de-DE In-Reply-To: <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[harz2023.behrens.de:s=pinky2]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; FROM_HAS_DN(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MLMMJ_DEST(0.00)[stable@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:8820, ipnet:2a01:170:1000::/36, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[2a01:170:1023::1:2:server fail]; PREVIOUSLY_DELIVERED(0.00)[stable@freebsd.org]; TO_DN_NONE(0.00)[]; DKIM_TRACE(0.00)[harz2023.behrens.de:+]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[behrens.de]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RvCwJ5Qmgz4JmX Hi Dimitry, Yuri and also Mark, thanks for your fast responses! Am 23.09.2023 um 20:58 schrieb Yuri Pankov: > Dimitry Andric wrote: >> On 23 Sep 2023, at 18:31, Frank Behrens wrote: >>> I created a zpool with a FreeBSD-14.0-CURRENT on February. With >>> 15.0-CURRENT/14.0-STABLE from now I get the message: >>> >>> status: One or more devices are configured to use a non-native block >>> size. >>> Expect reduced performance. >>> action: Replace affected devices with devices that support the >>> configured block size, or migrate data to a properly configured >>> pool. >>> NAME STATE READ WRITE CKSUM >>> zsys ONLINE 0 0 0 >>> raidz1-0 ONLINE 0 0 0 >>> nda0p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >>> nda1p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >>> nda2p4 ONLINE 0 0 0 block size: 4096B configured, 16384B native >>> >>> I use: >>> nda0: >>> nda0: nvme version 1.4 >>> nda0: 953869MB (1953525168 512 byte sectors) >>> >>> I cannot imagine, that the native blocksize changed. Do I really >>> expect a reduced performance? >>> Is it advisable to switch back to nvd? >> It could be due to a bug in nda so it reports the native block size >> incorrectly, in which case you would not need to do anything but >> ignore the message. However, if the native block size is really >> 16kiB, you will get write amplification effects, which could >> needlessly shorten the life of your SSD. >> >> I would try running e.g. smartmontools's smartctl, which can >> sometimes tell you what the real block size is. Although as far as I >> know, it retrieves this information from some internal database. You >> could also try to look up the information in the SSD vendor's data >> sheet, or ask the vendor directly? > Isn't it displayed by e.g. `nvmecontrol identify nda0` under the LBA > Formats (including the current one used to format the namespace)? Based on your comments I made some investigations and switched back to nvd: # smartctl -a /dev/nvme0 Namespace 1 Formatted LBA Size:     512 ... Supported LBA Sizes (NSID 0x1) Id Fmt  Data  Metadt  Rel_Perf  0 +     512       0         0 # nvmecontrol identify nda0 and # nvmecontrol identify nvd0 (after hw.nvme.use_nvd="1" and reboot) give the same result: Number of LBA Formats:       1 Current LBA Format:          LBA Format #00 LBA Format #00: Data Size:   512  Metadata Size:     0  Performance: Best ... Optimal I/O Boundary:        0 blocks NVM Capacity:                1000204886016 bytes Preferred Write Granularity: 32 blocks Preferred Write Alignment:   8 blocks Preferred Deallocate Granul: 9600 blocks Preferred Deallocate Align:  9600 blocks Optimal Write Size:          256 blocks The recommended blocksize for ZFS is GEOM's stripesize and there I see a difference: # diff -w -U 10  gpart_list_nvd.txt gpart_list_nda.txt -Geom name: nvd0 +Geom name: nda0  modified: false  state: OK  fwheads: 255  fwsectors: 63  last: 1953525127  first: 40  entries: 128  scheme: GPT  Providers: -1. Name: nvd0p1 +1. Name: nda0p1     Mediasize: 272629760 (260M)     Sectorsize: 512 -   Stripesize: 4096 -   Stripeoffset: 0 +   Stripesize: 16384 +   Stripeoffset: 4096     Mode: r1w1e2     efimedia: HD(1,GPT,8d4c57bb-932f-11ed-82da-74563c227532,0x28,0x82000)     rawuuid: 8d4c57bb-932f-11ed-82da-74563c227532     rawtype: c12a7328-f81f-11d2-ba4b-00a0c93ec93b     label: efiboot0     length: 272629760     offset: 20480     type: efi     index: 1     end: 532519     start: 40 ... -4. Name: nvd0p4 +4. Name: nda0p4     Mediasize: 995635494912 (927G)     Sectorsize: 512 -   Stripesize: 4096 +   Stripesize: 16384     Stripeoffset: 0     Mode: r1w1e1     efimedia: HD(4,GPT,8d61a5ca-932f-11ed-82da-74563c227532,0x882800,0x73e84000)     rawuuid: 8d61a5ca-932f-11ed-82da-74563c227532     rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b     label: zfs0     length: 995635494912     offset: 4568645632     type: freebsd-zfs     index: 4     end: 1953523711     start: 8923136 With these information I'm not sure, if I have really a problem with the native blocksize. Does anybody know, how the stripesize is determined? Kind regards,    Frank -- Frank Behrens Osterwieck, Germany From eugen@grosbein.net Mon Sep 25 10:16:14 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvJhw5t1vz4vLPQ for ; Mon, 25 Sep 2023 10:17:36 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:c2c:26d8::2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvJhw32gXz3FhY for ; Mon, 25 Sep 2023 10:17:36 +0000 (UTC) (envelope-from eugen@grosbein.net) Authentication-Results: mx1.freebsd.org; none Received: from eg.sd.rdtc.ru (root@eg.sd.rdtc.ru [62.231.161.221] (may be forged)) by hz.grosbein.net (8.17.1/8.17.1) with ESMTPS id 38PAHOc4005323 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NOT); Mon, 25 Sep 2023 10:17:25 GMT (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: frank@harz2023.behrens.de Received: from [10.58.0.11] (dadvw [10.58.0.11] (may be forged)) by eg.sd.rdtc.ru (8.17.1/8.17.1) with ESMTPS id 38PAHN02030200 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NOT); Mon, 25 Sep 2023 17:17:23 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: nvd->nda switch and blocksize changes for ZFS To: Frank Behrens , stable@freebsd.org References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> From: Eugene Grosbein Message-ID: <4451a05c-0c62-b16d-afa3-8ba6d707f48c@grosbein.net> Date: Mon, 25 Sep 2023 17:16:14 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED,SHORTCIRCUIT autolearn=disabled version=3.4.6 X-Spam-Report: * -0.0 SHORTCIRCUIT No description available. * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on hz.grosbein.net X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:2a01:4f8::/32, country:DE] X-Rspamd-Queue-Id: 4RvJhw32gXz3FhY 25.09.2023 13:42, Frank Behrens wrote: > With these information I'm not sure, if I have really a problem with the native blocksize. > Does anybody know, how the stripesize is determined? It is reported by underlying driver, these are nda or nvd in your case. Eugene From nobody Mon Sep 25 11:58:35 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvLxp3Ht3z4vRg8 for ; Mon, 25 Sep 2023 11:58:54 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvLxp2qpvz3bW3; Mon, 25 Sep 2023 11:58:54 +0000 (UTC) (envelope-from dim@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695643134; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=N1ptHLnLFoT99Og4R3WiJHdQhSv/HWmThdIt5YUdwnw=; b=U0WDmumnc5gySAc8jfl+MPjXLjLN6yweHmVg5Q8PWO7VuhOp7AIxhhHcGGn5qYvXVkKsYh u4neh9AY+jmreRyQyFo5kNF2BbetjHBFWurai2l9W+liJzVz5S8i6XYRnQm2jS58uD0Nzx lvWt6Jb+R5x7/mTtPJvtOcXcvNDyUIlaGNctAPVsbawqjNMhO9pHz1xX3XlEuBz4Woft89 pPO0QR5MAsORoNrKvNR+QYQpzQe/ZB1rhJ5rkpiBwco+D+FJqiP0jIVlxQ83Eco78cuPZP NfmyUVDklnFP3LuCZTIOrI8FiiBojCKJYQwzSJmhr44G3fKD05zFSMjq6cU1FA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695643134; a=rsa-sha256; cv=none; b=SfjyqaOPwCLGl4VNrHsm2/ujhBrFqKhcgPurlLwPUQmTCtNHg5YS/X+GyB8ofxakLZDqdQ oRAx4Q5e09/u5xGxowuu21l3436iNyrD/VVbaY8JciG9nVMlJH8HYDylBCCqd5Ayohl7KK 87Ie6O39pSn4965AfgYEnWXWmEyuUQj2gHzDJog9OEXP+8+WblkpPVMR2JMwEdhBt/vUCD v2yvNnPWVIWG2wbEv2M4rcMLNSxYV34ezR/IKEBDAHzTQ5LQmJOIg3DfsAS/JdbKIsgOr8 tHAh5Ih60a1ofANg+z974UY/csur+mNkkG0QCwsk94SQy8PuvyXGM06VuZGY6w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695643134; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=N1ptHLnLFoT99Og4R3WiJHdQhSv/HWmThdIt5YUdwnw=; b=DsWswhLwXtXXPu0q8fJvtfTUxcpcaMlF7TfYxVO0EEXOyt6Bf8BfiKGHgN93Py5QBTsuA7 ARg5035cIVe5hHgYBES1PjZiZGBuoHLJnUZw4VvSkwcdIr0ono2+g38r2i1KaVB4PWVo0M czXZwx/A2ckQzlzlQtg4KzkBAq85AsPIKrgpojRvoE+7vR/WM7yOlylgpVp5FQ1KWoDgtq RS0ZFa4Hu7pGp1BhFVqDOvCabDtUdvByMs16mhxS22/Wa1SsUqWNxa5RpwBgpVuvYhWXZM 00Cka4c4bkh9bgJj8WooQN8e9UVqjH0bkqgIL7UYekl3o2I3o1vT7+shUlV7gw== Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "tensor.andric.com", Issuer "R3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RvLxp18VGz1CZc; Mon, 25 Sep 2023 11:58:54 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtpclient.apple (longrow.home.andric.com [192.168.0.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id 3ED2E2A8D1; Mon, 25 Sep 2023 13:58:52 +0200 (CEST) Content-Type: multipart/signed; boundary="Apple-Mail=_1FDA81CF-C4AB-484D-954B-89C1A3569B46"; protocol="application/pgp-signature"; micalg=pgp-sha1 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: nvd->nda switch and blocksize changes for ZFS From: Dimitry Andric In-Reply-To: Date: Mon, 25 Sep 2023 13:58:35 +0200 Cc: stable@freebsd.org, Warner Losh Message-Id: References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> To: Frank Behrens X-Mailer: Apple Mail (2.3731.700.6) --Apple-Mail=_1FDA81CF-C4AB-484D-954B-89C1A3569B46 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 25 Sep 2023, at 08:42, Frank Behrens = wrote: >=20 > Hi Dimitry, Yuri and also Mark, thanks for your fast responses! >=20 > Am 23.09.2023 um 20:58 schrieb Yuri Pankov: ... > # smartctl -a /dev/nvme0 > Namespace 1 Formatted LBA Size: 512 > ... > Supported LBA Sizes (NSID 0x1) > Id Fmt Data Metadt Rel_Perf > 0 + 512 0 0 This is the default compatibility sector size of 512 bytes, so it is not = relevant. > # nvmecontrol identify nda0 and # nvmecontrol identify nvd0 (after = hw.nvme.use_nvd=3D"1" and reboot) give the same result: > Number of LBA Formats: 1 > Current LBA Format: LBA Format #00 > LBA Format #00: Data Size: 512 Metadata Size: 0 Performance: = Best > ... > Optimal I/O Boundary: 0 blocks > NVM Capacity: 1000204886016 bytes > Preferred Write Granularity: 32 blocks > Preferred Write Alignment: 8 blocks > Preferred Deallocate Granul: 9600 blocks > Preferred Deallocate Align: 9600 blocks > Optimal Write Size: 256 blocks My guess is that the "Preferred Write Granularity" is the optimal size, = in this case 32 'blocks' of 512 bytes, so 16 kiB. This also matches the = stripe size reported by geom, as you showed. The "Preferred Write Alignment" is 8 * 512 =3D 4 kiB, so you should = align partitions etc to at least this. However, it cannot hurt to align = everything to 16 kiB either, which is an integer multiple of 4 kiB. > The recommended blocksize for ZFS is GEOM's stripesize and there I see = a difference: >=20 > # diff -w -U 10 gpart_list_nvd.txt gpart_list_nda.txt > -Geom name: nvd0 > +Geom name: nda0 > modified: false > state: OK > fwheads: 255 > fwsectors: 63 > last: 1953525127 > first: 40 > entries: 128 > scheme: GPT > Providers: > -1. Name: nvd0p1 > +1. Name: nda0p1 > Mediasize: 272629760 (260M) > Sectorsize: 512 > - Stripesize: 4096 > - Stripeoffset: 0 > + Stripesize: 16384 > + Stripeoffset: 4096 Yeah, I am suspecting that nda reports the "stripesize" from the NVMe = "Preferred Write Granularity" and "stripeoffset" from the NVMe = "Preferred Write Alignment". I think Warner's the resident expert on = NVMe drivers, so maybe he's got some clue. :) -Dimitry --Apple-Mail=_1FDA81CF-C4AB-484D-954B-89C1A3569B46 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCZRF16wAKCRCwXqMKLiCW ozj7AJ4tjqxzB3PICZQs2RfvSailtzzWGQCeNbCjAQacFh8OWjxsEhW1sHr5p6c= =L89J -----END PGP SIGNATURE----- --Apple-Mail=_1FDA81CF-C4AB-484D-954B-89C1A3569B46-- From nobody Mon Sep 25 13:21:12 2023 X-Original-To: stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvNmx2XYkz4rKcx for ; Mon, 25 Sep 2023 13:21:21 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Received: from post.behrens.de (post.behrens.de [IPv6:2a01:170:1023::1:2]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "post.behrens.de", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvNmv64Gdz4K6W; Mon, 25 Sep 2023 13:21:19 +0000 (UTC) (envelope-from frank@harz2023.behrens.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=harz2023.behrens.de header.s=pinky2 header.b=gvncdPgC; spf=pass (mx1.freebsd.org: domain of frank@harz2023.behrens.de designates 2a01:170:1023::1:2 as permitted sender) smtp.mailfrom=frank@harz2023.behrens.de; dmarc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= harz2023.behrens.de; h=message-id:date:mime-version:subject:to :references:from:cc:in-reply-to:content-type :content-transfer-encoding; s=pinky2; bh=gbwFhzDM33LUOUDSY8DZ1Yo 5YJtPeN8/1dQuDLNIVh0=; b=gvncdPgCCQelstbk3iIdIz/J97fXe8ST1yIRx0o kLSP/hYEyK4LQUBJ77w2ZRtqoTn7eN+rfp9/Zq8hkcP2BIBOIfOpcApCpCE9f+mx sKbQPEBGp0fMVGojd9GBzvLd0zCgVuuKGK+HsPp9HkRKfzbZcHpAYAmWtLp32g5E x4mU= Received: from [IPV6:fdfb:1999:428:bb80:1490:f3ce:c379:6f69] ([IPv6:fdfb:1999:428:bb80:1490:f3ce:c379:6f69]) (authenticated bits=0) by post.behrens.de (8.17.1/8.17.1) with ESMTPSA(MSP) id 38PDLCOf066985 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO cn=); Mon, 25 Sep 2023 15:21:12 +0200 (CEST) (envelope-from frank@harz2023.behrens.de) Message-ID: Date: Mon, 25 Sep 2023 15:21:12 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:102.0) Gecko/20100101 Thunderbird/102.15.1 Subject: Re: nvd->nda switch and blocksize changes for ZFS Content-Language: de-DE, en-GB To: stable@freebsd.org References: <1b6190d1-1d42-6c99-bef6-c6b77edd386a@harz2023.behrens.de> <779546e4-1135-c808-372f-e77d347ecf65@aetern.org> From: Frank Behrens Cc: Warner Losh In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.40 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_DKIM_ALLOW(-0.20)[harz2023.behrens.de:s=pinky2]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; TO_DN_SOME(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_ALL(0.00)[]; ASN(0.00)[asn:8820, ipnet:2a01:170:1000::/36, country:DE]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[stable@freebsd.org]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[behrens.de]; DKIM_TRACE(0.00)[harz2023.behrens.de:+]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4RvNmv64Gdz4K6W Am 25.09.2023 um 13:58 schrieb Dimitry Andric: > # nvmecontrol identify nda0 and # nvmecontrol identify nvd0 (after > hw.nvme.use_nvd="1" and reboot) give the same result: >> Number of LBA Formats: 1 >> Current LBA Format: LBA Format #00 >> LBA Format #00: Data Size: 512 Metadata Size: 0 Performance: Best >> ... >> Optimal I/O Boundary: 0 blocks >> NVM Capacity: 1000204886016 bytes >> Preferred Write Granularity: 32 blocks >> Preferred Write Alignment: 8 blocks >> Preferred Deallocate Granul: 9600 blocks >> Preferred Deallocate Align: 9600 blocks >> Optimal Write Size: 256 blocks > My guess is that the "Preferred Write Granularity" is the optimal size, in this case 32 'blocks' of 512 bytes, so 16 kiB. This also matches the stripe size reported by geom, as you showed. > > The "Preferred Write Alignment" is 8 * 512 = 4 kiB, so you should align partitions etc to at least this. However, it cannot hurt to align everything to 16 kiB either, which is an integer multiple of 4 kiB. Eugene gave me a tip, so I looked into the drivers. dev/nvme/nvme_ns.c: nvme_ns_get_stripesize(struct nvme_namespace *ns) {         uint32_t ss;         if (((ns->data.nsfeat >> NVME_NS_DATA_NSFEAT_NPVALID_SHIFT) &             NVME_NS_DATA_NSFEAT_NPVALID_MASK) != 0) {                 ss = nvme_ns_get_sector_size(ns);                 if (ns->data.npwa != 0)                         return ((ns->data.npwa + 1) * ss);                 else if (ns->data.npwg != 0)                         return ((ns->data.npwg + 1) * ss);         }         return (ns->boundary); } cam/nvme/nvme_da.c:         if (((nsd->nsfeat >> NVME_NS_DATA_NSFEAT_NPVALID_SHIFT) &             NVME_NS_DATA_NSFEAT_NPVALID_MASK) != 0 && nsd->npwg != 0)                 disk->d_stripesize = ((nsd->npwg + 1) * disk->d_sectorsize);         else                 disk->d_stripesize = nsd->noiob * disk->d_sectorsize; So it seems, that nvd uses "sectorsize * Write Alignment" as stripesize  while nda uses "sectorsize * Write Granularity". My current interpretation is, that the nvd driver reports the wrong value for maximum performance and reliability. I should make a backup and re-create the pool. Maybe we should note in the 14.0 release notes, that the switch to nda is not a "nop". -- Frank Behrens Osterwieck, Germany From nobody Mon Sep 25 20:44:15 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvZc2295bz4v3kn; Mon, 25 Sep 2023 20:44:18 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvZc213QJz3dt2; Mon, 25 Sep 2023 20:44:18 +0000 (UTC) (envelope-from ronald@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695674658; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HvEWoyMtmrwmYl+UY5muApmvB9lcKqHFS71VyP9NK+0=; b=JdMnaFLqLiRZrZM282m2YewMKeFd6JBqJ11erCT8Ai1MTbWHPxGTGlclBPI+lYbBlzwN6P vRUYVLs2B6sO1xuLUbOdfe4YzvQl0LAG3YVCxzRfxHrCJHvsZQNMTrZefDtS5vj/4xrOQH yUVi06Bbp35T8Af4Dru+iioYGaCnSx9aMng3qHoGihwxMJHR77H8+ws3wnVXKemMwD71Ps lRryZgB7yfgsmmIE7f28FPzpc6AG3uVkSipy9B3YfM3WQNeJtEaZQUTN2PPUZV9NJhAoa+ 58k/OuzvXzgnfUTt9TLy+rglcjYpm8ZeWdxTzo5ORbn0kkB9v1w6cCOlFDcZLA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695674658; a=rsa-sha256; cv=none; b=qlmpW8/xp/ulkKDMKeFe/UTU9+k/ycQX4NFYuP0YKqGIQA46VwZPWZRXEsX8wIxDo856ll nSiD2ZsgWIXIZfAIqYR9hkLNtXQyf8qrWk6gstH9MksOyK6C9BnqpvKRvYTXikLoiRyfel ajOV0U7l8M45fH+sdGqgh558tqGZ1GLRdajpcnHvfRBkzXlu0egE9ObNHwBvdahXRkYHEW GrpFLuxGexbslfzdJMTF+7ghYRgGGdy5u1a5imfcBPCrPwNmgxftrWjmE7HHw3jYsTwHhQ n1HvTAfymIzblNB58Ka4G4NG3IrUWWL19Qg2lEXKLUxAw5DjHu7QUDWFilTEmg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695674658; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=HvEWoyMtmrwmYl+UY5muApmvB9lcKqHFS71VyP9NK+0=; b=J8oiYqa+rRwNZ9N6nvppORgVjfr+3XfYwOInUUz6ZnNK69X56sFLac2KsHSB+IM9j6qIOZ 5D/KyFAEE/5Y83pcE8dW+mwoK3eHXoIXL4BHHbjAH+x7GUpzlHZmfVE3Oa6yMd9BJddIdC VC3TwVaJhhqusE9iD8nLo2RX3cgthKslWzZrAE+OVvUxQldz4jjqt5F6dpZ9YUCZKJ6PeD tCScOOVH2dZ2oHI70UCsd7tFUy6oCc+x6AZXuJ2rlmcWfUiyK0Xavf0WD41kWLvteigF8x 4h5a6IqGghoHvy5mdYzNP8QJJzqJUYRJ5uue3YSYjtZOrYD5hULNR1PdRvuptg== Received: from [192.168.1.109] (84-105-120-103.cable.dynamic.v4.ziggo.nl [84.105.120.103]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) (Authenticated sender: ronald/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4RvZc11QqGz1N90; Mon, 25 Sep 2023 20:44:17 +0000 (UTC) (envelope-from ronald@FreeBSD.org) Message-ID: <1c21a6d7-0621-b62c-84b4-c4cd393e1fb3@FreeBSD.org> Date: Mon, 25 Sep 2023 22:44:15 +0200 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:102.0) Gecko/20100101 Thunderbird/102.15.0 Subject: Re: [UPDATE] FreeBSD 14.0-BETA3 Now Available Content-Language: en-US To: James Comfort , Nuno Teixeira , Kurt Jaeger Cc: Glen Barber , "freebsd-current@freebsd.org" , "freebsd-stable@freebsd.org" , FreeBSD Release Engineering Team References: <20230922225008.GQ4090@FreeBSD.org> <20230923054535.GJ52318@FreeBSD.org> From: Ronald Klop In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit On 9/25/23 22:18, James Comfort wrote: > Just out of curiosity, is there a reason that virtualbox-ose-additions don’t show up in a pkg search? I’ve tried compiling it from ports, but keep getting errors. > Yes. The pkg build was failing on FreeBSD 14 and 15 for some time. Recently a patch was committed which fixes this. The first pkg build containing this patch just finished. The pkgs will probably appear on the download servers tomorrow or the day after if nothing unexpected happens. This is the log of the successful build of virtualbox-ose-additions on releng/14: https://pkg-status.freebsd.org/beefy12/data/140releng-amd64-default/e88d010d0a2b/logs/virtualbox-ose-additions-6.1.46.log Regards, Ronald. > Jim Comfort > > Sent from Mail for Windows > > *From: *Nuno Teixeira > *Sent: *Saturday, September 23, 2023 5:11 AM > *To: *Kurt Jaeger > *Cc: *Glen Barber ; freebsd-current@freebsd.org ; freebsd-stable@freebsd.org ; FreeBSD Release Engineering Team > *Subject: *Re: [UPDATE] FreeBSD 14.0-BETA3 Now Available > > Same error but it seems that upgrade completed and pkgs cleaned: > > --- > > =>> Building lang/rust > build started at Sat Sep 23 12:26:01 WEST 2023 > port directory: /usr/ports/lang/rust > package name: rust-1.72.0 > building for: FreeBSD 140amd64-main-job-02 14.0-BETA3 FreeBSD 14.0-BETA3 amd64 > maintained by: rust@FreeBSD.org > Makefile datestamp: -rw-r--r--  1 1001 1001 11640 Sep  9 08:02 /usr/ports/lang/rust/Makefile > Poudriere version: poudriere-git-3.3.99.20220831 > Host OSVERSION: 1500001 > Jail OSVERSION: 1400097 > Job Id: 02 > > --- > > Kurt Jaeger > escreveu no dia sábado, 23/09/2023 à(s) 12:33: > > Hi! > > > On Fri, Sep 22, 2023 at 10:50:08PM +0000, Glen Barber wrote: > > > === Upgrading === > > > > > > Due to a known delay, freebsd-update(8) binary update builds are not yet > > > ready for BETA3.  A separate email will be sent once they are available. > > > > > > > Binary updates via freebsd-update(8) are now available for systems > > already running 14.0-BETA. > > If I try to update my poudriere 14.0-BETA2 jail with this command: > > poudriere jail -u -j 140 -t 14.0-BETA3 > > it fails, see here: > > https://people.freebsd.org/~pi/logs/pou-fail.txt > (short, only 1550 bytes) > > I have: > > 140   14.0-BETA2      amd64 http    2023-09-16 08:20:01 /pou/jails/140 > > with > > /usr/local/bin/poudriere installed by package poudriere-devel-3.3.99.20220831 > > -- > pi@FreeBSD.org         +49 171 3101372                  Now what ? > > > > -- > > Nuno Teixeira > FreeBSD Committer (ports) > From nobody Mon Sep 25 21:12:15 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvbDQ2LMXz4v5GF for ; Mon, 25 Sep 2023 21:12:22 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvbDP4VS1z4Fyj; Mon, 25 Sep 2023 21:12:21 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:1::12 as permitted sender) smtp.mailfrom=mike@sentex.net; dmarc=none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38PLCE9R032204 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Mon, 25 Sep 2023 17:12:14 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:5d3:ad9d:dff7:8fa0] ([IPv6:2607:f3e0:0:4:5d3:ad9d:dff7:8fa0]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38PLCEnc015300 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Mon, 25 Sep 2023 17:12:14 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: Date: Mon, 25 Sep 2023 17:12:15 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: FreeBSD-STABLE Mailing List From: mike tancsa Subject: ifconfig -v ix0 output delay Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.38 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; NEURAL_HAM_MEDIUM(-0.99)[-0.989]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[199.212.134.19:received]; XM_UA_NO_VERSION(0.01)[]; R_DKIM_NA(0.00)[]; FREEFALL_USER(0.00)[mike]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[sentex.net]; RCVD_TLS_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4RvbDP4VS1z4Fyj Hi All,     A small annoyance, but I was wondering why "ifconfig -v ix0" seems to take a "long time" compared to other 10G nics.  e.g. 0(nfs3b2)# time ifconfig -v ix0 ix0: flags=8863 metric 0 mtu 1500 options=4e53fbb         ether 0c:c4:7a:6f:20:a0         inet6 fe80::ec4:7aff:fe6f:20a0%ix0 prefixlen 64 scopeid 0x1         inet6 2607:f3e0:0:6:ec4:7aff:fe6f:20a0 prefixlen 64 autoconf         inet 10.255.255.132 netmask 0xffffff00 broadcast 10.255.255.255         media: Ethernet autoselect (1000baseT )         status: active         nd6 options=23 0.000u 1.251s 0:01.25 100.0%    167+198k 0+0io 0pf+0w 0(nfs3b2)# vs % time ifconfig -v cxl0 cxl0: flags=8843 metric 0 mtu 1500 options=6ec07bb         ether 00:07:43:60:c4:b0         inet 10.251.12.1 netmask 0xffffff00 broadcast 10.251.12.255         media: Ethernet 10Gbase-Twinax         status: active         nd6 options=29         plugged: SFP/SFP+/SFP28 Unknown (Copper pigtail)         vendor: OEM PN: SFP-H10GB-CU5M SN: S220304060201 DATE: 2022-03-24 0.000u 0.002s 0:00.02 0.0%      0+0k 0+0io 0pf+0w Going through truss, the delay seems to be after "ioctl(3,SIOCGIFSTATUS,0x65d9929d0f0)             ERR#22 'Invalid argument'" socket(PF_INET,SOCK_DGRAM|SOCK_CLOEXEC,0)        = 6 (0x6) ioctl(6,SIOCGIFINDEX,0x65d9929cbf0)              = 0 (0x0) close(6)                                         = 0 (0x0) ioctl(5,SIOCGDEFIFACE_IN6,0x65d9929cca0)         = 0 (0x0) close(5)                                         = 0 (0x0)         nd6 options=23 write(1,"\tnd6 options=23; Tue, 26 Sep 2023 07:28:50 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rvrvk1m3vz4R7V for ; Tue, 26 Sep 2023 07:28:50 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi by home.opsec.eu with local (Exim 4.96 (FreeBSD)) (envelope-from ) id 1ql2Ur-000LDI-01; Tue, 26 Sep 2023 09:28:41 +0200 Date: Tue, 26 Sep 2023 09:28:40 +0200 From: Kurt Jaeger To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: ifconfig -v ix0 output delay Message-ID: <20230926072840.GA81481@home.opsec.eu> References: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-Rspamd-Queue-Id: 4Rvrvk1m3vz4R7V Hi! > A small annoyance, but I was wondering why "ifconfig -v ix0" seems to take > a "long time" compared to other 10G nics. e.g. [...] Which version of the ix driver did you load ? The base one or the one from the ports, net/intel-ix-kmod ? I'm not sure freebsd@intel.com is reading this list, so maybe pointing them to the issue via some PR would be useful. -- pi@opsec.eu +49 171 3101372 Now what ? From nobody Tue Sep 26 09:03:30 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rvv122h4Tz4tsQ3 for ; Tue, 26 Sep 2023 09:03:34 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rvv1228dPz4dmY; Tue, 26 Sep 2023 09:03:34 +0000 (UTC) (envelope-from kp@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695719014; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NccwK/aDqXGPDjSqVx/0oNiyLI22mp8Fwa/w56W0pvY=; b=QKH9H20st7XpfjlpLzBZC3V6gCMPPTkwsJK6cRHRwFgBlj5d72y8xUsPvFd3FML7rNhLfM WZcmNJAJdBgbgWs1B5+BzF/FLQgS6lm6h91jylIhFaOtWuIqOKmqiWxZAWvekw5wdlxIGL clbe5fnpm2FI0gKZ5Km+boTAdTv3XMwpdc+DvREjDN/Ke47x1LwDVKLcF5fl/rbF40Ktpp y/zQ7v0V4g1nmT45sMInur+DM8WhelDL7VHSp60eijxii+2gFmIi4JLu3OFc+6f22UPaxB SAPKjtyry4V/jW2uLE4V+Oy5mJeIkCB4G4ZzHY1+t37AFINwUA/CRC4vAu94cw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695719014; a=rsa-sha256; cv=none; b=ir8VwrJfemEdAuFgRIXw3fy4XgUgFL7mD+kAwF1yXrt9m0HDE8ttmf5pzzI7iXZXJQSlhs KyfhL61l1O/+Ob+wZqr211OTPbREupJcdrqwFMeNZs4Obf3b4H2P8Q2bAOxS/bV3gox3Al wt8WYBnGJ7rCRhPf8nN/U66/OLOM9RAGlNFegBnSbgI6e+Uq671muHkA0MWo7fsCo4EbWx cVFdm8Kpy6XmahlY3QnUllDdQ3Yee9mywqGFaVNJZjuoeQ9Pmvw1Rtk/R8uk7lc1VmMufv dr+yCRh8RB+caGRMGbCYnV9uxi+tjZuUSKutB+JEWggz7l/BCYRn/kwdcbsoNA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695719014; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NccwK/aDqXGPDjSqVx/0oNiyLI22mp8Fwa/w56W0pvY=; b=SRqeRfFYgGNNe2pMyJ0sEUHZS8m6LjVR8DKjzbYpP49xQcgAGpKiEnJvbulzdJielSmhg2 QSz06jYhZ89ZTcxcYXQafl1pdYdwiO9KeAJNWzeETxoOjX98ut9wx63LovUdc+0eKCGn9I rJHBPEb5glBod2p5v1pKxSfsZaU5FtU31iW30XLhP5fXZB84dO+FwqYYphS3A32iUhPZru A7zkAh/PR8nVk6L9ctBf3butEiTYGKjla7KTUFU8oIq6aqEUqUoqeAQ071/xQcjb4DQv/g elPtiYIyChH0Zn0TwnaLw55xp8sBf/6f4q2yALL7bVx5ZsndKSw+h/bIdUyuAA== Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx1.codepro.be", Issuer "R3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rvv120bpfz8C7; Tue, 26 Sep 2023 09:03:33 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id CFB243F01F; Tue, 26 Sep 2023 11:03:31 +0200 (CEST) From: Kristof Provost To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: ifconfig -v ix0 output delay Date: Tue, 26 Sep 2023 11:03:30 +0200 X-Mailer: MailMate (1.14r5937) Message-ID: <4AEC7301-88C7-4F42-AFDA-89461AF5B647@FreeBSD.org> In-Reply-To: References: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 25 Sep 2023, at 23:12, mike tancsa wrote: > Hi All, > > =C2=A0=C2=A0=C2=A0 A small annoyance, but I was wondering why "ifconfig= -v ix0" seems to take a "long time" compared to other 10G nics.=C2=A0 e.= g. > > > 0(nfs3b2)# time ifconfig -v ix0 > ix0: flags=3D8863 metric 0 mtu = 1500 > options=3D4e53fbb > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ether 0c:c4:7a:6f:20:a0 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet6 fe80::ec4:7aff:fe6f:20= a0%ix0 prefixlen 64 scopeid 0x1 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet6 2607:f3e0:0:6:ec4:7aff= :fe6f:20a0 prefixlen 64 autoconf > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet 10.255.255.132 netmask = 0xffffff00 broadcast 10.255.255.255 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 media: Ethernet autoselect (= 1000baseT ) > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 status: active > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 nd6 options=3D23 > 0.000u 1.251s 0:01.25 100.0%=C2=A0=C2=A0=C2=A0 167+198k 0+0io 0pf+0w > 0(nfs3b2)# > > vs > > % time ifconfig -v cxl0 > cxl0: flags=3D8843 metric 0 mtu= 1500 > options=3D6ec07bb > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ether 00:07:43:60:c4:b0 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 inet 10.251.12.1 netmask 0xf= fffff00 broadcast 10.251.12.255 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 media: Ethernet 10Gbase-Twin= ax > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 status: active > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 nd6 options=3D29 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 plugged: SFP/SFP+/SFP28 Unkn= own (Copper pigtail) > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 vendor: OEM PN: SFP-H10GB-CU= 5M SN: S220304060201 DATE: 2022-03-24 > 0.000u 0.002s 0:00.02 0.0%=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 0+0k 0+0io 0pf= +0w > > > Going through truss, the delay seems to be after "ioctl(3,SIOCGIFSTATUS= ,0x65d9929d0f0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 ERR#22 'Invalid argument'" > > > socket(PF_INET,SOCK_DGRAM|SOCK_CLOEXEC,0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0 =3D 6 (0x6) > ioctl(6,SIOCGIFINDEX,0x65d9929cbf0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0 (0x0) > close(6)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0 (0x0) > ioctl(5,SIOCGDEFIFACE_IN6,0x65d9929cca0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 =3D 0 (0x0) > close(5)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0 (0x0) > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 nd6 options=3D23 > write(1,"\tnd6 options=3D23 ioctl(3,SIOCGIFSTATUS,0x65d9929d0f0)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 ERR#22 'Invalid argument' > > > > ioctl(4,SIOCGI2C,0x65d9929ca50)=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 =3D 0 (0x0) It=E2=80=99s this call. That ends up in ixgbe_read_i2c_byte_generic_int()= , where it=E2=80=99ll retry 11 times, taking roughly 100ms per attempt. I either do not understand how SFP type and presence detection is done, o= r it=E2=80=99s broken, so I=E2=80=99ve not yet been able to persuade it t= o be less awful. Ideally the Intel people should take a look at this. Best regards, Kristof From nobody Tue Sep 26 10:16:01 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rvwcj5Zdyz4txYG for ; Tue, 26 Sep 2023 10:16:05 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rvwcj3hp8z3GPC for ; Tue, 26 Sep 2023 10:16:05 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi by home.opsec.eu with local (Exim 4.96 (FreeBSD)) (envelope-from ) id 1ql56n-000MP4-26; Tue, 26 Sep 2023 12:16:01 +0200 Date: Tue, 26 Sep 2023 12:16:01 +0200 From: Kurt Jaeger To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: ifconfig -v ix0 output delay Message-ID: <20230926101601.GB81481@home.opsec.eu> References: List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-Rspamd-Queue-Id: 4Rvwcj3hp8z3GPC Hi! >A small annoyance, but I was wondering why "ifconfig -v ix0" seems to take > a "long time" compared to other 10G nics. e.g. I tested it on a system with ix0 (10g copper only). -v basically queries the i2c bus of the SFP+ slot, and 10g copper only probably does not have that i2c bus. That's why it's running into the timeout. Interesting problem 8-} -- pi@opsec.eu +49 171 3101372 Now what ? From nobody Tue Sep 26 12:41:30 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RvzrZ14WPz4v6Hv for ; Tue, 26 Sep 2023 12:41:34 +0000 (UTC) (envelope-from mike@sentex.net) Received: from smarthost1.sentex.ca (smarthost1.sentex.ca [IPv6:2607:f3e0:0:1::12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smarthost1.sentex.ca", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4RvzrY6JR3z3VCD; Tue, 26 Sep 2023 12:41:33 +0000 (UTC) (envelope-from mike@sentex.net) Authentication-Results: mx1.freebsd.org; none Received: from pyroxene2a.sentex.ca (pyroxene19.sentex.ca [199.212.134.19]) by smarthost1.sentex.ca (8.17.1/8.16.1) with ESMTPS id 38QCfVI0031698 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=FAIL); Tue, 26 Sep 2023 08:41:31 -0400 (EDT) (envelope-from mike@sentex.net) Received: from [IPV6:2607:f3e0:0:4:5d3:ad9d:dff7:8fa0] ([IPv6:2607:f3e0:0:4:5d3:ad9d:dff7:8fa0]) by pyroxene2a.sentex.ca (8.17.1/8.15.2) with ESMTPS id 38QCfUnU002169 (version=TLSv1.3 cipher=TLS_AES_128_GCM_SHA256 bits=128 verify=NO); Tue, 26 Sep 2023 08:41:31 -0400 (EDT) (envelope-from mike@sentex.net) Message-ID: <14cd1c6b-0020-4116-a3de-0b7399810bee@sentex.net> Date: Tue, 26 Sep 2023 08:41:30 -0400 List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: ifconfig -v ix0 output delay Content-Language: en-US To: Kurt Jaeger Cc: FreeBSD-STABLE Mailing List References: <20230926072840.GA81481@home.opsec.eu> From: mike tancsa Autocrypt: addr=mike@sentex.net; keydata= xsBNBFywzOMBCACoNFpwi5MeyEREiCeHtbm6pZJI/HnO+wXdCAWtZkS49weOoVyUj5BEXRZP xflV2ib2hflX4nXqhenaNiia4iaZ9ft3I1ebd7GEbGnsWCvAnob5MvDZyStDAuRxPJK1ya/s +6rOvr+eQiXYNVvfBhrCfrtR/esSkitBGxhUkBjOti8QwzD71JVF5YaOjBAs7jZUKyLGj0kW yDg4jUndudWU7G2yc9GwpHJ9aRSUN8e/mWdIogK0v+QBHfv/dsI6zVB7YuxCC9Fx8WPwfhDH VZC4kdYCQWKXrm7yb4TiVdBh5kgvlO9q3js1yYdfR1x8mjK2bH2RSv4bV3zkNmsDCIxjABEB AAHNHW1pa2UgdGFuY3NhIDxtaWtlQHNlbnRleC5uZXQ+wsCOBBMBCAA4FiEEmuvCXT0aY6hs 4SbWeVOEFl5WrMgFAl+pQfkCGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQeVOEFl5W rMiN6ggAk3H5vk8QnbvGbb4sinxZt/wDetgk0AOR9NRmtTnPaW+sIJEfGBOz47Xih+f7uWJS j+uvc9Ewn2Z7n8z3ZHJlLAByLVLtcNXGoRIGJ27tevfOaNqgJHBPbFOcXCBBFTx4MYMM4iAZ cDT5vsBTSaM36JZFtHZBKkuFEItbA/N8ZQSHKdTYMIA7A3OCLGbJBqloQ8SlW4MkTzKX4u7R yefAYQ0h20x9IqC5Ju8IsYRFacVZconT16KS81IBceO42vXTN0VexbVF2rZIx3v/NT75r6Vw 0FlXVB1lXOHKydRA2NeleS4NEG2vWqy/9Boj0itMfNDlOhkrA/0DcCurMpnpbM7ATQRcsMzk AQgA1Dpo/xWS66MaOJLwA28sKNMwkEk1Yjs+okOXDOu1F+0qvgE8sVmrOOPvvWr4axtKRSG1 t2QUiZ/ZkW/x/+t0nrM39EANV1VncuQZ1ceIiwTJFqGZQ8kb0+BNkwuNVFHRgXm1qzAJweEt RdsCMohB+H7BL5LGCVG5JaU0lqFU9pFP40HxEbyzxjsZgSE8LwkI6wcu0BLv6K6cLm0EiHPO l5G8kgRi38PS7/6s3R8QDsEtbGsYy6O82k3zSLIjuDBwA9GRaeigGppTxzAHVjf5o9KKu4O7 gC2KKVHPegbXS+GK7DU0fjzX57H5bZ6komE5eY4p3oWT/CwVPSGfPs8jOwARAQABwsB2BBgB CAAgFiEEmuvCXT0aY6hs4SbWeVOEFl5WrMgFAl+pQfkCGwwACgkQeVOEFl5WrMiVqwf9GwU8 c6cylknZX8QwlsVudTC8xr/L17JA84wf03k3d4wxP7bqy5AYy7jboZMbgWXngAE/HPQU95NM aukysSnknzoIpC96XZJ0okLBXVS6Y0ylZQ+HrbIhMpuQPoDweoF5F9wKrsHRoDaUK1VR706X rwm4HUzh7Jk+auuMYfuCh0FVlFBEuiJWMLhg/5WCmcRfiuB6F59ZcUQrwLEZeNhF2XJV4KwB Tlg7HCWO/sy1foE5noaMyACjAtAQE9p5kGYaj+DuRhPdWUTsHNuqrhikzIZd2rrcMid+ktb0 NvtvswzMO059z1YGMtGSqQ4srCArju+XHIdTFdiIYbd7+jeehg== In-Reply-To: <20230926072840.GA81481@home.opsec.eu> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Scanned-By: MIMEDefang 2.84 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA] X-Rspamd-Queue-Id: 4RvzrY6JR3z3VCD On 9/26/2023 3:28 AM, Kurt Jaeger wrote: > Hi! > >> A small annoyance, but I was wondering why "ifconfig -v ix0" seems to take >> a "long time" compared to other 10G nics. e.g. > [...] > > Which version of the ix driver did you load ? The base one or > the one from the ports, net/intel-ix-kmod ? I'm not sure > freebsd@intel.com is reading this list, so maybe pointing > them to the issue via some PR would be useful. This is just the base driver, built in ix with copper PHY  pciconf -lvcb ix0 ix0@pci0:1:0:0: class=0x020000 rev=0x01 hdr=0x00 vendor=0x8086 device=0x1528 subvendor=0x15d9 subdevice=0x1528     vendor     = 'Intel Corporation'     device     = 'Ethernet Controller 10-Gigabit X540-AT2'     class      = network     subclass   = ethernet     bar   [10] = type Prefetchable Memory, range 64, base 0xc7c00000, size 2097152, enabled     bar   [18] = type I/O Port, range 32, base 0x6020, size 32, enabled     bar   [20] = type Prefetchable Memory, range 64, base 0xc7e04000, size 16384, enabled     cap 01[40] = powerspec 3  supports D0 D3  current D0     cap 05[50] = MSI supports 1 message, 64 bit, vector masks     cap 11[70] = MSI-X supports 64 messages, enabled                  Table in map 0x20[0x0], PBA in map 0x20[0x2000]     cap 10[a0] = PCI-Express 2 endpoint max data 256(512) FLR NS                  max read 512                  link x8(x8) speed 5.0(5.0) ASPM disabled(L0s/L1)     ecap 0001[100] = AER 2 0 fatal 0 non-fatal 1 corrected     ecap 000e[150] = ARI 1     ecap 0010[160] = SR-IOV 1 IOV disabled, Memory Space disabled, ARI disabled                      0 VFs configured out of 64 supported                      First VF RID Offset 0x0180, VF RID Stride 0x0002                      VF Device ID 0x1515                      Page Sizes: 4096 (enabled), 8192, 65536, 262144, 1048576, 4194304     ecap 000d[1d0] = ACS 1 Source Validation unavailable, Translation Blocking unavailable                      P2P Req Redirect unavailable, P2P Cmpl Redirect unavailable                      P2P Upstream Forwarding unavailable, P2P Egress Control unavailable                      P2P Direct Translated unavailable, Enhanced Capability unavailable From nobody Tue Sep 26 13:33:45 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rw10y6YqJz4v9Tf for ; Tue, 26 Sep 2023 13:33:54 +0000 (UTC) (envelope-from pi@freebsd.org) Received: from home.opsec.eu (home.opsec.eu [IPv6:2001:14f8:200::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rw10y3R56z3g3L for ; Tue, 26 Sep 2023 13:33:54 +0000 (UTC) (envelope-from pi@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from pi by home.opsec.eu with local (Exim 4.96 (FreeBSD)) (envelope-from ) id 1ql8C9-000Np0-35; Tue, 26 Sep 2023 15:33:45 +0200 Date: Tue, 26 Sep 2023 15:33:45 +0200 From: Kurt Jaeger To: mike tancsa Cc: FreeBSD-STABLE Mailing List Subject: Re: ifconfig -v ix0 output delay Message-ID: <20230926133345.GC81481@home.opsec.eu> References: <20230926072840.GA81481@home.opsec.eu> <14cd1c6b-0020-4116-a3de-0b7399810bee@sentex.net> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <14cd1c6b-0020-4116-a3de-0b7399810bee@sentex.net> X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12502, ipnet:2001:14f8::/32, country:DE] X-Rspamd-Queue-Id: 4Rw10y3R56z3g3L Hi! > > > A small annoyance, but I was wondering why "ifconfig -v ix0" seems to take > > > a "long time" compared to other 10G nics. e.g. > > [...] > > > > Which version of the ix driver did you load ? The base one or > > the one from the ports, net/intel-ix-kmod ? I'm not sure > > freebsd@intel.com is reading this list, so maybe pointing > > them to the issue via some PR would be useful. > > This is just the base driver, built in ix with copper PHY I tested it with two ports on a 13.2p3 box with the port intel-ix-kmod in version 3.3.35 and the ports behave like you have observed: ix NICs with SFP+ cage display the optics info, if available. ix NICs with copper-port have approx. 0.4s delay. I guess that the driver should know if a certain model of the NIC has a SFP+ cage with some i2c bus -- and if it's copper-only, it should not query the bus. -- pi@opsec.eu +49 171 3101372 Now what ? From nobody Tue Sep 26 17:17:56 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Rw5zW0BKXz4vQLP for ; Tue, 26 Sep 2023 17:17:59 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Rw5zV6p6Qz4fRM; Tue, 26 Sep 2023 17:17:58 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695748679; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dx/6va4IIh0recdLk649KQOQZC9aykEDWE9p1d3RQ0g=; b=k1SkWdq/NCVl5r9NEXLAq7BQ2qAZNvKcA2esu3OdaxCojokU9Gc2o3ovgysIyusCzz/OEw RAYhLElwfMSVHdwjhCLSJN+lJySRBzGm2/2tItI7C5Ldy+tNp05ffwBuCCNDLhDlVJXI1H G05196j0HjmXiJjsVPAwDhPpVXiOqAGTk3qSyhRazMStYaFrV6LnWjoZ83+TWypUhZeE7k oSWBKMlFq7TAvQV3BzIfLd39V9nNWJAu8Do25DLIEzodUcAGTevWkZD45dnqiy6anGMyUx ijjH+gMqTZYk5WDIpMa6Kr23dQfGJqD+p9jxFCa1mHqestOSrHZJ4x1OOPQcIw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1695748679; a=rsa-sha256; cv=none; b=bBKhtpqYc8Fc0QfL/gv2qfWujFswaRz+o9Y1QJEYKgOb5ID5aKPy9c/fV+e1sGFurUV9zt O5OfTf7UBVv+X1dLQ4tA9MEViPnvkd21H+P3Uch3kBzQ4/6oK4KmCcl1LZX8FO8h4vgXeS COGBNgdMQGYD7SjXgUe45wH3GILLmK1NSnS3kXAeUC6s5BxjwlwL9oEfTrujmKIdh3vxdS 6ZVDjICjQ3Uo6vjPdfqIZdwUi91oSe38oDizlZnGV1tr5rGIB8Nj5Ag9QAuMTOyk77z+ua G5xUAkrN352p7kBjnuYPwf+6yGzxcuDJqmvtPhWcvQbOcACloF49ESaWaq15OQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1695748678; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=dx/6va4IIh0recdLk649KQOQZC9aykEDWE9p1d3RQ0g=; b=VI926FjISFLoIHmddcnzWdpamhsHbTbM3F6wXFmWsuGRAUNuUt8RxNGNM0roVDCCsO4+FJ kUrA9KwAEA6ZMvdm8l0s3dAeUPYO+AnvWRXgxrzy9QqAO3ofemAPyGgl2MsDuFJyGVlWRY sNiYKD8P701YGHGryVmbppWC14rLcbM7sYq5odzCMPDqEQN1sLBDi4IcmjeMw/0YgTeKus c+xAM8OJbequMpSq2wYlth+bUcVU5edLBWLOTXweiasljrj8ayCrlCjDHnM8lQjbvSsppT TGxDqL051KKjY6cwBflKFvoc71EP+xzXXpUpFFTwH3/TMqte0afoJCeiArjCgw== Received: from ltc.des.no (205.22.65.37.rev.sfr.net [37.65.22.205]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4Rw5zV55sKzn4q; Tue, 26 Sep 2023 17:17:58 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id 4B4591088D; Tue, 26 Sep 2023 19:17:56 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Doug Hardie Cc: Alain Zscheile , freebsd-stable@freebsd.org Subject: Re: local-unbound stopped working after upgrade to 13.2 In-Reply-To: (Doug Hardie's message of "Sat, 23 Sep 2023 15:20:02 -0700") References: <1a11ae16-7425-6d5a-c864-0005343b678c@ytrizja.de> <413c02d2-89bd-96c7-5999-ee789b6ed97b@ytrizja.de> <61C47FC1-43A5-4511-A034-D89E60DFF10E@sermon-archive.info> <867comscqv.fsf@ltc.des.no> <86B400F5-01AB-4623-BAF0-6332E3B0CA2F@sermon-archive.info> <86v8c6qwhv.fsf@ltc.des.no> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Tue, 26 Sep 2023 19:17:56 +0200 Message-ID: <864jjgc0qj.fsf@ltc.des.no> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Doug Hardie writes: > Local unbound sometimes is local_unbound and sometime local-unbound. > I found it difficult to remember which form to use and usually had to > try a couple times to get it right. It's called local-unbound everywhere except where syntax rules prohibit the use of a hyphen. DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Sat Sep 30 01:32:36 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Ry8pv0V0zz4v3Hx; Sat, 30 Sep 2023 01:32:39 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Ry8pv0DHTz4HZ8; Sat, 30 Sep 2023 01:32:39 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1696037559; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=KSoiKBSkRFbFA9j11w9ncFRxYkDACc0wbKyY3aknxsI=; b=ZGQgLxFnd+8/IobEPgEmRQzYODPXOadwAixhAl3ELKfljUa/RTi86fPF25Py9jFg2EnvO3 UGqT3a+mWfu2KGw6qv+o2biYgJVVoX+BAUkVuHHMZEbA3EKpEbgh3xonnOM6v44oxkgzVe nTVGCwumeDfFCi0zfRM9Eo7vPGkwl//DLvVVPnAPn59/+w7a0GhmSF8e3acxA3Qt8Z2rXs wM43e5p0KW72hQqu99mcVJRkmdg5XubFOfuvnRUkLrszgERxubOdUo/rxs8jall4LOHkHU FW23KuqFSYF+b5kWtXCISnffNUa26phNau7R+TN0dEiFhGsvhroFEGyTfEGWsA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1696037559; a=rsa-sha256; cv=none; b=x4/TEqmJ6CE+5HsVgyYLhMnolyjAb05twY80acsvh/fL44GNMHltnzrmYLTPaCuAmix3hl r9FH2KdmLPXNQ8y0s431m6YpZcKrFMoroz1PP/56pZnBjpDU4NHrSkVqFSRR9FXMgnQ808 bZ4++nigncOuv+GVVMTr2/65zfm1CxT8J1Tq01R9ERtiZya7rri4qhrrpMpL9sh7yPLPWM TBX77kowiwqQuhBNAQrH3eHR1Otbxzf4rn+MAQHjW4evp5MA7Up4/s082cyogTGiDRxWvV afDaMwgsHGKpbp9HWXcwg7oo1RrK2bY3IghFEooMebbDZ6Vzp47IXM/m03rZLw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1696037559; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=KSoiKBSkRFbFA9j11w9ncFRxYkDACc0wbKyY3aknxsI=; b=VLkw8X6Ohj5oUsyzpz7Mzav2+re+DjqcxJz5qQSnHieJZD0iZNDTEGxnibmhQ8jJkV7lW7 J6ZfGwUZEAtf1ORti9XutcGB+S6US/CnURsE1eOLE14j50Ixn9tCeNIAwHhSq8l1+fcwqx m26E4YIsbdUluMkxfQcmjUKEJbwgSjVERnzV/TH/abai+t0btV05lYJLuhUouC22vX408V 8KDOWSC8g05Xvkj/Mpf+BocbFArA/pNb17jIBUqbQmu0QAf8ltXx7nNOZKmwnbjas0BKCr zTgGS+b9xe+uByaIUYo6thG3MEGabw+1wP+1+39CHhhsddjQ85lxEUT2HD1JIQ== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id ABC10602A; Sat, 30 Sep 2023 01:32:38 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Sat, 30 Sep 2023 01:32:36 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org Cc: re@freebsd.org Subject: FreeBSD 14.0-BETA4 Now Available Message-ID: <20230930013236.GH1289@FreeBSD.org> List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The fourth BETA build of the 14.0-RELEASE release cycle is now available. Installation images are available for: o 14.0-BETA4 amd64 GENERIC o 14.0-BETA4 i386 GENERIC o 14.0-BETA4 powerpc GENERIC o 14.0-BETA4 powerpc64 GENERIC64 o 14.0-BETA4 powerpc64le GENERIC64LE o 14.0-BETA4 powerpcspe MPC85XXSPE o 14.0-BETA4 armv7 GENERICSD o 14.0-BETA4 aarch64 GENERIC o 14.0-BETA4 aarch64 RPI o 14.0-BETA4 aarch64 PINE64 o 14.0-BETA4 aarch64 PINE64-LTS o 14.0-BETA4 aarch64 PINEBOOK o 14.0-BETA4 aarch64 ROCK64 o 14.0-BETA4 aarch64 ROCKPRO64 o 14.0-BETA4 riscv64 GENERIC o 14.0-BETA4 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.0" branch. A summary of changes since 14.0-BETA3 includes: o A fix for a pnwerpc-related panic. o Console output on Raspberry Pi 3B+ and 4B have been silenced at boot. o A fix to freebsd=update(8) had been implemented to avoid restarting sshd(8) when updating the basedir. o Support for hidraw(4) has been added. o Several ZFS-related fixes. o Several VFS-related fixes. o Several miscellaneous fixes and driver updates. A list of changes since 13.2-RELEASE is available in the releng/14.0 release notes: https://www.freebsd.org/releases/14.0R/relnotes/ Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 14.0-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, and aarch64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA4/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.0-BETA4/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.0/BETA4 /aws/service/freebsd/amd64/base/zfs/14.0/BETA4 FreeBSD/aarch64 EC2 AMI IDs can be retrieved from the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/aarch64/base/ufs/14.0/BETA4 /aws/service/freebsd/aarch64/base/zfs/14.0/BETA4 === Vagrant Images === FreeBSD/amd64 images are not available for this build. === Upgrading === IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT Due to an issue where an existing file had been replaced by a directory with the same name, binary upgrades from 13.2 and earlier using the freebsd-update(8) utility will not work. A patch is currently in the main branch, and expected to be included in supported release branches before the next build. IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT IMPORTANT The freebsd-update(8) utility supports binary upgrades of amd64, i386, and aarch64 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 14.0-BETA4 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 14.0-BETA4 amd64 GENERIC: SHA512 (FreeBSD-14.0-BETA4-amd64-bootonly.iso) = f50ce06dfa312ddb906c54129b5da99000a574b6c6284352d1add5ee5ec41eca56a217de07df5a6170f884b1a842cad9c3725b18c23f9e45c40fc4b42f558ec1 SHA512 (FreeBSD-14.0-BETA4-amd64-bootonly.iso.xz) = b3161d57fb6a84381ea0eb5ace315dc8eac0adf7222c1854a3db1d7e3140117b67d18196d50939620306d504278811a01cb114a67ee7d22b7001b65d0181dc17 SHA512 (FreeBSD-14.0-BETA4-amd64-disc1.iso) = 6c34169ab359d45fab14252d135b6d672f446562f1943e89d5a6fe69a2b5ad303518877d1d67a963dbbea8fb0936a39c8b5da5c9cc60a5f506db663bc30349d1 SHA512 (FreeBSD-14.0-BETA4-amd64-disc1.iso.xz) = 52b3425b269d3449b60cd5cbc592e41f63343d4ec59a3179242b8a65610a85b13ebb2e8b0814cfd876dd180c8b50b574807459e367b13d05d71f0a5268098008 SHA512 (FreeBSD-14.0-BETA4-amd64-dvd1.iso) = 9e2e422a5c483918ba04f03b3bd408aeb599ae58aefce187bb116b9ba9c763340a7033fe5fd26cff914ff6048cc569bd4331cfeac4b692ddc67d0ca464cd7e42 SHA512 (FreeBSD-14.0-BETA4-amd64-dvd1.iso.xz) = 6e6de2de8eea6a25c768079fda80af4b0381bdae272102fb517eb521df90e3adb692ac21cbd01eefeba769005b710836fdcf00becc4435aaab6efc6e67eb9e7a SHA512 (FreeBSD-14.0-BETA4-amd64-memstick.img) = 69ef43b5d76e0d0d3fd7daf70c5eda4bb7b9446442497a5dc5ca1da2054de4c8583970dfc6b97fff82b2ce46ee02c617831be2eb52c1bc1bb43bdbf0beaec10e SHA512 (FreeBSD-14.0-BETA4-amd64-memstick.img.xz) = 9262c5ae3de7c237399161d9ffd61625adc7ac6de30345b1bdbe7986653e108b3ade5c800c3fe03b6a863d33fbe33b4904da816c11688a42d9f48408157c9e45 SHA512 (FreeBSD-14.0-BETA4-amd64-mini-memstick.img) = 6ec9c113b000692056da7e5534ca7c4a99558b2adb27dd36de2e733cb9d325127171d0b65ba76dcb461f83ee9f0cc6282502d94c9bf1dbec3e525337036ccc81 SHA512 (FreeBSD-14.0-BETA4-amd64-mini-memstick.img.xz) = ea1b2394dcca1c9870f8aec66de200cc2663247c53b78dfcb0fc7df5e7adb89367db64b16ef338e649a72b9260d2eb12592817852273612d9d2729edd5047a24 SHA256 (FreeBSD-14.0-BETA4-amd64-bootonly.iso) = d7eb876f2f49d56e4c273a26f870281e947af986f5a989d85653140fee8f3004 SHA256 (FreeBSD-14.0-BETA4-amd64-bootonly.iso.xz) = 49085e6983581526c0e85d2b8b4f2bc03369a00d981dc8e5f4eb0110a773c40f SHA256 (FreeBSD-14.0-BETA4-amd64-disc1.iso) = 85c17cd47ef03c7d518750e9f4cc1c543fa833c2e17d2c152bb7b45fc8db85c1 SHA256 (FreeBSD-14.0-BETA4-amd64-disc1.iso.xz) = b2a040287c5a7e0a891028cbfd440782386fc902d9365fc78d5a94b79269d5d2 SHA256 (FreeBSD-14.0-BETA4-amd64-dvd1.iso) = b71169959ac684513e63eac46b2514aa4ed7259b776fe1cbe324e09fcc3f9966 SHA256 (FreeBSD-14.0-BETA4-amd64-dvd1.iso.xz) = 69c5863a3b5af48d0e599c04416e6b9e46cfed9b1cfa8e5359635ba52547e8a3 SHA256 (FreeBSD-14.0-BETA4-amd64-memstick.img) = 34c753dfbce9c3e3ce5147741805dfb66e1b87f3ef9e3dbd065e41350946f24e SHA256 (FreeBSD-14.0-BETA4-amd64-memstick.img.xz) = c0fc2079d6c06999cee6287c29cb40fb837ae6cca0878c278362a3e1a90cc5e2 SHA256 (FreeBSD-14.0-BETA4-amd64-mini-memstick.img) = 820a076686b8cbce553a8c160e06bb1d64ff312368941a42d74e74bea31b8143 SHA256 (FreeBSD-14.0-BETA4-amd64-mini-memstick.img.xz) = 99d7c4d4cdd8b05f805f73f92ec4ccb8be98f4877ecf419a480d6a3bc376888d o 14.0-BETA4 i386 GENERIC: SHA512 (FreeBSD-14.0-BETA4-i386-bootonly.iso) = e5f90a2afe3dd58d4116bf499a748a29f4d332b254752eb4ba6bba460cef49644e253669229be97e3d85615eedc5dd49e9905a508621dda349c7b1a372c9981d SHA512 (FreeBSD-14.0-BETA4-i386-bootonly.iso.xz) = 83a41f5656223eee8cbd633c31a74c401349576cb7ade13668ac3174bfa35bd4cce9c940a9aae37f32f847a4f695c42ba2c8d97309cb3b6d6a9ac5c2a2f9c041 SHA512 (FreeBSD-14.0-BETA4-i386-disc1.iso) = 32331524209073286a9971a569c7800810b0940c3cfe78db737994dacb0becb513debb4f3c8926164022466128e523e8ef736556ba3b8f48290effb82715682c SHA512 (FreeBSD-14.0-BETA4-i386-disc1.iso.xz) = 132bbedeb3c6a7b7fd3c4f10c12e88f4bcf23f6563eaec54ec388f78dd6336c3b7ccd28acfe3798142d8de27261c5b80ec92b0ef5b41bc4d017b0ed7d446f6b0 SHA512 (FreeBSD-14.0-BETA4-i386-dvd1.iso) = 1b44e40b5a33cf2822bf5ebb6b06da067c494bd20ea887b74f276e670e4af5b6fac1e4d062fae5b2613731481bf0239b7cc307b5f0dff800d02757fa8355d582 SHA512 (FreeBSD-14.0-BETA4-i386-dvd1.iso.xz) = 267d46191bc09ddd2b22415c937af419359cfa4e69f8fe9f7d5faf3ff0a067493eb4253bc5d39ac6a625a456ca21f5783a393b9dc7ca1c04609dfa7a0d28a7a3 SHA512 (FreeBSD-14.0-BETA4-i386-memstick.img) = 1907146ce05ed307eb78c5ffbfe80012ca2cba8b29e32c860f6e8ce2c22ee83181f9995b170efe02cffcbd9d199f7a2c7d7cb76c023e40475b84ce0d226d4155 SHA512 (FreeBSD-14.0-BETA4-i386-memstick.img.xz) = 8a8dc501be1d8ad12dd3150c87b731a0391fb55fc361b56e296281ce803ea5bf6208053a3da6e4fe21aa246c44d0340fcc6478334efc1cc4f4ce5fadd4cdc758 SHA512 (FreeBSD-14.0-BETA4-i386-mini-memstick.img) = e2f2008b2871eeef8c0f8f07581afa4373091b8096da4e8da32476a1bec8a29bc71f20091c2d106a3eed2bd7650e91bfaefd4d78ff9c42bd8e75fadcd1738604 SHA512 (FreeBSD-14.0-BETA4-i386-mini-memstick.img.xz) = a416a1e3ac6cf50c7b8c42ca5cfc37ccb7d18373e072d1d53aad48fa22202c9f7c72fd6e3b27dbcf20103f7a7fd0aeb8d25e292b22f9b3faa5e553b892f9816e SHA256 (FreeBSD-14.0-BETA4-i386-bootonly.iso) = 7b22501914317260c5d52db4675e60aaab9be1088fba2e7b837f95d691349a5d SHA256 (FreeBSD-14.0-BETA4-i386-bootonly.iso.xz) = 44884ee24d5c861371a41944ea5f7777460c3f1048bf3c4d078bf063d80d900d SHA256 (FreeBSD-14.0-BETA4-i386-disc1.iso) = a1587ed3df97f1cf7cfe6e5c39ec47a44e87b44e08e2bd3412f3773a2bfa6e4d SHA256 (FreeBSD-14.0-BETA4-i386-disc1.iso.xz) = c22cfd84789731cb786bd7e7ed5bbea2d05b301eee8096b0d26f266c9c3851b9 SHA256 (FreeBSD-14.0-BETA4-i386-dvd1.iso) = c555985882c90bc2ea379a7db68f173629ce14eb40ffa078e777f217452b7791 SHA256 (FreeBSD-14.0-BETA4-i386-dvd1.iso.xz) = 4f455c67cc4aa9b20819ceb7f695f68977ab07dc502ffc3c2a42133cf7f98137 SHA256 (FreeBSD-14.0-BETA4-i386-memstick.img) = 737b3625e4058a482e31e1f2a050ec356f655b7b1c4b5c44cef26ea877815abd SHA256 (FreeBSD-14.0-BETA4-i386-memstick.img.xz) = ef87a24782c51794c8ea2463d41fa1eaa2baf52d11fab37916da1807a08b5d80 SHA256 (FreeBSD-14.0-BETA4-i386-mini-memstick.img) = 851c0ce5125e7923db8481faec424ca978f1598cf2ff78bf63e93166b06c4fa8 SHA256 (FreeBSD-14.0-BETA4-i386-mini-memstick.img.xz) = f16e86d89d1e5bd4243b2c9fb5675f093bfca7a0c75678e5297e156fa2d1bf5b o 14.0-BETA4 powerpc GENERIC: SHA512 (FreeBSD-14.0-BETA4-powerpc-bootonly.iso) = 2e788d1593fed78ed072230acc0f662eef7670eb127e99db860235da0ce0701b913718caf841779fc77bf6c1492fd55bc7bc49775e53a561e5f8b5e025382fc7 SHA512 (FreeBSD-14.0-BETA4-powerpc-bootonly.iso.xz) = 8a44addecfe8b0b0f0a7e46861a21784e43e6688c298189f3107b189d9c748c5bbcf10adba935808b4829a2e5081ecf9f3cc9f569355642ceda5235e8be21bc3 SHA512 (FreeBSD-14.0-BETA4-powerpc-disc1.iso) = 4ca4436d3d2881019af9114c137b01d0363817d917066b8c4cb87b4fb4715bc5abb22013eb8c633a626d39442ca723411cbb8fa056495b381bef6543daa133a3 SHA512 (FreeBSD-14.0-BETA4-powerpc-disc1.iso.xz) = 5974dd36e67c633d057f88e7a1ddb18a2c243aab9f24568b20d978f632df8c14fbc01a0654179224b56b6190d372badd9acad068b8a7868e9688462c03d291a8 SHA256 (FreeBSD-14.0-BETA4-powerpc-bootonly.iso) = 3464a74326cf32a1222fb7c80b0de9806f776d8ecac935a4b41fa7155bfde536 SHA256 (FreeBSD-14.0-BETA4-powerpc-bootonly.iso.xz) = 821a1d405c341919d384f098211e9479438ed80d87bd35d2a222fa9d492c3e3b SHA256 (FreeBSD-14.0-BETA4-powerpc-disc1.iso) = 74194e823ce81fedc4bd26dccd66164f1e2bc1896e2006251880ab719029dc47 SHA256 (FreeBSD-14.0-BETA4-powerpc-disc1.iso.xz) = 702c6c7a7849b3fb47423ee6d70dec037b438320dff26c333fbaf7524c0b2a04 o 14.0-BETA4 powerpc64 GENERIC64: SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64-bootonly.iso) = 3ba069756f76acd965182bbed9aba76665c94b39270a09c2101eea8f81e3355a09a07c319d00321e7bd947eeb4f39d1086d9505f5f5edd90347ad94f4f594712 SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64-bootonly.iso.xz) = fc3d658a937a6eb395fdab3d5b07d25a3bc2efb10396ac7ca74fa1904fdf656eb0ce3ee49689e5e32fbbbd3a3b67aadfa17e532a5bb0a52a327efd0a567c7876 SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64-disc1.iso) = e6c59a6de338da36255d635421fd19b76de420259001218fb95969e3dea2eb7faa91860a7686bbe210a74e96f9bd82bb1bf4009fc11515327383fd2b09b2099c SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64-disc1.iso.xz) = 1ef6ee7accde55bb736559b2c25328eb5782bb9ed725041c33b0e955293b82f215bddc21138c9d2ea96cc71f00dc4cb2a9bad1c14d470f756bfcebd100377184 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64-bootonly.iso) = de23c91be7ed4fbf9f05b8c9a66faab28c4e545ec579c87661bae35d1a3fe2bb SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64-bootonly.iso.xz) = 4d8213ae8fa78ddc4569fe7173074254ad54c87f1920b51a5b1ed97ba3215c3d SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64-disc1.iso) = ddc229304106a0c484ab656283a3d16de6bc6c7f2b461cfb9d8374b600f99285 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64-disc1.iso.xz) = 1cbf07ef7d670853042ad812104158c86cc011a425600a299a74d87f984ac846 o 14.0-BETA4 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-bootonly.iso) = 8cf4375176314e662f042f6bddb878d2f5916e6ddb04a326236ed6d187c2d5a8661d6aa8ab9ef8e29e0c4d2620acc47e1869c942903003ab7f8896f174470fbb SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-bootonly.iso.xz) = 7cfea351dc34cf7f27d570c68e3c2b26d6e61c8c26f51b94135e2d383745591ce47d21d91ede1787c8c01f8b10bf3b86e3fd02c791c90eeb47eb3f31525dd95a SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-disc1.iso) = 881902cff1e7a751d6a3c0a782587b5ec8cf8bf1d9d8164033229e8d32f294ae501ee6ad63dc073c82d31d0dfbcaaa49a7c23a841462ed046b13471b26cc3213 SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-disc1.iso.xz) = 0cf527fc633d78ba07c5c94b306ddfd1dd99f0f17c7039caa9a7c46f11393c9f7f78bfdbacf201a73bb520073d1661b4f72953f05cac0f2bfbc2ee49e2ce4eda SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-bootonly.iso) = cac692134646e73c3269882c45aa079ca5048e7abc36b2af8e2395a193bdacd8 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-bootonly.iso.xz) = 3beb58d41dda0e8a16b0201e36fbe07a5487e49ee5f0fbe34416b728a0b9830a SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-disc1.iso) = 2084d780f87f310c7e843e901893d9b0aca9435b3424448c41446e7a3cc3e9c2 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpc64le-disc1.iso.xz) = 1057f4d84c12911c07b07475151d15287824836c53d90981720e9d6a6d7b9939 o 14.0-BETA4 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-bootonly.iso) = 83ba25563d664e4dd8dfedae70de328f4ff3c3665f086f5231e796472b3b458b1c8c66d2a1072915c99eaeef706568c2f1373ecd1e0149477d520363b2ed1dcf SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-bootonly.iso.xz) = 88c476c33eae83f41712ea317c05bd6b827479d703224d4eea9117e052439be2a5ef4fe25e0500a21413e976b62b0805421ff7b428388e533876547773dd9960 SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-disc1.iso) = d96ced25c7c7c7744494bfc5906ad42a0b3d8596f0429a47a69b0061d079791156d38c3e70ba37c524f094c70b3bf34bd03eb7feeb208325c745ee97dbe0ee0f SHA512 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-disc1.iso.xz) = 36383e0f9e285597aa0e1d41133f87efc057e01895c78fcc2b9dedc50a4c4d33d67400b75544817a2a3e6214e905aba21ee884753b82730c6f05dfec851245da SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-bootonly.iso) = 70efa202c3687a7d1432e1e848c1bb63641b5c1e2eb60741479327da868f2db9 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-bootonly.iso.xz) = 463613d8b939e536b8685d92bdc78533f829f48ee070d196c902b854a5e6f14d SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-disc1.iso) = 30b48fcd883d3036a49b68cd3315d9c6b889c4b0423e5b9ae605da2e00c0a697 SHA256 (FreeBSD-14.0-BETA4-powerpc-powerpcspe-disc1.iso.xz) = a72c46c2b502bf80c71377a7fe6496b2dc005e1ac3b9b56d6cf89d5c1205a17e o 14.0-BETA4 armv7 GENERICSD: SHA512 (FreeBSD-14.0-BETA4-arm-armv7-GENERICSD.img.xz) = ecaf5ca9a7bb0af09edefdbd356fe5f091dc565907bbf2933aca65082dbbddb3978edaa27af0d9e261dec62a78dce0f69d23c3a167a239d24f4029feb53fe644 SHA256 (FreeBSD-14.0-BETA4-arm-armv7-GENERICSD.img.xz) = 4d43d2bc43e9fbba6ae074505479035e62328f4b073d35b0b16df45754916bd4 o 14.0-BETA4 aarch64 GENERIC: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-bootonly.iso) = 14716720aa6488c305b430d2c9024e478421e0d37c9ec4d775eb29b63065fdcd94bd2030ce85c733594516f36884d7e519803cdeb82a45ff7af4c1efc0c24614 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-bootonly.iso.xz) = fda35d1d830445af31ea7bd3cf6bf692fe681f88fe399575326b46f412ab49060d413972b111784cec9ba7e6454d9a6ddac8fa344e5d98d7cba1aa88c5c75c4f SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-disc1.iso) = 16c556316346417ad3926243726ba4c43830177427a45ae557f6f18b6bcdea11db834ce232a32fa65722eee1e4c5fa275eea77bf646d8a9d9ba691f4c1cd449f SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-disc1.iso.xz) = df8fe1793bb1fd365a43fb55b5a2eb0f05e29c95203b98ff2f3d06521c27c65e046baebd2ccde848e48b6e91a7273838683a5742d6fce9ccb636957a434fae42 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-dvd1.iso) = f66a3fbefb445c5bc7058c6f5205eea22ddc5a5990a7af9ca2a95f0c781dc21451c58d05e7224d9eaf0fe52139033cbcd6e5a8898353d65df4f25014d2c54eb3 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-dvd1.iso.xz) = 7486232d29033482e48cdb14145042b176b4a653a2762f9442c3b769eb07ea9ae2c7c1671d56506f4f23914830a4d162fe8927e2dfc125a924ee45bdb379f694 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-memstick.img) = 785e686790a50864dec2f50054bde2d534600613eef6ced0aaa2c9843a545ca6dd3f26eb9c00178291bec121994abab6a134175e7cbf6852997fb92570d769c3 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-memstick.img.xz) = 1b0344faa3139e6647b4bdced7ffa10ba8d16ce6874cc321d361525e02f275c2edfd11ef5a1b05331522c819d6d50062c74e3fbe9baa0e1b8483fc48ba477636 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-mini-memstick.img) = c0352dde34707aec11aad9b938ddd284e0679a86530826880ad603d97890634c139924dc14e952d068159b3c912ec166db64a1a9004546e58d35cad20cf3e5ae SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-mini-memstick.img.xz) = 0ef190a0a9f7164c1d3110ac26bac041dbed948c92974bb5c938a4278a7113fc5e70c5b92731ada0ef6b7c5d2a5be18eccbdb23778287ba209e0dbcad2a8a9cf SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-bootonly.iso) = fc816ddb843d0f162e96496a0942b73bca9f27e3dc3617bdb8645dfc4147f38f SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-bootonly.iso.xz) = 3dcb6b78dec9c914e5b8dbaccf12698e5377ab5e87a2d26ff07efbc79a8caacb SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-disc1.iso) = eafd8795d10c7527bb7bcde400e17fb0985e62a00ec85c364ecd66702a5ad76e SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-disc1.iso.xz) = baa32a7715223a42a4b3d4308770c89443955e09a30fe517bf5c5fbbe7b63421 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-dvd1.iso) = 5ad76fcac2dfa49380ece6b4c2442ed7faf66b511c57124127d756fa49a506d5 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-dvd1.iso.xz) = d72266209435b6f863bb10b614c67ace5dd4bf7c7cdffd95ceec09241b8bd5a9 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-memstick.img) = 9861a4aa06b65cd0c434648aa81af1d66fdd863a91f76811dbf35e86cb2d58b7 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-memstick.img.xz) = c37add6be366a189503f27a8548078bd29afd52ffd7689084132095b33bc52eb SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-mini-memstick.img) = 6a638c747f43fd19960e75f87c72d77eb26e3405fbf9c3e4bc816184a50c6fd2 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-mini-memstick.img.xz) = 73342741872898f254552fd7a05c5c15ad6904287cb8a812fb4b0695f1d5850a o 14.0-BETA4 aarch64 RPI: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-RPI.img.xz) = 435fe157522d42333d3d2cc62145e2890a727e8ea33a37802a4cac6d0a12697797542ee27c513798ad4167b850e0f80407ce4077fe40d267c17bd244cbd0665c SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-RPI.img.xz) = 9fc8fdb72fecc817c8850f33b13356c84f77d8dfadea0bd535130460639635f7 o 14.0-BETA4 aarch64 PINE64: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-PINE64.img.xz) = c08d3c88c31dd8dba40faffd4f475dafe8e2617a891e4da22abc0030979c62b0f2dedb2a7ecefd41d18fc9f8a4c182a2c5571c00a1dabf20fb0df0a8d0bbdba8 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-PINE64.img.xz) = 6476a934848d7a54ee0fc352e3d00e5a123bb16cb941274e4f549f84e410ff64 o 14.0-BETA4 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-PINE64-LTS.img.xz) = fda05c92d299dcad2b7c1898bf651e1f3c7340e47b3badfdf4e89b92fdaa52355277879586770c7422a18f6ed4cf849249070b92bbc8569efed3f65875484c66 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-PINE64-LTS.img.xz) = 175bbb4785c0d42dee501874b4b9aad745a612f2c78d8ea23f0178535e70e4aa o 14.0-BETA4 aarch64 PINEBOOK: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-PINEBOOK.img.xz) = 0984a4816052bd4b08def38da169fbf442d8ce28438271feee820663898ab6747391df78fd5b6cbc4a4b22075b376bbd28ad4b5aa56db4dbe54d2bcc23a771e2 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-PINEBOOK.img.xz) = 2d286155674ec2bba441aae4f711d091a646817bb84115a84fa17f68f7545ade o 14.0-BETA4 aarch64 ROCK64: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ROCK64.img.xz) = af0aa6f4cac335e4fb6a07fa8a68336597934e3f2c73d168c75fc39c2e7f11f4eafd5176932cc078b7fe89725cdb378f4a98f00308301c364860e10f87ce1f35 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ROCK64.img.xz) = c5266c7409a98a5bd33553e4ed36068f03ab064649104f072dfcc7e513b0c483 o 14.0-BETA4 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ROCKPRO64.img.xz) = e4805f8ebcd63fb071443ceeef7ca354e8f9559d0a5e321a56b1608ee01cdc1b4c8f92c36f389a7a05af7f42d816cf83284502e0dd0bc307b6b9bc26787f579b SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ROCKPRO64.img.xz) = b0937a8e3617b182be2c0c2105d18d76827b6f901a54258f2823d926e63ed153 o 14.0-BETA4 riscv64 GENERIC: SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-bootonly.iso) = 32b6ce7a4eef3a193108a47e615fc2c6597d8b2b33b304d732ad754844cd69c7624c68e38db151db0e4d4fe23db9d09475d4fa7efd05e51307538be93fcbd677 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-bootonly.iso.xz) = 06ddf3288c4f808deafe78e8844634e670ec96b69a0bb7d0812e2e1e68a009c90eab24222535d121a9138ad9b558a498caa0ea5f80491fb437dddd61af6010b1 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-disc1.iso) = 5710d45bb7a9c8a86560e9f9aedc45807ffbcd90af4b32485f10bc0217fbf4ba59ba4fb50ef3cc044d648afd5fee0e73f66230012e3aeaec4cbf5b002e3b2876 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-disc1.iso.xz) = 8aee03caa22c83dbfec4d1308f0f133cf5b55ac589e7e5914f747d17ee8a4c4c33dee94d8e1f017c71bde809e361cd97347d0a3b2ca797596f99a3a5ebc1d674 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-memstick.img) = a60e93cec1998a9a6e9e86136cb6501a513dc8dd5934ebad32c19e00b2b5c53f52a5d1fb2081054e2dfb5e92de00df3c9085fe6dbfdb7d1a8fa36b9d0e89baca SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-memstick.img.xz) = b9619cb37ed410ba65566a90cddd2e536fa833e43e39858e15e9920bacb15e825e9b7ca2225fa4cc726b60023fa9f731acf5871d060dc67c989df071d45c1aba SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-mini-memstick.img) = 522316e31c2b72019dd79800b8ec784fbb16cdd65ae1f1f9fbb11272d74c4bf1676c282129f82919faf449f406d168aba1e3c128fe0d6fc642815762f87544dc SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-mini-memstick.img.xz) = 6c5d4f2df08b6c6f2b2db19b22c895f1cceb812e9016e0d82528e246d1f1f0a560ed86dfa0258993ad9b35af4aaca5e625d71cfb2e3fe3feb0eb165f66ed0981 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-bootonly.iso) = d143fd61b70354d99aa60c22f5c5a521b0bd847839b3f6ac231d3e04b3a88095 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-bootonly.iso.xz) = 59c087f09bae53f14caff400d0082aa95e54783c37929d4c34cff4c73fd785ea SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-disc1.iso) = 6f44ff6233dc49e4219b4b32c74172c64ddabd3c84a8a9de5d8892d44e1f72a6 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-disc1.iso.xz) = 2965f51ac50dd6e5d13db8e01ec0a0789d417c7dfd04b46b836c52051cc232f1 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-memstick.img) = bbc5cabd7a551cbdfd03911ad6b3178362628c99b9619bdeca6e7f7993aab312 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-memstick.img.xz) = 93a7cb7827b9f72e5d1bdb4d9fa6b6ca2562830119aabeb13060f92fb79caaeb SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-mini-memstick.img) = 889d05979c74695a1ac4380dc427729aea7477aefe59aef25c50daae32bb562e SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-mini-memstick.img.xz) = 1922f0ab2e4588f5b342159eaca409c68804baba0baa6df522c922a1a744150a o 14.0-BETA4 riscv64 GENERICSD: SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-GENERICSD.img.xz) = c2d28bb518a4fda33ff5c00b4fb507606f97940dc2aeb19e740616c68163a023cec8d2e8c1d1718d0f1340f6652cfbd5e999ebb19a4cb339db771554c82f7aec SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-GENERICSD.img.xz) = 24c4ef28750d55f9e4d9faf668ac8da7a4cfe69730cfccd4d5e67313719507f2 == VM IMAGE CHECKSUMS == o 14.0-BETA4 amd64: SHA512 (FreeBSD-14.0-BETA4-amd64-ufs.qcow2.xz) = b6adacfaea91f55f7f1455e22701b8e9785517ae77441c27ce13dc84a2c83f635574c742b5f2394294415f9af58f457627e31fa9ff55daebabd635e9398b24ca SHA512 (FreeBSD-14.0-BETA4-amd64-ufs.raw.xz) = 6641caadc3e1b60b5f824b6a3bdb6e5a17380a9f36e922e8606b244ebd301e0cdafa009efdb792dbf6df3bdaadbb0ae193f0a3d0ca601007269f11dd4636c236 SHA512 (FreeBSD-14.0-BETA4-amd64-ufs.vhd.xz) = 650369fd1668c8e7fc6b5bbdf41af6539786b6dad331d1f04cdd672419e9e6320c00ca28da2ce4d54d9c541cf2d7c5c35ed869cffe25c75c8b28b19abaf2a347 SHA512 (FreeBSD-14.0-BETA4-amd64-ufs.vmdk.xz) = 7435c7787c654206da25f9f175babc0c699618e570845ceb4e5fd193d94d234181481a0e3ef00c5c1aeedcac183b819d0be3f6c51b10161c2e6b82318551d67d SHA512 (FreeBSD-14.0-BETA4-amd64-zfs.qcow2.xz) = 1947d242cad101a8c5447cd0534ec929a8d0734514155c810874d1a7b4331ccd671cc6c3f3690a85331c422f61706e6259e40d750f7c93b572572c356faf2444 SHA512 (FreeBSD-14.0-BETA4-amd64-zfs.raw.xz) = 205df645e3b277ebe8fe77cdc55104e05c54a344b406f9b69352b647613b2ded09e8d37856ea6433ce1965f25c80528e22537468f21af566ddb996f48dc19efc SHA512 (FreeBSD-14.0-BETA4-amd64-zfs.vhd.xz) = 9f68fbafb51f35902c29bada1c6ad43d8c86d3342772eb42864d5cc8e4f7617aea623aaf2ade37e4d63f477bc0187be5a8f39a99336b626fa0cb366328982a6c SHA512 (FreeBSD-14.0-BETA4-amd64-zfs.vmdk.xz) = 390f10c76265757489ba0aacb838251d6b44954880d9e44f9f8da4e56abf38eaa4728f8fecd5d686d9981e7ee92476ea5db475a4f2efe9eada54931132d3e99b SHA512 (FreeBSD-14.0-BETA4-amd64.qcow2.xz) = b6adacfaea91f55f7f1455e22701b8e9785517ae77441c27ce13dc84a2c83f635574c742b5f2394294415f9af58f457627e31fa9ff55daebabd635e9398b24ca SHA512 (FreeBSD-14.0-BETA4-amd64.raw.xz) = 6641caadc3e1b60b5f824b6a3bdb6e5a17380a9f36e922e8606b244ebd301e0cdafa009efdb792dbf6df3bdaadbb0ae193f0a3d0ca601007269f11dd4636c236 SHA512 (FreeBSD-14.0-BETA4-amd64.vhd.xz) = 650369fd1668c8e7fc6b5bbdf41af6539786b6dad331d1f04cdd672419e9e6320c00ca28da2ce4d54d9c541cf2d7c5c35ed869cffe25c75c8b28b19abaf2a347 SHA512 (FreeBSD-14.0-BETA4-amd64.vmdk.xz) = 7435c7787c654206da25f9f175babc0c699618e570845ceb4e5fd193d94d234181481a0e3ef00c5c1aeedcac183b819d0be3f6c51b10161c2e6b82318551d67d SHA256 (FreeBSD-14.0-BETA4-amd64-ufs.qcow2.xz) = 0e4e72be31908d5314e743ba6d9831473621a1441c16e68088128764f4a67024 SHA256 (FreeBSD-14.0-BETA4-amd64-ufs.raw.xz) = 51a9de65672214754f934d25d354c1b48e1b1fcf6604a8fe47b05315f8e58867 SHA256 (FreeBSD-14.0-BETA4-amd64-ufs.vhd.xz) = fc03e463447bc8accf933e0ade6214c790a6215e704cc3cffe82035b351858ed SHA256 (FreeBSD-14.0-BETA4-amd64-ufs.vmdk.xz) = 6569e7a7368b26aa7c09788979383abc3b769f88edc79d36f4d0273545c8d200 SHA256 (FreeBSD-14.0-BETA4-amd64-zfs.qcow2.xz) = dc252a9e0652e379c2d24f4f0d7361f595157e43f02b465a8156b6898578acdc SHA256 (FreeBSD-14.0-BETA4-amd64-zfs.raw.xz) = 0576c8c8cbf68d26f8b1c22fe0722793dd75e3ac1ef9f4d7b923295a4d92c9ba SHA256 (FreeBSD-14.0-BETA4-amd64-zfs.vhd.xz) = fafc4885729ad725c3448836b867b23772cc2c044450647d08661e0bc607b0c4 SHA256 (FreeBSD-14.0-BETA4-amd64-zfs.vmdk.xz) = fe1ef5451b4a065cd0258743f0ad44e65b764071b98dd9d6d3a05705b56b347f SHA256 (FreeBSD-14.0-BETA4-amd64.qcow2.xz) = 0e4e72be31908d5314e743ba6d9831473621a1441c16e68088128764f4a67024 SHA256 (FreeBSD-14.0-BETA4-amd64.raw.xz) = 51a9de65672214754f934d25d354c1b48e1b1fcf6604a8fe47b05315f8e58867 SHA256 (FreeBSD-14.0-BETA4-amd64.vhd.xz) = fc03e463447bc8accf933e0ade6214c790a6215e704cc3cffe82035b351858ed SHA256 (FreeBSD-14.0-BETA4-amd64.vmdk.xz) = 6569e7a7368b26aa7c09788979383abc3b769f88edc79d36f4d0273545c8d200 o 14.0-BETA4 i386: SHA512 (FreeBSD-14.0-BETA4-i386-ufs.qcow2.xz) = 02c3010658691cb90e2dc081e13d9787a4d3ebbb2871a16bd0a60b3cf4445b002d1ba57775613ed833ae5a10184cd5c4549c21af1e3ab7c6220f3968a7821109 SHA512 (FreeBSD-14.0-BETA4-i386-ufs.raw.xz) = 400714943c699e2ab591afd5fa1f7f4cb399242452593ff5120f0563f62ec543a7cb530106483550a404234aaaf4bf26ebbb7fcb3cb4730b6dbd240285b38a38 SHA512 (FreeBSD-14.0-BETA4-i386-ufs.vhd.xz) = c6e9dcf440620c997a9da842e206af576bda6a3e8a7ddcba4ab79aa36fd15fbc60b26ee83ebe70e82f5f74a21d17a8e210d961de275ab92b83f81112890d10b3 SHA512 (FreeBSD-14.0-BETA4-i386-ufs.vmdk.xz) = bb0b1ca987b1ede51b35651a36e65bc4f066e59a16fe2648f7679e46b5d6f3e16693653c6665df24b589bde8ac1475df8b6da55a0d8d4d2f24d4b6d49d8d8bb0 SHA512 (FreeBSD-14.0-BETA4-i386-zfs.qcow2.xz) = e628aa738332a1e4febc26e9f1dc86cd33eb94b2d27bc9b7b9230f1e60771ead323d00143102232c0cc319b64b4a41c1053b6d80dfa450e8e6fcec54d4551be7 SHA512 (FreeBSD-14.0-BETA4-i386-zfs.raw.xz) = 650887e66205347ae3b0c1900acb1e5df9bbbda71051b18060d08d691444b0b4d4294af8cfd0c5fa83d70906deda40abb793451c06f9776e7e0a41ea095375a2 SHA512 (FreeBSD-14.0-BETA4-i386-zfs.vhd.xz) = c40d3d8aa6f1ae8c1a55375990e096be4ec936680a3ff886d8e2950e8adcfa18e4d38209360f09e2ea6e5ac37fac61ec495654f8ddbff3b088f6bb25b0a17183 SHA512 (FreeBSD-14.0-BETA4-i386-zfs.vmdk.xz) = 70b73db2e8845cfa694b2a3a88b58e19b9c23daa89d602ad0a6c3b6811496f54911e1473479ec14f77275476a4d8d46c063db6ceb0c60cc2e347afd85abe783a SHA512 (FreeBSD-14.0-BETA4-i386.qcow2.xz) = 02c3010658691cb90e2dc081e13d9787a4d3ebbb2871a16bd0a60b3cf4445b002d1ba57775613ed833ae5a10184cd5c4549c21af1e3ab7c6220f3968a7821109 SHA512 (FreeBSD-14.0-BETA4-i386.raw.xz) = 400714943c699e2ab591afd5fa1f7f4cb399242452593ff5120f0563f62ec543a7cb530106483550a404234aaaf4bf26ebbb7fcb3cb4730b6dbd240285b38a38 SHA512 (FreeBSD-14.0-BETA4-i386.vhd.xz) = c6e9dcf440620c997a9da842e206af576bda6a3e8a7ddcba4ab79aa36fd15fbc60b26ee83ebe70e82f5f74a21d17a8e210d961de275ab92b83f81112890d10b3 SHA512 (FreeBSD-14.0-BETA4-i386.vmdk.xz) = bb0b1ca987b1ede51b35651a36e65bc4f066e59a16fe2648f7679e46b5d6f3e16693653c6665df24b589bde8ac1475df8b6da55a0d8d4d2f24d4b6d49d8d8bb0 SHA256 (FreeBSD-14.0-BETA4-i386-ufs.qcow2.xz) = bbc6ba74ec180682f64e4862b6ad7dd9a53f584366b408d65701f557401f773e SHA256 (FreeBSD-14.0-BETA4-i386-ufs.raw.xz) = 87369218cb7b1d5da0bfee344eadb215a7ae38965a106ad564835fdc36b10c40 SHA256 (FreeBSD-14.0-BETA4-i386-ufs.vhd.xz) = eac4b8dad07ab005e9fc92c49525d839e3d942f248b542cb5669d56d309c9131 SHA256 (FreeBSD-14.0-BETA4-i386-ufs.vmdk.xz) = 986bd6829d3ac552a1eaf991675098963b2cccb4642030b8dcfbb1570596c309 SHA256 (FreeBSD-14.0-BETA4-i386-zfs.qcow2.xz) = 6e9d52a1a3c0223a2841d0c6294a5f767facd7530fb91012ab4e5367e326dc97 SHA256 (FreeBSD-14.0-BETA4-i386-zfs.raw.xz) = 49f888971c4be9aefbf402fb456f46ea86b78efafca01860aed4fcf790fd75bb SHA256 (FreeBSD-14.0-BETA4-i386-zfs.vhd.xz) = 7cfe1eeede69d4248ef2fd1bc8d17e45e29a66bfb3d14e90735f784fd31b380b SHA256 (FreeBSD-14.0-BETA4-i386-zfs.vmdk.xz) = 178dce3305d736b29405156c09e2176c3ce552784cd47489dcdb925d6b9e6382 SHA256 (FreeBSD-14.0-BETA4-i386.qcow2.xz) = bbc6ba74ec180682f64e4862b6ad7dd9a53f584366b408d65701f557401f773e SHA256 (FreeBSD-14.0-BETA4-i386.raw.xz) = 87369218cb7b1d5da0bfee344eadb215a7ae38965a106ad564835fdc36b10c40 SHA256 (FreeBSD-14.0-BETA4-i386.vhd.xz) = eac4b8dad07ab005e9fc92c49525d839e3d942f248b542cb5669d56d309c9131 SHA256 (FreeBSD-14.0-BETA4-i386.vmdk.xz) = 986bd6829d3ac552a1eaf991675098963b2cccb4642030b8dcfbb1570596c309 o 14.0-BETA4 aarch64: SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.qcow2.xz) = a5515eff90a822f62443bb74fcc087550c739eae94e992126b7c4171087f2dc737c0c8772287619da3493f13d7d878300cd55ffa65b843553efcd79147e778f4 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.raw.xz) = 47902c5e036a20cd4a7e5360ed20615c28c6c253d80592914959dbb009285fb76c5c887a8032fd2d941fb309727a92faf1b6964f8ff8d53c3574db386f28dc66 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.vhd.xz) = 17e5d2d31f80485f52a6dbc74b0a176408ff8e8f9e70d8a64756ebc0cc9c73366f4a9eb964512cb4b14ee8c1263c88fa718ff40e7422d476ec00f64bd135c337 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.vmdk.xz) = a608fd973d60ddc4391f93bd6f64ee7101848799aab18d7b1b0ea563b198dc337110eeb7f36d8449e7bb1573e216bbb506bf267b39e883076b75173bfddb4108 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.qcow2.xz) = 1acc9536f819b1396da6d5d9eb305dc2a783679e55736f3800f2e38918420bb4ffe58d79858fc4d3110f6ab393b9e72cf1530a34ef57250e77fb30e336a2986a SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.raw.xz) = 607c71e18d759223156bad654c5534dad3844e5cac9c555e4816d7efdad6e7a987017b6bef014ab2faf647af24e60adee20827f7390de797b738c9ebd81c8d30 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.vhd.xz) = 60391f6b915cd8c9f4993251ab94865f466a8de622f13774c0a95d5dc7cfbae4e6e6f39c778982523873d0dd743bd33f69cbf1a677b2b19178acab7ad99cdd91 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.vmdk.xz) = 714814992b01e75b2d5461f1d0b66695c178f55a40deddc4886d3934ace8168b4fc4760d2914d2bd8df9c130d6d3ad5a8b6a61355bdb2d1741e314803882c792 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64.qcow2.xz) = a5515eff90a822f62443bb74fcc087550c739eae94e992126b7c4171087f2dc737c0c8772287619da3493f13d7d878300cd55ffa65b843553efcd79147e778f4 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64.raw.xz) = 47902c5e036a20cd4a7e5360ed20615c28c6c253d80592914959dbb009285fb76c5c887a8032fd2d941fb309727a92faf1b6964f8ff8d53c3574db386f28dc66 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64.vhd.xz) = 17e5d2d31f80485f52a6dbc74b0a176408ff8e8f9e70d8a64756ebc0cc9c73366f4a9eb964512cb4b14ee8c1263c88fa718ff40e7422d476ec00f64bd135c337 SHA512 (FreeBSD-14.0-BETA4-arm64-aarch64.vmdk.xz) = a608fd973d60ddc4391f93bd6f64ee7101848799aab18d7b1b0ea563b198dc337110eeb7f36d8449e7bb1573e216bbb506bf267b39e883076b75173bfddb4108 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.qcow2.xz) = 7f20483e7ffdbe1a4548b60bd42f7acc09138f76209559df5593ecdab56f072b SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.raw.xz) = aacf57fa5b3f797bf021b3372a4fb5f355e57f469db12c48b17ef9b1f3768f6d SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.vhd.xz) = 4e030b19e939d80c8f91acb762e7d7a5884fa946248c859b453d86ce670f6dac SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-ufs.vmdk.xz) = 3cfc45906fe768ee0008bface5d1d4bdd4b874ed0721db4b30951779f1999bb0 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.qcow2.xz) = 228bc2a2527a440454ad37ceb850201005a355ce359a3dac7c9880602d99d554 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.raw.xz) = 1385609a01f1e17a1664c8f287ca5f63d0c81cdd93c9619ff9ec92131aff0415 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.vhd.xz) = fc056285789a15c402ad04cd390e6696143c0a148b9ca1cc32a3bbba9ea7b494 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64-zfs.vmdk.xz) = 876d09354d1978bb56facdb2dba5eeebec3b54526e69078cf59729401e0ca930 SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64.qcow2.xz) = 7f20483e7ffdbe1a4548b60bd42f7acc09138f76209559df5593ecdab56f072b SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64.raw.xz) = aacf57fa5b3f797bf021b3372a4fb5f355e57f469db12c48b17ef9b1f3768f6d SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64.vhd.xz) = 4e030b19e939d80c8f91acb762e7d7a5884fa946248c859b453d86ce670f6dac SHA256 (FreeBSD-14.0-BETA4-arm64-aarch64.vmdk.xz) = 3cfc45906fe768ee0008bface5d1d4bdd4b874ed0721db4b30951779f1999bb0 o 14.0-BETA4 riscv64: SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.qcow2.xz) = 57981be6d61e8a5cf3fc61578f88b913033dd2ac1b51a815d14332b5bec896317f2f0a322425280f7e1151891867b852b10d58e499a0e438fb1add51056f583a SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.raw.xz) = 49c27d9bb6089941472896e8351ed5f3018df75eb19d34bcd1767daa8a563a9a795f844112896fe63f60353fe9f98fa7c32749825eee814cf2fefb2605b73cc8 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.vhd.xz) = 409366e7f6764ea19b5e13b94aa8e8e18a776d29b6f001adc433f8bcf33eccd409f85a6d77d107b04ae172cdda5dbbbc36712161275ce85905e079b32ffa5045 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.vmdk.xz) = 706410c5e59c72b33886ae1c1c6556c6baf5e054525751d9a61fe0a25c9d174cfb5fb6d048de5a666ef5d1ea1486d45e44e97a1a675b317e151e433e035e2d5e SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.qcow2.xz) = 583706dd67a966c03e6733b35e8b25607ae88c597830580eaef81bf1069522fbac0b0746f262afc8a9243ba185c9bd290665785b0f59afbc46693855c9e332f8 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.raw.xz) = 79e76350551995835fb7ace01f523e14b94cfd8efe1f4018ae3884b43caae36faab5de94a58e841f11ed6d771d896251238eaeae4e7577819df113351b5f9d85 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.vhd.xz) = 1f86e93f3fe835708d9259d80ba4551df9e4abb23f4a47b00cabcc745f6a181a931aa146796db256d1e2ee1a47ec781c3b83f5762cb6bbe75eb7a6fa9fc158e6 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.vmdk.xz) = 788b98e9d5c542788f52a9c24ec37d5511e7ff127b2fc0f1a735ff0e9c27da8e0567c3830d61b85865644b1f289d33a95f94d58c1a72a6ddb8b12b3f9618d61a SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64.qcow2.xz) = 57981be6d61e8a5cf3fc61578f88b913033dd2ac1b51a815d14332b5bec896317f2f0a322425280f7e1151891867b852b10d58e499a0e438fb1add51056f583a SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64.raw.xz) = 49c27d9bb6089941472896e8351ed5f3018df75eb19d34bcd1767daa8a563a9a795f844112896fe63f60353fe9f98fa7c32749825eee814cf2fefb2605b73cc8 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64.vhd.xz) = 409366e7f6764ea19b5e13b94aa8e8e18a776d29b6f001adc433f8bcf33eccd409f85a6d77d107b04ae172cdda5dbbbc36712161275ce85905e079b32ffa5045 SHA512 (FreeBSD-14.0-BETA4-riscv-riscv64.vmdk.xz) = 706410c5e59c72b33886ae1c1c6556c6baf5e054525751d9a61fe0a25c9d174cfb5fb6d048de5a666ef5d1ea1486d45e44e97a1a675b317e151e433e035e2d5e SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.qcow2.xz) = bfc43aaf01c34a51ec8e6111e88d24fca89ec42982b1965be089c449316abe97 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.raw.xz) = 874270960c459929e73782e03b7d5d81a157d9fb26399db331d62b1b11b219aa SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.vhd.xz) = 96bfebd56387db75a5a83be854b091a1481ff078a9db2c1bfae79225e136eaca SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-ufs.vmdk.xz) = a9af0aced226d18b60087e3e2af1c58ee0b7abce47366d29690b85edffcba013 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.qcow2.xz) = 525ab4851fe572cf78d1d6a9d665ae5af006c1ea721e0eb45c07009e27879cfe SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.raw.xz) = af5603ba364c30016e48c68e9e89a66f172f42ad4e04c8a214cdecf8b857e60b SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.vhd.xz) = 821c0a5f9ee9bbf98c529874a0cfdefcd1c4247102f8067b6087f92009a4861c SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64-zfs.vmdk.xz) = 2cb8c3fe9c0236dabab24a36d44d6467d2b74953c35b3409c124a8f2fed77257 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64.qcow2.xz) = bfc43aaf01c34a51ec8e6111e88d24fca89ec42982b1965be089c449316abe97 SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64.raw.xz) = 874270960c459929e73782e03b7d5d81a157d9fb26399db331d62b1b11b219aa SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64.vhd.xz) = 96bfebd56387db75a5a83be854b091a1481ff078a9db2c1bfae79225e136eaca SHA256 (FreeBSD-14.0-BETA4-riscv-riscv64.vmdk.xz) = a9af0aced226d18b60087e3e2af1c58ee0b7abce47366d29690b85edffcba013 o 14.0-BETA4 amd64 BASIC-CI: SHA512 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = 8ee81b6f692d657c2e3ae6891f9c4b82774cfe47104cfa70c6580f483d2cd1a3b13a9d17906d654c014c0b899a586be63e8a30157dee6f80088fdcf736fd76dd SHA256 (FreeBSD-CHECKSUM.SHA256-amd64-BASIC-CI.raw.xz) = ad666ce9d9a9e41e144e32d730260ec04c5d69656dca56db440686ed9c2f4872 Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUXerQACgkQAxRYpUeP 4pMI0A//Z7DAe4wpWd8TToGJAHtzO16ZmgUfKB80/dah7QeK9miU1BybNg1dKBfS XEz48mN7C/r++L0fwxREYKN70uScObcORmcjsn7Io8RPsg327iqB/1XqvmxGbDT2 KdEmKkzlYX9qEt+rKGvzdFd907CKauZJ8GSr9vDqvbg6A1tE/WoKVlwyug6qzdgL 51xAWYyVJgBLBTjtPbc/nphy3q9duWBlFGg+WhHmAf2AknHfkGFfKe0/rDYp66nT orTHAUnD69z7M18qQhUmCpalkZ+LOCbN/TeB4U1G7ZsQY0cKYHFFddNxmjdUNZDD GJ3tpmx340qu1ENGPQ4qjOeOE2zW3LPtXCDmqhLeHbPGOofq5ZDkj9jPRSmM1zyp igMBn+MXj0GaHm1FX081j39rEMAhAZ2hCb7pUw66iPgNuHNdQhi2ksidIpY5/R9g G0nBEHavxzdPg2zvgnx/F/Y5y+qK2bNCDGSSPBxTaUZZErkaLwgvU3FjIAL6fgAZ VFkI321MtB3NdyyxkmRjcCfUm41Dyp95e3lywRZfe7nKcw09/huNVo/5BzV3MMLV 0vN12o1TSIGdcvdW7aKN+MREZ+/ItVHlfe4lHgRK0w6cGGgithw19CRMAhL5WEot ksDbDU54hjI5OHFF7abe5EyFd/D6C/1AL98/h53naKnd1kKXRSw= =IYGd -----END PGP SIGNATURE----- From nobody Sat Sep 30 07:46:39 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RyK6j3zsQz4vkTy for ; Sat, 30 Sep 2023 07:46:53 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic304-23.consmr.mail.gq1.yahoo.com (sonic304-23.consmr.mail.gq1.yahoo.com [98.137.68.204]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RyK6h1kbRz3Cbb for ; Sat, 30 Sep 2023 07:46:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=FHv1VSe6; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.68.204 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1696060010; bh=XjgMf2wMD0Xe/LM/aiJrawiiUBspj2Q815CWd0szC7M=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=FHv1VSe65zpdUyrnl/FSxbF/l05ErrcuLWgqbc1PnAup2JB2Lg45/fCIBmX9rVyQTyl7KM9lMAX8Iq2k1BIPVt/S2UJnfPbY29VdhlFk+mOWGsL0QvOXvyyzLYaybpG4GVAhtUPqTHxeEQI7TIetnfC3sxTuxu4i38x1PKGz8QX4ul5bTzBUkrJxPOmXxDW11Yl6GkY6bf2Er+xMJq83Er/2tUt26EhmnEyFPzmvdaMuQYyvMa6oNJLgo6ZoqUMam32LNzWzzvwYxXwEQtrAhh0wEHzdc1RyRcOh+vLrtYQPZ/2Tc80iW8xAXQeltmsRaFE1dXScNhyEsN1zE0rlGg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1696060010; bh=/4mjIb7OJjtP60wLkd+9Qpgp0l8AAntSc29ucUyTyMj=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Mscnnsm56IkFdvZjbAaD4VK1QXnbBgBJjjlbrA/T8njm22r1a54p9GILe3CbralKZRO2KN/gofQmT+AT8aAiBVV3NREithEfUyAmJ6VlIplW9U1aeqvz/sD+T7yguv7UoDeRk8M7EdUxwmRPYKas0IFuiATx5bdeiaECIyLgPZsPXReJMQT+aKDJNqvZMwP/329wTuiDRJzp2vGOIqCrgj1R/nE4uxL/tlwJBm4dmAA7kn0/SuOI3X07EJ27U0AnonFhjJ1GDtRGv0TVPbllSfVAtgqNijqTc2DQ7f7BcJsQ8QCJxOg4TSikV8vAMCSEON0HN+dE1uvOh6tKOQVuww== X-YMail-OSG: l8d_pAQVM1kVUZUvo1O5I6PQod0MTmJcaTC5YWQXov1uLzD_w8hj5Jy_A3wQleR RQ7lykw0JyXjtrk9FtE5HFYqjZyO6Dp7NPoXSDXLGI4JsufmTXaIEtPGSrD1STKUyNVu0DdGbLEO CpByYrMPmbiXU05JtW_nE0QfWL9oRApKd5YvLka0STTMSuwOn8ZRk9ayq_LZkP3pv2qK7TgQs_3l U48mWcIOWMENwwi27R5_e_mF50L0mtJKS5fsBA72Teja.ZHhvlxEE7QkNImYeLJ6.Ienc4W7tKzo llXiV6ZOvfLqiabx_z8JpC_PvGp.rtLygKGJvr8aZm8Xik1pjpsdCZUm.Lx65tiKW5fQo8Yq9oEP oa18mPlL6D2Qz2PWQvbzbcqmWvqy_BFcaXdIdfdeRu8V3JbWrQhHaF4INM1sSH9Z7nJo4oKSeG1f 8t9P_VQQJUp6mrq.e1y0spDTdIaUik9OuSJtoR_43Q3pKPASgja2hVoUpT7hLEphyzGyUsFulp.I Dyy_gwHL1Py9vx8lj.MXNjuqVnfquilY3sKhwLc6QAbCaylXBDSbbjEHtPeSaus1sMBn_RxQNxrd Q1ESSHlRoGNmbIU4Oz2BZDqMB33fZFp4ra.2y82WECF0liq1V4_B9VxJ.Yrq6FKWRNqHC7RJ0tz8 4XMOqcs6pITVWGei0iQiyTQ4viM_M1z0Mhu4GZDer7OwxtluSjpuojQJ5CmbxrQapsly5IF_Mul1 aj664eZNl6vDGQW3uqjZbzLr5DDBLunqyZNGB5xZufvJ0akm1MlVCeCqVi29U824opLpYTmAHYyM nRe3qhvy8.ReV1HxdOpz1jc9H_qd2H4X5Us65j.9fE.4D4b4tzMPdc6ndQ_4747dntZGm5FHAb1t _ydBaWUqf84a3Vcv8zdWnQwt_QKaD.fNtSn0G9dbNGgzQw3oo60SgQn4v71y1r34GFnQuUuNJIHP YB9ER1D0CqtvpZqhgUqzLtCP6G2cM5yWs7Ye8mnEUHFoXVl2Nkc_v7FWWsJxd5Sjx1KmHSNu8hSE LhU9.7oLWqjIQEJY25SFzHJy6VVVgY5OllS83X5mmCImtZOInRnk1NLXw7ZHvNPifBI.xbmvWQ9u nypPp18_I5eIa2BXWQtiAHSW1BaDKJUNOsO1K1VTDrg9f_8LCxhgXndLK7RH7Hrtt9jCB1.zVLhH x2KpePyRhK_JX_kts1JoVHRZnwY.NJVvEZFOOi9JDzTzWJrRiL_2Rjkb4JNcxNV9dDwsrGF0hbUJ YaLRSSD2zhbnoPtsIQtFj4Z4vVxCp8nGEAWoe3Boy273zyRA_tZWEZk4A1ng3gxu9QBfsd5J7oBN PXL1POHFyDy58E8Ypy9VttdIXTAgO4xBbJnOp.dSCbKuZiLG76Jx.eg3r3V2FndCm7qGAzsF2k1q YqY7iapPrBx91WJY2k5MqdL1db1Mv_cFVTI.w6snAGbY6rzPJ5fy.0pb6zqArE1jIxXkU66l0_qx yO5r.qFJcU6YwrJSaZbGhoVQxOFV_oNFiDXfEpw3T1XlWbfbd9evZj5op23XQEe4EcNW6blm6oFD VhuY5eIGFySUK7vzHu_SAZ__VH_CLQLS08Pi2jtx1HT9Q32oRXXbQtbYyT8ytPnL8wE1rhbYy.Rj jx4GJCC.lfhoSdYIhWndBIMn6aK9Gc6TJSmLoWvU.dF4yeXqzm09Rov0VQJTe2T3TJ946OayD8n3 mTmFC5p_qvYw5RKodMnu4NteTC.TWcdB_I7_M4vKK9PcVu2Vo5hWmKldSvgPpUtzk_6yCU4Y..i4 KecQXOqEwcNiE_00VVBAmO5ekiiiR011z_x0SStCgTcnaFqr7u8KIi6X.UpkGNeIuL8vrm.FiZv_ QItsTDnflt5k6U96CL3VTKOUiVWO0fVoCpIKrpySOERRtCMM.U4M4BEIiyVF2mVH7RiFihZQVam7 JPswlcg5rQLwiB_NGsKGVXlq2dkCLP0PtykgaHaEBKEDB6V7y0392sHzhf0vJIaq61DLrfC1gkgx lWvvJGunORuxkPGe2W7otcxtUjEJioPayLVOqqscE0AaLw3naFcyMaR7kXeekMHz.9j.bbWsV4n6 aEAGLXRQ61rh.oQ8WPttpSav8rokCW2e0vlyfJ0kcZKu_kFWqqAI6ozr7qhCd75liKr1r.bslF_A aqGeN8jM7ceIWn5NkkP.TIuS3uaE9rwRS4A9Rxa6_c0U8o1AWjYABqj7o9JELZSr6NBP00fQnvoc p27cUnjrlXn7sPUKhcBg8Jc_GcyTKl_Bkz_Iu3ezV_OgAI3ZSer5OBL1dtVHGEHgXcZnXuw-- X-Sonic-MF: X-Sonic-ID: ab9d4623-6fbb-4889-8a31-f1f11c884c50 Received: from sonic.gate.mail.ne1.yahoo.com by sonic304.consmr.mail.gq1.yahoo.com with HTTP; Sat, 30 Sep 2023 07:46:50 +0000 Received: by hermes--production-gq1-56dd58fbdb-hkqgj (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b63fb46944f6aa226335089e6331af7d; Sat, 30 Sep 2023 07:46:49 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: 15 & 14: ram_attach vs. its using regions_to_avail vs. "bus_alloc_resource" can lead to: panic("ram_attach: resource %d failed to attach", rid) Message-Id: <3CB904C2-D983-4EF7-84D3-6BDED0700B08@yahoo.com> Date: Sat, 30 Sep 2023 00:46:39 -0700 To: Current FreeBSD , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3731.700.6) References: <3CB904C2-D983-4EF7-84D3-6BDED0700B08.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.68.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.68.204:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RyK6h1kbRz3Cbb ram_attach is based on regions_to_avail but that is a problem for its later bus_alloc_resource use --and that can lead to: panic("ram_attach: resource %d failed to attach", rid); Unfortunately, the known example is use of EDK2 on RPi4B class systems, not what is considered the supported way. The panic happens for main [so: 15] and will happen once the cortex-a72 handling in 14.0-* is in a build fixed by: =E2=80=A2 git: 906bcc44641d - releng/14.0 - arm64: Fix errata = workarounds that depend on smccc Andrew Turner The lack of the fix leads to an earlier panic as stands. sys/kern/subr_physmem.c 's regions_to_avail is based on ignoring phys_avail and using only hwregions and exregions. In other words, in part: * Initially dump_avail and phys_avail are identical. Boot time memory * allocations remove extents from phys_avail that may still be included * in dumps. This means that early, dedicated memory allocations are treated as available for general use by regions_to_avail . The distinction is visible in the boot -v output in that: real memory =3D 3138154496 (2992 MB) Physical memory chunk(s): 0x00000000200000 - 0x0000002b7fffff, 727711744 bytes (177664 pages) 0x0000002ce3a000 - 0x0000003385ffff, 111304704 bytes (27174 pages) 0x000000338c0000 - 0x000000338c6fff, 28672 bytes (7 pages) 0x00000033a30000 - 0x00000036efffff, 55377920 bytes (13520 pages) 0x000000372e0000 - 0x0000003b2fffff, 67239936 bytes (16416 pages) 0x00000040000000 - 0x000000bb3dcfff, 2067648512 bytes (504797 pages) avail memory =3D 3027378176 (2887 MB) does not list the wider: 0x00000040000000 - 0x000000bfffffff because of phys_avail . But the earlier dump based on hwregions and exregions shows: Physical memory chunk(s): 0x001d0000 - 0x001effff, 0 MB ( 32 pages) 0x00200000 - 0x338c6fff, 822 MB ( 210631 pages) 0x33920000 - 0x3b2fffff, 121 MB ( 31200 pages) 0x40000000 - 0xbfffffff, 2048 MB ( 524288 pages) Excluded memory regions: 0x001d0000 - 0x001effff, 0 MB ( 32 pages) NoAlloc=20 0x2b800000 - 0x2ce39fff, 22 MB ( 5690 pages) NoAlloc=20 0x33860000 - 0x338bffff, 0 MB ( 96 pages) NoAlloc=20 0x33920000 - 0x33a2ffff, 1 MB ( 272 pages) NoAlloc=20 0x36f00000 - 0x372dffff, 3 MB ( 992 pages) NoAlloc=20 which indicates: 0x40000000 - 0xbfffffff is available as far as it is concerned. (Note some code works/displays in terms of: 0x40000000 - 0xc0000000 instead.) For aarch64 , sys/arm64/arm64/nexus.c has a nexus_alloc_resource that is used as bus_alloc_resource . It ends up rejecting the RPi4B boot via using the result of the call in ram_attach: if (bus_alloc_resource(dev, SYS_RES_MEMORY, &rid, start, = end, end - start, 0) =3D=3D NULL) panic("ram_attach: resource %d failed to = attach", rid); as shown by the just-prior start/end pair sequence messages: ram0: reserving memory region: 200000-2b800000 ram0: reserving memory region: 2ce3a000-33860000 ram0: reserving memory region: 338c0000-338c7000 ram0: reserving memory region: 33a30000-36f00000 ram0: reserving memory region: 372e0000-3b300000 ram0: reserving memory region: 40000000-c0000000 panic: ram_attach: resource 5 failed to attach I do not see anything about this that looks inherently RPi* specific for possibly ending up with an analogous panic. So I expect the example is sufficient context to identify a problem is present, despite EDK2 use not being normal for RPi4B's and the like as far as FreeBSD is concerned. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Sep 30 18:24:28 2023 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RybGY64zkz4vgPt; Sat, 30 Sep 2023 18:24:37 +0000 (UTC) (envelope-from pch-b538D2F77@u-1.phicoh.com) Received: from stereo.hq.phicoh.net (stereo.hq.phicoh.net [45.83.6.19]) (using TLSv1.2 with cipher ECDHE-RSA-CHACHA20-POLY1305 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RybGX5drFz4cNs; Sat, 30 Sep 2023 18:24:36 +0000 (UTC) (envelope-from pch-b538D2F77@u-1.phicoh.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of pch-b538D2F77@u-1.phicoh.com has no SPF policy when checking 45.83.6.19) smtp.mailfrom=pch-b538D2F77@u-1.phicoh.com; dmarc=none Received: from stereo.hq.phicoh.net (localhost [::ffff:127.0.0.1]) by stereo.hq.phicoh.net with esmtp (TLS version=TLSv1.2 cipher=ECDHE-RSA-CHACHA20-POLY1305) (Smail #158) id m1qmedh-0000KgC; Sat, 30 Sep 2023 20:24:29 +0200 Message-Id: To: Glen Barber Cc: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, FreeBSD Release Engineering Team Subject: Re: [UPDATE] FreeBSD 14.0-BETA3 Now Available From: Philip Homburg References: <20230922225008.GQ4090@FreeBSD.org> <20230923054535.GJ52318@FreeBSD.org> In-reply-to: Your message of "Sat, 23 Sep 2023 05:45:35 +0000 ." <20230923054535.GJ52318@FreeBSD.org> Date: Sat, 30 Sep 2023 20:24:28 +0200 X-Spamd-Bar: / X-Spamd-Result: default: False [0.98 / 15.00]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-0.85)[-0.855]; NEURAL_SPAM_MEDIUM(0.55)[0.551]; NEURAL_HAM_SHORT(-0.52)[-0.520]; SUBJECT_ENDS_SPACES(0.50)[]; FORGED_SENDER(0.30)[pch-fbsd-2@u-1.phicoh.com,pch-b538D2F77@u-1.phicoh.com]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; DMARC_NA(0.00)[phicoh.com]; R_SPF_NA(0.00)[no SPF record]; ARC_NA(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:206238, ipnet:45.83.4.0/22, country:NL]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org,freebsd-stable@freebsd.org]; FROM_NEQ_ENVFROM(0.00)[pch-fbsd-2@u-1.phicoh.com,pch-b538D2F77@u-1.phicoh.com]; RCPT_COUNT_THREE(0.00)[4]; RCVD_TLS_LAST(0.00)[] X-Rspamd-Queue-Id: 4RybGX5drFz4cNs List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org >Note, releases from 13.2 and earlier are >still problematic due to a file name being replaced with a directory of >the same name. A patch is being tested currently, and we hope to have >this resolved for 14.0-BETA4. I tried upgrading from 13.2 to BETA4 and it seems that the issue is still there. Is there going to be another BETA?