From nobody Mon Feb 5 16:02:19 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTB3Q2RGCz58TVy for ; Mon, 5 Feb 2024 16:02:26 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: from spindle.one-eyed-alien.net (spindle.one-eyed-alien.net [199.48.129.229]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTB3P4rWjz4KL6 for ; Mon, 5 Feb 2024 16:02:25 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=freebsd.org (policy=none); spf=none (mx1.freebsd.org: domain of brooks@spindle.one-eyed-alien.net has no SPF policy when checking 199.48.129.229) smtp.mailfrom=brooks@spindle.one-eyed-alien.net Received: by spindle.one-eyed-alien.net (Postfix, from userid 3001) id 0E3ED3C019A; Mon, 5 Feb 2024 16:02:19 +0000 (UTC) Date: Mon, 5 Feb 2024 16:02:19 +0000 From: Brooks Davis To: Paul Floyd Cc: freebsd-current@freebsd.org Subject: Re: libc/libsys split coming soon Message-ID: References: <8a34573d-4a6c-4d5d-a771-b39279059547@gmail.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <8a34573d-4a6c-4d5d-a771-b39279059547@gmail.com> X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.60 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; FORGED_SENDER(0.30)[brooks@freebsd.org,brooks@spindle.one-eyed-alien.net]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : No valid SPF, No valid DKIM,none]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_COUNT_ONE(0.00)[1]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:36236, ipnet:199.48.128.0/22, country:US]; FREEFALL_USER(0.00)[brooks]; ARC_NA(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[brooks@freebsd.org,brooks@spindle.one-eyed-alien.net]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; R_SPF_NA(0.00)[no SPF record] X-Rspamd-Queue-Id: 4TTB3P4rWjz4KL6 On Sat, Feb 03, 2024 at 05:11:42PM +0100, Paul Floyd wrote: > > On 02/02/2024 23:31, Brooks Davis wrote: > > TL;DR: The implementation of system calls is moving to a seperate > > library (libsys). No changes are required to existing software (except > > to ensure that libsys is present when building custom disk images). > > > > Code:https://github.com/freebsd/freebsd-src/pull/908 > > > > After nearly a decade of intermittent work, I'm about to land a series > > of patches which moves system calls, vdso support, and libc's parsing of > > the ELF auxiliary argument vector into a separate library (libsys). I > > plan to do this early next week (February 5th). > > > > This change serves three primary purposes: > > 1. It's easier to completely replace system call implementations for > > tracing or compartmentalization purposes. > > Will that affect code that makes syscalls without currently linking to libc? Such programs might be broken in these environments but it would depend a lot on the details of both the program and the replacement syscall layer. > > 2. It simplifies the implementation of restrictions on system calls such > > as those implemented by OpenBSD's msyscall(2) > > (https://man.openbsd.org/msyscall.2). > > That's one to ignore for tools that make syscalls outside of the libc memory > mapping. Should someone implement msyscall(2) there will certainly be an opt out mechanism along the usual lines that uses elfctl and procctl. > > 3. It allows language runtimes to link with libsys for system call > > implementations without requiring libc. > > I see that pagesize is on the list of functions that are moving. There are a > couple of other functions that might cause me problems if libc isn't linked. > > Could you do a quick test with an exe linked to libsys but not libc running > under Valgrind memcheck, please? Could you suggest a more concrete example? -- Brooks From nobody Mon Feb 5 18:05:12 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTDn64NWRz58hHW for ; Mon, 5 Feb 2024 18:05:14 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Received: from spindle.one-eyed-alien.net (spindle.one-eyed-alien.net [199.48.129.229]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTDn52wLLz4Xld; Mon, 5 Feb 2024 18:05:13 +0000 (UTC) (envelope-from brooks@spindle.one-eyed-alien.net) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=freebsd.org (policy=none); spf=none (mx1.freebsd.org: domain of brooks@spindle.one-eyed-alien.net has no SPF policy when checking 199.48.129.229) smtp.mailfrom=brooks@spindle.one-eyed-alien.net Received: by spindle.one-eyed-alien.net (Postfix, from userid 3001) id 6E6083C019A; Mon, 5 Feb 2024 18:05:12 +0000 (UTC) Date: Mon, 5 Feb 2024 18:05:12 +0000 From: Brooks Davis To: Mateusz Guzik Cc: Brooks Davis , current@freebsd.org Subject: Re: libc/libsys split coming soon Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.60 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FORGED_SENDER(0.30)[brooks@freebsd.org,brooks@spindle.one-eyed-alien.net]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : No valid SPF, No valid DKIM,none]; ASN(0.00)[asn:36236, ipnet:199.48.128.0/22, country:US]; FREEFALL_USER(0.00)[brooks]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ONE(0.00)[1]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FREEMAIL_TO(0.00)[gmail.com]; R_DKIM_NA(0.00)[]; FROM_NEQ_ENVFROM(0.00)[brooks@freebsd.org,brooks@spindle.one-eyed-alien.net]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_THREE(0.00)[3] X-Rspamd-Queue-Id: 4TTDn52wLLz4Xld On Sat, Feb 03, 2024 at 10:15:09AM +0100, Mateusz Guzik wrote: > On 2/2/24, Brooks Davis wrote: > > TL;DR: The implementation of system calls is moving to a seperate > > library (libsys). No changes are required to existing software (except > > to ensure that libsys is present when building custom disk images). > > > > Code: https://github.com/freebsd/freebsd-src/pull/908 > > > > After nearly a decade of intermittent work, I'm about to land a series > > of patches which moves system calls, vdso support, and libc's parsing of > > the ELF auxiliary argument vector into a separate library (libsys). I > > plan to do this early next week (February 5th). > > > > This change serves three primary purposes: > > 1. It's easier to completely replace system call implementations for > > tracing or compartmentalization purposes. > > 2. It simplifies the implementation of restrictions on system calls such > > as those implemented by OpenBSD's msyscall(2) > > (https://man.openbsd.org/msyscall.2). > > 3. It allows language runtimes to link with libsys for system call > > implementations without requiring libc. > > > > libsys is an auxiliary filter for libc. This means that for any symbol > > defined by both, the libsys version takes precedence at runtime. For > > system call implementations, libc contains empty stubs. For others it > > contains copies of the functions (this could be further refined at a > > later date). The statically linked libc contains the full > > implementations so linking libsys is not required. > > > > Do I read it correctly that everything dynamically linked will also be > linked to libsys, as in executing such a binary will now require > loading one extra .so? > > Binary startup is very slow, for example execve of a hello world > binary in a Linux-based chroot on FreeBSD is faster by a factor of 2 > compared to a native one. As such perf-wise this looks like a step in > the wrong direction. > > Is there a problem making it so that libc ends up unchanged, but all > the bits are available separately in libsys if one does not want libc? Doing so fails to accomplish goal 1 for people who want to do it system wide and does nothing for goal 2. That being said, it would be pretty easy to make this something we can toggle if we find it's an issue in practice. That being said, it seems like we should be spending time on rtld improvements instead of optimizing for its current (seemingly worse than necessary) performance. -- Brooks From nobody Mon Feb 5 21:13:07 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTJy909SZz592MJ for ; Mon, 5 Feb 2024 21:13:21 +0000 (UTC) (envelope-from paulf2718@gmail.com) Received: from mail-wm1-x32d.google.com (mail-wm1-x32d.google.com [IPv6:2a00:1450:4864:20::32d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTJy82MHCz52MH for ; Mon, 5 Feb 2024 21:13:20 +0000 (UTC) (envelope-from paulf2718@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=SqJED4BD; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of paulf2718@gmail.com designates 2a00:1450:4864:20::32d as permitted sender) smtp.mailfrom=paulf2718@gmail.com Received: by mail-wm1-x32d.google.com with SMTP id 5b1f17b1804b1-40fdf17fa89so3612725e9.0 for ; Mon, 05 Feb 2024 13:13:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707167599; x=1707772399; darn=freebsd.org; h=message-id:in-reply-to:to:references:date:subject:mime-version :content-transfer-encoding:from:from:to:cc:subject:date:message-id :reply-to; bh=+moefX2ltD3VtIainMNidRZtwrHZvaHrSibWyDhqm88=; b=SqJED4BD17l30B3zXWJ1UbBczXyJRgNPev/aPmOL6qTi5h2eK6dsc2IhaIJUq7ewyh W9l3DrmjyflOR2ux5ERx97KAFshDVeCk18i4RXXUz+fn2XKMxWH+AqLk3jTUUfsIoX1p qj3/X0hlN48Au5z8rwOfhT790wUHeU41letoivvfGujCNIZqkh7pRWGJ7smRHDq5qWFf w20H4pk9L4BssJKAVmKfe3rZdKblp+zBtHYyqKhShtiqxS25T6Ap2LhUwJQKKdq6HVWa diK+SQ1ANsmGl7cLiXxmc5scpOro33ibtXKxnS4sKXCCyBI1wDwjiLQLfy827gSS7ygo GO3w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707167599; x=1707772399; h=message-id:in-reply-to:to:references:date:subject:mime-version :content-transfer-encoding:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=+moefX2ltD3VtIainMNidRZtwrHZvaHrSibWyDhqm88=; b=oblLPSoXbjIEp+YQrpQruGbUBNYwKwhYgrSGMr/3w8v5jY5UZkGSecxnwMYU63lZiJ WZkkQGF6YGRoohju72NVpNx4ObQ3xWYksJByujXdb9SH1aDb+mxOBVbweOPuqMIkrJm8 BHanorBNP8SSZxh14Lh7Egu1oenhymBQjhum3qcAVq6voGVUbO+7D37HDpf4QhcjjCbL VRTTDrunQQJzYsYiUJ+gAgtbteSUtXfOHglY8ymKogc7doS/vGNMbM1DKku5031HlZO+ +l3wdlE3ddC2u3ssPN0I16waz0bIo35UpFP/1r6hqWcY6/A+ionT0EwjxA0x6tWaVnVj FKdA== X-Gm-Message-State: AOJu0Yyt2mczx/Q3bO0c6oMjBRK49KYCV7cN7ym8RHk+uydOXRaju4cO Wtzn5RBNCtgipKjUrKtrwavaQhi3JIyzJS75sYj4U6ECjgNwAwkDHPVH/X0J X-Google-Smtp-Source: AGHT+IFQMJul4g/rPq2On+kob1xtwiSzccQvJAAnko0QEbmgPDzO6hxldMlGGnTQ6h4P/SQ/uEvRmQ== X-Received: by 2002:a05:600c:4f51:b0:40e:9fd3:6b75 with SMTP id m17-20020a05600c4f5100b0040e9fd36b75mr662173wmq.2.1707167598856; Mon, 05 Feb 2024 13:13:18 -0800 (PST) Received: from smtpclient.apple ([2a01:cb15:8010:2f00:3d77:22b:67cd:ad6e]) by smtp.gmail.com with ESMTPSA id t10-20020a05600c450a00b0040fdf204fe7sm1281075wmo.38.2024.02.05.13.13.18 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 05 Feb 2024 13:13:18 -0800 (PST) From: Paul Floyd Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: libc/libsys split coming soon Date: Mon, 5 Feb 2024 22:13:07 +0100 References: <8a34573d-4a6c-4d5d-a771-b39279059547@gmail.com> To: freebsd-current@freebsd.org In-Reply-To: Message-Id: X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32d:from] X-Rspamd-Queue-Id: 4TTJy82MHCz52MH Hi > On 5 Feb 2024, at 17:02, Brooks Davis wrote: >=20 >=20 >>> 2. It simplifies the implementation of restrictions on system = calls such >>> as those implemented by OpenBSD's msyscall(2) >>> (https://man.openbsd.org/msyscall.2). >>=20 >> That's one to ignore for tools that make syscalls outside of the libc = memory >> mapping. >=20 > Should someone implement msyscall(2) there will certainly be an opt = out > mechanism along the usual lines that uses elfctl and procctl. I was thinking more of simply not passing on such syscalls. >=20 >>> 3. It allows language runtimes to link with libsys for system call >>> implementations without requiring libc. >>=20 >> I see that pagesize is on the list of functions that are moving. = There are a >> couple of other functions that might cause me problems if libc isn't = linked. >>=20 >> Could you do a quick test with an exe linked to libsys but not libc = running >> under Valgrind memcheck, please? >=20 > Could you suggest a more concrete example? I don=E2=80=99t think that it really matters. Just an empty main(). The = important thing would be linking to libsys and not libc. A+ Paul= From nobody Tue Feb 6 14:42:45 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTmFB3zz3z59NQx for ; Tue, 6 Feb 2024 14:42:54 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTmF939QGz4d0D for ; Tue, 6 Feb 2024 14:42:53 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.17.1/8.17.1) with ESMTP id 416EgjgF031994 for ; Tue, 6 Feb 2024 14:42:45 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.17.1/8.17.1/Submit) id 416EgjK3031993 for current@freebsd.org; Tue, 6 Feb 2024 06:42:45 -0800 (PST) (envelope-from david) Date: Tue, 6 Feb 2024 06:42:45 -0800 From: David Wolfskill To: current@freebsd.org Subject: Re: 'poweroff' seems to (only) halt as of main-n267841-0b3f9e435f2b Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="8fC6IOSSV/UJbb/G" Content-Disposition: inline In-Reply-To: X-Spamd-Bar: / X-Spamd-Result: default: False [-0.39 / 15.00]; REPLYTO_EQ_TO_ADDR(5.00)[]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.990]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; FREEFALL_USER(0.00)[david]; RCPT_COUNT_ONE(0.00)[1]; MISSING_XM_UA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DMARC_NA(0.00)[catwhisker.org]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; HAS_REPLYTO(0.00)[current@freebsd.org] X-Rspamd-Queue-Id: 4TTmF939QGz4d0D --8fC6IOSSV/UJbb/G Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable [Closing the loop on this -- dhw] On Tue, Jan 30, 2024 at 06:49:32AM -0800, David Wolfskill wrote: > The machines where I track head (& stable/14) daily get powered off once > they have finished their work for the day; this is done via "poweroff". > ... > |=20 > | The operating system has halted. > | Please press any key to reboot. >=20 > So I hit "Enter" and then saw: >=20 > |=20 > | acpi0: Powering system off > .... As of main-n268079-e4ab361e5394, this is resolved. See also the thread starting with https://lists.freebsd.org/archives/dev-commits-src-main/2024-February/02163= 7.html, "git: e4ab361e5394 - main - fix poweroff regression from 9cdf326b4f by delaying shutdown_halt" Thanks, Andriy! :-) Peace, david --=20 David H. Wolfskill david@catwhisker.org Do these ends really justify those means? See https://www.catwhisker.org/~david/publickey.gpg for my public key. --8fC6IOSSV/UJbb/G Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSTLzOSbomIK53fjFliipiWhXYx5QUCZcJFZV8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0OTMy RjMzOTI2RTg5ODgyQjlEREY4QzU5NjI4QTk4OTY4NTc2MzFFNQAKCRBiipiWhXYx 5dNKAP9movUtLUo64sdl3MhLQc5jxfg152R1cko2/O+goWLfHAEA3HC4QGK0ZzFs tN4so7XR+nKwc5xXUkhuG4on3ll8QgU= =Tzxt -----END PGP SIGNATURE----- --8fC6IOSSV/UJbb/G-- From nobody Tue Feb 6 15:31:31 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTnKX1GRgz59Scx for ; Tue, 6 Feb 2024 15:31:44 +0000 (UTC) (envelope-from air.lightz@gmail.com) Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTnKW3DpXz4lCl for ; Tue, 6 Feb 2024 15:31:43 +0000 (UTC) (envelope-from air.lightz@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=T5ZQWt4H; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of air.lightz@gmail.com designates 2a00:1450:4864:20::32a as permitted sender) smtp.mailfrom=air.lightz@gmail.com Received: by mail-wm1-x32a.google.com with SMTP id 5b1f17b1804b1-40fdc63f4feso17902165e9.3 for ; Tue, 06 Feb 2024 07:31:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707233502; x=1707838302; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=mmtd8Jik3QS44zqUHkEOlFuYLV8Uk6olno6LTd3i8S0=; b=T5ZQWt4H7M9Df+3ttu6Kc9S63rHkDPMjMzCxs97k4L20U3VzcykzJg5aB3gbC8VCej UkUrPvx7cQdlQ4w/boIaRuw0EUhunaeNC+q1m9slYHOBvlc+P4kvipkwjnxR/XXti2Lx JC/vOBhbOFwM0X3lssKtfvJ3KUzZMDE3bsx8t8+0o7yLWrnxPIxgduYkRiX06pbczenk Rju91zSVrdFYlDknt3XC5OPLExhQLqkW667+w+l9N+p5oFOPs75XnVvMRb1K5vcdyHl1 vDTOoifVurHq0eUoQdxk9SxuRXCSCHuzV7CRWgrtzKVfN3MZFcKMIK5WpQEXLkphALO2 81pA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707233502; x=1707838302; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=mmtd8Jik3QS44zqUHkEOlFuYLV8Uk6olno6LTd3i8S0=; b=DTOjPpJUbN6uosYVmiLNcCvu1I3KtrrBHEORQ3ODObg5tdnciIEkmDrstfq/pOD9D3 gDmgrC9QywTMP0/GgTgqDGQOW8mLt0qSVtQTLLJX4O0z6sECZJrVvemzERwa/cj34hMj RKCH8XlUtS4aPAfA7JW23QoVIcQ6mMB1T/fCi+277ndxv8QPwqkspDKwGUcprCGNHOAl 6v+3HyiSWAbQXfTnrlXhdLEqKdRciik9RMQ5KZcpu2PsY0JBjLp+aChYN+fYCPHgvrBJ Pn2i/C4hAJ4cIluI+EQCJPrfBMDayXloDaA76Qg+pZb26SYdXfYTLFMRj3q38STxU37T TYkg== X-Gm-Message-State: AOJu0YzuYrkkr0rJBcqFDHm/hmz4UrRXbX5M6GPMgg5kALiUnlxlsxDb m64kB0Vb5jzViAq3d25sZGc+9ywPVtIsgsiy4JC/Xl+l2RgaHuf10xAMcdZUoixn69TfIKU0t+A 1tVd3ZHu8gEQZuJOW5B/ESan2UdAPhZW6np8= X-Google-Smtp-Source: AGHT+IH2Z3v9GLq4ibwzIg2illyYl7lCXdA1nTZ9ae8q+wZZvonU+rYsbN0cbtT3BkoQ+xC13VxwliOKKR+vrw3YjBc= X-Received: by 2002:a5d:6882:0:b0:33b:d04:9c67 with SMTP id h2-20020a5d6882000000b0033b0d049c67mr1337140wru.38.1707233501841; Tue, 06 Feb 2024 07:31:41 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Ryan R Date: Tue, 6 Feb 2024 10:31:31 -0500 Message-ID: Subject: unsubscribe To: current@freebsd.org Content-Type: multipart/alternative; boundary="0000000000006d0d020610b846e2" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.47 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.973]; R_PARTS_DIFFER(0.50)[100.0%]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TAGGED_FROM(0.00)[]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; MISSING_XM_UA(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MLMMJ_DEST(0.00)[current@freebsd.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_ONE(0.00)[1]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32a:from] X-Rspamd-Queue-Id: 4TTnKW3DpXz4lCl --0000000000006d0d020610b846e2 Content-Type: text/plain; charset="UTF-8" unsubscribe --0000000000006d0d020610b846e2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
unsubscribe=C2=A0
--0000000000006d0d020610b846e2-- From nobody Tue Feb 6 22:05:27 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTy3y2TW0z5B3Xl; Tue, 6 Feb 2024 22:05:34 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTy3x2z1Zz4hlc; Tue, 6 Feb 2024 22:05:33 +0000 (UTC) (envelope-from tuexen@freebsd.org) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=fail reason="No valid SPF, No valid DKIM" header.from=freebsd.org (policy=none); spf=softfail (mx1.freebsd.org: 2001:638:a02:a001:20e:cff:fe4a:feaa is neither permitted nor denied by domain of tuexen@freebsd.org) smtp.mailfrom=tuexen@freebsd.org Received: from smtpclient.apple (unknown [IPv6:2a02:8109:1140:c3d:69d8:88e:adce:2e83]) (Authenticated sender: micmac) by drew.franken.de (Postfix) with ESMTPSA id 73445721E280D; Tue, 6 Feb 2024 23:05:28 +0100 (CET) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: Request for Testing: TCP RACK From: tuexen@freebsd.org In-Reply-To: Date: Tue, 6 Feb 2024 23:05:27 +0100 Cc: "Herbert J. Skuhra" , current@freebsd.org, net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <1283FF33-4A2B-4895-926D-5593684C3211@freebsd.org> References: <42C327BD-6CE4-43AA-A1AE-3BEC08D623DB@freebsd.org> <87pm09ykb8.wl-herbert@gojira.at> <87o7ftyhkp.wl-herbert@gojira.at> <87msvdy0v4.wl-herbert@gojira.at> <867DC224-F0B1-4C9C-8EB7-C9F7BE1C029A@freebsd.org> <87edgo33s9.wl-herbert@gojira.at> <87o7e1s7oc.wl-herbert@gojira.at> <87le95rnp8.wl-herbert@gojira.at> <99432C3E-6AD0-4B1B-9E50-C455D397861B@freebsd.org> <87jzoosuie.wl-herbert@gojira.at> To: Michael Tuexen X-Mailer: Apple Mail (2.3774.400.31) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.75 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.85)[-0.853]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : No valid SPF, No valid DKIM,none]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; FROM_NO_DN(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FREEFALL_USER(0.00)[tuexen]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE]; RCVD_TLS_ALL(0.00)[]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; R_SPF_SOFTFAIL(0.00)[~all:c]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_DKIM_NA(0.00)[]; MLMMJ_DEST(0.00)[current@freebsd.org,net@freebsd.org]; RCPT_COUNT_THREE(0.00)[4] X-Rspamd-Queue-Id: 4TTy3x2z1Zz4hlc > On Jan 5, 2024, at 08:48, tuexen@freebsd.org wrote: >=20 >> On Jan 4, 2024, at 21:39, Herbert J. Skuhra = wrote: >>=20 >> On Thu, 04 Jan 2024 21:22:22 +0100, tuexen@freebsd.org wrote: >>>=20 >>>> On Jan 4, 2024, at 18:52, Herbert J. Skuhra = wrote: >>>>=20 >>>> On Thu, 04 Jan 2024 11:40:35 +0100, "Herbert J. Skuhra" wrote: >>>>>=20 >>>>> On Fri, 17 Nov 2023 14:31:02 +0100, "Herbert J. Skuhra" wrote: >>>>>>=20 >>>>>> Hi, >>>>>>=20 >>>>>> On Fri, 17 Nov 2023 00:15:13 +0100, tuexen@freebsd.org wrote: >>>>>>>=20 >>>>>>>> On Nov 16, 2023, at 20:06, Herbert J. Skuhra = wrote: >>>>>>>>=20 >>>>>>>> On Thu, 16 Nov 2023 19:07:29 +0100, Olivier Cochard-Labb=C3=A9 = wrote: >>>>>>>>>=20 >>>>>>>>> On Thu, Nov 16, 2023 at 5:10=E2=80=AFPM Herbert J. Skuhra = wrote: >>>>>>>>>=20 >>>>>>>>>>=20 >>>>>>>>>> OK, I am now running GENERIC-NODEBUG + "options TCPHPTS". >>>>>>>>>>=20 >>>>>>>>>> After setting "sysctl net.inet.tcp.functions_default=3Drack" = git no >>>>>>>>>> longer works: >>>>>>>>>>=20 >>>>>>>>>>=20 >>>>>>>>> Are you using a fresh 15 head or a specific network setup ? >>>>>>>>>=20 >>>>>>>>> Because I'm not able to reproduce your problem on my system: >>>>>>>>>=20 >>>>>>>>> $ uname -a >>>>>>>>> FreeBSD bigone 15.0-CURRENT FreeBSD 15.0-CURRENT #0 >>>>>>>>> main-n266452-070d9e3540e6: Thu Nov 16 17:53:15 CET 2023 >>>>>>>>> root@bigone:/usr/obj/usr/src/amd64.amd64/sys/TCPHPTS >>>>>>>>> amd64 >>>>>>>>> $ cat /usr/src/sys/amd64/conf/TCPHPTS >>>>>>>>> include GENERIC-NODEBUG >>>>>>>>> ident TCPHPTS >>>>>>>>> options TCPHPTS >>>>>>>>> $ sysctl net.inet.tcp.functions_default >>>>>>>>> net.inet.tcp.functions_default: rack >>>>>>>>> $ git clone -q git@github.com:freebsd/freebsd-src.git && echo = working >>>>>>>>> working >>>>>>>>> $ >>>>>>>>=20 >>>>>>>> OK, (g)it works if I disable pf. Do you use pf? >>>>>>> Can you share your pf config such that I can reproduce the = problem locally? >>>>>>=20 >>>>>> 1. It even fails with a simple pf.conf: >>>>>> pass in all >>>>>> pass out all >>>>>>=20 >>>>>> 2. Fetching port distfiles also failed. >>>>>>=20 >>>>>> 3. If I disable rxcsum on the ethernet adapter (igb0) it works. >>>>>=20 >>>>> Disabling lro also resolves the issue. >>>>=20 >>>> If I run "sysctl net.inet.tcp.rack.features.cmpack=3D0" I don't = have to >>>> disable rxcsum/tcxsum or lro on igb0. >>> Does the problem also goes away if you disable pf completely, but = keep >>> compressed acks enabled? >>=20 >> Yes, it works with pf disabled and compressed acks enabled. > Thanks for the information! A patch is available at: https://reviews.freebsd.org/D43769 Best regards Michael >=20 > Best regards > Michael >>=20 >> -- >> Herbert >=20 >=20 From nobody Tue Feb 6 23:16:46 2024 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TTzfj3w4gz5B92C; Tue, 6 Feb 2024 23:17:17 +0000 (UTC) (envelope-from herbert@gojira.at) Received: from mail.bsd4all.net (mail.bsd4all.net [94.130.200.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-384) client-digest SHA384) (Client CN "mail.bsd4all.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TTzfj1tdsz4spy; Tue, 6 Feb 2024 23:17:17 +0000 (UTC) (envelope-from herbert@gojira.at) Authentication-Results: mx1.freebsd.org; none Date: Wed, 07 Feb 2024 00:16:46 +0100 DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gojira.at; s=mail202005; t=1707261429; bh=nwdWG/uNgv7UCmF64g1FL9XoeiiL8OkE0wji1WyvOFc=; h=Date:Message-ID:From:To:Cc:Subject:MIME-Version:Content-Type; b=qGU6LjiIuI9apEwbN3nou+YMvrX5G1h8A2qHk0TqKqsAzqRNDCqaluJjiNL8uHmh0 UMEudI+oE103MYXfCU/Bwye5GlPVFP269Lrek0/0Rmqq69guYw3vgJJYnMVpOWKLZA u26f0NrkjLPUJAOs8HQUMRqBJlYKaAOEEskb8IPKDnLkNjZEbXq+LWUfJsM4rV2dJl hRHeEHSvccbtXyeRkULBqs6tab3/8YXvwR2h+Pn70pM76K9ZK6MskP3ACLsJj2/s6+ 0d2Fz+1tjym3yDfqj757BFA5+hkqLsE1Sgb4wKx2C9PPSMDcuq6xFleNg4BbeeQ2Gc zP3jIJIcqvNfg== Message-ID: <87jznhw5cx.wl-herbert@gojira.at> From: "Herbert J. Skuhra" To: tuexen@freebsd.org Cc: current@freebsd.org, net@freebsd.org Subject: Re: Request for Testing: TCP RACK In-Reply-To: <1283FF33-4A2B-4895-926D-5593684C3211@freebsd.org> References: <42C327BD-6CE4-43AA-A1AE-3BEC08D623DB@freebsd.org> <87pm09ykb8.wl-herbert@gojira.at> <87o7ftyhkp.wl-herbert@gojira.at> <87msvdy0v4.wl-herbert@gojira.at> <867DC224-F0B1-4C9C-8EB7-C9F7BE1C029A@freebsd.org> <87edgo33s9.wl-herbert@gojira.at> <87o7e1s7oc.wl-herbert@gojira.at> <87le95rnp8.wl-herbert@gojira.at> <99432C3E-6AD0-4B1B-9E50-C455D397861B@freebsd.org> <87jzoosuie.wl-herbert@gojira.at> <1283FF33-4A2B-4895-926D-5593684C3211@freebsd.org> User-Agent: Wanderlust/2.15.9 (Almost Unreal) Emacs/29.2 Mule/6.0 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4TTzfj1tdsz4spy X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:24940, ipnet:94.130.0.0/16, country:DE] On Tue, 06 Feb 2024 23:05:27 +0100, tuexen@freebsd.org wrote: >=20 > > On Jan 5, 2024, at 08:48, tuexen@freebsd.org wrote: > >=20 > >> On Jan 4, 2024, at 21:39, Herbert J. Skuhra wrote: > >>=20 > >> On Thu, 04 Jan 2024 21:22:22 +0100, tuexen@freebsd.org wrote: > >>>=20 > >>>> On Jan 4, 2024, at 18:52, Herbert J. Skuhra wrot= e: > >>>>=20 > >>>> On Thu, 04 Jan 2024 11:40:35 +0100, "Herbert J. Skuhra" wrote: > >>>>>=20 > >>>>> On Fri, 17 Nov 2023 14:31:02 +0100, "Herbert J. Skuhra" wrote: > >>>>>>=20 > >>>>>> Hi, > >>>>>>=20 > >>>>>> On Fri, 17 Nov 2023 00:15:13 +0100, tuexen@freebsd.org wrote: > >>>>>>>=20 > >>>>>>>> On Nov 16, 2023, at 20:06, Herbert J. Skuhra = wrote: > >>>>>>>>=20 > >>>>>>>> On Thu, 16 Nov 2023 19:07:29 +0100, Olivier Cochard-Labb=C3=A9 w= rote: > >>>>>>>>>=20 > >>>>>>>>> On Thu, Nov 16, 2023 at 5:10=E2=80=AFPM Herbert J. Skuhra wrote: > >>>>>>>>>=20 > >>>>>>>>>>=20 > >>>>>>>>>> OK, I am now running GENERIC-NODEBUG + "options TCPHPTS". > >>>>>>>>>>=20 > >>>>>>>>>> After setting "sysctl net.inet.tcp.functions_default=3Drack" g= it no > >>>>>>>>>> longer works: > >>>>>>>>>>=20 > >>>>>>>>>>=20 > >>>>>>>>> Are you using a fresh 15 head or a specific network setup ? > >>>>>>>>>=20 > >>>>>>>>> Because I'm not able to reproduce your problem on my system: > >>>>>>>>>=20 > >>>>>>>>> $ uname -a > >>>>>>>>> FreeBSD bigone 15.0-CURRENT FreeBSD 15.0-CURRENT #0 > >>>>>>>>> main-n266452-070d9e3540e6: Thu Nov 16 17:53:15 CET 2023 > >>>>>>>>> root@bigone:/usr/obj/usr/src/amd64.amd64/sys/TCPHPTS > >>>>>>>>> amd64 > >>>>>>>>> $ cat /usr/src/sys/amd64/conf/TCPHPTS > >>>>>>>>> include GENERIC-NODEBUG > >>>>>>>>> ident TCPHPTS > >>>>>>>>> options TCPHPTS > >>>>>>>>> $ sysctl net.inet.tcp.functions_default > >>>>>>>>> net.inet.tcp.functions_default: rack > >>>>>>>>> $ git clone -q git@github.com:freebsd/freebsd-src.git && echo w= orking > >>>>>>>>> working > >>>>>>>>> $ > >>>>>>>>=20 > >>>>>>>> OK, (g)it works if I disable pf. Do you use pf? > >>>>>>> Can you share your pf config such that I can reproduce the proble= m locally? > >>>>>>=20 > >>>>>> 1. It even fails with a simple pf.conf: > >>>>>> pass in all > >>>>>> pass out all > >>>>>>=20 > >>>>>> 2. Fetching port distfiles also failed. > >>>>>>=20 > >>>>>> 3. If I disable rxcsum on the ethernet adapter (igb0) it works. > >>>>>=20 > >>>>> Disabling lro also resolves the issue. > >>>>=20 > >>>> If I run "sysctl net.inet.tcp.rack.features.cmpack=3D0" I don't have= to > >>>> disable rxcsum/tcxsum or lro on igb0. > >>> Does the problem also goes away if you disable pf completely, but keep > >>> compressed acks enabled? > >>=20 > >> Yes, it works with pf disabled and compressed acks enabled. > > Thanks for the information! > A patch is available at: > https://reviews.freebsd.org/D43769 Hi Michael, the patch resolves the issue. Thanks a lot. Best regards, Herbert From nobody Thu Feb 8 15:34:52 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TW1JK5xVlz59v61 for ; Thu, 8 Feb 2024 15:34:57 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Received: from NAM11-BN8-obe.outbound.protection.outlook.com (mail-bn8nam11on20701.outbound.protection.outlook.com [IPv6:2a01:111:f403:2414::701]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TW1JK0TVpz4HTS for ; Thu, 8 Feb 2024 15:34:57 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dartmouth.edu header.s=selector2 header.b=HqMIkZVQ; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=dartmouth.edu; spf=pass (mx1.freebsd.org: domain of Matthew.L.Dailey@dartmouth.edu designates 2a01:111:f403:2414::701 as permitted sender) smtp.mailfrom=Matthew.L.Dailey@dartmouth.edu ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FqTyeW44Oub/y6oY2MQjdKPk1H7bnV9lnuwNHNpTBfvhW/1qFSa8mXQyWsBHByydUcCuGXiFzDwkiriFNGCs6oeGyMyDx6D62RZhFAjCohclnj5TJ2Z/aVo0+6Wf2XSk4/XsIrepFsdWq+HZGAye5SEcqiGKhJmpoMsp0+DrXKaTLsM1x4Uj+0nvuy+xOXrMDk7bJoIe0Z7DuTEyrMZRemdZJZpK8xaSm2hKEjzCZ8TxOEh5ALeCS6eV5ThlJGdVT1ucmR3foKzbAOqHiLD5eUV+jPD8E6OAGVW+cXccEtUDSSTmh1BzqgwN/s6SgMhtzDnfLIfOAe9dyc9UgHqH4Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=0nSee75tcfedWvFMempJgVzQYA8bFjqWUq1SgUjv9ic=; b=oaK81bZPR94xydSrDeza8HZGRZNBahQZcQ2VZF17B2o9u2x7vbg2+FHUKXThrZPvXuB9z8MS2TxBTYp0mfL5CXc7xM4nWnpl8OWeILNrTdFhAJl4bUWVd8ol2ksnJnXDAHLgJNc1Ek7agMNPayyXHaZmKcDaOSPFRpp/tlF8J93s9ee8ih3VAIpSITqeOQcj3hN6UV6pkVP7A6jSPfk3Qq1dEZPGagW1V3tEDt1wkZCD6/BD3WpHUmuiTe05EgwIDc602wQQdNZiJMIOXhOZWB+V/OGAI+XW3FoZ8DdEH60UbrarptTSkYVEA/03AhvztXVeyu0WSw+uvkZQRCcqHQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dartmouth.edu; dmarc=pass action=none header.from=dartmouth.edu; dkim=pass header.d=dartmouth.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dartmouth.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=0nSee75tcfedWvFMempJgVzQYA8bFjqWUq1SgUjv9ic=; b=HqMIkZVQFi6XC6jPFrM8a4WAWmZOErGTHDj0mWjgsroa7BTF72GLs2phtsJYu8lzwWCMpI3UTTspyjodnNv8K5KTeqmyYa3eqk27VvHX4AgnnOB130Rpb5XUHYdXUH5753d588JoD8U2r8C1Gg7fTgC8hnhmcrpaUObfITXS25o= Received: from DS7PR03MB5574.namprd03.prod.outlook.com (2603:10b6:5:2c1::16) by PH0PR03MB6250.namprd03.prod.outlook.com (2603:10b6:510:e8::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.39; Thu, 8 Feb 2024 15:34:52 +0000 Received: from DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e]) by DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e%7]) with mapi id 15.20.7249.038; Thu, 8 Feb 2024 15:34:52 +0000 From: "Matthew L. Dailey" To: "freebsd-current@freebsd.org" Subject: FreeBSD panics possibly caused by nfs clients Thread-Topic: FreeBSD panics possibly caused by nfs clients Thread-Index: AQHaWqRbdS9Bo1uUrUmmySsvFWddcg== Date: Thu, 8 Feb 2024 15:34:52 +0000 Message-ID: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Mozilla Thunderbird x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR03MB5574:EE_|PH0PR03MB6250:EE_ x-ms-office365-filtering-correlation-id: 7a7522c3-618c-4262-a83d-08dc28bb7e5a x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: d4hhTwQ7eshWyzrRQk4lbq3VfhqPPLovBNnKDjUkWocHeIZWXXjd6+857IFyppm42q2BG+csJpmCbeP/VH+fnWQQgr5bD1z2vbhBDS7Xg2+VYUgNzVvw2NSndmdi7Jzydw+T+PRG8Jw9vLW08rfgCMf+w/tCkgLeGcjel+Y7gRr4QxQYEJlRoMPF/6O2mmZbOZCr1X1n13wiX0ewakZZETh/2+hnCkNxxMmQlKF4mUe2kbusIX0mdoG291GWntbK/Q6U9LcltZG7OYrLmPyCmy/bmleYPAjdSE5J4cIxB/vmEH44J735NFEnKOwH7ve+iEx+qye69/G0GFA3Dbp9lCfWNb2EZLLe9vc3O/90aTn5w8bdBizlFWVd0HHQvUgmvKOfVHBIOHtqmroaXutSqD+CBayXfIQPnC7rtSJGUjwYH6NQtQ1zLcES9ZKCazq/Z1hr+rA7/YrAw+n/VyETglxONdE+hQihspQw6ge2g6z1t22+pkHdCHKlFjTCrVhKKixy7akuvaEN7o5gi5fVYp1R8Utpa8ONjU97gC1l/acs8C+BW0m+qschDA+9vqOyltKzcC4o8RwnB/7QxrUkFuQxON6OZzahp1TOx82VOFC6XLcnAwzG748wM98TMC7z x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5574.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(39860400002)(366004)(396003)(346002)(376002)(136003)(230922051799003)(64100799003)(1800799012)(186009)(451199024)(40140700001)(36756003)(38070700009)(53546011)(71200400001)(6506007)(478600001)(6486002)(6512007)(2616005)(26005)(6916009)(2906002)(83380400001)(5660300002)(66446008)(786003)(91956017)(66476007)(66556008)(66946007)(76116006)(64756008)(8936002)(8676002)(86362001)(316002)(31696002)(122000001)(38100700002)(75432002)(41300700001)(31686004);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?WjFIV1YrcThlQ1VNZG5UY2t4RmlsejBzb3BUd1pxZzRhSXNiTVZLalJHWnM3?= =?utf-8?B?WXBOZDUwR2NFK2V3Z3phekpXZ0ZLTFMrY25tdWFPVW4zdTgvZXRzVUx0UDZR?= =?utf-8?B?bU5OUlZidHE1MmJlN1NzQ1FLdVJ0ZUVJYi9BcWdKamQvcWNaZHpndHlpN2Nm?= =?utf-8?B?c0xkSlQvNnF6dzZWK2FiaFgrb1dvUDFUTmYyK1IyTUwzcUJkVzVIWEhPNEkw?= =?utf-8?B?ekRNSTNxV1ZHT3dnd0RHMTloTmJCRlJ5Y3NnYnJWeW5nY25jcFJ5LzRiQy9H?= =?utf-8?B?aHZvUzFESGxldVZwRTZtNFFkaXB0alBvWWwySmpXSnMwM1ZtVWdLbVRmSGNI?= =?utf-8?B?U0JISGZoY1l6dkRQblFHKytaUU1rY0lMR2szbGxGczhreTU1aW94eUtlM2xH?= =?utf-8?B?TVE5S2JRckY2dStBUXhTYnRzUndPWDBLVURKUExYZWdaajRnSi9vZmwvelN5?= =?utf-8?B?VlFITGVkRWZiWUw1TnZzSGl2VjkwZCtVZlplcUJMU05NYzUwRm8xc2NPb3hR?= =?utf-8?B?M2VhYXNiRFlZSXMxbUV2Znl1VzlXWE8vcVB3ZU50WWlhSnpxS2V3cVdRdy9a?= =?utf-8?B?THg0SHE0ZmdPbmpZR0lzYzkxYStaSnRqUllpRXk3ejNIMTg2OHUyK1V1dWV4?= =?utf-8?B?cWJidFpHa1l2SFcyeDdFT0NsTzkrbytRek9mbytwdzJhemp2Sm42SUU0YW5O?= =?utf-8?B?dys2SVFkS3d0SUFXdEoxeXBUazNnS0x6em9yb1F0eDdVVG9aQjF2UkgrYXU5?= =?utf-8?B?NCtJOVRwbVNpeEVhdnFIQlJ2VDhUYVFOck9mdGlCSDRIbEoweDZHOTNxMFlr?= =?utf-8?B?STZpR2o4WkZnRVEzVk50LytYQkdMSCt0R0ovR3pCazhHODNKc0ZOU3ZEaTF4?= =?utf-8?B?M0owamlsUkY3d2o2dHJ0Z1pUU2VDWC8vTTEwV3REQndQMlphSXBxb05WVXh6?= =?utf-8?B?QnhzQUQwNi9MS2dPYTl6T05Mbkk2bUpHbERseFBCaG5sYjVaOXE3TTVXK2NU?= =?utf-8?B?UTRoenRFUEpUaHN5NzFoWGVHMUVkNWJFYU94cFdaZVdiRnc0bXRPcnh0Q0Nj?= =?utf-8?B?TXRRWEdFU2RHRlJ6U1NqM3NOVnkvK0QwR2JCczBGNWdoMmZ5Lzczb3NhcEhD?= =?utf-8?B?NHBGdmhvOUdKNDVod1FiSll6c0ZjZHEyeS8rVHR2R1RMeEptSFlnUkR2TkZZ?= =?utf-8?B?WDRJY0o0eXR3cERCV0RocjJJSDdGdmJGNERNcnRmTWhhTUtsTHpLdmVFbFEr?= =?utf-8?B?VUVYNllIYkt0Sy9KNERaV0xUYkx4dG5UZnc2MmJCUmNqS1VZUXZUbG9jVG5Y?= =?utf-8?B?MVpoTnpzK1c5dHorVkp5eWYzZ3ptTnRhSTJVQVJ2OGNOREM2ZUgvNExNbWdB?= =?utf-8?B?dGFYdGZ0cENTZ0NFZUlEcjA0WE54bElxTzM3elNHZUw5STA1Y0FsMkhLVzZ2?= =?utf-8?B?b1Zxd0NXeHdIWEkvelR4MTZSMU1CcHZ3eGN1V1BNdXdhTGgyendLbTdxS2la?= =?utf-8?B?aDB5NjRIVzBvU2dtQVp5Q1F6dW4xV05CNjIzMCthYitTQTFpYUVpUThHZHEy?= =?utf-8?B?VUFZTDhaTjh3WjRETWFMeUFvdmlZWjU3UXBTL1poRndOTE1ZUnA4eDNmTSta?= =?utf-8?B?U3VzMU9KYTNNbXltcy9BVVZ6ZzEveGxZYzFmOWFMT2R5L2llWU9UVXFpaTEx?= =?utf-8?B?NExnNDJ2NW0yb0R4UjhiNEh0WHFQenZWTEVwWE9HMnJOYVR6MGQwOGVtUmRM?= =?utf-8?B?QmNid1AwMmJhdnNHSzI5Vm81elhlM1Nid25YZXgyMFE1bXM5a0hpNWhYSW5M?= =?utf-8?B?Qy9jNnZGTEkwR2IzQ2xKYnpkUXFoQVkrc3hNNk11T004SktZbGN2d3huRHVP?= =?utf-8?B?MGN4eVhPenNwRFIzTUQrQkVRVXdUMHQzV3RjYW9GRFhXZDZReU5od0p1bkpH?= =?utf-8?B?dy9LL3FvSVRsZEh2dnNSREN6Y2RVeWtJalFVSnpXZi9kOEdYWk82Z2R4NWUw?= =?utf-8?B?MGMxdkJwc3FxT1Z4QzBqOHpsUktVb3dGN3FzQVI2OEJ6N05SQ3pDeGtQYVhq?= =?utf-8?B?SFgvV0lSZmpXMVQ3RTd3c21PcTJJSE5vMGZBZ25DRUlKZnZxUlYwQVUvaWY3?= =?utf-8?Q?YsAG9zkUGqUhCT7SPse05gGS+?= Content-Type: text/plain; charset="utf-8" Content-ID: <6534B3B731A6BB4F9DD39C17ACB06E7E@namprd03.prod.outlook.com> Content-Transfer-Encoding: base64 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: dartmouth.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5574.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 7a7522c3-618c-4262-a83d-08dc28bb7e5a X-MS-Exchange-CrossTenant-originalarrivaltime: 08 Feb 2024 15:34:52.3062 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 995b0936-48d6-40e5-a31e-bf689ec9446f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: I833f9Nf8s920Zi12uqlPm6VkINqFcLkqhcYfZBLq7CcsJ40T9GUAca5oUrn+kgTs21XtrJMlMq9uYWz8cZlfg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR03MB6250 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.19 / 15.00]; INTRODUCTION(2.00)[]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[dartmouth.edu:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.990]; NEURAL_SPAM_LONG(0.69)[0.686]; DMARC_POLICY_ALLOW(-0.50)[dartmouth.edu,none]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f403::/49]; R_DKIM_ALLOW(-0.20)[dartmouth.edu:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MIME_BASE64_TEXT(0.10)[]; XM_UA_NO_VERSION(0.01)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[dartmouth.edu:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; MID_RHS_MATCH_FROM(0.00)[]; MIME_TRACE(0.00)[0:+] X-Rspamd-Queue-Id: 4TW1JK0TVpz4HTS R29vZCBtb3JuaW5nIGFsbCwNCg0KUGVyIFJpY2sgTWFja2xlbSdzIHN1Z2dlc3Rpb24sIEknbSBw b3N0aW5nIHRoaXMgcXVlcnkgaGVyZSBpbiB0aGUgaG9wZXMgDQp0aGF0IG90aGVyIG1heSBoYXZl IGlkZWFzLg0KDQpXZSBkaWQgZG8gc29tZSBtaW5pbWFsIHRlc3Rpbmcgd2l0aCB1ZnMgYXJvdW5k IHRoaXMgcHJvYmxlbSBiYWNrIGluIA0KQXVndXN0LCBidXQgaGFkbid0IG5hcnJvd2VkIHRoZSBp c3N1ZSBkb3duIHRvIGhkZjUgd29ya2xvYWRzIHlldCwgc28gDQp0ZXN0aW5nIHdhcyBpbmNvbmNs dXNpdmUuIFdlJ2xsIGRvIGZ1cnRoZXIgdGVzdGluZyBvbiB0aGlzIHRvIHRyeSB0byANCnJ1bGUg aW4gb3Igb3V0IHpmcyBhcyBhIGNvbnRyaWJ1dGluZyBmYWN0b3IuDQoNCkknbSBoYXBweSB0byBw cm92aWRlIG1vcmUgdGVjaG5pY2FsIGRldGFpbHMgYWJvdXQgdGhpcyBpc3N1ZSwgYnV0IGl0IGlz IA0KcXVpdGUgY29tcGxleCB0byBleHBsYWluIGFuZCByZXByb2R1Y2UuDQoNClRoYW5rcyBpbiBh ZHZhbmNlIGZvciBhbnkgaGVscCENCg0KQmVzdCwNCk1hdHQNCg0KT24gMi83LzI0IDY6MTAgUE0s IFJpY2sgTWFja2xlbSB3cm90ZToNCiA+DQogPiBXZWxsLCB0aGVyZSBpcyBjZXJ0YWlubHkgbm8g b2J2aW91cyBhbnN3ZXIuDQogPiBPbmUgdGhpbmcgSSB3b3VsZCBzdWdnZXN0IGlzIHNldHRpbmcg dXAgYSB0ZXN0DQogPiBzZXJ2ZXIgdXNpbmcgVUZTIGFuZCBzZWUgaXQgaWYgcGFuaWNzLg0KID4N CiA+IFRvIGJlIGhvbmVzdCwgTkZTIGlzIHByZXR0eSBzaW1wbGUgd2hlbiBpdCBjb21lcw0KID4g dG8gc2VydmVyIHNpZGUgcmVhZGluZy93cml0aWluZy4gSXQgYmFzaWNhbGx5IHRyYW5zbGF0ZXMN CiA+IE5GUyBSUENzIHRvIFZPUCBjYWxscyBvbiB0aGUgdW5kZXJseWluZyBmaWxlIHN5c3RlbS4N CiA+IEFzIHN1Y2gsIGlzc3VlcyBhcmUgdXN1YWxseSBlaXRoZXIgbmV0d29yayBmYWJyaWMgb24g b25lIHNpZGUNCiA+IChldmVyeXRoaW5nIGZyb20gY2FibGVzIHRvIE5JQyBkcml2ZXMgYW5kIHRo ZSBUQ1Agc3RhY2spLg0KID4gU2luY2UgeW91IGFyZSBzZWVpbmcgdGhpcyB3aXRoIGFzc29ydGVk IE5JQ3MgYW5kIEZyZWVCU0QNCiA+IHZlcnNpb25zLCBJIGRvdWJ0IGl0IGlzIG5ldHdvcmsgZmFi cmljIHJlbGF0ZWQsIGJ1dD8/DQogPiBUaGlzIGlzIHdoeSBJJ2Qgc3VzcGVjdCB0aGUgWkZTIHNp ZGUgYW5kIHRyeWluZyBVRlMgd291bGQNCiA+IGlzb2xhdGUgdGhlIHByb2JsZW0gdG8gWkZTLg0K ID4NCiA+IEFsdGhvdWdoIEkga25vdyBub3RoaW5nIGFib3V0IGhkZjUgZmlsZXMsIHRoZSBORlMg Y29kZSBkb2VzDQogPiBub3RoaW5nIHdpdGggdGhlIGRhdGEgKGl0IGlzIGp1c3QgYSBieXRlIHN0 cmVhbSksDQogPiBTaW5jZSBaRlMgZG9lcyBub3JtYWxseSBkbyB0aGluZ3MgbGlrZSBjb21wcmVz c2lvbiwgaXQgY291bGQgYmUNCiA+IGFmZmVjdGVkIGJ5IHRoZSBkYXRhIGNvbnRlbnRzLg0KID4N CiA+IEFub3RoZXIgY29tbW9uIChhbHRob3VnaCBsZXNzIGNvbW1vbiBub3cpIHByb2JsZW0gaXMg VFNPDQogPiB3aGVuIGRhdGEgb2YgY2VydGFpbiBzaXplcyAob2Z0ZW4ganVzdCBsZXNzIHRoYW4g NjRLKSBpcyBoYW5kbGVkLg0KID4gSG93ZXZlciwgdGhpcyB1c3VhbGx5IHJlc3VsdHMgaW4gaGFu Z3MgYW5kIEkgaGF2ZSBuZXZlciBoZWFyZA0KID4gb2YgbWVtb3J5IGRhdGEgY29ycnVwdGlvbi4N CiA+DQogPiBCb3R0b20gbGluZS4uZGV0ZXJtaW5pbmcgaWYgaXQgaXMgWkZTIHNwZWNpZmljIHdv dWxkIGJlIHRoZSBiZXN0DQogPiBmaXJzdCBzdGVwLCBJIHRoaW5rPw0KID4NCiA+IEl0IHdvdWxk IGJlIGdvb2QgdG8gcG9zdCB0aGlzIHRvIGEgbWFpbGluZyBsaXN0IGxpa2UgZnJlZWJzZC1jdXJy ZW50QCwNCiA+IHNpbmNlIG90aGVycyBtaWdodCBoYXZlIHNvbWUgaW5zaXRlIGludG8gdGhpcy4g KEFsdGhvdWdoIHlvdSBhcmUNCiA+IG5vdCB1c2luZyBmcmVlYnNkLWN1cnJlbnRALCB0aGF0IGlz IHdoZXJlIG1vc3QgZGV2ZWxvcGVycyByZWFkDQogPiBlbWFpbC4pDQogPg0KID4gcmljaw0KID4N CiA+DQogPiBPbiBXZWQsIEZlYiA3LCAyMDI0IGF0IDEwOjUw4oCvQU0gTWF0dGhldyBMLiBEYWls ZXkNCiA+IDxNYXR0aGV3LkwuRGFpbGV5QGRhcnRtb3V0aC5lZHU+IHdyb3RlOg0KID4+DQogPj4N CiA+PiBIaSBSaWNrLA0KID4+DQogPj4gTXkgbmFtZSBpcyBNYXR0IERhaWxleSwgYW5kIChhbW9u ZyBtYW55IG90aGVyIHRoaW5ncyksIEkgcnVuIGEgRnJlZUJTRA0KID4+IGZpbGUgc2VydmVyIGZv ciB0aGUgVGhheWVyIFNjaG9vbCBvZiBFbmdpbmVlcmluZyBhbmQgdGhlIERlcGFydG1lbnQgb2YN CiA+PiBDb21wdXRlciBTY2llbmNlIGhlcmUgYXQgRGFydG1vdXRoIENvbGxlZ2UuIFdlIGhhdmUg cnVuIGludG8gYSB2ZXJ5IG9kZA0KID4+IGlzc3VlIGluIHdoaWNoIG5mczQgTGludXggY2xpZW50 cyB1c2luZyBoZGY1IGZpbGVzIGFyZSBjb3JydXB0aW5nIG1lbW9yeQ0KID4+IGFuZCBjYXVzaW5n IGtlcm5lbCBwYW5pY3Mgb24gb3VyIEZyZWVCU0Qgc2VydmVyLiBUaGUgaXNzdWUgaXMgdmVyeQ0K ID4+IGNvbXBsZXggdG8gZGVzY3JpYmUsIGFuZCBkZXNwaXRlIG91ciBkaWxpZ2VudCBlZmZvcnRz LCB3ZSBoYXZlIG5vdCBiZWVuDQogPj4gYWJsZSB0byByZXBsaWNhdGUgaXQgaW4gYSBzaW1wbGUg c2NlbmFyaW8gdG8gcmVwb3J0IHRvIEZyZWVCU0QNCiA+PiBkZXZlbG9wZXJzLiBJbiBhZHZhbmNl IG9mIGZpbGluZyBhbiBvZmZpY2lhbCBidWcgcmVwb3J0LCBJ4oCZbSByZWFjaGluZw0KID4+IG91 dCBpbiB0aGUgaG9wZXMgb2YgaGF2aW5nIGEgZGlzY3Vzc2lvbiB0byBnZXQgeW91ciBndWlkYW5j ZSBhYm91dCBob3cNCiA+PiBiZXN0IHRvIHByb2NlZWQuDQogPj4NCiA+PiBUaGUgcXVpY2sgYmFj a2dyb3VuZCBpcyB0aGF0IHdl4oCZdmUgYmVlbiBydW5uaW5nIGEgRnJlZUJTRCBmaWxlIHNlcnZl ciwNCiA+PiBzZXJ2aW5nIGZpbGVzIGZyb20gYSB6ZnMgZmlsZXN5c3RlbSBvdmVyIGtlcmJlcml6 ZWQgbmZzNCBhbmQgc2FtYmEgZm9yDQogPj4gYWxtb3N0IDExIHllYXJzLCB0aHJvdWdoIDMgZGlm ZmVyZW50IGdlbmVyYXRpb25zIG9mIGhhcmR3YXJlIGFuZCBmcm9tDQogPj4gRnJlZUJTRCA5LjEg dXAgdGhyb3VnaCAxMy4yLiBUaGlzIHN5c3RlbSBoYXMgaGlzdG9yaWNhbGx5IGJlZW4NCiA+PiB3 b25kZXJmdWxseSBzdGFibGUgYW5kIHJvYnVzdC4NCiA+Pg0KID4+IEJlZ2lubmluZyBsYXRlIGlu IDIwMjIsIGFuZCB0aGVuIG1vcmUgcmVndWxhcmx5IGJlZ2lubmluZyBpbiBKdWx5IG9mDQogPj4g MjAyMywgd2Ugc3RhcnRlZCBleHBlcmllbmNpbmcga2VybmVsIHBhbmljcyBvbiBvdXIgY3VycmVu dCBzeXN0ZW0sIHRoZW4NCiA+PiBydW5uaW5nIEZyZWVCU0QgMTMuMC4gVGhleSB3ZXJlIHNlZW1p bmdseSByYW5kb20gKG1vc3RseSB0cmFwIDEyIGFuZA0KID4+IHRyYXAgOSkgaW4gcmFuZG9tIGtl cm5lbCBmdW5jdGlvbnMsIHNvIHdlIGluaXRpYWxseSBibGFtZWQgaGFyZHdhcmUuIFdlDQogPj4g cmVwbGFjZWQgYWxsIFJBTSwgbW92ZWQgdG8gYmFja3VwIGhhcmR3YXJlLCBhbmQgZXZlbiBtb3Zl ZCB0byBhbiBvbGRlciwNCiA+PiByZXRpcmVkIHN5c3RlbSBhbmQgdGhlIHBhbmljcyBwZXJzaXN0 ZWQuIFdlIGhhdmUgYWxzbyB1cGdyYWRlZCBmcm9tIDEzLjANCiA+PiB0byAxMy4yIGFuZCBhcmUg Y3VycmVudGx5IGF0IDEzLjJwNS4NCiA+Pg0KID4+IEFmdGVyIG1vbnRocyBvZiBpbnZlc3RpZ2F0 aW9uLCB3ZSBmaW5hbGx5IG5hcnJvd2VkIGRvd24gdGhhdCB0aGVzZQ0KID4+IHBhbmljcyB3ZXJl IGJlaW5nIGNhdXNlZCBieSBzb2Z0d2FyZSBvbiBvdXIgTGludXggY2xpZW50cyB3cml0aW5nIGhk ZjUNCiA+PiBmaWxlcyBvdmVyIG5mcyB0byB0aGUgRnJlZUJTRCBzZXJ2ZXIuIEFzIG5lYXIgYXMg d2UgY2FuIHRlbGwgZnJvbSBwb3JpbmcNCiA+PiB0aHJvdWdoIGNvcmUgZHVtcHMsIHNvbWV0aGlu ZyBhYm91dCBob3cgdGhpcyBuZnMgdHJhZmZpYyBpcyBiZWluZw0KID4+IHByb2Nlc3NlZCBpcyBj b3JydXB0aW5nIGtlcm5lbCBtZW1vcnkgYW5kIHRoZW4gZXZlbnR1YWxseSBhIHBhbmljIGlzDQog Pj4gaGFwcGVuaW5nIHdoZW4gc29tZSB1bnN1c3BlY3RpbmcgZnVuY3Rpb24gcmVhZHMgdGhlIGNv cnJ1cHRlZCBtZW1vcnkuDQogPj4gU2luY2Ugd2UgaGF2ZSBlbGltaW5hdGVkIG1vc3Qga25vd24g aGRmNSB3b3JrbG9hZHMgb24gb3VyIHByb2R1Y3Rpb24NCiA+PiBzeXN0ZW0sIHRoZSBwYW5pY3Mg aGF2ZSBtb3N0bHkgY2Vhc2VkLCBhbmQgd2Ugc3VzcGVjdCB0aGF0IHRoZSByZW1haW5pbmcNCiA+ PiBjcmFzaGVzIGNvdWxkIGJlIGZyb20gdXNlcnMgc3RpbGwgdXNpbmcgaGRmNS4NCiA+Pg0KID4+ IFdlIGhhdmUgcmVwcm9kdWNlZCB0aGlzIGlzc3VlIHdpdGggYm90aCBrcmI1IGFuZCBzeXMgbW91 bnRzLCBhbmQgdXANCiA+PiB0aHJvdWdoIDEzLjJwOSBhbmQgMTQuMHA0LiBBbGwgb3VyIHRlc3Rp bmcgaGFzIGJlZW4gdXNpbmcgbmZzIDQuMS4NCiA+PiBEZXBlbmRpbmcgb24gY29uZGl0aW9ucywg cGFuaWNzIHNvbWV0aW1lcyBvY2N1ciB3aXRoaW4gYW4gaG91ciBvciB0d28sDQogPj4gb3Igc29t ZXRpbWVzIGNhbiB0YWtlIHNldmVyYWwgZGF5cy4gT24gMTQuMCwgdGhlIHBhbmljcyBzZWVtcyBt dWNoIGxlc3MNCiA+PiBwcmV2YWxlbnQsIGJ1dCBzdGlsbCBleGlzdC4gV2l0aCAxMy54LCBpdCBp cyBlYXNpZXIgdG8gcmVwcm9kdWNlIG9uDQogPj4gaGFyZHdhcmUgdGhhbiBpdCBpcyBvbiBhIFZN LiBXaXRoIDE0LjAsIGl0IGlzIHRoZSBvcHBvc2l0ZS4gV2UgaGF2ZQ0KID4+IHBhbmlja2VkIG91 ciB0ZXN0IFZNIG1hbnkgdGltZXMgaW4gdGhlIHBhc3QgdHdvIHdlZWtzLCBidXQgaGF2ZSBub3Qg eWV0DQogPj4gaGFkIGEgcGFuaWMgb24gdGVzdCBoYXJkd2FyZS4gQW5kLCBvbmUgb2YgdGhlIHBh bmljcyBvbiB0aGUgVk0gYWN0dWFsbHkNCiA+PiBjb3JydXB0ZWQgdGhlIHJvb3QgenBvb2wgc3Vj aCB0aGF0IGl0IGNvdWxkIG5vdCBiZSBpbXBvcnRlZCBvciANCnJlY292ZXJlZCENCiA+Pg0KID4+ IEnigJltIGNvbnRhY3RpbmcgeW91IGRpcmVjdGx5IGFzIHlvdSBzZWVtIHRvIGJlIOKAnHRoZSBn dXnigJ0gd2hlbiBpdCBjb21lcyB0bw0KID4+IGFsbCB0aGluZ3MgbmZzIG9uIEZyZWVCU0QuIEFm dGVyIGh1bmRyZWRzIG9mIGhvdXJzIGludmVzdGlnYXRpbmcsIEnigJltDQogPj4gbGVmdCB3aXRo IHRoZSBmZWVsaW5nIHRoYXQgYSBidWcgcmVwb3J0IGRlc2NyaWJpbmcgdGhlc2UgY29tcGxleA0K ID4+IHNjZW5hcmlvcyB3aWxsIGJlIGV4dHJlbWVseSB1bmFwcGV0aXppbmcgdG8gc2luayBvbmXi gJlzIHRlZXRoIGludG8uIEl0DQogPj4gZmVlbHMgbGlrZSBhIGRpc2N1c3Npb24gd291bGQgYWNj b21wbGlzaCBtb3JlLiBXZSB3b3VsZCBiZSBhYmxlIHRvDQogPj4gYW5zd2VyIHF1ZXN0aW9ucyB0 byBkZXNjcmliZSB0aGlzIGNvbXBsZXggaXNzdWUgd2l0aCB0aGUgbnVhbmNlIHlvdQ0KID4+IG5l ZWQsIGFuZCB5b3UgbWlnaHQgaGF2ZSBpZGVhcyBmb3IgaG93IHdlIGNvdWxkIGhlbHAgbmFycm93 IHRoaW5ncyBkb3duDQogPj4gZnVydGhlciBmb3IgdGhlIGJlbmVmaXQgb2YgYm90aCBGcmVlQlNE IGFuZCBEYXJ0bW91dGguDQogPj4NCiA+PiBXZSBjdXJyZW50bHkgYXJlIHNlcnZpbmcgYWJvdXQg NDAwVEIgb2YgZGF0YSB0byBmYWN1bHR5LCBzdGFmZiwNCiA+PiByZXNlYXJjaGVycyBhbmQgc3R1 ZGVudHMgKGh1bmRyZWRzIG9mIHVzZXJzKSBhbmQgYXJlIGVhZ2VyIHRvIGdldCB0aGlzDQogPj4g aW50byB0aGUgaGFuZHMgb2YgZm9sa3MgdGhhdCBjYW4gaGVscCBkaWFnbm9zZSBhbmQgZml4IHRo aXMgaXNzdWUuDQogPj4NCiA+PiBUaGFua3Mgc28gbXVjaCBmb3IgYW55IGhlbHAgeW91IGNhbiBw cm92aWRlLg0KID4+DQogPj4gQmVzdCwNCiA+PiBNYXR0DQogPj4NCiA+PiAtLQ0KID4+IE1hdHRo ZXcgTC4gRGFpbGV5DQogPj4gRW50ZXJwcmlzZSBTeXN0ZW1zIEVuZ2luZWVyDQogPj4gVGhheWVy IFNjaG9vbCBvZiBFbmdpbmVlcmluZw0KID4+IERhcnRtb3V0aCBDb2xsZWdlDQogPj4gKzEgKDYw MykgNjQ2LTI3NjANCg== From nobody Fri Feb 9 16:04:30 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWdw33m8Fz59vjB for ; Fri, 9 Feb 2024 16:04:35 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qt1-x82b.google.com (mail-qt1-x82b.google.com [IPv6:2607:f8b0:4864:20::82b]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWdw24byDz4MHb for ; Fri, 9 Feb 2024 16:04:34 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=WpDwjjON; dmarc=fail reason="SPF not aligned (relaxed), DKIM not aligned (relaxed)" header.from=freebsd.org (policy=none); spf=pass (mx1.freebsd.org: domain of markjdb@gmail.com designates 2607:f8b0:4864:20::82b as permitted sender) smtp.mailfrom=markjdb@gmail.com Received: by mail-qt1-x82b.google.com with SMTP id d75a77b69052e-42a99202ae0so7439061cf.1 for ; Fri, 09 Feb 2024 08:04:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707494674; x=1708099474; darn=freebsd.org; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :from:to:cc:subject:date:message-id:reply-to; bh=WTN97BSdlaOiRKD8wKrZlc+wbYB50u73zGxQlHhxFYo=; b=WpDwjjONQFFvXWtP8K21jWnWDV8z+JtlY0dhXWu7/6wS5U1e4dSSqwT1w/nWVM7jzQ Eus3KTdxA/cmcvvTGkFmUOszbsJNbJlCFT2Pq5Uubd1mhxDuULC4xZwxBc6ex+AkSfLQ JE0DI36E+QAzdOPgQJpcpvG9F6Stlo3kLgZiThfnZ3uFdkxFYgSGjoqabD+iq4ajO6r7 BOV6Xv0VoHiRbR6nBtJcOSmYTXKVOiF+7vIHPbchyK2YUUtdwlWRWrB9z3Jb5Ydn0Kmo RBxbvYUDYsLSWe5vwCl5hncvhIEXKUkAbU1uJHoenqw39dfyb+GZTFS8CzignTw/Er+h lIzQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707494674; x=1708099474; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=WTN97BSdlaOiRKD8wKrZlc+wbYB50u73zGxQlHhxFYo=; b=mgvrO/lHTOGUdSgElOTLvZymRgBUwDVk4CfG+2Iqz7odnmh3NxK+wNvPZEaa/tPPCf fdTjxI24cObKLqCEO42ABMhuajjWibaZ1Cyps+EfIbZKm2YtcgV9MbSF3+gIslNbT8/S iPDgM6Sw7v+V8T1OntB5pYW+X+4W4p+aSSHt/n8m5fODyYPet+GwMc4Jwi44F3R9sxC6 6+EPAH94CrFZXTAkxVAaDpPlJ+iuidK5k19TwSm5ATWGklgcaXXjVnm/5CUmDySmPQdv 2X3lmxzFt0GDDcMDxz7KOE5cE792d6C/gRrrb1VR/GAlk0oiNahSos0IUH1BH6W4RYMX bv0Q== X-Gm-Message-State: AOJu0YymFqkem4g2ymVNkJGuriHBMJkcACllu+OBxgZfoUfijaispsir Cd3n1+5NnfOcPhydXf+r7m3Iv5GqK/DhHGX129RId7PtrfjV3/E+J3h/cjDN X-Google-Smtp-Source: AGHT+IGg7bxfk8roGB+XWqapGg4HMc5chgIf+6AwCLp+qo8khFSVB1EOesTbga/TOJ8fTUPw0DJaaw== X-Received: by 2002:ac8:5910:0:b0:42c:56cd:14a2 with SMTP id 16-20020ac85910000000b0042c56cd14a2mr2333994qty.6.1707494673709; Fri, 09 Feb 2024 08:04:33 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id b6-20020ac86bc6000000b0042c0d54b1c6sm812525qtt.31.2024.02.09.08.04.32 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 09 Feb 2024 08:04:33 -0800 (PST) Date: Fri, 9 Feb 2024 11:04:30 -0500 From: Mark Johnston To: "Matthew L. Dailey" Cc: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: X-Spamd-Bar: / X-Spamd-Result: default: False [-0.59 / 15.00]; INTRODUCTION(2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.987]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[markj@freebsd.org,markjdb@gmail.com]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), DKIM not aligned (relaxed),none]; FREEMAIL_ENVFROM(0.00)[gmail.com]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::82b:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_NEQ_ENVFROM(0.00)[markj@freebsd.org,markjdb@gmail.com]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Rspamd-Queue-Id: 4TWdw24byDz4MHb On Thu, Feb 08, 2024 at 03:34:52PM +0000, Matthew L. Dailey wrote: > Good morning all, > > Per Rick Macklem's suggestion, I'm posting this query here in the hopes > that other may have ideas. > > We did do some minimal testing with ufs around this problem back in > August, but hadn't narrowed the issue down to hdf5 workloads yet, so > testing was inconclusive. We'll do further testing on this to try to > rule in or out zfs as a contributing factor. > > I'm happy to provide more technical details about this issue, but it is > quite complex to explain and reproduce. It sounds like you've so far only tested with release kernels, is that right? To make some progress and narrow this down a bit, we'd want to see testing results from a debug kernel. Unfortunately we don't ship pre-compiled debug kernels with releases, so you'll have to compile your own, or test a snapshot of the development branch. To do the former, add the following lines to /usr/src/sys/amd64/conf/GENERIC and follow the steps here: https://docs.freebsd.org/en/books/handbook/kernelconfig/#kernelconfig-building options DDB options INVARIANT_SUPPORT options INVARIANTS options QUEUE_MACRO_DEBUG_TRASH options WITNESS options WITNESS_SKIPSPIN Since the problem appears to be some random memory corruption, I'd also suggest using a KASAN(9) kernel in your test VM. If the root cause of the crashes is some kind of use-after-free or buffer overflow, KASAN has a good chance of catching it. Note that both debug kernels and KASAN kernels have are significantly slower than release kernels, so you'll want to deploy these in your test VM. Once you do, and a panic occurs, share the panic message and backtrace here, and we'll have a better idea of where to start. > Thanks in advance for any help! > > Best, > Matt > > On 2/7/24 6:10 PM, Rick Macklem wrote: > > > > Well, there is certainly no obvious answer. > > One thing I would suggest is setting up a test > > server using UFS and see it if panics. > > > > To be honest, NFS is pretty simple when it comes > > to server side reading/writiing. It basically translates > > NFS RPCs to VOP calls on the underlying file system. > > As such, issues are usually either network fabric on one side > > (everything from cables to NIC drives and the TCP stack). > > Since you are seeing this with assorted NICs and FreeBSD > > versions, I doubt it is network fabric related, but?? > > This is why I'd suspect the ZFS side and trying UFS would > > isolate the problem to ZFS. > > > > Although I know nothing about hdf5 files, the NFS code does > > nothing with the data (it is just a byte stream), > > Since ZFS does normally do things like compression, it could be > > affected by the data contents. > > > > Another common (although less common now) problem is TSO > > when data of certain sizes (often just less than 64K) is handled. > > However, this usually results in hangs and I have never heard > > of memory data corruption. > > > > Bottom line..determining if it is ZFS specific would be the best > > first step, I think? > > > > It would be good to post this to a mailing list like freebsd-current@, > > since others might have some insite into this. (Although you are > > not using freebsd-current@, that is where most developers read > > email.) > > > > rick > > > > > > On Wed, Feb 7, 2024 at 10:50 AM Matthew L. Dailey > > wrote: > >> > >> > >> Hi Rick, > >> > >> My name is Matt Dailey, and (among many other things), I run a FreeBSD > >> file server for the Thayer School of Engineering and the Department of > >> Computer Science here at Dartmouth College. We have run into a very odd > >> issue in which nfs4 Linux clients using hdf5 files are corrupting memory > >> and causing kernel panics on our FreeBSD server. The issue is very > >> complex to describe, and despite our diligent efforts, we have not been > >> able to replicate it in a simple scenario to report to FreeBSD > >> developers. In advance of filing an official bug report, I’m reaching > >> out in the hopes of having a discussion to get your guidance about how > >> best to proceed. > >> > >> The quick background is that we’ve been running a FreeBSD file server, > >> serving files from a zfs filesystem over kerberized nfs4 and samba for > >> almost 11 years, through 3 different generations of hardware and from > >> FreeBSD 9.1 up through 13.2. This system has historically been > >> wonderfully stable and robust. > >> > >> Beginning late in 2022, and then more regularly beginning in July of > >> 2023, we started experiencing kernel panics on our current system, then > >> running FreeBSD 13.0. They were seemingly random (mostly trap 12 and > >> trap 9) in random kernel functions, so we initially blamed hardware. We > >> replaced all RAM, moved to backup hardware, and even moved to an older, > >> retired system and the panics persisted. We have also upgraded from 13.0 > >> to 13.2 and are currently at 13.2p5. > >> > >> After months of investigation, we finally narrowed down that these > >> panics were being caused by software on our Linux clients writing hdf5 > >> files over nfs to the FreeBSD server. As near as we can tell from poring > >> through core dumps, something about how this nfs traffic is being > >> processed is corrupting kernel memory and then eventually a panic is > >> happening when some unsuspecting function reads the corrupted memory. > >> Since we have eliminated most known hdf5 workloads on our production > >> system, the panics have mostly ceased, and we suspect that the remaining > >> crashes could be from users still using hdf5. > >> > >> We have reproduced this issue with both krb5 and sys mounts, and up > >> through 13.2p9 and 14.0p4. All our testing has been using nfs 4.1. > >> Depending on conditions, panics sometimes occur within an hour or two, > >> or sometimes can take several days. On 14.0, the panics seems much less > >> prevalent, but still exist. With 13.x, it is easier to reproduce on > >> hardware than it is on a VM. With 14.0, it is the opposite. We have > >> panicked our test VM many times in the past two weeks, but have not yet > >> had a panic on test hardware. And, one of the panics on the VM actually > >> corrupted the root zpool such that it could not be imported or > recovered! > >> > >> I’m contacting you directly as you seem to be “the guy” when it comes to > >> all things nfs on FreeBSD. After hundreds of hours investigating, I’m > >> left with the feeling that a bug report describing these complex > >> scenarios will be extremely unappetizing to sink one’s teeth into. It > >> feels like a discussion would accomplish more. We would be able to > >> answer questions to describe this complex issue with the nuance you > >> need, and you might have ideas for how we could help narrow things down > >> further for the benefit of both FreeBSD and Dartmouth. > >> > >> We currently are serving about 400TB of data to faculty, staff, > >> researchers and students (hundreds of users) and are eager to get this > >> into the hands of folks that can help diagnose and fix this issue. > >> > >> Thanks so much for any help you can provide. > >> > >> Best, > >> Matt > >> > >> -- > >> Matthew L. Dailey > >> Enterprise Systems Engineer > >> Thayer School of Engineering > >> Dartmouth College > >> +1 (603) 646-2760 From nobody Fri Feb 9 16:20:19 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWfGJ4lTpz59x4g for ; Fri, 9 Feb 2024 16:20:24 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on2122.outbound.protection.outlook.com [40.107.93.122]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWfGH17kkz4NyM; Fri, 9 Feb 2024 16:20:23 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Authentication-Results: mx1.freebsd.org; none ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=aZRzU0/XQUbTrQ6J5PfdzITzVcvTnHpLFEr55RpwPF91X9yaat4312KTVPz48Vlw8jHh8YnjwFLezDB3dzaP187SyG3rLyBJZnRnyL4hzAfwRocF7bnJvGV3vzU17LKtPD8AqUbhNpweC9mrlASHAusUII5HUiNKaxgi0isJec+0GuZRM3Hx+HsYHX6Cs9o+wDdJS1WGKtlTLSM6AR2HaiHPrNrVB0xC3/EoUo+C8A7pLjHvuVuG4Ahe6JxoVBJMCoVFAeZFGBqd44N9BwdfCLa77NA9la07j3rCcOsLFDz2aL/Gy2QU7miTeHqKJ/JZGVyS0B++xvMGv/4fM9bwzw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9qBrST0wKKkiFY4Vgprx5XWHFMqT2w6NSlm68Z+/Bco=; b=EPaTepiiEMDVUxqRYjQBeltl+Bov7pCNMjKcbcwTw77EUY2O7y60IcS80JMjbSmt1KKUFxElyrnnfRT+RMH0TK0MeqlvIiwVvDFX9FiCDdN+lFpN2hZf1vDV+GczsFsMdYaYZoLxW6XPR9zNnS3PGhgZutGDgr38IlefkNgPIU013cneHF9OOqq6murp09L9nK58/5Mgr/6se+MpeavC1W3PfgYKD8oJ9w2WOE5pHZVCpXabVOaSdvl/JFgcYP9S+F53G8Xh577ZpBT+aEDV6v4LWCxUAARDWz0TI2LBoBlzVKcSC8+cOUWz8qloAEzSXm/yU3islbr+uZxTMJtqfg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dartmouth.edu; dmarc=pass action=none header.from=dartmouth.edu; dkim=pass header.d=dartmouth.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dartmouth.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9qBrST0wKKkiFY4Vgprx5XWHFMqT2w6NSlm68Z+/Bco=; b=ih+TIqET1nmb4E+SEPTCbNQ4qhmA4eziMNiQhcYyHC/5RAfQCSG1aaE+Vv9XZGO4n2v7BAhwqhvY/vG6AjDhw+KamscC/9ih69vYZyaph7mJjtiHaeAWhIOaSvAphkEoiMNRJDgxq1r4PA5nAS98Yc3LhFM+eKYW764cd1TCgMI= Received: from DS7PR03MB5574.namprd03.prod.outlook.com (2603:10b6:5:2c1::16) by BL1PR03MB6198.namprd03.prod.outlook.com (2603:10b6:208:31e::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7270.27; Fri, 9 Feb 2024 16:20:19 +0000 Received: from DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e]) by DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e%7]) with mapi id 15.20.7249.038; Fri, 9 Feb 2024 16:20:19 +0000 From: "Matthew L. Dailey" To: Mark Johnston CC: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Thread-Topic: FreeBSD panics possibly caused by nfs clients Thread-Index: AQHaW3GuNV72DJinEE2eW1yguCVi9LECMNoA Date: Fri, 9 Feb 2024 16:20:19 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Mozilla Thunderbird x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR03MB5574:EE_|BL1PR03MB6198:EE_ x-ms-office365-filtering-correlation-id: cf9fcc6d-e517-4574-f09b-08dc298b024c x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: NvjzxYXDWrzionE8lSYs9brs5dTAF+0AW7ef2h58WhAK3+cgwfSDTCqhNgYal7ZCWuf9WlSMQ3umBZ6lt6d36PgW2bcVbsqPG/nOLI+20g00l+KqgvGwngZEPydjMYGgYZxCuiWQLV5DtMNZs4SXREpyQa53FUEV2ZhweNHqDU4s/hInhrEq+G8VDzrJa0/174zm3svMPmId1lM1iLXTWvkleAM5BmQCAaZxBU5TvXzSPySkhqhZ7OeFUfeHBqM3aX7fEzPeI1Gx7JEThBgD/2RdkuX19XgYkdB2lm3oXg/OiUjINtP/31NeeMzW0xRNzd9rET93oyq36dZeES/cFPj3UdESkE4LBeW/Phpa08jzVO6fGHvmFlS4st46kE4ZlplMSMKBsJUEatwi25BVz0qO9qknhWpnRP0x7QUEmQH+9y0B5XKP3hnvCaLDDX51RFpAiE//0PvKxfvBwRUVHEHAwVXbr5h8GYTSya+9+t6Gn2EdNR/e+87+1MZwAfO+3YyIwfuYgvnFyUJ/B3jf/9laGAa5Aj8dkQB0hAtuu2yEN1VJSys2tx11BoTNjoQxvwIP9Wz2JNsGM5Cbd3Ul+0ckcv0xPQ6EYRxTWjC7KFs= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5574.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(396003)(346002)(136003)(366004)(376002)(39860400002)(230473577357003)(230922051799003)(230273577357003)(64100799003)(451199024)(1800799012)(186009)(75432002)(2616005)(41300700001)(478600001)(6506007)(6512007)(966005)(6486002)(31686004)(53546011)(2906002)(5660300002)(4326008)(66446008)(66556008)(6916009)(66946007)(450100002)(91956017)(8676002)(66476007)(8936002)(64756008)(76116006)(316002)(786003)(71200400001)(26005)(83380400001)(86362001)(38100700002)(36756003)(31696002)(38070700009)(122000001)(40140700001);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?YXFyZkJINlZuN2RNOGJiWjFvUDllTlJ1eWFqSW56WHFRTnk0N09lUEZpb05t?= =?utf-8?B?d3dKK2hzbWhscDRudzhMK1Z4eDZjSmUrY2lNV1ErR2EwLzJCV05SN1Q1WU8v?= =?utf-8?B?bWZEcVlxOEhHTXdRYmxESkFTdi9PbXRHU3BOY2xjUWJneHZHbXI3UDlwYzZY?= =?utf-8?B?Rkp2Qk5mZ2taNWswYUtQZUlUTTVQczVMRnlZOGJsUUZER3NmMW41cExmNFJm?= =?utf-8?B?eFd1Qk84a1hhb1dRc1E5TENuYmhEenRVVDVIVmRDMjk2cEoyZG1peFloZ0xQ?= =?utf-8?B?aUVzWGdlQXBEUHovaWtpdjV6U1F0UzY2THNJYnEyaEQyc2hTaXdjRzVFTUU3?= =?utf-8?B?WndlOGgycUhRQTA1Z3cwdTRLZ1RteE9RTnJuY1NJV0pPemNJSkI0MlJ5LzJW?= =?utf-8?B?S21QVVV2U2Nld0Y1azNSSHoxV0kxMkMyN3d0cExTelBUb09idWZKYzA4NG1q?= =?utf-8?B?cjVxRHJoYU1xTGcvb21GYm1LQzdXVDM1bE80V2JMRFE4RldqYU9QamQ1OGZv?= =?utf-8?B?VkkyRzBYTnRVRWU1dVdQRTk2YTRaTXpYYnRwR3lNYkpUdlcvU0tHM1JUbDl4?= =?utf-8?B?c3hwNHl1OGEwRU02bXpRbHdseWpDK0VmUUdZOVBkd29FZG9TUkhoY2g2Y0xC?= =?utf-8?B?Y3NqL0ZBM3M4Z3MxcmQxSGQvUVhGbDZUdHJ3eXU3S1hMcnVCRzZ0NWRWSjNz?= =?utf-8?B?OUNxSStpeWtFM3NzSFVuamppNVJNaXZWQllWd29ENVJmUCtuVXA1bDhuRStP?= =?utf-8?B?Nk9jU2xGMFhGb1Y5T0x0YW5Xemo5ZytPbEc3WWNLYWRHaGtxSVhpSG1VL3Yz?= =?utf-8?B?N1JNcjYvNzlHT2wrcFlTOWs2aFJvdTRCb0tCdEN4UDdYL3VNc3hWU0JzOU42?= =?utf-8?B?c1FBRzFySjNGQ1AvZ2ZSem1IMEVyOER4NmR0cUNadXhTbXM3VkxMdzFPN1dp?= =?utf-8?B?TUpaQnkwM3A3RU9kZVFIZFloWm5MTzhEMW5vbGYwejkvd3h4U2xFVVM1SVdD?= =?utf-8?B?Q3FTSjcrb2VEWXNkWVlZTkpMQm5wUE8xSFRQbWpqLzdqalRJZnhJQUVEZEVK?= =?utf-8?B?RHFmMnhCRHp5WjErUUFxLzVFYUJBc3RYRk5ZZUJnYloyZkZlc3U0Q2lrbVBX?= =?utf-8?B?S2Z6S1dmaFd4WklldnM4ZFNlZFNYOGlFM1UvSFNhN1BJQVArSERrTFhBWFp4?= =?utf-8?B?bnlTdS91MExoMnR6dmJya2NEMlM4RGNPak9yNjU4VVh3OUxYdTJObllRNnVT?= =?utf-8?B?MmV2NTUxYkt2WEJGNno2d0Y2M0haYjdxRVhVaXkvb2RHd3dOSVNOVWZSdGFB?= =?utf-8?B?QVgyb2tsNTVVNnVQeklUTFVpSmxBSVFvaEx4K2I2QWVpN0o3TWdxVjFLSnpL?= =?utf-8?B?ckh3b0lRQXJobFJKbkUyU3RIVHQyK2hrSlFYVVEvWENldk1kaDZyajl4bE83?= =?utf-8?B?SGEvSTNPME5ONTVJVGppVWl0cm53eitXckMyckJkay94RkZHU0I2TGNhWnNa?= =?utf-8?B?TzJoS2hIZlUyR0hVUTlqelFmVklaTno5NWJZY21hMmI1TDFFVkdzajYzalM0?= =?utf-8?B?dmNYYlVOdSt1SXlKSWErbFNrRDVVMVRCQzhXQ0I4anJJazljOUU4Tm9sdVNj?= =?utf-8?B?V1NZSHlDMkRwUVpEWG1zK3lFaitnOVFyK2MwSjJ6R2daOGZodXZadng3dEdo?= =?utf-8?B?SnVOZisyL01PeHZxcU1NMWR6dUZ3TCs2S2Q0Ty9sU2Y2VDB0KzV3OXFrRE83?= =?utf-8?B?SS9RL1VRT0xmVTlNSVBoU3Z2bWdxVzBWSTJoU0RtWnNHREdBcEhHNnNuTWpu?= =?utf-8?B?Y3h2WkErN3laRE1Yb2lSMUsvRjh0MHdXTlJIVmlpZGdVNnlMcEk4d2JCTm1Y?= =?utf-8?B?MHllQVhUVWpHQ1JLZXBiWVR3LzdwMlZRYndybmhERWtKaURQWmN1dERpZU5H?= =?utf-8?B?SHVlWE5ERS8zbHJ6STR0YXg3UVpHZ0xSaUw0dGhuZUFiNCtHZ2tMZ1hwZWN3?= =?utf-8?B?bTNETmF2TEhPeVpIZlpkYml5b1dMdzNKZFR5WS9XOEZhMGJNeGtHSGRzZUtN?= =?utf-8?B?bTFEWjFyd3R3MUJ5endJNGgyK1ZRTCtFdVF3Um1HZjVCeVVpZkNMeXZOT3d3?= =?utf-8?Q?0UqQn/LgN6lCiAipq5W5xu5Bu?= Content-Type: text/plain; charset="utf-8" Content-ID: <8377402C550D1A47A5810ABE205E15F3@namprd03.prod.outlook.com> Content-Transfer-Encoding: base64 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: dartmouth.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5574.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: cf9fcc6d-e517-4574-f09b-08dc298b024c X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Feb 2024 16:20:19.5269 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 995b0936-48d6-40e5-a31e-bf689ec9446f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 32apC8NO4IQmlY8OvNDkhVLqeYQGQrDfK+szaWg9ccU7Po8KK2NVsHMzB3I3EYisC6/XtHZ+e1Riv2HSSWhyug== X-MS-Exchange-Transport-CrossTenantHeadersStamped: BL1PR03MB6198 X-Rspamd-Queue-Id: 4TWfGH17kkz4NyM X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US] DQpPbiAyLzkvMjQgMTE6MDQgQU0sIE1hcmsgSm9obnN0b24gd3JvdGU6DQo+IFtZb3UgZG9uJ3Qg b2Z0ZW4gZ2V0IGVtYWlsIGZyb20gbWFya2pAZnJlZWJzZC5vcmcuIExlYXJuIHdoeSB0aGlzIGlz IGltcG9ydGFudCBhdCBodHRwczovL2FrYS5tcy9MZWFybkFib3V0U2VuZGVySWRlbnRpZmljYXRp b24gXQ0KPiANCj4gT24gVGh1LCBGZWIgMDgsIDIwMjQgYXQgMDM6MzQ6NTJQTSArMDAwMCwgTWF0 dGhldyBMLiBEYWlsZXkgd3JvdGU6DQo+PiBHb29kIG1vcm5pbmcgYWxsLA0KPj4NCj4+IFBlciBS aWNrIE1hY2tsZW0ncyBzdWdnZXN0aW9uLCBJJ20gcG9zdGluZyB0aGlzIHF1ZXJ5IGhlcmUgaW4g dGhlIGhvcGVzDQo+PiB0aGF0IG90aGVyIG1heSBoYXZlIGlkZWFzLg0KPj4NCj4+IFdlIGRpZCBk byBzb21lIG1pbmltYWwgdGVzdGluZyB3aXRoIHVmcyBhcm91bmQgdGhpcyBwcm9ibGVtIGJhY2sg aW4NCj4+IEF1Z3VzdCwgYnV0IGhhZG4ndCBuYXJyb3dlZCB0aGUgaXNzdWUgZG93biB0byBoZGY1 IHdvcmtsb2FkcyB5ZXQsIHNvDQo+PiB0ZXN0aW5nIHdhcyBpbmNvbmNsdXNpdmUuIFdlJ2xsIGRv IGZ1cnRoZXIgdGVzdGluZyBvbiB0aGlzIHRvIHRyeSB0bw0KPj4gcnVsZSBpbiBvciBvdXQgemZz IGFzIGEgY29udHJpYnV0aW5nIGZhY3Rvci4NCj4+DQo+PiBJJ20gaGFwcHkgdG8gcHJvdmlkZSBt b3JlIHRlY2huaWNhbCBkZXRhaWxzIGFib3V0IHRoaXMgaXNzdWUsIGJ1dCBpdCBpcw0KPj4gcXVp dGUgY29tcGxleCB0byBleHBsYWluIGFuZCByZXByb2R1Y2UuDQo+IA0KPiBJdCBzb3VuZHMgbGlr ZSB5b3UndmUgc28gZmFyIG9ubHkgdGVzdGVkIHdpdGggcmVsZWFzZSBrZXJuZWxzLCBpcyB0aGF0 DQo+IHJpZ2h0PyAgVG8gbWFrZSBzb21lIHByb2dyZXNzIGFuZCBuYXJyb3cgdGhpcyBkb3duIGEg Yml0LCB3ZSdkIHdhbnQgdG8NCj4gc2VlIHRlc3RpbmcgcmVzdWx0cyBmcm9tIGEgZGVidWcga2Vy bmVsLiAgVW5mb3J0dW5hdGVseSB3ZSBkb24ndCBzaGlwDQo+IHByZS1jb21waWxlZCBkZWJ1ZyBr ZXJuZWxzIHdpdGggcmVsZWFzZXMsIHNvIHlvdSdsbCBoYXZlIHRvIGNvbXBpbGUgeW91cg0KPiBv d24sIG9yIHRlc3QgYSBzbmFwc2hvdCBvZiB0aGUgZGV2ZWxvcG1lbnQgYnJhbmNoLiAgVG8gZG8g dGhlIGZvcm1lciwNCj4gYWRkIHRoZSBmb2xsb3dpbmcgbGluZXMgdG8gL3Vzci9zcmMvc3lzL2Ft ZDY0L2NvbmYvR0VORVJJQyBhbmQgZm9sbG93DQo+IHRoZSBzdGVwcyBoZXJlOiBodHRwczovL2Rv Y3MuZnJlZWJzZC5vcmcvZW4vYm9va3MvaGFuZGJvb2sva2VybmVsY29uZmlnLyNrZXJuZWxjb25m aWctYnVpbGRpbmcNCj4gDQo+IG9wdGlvbnMgRERCDQo+IG9wdGlvbnMgSU5WQVJJQU5UX1NVUFBP UlQNCj4gb3B0aW9ucyBJTlZBUklBTlRTDQo+IG9wdGlvbnMgUVVFVUVfTUFDUk9fREVCVUdfVFJB U0gNCj4gb3B0aW9ucyBXSVRORVNTDQo+IG9wdGlvbnMgV0lUTkVTU19TS0lQU1BJTg0KPiANCj4g U2luY2UgdGhlIHByb2JsZW0gYXBwZWFycyB0byBiZSBzb21lIHJhbmRvbSBtZW1vcnkgY29ycnVw dGlvbiwgSSdkIGFsc28NCj4gc3VnZ2VzdCB1c2luZyBhIEtBU0FOKDkpIGtlcm5lbCBpbiB5b3Vy IHRlc3QgVk0uICBJZiB0aGUgcm9vdCBjYXVzZSBvZg0KPiB0aGUgY3Jhc2hlcyBpcyBzb21lIGtp bmQgb2YgdXNlLWFmdGVyLWZyZWUgb3IgYnVmZmVyIG92ZXJmbG93LCBLQVNBTiBoYXMNCj4gYSBn b29kIGNoYW5jZSBvZiBjYXRjaGluZyBpdC4gIE5vdGUgdGhhdCBib3RoIGRlYnVnIGtlcm5lbHMg YW5kIEtBU0FODQo+IGtlcm5lbHMgaGF2ZSBhcmUgc2lnbmlmaWNhbnRseSBzbG93ZXIgdGhhbiBy ZWxlYXNlIGtlcm5lbHMsIHNvIHlvdSdsbA0KPiB3YW50IHRvIGRlcGxveSB0aGVzZSBpbiB5b3Vy IHRlc3QgVk0uICBPbmNlIHlvdSBkbywgYW5kIGEgcGFuaWMgb2NjdXJzLA0KPiBzaGFyZSB0aGUg cGFuaWMgbWVzc2FnZSBhbmQgYmFja3RyYWNlIGhlcmUsIGFuZCB3ZSdsbCBoYXZlIGEgYmV0dGVy IGlkZWENCj4gb2Ygd2hlcmUgdG8gc3RhcnQuDQo+IA0KDQpIaSBNYXJrLA0KDQpUaGFua3MgZm9y IHlvdXIgcmVzcG9uc2UuIFRoaXMgaXMgbW9zdGx5IHJpZ2h0IC0gdGhlIGJ1bGsgb2Ygb3VyIHRl c3RpbmcgDQpoYXMgYmVlbiBvbiBHRU5FUklDLCB3aXRoIHRoZSBLR1NTQVBJIG9wdGlvbiBhZGRl ZCBmb3Iga2VyYmVyaXplZCBuZnMuDQoNCkkndmUgaGFkIHNvbWUgb3V0LW9mLWJhbmQgZGlzY3Vz c2lvbnMgd2hlcmUgSSBsZWFybmVkIGFib3V0IEtBU0FOIC0gSSANCmJ1aWx0IGEgMTQuMHA0IGtl cm5lbCB0aGlzIG1vcm5pbmcgd2l0aCB0aGlzIGFuZCBzdGFydGVkIGEgdGVzdCBhIGxpdHRsZSAN CndoaWxlIGFnby4NCg0KQmFzZWQgb24geW91ciBzdWdnZXN0aW9ucywgSSdsbCBhbHNvIGJ1aWxk IGEgZGVidWcga2VybmVsIHNvIEkgY2FuIGRvIA0Kc29tZSBwYXJhbGxlbCB0ZXN0aW5nIHdpdGgg dGhpcy4gSSBhbHNvIHN0aWxsIG5lZWQgdG8gZG8gbW9yZSB0ZXN0aW5nIHRvIA0KcnVsZSBpbiBv ciBvdXQgemZzIGFzIFJpY2sgc3VnZ2VzdGVkLg0KDQpJbiBvdXIgZXhwZXJpZW5jZSwgdGhlc2Ug cGFuaWNzIGNhbiB0YWtlIGhvdXJzIG9yIGRheXMgdG8gbWFuaWZlc3QgKG91ciANCmhpZ2ggYmFy IHNvIGZhciBpcyAxNzYgaG91cnMhKSwgc28gaXQgbWF5IHRha2UgYSB3aGlsZSB0byBnZXQgcmVz dWx0cy4gOi0pDQoNCkknbGwgcG9zdCBtb3JlIGhlcmUgYXMgdGhlcmUncyBhbnl0aGluZyB0byBy ZXBvcnQuDQoNCkJlc3QsDQpNYXR0DQoNCj4+IFRoYW5rcyBpbiBhZHZhbmNlIGZvciBhbnkgaGVs cCENCj4+DQo+PiBCZXN0LA0KPj4gTWF0dA0KPj4NCj4+IE9uIDIvNy8yNCA2OjEwIFBNLCBSaWNr IE1hY2tsZW0gd3JvdGU6DQo+PiAgID4NCj4+ICAgPiBXZWxsLCB0aGVyZSBpcyBjZXJ0YWlubHkg bm8gb2J2aW91cyBhbnN3ZXIuDQo+PiAgID4gT25lIHRoaW5nIEkgd291bGQgc3VnZ2VzdCBpcyBz ZXR0aW5nIHVwIGEgdGVzdA0KPj4gICA+IHNlcnZlciB1c2luZyBVRlMgYW5kIHNlZSBpdCBpZiBw YW5pY3MuDQo+PiAgID4NCj4+ICAgPiBUbyBiZSBob25lc3QsIE5GUyBpcyBwcmV0dHkgc2ltcGxl IHdoZW4gaXQgY29tZXMNCj4+ICAgPiB0byBzZXJ2ZXIgc2lkZSByZWFkaW5nL3dyaXRpaW5nLiBJ dCBiYXNpY2FsbHkgdHJhbnNsYXRlcw0KPj4gICA+IE5GUyBSUENzIHRvIFZPUCBjYWxscyBvbiB0 aGUgdW5kZXJseWluZyBmaWxlIHN5c3RlbS4NCj4+ICAgPiBBcyBzdWNoLCBpc3N1ZXMgYXJlIHVz dWFsbHkgZWl0aGVyIG5ldHdvcmsgZmFicmljIG9uIG9uZSBzaWRlDQo+PiAgID4gKGV2ZXJ5dGhp bmcgZnJvbSBjYWJsZXMgdG8gTklDIGRyaXZlcyBhbmQgdGhlIFRDUCBzdGFjaykuDQo+PiAgID4g U2luY2UgeW91IGFyZSBzZWVpbmcgdGhpcyB3aXRoIGFzc29ydGVkIE5JQ3MgYW5kIEZyZWVCU0QN Cj4+ICAgPiB2ZXJzaW9ucywgSSBkb3VidCBpdCBpcyBuZXR3b3JrIGZhYnJpYyByZWxhdGVkLCBi dXQ/Pw0KPj4gICA+IFRoaXMgaXMgd2h5IEknZCBzdXNwZWN0IHRoZSBaRlMgc2lkZSBhbmQgdHJ5 aW5nIFVGUyB3b3VsZA0KPj4gICA+IGlzb2xhdGUgdGhlIHByb2JsZW0gdG8gWkZTLg0KPj4gICA+ DQo+PiAgID4gQWx0aG91Z2ggSSBrbm93IG5vdGhpbmcgYWJvdXQgaGRmNSBmaWxlcywgdGhlIE5G UyBjb2RlIGRvZXMNCj4+ICAgPiBub3RoaW5nIHdpdGggdGhlIGRhdGEgKGl0IGlzIGp1c3QgYSBi eXRlIHN0cmVhbSksDQo+PiAgID4gU2luY2UgWkZTIGRvZXMgbm9ybWFsbHkgZG8gdGhpbmdzIGxp a2UgY29tcHJlc3Npb24sIGl0IGNvdWxkIGJlDQo+PiAgID4gYWZmZWN0ZWQgYnkgdGhlIGRhdGEg Y29udGVudHMuDQo+PiAgID4NCj4+ICAgPiBBbm90aGVyIGNvbW1vbiAoYWx0aG91Z2ggbGVzcyBj b21tb24gbm93KSBwcm9ibGVtIGlzIFRTTw0KPj4gICA+IHdoZW4gZGF0YSBvZiBjZXJ0YWluIHNp emVzIChvZnRlbiBqdXN0IGxlc3MgdGhhbiA2NEspIGlzIGhhbmRsZWQuDQo+PiAgID4gSG93ZXZl ciwgdGhpcyB1c3VhbGx5IHJlc3VsdHMgaW4gaGFuZ3MgYW5kIEkgaGF2ZSBuZXZlciBoZWFyZA0K Pj4gICA+IG9mIG1lbW9yeSBkYXRhIGNvcnJ1cHRpb24uDQo+PiAgID4NCj4+ICAgPiBCb3R0b20g bGluZS4uZGV0ZXJtaW5pbmcgaWYgaXQgaXMgWkZTIHNwZWNpZmljIHdvdWxkIGJlIHRoZSBiZXN0 DQo+PiAgID4gZmlyc3Qgc3RlcCwgSSB0aGluaz8NCj4+ICAgPg0KPj4gICA+IEl0IHdvdWxkIGJl IGdvb2QgdG8gcG9zdCB0aGlzIHRvIGEgbWFpbGluZyBsaXN0IGxpa2UgZnJlZWJzZC1jdXJyZW50 QCwNCj4+ICAgPiBzaW5jZSBvdGhlcnMgbWlnaHQgaGF2ZSBzb21lIGluc2l0ZSBpbnRvIHRoaXMu IChBbHRob3VnaCB5b3UgYXJlDQo+PiAgID4gbm90IHVzaW5nIGZyZWVic2QtY3VycmVudEAsIHRo YXQgaXMgd2hlcmUgbW9zdCBkZXZlbG9wZXJzIHJlYWQNCj4+ICAgPiBlbWFpbC4pDQo+PiAgID4N Cj4+ICAgPiByaWNrDQo+PiAgID4NCj4+ICAgPg0KPj4gICA+IE9uIFdlZCwgRmViIDcsIDIwMjQg YXQgMTA6NTDigK9BTSBNYXR0aGV3IEwuIERhaWxleQ0KPj4gICA+IDxNYXR0aGV3LkwuRGFpbGV5 QGRhcnRtb3V0aC5lZHU+IHdyb3RlOg0KPj4gICA+Pg0KPj4gICA+Pg0KPj4gICA+PiBIaSBSaWNr LA0KPj4gICA+Pg0KPj4gICA+PiBNeSBuYW1lIGlzIE1hdHQgRGFpbGV5LCBhbmQgKGFtb25nIG1h bnkgb3RoZXIgdGhpbmdzKSwgSSBydW4gYSBGcmVlQlNEDQo+PiAgID4+IGZpbGUgc2VydmVyIGZv ciB0aGUgVGhheWVyIFNjaG9vbCBvZiBFbmdpbmVlcmluZyBhbmQgdGhlIERlcGFydG1lbnQgb2YN Cj4+ICAgPj4gQ29tcHV0ZXIgU2NpZW5jZSBoZXJlIGF0IERhcnRtb3V0aCBDb2xsZWdlLiBXZSBo YXZlIHJ1biBpbnRvIGEgdmVyeSBvZGQNCj4+ICAgPj4gaXNzdWUgaW4gd2hpY2ggbmZzNCBMaW51 eCBjbGllbnRzIHVzaW5nIGhkZjUgZmlsZXMgYXJlIGNvcnJ1cHRpbmcgbWVtb3J5DQo+PiAgID4+ IGFuZCBjYXVzaW5nIGtlcm5lbCBwYW5pY3Mgb24gb3VyIEZyZWVCU0Qgc2VydmVyLiBUaGUgaXNz dWUgaXMgdmVyeQ0KPj4gICA+PiBjb21wbGV4IHRvIGRlc2NyaWJlLCBhbmQgZGVzcGl0ZSBvdXIg ZGlsaWdlbnQgZWZmb3J0cywgd2UgaGF2ZSBub3QgYmVlbg0KPj4gICA+PiBhYmxlIHRvIHJlcGxp Y2F0ZSBpdCBpbiBhIHNpbXBsZSBzY2VuYXJpbyB0byByZXBvcnQgdG8gRnJlZUJTRA0KPj4gICA+ PiBkZXZlbG9wZXJzLiBJbiBhZHZhbmNlIG9mIGZpbGluZyBhbiBvZmZpY2lhbCBidWcgcmVwb3J0 LCBJ4oCZbSByZWFjaGluZw0KPj4gICA+PiBvdXQgaW4gdGhlIGhvcGVzIG9mIGhhdmluZyBhIGRp c2N1c3Npb24gdG8gZ2V0IHlvdXIgZ3VpZGFuY2UgYWJvdXQgaG93DQo+PiAgID4+IGJlc3QgdG8g cHJvY2VlZC4NCj4+ICAgPj4NCj4+ICAgPj4gVGhlIHF1aWNrIGJhY2tncm91bmQgaXMgdGhhdCB3 ZeKAmXZlIGJlZW4gcnVubmluZyBhIEZyZWVCU0QgZmlsZSBzZXJ2ZXIsDQo+PiAgID4+IHNlcnZp bmcgZmlsZXMgZnJvbSBhIHpmcyBmaWxlc3lzdGVtIG92ZXIga2VyYmVyaXplZCBuZnM0IGFuZCBz YW1iYSBmb3INCj4+ICAgPj4gYWxtb3N0IDExIHllYXJzLCB0aHJvdWdoIDMgZGlmZmVyZW50IGdl bmVyYXRpb25zIG9mIGhhcmR3YXJlIGFuZCBmcm9tDQo+PiAgID4+IEZyZWVCU0QgOS4xIHVwIHRo cm91Z2ggMTMuMi4gVGhpcyBzeXN0ZW0gaGFzIGhpc3RvcmljYWxseSBiZWVuDQo+PiAgID4+IHdv bmRlcmZ1bGx5IHN0YWJsZSBhbmQgcm9idXN0Lg0KPj4gICA+Pg0KPj4gICA+PiBCZWdpbm5pbmcg bGF0ZSBpbiAyMDIyLCBhbmQgdGhlbiBtb3JlIHJlZ3VsYXJseSBiZWdpbm5pbmcgaW4gSnVseSBv Zg0KPj4gICA+PiAyMDIzLCB3ZSBzdGFydGVkIGV4cGVyaWVuY2luZyBrZXJuZWwgcGFuaWNzIG9u IG91ciBjdXJyZW50IHN5c3RlbSwgdGhlbg0KPj4gICA+PiBydW5uaW5nIEZyZWVCU0QgMTMuMC4g VGhleSB3ZXJlIHNlZW1pbmdseSByYW5kb20gKG1vc3RseSB0cmFwIDEyIGFuZA0KPj4gICA+PiB0 cmFwIDkpIGluIHJhbmRvbSBrZXJuZWwgZnVuY3Rpb25zLCBzbyB3ZSBpbml0aWFsbHkgYmxhbWVk IGhhcmR3YXJlLiBXZQ0KPj4gICA+PiByZXBsYWNlZCBhbGwgUkFNLCBtb3ZlZCB0byBiYWNrdXAg aGFyZHdhcmUsIGFuZCBldmVuIG1vdmVkIHRvIGFuIG9sZGVyLA0KPj4gICA+PiByZXRpcmVkIHN5 c3RlbSBhbmQgdGhlIHBhbmljcyBwZXJzaXN0ZWQuIFdlIGhhdmUgYWxzbyB1cGdyYWRlZCBmcm9t IDEzLjANCj4+ICAgPj4gdG8gMTMuMiBhbmQgYXJlIGN1cnJlbnRseSBhdCAxMy4ycDUuDQo+PiAg ID4+DQo+PiAgID4+IEFmdGVyIG1vbnRocyBvZiBpbnZlc3RpZ2F0aW9uLCB3ZSBmaW5hbGx5IG5h cnJvd2VkIGRvd24gdGhhdCB0aGVzZQ0KPj4gICA+PiBwYW5pY3Mgd2VyZSBiZWluZyBjYXVzZWQg Ynkgc29mdHdhcmUgb24gb3VyIExpbnV4IGNsaWVudHMgd3JpdGluZyBoZGY1DQo+PiAgID4+IGZp bGVzIG92ZXIgbmZzIHRvIHRoZSBGcmVlQlNEIHNlcnZlci4gQXMgbmVhciBhcyB3ZSBjYW4gdGVs bCBmcm9tIHBvcmluZw0KPj4gICA+PiB0aHJvdWdoIGNvcmUgZHVtcHMsIHNvbWV0aGluZyBhYm91 dCBob3cgdGhpcyBuZnMgdHJhZmZpYyBpcyBiZWluZw0KPj4gICA+PiBwcm9jZXNzZWQgaXMgY29y cnVwdGluZyBrZXJuZWwgbWVtb3J5IGFuZCB0aGVuIGV2ZW50dWFsbHkgYSBwYW5pYyBpcw0KPj4g ICA+PiBoYXBwZW5pbmcgd2hlbiBzb21lIHVuc3VzcGVjdGluZyBmdW5jdGlvbiByZWFkcyB0aGUg Y29ycnVwdGVkIG1lbW9yeS4NCj4+ICAgPj4gU2luY2Ugd2UgaGF2ZSBlbGltaW5hdGVkIG1vc3Qg a25vd24gaGRmNSB3b3JrbG9hZHMgb24gb3VyIHByb2R1Y3Rpb24NCj4+ICAgPj4gc3lzdGVtLCB0 aGUgcGFuaWNzIGhhdmUgbW9zdGx5IGNlYXNlZCwgYW5kIHdlIHN1c3BlY3QgdGhhdCB0aGUgcmVt YWluaW5nDQo+PiAgID4+IGNyYXNoZXMgY291bGQgYmUgZnJvbSB1c2VycyBzdGlsbCB1c2luZyBo ZGY1Lg0KPj4gICA+Pg0KPj4gICA+PiBXZSBoYXZlIHJlcHJvZHVjZWQgdGhpcyBpc3N1ZSB3aXRo IGJvdGgga3JiNSBhbmQgc3lzIG1vdW50cywgYW5kIHVwDQo+PiAgID4+IHRocm91Z2ggMTMuMnA5 IGFuZCAxNC4wcDQuIEFsbCBvdXIgdGVzdGluZyBoYXMgYmVlbiB1c2luZyBuZnMgNC4xLg0KPj4g ICA+PiBEZXBlbmRpbmcgb24gY29uZGl0aW9ucywgcGFuaWNzIHNvbWV0aW1lcyBvY2N1ciB3aXRo aW4gYW4gaG91ciBvciB0d28sDQo+PiAgID4+IG9yIHNvbWV0aW1lcyBjYW4gdGFrZSBzZXZlcmFs IGRheXMuIE9uIDE0LjAsIHRoZSBwYW5pY3Mgc2VlbXMgbXVjaCBsZXNzDQo+PiAgID4+IHByZXZh bGVudCwgYnV0IHN0aWxsIGV4aXN0LiBXaXRoIDEzLngsIGl0IGlzIGVhc2llciB0byByZXByb2R1 Y2Ugb24NCj4+ICAgPj4gaGFyZHdhcmUgdGhhbiBpdCBpcyBvbiBhIFZNLiBXaXRoIDE0LjAsIGl0 IGlzIHRoZSBvcHBvc2l0ZS4gV2UgaGF2ZQ0KPj4gICA+PiBwYW5pY2tlZCBvdXIgdGVzdCBWTSBt YW55IHRpbWVzIGluIHRoZSBwYXN0IHR3byB3ZWVrcywgYnV0IGhhdmUgbm90IHlldA0KPj4gICA+ PiBoYWQgYSBwYW5pYyBvbiB0ZXN0IGhhcmR3YXJlLiBBbmQsIG9uZSBvZiB0aGUgcGFuaWNzIG9u IHRoZSBWTSBhY3R1YWxseQ0KPj4gICA+PiBjb3JydXB0ZWQgdGhlIHJvb3QgenBvb2wgc3VjaCB0 aGF0IGl0IGNvdWxkIG5vdCBiZSBpbXBvcnRlZCBvcg0KPj4gcmVjb3ZlcmVkIQ0KPj4gICA+Pg0K Pj4gICA+PiBJ4oCZbSBjb250YWN0aW5nIHlvdSBkaXJlY3RseSBhcyB5b3Ugc2VlbSB0byBiZSDi gJx0aGUgZ3V54oCdIHdoZW4gaXQgY29tZXMgdG8NCj4+ICAgPj4gYWxsIHRoaW5ncyBuZnMgb24g RnJlZUJTRC4gQWZ0ZXIgaHVuZHJlZHMgb2YgaG91cnMgaW52ZXN0aWdhdGluZywgSeKAmW0NCj4+ ICAgPj4gbGVmdCB3aXRoIHRoZSBmZWVsaW5nIHRoYXQgYSBidWcgcmVwb3J0IGRlc2NyaWJpbmcg dGhlc2UgY29tcGxleA0KPj4gICA+PiBzY2VuYXJpb3Mgd2lsbCBiZSBleHRyZW1lbHkgdW5hcHBl dGl6aW5nIHRvIHNpbmsgb25l4oCZcyB0ZWV0aCBpbnRvLiBJdA0KPj4gICA+PiBmZWVscyBsaWtl IGEgZGlzY3Vzc2lvbiB3b3VsZCBhY2NvbXBsaXNoIG1vcmUuIFdlIHdvdWxkIGJlIGFibGUgdG8N Cj4+ICAgPj4gYW5zd2VyIHF1ZXN0aW9ucyB0byBkZXNjcmliZSB0aGlzIGNvbXBsZXggaXNzdWUg d2l0aCB0aGUgbnVhbmNlIHlvdQ0KPj4gICA+PiBuZWVkLCBhbmQgeW91IG1pZ2h0IGhhdmUgaWRl YXMgZm9yIGhvdyB3ZSBjb3VsZCBoZWxwIG5hcnJvdyB0aGluZ3MgZG93bg0KPj4gICA+PiBmdXJ0 aGVyIGZvciB0aGUgYmVuZWZpdCBvZiBib3RoIEZyZWVCU0QgYW5kIERhcnRtb3V0aC4NCj4+ICAg Pj4NCj4+ICAgPj4gV2UgY3VycmVudGx5IGFyZSBzZXJ2aW5nIGFib3V0IDQwMFRCIG9mIGRhdGEg dG8gZmFjdWx0eSwgc3RhZmYsDQo+PiAgID4+IHJlc2VhcmNoZXJzIGFuZCBzdHVkZW50cyAoaHVu ZHJlZHMgb2YgdXNlcnMpIGFuZCBhcmUgZWFnZXIgdG8gZ2V0IHRoaXMNCj4+ICAgPj4gaW50byB0 aGUgaGFuZHMgb2YgZm9sa3MgdGhhdCBjYW4gaGVscCBkaWFnbm9zZSBhbmQgZml4IHRoaXMgaXNz dWUuDQo+PiAgID4+DQo+PiAgID4+IFRoYW5rcyBzbyBtdWNoIGZvciBhbnkgaGVscCB5b3UgY2Fu IHByb3ZpZGUuDQo+PiAgID4+DQo+PiAgID4+IEJlc3QsDQo+PiAgID4+IE1hdHQNCj4+ICAgPj4N Cj4+ICAgPj4gLS0NCj4+ICAgPj4gTWF0dGhldyBMLiBEYWlsZXkNCj4+ICAgPj4gRW50ZXJwcmlz ZSBTeXN0ZW1zIEVuZ2luZWVyDQo+PiAgID4+IFRoYXllciBTY2hvb2wgb2YgRW5naW5lZXJpbmcN Cj4+ICAgPj4gRGFydG1vdXRoIENvbGxlZ2UNCj4+ICAgPj4gKzEgKDYwMykgNjQ2LTI3NjANCg== From nobody Fri Feb 9 18:23:08 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWj016dVkz5B6s5 for ; Fri, 9 Feb 2024 18:23:13 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on20725.outbound.protection.outlook.com [IPv6:2a01:111:f400:7e88::725]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWj005cGcz4bWx for ; Fri, 9 Feb 2024 18:23:12 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=dartmouth.edu header.s=selector2 header.b=cRPWLJ+O; arc=pass ("microsoft.com:s=arcselector9901:i=1"); dmarc=pass (policy=none) header.from=dartmouth.edu; spf=pass (mx1.freebsd.org: domain of Matthew.L.Dailey@dartmouth.edu designates 2a01:111:f400:7e88::725 as permitted sender) smtp.mailfrom=Matthew.L.Dailey@dartmouth.edu ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XJttAPQwG3KhaKuLrJRgEB98lXNJZzIxUKsQ1FbZG78LfUslTGBD02iFaZC+Nnx9vScCqetuzIhnGTWuje5NS7OLs39ytm+7AgtPcrPiMQKjFfGB8PSEvqBjSBnGrC/KczvE4hm7KVr2yq43u0XVbTZg3AmWZj7WN2xXoCSmEsZk+GXXsRmqvXz7C9FlqjQHmFhj3B9fnxOsF6uv1rFOzJTdkcCJ+E4LZkQXJI1fr2NZSGNSVJLc+aCkQ7qFSGzP/1Xrsa23BYl6DE5DCRocpVsn3kSVOVvSeiTHkKVg0CRUMUy2LiPmaRbQ7o+lO0dljIyzOIV2XovZ0aO36vG3eQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=cm5aZ3RDls/FPoG6BNNhqz0hA1vQH5qXkJh1u+U7xeU=; b=O8tKM0/ZHXGmVNTK1gAqH2r8xmu5d0qos1CelNZuAv2z7OZ9wmYdA6zwddwIR1NJHlSsntT01d2AqeqZJf0290vGXL4KlNv2HnMZnxsHRWS46BfM42SEVSdOjlXxE+y6ulO1yemkYztHNoF9E4TzoVqyvvguGNMuPSNcJBCyQKScZvvWn+EmKyGFll1jyZf4RYcjcMTefF96x42bwOfzeQXYGly8i6iFZpQ39QlKkztiA9x9ftr9pTSH02Qe4s4o4TYz2BVyk/HBU3qlR9W/+Ptyk0BAQxpS8qXp7OdONKlJwhA40OEZyVhzQoAwUxv7/0wPyB7fk1xSrWSplEcEag== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dartmouth.edu; dmarc=pass action=none header.from=dartmouth.edu; dkim=pass header.d=dartmouth.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dartmouth.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=cm5aZ3RDls/FPoG6BNNhqz0hA1vQH5qXkJh1u+U7xeU=; b=cRPWLJ+OzPwMAWpp8jXlLhtAb5oyincyWSvdNzcRB4+xpe6Bl5UzTdhTnBYssCDPEF9FBSaLjmcMO0dynSfUZxoxIC2L3aceWHtOpiBs+qqp3ygQe25t+1sMrwjXINzvcum5d39AyIhCZBcMz82F8tRKKhwT+Cw4w0t2bJFs0SU= Received: from DS7PR03MB5574.namprd03.prod.outlook.com (2603:10b6:5:2c1::16) by SN7PR03MB7034.namprd03.prod.outlook.com (2603:10b6:806:32e::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7270.27; Fri, 9 Feb 2024 18:23:09 +0000 Received: from DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e]) by DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e%7]) with mapi id 15.20.7249.038; Fri, 9 Feb 2024 18:23:08 +0000 From: "Matthew L. Dailey" To: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Thread-Topic: FreeBSD panics possibly caused by nfs clients Thread-Index: AQHaW3GuNV72DJinEE2eW1yguCVi9LECMNoAgAAiUIA= Date: Fri, 9 Feb 2024 18:23:08 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Mozilla Thunderbird x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR03MB5574:EE_|SN7PR03MB7034:EE_ x-ms-office365-filtering-correlation-id: aaa438d8-d951-4a04-f63e-08dc299c2a71 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: qYvmHH+aeLv0kVmztYcs7On4I8GuzQ9Zx/tUa65FB3Vh43YTgv7m9khYrFHx1KaOUXh0H28MwKmY0Y8RG+GLK2PT+uq5HUL8yLmb7qAWqxOjc2i8lee2T3VKvAVvOQSO/9UIPfsacJonsOP+SMsHad5udixDHHrstX2wxHvKR9dZb3wKAYFy9NVY1oyv+5gftOK2LDfnEaFeP/ScczdTLOMo3KQx7evwvsADJLZgszgZErqA7SKAtdFKsUyPrjO19p6UUveko7JWbnO8V48ec6hVukN17zOl2WiYcfEYYHobSeEN14OB8eW9v977NNjQcGypkcRQEpD/mhC5KsLQVCMWEjkCX0hnxPpnXOJWkZWfpdHmgWEbFeMja6E2P7sYob6XOkTB7dobqPTPKTgw3J8l1/0o/BekDtZL3oEzIC4gf1YMiuLJ93DlBPFYm3Kb35QhqmEHeNdx89yYDk0XV4lVFpgxwvQp2pdG0fevxFv1oLfBZU68c57vfgtrcP/zy12tcO0W7a4R9xI/kzSsAWBALma99Fn7mwjAaeWTmhg952K5AN0m5AaMCHuYrJvfB4gxu4AoQy8Tkb6XyP+cjsepRmMl6rciLXiTu492gOJi5b2k/tGn9Cmk5oU+4Ia3 x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5574.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(376002)(136003)(346002)(396003)(366004)(39860400002)(230922051799003)(64100799003)(1800799012)(186009)(451199024)(6506007)(6512007)(478600001)(6486002)(71200400001)(83380400001)(2616005)(26005)(5660300002)(2906002)(66476007)(66446008)(64756008)(8676002)(66556008)(316002)(91956017)(66946007)(8936002)(786003)(6916009)(76116006)(38070700009)(36756003)(38100700002)(122000001)(31696002)(86362001)(41300700001)(75432002)(31686004);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?c0xZaHNSNGtoQXFqeEphUm9rN2c3NUh1ckQ3TDdKZFZ5UHJ0TUk5ckdYN29p?= =?utf-8?B?K2lPaHE2Vm1VNTAzZTRCMWtQV3pLODMza3dWL2RvWHc2aVdTaTBDbStqNHl3?= =?utf-8?B?Y1RzN2hYbTc3OS9NeHA0MXdWdkwrdTBJWjFYdE90aUxjUDQyRmdkNVllNDBG?= =?utf-8?B?aTRXVTV3MUVDOGo5cW9FSittS1ZVNmhiUWpnWmFWTnpESnBXNk5UcjkxUjgz?= =?utf-8?B?aEozRGlFZVprYlVJemIwck1sa1dhTWtVQkkxM1dBYk8wOUI4eHNiWlFsS2lu?= =?utf-8?B?OG53TWl6R29aSCtDNGlSR3I0QjNjcGFoenpPRkF4S2I1QmlmQTNoZi9CcDha?= =?utf-8?B?MEZ2b0VuU0VTOC96T1V6MjZDTkl2VUdRN3ZFcFF1eTg1S0pKZDhnSlNraWtu?= =?utf-8?B?b0VCZTlFYU5RZ09sVW9ueTlXUmxQWEJWWnZKeG1MR0hEcjZlNHhGWmU4L1Nm?= =?utf-8?B?anJWMGY3YStEZkxXU2xQZk90RFZhMVNNTnFRRnBGaXJ3M0hGL2ZCV0xXQmgw?= =?utf-8?B?cXZ0czRta2l4QnRrYzFiU0huZFFDRHlFRDFENVN0RS9HZkNUazVUa25KdXN4?= =?utf-8?B?alA3bG9pNTlxL2NkT0NxbmJadmNMdkRhaTBmSjlZVE96ODhOMTRNeTlUam5i?= =?utf-8?B?VVFIQTA5VmdwVUYwTFVFNS9PUUZwWGZPUVQvcjZicXBmMEx4dDFjWTAxckZG?= =?utf-8?B?ZENrWDdXZ3EzaGxuZ1RNOFlKOFdnUk0zeVVvazczQm56dUgrMlIyNFFiNTJG?= =?utf-8?B?ZkNCa0hPa3pQMXErUitPY0E2dEJ4bVRVNFF2eHp2NHErRnhCUmFyM1pBcGpj?= =?utf-8?B?c2pZM05rUHo2U2RsTEs1TU9aWURPNGx0RzJ4Wk81KzVjMmRWMzRuSmZMSXFB?= =?utf-8?B?RFlBbTI1bThhVWtOQjNzMUFpSUNLdENYVFpJNW0xczRzUEtxeWptL3VmQVNF?= =?utf-8?B?UHlHbmtHckxITEJtNlNBa21JbUloYmhjejB1OUloOXFPb1pGbVgzNERyRmFy?= =?utf-8?B?b05iOWRvWTFReThPUjU1a1E2SGpmUEZlQlZvMVVrMm5TeE1kc1Zqa2N5VDB2?= =?utf-8?B?L2NUSStVbGxmUGhxZ1pBSW02ZmlYZlh6MmZWUVZpdXF3YWF6ZVU2SGo1UVBr?= =?utf-8?B?c1BqVWppaUxXTXh4em1kSlpUcTZGeGhKdnpqZVllV2t6NzlxUFljdkZLUlFC?= =?utf-8?B?bTczNXptalY2YitxNm1QUEhSejJ5NE1JQTlWYXI5OHN0cmdQK2MydFM4V2FX?= =?utf-8?B?djRKMnExSHA4VjA4QXg4dXZMYzd5YjkvMGRIMEdTN0R6RUp2dEM0QUxPWVlx?= =?utf-8?B?akYvemRuNXBTa0pSTnlkUHMwRzk0RnZ0bWNyUDE3dGtkRjhPYUJmNW9TVTZS?= =?utf-8?B?UGxnTkQrbUJhb1VtTGxSeWp4SHlqRnpQSGlKZG5Gc2ZJY1hDTEsvUnpQUWpq?= =?utf-8?B?OXZDdThwdkNIL0NLejYydFRTV3hwa2FaZDZuemRZZkwrUnpOMDNrZHQ3cWNM?= =?utf-8?B?SjhxYU9jNysxckdKNjBtRDE2TytOK05GQTRxcGt3TWY2dFpvMm5kRTdiTzlu?= =?utf-8?B?VnpVdmhqbHMxLzRCR3hUQ1hCOVVmeCtPQS9DS2M0QVhQRGV6QktPRlUxV2lN?= =?utf-8?B?QlQ0b1huSk40SWdUcG1rc2VaRXJ3UkdaaThoNkNwUUtQL0JPdTNoNnRiWXRr?= =?utf-8?B?MHdra2xlNnFFalBiR0Z0ZW5pMVBjbmtnaGVISE9GMTVpUW1ERFltK3pBdUMw?= =?utf-8?B?UkJXR1BWSmxYVU9vSmN6RU9nSE1jTi95T0FDQ21iYkZzTXNXcWxGbjJST3E1?= =?utf-8?B?U2pWYVk1dHl6aFE4dm5lSHVwdVZydlJsdEpWWXhnbHpDTng0WW04N0pwbWVZ?= =?utf-8?B?Sk02SUR4NEREZTgwMGFHVGppVE4xS1R1dngzZWcxZzhiRUFpZFJzeU82eGZJ?= =?utf-8?B?TjA3RHp2SmR2SVhEcVlDdmF1Q1RFYmNjRWhTTUFHM3p2NnV3Z1pKdzdPWUll?= =?utf-8?B?SzErdTViRHhnTlNyeVgwVVdheU9Ld0ZtMlErNUtZcS9mT2RwOThQU2JaU2Y2?= =?utf-8?B?U0o2UjVIa0NmNFdYbHNiMUc0ZzdMQkxpSEttTFArTmpabzNzeExEZUhVd2Zy?= =?utf-8?Q?3eq/z70+HbpyzXp3p/YzE6nTZ?= Content-Type: text/plain; charset="utf-8" Content-ID: Content-Transfer-Encoding: base64 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: dartmouth.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5574.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: aaa438d8-d951-4a04-f63e-08dc299c2a71 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Feb 2024 18:23:08.3161 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 995b0936-48d6-40e5-a31e-bf689ec9446f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 1DMeI0RAvXRJ4hHl7FKHXrWuXOdGpJ0qdmNFUd0MbvaW7a1ZWF1UMeRCu1JChn5YZjpsAaleRHqoxsIQWcJXdA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR03MB7034 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.65 / 15.00]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; DWL_DNSWL_LOW(-1.00)[dartmouth.edu:dkim]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.76)[-0.757]; DMARC_POLICY_ALLOW(-0.50)[dartmouth.edu,none]; R_SPF_ALLOW(-0.20)[+ip6:2a01:111:f400::/48]; R_DKIM_ALLOW(-0.20)[dartmouth.edu:s=selector2]; MIME_GOOD(-0.10)[text/plain]; MIME_BASE64_TEXT(0.10)[]; XM_UA_NO_VERSION(0.01)[]; ASN(0.00)[asn:8075, ipnet:2a01:111:f000::/36, country:US]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[dartmouth.edu:+] X-Rspamd-Queue-Id: 4TWj005cGcz4bWx SSBoYWQgbXkgZmlyc3Qga2VybmVsIHBhbmljIHdpdGggYSBLQVNBTiBrZXJuZWwgYWZ0ZXIgb25s eSAwMToyNy4gVGhpcyANCmZpcnN0IHBhbmljIHdhcyBhICJkb3VibGUgZmF1bHQsIiB3aGljaCBp c24ndCBhbnl0aGluZyB3ZSd2ZSBzZWVuIA0KcHJldmlvdXNseSAtIHVzdWFsbHkgd2UndmUgc2Vl biB0cmFwIDkgb3IgdHJhcCAxMiwgYnV0IHNvbWV0aW1lcyBvdGhlcnMuIA0KQmFzZWQgb24gdGhl IGJhY2t0cmFjZSwgaXQgZGVmaW5pdGVseSBsb29rcyBsaWtlIEtBU0FOIGNhdWdodCBzb21ldGhp bmcsIA0KYnV0IEkgZG9uJ3QgaGF2ZSB0aGUgZXhwZXJ0aXNlIHRvIGtub3cgaWYgdGhpcyBwb2lu dHMgdG8gYW55dGhpbmcgDQpzcGVjaWZpYy4gRnJvbSB0aGUgYmFja3RyYWNlLCBpdCBsb29rcyBs aWtlIHRoaXMgbWlnaHQgaGF2ZSBvcmlnaW5hdGVkIA0KaW4gaXBmdyBjb2RlLg0KDQpQbGVhc2Ug bGV0IG1lIGtub3cgd2hhdCBvdGhlciBpbmZvIEkgY2FuIHByb3ZpZGUgb3Igd2hhdCBJIGNhbiBk byB0byBkaWcgDQpkZWVwZXIuDQoNClRoYW5rcyEhDQoNClBhbmljIG1lc3NhZ2U6DQpbNTY3NF0g RmF0YWwgZG91YmxlIGZhdWx0DQpbNTY3NF0gcmlwIDB4ZmZmZmZmZmY4MTJmNmUzMiByc3AgMHhm ZmZmZmUwMTQ2NzdhZmUwIHJicCAweGZmZmZmZTAxNDY3N2I0MzANCls1Njc0XSByYXggMHgxZmZm ZmZjMDI4Y2VmNjIwIHJkeCAweGYyZjJmMmY4ZjJmMmYyZjIgcmJ4IDB4MQ0KWzU2NzRdIHJjeCAw eGRmZmZmN2MwMDAwMDAwMDAgcnNpIDB4ZmZmZmZlMDA0MDg2YTRhMCByZGkgMHhmOGY4ZjhmOGYy ZjJmMmY4DQpbNTY3NF0gcjggMHhmOGY4ZjhmOGY4ZjhmOGY4IHI5IDB4MTYyYSByMTAgMHg4MzUw MDMwMDJkM2E2NGUxDQpbNTY3NF0gcjExIDAgcjEyIDB4ZmZmZmY3ODAyOGNlZjYyMCByMTMgMHhm ZmZmZmUwMDQwODZhNDQwDQpbNTY3NF0gcjE0IDB4ZmZmZmZlMDE0ODhjMDU2MCByMTUgMHgyNmY0 MCByZmxhZ3MgMHgxMDAwNg0KWzU2NzRdIGNzIDB4MjAgc3MgMHgyOCBkcyAweDNiIGVzIDB4M2Ig ZnMgMHgxMyBncyAweDFiDQpbNTY3NF0gZnNiYXNlIDB4OTVkMWQ4MWExMzAgZ3NiYXNlIDB4ZmZm ZmZmZmY4NGExNDAwMCBrZ3NiYXNlIDANCls1Njc0XSBjcHVpZCA9IDQ7IGFwaWMgaWQgPSAwOA0K WzU2NzRdIHBhbmljOiBkb3VibGUgZmF1bHQNCls1Njc0XSBjcHVpZCA9IDQNCls1Njc0XSB0aW1l ID0gMTcwNzQ5ODQyMA0KWzU2NzRdIEtEQjogc3RhY2sgYmFja3RyYWNlOg0KWzU2NzRdIFVwdGlt ZTogMWgzNG0zNHMNCg0KQmFja3RyYWNlOg0KIzAgIF9fY3VydGhyZWFkICgpIGF0IC91c3Ivc3Jj L3N5cy9hbWQ2NC9pbmNsdWRlL3BjcHVfYXV4Lmg6NTcNCiMxICBkb2FkdW1wICh0ZXh0ZHVtcD08 b3B0aW1pemVkIG91dD4pIGF0IA0KL3Vzci9zcmMvc3lzL2tlcm4va2Vybl9zaHV0ZG93bi5jOjQw NQ0KIzIgIDB4ZmZmZmZmZmY4MTI4YjdkYyBpbiBrZXJuX3JlYm9vdCAoaG93dG89aG93dG9AZW50 cnk9MjYwKQ0KICAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9rZXJuX3NodXRkb3duLmM6NTI2DQoj MyAgMHhmZmZmZmZmZjgxMjhjMDAwIGluIHZwYW5pYyAoDQogICAgIGZtdD1mbXRAZW50cnk9MHhm ZmZmZmZmZjgyNTg5YTAwIDxzdHI+ICJkb3VibGUgZmF1bHQiLA0KICAgICBhcD1hcEBlbnRyeT0w eGZmZmZmZTAwNDA4NjZkZTApIGF0IA0KL3Vzci9zcmMvc3lzL2tlcm4va2Vybl9zaHV0ZG93bi5j Ojk3MA0KIzQgIDB4ZmZmZmZmZmY4MTI4YmQ3NSBpbiBwYW5pYyAoZm10PTB4ZmZmZmZmZmY4MjU4 OWEwMCA8c3RyPiAiZG91YmxlIA0KZmF1bHQiKQ0KICAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9r ZXJuX3NodXRkb3duLmM6ODk0DQojNSAgMHhmZmZmZmZmZjgxYzRiMzM1IGluIGRibGZhdWx0X2hh bmRsZXIgKGZyYW1lPTxvcHRpbWl6ZWQgb3V0PikNCiAgICAgYXQgL3Vzci9zcmMvc3lzL2FtZDY0 L2FtZDY0L3RyYXAuYzoxMDEyDQojNiAgPHNpZ25hbCBoYW5kbGVyIGNhbGxlZD4NCiM3ICAweGZm ZmZmZmZmODEyZjZlMzIgaW4gc2NoZWRfY2xvY2sgKHRkPXRkQGVudHJ5PTB4ZmZmZmZlMDE0ODhj MDU2MCwNCiAgICAgY250PWNudEBlbnRyeT0xKSBhdCAvdXNyL3NyYy9zeXMva2Vybi9zY2hlZF91 bGUuYzoyNjAxDQojOCAgMHhmZmZmZmZmZjgxMTllMmE3IGluIHN0YXRjbG9jayAoY250PWNudEBl bnRyeT0xLA0KICAgICB1c2VybW9kZT11c2VybW9kZUBlbnRyeT0wKSBhdCAvdXNyL3NyYy9zeXMv a2Vybi9rZXJuX2Nsb2NrLmM6NzYwDQojOSAgMHhmZmZmZmZmZjgxMTlmYjY3IGluIGhhbmRsZWV2 ZW50cyAobm93PW5vd0BlbnRyeT0yNDM3MTg1NTY5OTgzMiwNCiAgICAgZmFrZT1mYWtlQGVudHJ5 PTApIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fY2xvY2tzb3VyY2UuYzoxOTUNCiMxMCAweGZm ZmZmZmZmODExYTEwY2MgaW4gdGltZXJjYiAoZXQ9PG9wdGltaXplZCBvdXQ+LCBhcmc9PG9wdGlt aXplZCBvdXQ+KQ0KICAgICBhdCAvdXNyL3NyYy9zeXMva2Vybi9rZXJuX2Nsb2Nrc291cmNlLmM6 MzUzDQojMTEgMHhmZmZmZmZmZjgxZGNkMjgwIGluIGxhcGljX2hhbmRsZV90aW1lciAoZnJhbWU9 MHhmZmZmZmUwMTQ2NzdiNzUwKQ0KICAgICBhdCAvdXNyL3NyYy9zeXMveDg2L3g4Ni9sb2NhbF9h cGljLmM6MTM0Mw0KIzEyIDxzaWduYWwgaGFuZGxlciBjYWxsZWQ+DQojMTMgX19hc2FuX2xvYWQ4 X25vYWJvcnQgKGFkZHI9MTg0NDY3NDE4ODAyMTk2ODkyMzIpDQogICAgIGF0IC91c3Ivc3JjL3N5 cy9rZXJuL3N1YnJfYXNhbi5jOjExMTMNCiMxNCAweGZmZmZmZmZmODUxNDg4YjggaW4gPz8gKCkg ZnJvbSAvYm9vdC90aGF5ZXIvaXBmdy5rbw0KIzE1IDB4ZmZmZmZlMDEwMDAwMDAwMCBpbiA/PyAo KQ0KIzE2IDB4ZmZmZmZmZmY4MTM0ZGNkNSBpbiBwY3B1X2ZpbmQgKGNwdWlkPTEyMzg0MjU4NTYp DQogICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N1YnJfcGNwdS5jOjI4Ng0KIzE3IDB4ZmZmZmZm ZmY4NTE1MWY2ZiBpbiA/PyAoKSBmcm9tIC9ib290L3RoYXllci9pcGZ3LmtvDQojMTggMHgwMDAw MDAwMDAwMDAwMDAwIGluID8/ICgpDQo= From nobody Fri Feb 9 21:18:09 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWmsy5Gncz5BMB7 for ; Fri, 9 Feb 2024 21:18:14 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qv1-xf29.google.com (mail-qv1-xf29.google.com [IPv6:2607:f8b0:4864:20::f29]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWmsy1qQrz46Y1 for ; Fri, 9 Feb 2024 21:18:14 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qv1-xf29.google.com with SMTP id 6a1803df08f44-68cc9061c78so7392926d6.3 for ; Fri, 09 Feb 2024 13:18:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707513492; x=1708118292; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=oO//GNpG3BkJGDlsxBWQOKjg9nrKalFUp6sJ//1eTzo=; b=Tq8SWaZ64dkp9HHSqfBCHFDxZ3g2O4y0a04hefzmswMazvRyFsjvw9nOPk7gDu7Yag W4DiY/oZ6YfBjA+z66UpsDDOqmgJbiGxx6S1THoCu6ICTxCaf6wWPjQFS0LmpAxouelV YBLMOSWf6A+eLjR2Y+LWsyxpiNtYr/DaMjBSTRO55HfjtFb7oz09B3zsEik+mhhzWRke 74L5raJr/EoMoqiDUeGsa+WguaQ2xsMpZI4yQejYcJe+IABJdeebVeTabYHlsiznp4cn 3myAV7jbY9mTf+wDohYJDS22ptHguZIjgQmt3Tf1OvCF3Ov5OIzvcw5YfOAFo6YxwbPG HquA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707513492; x=1708118292; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=oO//GNpG3BkJGDlsxBWQOKjg9nrKalFUp6sJ//1eTzo=; b=b3qvPwGC8JpQc630HKxu9EYpYUkB+uI8CYA4Ipz0PFmKkSY8fU1UkXrtca5XIeeX+V MsGM6mklDLtil2zCq8xhR/WeRmHSKrqLyHEidow20nKRV3kH0n8k6yLxpuFex/KAwkbx Xl/WQqtexHOjzd7SlPCKncQTxsC+sZlzdwmN9bGwWS+Q63dwkhZKWi6R+dIOJar9rfTH x5sq0ZZXV64tNpezZhv49Dma17oFghyTWN3c6xuD8GtIgF4nwhQKt6mOcclYi5w4C/vi aw827ZzqpxWykek9U5N3i06WhJfK9YmvBSNNQqbd26adIV0l/klnLWBiLAxNF13bHSi4 PjhA== X-Gm-Message-State: AOJu0YxYmA3FC+GDEGdiGPNAShhA5/nMU8nSX45NXn87k+/mWERFIoTn WC44OoNFx1xnoB4vTBEP+K/8UIm43/fcei6J9Qmqxiq7sj2v++ys X-Google-Smtp-Source: AGHT+IHTZFJ412UrE4/gIz4jk25MdM4NjqaGsjsBupQiTEwU6eY90UU3OztNTQ6IWXInUZBzaELAPQ== X-Received: by 2002:a05:6214:21c9:b0:68c:a9a7:22cb with SMTP id d9-20020a05621421c900b0068ca9a722cbmr385666qvh.22.1707513492151; Fri, 09 Feb 2024 13:18:12 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id a7-20020a0cefc7000000b0068cc143e310sm1154314qvt.143.2024.02.09.13.18.11 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 09 Feb 2024 13:18:11 -0800 (PST) Date: Fri, 9 Feb 2024 16:18:09 -0500 From: Mark Johnston To: "Matthew L. Dailey" Cc: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Message-ID: References: List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4TWmsy1qQrz46Y1 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Fri, Feb 09, 2024 at 06:23:08PM +0000, Matthew L. Dailey wrote: > I had my first kernel panic with a KASAN kernel after only 01:27. This > first panic was a "double fault," which isn't anything we've seen > previously - usually we've seen trap 9 or trap 12, but sometimes others. > Based on the backtrace, it definitely looks like KASAN caught something, > but I don't have the expertise to know if this points to anything > specific. From the backtrace, it looks like this might have originated > in ipfw code. A double fault is rather unexpected. I presume you're running releng/14.0? Is it at all possible to test with FreeBSD-CURRENT? Did you add INVARIANTS etc. to the kernel configuration used here, or just KASAN? > Please let me know what other info I can provide or what I can do to dig > deeper. If you could repeat the test several times, I'd be interested in seeing if you always get the same result. If you're willing to share the vmcore (or several), I'd be willing to take a look at it. > Thanks!! > > Panic message: > [5674] Fatal double fault > [5674] rip 0xffffffff812f6e32 rsp 0xfffffe014677afe0 rbp 0xfffffe014677b430 > [5674] rax 0x1fffffc028cef620 rdx 0xf2f2f2f8f2f2f2f2 rbx 0x1 > [5674] rcx 0xdffff7c000000000 rsi 0xfffffe004086a4a0 rdi 0xf8f8f8f8f2f2f2f8 > [5674] r8 0xf8f8f8f8f8f8f8f8 r9 0x162a r10 0x835003002d3a64e1 > [5674] r11 0 r12 0xfffff78028cef620 r13 0xfffffe004086a440 > [5674] r14 0xfffffe01488c0560 r15 0x26f40 rflags 0x10006 > [5674] cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b > [5674] fsbase 0x95d1d81a130 gsbase 0xffffffff84a14000 kgsbase 0 > [5674] cpuid = 4; apic id = 08 > [5674] panic: double fault > [5674] cpuid = 4 > [5674] time = 1707498420 > [5674] KDB: stack backtrace: > [5674] Uptime: 1h34m34s > > Backtrace: > #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > #1 doadump (textdump=) at > /usr/src/sys/kern/kern_shutdown.c:405 > #2 0xffffffff8128b7dc in kern_reboot (howto=howto@entry=260) > at /usr/src/sys/kern/kern_shutdown.c:526 > #3 0xffffffff8128c000 in vpanic ( > fmt=fmt@entry=0xffffffff82589a00 "double fault", > ap=ap@entry=0xfffffe0040866de0) at > /usr/src/sys/kern/kern_shutdown.c:970 > #4 0xffffffff8128bd75 in panic (fmt=0xffffffff82589a00 "double > fault") > at /usr/src/sys/kern/kern_shutdown.c:894 > #5 0xffffffff81c4b335 in dblfault_handler (frame=) > at /usr/src/sys/amd64/amd64/trap.c:1012 > #6 > #7 0xffffffff812f6e32 in sched_clock (td=td@entry=0xfffffe01488c0560, > cnt=cnt@entry=1) at /usr/src/sys/kern/sched_ule.c:2601 > #8 0xffffffff8119e2a7 in statclock (cnt=cnt@entry=1, > usermode=usermode@entry=0) at /usr/src/sys/kern/kern_clock.c:760 > #9 0xffffffff8119fb67 in handleevents (now=now@entry=24371855699832, > fake=fake@entry=0) at /usr/src/sys/kern/kern_clocksource.c:195 > #10 0xffffffff811a10cc in timercb (et=, arg=) > at /usr/src/sys/kern/kern_clocksource.c:353 > #11 0xffffffff81dcd280 in lapic_handle_timer (frame=0xfffffe014677b750) > at /usr/src/sys/x86/x86/local_apic.c:1343 > #12 > #13 __asan_load8_noabort (addr=18446741880219689232) > at /usr/src/sys/kern/subr_asan.c:1113 > #14 0xffffffff851488b8 in ?? () from /boot/thayer/ipfw.ko > #15 0xfffffe0100000000 in ?? () > #16 0xffffffff8134dcd5 in pcpu_find (cpuid=1238425856) > at /usr/src/sys/kern/subr_pcpu.c:286 > #17 0xffffffff85151f6f in ?? () from /boot/thayer/ipfw.ko > #18 0x0000000000000000 in ?? () From nobody Fri Feb 9 22:03:30 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWntV1BVbz5BQJX for ; Fri, 9 Feb 2024 22:03:46 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-lj1-x22d.google.com (mail-lj1-x22d.google.com [IPv6:2a00:1450:4864:20::22d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWntT527Nz4FJL; Fri, 9 Feb 2024 22:03:45 +0000 (UTC) (envelope-from zbeeble@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lj1-x22d.google.com with SMTP id 38308e7fff4ca-2d0d95e8133so17659911fa.1; Fri, 09 Feb 2024 14:03:45 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707516224; x=1708121024; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=DjIgXqNALCEXinqtuhnjnxxG5dEPI2ptcvWRk7SFVOg=; b=V8mRH05Dnmk3cTu/S8frkx59/ratKlqXhupdeCT3u5bgU/1mS+fBcozXp2aaSJPG/W qAWwbea73cAo2tlu4cpjbA6Q0WW5gouC6oonPmkfkvL7Mh+Q/vPrHi/bjZYbWIAMAVdw JgQhFDoHKrQxvMfhF10c/WQ2c1Hg5fO0uJweWHt1cqQFQzHMtAanpVxzkpyGb9TuOovO s8Epj2aH8EtcxZ73hCc6jRYOV6/XfohSfwkkQX927/KFlM1w6CP5Vn5vjhdh6p1s+x7z F9pWynyqHFsvFz1DZJq0KRUPsKsOHfhnHN1vXUpRPdzKLocmVP5C2CMpOudMgFdIEM+R xxaA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707516224; x=1708121024; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=DjIgXqNALCEXinqtuhnjnxxG5dEPI2ptcvWRk7SFVOg=; b=iLDBGSKCAQC0EauTUVI4RhrlmaEpGAv3cn0FqVrqebvtDXA8xc7+rZ5LEnpLXyyCEQ 7sSNtkiJ494iY43W4iLWy4fEjdUSMtN1ttXhSVkpxWA7wTzsOML8T0yxadIywpkWqeKt 9J6tQMnF1wIe1lotWxy5ex5Pp3naXhX0Uo8y1VFH7r8E3nkSGwjUe7WBa29JbRUf6f/p ISnzVhEDtgPKavwALDnx+mymHyDIdzvPbZyMuiyhsriA5flNJU6Mr6xBfPVD1GiWUfkt pkAoNoJ6fM3KtXMd+r6zFpi0yQEvX7VoF0xAoy4i1LJH+cFxAKfnureGcVrCIOA3h1QW FRQQ== X-Forwarded-Encrypted: i=1; AJvYcCVoIWAwpD3etTdbAZ8n052kDgMfJs/3rRqYGVLe+sBdpaP0m/5c3+HvWfthGM9gZmPDWxHxIeSEGWQImXNe7dVkW22NNPKI/2ruPBo= X-Gm-Message-State: AOJu0Yy563QeEi2JdH3hS7p43+EidHtKTkAE2cwcXJZXeStCIpEPJRor AbIJfvJBZ6N4z2V3lMXW5CAQeRzVKp8SlIqBngPllt5Sx2B1g6/6PU753kDkTUltx++qVgtnfDb mLKEh02tzFwrIVGqSilA+r8Enb/TTHS3okA== X-Google-Smtp-Source: AGHT+IHrrP/LzJAuZ7zExlP3IKrrw17BLC7HSLocPVjjsDPuWrOkkOJ/E9y8W4ufKp8nxpevvOOZnNPYJsa8srJlSkc= X-Received: by 2002:a2e:7411:0:b0:2d0:d161:98c2 with SMTP id p17-20020a2e7411000000b002d0d16198c2mr168411ljc.35.1707516223450; Fri, 09 Feb 2024 14:03:43 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Zaphod Beeblebrox Date: Fri, 9 Feb 2024 17:03:30 -0500 Message-ID: Subject: Re: FreeBSD panics possibly caused by nfs clients To: Mark Johnston Cc: "Matthew L. Dailey" , "freebsd-current@freebsd.org" Content-Type: multipart/alternative; boundary="000000000000f273500610fa199d" X-Rspamd-Queue-Id: 4TWntT527Nz4FJL X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] --000000000000f273500610fa199d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Just in case it's relevant, I'm carrying around this patch on my fairly busy little RISC-V machine. diff --git a/sys/fs/nfsclient/nfs_clvnops.c b/sys/fs/nfsclient/nfs_clvnops.= c index 0b8c587a542c..85c0ebd7a10f 100644 --- a/sys/fs/nfsclient/nfs_clvnops.c +++ b/sys/fs/nfsclient/nfs_clvnops.c @@ -2459,6 +2459,16 @@ nfs_readdir(struct vop_readdir_args *ap) return (EINVAL); uio->uio_resid -=3D left; + /* + * For readdirplus, if starting to read the directory, + * purge the name cache, since it will be reloaded by + * this directory read. + * This removes potentially stale name cache entries. + */ + if (uio->uio_offset =3D=3D 0 && + (VFSTONFS(vp->v_mount)->nm_flag & NFSMNT_RDIRPLUS) !=3D 0) + cache_purge(vp); + /* * Call ncl_bioread() to do the real work. */ ... without it, I can panic. On Fri, Feb 9, 2024 at 4:18=E2=80=AFPM Mark Johnston wr= ote: > On Fri, Feb 09, 2024 at 06:23:08PM +0000, Matthew L. Dailey wrote: > > I had my first kernel panic with a KASAN kernel after only 01:27. This > > first panic was a "double fault," which isn't anything we've seen > > previously - usually we've seen trap 9 or trap 12, but sometimes others= . > > Based on the backtrace, it definitely looks like KASAN caught something= , > > but I don't have the expertise to know if this points to anything > > specific. From the backtrace, it looks like this might have originated > > in ipfw code. > > A double fault is rather unexpected. I presume you're running > releng/14.0? Is it at all possible to test with FreeBSD-CURRENT? > > Did you add INVARIANTS etc. to the kernel configuration used here, or > just KASAN? > > > Please let me know what other info I can provide or what I can do to di= g > > deeper. > > If you could repeat the test several times, I'd be interested in seeing > if you always get the same result. If you're willing to share the > vmcore (or several), I'd be willing to take a look at it. > > > Thanks!! > > > > Panic message: > > [5674] Fatal double fault > > [5674] rip 0xffffffff812f6e32 rsp 0xfffffe014677afe0 rbp > 0xfffffe014677b430 > > [5674] rax 0x1fffffc028cef620 rdx 0xf2f2f2f8f2f2f2f2 rbx 0x1 > > [5674] rcx 0xdffff7c000000000 rsi 0xfffffe004086a4a0 rdi > 0xf8f8f8f8f2f2f2f8 > > [5674] r8 0xf8f8f8f8f8f8f8f8 r9 0x162a r10 0x835003002d3a64e1 > > [5674] r11 0 r12 0xfffff78028cef620 r13 0xfffffe004086a440 > > [5674] r14 0xfffffe01488c0560 r15 0x26f40 rflags 0x10006 > > [5674] cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b > > [5674] fsbase 0x95d1d81a130 gsbase 0xffffffff84a14000 kgsbase 0 > > [5674] cpuid =3D 4; apic id =3D 08 > > [5674] panic: double fault > > [5674] cpuid =3D 4 > > [5674] time =3D 1707498420 > > [5674] KDB: stack backtrace: > > [5674] Uptime: 1h34m34s > > > > Backtrace: > > #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > > #1 doadump (textdump=3D) at > > /usr/src/sys/kern/kern_shutdown.c:405 > > #2 0xffffffff8128b7dc in kern_reboot (howto=3Dhowto@entry=3D260) > > at /usr/src/sys/kern/kern_shutdown.c:526 > > #3 0xffffffff8128c000 in vpanic ( > > fmt=3Dfmt@entry=3D0xffffffff82589a00 "double fault", > > ap=3Dap@entry=3D0xfffffe0040866de0) at > > /usr/src/sys/kern/kern_shutdown.c:970 > > #4 0xffffffff8128bd75 in panic (fmt=3D0xffffffff82589a00 "double > > fault") > > at /usr/src/sys/kern/kern_shutdown.c:894 > > #5 0xffffffff81c4b335 in dblfault_handler (frame=3D) > > at /usr/src/sys/amd64/amd64/trap.c:1012 > > #6 > > #7 0xffffffff812f6e32 in sched_clock (td=3Dtd@entry=3D0xfffffe01488c05= 60, > > cnt=3Dcnt@entry=3D1) at /usr/src/sys/kern/sched_ule.c:2601 > > #8 0xffffffff8119e2a7 in statclock (cnt=3Dcnt@entry=3D1, > > usermode=3Dusermode@entry=3D0) at /usr/src/sys/kern/kern_clock.c:7= 60 > > #9 0xffffffff8119fb67 in handleevents (now=3Dnow@entry=3D2437185569983= 2, > > fake=3Dfake@entry=3D0) at /usr/src/sys/kern/kern_clocksource.c:195 > > #10 0xffffffff811a10cc in timercb (et=3D, arg=3D out>) > > at /usr/src/sys/kern/kern_clocksource.c:353 > > #11 0xffffffff81dcd280 in lapic_handle_timer (frame=3D0xfffffe014677b75= 0) > > at /usr/src/sys/x86/x86/local_apic.c:1343 > > #12 > > #13 __asan_load8_noabort (addr=3D18446741880219689232) > > at /usr/src/sys/kern/subr_asan.c:1113 > > #14 0xffffffff851488b8 in ?? () from /boot/thayer/ipfw.ko > > #15 0xfffffe0100000000 in ?? () > > #16 0xffffffff8134dcd5 in pcpu_find (cpuid=3D1238425856) > > at /usr/src/sys/kern/subr_pcpu.c:286 > > #17 0xffffffff85151f6f in ?? () from /boot/thayer/ipfw.ko > > #18 0x0000000000000000 in ?? () > > --000000000000f273500610fa199d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Just in case it's relevant, I'm carrying arou= nd this patch on my fairly busy little RISC-V machine.

=
diff --git a/sys/fs/nfsclient/nfs_clvnops.c b/sys/fs/nfsclient/nfs_clv= nops.c
index 0b8c587a542c..85c0ebd7a10f 100644
--- a/sys/fs/nfsclient= /nfs_clvnops.c
+++ b/sys/fs/nfsclient/nfs_clvnops.c
@@ -2459,6 +2459,= 16 @@ nfs_readdir(struct vop_readdir_args *ap)
=C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 return (EINVAL);
=C2=A0 =C2=A0 =C2=A0 = =C2=A0 uio->uio_resid -=3D left;

+ =C2=A0 =C2=A0 =C2=A0 /*
+ = =C2=A0 =C2=A0 =C2=A0 =C2=A0* For readdirplus, if starting to read the direc= tory,
+ =C2=A0 =C2=A0 =C2=A0 =C2=A0* purge the name cache, since it will= be reloaded by
+ =C2=A0 =C2=A0 =C2=A0 =C2=A0* this directory read.
+= =C2=A0 =C2=A0 =C2=A0 =C2=A0* This removes potentially stale name cache ent= ries.
+ =C2=A0 =C2=A0 =C2=A0 =C2=A0*/
+ =C2=A0 =C2=A0 =C2=A0 if (uio-= >uio_offset =3D=3D 0 &&
+ =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = (VFSTONFS(vp->v_mount)->nm_flag & NFSMNT_RDIRPLUS) !=3D 0)
+ = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 cache_purge(vp);
+
= =C2=A0 =C2=A0 =C2=A0 =C2=A0 /*
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0* Call = ncl_bioread() to do the real work.
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0*/<= /div>
... without it, I can panic.


On Fri, Feb 9, 2= 024 at 4:18=E2=80=AFPM Mark Johnston <markj@freebsd.org> wrote:
On Fri, Feb 09, 2024 at 06:23:08PM +0000, Matthew L. Da= iley wrote:
> I had my first kernel panic with a KASAN kernel after only 01:27. This=
> first panic was a "double fault," which isn't anything w= e've seen
> previously - usually we've seen trap 9 or trap 12, but sometimes o= thers.
> Based on the backtrace, it definitely looks like KASAN caught somethin= g,
> but I don't have the expertise to know if this points to anything =
> specific. From the backtrace, it looks like this might have originated=
> in ipfw code.

A double fault is rather unexpected.=C2=A0 I presume you're running
releng/14.0?=C2=A0 Is it at all possible to test with FreeBSD-CURRENT?

Did you add INVARIANTS etc. to the kernel configuration used here, or
just KASAN?

> Please let me know what other info I can provide or what I can do to d= ig
> deeper.

If you could repeat the test several times, I'd be interested in seeing=
if you always get the same result.=C2=A0 If you're willing to share the=
vmcore (or several), I'd be willing to take a look at it.

> Thanks!!
>
> Panic message:
> [5674] Fatal double fault
> [5674] rip 0xffffffff812f6e32 rsp 0xfffffe014677afe0 rbp 0xfffffe01467= 7b430
> [5674] rax 0x1fffffc028cef620 rdx 0xf2f2f2f8f2f2f2f2 rbx 0x1
> [5674] rcx 0xdffff7c000000000 rsi 0xfffffe004086a4a0 rdi 0xf8f8f8f8f2f= 2f2f8
> [5674] r8 0xf8f8f8f8f8f8f8f8 r9 0x162a r10 0x835003002d3a64e1
> [5674] r11 0 r12 0xfffff78028cef620 r13 0xfffffe004086a440
> [5674] r14 0xfffffe01488c0560 r15 0x26f40 rflags 0x10006
> [5674] cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b
> [5674] fsbase 0x95d1d81a130 gsbase 0xffffffff84a14000 kgsbase 0
> [5674] cpuid =3D 4; apic id =3D 08
> [5674] panic: double fault
> [5674] cpuid =3D 4
> [5674] time =3D 1707498420
> [5674] KDB: stack backtrace:
> [5674] Uptime: 1h34m34s
>
> Backtrace:
> #0=C2=A0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > #1=C2=A0 doadump (textdump=3D<optimized out>) at
> /usr/src/sys/kern/kern_shutdown.c:405
> #2=C2=A0 0xffffffff8128b7dc in kern_reboot (howto=3Dhowto@entry=3D260)=
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/kern/kern_shutdown.c:526
> #3=C2=A0 0xffffffff8128c000 in vpanic (
>=C2=A0 =C2=A0 =C2=A0 fmt=3Dfmt@entry=3D0xffffffff82589a00 <str> &= quot;double fault",
>=C2=A0 =C2=A0 =C2=A0 ap=3Dap@entry=3D0xfffffe0040866de0) at
> /usr/src/sys/kern/kern_shutdown.c:970
> #4=C2=A0 0xffffffff8128bd75 in panic (fmt=3D0xffffffff82589a00 <str= > "double
> fault")
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/kern/kern_shutdown.c:894
> #5=C2=A0 0xffffffff81c4b335 in dblfault_handler (frame=3D<optimized= out>)
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/amd64/amd64/trap.c:1012
> #6=C2=A0 <signal handler called>
> #7=C2=A0 0xffffffff812f6e32 in sched_clock (td=3Dtd@entry=3D0xfffffe01= 488c0560,
>=C2=A0 =C2=A0 =C2=A0 cnt=3Dcnt@entry=3D1) at /usr/src/sys/kern/sched_ul= e.c:2601
> #8=C2=A0 0xffffffff8119e2a7 in statclock (cnt=3Dcnt@entry=3D1,
>=C2=A0 =C2=A0 =C2=A0 usermode=3Dusermode@entry=3D0) at /usr/src/sys/ker= n/kern_clock.c:760
> #9=C2=A0 0xffffffff8119fb67 in handleevents (now=3Dnow@entry=3D2437185= 5699832,
>=C2=A0 =C2=A0 =C2=A0 fake=3Dfake@entry=3D0) at /usr/src/sys/kern/kern_c= locksource.c:195
> #10 0xffffffff811a10cc in timercb (et=3D<optimized out>, arg=3D&= lt;optimized out>)
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/kern/kern_clocksource.c:353
> #11 0xffffffff81dcd280 in lapic_handle_timer (frame=3D0xfffffe014677b7= 50)
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/x86/x86/local_apic.c:1343
> #12 <signal handler called>
> #13 __asan_load8_noabort (addr=3D18446741880219689232)
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/kern/subr_asan.c:1113
> #14 0xffffffff851488b8 in ?? () from /boot/thayer/ipfw.ko
> #15 0xfffffe0100000000 in ?? ()
> #16 0xffffffff8134dcd5 in pcpu_find (cpuid=3D1238425856)
>=C2=A0 =C2=A0 =C2=A0 at /usr/src/sys/kern/subr_pcpu.c:286
> #17 0xffffffff85151f6f in ?? () from /boot/thayer/ipfw.ko
> #18 0x0000000000000000 in ?? ()

--000000000000f273500610fa199d-- From nobody Fri Feb 9 22:11:14 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWp394bR4z5BR1t for ; Fri, 9 Feb 2024 22:11:17 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Received: from NAM10-DM6-obe.outbound.protection.outlook.com (mail-dm6nam10on2121.outbound.protection.outlook.com [40.107.93.121]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWp384rSDz4GMc; Fri, 9 Feb 2024 22:11:16 +0000 (UTC) (envelope-from Matthew.L.Dailey@dartmouth.edu) Authentication-Results: mx1.freebsd.org; none ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=U+eGje/8obSlpsLvFtQjj8IU+vwNJcsUeCCt+JICLSCg88opjCvYwobl1i6PJUMNobEHwGSAv9hhj32tVCkC5OhgnnHs6owyu3wnrVPKm5DtN42hLRvSP1vdi8C0TooWXI2a5ySg+LTFkPOOEpw4fmGDdSZNE7SPqUcGIpb65a6bhdofGZ/7PV8vU2sp6OSOA+LzT7WaXmfFopztioN4v34x6fmuWsWa82EZjMi7qgxS5hGFPtTtBlCqfO2GkhiaWPsOUV+fXRUW1oe/WYOdqCSFdei/aj7EtcwD/snfLNImIdoKmLoZwijcP1CkJahY0jevGwDChoNiC+qqEInCqw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=afg9q0e+l7v+xUKx9BC01cE57PbEb5Kco0nALAjL0lM=; b=VL/1bIB+hUd9UDAlBPeLd7hg6KpXfNjaXweVx3wJKNWieVvDAM9sYD/qf38ZzpGOEgGD0eI2Badb4Zq/Y4VXfFTpzyxGi0/BtEE/YBek1JbyHpD3LG4FM8/X2CAFUbTJjLKY+2a7i9TCYJ351jlGWw59lJbQT4g4i2oXVTfhThDoj0xGqM+8l+mdET3dPfxpSUaVVhQPbGje/jWPPoqkJaI8OLAwxAT96b7n4SZfOe/xmUG8nAiHYiEzztB8PpD8RSFAWjeGcHwQ4AKVMAHEOWrEbGjWipUwS6PHepuFz6/5sqG3XvfMNMGJQl4UWXSUr8GzSHhF1gvQbmj9hswfQQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=dartmouth.edu; dmarc=pass action=none header.from=dartmouth.edu; dkim=pass header.d=dartmouth.edu; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=dartmouth.edu; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=afg9q0e+l7v+xUKx9BC01cE57PbEb5Kco0nALAjL0lM=; b=Et7EsF1Jfg7M+iMSenueQMeiUzUtiMFsmQPZ7jVYxu/wFzuQ+3Oqh4JIbNIN10zCvCbf0hhpNK8+VMYa8OuysV0tfdwXkXwKEWacWs3Qefh3a6qd2Hmnnfyj9jEZEvC9ZYLHjufUenGnCcx/MDrUGfOoi4freOZCFXX/l9BWlOs= Received: from DS7PR03MB5574.namprd03.prod.outlook.com (2603:10b6:5:2c1::16) by PH0PR03MB5672.namprd03.prod.outlook.com (2603:10b6:510:3a::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7249.36; Fri, 9 Feb 2024 22:11:14 +0000 Received: from DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e]) by DS7PR03MB5574.namprd03.prod.outlook.com ([fe80::db67:1ab1:da71:659e%7]) with mapi id 15.20.7249.038; Fri, 9 Feb 2024 22:11:14 +0000 From: "Matthew L. Dailey" To: Mark Johnston CC: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Thread-Topic: FreeBSD panics possibly caused by nfs clients Thread-Index: AQHaW3GuNV72DJinEE2eW1yguCVi9LECMNoAgAAiUICAADDogIAADtOA Date: Fri, 9 Feb 2024 22:11:14 +0000 Message-ID: <3ea6d241-b9cc-4294-aef8-ae1c6d9d8161@dartmouth.edu> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: user-agent: Mozilla Thunderbird x-ms-publictraffictype: Email x-ms-traffictypediagnostic: DS7PR03MB5574:EE_|PH0PR03MB5672:EE_ x-ms-office365-filtering-correlation-id: ba7631f2-2790-4825-8a6f-08dc29bc07c9 x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 6+sg7+jKLaw3/FEPDv/3zHyR1LHC+mjOhVh/9Yvn7luSoKpl9XEwhEEAUC9n0dOh2fLCDuyAWkQyFxj5/8J32glfmv+N3q9N8Sv30wD2vwgmrpB92gODG1xvY8nKnUu2gpvJGbpHknexlY7vpiwlqh7x7zirhBSzHp4pE0IGLRY9OqisiyvQTDLV8AXvxG/j4rtAPJb43/QDBdRIp7YbfuSM0W8ufOjwmC6BVAjYHBVi+18Ff3j88mD+q6GXQucaMneKp1PdEngnKRNvfLdNeP6w0iLUikT+catc14VPuf+0FmMJ1ONObNcYoLxnkCSeCFmryFnQJVVa2+6sTjdN3HZbKkjEBQ+nd+H2c5OhktV0232tH26RMQO4zS6uvFa48RJkXERvfgTYnMzIpMNK2Rxsgk/cWoMgnjURtqqu+jlQVjjESzCLuzJUma41HwUHMCKXSBiLtti4VJiIU7wauvRQgorkkYftssmz85GJ7Yy9wFfNNeSnmzbtINWPIaZfMrMFNg3ZaKRQgIS3DQHMAk2cd5J/2Z3blK41JhD/QrVU9OckTPfODf53UrzbPgve/XWktJi+Stu4QlRLBZPFKSfEFHEtioy16hcFAJZlrvVvwN47Lb8r7OrQrcDOVt5/ x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DS7PR03MB5574.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(13230031)(396003)(136003)(366004)(346002)(376002)(39860400002)(230473577357003)(230273577357003)(230922051799003)(64100799003)(1800799012)(186009)(451199024)(122000001)(38100700002)(31686004)(83380400001)(966005)(86362001)(26005)(6506007)(6486002)(478600001)(31696002)(2616005)(75432002)(53546011)(71200400001)(6512007)(316002)(66446008)(4326008)(66476007)(41300700001)(38070700009)(66946007)(64756008)(76116006)(6916009)(66556008)(91956017)(36756003)(450100002)(2906002)(8676002)(5660300002)(786003)(8936002);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?utf-8?B?VVJWcWtxOVYwdTQvckFmN1VyQXAvZVFCUmphbG5Xam5CdDdpRlNMWktnckhV?= =?utf-8?B?M2tzc2ZjbnlvM2xPclA1OHpGangrKzJORFJ6ajl5SDlSeU1iZHhCQXBLRXU4?= =?utf-8?B?UGhBMWc1RmE2YjlhWEtHL1pFQ0xvdmFpck5Qb0FEK3hXbkY3TFhyWE1reTgx?= =?utf-8?B?OFZjckVpa1k4dkQ1ckhrMCtMQ0x0c2s2eWFacW5LckltYnFZN0xISFYyVmJN?= =?utf-8?B?cFVrNkpNdmJZUkR2aFRnMnEvRHREbk9MdFFobUxIaVNiM0pES0ZXRm5pNjBx?= =?utf-8?B?czU3dVU4Qld1SE04elBvajM5MFRiazhvbloxOTQ2K2FiQU9RL3Iwa1BoakND?= =?utf-8?B?K0VVeVA1dHZkb0JZMHBjdkc1d1R5cDFoa1NiSDBsTmVnRzhITUwxZUJjaFh5?= =?utf-8?B?VUF3Wm9XS3ZRK1M3VDJEUGc5dHpieVRKdXFwd0pVYWh2S09OaEhKLzFNUXZF?= =?utf-8?B?Z2l1ZnZUQXlrVjdtSlFWTkxFQlZlZCs0MzE2Z0ZEYkhxOStRZXBTZk5Yczdn?= =?utf-8?B?cDJDYzU4V0xKblZCNTF5ejRZTStJSmR1QklRelVDcC94V2RYVUpsRmxTWlRR?= =?utf-8?B?VHdKR2RhaitGZ2JGTFNNRWEyenJPcmVvcWZnUWQwVXR3NjZmZzE1OHo0SGdC?= =?utf-8?B?OXo3NGZLUnk3dUI2cFBpdmdjbndxV3kweTNyVHNKTnk2aXJITCs5cGJoZ0NF?= =?utf-8?B?UFZhUkVzeU9jb2V0RlcxNEVORlZFK09iMWNkRUVQNnlpVFIwTWtoeDMrUlpW?= =?utf-8?B?aXVDaDJUV0lUNG9Md1o4eUJIbGlEc204UXc4QWU1ODRXN1VKQ01ib21maDZL?= =?utf-8?B?d1Z3a00wMTBzZWJmbmZkMCtqSTFEY0xSVmRDN2ZwRDhVZTZWNklnV1RsS2wx?= =?utf-8?B?Y1V4SkZveDZ4M1pzaXp3NWEvSkFpVWt2WWVSWkZqd0s1YzE1RHJZOHhjOU1Q?= =?utf-8?B?bWFiN0ZYMkVoNGRjNytZb0hRdjgxZU95aUU1MFVBeEgxeDQ4VXc3b1EzTEEy?= =?utf-8?B?V1lORmhidlE4d1NFTXZGUDc4QzRPaE55UmRwWm1PU2RTdDZiRis3WGRjdlZj?= =?utf-8?B?Z2YzdUZVMitOcDhsWmdHU3R1UG91dHFlTmhEeFByYU8wb1h3TzZSeUVOK2pw?= =?utf-8?B?NGtSbWdFbjZ0bDhKT3M0ZU1lL3NqZS92L0toVi9yQ1N3RFdFeXh2emtBYzRH?= =?utf-8?B?QXlKdXY5ajIyNEQvTnNUNTNJU0dIWVZ2SWdNYnUwWFpQdm5GQXYyTzdlazdr?= =?utf-8?B?VnE5MWJnQ3JzSkRYSG5lTXFUZmtYOGc2bWVyMzZlc1l0VHhQTjdoWTJnREJh?= =?utf-8?B?VVgwZjJ1S3BobUFrRXNDR25Ra204ZXAzOVloZThmYVZzUWgwTjRYRCt3SHNj?= =?utf-8?B?UjMxc0U0NjFBRkoyQzg5WG9wWmNRU2Y4aFJ1eUt6dDU3V3ZEMXYxaCsrSmFq?= =?utf-8?B?WGFpdm5qcFBLMXUrWkJUM3BONmdZTUxlbUJVN3poeXp5WWV3S1VvYjdSM0VQ?= =?utf-8?B?UFV0d0ROZ3ljOGU5OHFNQ1VpM0xmemNZbHAvZWNlTnQxQzEvU3RBSkdhdFJx?= =?utf-8?B?ay91TmsvMEhiQnd3SEVqNzZhRlo4VGlQOU5mME5RbmV1K1dJSE13Z3JKVUQ2?= =?utf-8?B?LzlLSXlaSUx0YTc4cHRQcFNXVWZRaFNubE5ONmpTQ0lMOUhTNWpnQUNOMXZq?= =?utf-8?B?SFQ2cHkxRlM1Qml1dkh1eU95RlYyQTQvZXRuY29tbkloRVppYjJqZFFmdEx6?= =?utf-8?B?d3R0L3VYaExOcEZBdmlmOFBUVFZvWFlkS2hIaUs2d0s3Wkh3U09HLzlnSTdB?= =?utf-8?B?ZU9qczhVaXpYR0paNFNEeER5ODF3MUhhRERoVTFkZnk3cjBjSC8yd2JlWUls?= =?utf-8?B?Qkx1WVhDbzJ6ZUVqd0JjNlBtcDdUQk9qVWdvQmMzOUI2bWRMQTVEcjRwck96?= =?utf-8?B?WFhGSE5vL1A3bXJ6UVVBcmx2Mjdob0lRM3krcXNlbHRPbURCTkhGVzR1VlZ3?= =?utf-8?B?TEJIMFRzWmtteW9OTHZNZzV2UXZBS0NNbHNJcjBvekVaWWl4cnZ5dGtSVEtD?= =?utf-8?B?enVXL0t3N2M3OXVvM3I0Q0NJMW1ISE02SHJpb0x0ak9kSjl1TThPQ0xobUh1?= =?utf-8?Q?c7fQjLV6ekkk78/+nn2t75oXX?= Content-Type: text/plain; charset="utf-8" Content-ID: <2281520E57857B45A63C5C579D51B89F@namprd03.prod.outlook.com> Content-Transfer-Encoding: base64 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: dartmouth.edu X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: DS7PR03MB5574.namprd03.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: ba7631f2-2790-4825-8a6f-08dc29bc07c9 X-MS-Exchange-CrossTenant-originalarrivaltime: 09 Feb 2024 22:11:14.0878 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 995b0936-48d6-40e5-a31e-bf689ec9446f X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: WncOwXH2m9as+4nRV2SgWwyOQdyZONigFrhFrj6Otdo7xV9Vx9B4+FDF886hTuu4dEKvqp+rX0pBGjDoVDY5Xw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR03MB5672 X-Rspamd-Queue-Id: 4TWp384rSDz4GMc X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US] DQoNCk9uIDIvOS8yNCA0OjE4IFBNLCBNYXJrIEpvaG5zdG9uIHdyb3RlOg0KPiBbWW91IGRvbid0 IG9mdGVuIGdldCBlbWFpbCBmcm9tIG1hcmtqQGZyZWVic2Qub3JnLiBMZWFybiB3aHkgdGhpcyBp cyBpbXBvcnRhbnQgYXQgaHR0cHM6Ly9ha2EubXMvTGVhcm5BYm91dFNlbmRlcklkZW50aWZpY2F0 aW9uIF0NCj4gDQo+IE9uIEZyaSwgRmViIDA5LCAyMDI0IGF0IDA2OjIzOjA4UE0gKzAwMDAsIE1h dHRoZXcgTC4gRGFpbGV5IHdyb3RlOg0KPj4gSSBoYWQgbXkgZmlyc3Qga2VybmVsIHBhbmljIHdp dGggYSBLQVNBTiBrZXJuZWwgYWZ0ZXIgb25seSAwMToyNy4gVGhpcw0KPj4gZmlyc3QgcGFuaWMg d2FzIGEgImRvdWJsZSBmYXVsdCwiIHdoaWNoIGlzbid0IGFueXRoaW5nIHdlJ3ZlIHNlZW4NCj4+ IHByZXZpb3VzbHkgLSB1c3VhbGx5IHdlJ3ZlIHNlZW4gdHJhcCA5IG9yIHRyYXAgMTIsIGJ1dCBz b21ldGltZXMgb3RoZXJzLg0KPj4gQmFzZWQgb24gdGhlIGJhY2t0cmFjZSwgaXQgZGVmaW5pdGVs eSBsb29rcyBsaWtlIEtBU0FOIGNhdWdodCBzb21ldGhpbmcsDQo+PiBidXQgSSBkb24ndCBoYXZl IHRoZSBleHBlcnRpc2UgdG8ga25vdyBpZiB0aGlzIHBvaW50cyB0byBhbnl0aGluZw0KPj4gc3Bl Y2lmaWMuIEZyb20gdGhlIGJhY2t0cmFjZSwgaXQgbG9va3MgbGlrZSB0aGlzIG1pZ2h0IGhhdmUg b3JpZ2luYXRlZA0KPj4gaW4gaXBmdyBjb2RlLg0KPiANCj4gQSBkb3VibGUgZmF1bHQgaXMgcmF0 aGVyIHVuZXhwZWN0ZWQuICBJIHByZXN1bWUgeW91J3JlIHJ1bm5pbmcNCj4gcmVsZW5nLzE0LjA/ ICBJcyBpdCBhdCBhbGwgcG9zc2libGUgdG8gdGVzdCB3aXRoIEZyZWVCU0QtQ1VSUkVOVD8NCg0K VGhpcyBpcyBqdXN0IDE0LjAtUkVMRUFTRSwgdXBkYXRlZCB0byBwNC4gSGF2ZW4ndCBwbGF5ZWQg d2l0aCBDVVJSRU5UIA0KYmVmb3JlLCBidXQgSSdsbCBnaXZlIGl0IGEgc2hvdC4NCg0KPiANCj4g RGlkIHlvdSBhZGQgSU5WQVJJQU5UUyBldGMuIHRvIHRoZSBrZXJuZWwgY29uZmlndXJhdGlvbiB1 c2VkIGhlcmUsIG9yDQo+IGp1c3QgS0FTQU4/DQo+IA0KDQpUaGlzIGp1c3QgaGFkIEtBU0FOLiBB cmUgeW91IHN1Z2dlc3RpbmcgdGhhdCBJIG9ubHkgYWRkIElOVkFSSUFOVFMgDQooYWxvbmcgd2l0 aCBLQVNBTiksIG9yIGFsbCB0aGUgdmFyaW91cyBkZWJ1ZyBiaXRzOg0Kb3B0aW9ucyBEREINCm9w dGlvbnMgSU5WQVJJQU5UX1NVUFBPUlQNCm9wdGlvbnMgSU5WQVJJQU5UUw0Kb3B0aW9ucyBRVUVV RV9NQUNST19ERUJVR19UUkFTSA0Kb3B0aW9ucyBXSVRORVNTDQpvcHRpb25zIFdJVE5FU1NfU0tJ UFNQSU4NCg0KPj4gUGxlYXNlIGxldCBtZSBrbm93IHdoYXQgb3RoZXIgaW5mbyBJIGNhbiBwcm92 aWRlIG9yIHdoYXQgSSBjYW4gZG8gdG8gZGlnDQo+PiBkZWVwZXIuDQo+IA0KPiBJZiB5b3UgY291 bGQgcmVwZWF0IHRoZSB0ZXN0IHNldmVyYWwgdGltZXMsIEknZCBiZSBpbnRlcmVzdGVkIGluIHNl ZWluZw0KPiBpZiB5b3UgYWx3YXlzIGdldCB0aGUgc2FtZSByZXN1bHQuICBJZiB5b3UncmUgd2ls bGluZyB0byBzaGFyZSB0aGUNCj4gdm1jb3JlIChvciBzZXZlcmFsKSwgSSdkIGJlIHdpbGxpbmcg dG8gdGFrZSBhIGxvb2sgYXQgaXQuDQo+IA0KDQpXZSdsbCBzZWUgaG93IHRoaW5ncyBnbyB3aXRo IHRlc3RpbmcsIGFuZCBJJ2xsIHBhc3MgYWxvbmcgY29yZXMgZGlyZWN0bHkgDQppZiBpdCBtYWtl cyBzZW5zZS4gVGhlcmUgc2hvdWxkbid0IGJlIGFueXRoaW5nIHNlbnNpdGl2ZSB0aGF0IHdlIGNh cmUgYWJvdXQuDQoNCj4+IFRoYW5rcyEhDQo+Pg0KPj4gUGFuaWMgbWVzc2FnZToNCj4+IFs1Njc0 XSBGYXRhbCBkb3VibGUgZmF1bHQNCj4+IFs1Njc0XSByaXAgMHhmZmZmZmZmZjgxMmY2ZTMyIHJz cCAweGZmZmZmZTAxNDY3N2FmZTAgcmJwIDB4ZmZmZmZlMDE0Njc3YjQzMA0KPj4gWzU2NzRdIHJh eCAweDFmZmZmZmMwMjhjZWY2MjAgcmR4IDB4ZjJmMmYyZjhmMmYyZjJmMiByYnggMHgxDQo+PiBb NTY3NF0gcmN4IDB4ZGZmZmY3YzAwMDAwMDAwMCByc2kgMHhmZmZmZmUwMDQwODZhNGEwIHJkaSAw eGY4ZjhmOGY4ZjJmMmYyZjgNCj4+IFs1Njc0XSByOCAweGY4ZjhmOGY4ZjhmOGY4ZjggcjkgMHgx NjJhIHIxMCAweDgzNTAwMzAwMmQzYTY0ZTENCj4+IFs1Njc0XSByMTEgMCByMTIgMHhmZmZmZjc4 MDI4Y2VmNjIwIHIxMyAweGZmZmZmZTAwNDA4NmE0NDANCj4+IFs1Njc0XSByMTQgMHhmZmZmZmUw MTQ4OGMwNTYwIHIxNSAweDI2ZjQwIHJmbGFncyAweDEwMDA2DQo+PiBbNTY3NF0gY3MgMHgyMCBz cyAweDI4IGRzIDB4M2IgZXMgMHgzYiBmcyAweDEzIGdzIDB4MWINCj4+IFs1Njc0XSBmc2Jhc2Ug MHg5NWQxZDgxYTEzMCBnc2Jhc2UgMHhmZmZmZmZmZjg0YTE0MDAwIGtnc2Jhc2UgMA0KPj4gWzU2 NzRdIGNwdWlkID0gNDsgYXBpYyBpZCA9IDA4DQo+PiBbNTY3NF0gcGFuaWM6IGRvdWJsZSBmYXVs dA0KPj4gWzU2NzRdIGNwdWlkID0gNA0KPj4gWzU2NzRdIHRpbWUgPSAxNzA3NDk4NDIwDQo+PiBb NTY3NF0gS0RCOiBzdGFjayBiYWNrdHJhY2U6DQo+PiBbNTY3NF0gVXB0aW1lOiAxaDM0bTM0cw0K Pj4NCj4+IEJhY2t0cmFjZToNCj4+ICMwICBfX2N1cnRocmVhZCAoKSBhdCAvdXNyL3NyYy9zeXMv YW1kNjQvaW5jbHVkZS9wY3B1X2F1eC5oOjU3DQo+PiAjMSAgZG9hZHVtcCAodGV4dGR1bXA9PG9w dGltaXplZCBvdXQ+KSBhdA0KPj4gL3Vzci9zcmMvc3lzL2tlcm4va2Vybl9zaHV0ZG93bi5jOjQw NQ0KPj4gIzIgIDB4ZmZmZmZmZmY4MTI4YjdkYyBpbiBrZXJuX3JlYm9vdCAoaG93dG89aG93dG9A ZW50cnk9MjYwKQ0KPj4gICAgICAgYXQgL3Vzci9zcmMvc3lzL2tlcm4va2Vybl9zaHV0ZG93bi5j OjUyNg0KPj4gIzMgIDB4ZmZmZmZmZmY4MTI4YzAwMCBpbiB2cGFuaWMgKA0KPj4gICAgICAgZm10 PWZtdEBlbnRyeT0weGZmZmZmZmZmODI1ODlhMDAgPHN0cj4gImRvdWJsZSBmYXVsdCIsDQo+PiAg ICAgICBhcD1hcEBlbnRyeT0weGZmZmZmZTAwNDA4NjZkZTApIGF0DQo+PiAvdXNyL3NyYy9zeXMv a2Vybi9rZXJuX3NodXRkb3duLmM6OTcwDQo+PiAjNCAgMHhmZmZmZmZmZjgxMjhiZDc1IGluIHBh bmljIChmbXQ9MHhmZmZmZmZmZjgyNTg5YTAwIDxzdHI+ICJkb3VibGUNCj4+IGZhdWx0IikNCj4+ ICAgICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fc2h1dGRvd24uYzo4OTQNCj4+ICM1ICAw eGZmZmZmZmZmODFjNGIzMzUgaW4gZGJsZmF1bHRfaGFuZGxlciAoZnJhbWU9PG9wdGltaXplZCBv dXQ+KQ0KPj4gICAgICAgYXQgL3Vzci9zcmMvc3lzL2FtZDY0L2FtZDY0L3RyYXAuYzoxMDEyDQo+ PiAjNiAgPHNpZ25hbCBoYW5kbGVyIGNhbGxlZD4NCj4+ICM3ICAweGZmZmZmZmZmODEyZjZlMzIg aW4gc2NoZWRfY2xvY2sgKHRkPXRkQGVudHJ5PTB4ZmZmZmZlMDE0ODhjMDU2MCwNCj4+ICAgICAg IGNudD1jbnRAZW50cnk9MSkgYXQgL3Vzci9zcmMvc3lzL2tlcm4vc2NoZWRfdWxlLmM6MjYwMQ0K Pj4gIzggIDB4ZmZmZmZmZmY4MTE5ZTJhNyBpbiBzdGF0Y2xvY2sgKGNudD1jbnRAZW50cnk9MSwN Cj4+ICAgICAgIHVzZXJtb2RlPXVzZXJtb2RlQGVudHJ5PTApIGF0IC91c3Ivc3JjL3N5cy9rZXJu L2tlcm5fY2xvY2suYzo3NjANCj4+ICM5ICAweGZmZmZmZmZmODExOWZiNjcgaW4gaGFuZGxlZXZl bnRzIChub3c9bm93QGVudHJ5PTI0MzcxODU1Njk5ODMyLA0KPj4gICAgICAgZmFrZT1mYWtlQGVu dHJ5PTApIGF0IC91c3Ivc3JjL3N5cy9rZXJuL2tlcm5fY2xvY2tzb3VyY2UuYzoxOTUNCj4+ICMx MCAweGZmZmZmZmZmODExYTEwY2MgaW4gdGltZXJjYiAoZXQ9PG9wdGltaXplZCBvdXQ+LCBhcmc9 PG9wdGltaXplZCBvdXQ+KQ0KPj4gICAgICAgYXQgL3Vzci9zcmMvc3lzL2tlcm4va2Vybl9jbG9j a3NvdXJjZS5jOjM1Mw0KPj4gIzExIDB4ZmZmZmZmZmY4MWRjZDI4MCBpbiBsYXBpY19oYW5kbGVf dGltZXIgKGZyYW1lPTB4ZmZmZmZlMDE0Njc3Yjc1MCkNCj4+ICAgICAgIGF0IC91c3Ivc3JjL3N5 cy94ODYveDg2L2xvY2FsX2FwaWMuYzoxMzQzDQo+PiAjMTIgPHNpZ25hbCBoYW5kbGVyIGNhbGxl ZD4NCj4+ICMxMyBfX2FzYW5fbG9hZDhfbm9hYm9ydCAoYWRkcj0xODQ0Njc0MTg4MDIxOTY4OTIz MikNCj4+ICAgICAgIGF0IC91c3Ivc3JjL3N5cy9rZXJuL3N1YnJfYXNhbi5jOjExMTMNCj4+ICMx NCAweGZmZmZmZmZmODUxNDg4YjggaW4gPz8gKCkgZnJvbSAvYm9vdC90aGF5ZXIvaXBmdy5rbw0K Pj4gIzE1IDB4ZmZmZmZlMDEwMDAwMDAwMCBpbiA/PyAoKQ0KPj4gIzE2IDB4ZmZmZmZmZmY4MTM0 ZGNkNSBpbiBwY3B1X2ZpbmQgKGNwdWlkPTEyMzg0MjU4NTYpDQo+PiAgICAgICBhdCAvdXNyL3Ny Yy9zeXMva2Vybi9zdWJyX3BjcHUuYzoyODYNCj4+ICMxNyAweGZmZmZmZmZmODUxNTFmNmYgaW4g Pz8gKCkgZnJvbSAvYm9vdC90aGF5ZXIvaXBmdy5rbw0KPj4gIzE4IDB4MDAwMDAwMDAwMDAwMDAw MCBpbiA/PyAoKQ0K From nobody Fri Feb 9 22:20:28 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWpG82psrz5BRlG for ; Fri, 9 Feb 2024 22:20:48 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pg1-x52a.google.com (mail-pg1-x52a.google.com [IPv6:2607:f8b0:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWpG816K5z4HvN; Fri, 9 Feb 2024 22:20:48 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52a.google.com with SMTP id 41be03b00d2f7-5cf2d73a183so1917287a12.1; Fri, 09 Feb 2024 14:20:48 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707517246; x=1708122046; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=BKl8fko2BlWet28JRrZayCGX3dd0QVWg8EA/m6waNwk=; b=i9l4NnktXIBbXSuzXVVgTLxJJAlOIKmYDaGTb5cIA91Fg8z5iCQG25wK9Jn1FIt+B7 fKlFKovziit3J8y5Igc6lQrBgtBCbXlSx6bSxmr5+IO8y0Y6cqNrroHCI+PEP319/Sxy BsAQJMFTPm3gW4ORslqDvAwDnBblG3wVwBrz19ncu/e7EKqzjaD06x11pegsFtr+9Rbk lzYZ/vGF8VR4llq9Y6FHWMQ/ufddU+d471crsC+CIFjEDgJavMBQl+7TN49yexmvF221 NyYar4GnJyCauTpu3ftFtgrFYmtU86MAwD4KZpjpkM6JaA2Qm+PQ0mKFCAfNvUweuC4w wH5Q== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707517246; x=1708122046; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=BKl8fko2BlWet28JRrZayCGX3dd0QVWg8EA/m6waNwk=; b=Q+KlBqCbgKtTHPRAAK5E502rIJd8ph6B+c1wHPhUiUwVZHwQ1VRKmisGUPFaB4LdQj eWmyIXxjR0tW6H4WL/Zhl1GzBW7cYki9nrfhLTUwElkz/KbJCGRK5li8/kCPhmyB4yHw 3dGO2K0cwnj2VA+3FxP6I3qMHqsoKFFeuxyAyTYWVFHO8Kpwe5wC5d6hWzPThfomGXTX PIO9wTckxbgQkO8ZgQSBx658kZWX362ohXPdrbsFOTxf3Ody6bxvP4sZIaKC5RsA4UYA FYKVaUNaTpCeg/fB7Z8AJIcjGArbt4ZJXk5GtM8mBAHlduDG3Qgz8eYkIxvtI6o1Czgp gHhA== X-Forwarded-Encrypted: i=1; AJvYcCUDyRB06viFrThuWWLTWfyvig+JupBwvJshKYBzpzhesvpFiIDMh9iB4dl1yTJ/smJX/L3CRcvURlJRlv1D2Yma+hC0qaLgzy8FO9c= X-Gm-Message-State: AOJu0YxN0/k/I0NMBrVvVQZM5W4v1KIxLmAeBd5W5vSCbBSt8mj04Ajk CaxS1RIRPOHseMlWc2e9YUnUWj37h4tRPi89ok7VGOPuD0GSoYIyOXrBTdkYKYuQl9jvWwIpMd1 JmX03V0rRKmTF+WFKhwRQwDDGaA== X-Google-Smtp-Source: AGHT+IEfJpkQg1O8torNwx4RJe5ldVHoIQmV/3yaAbJBWOIgZh1SHDx3AW/w6JJuBXxUhkj/YWu3m+mMS54MtiP7EM8= X-Received: by 2002:a17:90a:9c2:b0:295:cd6f:86e0 with SMTP id 60-20020a17090a09c200b00295cd6f86e0mr3286104pjo.17.1707517245567; Fri, 09 Feb 2024 14:20:45 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rick Macklem Date: Fri, 9 Feb 2024 14:20:28 -0800 Message-ID: Subject: Re: FreeBSD panics possibly caused by nfs clients To: Zaphod Beeblebrox Cc: Mark Johnston , "Matthew L. Dailey" , "freebsd-current@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4TWpG816K5z4HvN X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Fri, Feb 9, 2024 at 2:04=E2=80=AFPM Zaphod Beeblebrox wrote: > > Just in case it's relevant, I'm carrying around this patch on my fairly b= usy little RISC-V machine. > > diff --git a/sys/fs/nfsclient/nfs_clvnops.c b/sys/fs/nfsclient/nfs_clvnop= s.c > index 0b8c587a542c..85c0ebd7a10f 100644 > --- a/sys/fs/nfsclient/nfs_clvnops.c > +++ b/sys/fs/nfsclient/nfs_clvnops.c > @@ -2459,6 +2459,16 @@ nfs_readdir(struct vop_readdir_args *ap) > return (EINVAL); > uio->uio_resid -=3D left; > > + /* > + * For readdirplus, if starting to read the directory, > + * purge the name cache, since it will be reloaded by > + * this directory read. > + * This removes potentially stale name cache entries. > + */ > + if (uio->uio_offset =3D=3D 0 && > + (VFSTONFS(vp->v_mount)->nm_flag & NFSMNT_RDIRPLUS) !=3D 0) > + cache_purge(vp); > + > /* > * Call ncl_bioread() to do the real work. > */ > ... without it, I can panic. This is not of interest to Matthew, since he is using Linux clients against= a FreeBSD server. However, it is of interest to me. This is the first time = I've seen this (unless I just forgot;-) and since readdirplus is not a default, = I suspect few test/use it. I will take a look at this, since it sounds reasonable. Thanks for posting it, rick > > > On Fri, Feb 9, 2024 at 4:18=E2=80=AFPM Mark Johnston = wrote: >> >> On Fri, Feb 09, 2024 at 06:23:08PM +0000, Matthew L. Dailey wrote: >> > I had my first kernel panic with a KASAN kernel after only 01:27. This >> > first panic was a "double fault," which isn't anything we've seen >> > previously - usually we've seen trap 9 or trap 12, but sometimes other= s. >> > Based on the backtrace, it definitely looks like KASAN caught somethin= g, >> > but I don't have the expertise to know if this points to anything >> > specific. From the backtrace, it looks like this might have originated >> > in ipfw code. >> >> A double fault is rather unexpected. I presume you're running >> releng/14.0? Is it at all possible to test with FreeBSD-CURRENT? >> >> Did you add INVARIANTS etc. to the kernel configuration used here, or >> just KASAN? >> >> > Please let me know what other info I can provide or what I can do to d= ig >> > deeper. >> >> If you could repeat the test several times, I'd be interested in seeing >> if you always get the same result. If you're willing to share the >> vmcore (or several), I'd be willing to take a look at it. >> >> > Thanks!! >> > >> > Panic message: >> > [5674] Fatal double fault >> > [5674] rip 0xffffffff812f6e32 rsp 0xfffffe014677afe0 rbp 0xfffffe01467= 7b430 >> > [5674] rax 0x1fffffc028cef620 rdx 0xf2f2f2f8f2f2f2f2 rbx 0x1 >> > [5674] rcx 0xdffff7c000000000 rsi 0xfffffe004086a4a0 rdi 0xf8f8f8f8f2f= 2f2f8 >> > [5674] r8 0xf8f8f8f8f8f8f8f8 r9 0x162a r10 0x835003002d3a64e1 >> > [5674] r11 0 r12 0xfffff78028cef620 r13 0xfffffe004086a440 >> > [5674] r14 0xfffffe01488c0560 r15 0x26f40 rflags 0x10006 >> > [5674] cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b >> > [5674] fsbase 0x95d1d81a130 gsbase 0xffffffff84a14000 kgsbase 0 >> > [5674] cpuid =3D 4; apic id =3D 08 >> > [5674] panic: double fault >> > [5674] cpuid =3D 4 >> > [5674] time =3D 1707498420 >> > [5674] KDB: stack backtrace: >> > [5674] Uptime: 1h34m34s >> > >> > Backtrace: >> > #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 >> > #1 doadump (textdump=3D) at >> > /usr/src/sys/kern/kern_shutdown.c:405 >> > #2 0xffffffff8128b7dc in kern_reboot (howto=3Dhowto@entry=3D260) >> > at /usr/src/sys/kern/kern_shutdown.c:526 >> > #3 0xffffffff8128c000 in vpanic ( >> > fmt=3Dfmt@entry=3D0xffffffff82589a00 "double fault", >> > ap=3Dap@entry=3D0xfffffe0040866de0) at >> > /usr/src/sys/kern/kern_shutdown.c:970 >> > #4 0xffffffff8128bd75 in panic (fmt=3D0xffffffff82589a00 "doubl= e >> > fault") >> > at /usr/src/sys/kern/kern_shutdown.c:894 >> > #5 0xffffffff81c4b335 in dblfault_handler (frame=3D) >> > at /usr/src/sys/amd64/amd64/trap.c:1012 >> > #6 >> > #7 0xffffffff812f6e32 in sched_clock (td=3Dtd@entry=3D0xfffffe01488c0= 560, >> > cnt=3Dcnt@entry=3D1) at /usr/src/sys/kern/sched_ule.c:2601 >> > #8 0xffffffff8119e2a7 in statclock (cnt=3Dcnt@entry=3D1, >> > usermode=3Dusermode@entry=3D0) at /usr/src/sys/kern/kern_clock.c:= 760 >> > #9 0xffffffff8119fb67 in handleevents (now=3Dnow@entry=3D243718556998= 32, >> > fake=3Dfake@entry=3D0) at /usr/src/sys/kern/kern_clocksource.c:19= 5 >> > #10 0xffffffff811a10cc in timercb (et=3D, arg=3D) >> > at /usr/src/sys/kern/kern_clocksource.c:353 >> > #11 0xffffffff81dcd280 in lapic_handle_timer (frame=3D0xfffffe014677b7= 50) >> > at /usr/src/sys/x86/x86/local_apic.c:1343 >> > #12 >> > #13 __asan_load8_noabort (addr=3D18446741880219689232) >> > at /usr/src/sys/kern/subr_asan.c:1113 >> > #14 0xffffffff851488b8 in ?? () from /boot/thayer/ipfw.ko >> > #15 0xfffffe0100000000 in ?? () >> > #16 0xffffffff8134dcd5 in pcpu_find (cpuid=3D1238425856) >> > at /usr/src/sys/kern/subr_pcpu.c:286 >> > #17 0xffffffff85151f6f in ?? () from /boot/thayer/ipfw.ko >> > #18 0x0000000000000000 in ?? () >> From nobody Fri Feb 9 22:31:18 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWpVL13NDz5BS5h for ; Fri, 9 Feb 2024 22:31:22 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-qk1-x731.google.com (mail-qk1-x731.google.com [IPv6:2607:f8b0:4864:20::731]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWpVK6YQdz4KPP for ; Fri, 9 Feb 2024 22:31:21 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-qk1-x731.google.com with SMTP id af79cd13be357-78574840242so62597085a.0 for ; Fri, 09 Feb 2024 14:31:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707517881; x=1708122681; darn=freebsd.org; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:from:to:cc:subject:date:message-id :reply-to; bh=mA+Qp6OO6bG8xB1MDizU/YD9EhCPnkAa2llGLH9+tMY=; b=l3oHF9HkVGdHbK0/UK7AW2ufuG1vEzpw+StJWkg6ullzqvXyIXSl23uNVOizaSfwiz mBBauxS7qnvbAzakui/znpLauyiwCH3HwSCI1BjdXRsb3a2OR3r4bkQAtO3eicuwmix8 DDcnIVEdmFNYaSBYY7QqAMjxaaIxkXY2OzxcSV3mAzclpfkdX9FSGglQ1a7aYOhARMEp mPHxnWGaBkurWxE1EoACfQkHJRE6mJ6TRnNzSVkeBHbZ/rvBbE/kXBW8brF26OXRck92 MFhyFnnEwvCEOi2FdrSUDdayOOGIa+210NOmjnePBwRnEhg/riSJ01s7fgFku/s9Fctz 0Iew== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707517881; x=1708122681; h=in-reply-to:content-disposition:mime-version:references:message-id :subject:cc:to:from:date:sender:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=mA+Qp6OO6bG8xB1MDizU/YD9EhCPnkAa2llGLH9+tMY=; b=DI8oL1cPUHZv3wO2dtsrY347PQD9V0uK4b+A1EeF4iCalez1eSA5Bk5W1viT7QVuSE uIPBSlIfRas2pX4vX2VIIcsFZRplyPbJ4Lc+UHjjzls+8M6m/qYKg+8Ncib5fuSVn63G bjie3KkQ2j6Z6fQxIGpx+0muAmD+k06WRexHm6W6KHJOVBW5AS/+xRJ93xv861PCxz0b qs3W0TMcMFJDwNqJxqCvm3iudc09hKHlLAWIRozd/LqX8wZg3144d86qaLSAJNDovePz fz55fChBrmuqhLsPwhzYpFFybcpHRfBlAD+ET4c8H8IfHeyr6I+PtFUqqNhGBqVoKVvZ Q1PA== X-Gm-Message-State: AOJu0YwpwBZBaWc2j53mH4hQF76s3PqmzAluqJPyce7cUC43hrjB9jwX Gbz1yDbF40m1gg0Iz17Jhnh1RWMcznbxkR9JMTS40AwI+1tL69HNDQzbDXzv X-Google-Smtp-Source: AGHT+IFvbwT/Ogun8ua2u7DpsAtEyxFUPY1vfrDpmYvedioeC46MvA8QpbGhc9hZpmRTmLWRosTI3Q== X-Received: by 2002:a05:620a:2415:b0:783:bd02:c037 with SMTP id d21-20020a05620a241500b00783bd02c037mr475603qkn.47.1707517881218; Fri, 09 Feb 2024 14:31:21 -0800 (PST) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id j14-20020a05620a146e00b007854018044bsm135596qkl.134.2024.02.09.14.31.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 09 Feb 2024 14:31:20 -0800 (PST) Date: Fri, 9 Feb 2024 17:31:18 -0500 From: Mark Johnston To: "Matthew L. Dailey" Cc: "freebsd-current@freebsd.org" Subject: Re: FreeBSD panics possibly caused by nfs clients Message-ID: References: <3ea6d241-b9cc-4294-aef8-ae1c6d9d8161@dartmouth.edu> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3ea6d241-b9cc-4294-aef8-ae1c6d9d8161@dartmouth.edu> X-Rspamd-Queue-Id: 4TWpVK6YQdz4KPP X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Fri, Feb 09, 2024 at 10:11:14PM +0000, Matthew L. Dailey wrote: > On 2/9/24 4:18 PM, Mark Johnston wrote: > > [You don't often get email from markj@freebsd.org. Learn why this is important at https://aka.ms/LearnAboutSenderIdentification ] > > > > On Fri, Feb 09, 2024 at 06:23:08PM +0000, Matthew L. Dailey wrote: > >> I had my first kernel panic with a KASAN kernel after only 01:27. This > >> first panic was a "double fault," which isn't anything we've seen > >> previously - usually we've seen trap 9 or trap 12, but sometimes others. > >> Based on the backtrace, it definitely looks like KASAN caught something, > >> but I don't have the expertise to know if this points to anything > >> specific. From the backtrace, it looks like this might have originated > >> in ipfw code. > > > > A double fault is rather unexpected. I presume you're running > > releng/14.0? Is it at all possible to test with FreeBSD-CURRENT? > > This is just 14.0-RELEASE, updated to p4. Haven't played with CURRENT > before, but I'll give it a shot. > > > > > Did you add INVARIANTS etc. to the kernel configuration used here, or > > just KASAN? > > > > This just had KASAN. Are you suggesting that I only add INVARIANTS > (along with KASAN), or all the various debug bits: > options DDB > options INVARIANT_SUPPORT > options INVARIANTS > options QUEUE_MACRO_DEBUG_TRASH > options WITNESS > options WITNESS_SKIPSPIN Please try adding all of them. From nobody Fri Feb 9 22:41:53 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWpkr5pq0z5BTDq for ; Fri, 9 Feb 2024 22:42:12 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-pg1-x52d.google.com (mail-pg1-x52d.google.com [IPv6:2607:f8b0:4864:20::52d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWpkr3zfkz4Lhy for ; Fri, 9 Feb 2024 22:42:12 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-pg1-x52d.google.com with SMTP id 41be03b00d2f7-53fbf2c42bfso1008744a12.3 for ; Fri, 09 Feb 2024 14:42:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707518531; x=1708123331; darn=freebsd.org; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=Vc5hlh0C/iI+/RibW/yHYG1ocRxfyghTuBq2n+Xog2M=; b=QCx02570j+03wrtBhkb1PtWQvHk5y9/a8aXTmltyCFqtijmgOSABN0ujVCf6Hvm0zy awsm9LpPBKb2A7MEJhfzgHKn2+UGCj1MvC8cEbnERakh5gB1cvFbP9C/rsU7XAuYjVQl EoPorRiuFgjn8QwducorNkEx5l9M4wvJxNRZL2mZ3jUykFDgTal4WpwoEfn50mVwkZN7 lhbdYXFq4NJElm+98zBoxhRix6hclE58DMnijESMFU6LAPDcJ8ScBi961lEOPsLViixX AdyK2HTHEIkIclkOF+0oQcxQ9UwSKfIZv6z91EAm0Z8uH52OB7psuRLjVwitYZHAYURM 861w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707518531; x=1708123331; h=content-transfer-encoding:cc:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=Vc5hlh0C/iI+/RibW/yHYG1ocRxfyghTuBq2n+Xog2M=; b=co5EKllnPvnzTMm3cLy+DyBkvFhWb1+HSvwX1TmaMoJvikYAwDc5E+KkNf9fgtrRp7 +lA39ZLowC5n+MdlGlhA/ZaUYtVfH5UBfy6E5ZShL8OcK2Yy2FKBKWSzVyqCyMzDaAoJ siolPKNWM4QS50fOfaVTPen920pF0/pWwY6ITQ17+0m7Q0p+utlat4xjDgg7fcYwn8Z6 66HHxiims0iuRdW+E0bz0CwB5HcuHYF7fvf4tkCVByIn4Nvt7BzYCGrcQODPyWhEnCZx 1OKaaU6QLrEDZen0bTcN1ODeg96B94O/ULIkVvacs+9Q4av/+RUKFHw6mDzI508GT12t IPSQ== X-Gm-Message-State: AOJu0YzOvu2X9TIYGpIxzCXVe6XA5CgEq2ycNNlbnRYDPjTy5OH4nzbl nzRnhhS32LQQGeK9cUeegbZCXncXjsvXITc+hkZUHdxnPWKEJLlGyIkwCXGsqHAohcr5j4pe9A/ QiD+M7LodxNc2wV7q/6pRDDvMcypRtwE= X-Google-Smtp-Source: AGHT+IEY3KyvRWqWcv21TRXCR9gmmuTk8L1Mu0q+qD4v0XG9C4Zk9h1xPN/r0I5ZXy7oMHyn4GUQX9P+nAwfkG1NyHI= X-Received: by 2002:a05:6a21:9188:b0:19e:8b31:f1ae with SMTP id tp8-20020a056a21918800b0019e8b31f1aemr662751pzb.29.1707518530865; Fri, 09 Feb 2024 14:42:10 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Rick Macklem Date: Fri, 9 Feb 2024 14:41:53 -0800 Message-ID: Subject: Re: FreeBSD panics possibly caused by nfs clients To: "Matthew L. Dailey" Cc: "freebsd-current@freebsd.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Rspamd-Queue-Id: 4TWpkr3zfkz4Lhy X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; TAGGED_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] On Fri, Feb 9, 2024 at 10:23=E2=80=AFAM Matthew L. Dailey wrote: > > I had my first kernel panic with a KASAN kernel after only 01:27. This > first panic was a "double fault," which isn't anything we've seen > previously - usually we've seen trap 9 or trap 12, but sometimes others. > Based on the backtrace, it definitely looks like KASAN caught something, > but I don't have the expertise to know if this points to anything > specific. From the backtrace, it looks like this might have originated > in ipfw code. I do not know anything about the KASAN kernel, but I do see it increases the kernel stack to 6 pages and when I see a double fault, it is usually a kernel stack being blown. You might check what it is: # sysctl -a | fgrep kstack_pages If it is already 6, you could try bumping it to 8. Just add this line to /boot/loader.conf kern.kstack_pages=3D8 and reboot. rick > > Please let me know what other info I can provide or what I can do to dig > deeper. > > Thanks!! > > Panic message: > [5674] Fatal double fault > [5674] rip 0xffffffff812f6e32 rsp 0xfffffe014677afe0 rbp 0xfffffe014677b4= 30 > [5674] rax 0x1fffffc028cef620 rdx 0xf2f2f2f8f2f2f2f2 rbx 0x1 > [5674] rcx 0xdffff7c000000000 rsi 0xfffffe004086a4a0 rdi 0xf8f8f8f8f2f2f2= f8 > [5674] r8 0xf8f8f8f8f8f8f8f8 r9 0x162a r10 0x835003002d3a64e1 > [5674] r11 0 r12 0xfffff78028cef620 r13 0xfffffe004086a440 > [5674] r14 0xfffffe01488c0560 r15 0x26f40 rflags 0x10006 > [5674] cs 0x20 ss 0x28 ds 0x3b es 0x3b fs 0x13 gs 0x1b > [5674] fsbase 0x95d1d81a130 gsbase 0xffffffff84a14000 kgsbase 0 > [5674] cpuid =3D 4; apic id =3D 08 > [5674] panic: double fault > [5674] cpuid =3D 4 > [5674] time =3D 1707498420 > [5674] KDB: stack backtrace: > [5674] Uptime: 1h34m34s > > Backtrace: > #0 __curthread () at /usr/src/sys/amd64/include/pcpu_aux.h:57 > #1 doadump (textdump=3D) at > /usr/src/sys/kern/kern_shutdown.c:405 > #2 0xffffffff8128b7dc in kern_reboot (howto=3Dhowto@entry=3D260) > at /usr/src/sys/kern/kern_shutdown.c:526 > #3 0xffffffff8128c000 in vpanic ( > fmt=3Dfmt@entry=3D0xffffffff82589a00 "double fault", > ap=3Dap@entry=3D0xfffffe0040866de0) at > /usr/src/sys/kern/kern_shutdown.c:970 > #4 0xffffffff8128bd75 in panic (fmt=3D0xffffffff82589a00 "double > fault") > at /usr/src/sys/kern/kern_shutdown.c:894 > #5 0xffffffff81c4b335 in dblfault_handler (frame=3D) > at /usr/src/sys/amd64/amd64/trap.c:1012 > #6 > #7 0xffffffff812f6e32 in sched_clock (td=3Dtd@entry=3D0xfffffe01488c0560= , > cnt=3Dcnt@entry=3D1) at /usr/src/sys/kern/sched_ule.c:2601 > #8 0xffffffff8119e2a7 in statclock (cnt=3Dcnt@entry=3D1, > usermode=3Dusermode@entry=3D0) at /usr/src/sys/kern/kern_clock.c:760 > #9 0xffffffff8119fb67 in handleevents (now=3Dnow@entry=3D24371855699832, > fake=3Dfake@entry=3D0) at /usr/src/sys/kern/kern_clocksource.c:195 > #10 0xffffffff811a10cc in timercb (et=3D, arg=3D) > at /usr/src/sys/kern/kern_clocksource.c:353 > #11 0xffffffff81dcd280 in lapic_handle_timer (frame=3D0xfffffe014677b750) > at /usr/src/sys/x86/x86/local_apic.c:1343 > #12 > #13 __asan_load8_noabort (addr=3D18446741880219689232) > at /usr/src/sys/kern/subr_asan.c:1113 > #14 0xffffffff851488b8 in ?? () from /boot/thayer/ipfw.ko > #15 0xfffffe0100000000 in ?? () > #16 0xffffffff8134dcd5 in pcpu_find (cpuid=3D1238425856) > at /usr/src/sys/kern/subr_pcpu.c:286 > #17 0xffffffff85151f6f in ?? () from /boot/thayer/ipfw.ko > #18 0x0000000000000000 in ?? () From nobody Sat Feb 10 04:13:15 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TWy5B5ydHz58nrZ for ; Sat, 10 Feb 2024 04:13:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TWy595ZdPz3xby for ; Sat, 10 Feb 2024 04:13:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=t35boHvQ; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.32 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707538411; bh=fXLoWye0vC82uumYRN+aUEBDWaMje4L4XPYD1S/CQWk=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=t35boHvQhuSb9djEgPr5AHpLVUBdw3KtYiGDq6rBLXyJxE+GVo0BMlbi8Dq2yPH3r224qVosQ+yDwLMY6Yh/SjJZvwSE+HZBSS2kE4PsS60z4EeZE4ncW4h+Tygwe4qB+wtY+RuEb+rgOofVPRcHSstDe51vdmE4n8aY1oshkw155b6LzS+VPWgdys8D4+PehUIbwK3/WONq4F97IoPjUlLDYtBuVFTweb7POXSlUJbw2LvqLnuMJTFcQLeVbxy9QqDTA9S+d/EzGZ5trmdy/HW6Siws6WrOLr9VPIh3cHionYPDbrpF3MYQ21qcA6PJhSO1w2krICHgOdzKDaZwXg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707538411; bh=hdo7477X7miX6FisfQf7VxOr0srr2ncU3ZEg+ZwEs2H=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=RnhswI6qvcEWJC8f2w0j7T8q2/UctOmLgRmmFphikC6Zk32AnSeOUd2qgzN0nGHdQRmc+Ob3JRZlH1/pNoWnneGgVF0C63EQNqJsmYTEfxnTLz3Nqxmv3VbC5pGZeD+uHKuL1iihKuRB8ZSiIBwtHagOgVg2b8+CR3RO0sgqu6GNUCkIqZokkyxcCP77LKktiPK91VMQ2ykwgR5+OSGoFDObDmzjLThsfYa9sh1xoQVJ+ZGCi/Up2b/GlAn2q/5Hk9T0joGMmFpO4FBJD6oBiAlAMBeEEIUpMqmnNw2JLuchZCkifjW5CcimJI0oJ0WkdGyybXJ4hSfi8bxu6+WcHQ== X-YMail-OSG: XYoVmy8VM1kusseyNx67APgMO2v5ds2h0M893qWiKfDpxXcDYz4mqNmvLBrmvPL HOC8iQTgMXI7o9fVomFFiXpPFNbnz4TERKIfM5Wpe1Y26_GrZi00W91WHj467fIB8mJB7DFKDDLE rJd0_JWQBly.RMzU32xc46.NrDuzX7sfdv.C9X7Adsl1ei7Q8oJ_UgzEeaD4sn86mn8jS0Il8_BV E8DvVoqMliBtV.uXl4ZA8Jpw5r9t9I7W3LltVlG56t6BKAALcW2EiATnAFVlKyW.9Um_fd63cZx3 37s4i8PAdfjbajKETfxxksCMB5GU_.njn1_bvUCOkJegVZBpCeUz9sKy8XN8qHSyIXsXgpJTQbkf ybLrPnXFIYtgXUwByZw0.QVzqJ6w_ztKZCKKYCPei.9y6hTtObzdCw9MPDoM5Z2dJ7TiRWjo8EO3 SZqaXHA_0tBh7GJz0Ofi1SuEmhaPWMT4E5cl8S5OLgKL94DHV3PZpnvudrHaOQ4yRO0fXWAOfn8X Sd7UVKg73OGxF8fwL3ELa0D9fWWc0Gi3lBWhjDjOeXTo4n7ce6w2lLrYLFEDeXtKeLaSrNp_0vgQ yESvF8CYaZWtph8b6NJp5RA523UmUGqWdGYVE8l4ER6aWvgQChk4GQThEFBZxlfChgub3aYnUBAi b036wjJZYRJ62RZKA4JXI3m2NOUjq6Kv2CqSunFkKDiLNY_cFKRhE15ylPtkJ9jAV97gfIdKy6yE lCbPgiMuAcp_3bficWcRI7cE24_s.RX2sn8d2LcY8GYFFgSYl2V1eolljXEGuI_n0vMtWLp_wiVQ AdOfDu23ONTDRGN62wduexKu17NWiK0lv7flS66dguNpIpay2maTqS.sGTkadgbX.EvgAj5HJes9 VIyDCJO8msKYg4pXVP9qC0tTveJJVjrBudF67stQDSyORdWejfFEYs0XB7hH3RMMYinq91i8ktQc bkS9DDSbVBTCUk9c.gs4CMMDQI6kgX4suPiKDh74W1tlrN5ElstYpWxOUiQhn.U.EdceG2DVQEJ6 0_2426FsvNViB_Ce9WAHCfhb3v.8GxPkZsYcBENoXoa3T..Vx84G9XkPB4gboUh3659AOjhsxLHA VE9FYZoqEv3HSOuXdGcHbmZ6S5dHQPdTD_lXoEpiYyAxa6k9f9Nk7t2WU.aj3sk0kmkTuYqbcI1n 0pZwEXbuz3Mckha8vq3y_hf5jeDSsQnAGPSoolNGkte6BzDaMscmC.nXzqg.XZYrb_PTNIInoqwz YY8PmHzM.9zY0ZyJ1APa5DrS7BdbvA_nB6Axbu2Q4zdhZERYXFZ0RtA.7hoL1CJvD7SeImYPohag pHSZYlylZm5hA7vtZBQOXMmk6gdDfr4_pyQrAOK7z.M4S2MFf9bctEJ3Pcd66d26Yx9djtjp8OIG hKhgsp4vgMqsSF7eMsHTM3GHbMfl01M.LpbqVyTFm1Z07nR8e0oySHb4RPjNtYpjxf0rew4mUSTS KSs7meMuatRxkzsolH3POLw1RnRK5_m_u1gq6CMQDvrygWxWokUAvDRFsc9SnejLKYEkUX4Ry5tF TvBvxUkip8DYJ92thnOD6P7qXHiEOL.tmmAmqVyqpEctbLZ88EHU9Q6_28arFvTaPmVej14WIFnH QXXWlN3MRgDATeY8zOJBs6ulGghk2ogX4c4uyI7ZfW.x27kxanjO9Q.tIPMPz5fTJTloHWMoW9cZ ucZNLYeLuyId7WurH2v36JUtqP1vkWoUQDEZapTYxsHAVK2PimZbogOO8.T173S40JU9vRkm5pov sTqKCjkd.iJn6e5NokQISBzoKtGGxWjrv5D5LQ4N3A02pBV817GndJy88xUXBEh8xJmzs9mqQjg0 wsuO3qcY1uk.7vyjkg5.NBTDddYYuxPONL8ajKAl8vg9lO0Ib8a5N0pXbv86jg6oGAMKzajoz33h X9jLzJdhiHQmJ8nAaLA9dxKzZ73EvFclUNoVHwq0GfGyuN65hLNRg18y4l3V0xSaiznMsSL4ZH65 IDDNnBluuyh90WidOBld151TFGEDZfuq7iC7W3LBfqDHVRgqNaL9Oo3FPfKHgzKHgNxyzUPi17_4 DAa7jwD.do.Ek.o4rX5YplFETID7zR4swnSyrfP_MZhlQojDG3VtAdRi.OZaEPnVh21.FMd_5xAO XCQRNfJYIRgv0C9dp5d3GNY_C7dN6NfOnhp.NQghSjjNP_Cw7qu6_cxpk4yH18FvNwexIiQrq9Gy Ji9WzQdLQ01cKm6cH4f1gSYtjpyAPV2CKcl5lfSRGyzXPIj7NeolEcVyoBi.wNd1GW1BmGgm05FC Dg0e2T8hz X-Sonic-MF: X-Sonic-ID: 6ad2b8dd-20f3-49b4-8ee9-677bff21eecd Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sat, 10 Feb 2024 04:13:31 +0000 Received: by hermes--production-gq1-5c57879fdf-hrd4s (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID b6980849aaabe1487b039d52854ae5f2; Sat, 10 Feb 2024 04:13:26 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Recent commits reject RPi4B booting: pcib0 vs. pcib1 "rman_manage_region: request" leads to panic Message-Id: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5@yahoo.com> Date: Fri, 9 Feb 2024 20:13:15 -0800 Cc: John Baldwin , Warner Losh To: FreeBSD ARM List , Current FreeBSD X-Mailer: Apple Mail (2.3774.400.31) References: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCPT_COUNT_THREE(0.00)[4]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.32:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.32:from] X-Rspamd-Queue-Id: 4TWy595ZdPz3xby Summary: pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 pcib0: parsing FDT for ECAM0: pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 . . . rman_manage_region: request: start 0x600000000, = end 0x6000fffff panic: Failed to add resource to rman Detail: . . . pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 pcib0: parsing FDT for ECAM0: pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 pcib0: Bus is not cache-coherent rman_reserve_resource_bound: request: = [0xfd500000, 0xfd50930f], length 0x9310, flags 100, device pcib0 rman_reserve_resource_bound: trying 0x1fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x1fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x31bfffff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x33296fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39bf1fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c02fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c06fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c07fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c08fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c2afff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c36fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x39c37fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3b03ffff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3b04ffff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3b2fffff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3ee61fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3ee63fff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0x3fffffff <0xfd500000,0x930f> rman_reserve_resource_bound: tried 0xfbffffff <0xfd500000,0x930f> considering [0xfc000000, 0xfd5d1fff] truncated region: [0xfd500000, 0xfd50930f]; size 0x9310 (requested = 0x9310) candidate region: [0xfd500000, 0xfd50930f], size 0x9310 splitting region in three parts: [0xfc000000, 0xfd4fffff]; [0xfd500000, = 0xfd50930f]; [0xfd509310, 0xfd5d1fff] rman_manage_region: request: start 0xc0000000, end = 0xffffffff pcib0: hardware identifies as revision 0x304. pcib0: note: reported link speed is 5.0 GT/s. rman_reserve_resource_bound: request: [0x51, 0x51], length = 0x1, flags 0, device pcib0 rman_reserve_resource_bound: trying 0 <0x51,0> rman_reserve_resource_bound: tried 0 <0x51,0> rman_reserve_resource_bound: tried 0x1 <0x51,0> rman_reserve_resource_bound: tried 0x2 <0x51,0> rman_reserve_resource_bound: tried 0x3 <0x51,0> rman_reserve_resource_bound: tried 0x4 <0x51,0> rman_reserve_resource_bound: tried 0x5 <0x51,0> rman_reserve_resource_bound: tried 0x6 <0x51,0> rman_reserve_resource_bound: tried 0x7 <0x51,0> rman_reserve_resource_bound: tried 0xc <0x51,0> rman_reserve_resource_bound: tried 0xd <0x51,0> rman_reserve_resource_bound: tried 0xe <0x51,0> rman_reserve_resource_bound: tried 0xf <0x51,0> rman_reserve_resource_bound: tried 0x10 <0x51,0> rman_reserve_resource_bound: tried 0x11 <0x51,0> rman_reserve_resource_bound: tried 0x12 <0x51,0> rman_reserve_resource_bound: tried 0x17 <0x51,0> rman_reserve_resource_bound: tried 0x18 <0x51,0> rman_reserve_resource_bound: tried 0x1a <0x51,0> rman_reserve_resource_bound: tried 0x1b <0x51,0> rman_reserve_resource_bound: tried 0x22 <0x51,0> rman_reserve_resource_bound: tried 0x23 <0x51,0> rman_reserve_resource_bound: tried 0x24 <0x51,0> rman_reserve_resource_bound: tried 0x25 <0x51,0> rman_reserve_resource_bound: tried 0x26 <0x51,0> rman_reserve_resource_bound: tried 0x27 <0x51,0> rman_reserve_resource_bound: tried 0x28 <0x51,0> rman_reserve_resource_bound: tried 0x29 <0x51,0> rman_reserve_resource_bound: tried 0x4e <0x51,0> rman_reserve_resource_bound: tried 0x4f <0x51,0> considering [0x50, 0xffffffffffffffff] truncated region: [0x51, 0x51]; size 0x1 (requested 0x1) candidate region: [0x51, 0x51], size 0x1 splitting region in three parts: [0x50, 0x50]; [0x51, 0x51]; [0x52, = 0xffffffffffffffff] pci0: on pcib0 rman_manage_region: request: start 0, end = 0xff rman_reserve_resource_bound: request: [0, 0], = length 0x1, flags 0, device pci0 rman_reserve_resource_bound: trying 0xff <0,0> considering [0, 0xff] truncated region: [0, 0]; size 0x1 (requested 0x1) candidate region: [0, 0], size 0x1 allocating from the beginning pci0: domain=3D0, physical bus=3D0 found-> vendor=3D0x14e4, dev=3D0x2711, revid=3D0x00 domain=3D0, bus=3D0, slot=3D0, func=3D0 class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords) lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 = ns) intpin=3Da, irq=3D0 powerspec 3 supports D0 D3 current D0 secbus=3D1, subbus=3D1 rman_reserve_resource_bound: request: [0x1, = 0x1], length 0x1, flags 0, device (null) rman_reserve_resource_bound: trying 0 <0x1,0> rman_reserve_resource_bound: tried 0 <0x1,0> considering [0x1, 0xff] truncated region: [0x1, 0x1]; size 0x1 (requested 0x1) candidate region: [0x1, 0x1], size 0x1 allocating from the beginning pcib1: irq 91 at device 0.0 on pci0 rman_manage_region: request: start 0x1, end 0x1 pcib0: rman_reserve_resource: start=3D0xc0000000, end=3D0xc00fffff, = count=3D0x100000 rman_reserve_resource_bound: request: [0xc0000000, = 0xc00fffff], length 0x100000, flags 102, device pcib1 rman_reserve_resource_bound: trying 0xffffffff <0xc0000000,0xfffff> considering [0xc0000000, 0xffffffff] truncated region: [0xc0000000, 0xc00fffff]; size 0x100000 (requested = 0x100000) candidate region: [0xc0000000, 0xc00fffff], size 0x100000 allocating from the beginning rman_manage_region: request: start 0x600000000, = end 0x6000fffff panic: Failed to add resource to rman cpuid =3D 0 time =3D 1 KDB: stack backtrace: db_trace_self() at db_trace_self db_trace_self_wrapper() at db_trace_self_wrapper+0x38 vpanic() at vpanic+0x1a4 panic() at panic+0x48 pcib_add_window_resources() at pcib_add_window_resources+0xf4 pcib_alloc_window() at pcib_alloc_window+0xfc pcib_attach_common() at pcib_attach_common+0xa18 pcib_attach() at pcib_attach+0x14 device_attach() at device_attach+0x3fc device_probe_and_attach() at device_probe_and_attach+0x80 bus_generic_attach() at bus_generic_attach+0x1c pci_attach() at pci_attach+0xec device_attach() at device_attach+0x3fc device_probe_and_attach() at device_probe_and_attach+0x80 bus_generic_attach() at bus_generic_attach+0x1c device_attach() at device_attach+0x3fc device_probe_and_attach() at device_probe_and_attach+0x80 bus_generic_new_pass() at bus_generic_new_pass+0x100 bus_generic_new_pass() at bus_generic_new_pass+0xb0 bus_generic_new_pass() at bus_generic_new_pass+0xb0 bus_generic_new_pass() at bus_generic_new_pass+0xb0 bus_set_pass() at bus_set_pass+0x50 mi_startup() at mi_startup+0x1e0 virtdone() at virtdone+0x68 KDB: enter: panic [ thread pid 0 tid 100000 ] Stopped at kdb_enter+0x4c: str xzr, [x19, #1280] db>=20 =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Feb 10 07:44:05 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TX2mN1wQbz598ng for ; Sat, 10 Feb 2024 07:44:20 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pf1-x432.google.com (mail-pf1-x432.google.com [IPv6:2607:f8b0:4864:20::432]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TX2mM5QfXz4NcC for ; Sat, 10 Feb 2024 07:44:19 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; none Received: by mail-pf1-x432.google.com with SMTP id d2e1a72fcca58-6da9c834646so1427394b3a.3 for ; Fri, 09 Feb 2024 23:44:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1707551058; x=1708155858; darn=freebsd.org; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=HSJOYKFo1a32jSc4wwK8fl2EJIgK761ceIJLg+zycAQ=; b=QI9pr2jJ/gdTB2WZy9FlLdRvkfEwpfm/30sCTmOTrgrqDPzEaW/HncLjggLyKVXLX6 FENvrrcfWUpx/OxROa+hUESTjM12paLq6uE3Lx89M9mcLJuYsSl7jaDz6QwcWtpnRU+T +Ae7p6wgdXThH6WQMNX3qlK7SKVQBvg9oAYda2dH9u+9h63HaV/nzvVEITqW1KgGu2Wg JBNm0PYOPqBQD9EBsRbE1UgDGkPf1hPIj4VQNb1NT92iUqJNLWG5M2zxjW6nG6ZwYLPx BbFUuzYdCNMWqubDJyIaoSdShO3ErAIg3ttUcGc0B5Wb9fVgZ2uauUXNI6ZlufeClNEs O84g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707551058; x=1708155858; h=to:references:message-id:content-transfer-encoding:cc:date :in-reply-to:from:subject:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=HSJOYKFo1a32jSc4wwK8fl2EJIgK761ceIJLg+zycAQ=; b=snSWVq1rUSsm3CB4ELwY3iOHVaEJ2sybmtjEoMHddS4xv/lxCRQZcjjBVqNlTwaQLV AatJssNa6Yw+4pVJqnBBpsXoiQqKrU/TgGUlnYyyLPvdPvpQSUc1sSW3o9KPyTAIXR/j 74TkXOnylUQt6QamnjQeqM1KBwYZfCv2RyANxdibcxnway7o37CsJpsc7Yashd8AtiY+ 1EtYpZhekNFS7V1znInQ8w/A9WN5/sHbBwUvwzL9t7TNB5u3ugD78fwWZNxpMk6ZUrd7 1o8/xDiG0WmuwyPF+GN9U/8LR1yQNNizJ0vPkK/7ORZyL1grSxFxJ0DxkZCYjc2xBwGh VGDw== X-Forwarded-Encrypted: i=1; AJvYcCWQb5tv3NPHZR9MJkWkAtp52Z0zaWwn0WO/FAKhr7xAApMpSNc1JnuMaK+ASiEzIs8o2w3MB9A9x0R2Nm+MgyB1XQ36FCmpFx5deS8= X-Gm-Message-State: AOJu0YwxpBW5YkbMuA2keH+EjSc0ssm0U3Z5ZnBEdcp7P1TZBNkPDARk FvXFvSgKzKuA8Z/xGhi9EP+6n1Q2DqNuYCPCJXrgdolZhu6QQ0iyiPa3Dz78aw== X-Google-Smtp-Source: AGHT+IFEEpsbeUgFQ84M7GE8U0ZC8kx7L5FNm6vUl+RekB0hYYqrm1nUtQB6nvHskqlFIOpBvbGJkA== X-Received: by 2002:a05:6a00:1d1f:b0:6de:3b41:2845 with SMTP id a31-20020a056a001d1f00b006de3b412845mr1911346pfx.32.1707551057978; Fri, 09 Feb 2024 23:44:17 -0800 (PST) X-Forwarded-Encrypted: i=1; AJvYcCXz+q7NsJzxIkwrbq+tnIWQbDNdqWJwBBnwq7rk794F5ss+oxskRSCWgl/a+dhF/nbnjQwkm0ruJNeEmReMOScowtc4AOy+uO3mVEieyw2Qssf5PIiAJpBdv68lE3/XcN6iEdaCJ5cnv0PYwSA= Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id g7-20020a62e307000000b006e0978bb895sm1704069pfh.68.2024.02.09.23.44.16 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 09 Feb 2024 23:44:17 -0800 (PST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: Recent commits reject RPi4B booting: pcib0 vs. pcib1 "rman_manage_region: request" leads to panic From: Bakul Shah In-Reply-To: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5@yahoo.com> Date: Fri, 9 Feb 2024 23:44:05 -0800 Cc: FreeBSD ARM List , Current FreeBSD , John Baldwin , Warner Losh Content-Transfer-Encoding: quoted-printable Message-Id: <2FE8FA48-180B-4F0D-BCD8-F7F33053B0F7@iitbombay.org> References: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5.ref@yahoo.com> <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5@yahoo.com> To: Mark Millard X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4TX2mM5QfXz4NcC X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated $ git bisect good b377ff8110e3489eb6e6b920b51a2384dfc4eb0b is the first bad commit > On Feb 9, 2024, at 8:13=E2=80=AFPM, Mark Millard = wrote: >=20 > Summary: >=20 > pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 > pcib0: parsing FDT for ECAM0: > pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 > . . > rman_manage_region: request: start 0x600000000, = end 0x6000fffff > panic: Failed to add resource to rman >=20 >=20 > Detail: >=20 >=20 > . . > pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 > pcib0: parsing FDT for ECAM0: > pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 > pcib0: Bus is not cache-coherent > rman_reserve_resource_bound: request: = [0xfd500000, 0xfd50930f], length 0x9310, flags 100, device pcib0 > rman_reserve_resource_bound: trying 0x1fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x1fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x31bfffff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x33296fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39bf1fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c02fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c06fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c07fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c08fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c2afff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c36fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x39c37fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3b03ffff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3b04ffff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3b2fffff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3ee61fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3ee63fff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0x3fffffff <0xfd500000,0x930f> > rman_reserve_resource_bound: tried 0xfbffffff <0xfd500000,0x930f> > considering [0xfc000000, 0xfd5d1fff] > truncated region: [0xfd500000, 0xfd50930f]; size 0x9310 (requested = 0x9310) > candidate region: [0xfd500000, 0xfd50930f], size 0x9310 > splitting region in three parts: [0xfc000000, 0xfd4fffff]; = [0xfd500000, 0xfd50930f]; [0xfd509310, 0xfd5d1fff] > rman_manage_region: request: start 0xc0000000, end = 0xffffffff > pcib0: hardware identifies as revision 0x304. > pcib0: note: reported link speed is 5.0 GT/s. > rman_reserve_resource_bound: request: [0x51, 0x51], = length 0x1, flags 0, device pcib0 > rman_reserve_resource_bound: trying 0 <0x51,0> > rman_reserve_resource_bound: tried 0 <0x51,0> > rman_reserve_resource_bound: tried 0x1 <0x51,0> > rman_reserve_resource_bound: tried 0x2 <0x51,0> > rman_reserve_resource_bound: tried 0x3 <0x51,0> > rman_reserve_resource_bound: tried 0x4 <0x51,0> > rman_reserve_resource_bound: tried 0x5 <0x51,0> > rman_reserve_resource_bound: tried 0x6 <0x51,0> > rman_reserve_resource_bound: tried 0x7 <0x51,0> > rman_reserve_resource_bound: tried 0xc <0x51,0> > rman_reserve_resource_bound: tried 0xd <0x51,0> > rman_reserve_resource_bound: tried 0xe <0x51,0> > rman_reserve_resource_bound: tried 0xf <0x51,0> > rman_reserve_resource_bound: tried 0x10 <0x51,0> > rman_reserve_resource_bound: tried 0x11 <0x51,0> > rman_reserve_resource_bound: tried 0x12 <0x51,0> > rman_reserve_resource_bound: tried 0x17 <0x51,0> > rman_reserve_resource_bound: tried 0x18 <0x51,0> > rman_reserve_resource_bound: tried 0x1a <0x51,0> > rman_reserve_resource_bound: tried 0x1b <0x51,0> > rman_reserve_resource_bound: tried 0x22 <0x51,0> > rman_reserve_resource_bound: tried 0x23 <0x51,0> > rman_reserve_resource_bound: tried 0x24 <0x51,0> > rman_reserve_resource_bound: tried 0x25 <0x51,0> > rman_reserve_resource_bound: tried 0x26 <0x51,0> > rman_reserve_resource_bound: tried 0x27 <0x51,0> > rman_reserve_resource_bound: tried 0x28 <0x51,0> > rman_reserve_resource_bound: tried 0x29 <0x51,0> > rman_reserve_resource_bound: tried 0x4e <0x51,0> > rman_reserve_resource_bound: tried 0x4f <0x51,0> > considering [0x50, 0xffffffffffffffff] > truncated region: [0x51, 0x51]; size 0x1 (requested 0x1) > candidate region: [0x51, 0x51], size 0x1 > splitting region in three parts: [0x50, 0x50]; [0x51, 0x51]; [0x52, = 0xffffffffffffffff] > pci0: on pcib0 > rman_manage_region: request: start 0, end = 0xff > rman_reserve_resource_bound: request: [0, = 0], length 0x1, flags 0, device pci0 > rman_reserve_resource_bound: trying 0xff <0,0> > considering [0, 0xff] > truncated region: [0, 0]; size 0x1 (requested 0x1) > candidate region: [0, 0], size 0x1 > allocating from the beginning > pci0: domain=3D0, physical bus=3D0 > found-> vendor=3D0x14e4, dev=3D0x2711, revid=3D0x00 > domain=3D0, bus=3D0, slot=3D0, func=3D0 > class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 > cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords) > lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) > intpin=3Da, irq=3D0 > powerspec 3 supports D0 D3 current D0 > secbus=3D1, subbus=3D1 > rman_reserve_resource_bound: request: [0x1, = 0x1], length 0x1, flags 0, device (null) > rman_reserve_resource_bound: trying 0 <0x1,0> > rman_reserve_resource_bound: tried 0 <0x1,0> > considering [0x1, 0xff] > truncated region: [0x1, 0x1]; size 0x1 (requested 0x1) > candidate region: [0x1, 0x1], size 0x1 > allocating from the beginning > pcib1: irq 91 at device 0.0 on pci0 > rman_manage_region: request: start 0x1, end 0x1 > pcib0: rman_reserve_resource: start=3D0xc0000000, end=3D0xc00fffff, = count=3D0x100000 > rman_reserve_resource_bound: request: [0xc0000000, = 0xc00fffff], length 0x100000, flags 102, device pcib1 > rman_reserve_resource_bound: trying 0xffffffff <0xc0000000,0xfffff> > considering [0xc0000000, 0xffffffff] > truncated region: [0xc0000000, 0xc00fffff]; size 0x100000 (requested = 0x100000) > candidate region: [0xc0000000, 0xc00fffff], size 0x100000 > allocating from the beginning > rman_manage_region: request: start 0x600000000, = end 0x6000fffff > panic: Failed to add resource to rman > cpuid =3D 0 > time =3D 1 > KDB: stack backtrace: > db_trace_self() at db_trace_self > db_trace_self_wrapper() at db_trace_self_wrapper+0x38 > vpanic() at vpanic+0x1a4 > panic() at panic+0x48 > pcib_add_window_resources() at pcib_add_window_resources+0xf4 > pcib_alloc_window() at pcib_alloc_window+0xfc > pcib_attach_common() at pcib_attach_common+0xa18 > pcib_attach() at pcib_attach+0x14 > device_attach() at device_attach+0x3fc > device_probe_and_attach() at device_probe_and_attach+0x80 > bus_generic_attach() at bus_generic_attach+0x1c > pci_attach() at pci_attach+0xec > device_attach() at device_attach+0x3fc > device_probe_and_attach() at device_probe_and_attach+0x80 > bus_generic_attach() at bus_generic_attach+0x1c > device_attach() at device_attach+0x3fc > device_probe_and_attach() at device_probe_and_attach+0x80 > bus_generic_new_pass() at bus_generic_new_pass+0x100 > bus_generic_new_pass() at bus_generic_new_pass+0xb0 > bus_generic_new_pass() at bus_generic_new_pass+0xb0 > bus_generic_new_pass() at bus_generic_new_pass+0xb0 > bus_set_pass() at bus_set_pass+0x50 > mi_startup() at mi_startup+0x1e0 > virtdone() at virtdone+0x68 > KDB: enter: panic > [ thread pid 0 tid 100000 ] > Stopped at kdb_enter+0x4c: str xzr, [x19, #1280] > db>=20 >=20 > =3D=3D=3D > Mark Millard > marklmi at yahoo.com >=20 >=20 From nobody Sat Feb 10 18:04:37 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXJXJ5FRCz5B5BL for ; Sat, 10 Feb 2024 18:04:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXJXJ2T25z46S2 for ; Sat, 10 Feb 2024 18:04:48 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707588286; bh=xGS15oMLb2rtIa1Yj3Bz7vwb9dBukxQZXzwgAcP3UyY=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=K5pG3E9bIWqQ8zfpSEryCGWRUPVjGWVgWgKLduOJrvIqfdHI+l+RQIFWcLBLhc/T8Rw1j7qTHBPNrzxgbmf1G6ATa0qPpG+BbalMnTrpOTWUscGX6TQJrjOSHm4Z2ha+RYj2aGV2/ROcgOvKnKPpfjby9x6zve2qI7orfRoFafEd0gnu21autK3B5AU4U0cFeE+itgt/Qhqzjxe+YpoY/CNwblHAQb6hdFwidY/3SBn6NWuZ4XOTb/59551DqIyH+5NIZsBjyw2rdYZBdteqYrtgLtS+MtZstyavZ9EBcNRSMhpFDRv2bnNe6oFMYZHOT4Mbc+71Riz2gYiJYH7+vw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707588286; bh=8RsQZoTKgzLptUqWGDWP8eSZkkTNqY4PV7Ijg/EEypN=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=VnD9EcZaaVFdsYIEeO7DRo+/GLq+0uDfdeo0fiVxfVcu0tFRuXo0/PT0aFLCT8LSreE87ITVJbgrsneXAhUcffwM4ZbkSzw68H5S/eAk40BbR+MslbCxHNM3/25F8UH4ZM9rTZgcLtgIABu/0I9x9V4GudxvtBjysNwUTVSgR/kZkIWX8swx8jpkL216cWCbEVcom2qlo2eOhaOqGDyQY3r+Z2ouaOgcTbLjuVLdJ/+qmSWkCKXpXxmYK7g6KwChXMHE2lfteLOhO/GwvG53/BoArhvZVp7ke3TMfEzFZul4GOTb9L+NPA13kctRljeyilEffMOBEuqFHDHNbVBdFg== X-YMail-OSG: CcQ.E5YVM1mLaHHxU2JSyflw4fwVWhhq8C7TiDS_.h7DhQgf7huedUV_YlXGmVb RCjI39x7ngXt03dtB2SkeU3Wj8HaeRH3jAuBRZs.8eolYuQtpA8CRBYsb32zN2COFsFqECQdU5gz AKOPs3G6sB0d7CWD1.AhrBFYdufrAexfjQ_53XZUmW74Cs4K0rFDsmWg9FlFaftOoAB.EFO2vSCe W4n3li8LkOJzLzkhhrM7szX3FKF_ZBRjnq.s12.FPbzOwE5Lcn5M5f4Zs6YQswoAQDbEN.xzaY1i Q6JcBimXOqk1T.L9TFFOrL4rexwoMc11oNJ_tXIps8X9AiTW.B1e7KfJPSpP72gPboRCvxo7O1mJ w2NlW6z4u.Y.nbtoWbu.3T5bNVHe_vHaomiShymQjgJJ1_LUraT5zd.QVVBh4X1hmOJ4wbVxVXJp DvfMzSyBy_dyahz7rh.R1znOOdb7iqL1UkbMA7qCg6MkbNSYP5a4HUtNdmBXOtuR0_op59MMpXXj 7kO_2NPYei_ZFQyUpRLN.VJ2BY.MTm03PegTazBWueQzRfNSfTcqT1T2xjlmsu_FovTTH88xK2sJ RUIKSW39T6UfXtDhBJL5gSLRNuqz_ukSxCosG0Th9lDW7e..Lw0LNXpxPr4VqyIiPxjjH7iSaPvf AcwNHDvO.39FlOwdPEn.qfsLBASCWh8mDgDuIia1dkSCNIfPzF._ceDGDEEYW1ToK_GGR3htwFlk ig9zmHRIdrlqU6HbTVilvQsa9FkJv.OyLrM.cspVs2WXLRlPYqZduzDu33NTs5V2D9OEvBXe.aeD Eb4WFgh9MPmlYPnwD3ETITnrB1oUAutHsQsPomIWVmuxE.GHXCYkR3bhwzRDuHcbiQJp6T7GdWsX Xbb1tnfJvVmBQl.m.chxztcCrNrGUq7kFy2vaTiYelzKVLwcEs5JFb.xDssnbHYhPH9rBipQ8.Ck NmcXrA7g.2XBqKcyvcm7rwdMstCYx_sviOU.asYoIqpRJ3NK8eXWJPoKvP4P3jwZncdvwS0kbu3y 5PBRDEye4on5Ci_tJZDX6VOPnyMBgKdAeazdARj1kJUUESu7HBpJx9IhN1kDKqZmcTD6ZF5n7sau nLkDjI3VI_YJXspdYKHOCZC1TntQy8YILDp73KYy8jT_cPcrOTJ3iw3mhszvI4v8hUvazurtibk5 n3cW10vvEbVxLzwFClS4INQXPADXHeM69HHTcgUveme6dM12c8C_2G_MgVmbH2hNFFATyF72pwxo oxaNA_gMkfxLyxAEP7joUFMmqqggyzrD5osq5jxPnnoU5oWn84Hwgg8sgOtyM_ow_1AihlCD858q BHEXjozn1Yw66V4xUlXYhzPeG_HV15_.xrPL_7JS2I_Ek9D1jkSFrlPyitAaFmHyPSh2u9wybERu njdisingOkWuOpYVAMA_6r4y6Fzhd1e6uiogkp_wJBusOh6FVOMFCveV1Qhd8U64JFuR6MxA9zrH sRbEzQkpkoIWuQcX9SX.RkQi_N4c7J_ipDsM3J1yx9_e7R.uSNbVncvBucvLUXwe_TQV9w4lmsee Z0ckwxRCVUDmNL.Db4sqeB2iBzgTjJct5ENhTdF6PXDzUnKgkWJ9d0rk3aTvjFPEY61DJR8N7AF9 ma6KCOapr1uCmdez5puuU8VV6tQ1KD55k1fiPaOEAUHe5fuIJvkShB7GdhKbnLhk4VuBuEcB8q.f BmX32bX6f8GR9MpD6y_Vjl9.T9LRg_MBA4PvUp1Z6yeizuKRWKvcPqSbhyHP94jJA4J4GeuDoQ3Q VC8zrBJiUPKjHVqi9vqr.A9729PHnqQBBibv7gyV6uEnG6nJCKEv1lYOziqZNU3p6M6DQ23rn2Br _RPyXO0KsWxi7f2OIyuyUByfaQ6QS2B58HtXJXivnpTh71bvs1di2AdsjeWUtUTGGOgoiHotlgsA pAjiCjuj4zPZ7gSB2ff.rP8KUTmIS9oEq0p_waPTz1QgPPUKK3XvT83ekVADRzdUW9YTGnIq2c_j AmVr0VxZUq3zrL1VueE8v_37wjuqlhbCOpdXxlCxt1CDpukzxyOWIxW1Y4D00.Y3MiMWRJTvZKuH 1fMBDu2PFPrjW6KukUd0Kkp_FF8uhkt3jp1sGCMTe8CDS5WsTbkFmB4eS.dIhd1cjQyF5g0PMAPa hUCn05scBkpNSY60NqBXmdfaLfyS85AGzC0i9bNJTMpXZKVXfo2WxBRTl9wssvvJd.Hx99G6777h yH7qRqp2g9tv7JyTTYTn_txhkuYLdfC.0g3qLbIAWovEVO55RtrlixhRISom.uox9xcRhrAHZ3El oMoMqn309ptC4CmtXO4fOpmvfRLjF3w-- X-Sonic-MF: X-Sonic-ID: 39b70c62-a369-4f96-ba36-4172a0d5de37 Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Sat, 10 Feb 2024 18:04:46 +0000 Received: by hermes--production-gq1-5c57879fdf-8lthq (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 582860a2ede8cd9f4e7dedbc5f423cf3; Sat, 10 Feb 2024 18:04:40 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: Recent commits reject RPi4B booting: pcib0 vs. pcib1 "rman_manage_region: request" leads to panic From: Mark Millard In-Reply-To: <2FE8FA48-180B-4F0D-BCD8-F7F33053B0F7@iitbombay.org> Date: Sat, 10 Feb 2024 10:04:37 -0800 Cc: John Baldwin , Warner Losh , Bakul Shah Content-Transfer-Encoding: quoted-printable Message-Id: <986D2CD6-6241-4EBE-8BD2-9821AB693BA7@yahoo.com> References: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5.ref@yahoo.com> <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5@yahoo.com> <2FE8FA48-180B-4F0D-BCD8-F7F33053B0F7@iitbombay.org> To: FreeBSD ARM List , Current FreeBSD X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4TXJXJ2T25z46S2 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated On Feb 9, 2024, at 23:44, Bakul Shah wrote: > $ git bisect good > b377ff8110e3489eb6e6b920b51a2384dfc4eb0b is the first bad commit >=20 >> On Feb 9, 2024, at 8:13=E2=80=AFPM, Mark Millard = wrote: >>=20 >> Summary: >>=20 >> pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 >> pcib0: parsing FDT for ECAM0: >> pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 >> . . >> rman_manage_region: request: start 0x600000000, = end 0x6000fffff >> panic: Failed to add resource to rman >>=20 >>=20 >> Detail: >>=20 >>=20 >> . . >> pcib0: mem = 0x7d500000-0x7d50930f irq 80,81 on simplebus2 >> pcib0: parsing FDT for ECAM0: >> pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >> pcib0: Bus is not cache-coherent >> rman_reserve_resource_bound: request: = [0xfd500000, 0xfd50930f], length 0x9310, flags 100, device pcib0 >> rman_reserve_resource_bound: trying 0x1fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x1fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x31bfffff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x33296fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39bf1fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c02fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c06fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c07fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c08fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c2afff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c36fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x39c37fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3b03ffff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3b04ffff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3b2fffff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3ee61fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3ee63fff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0x3fffffff <0xfd500000,0x930f> >> rman_reserve_resource_bound: tried 0xfbffffff <0xfd500000,0x930f> >> considering [0xfc000000, 0xfd5d1fff] >> truncated region: [0xfd500000, 0xfd50930f]; size 0x9310 (requested = 0x9310) >> candidate region: [0xfd500000, 0xfd50930f], size 0x9310 >> splitting region in three parts: [0xfc000000, 0xfd4fffff]; = [0xfd500000, 0xfd50930f]; [0xfd509310, 0xfd5d1fff] >> rman_manage_region: request: start 0xc0000000, end = 0xffffffff >> pcib0: hardware identifies as revision 0x304. >> pcib0: note: reported link speed is 5.0 GT/s. >> rman_reserve_resource_bound: request: [0x51, 0x51], = length 0x1, flags 0, device pcib0 >> rman_reserve_resource_bound: trying 0 <0x51,0> >> rman_reserve_resource_bound: tried 0 <0x51,0> >> rman_reserve_resource_bound: tried 0x1 <0x51,0> >> rman_reserve_resource_bound: tried 0x2 <0x51,0> >> rman_reserve_resource_bound: tried 0x3 <0x51,0> >> rman_reserve_resource_bound: tried 0x4 <0x51,0> >> rman_reserve_resource_bound: tried 0x5 <0x51,0> >> rman_reserve_resource_bound: tried 0x6 <0x51,0> >> rman_reserve_resource_bound: tried 0x7 <0x51,0> >> rman_reserve_resource_bound: tried 0xc <0x51,0> >> rman_reserve_resource_bound: tried 0xd <0x51,0> >> rman_reserve_resource_bound: tried 0xe <0x51,0> >> rman_reserve_resource_bound: tried 0xf <0x51,0> >> rman_reserve_resource_bound: tried 0x10 <0x51,0> >> rman_reserve_resource_bound: tried 0x11 <0x51,0> >> rman_reserve_resource_bound: tried 0x12 <0x51,0> >> rman_reserve_resource_bound: tried 0x17 <0x51,0> >> rman_reserve_resource_bound: tried 0x18 <0x51,0> >> rman_reserve_resource_bound: tried 0x1a <0x51,0> >> rman_reserve_resource_bound: tried 0x1b <0x51,0> >> rman_reserve_resource_bound: tried 0x22 <0x51,0> >> rman_reserve_resource_bound: tried 0x23 <0x51,0> >> rman_reserve_resource_bound: tried 0x24 <0x51,0> >> rman_reserve_resource_bound: tried 0x25 <0x51,0> >> rman_reserve_resource_bound: tried 0x26 <0x51,0> >> rman_reserve_resource_bound: tried 0x27 <0x51,0> >> rman_reserve_resource_bound: tried 0x28 <0x51,0> >> rman_reserve_resource_bound: tried 0x29 <0x51,0> >> rman_reserve_resource_bound: tried 0x4e <0x51,0> >> rman_reserve_resource_bound: tried 0x4f <0x51,0> >> considering [0x50, 0xffffffffffffffff] >> truncated region: [0x51, 0x51]; size 0x1 (requested 0x1) >> candidate region: [0x51, 0x51], size 0x1 >> splitting region in three parts: [0x50, 0x50]; [0x51, 0x51]; [0x52, = 0xffffffffffffffff] >> pci0: on pcib0 >> rman_manage_region: request: start 0, end = 0xff >> rman_reserve_resource_bound: request: [0, = 0], length 0x1, flags 0, device pci0 >> rman_reserve_resource_bound: trying 0xff <0,0> >> considering [0, 0xff] >> truncated region: [0, 0]; size 0x1 (requested 0x1) >> candidate region: [0, 0], size 0x1 >> allocating from the beginning >> pci0: domain=3D0, physical bus=3D0 >> found-> vendor=3D0x14e4, dev=3D0x2711, revid=3D0x00 >> domain=3D0, bus=3D0, slot=3D0, func=3D0 >> class=3D06-04-00, hdrtype=3D0x01, mfdev=3D0 >> cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords) >> lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 ns) >> intpin=3Da, irq=3D0 >> powerspec 3 supports D0 D3 current D0 >> secbus=3D1, subbus=3D1 >> rman_reserve_resource_bound: request: = [0x1, 0x1], length 0x1, flags 0, device (null) >> rman_reserve_resource_bound: trying 0 <0x1,0> >> rman_reserve_resource_bound: tried 0 <0x1,0> >> considering [0x1, 0xff] >> truncated region: [0x1, 0x1]; size 0x1 (requested 0x1) >> candidate region: [0x1, 0x1], size 0x1 >> allocating from the beginning >> pcib1: irq 91 at device 0.0 on pci0 Looking at an old log shows that the next normal output was: pcib0: rman_reserve_resource: start=3D0xc0000000, end=3D0xc00fffff, = count=3D0x100000 and somewhat later there was: pcib1: allocated memory range (0xc0000000-0xc0000fff) for rid 10 of = bcm_xhci0 I'll give more text at the end of this message. Basically the sequence is assocaited with xhci0. The count=3D0x100000 looks to be from the reg for xhci@7e9c0000. scb { compatible =3D "simple-bus"; #address-cells =3D <0x00000002>; #size-cells =3D <0x00000002>; ranges =3D <0x00000000 0x7c000000 0x00000000 0xfc000000 = 0x00000000 0x03800000 0x00000000 0x40000000 0x00000000 0xff800000 = 0x00000000 0x00800000 0x00000006 0x00000000 0x00000006 0x00000000 = 0x00000000 0x40000000 0x00000000 0x00000000 0x00000000 0x00000000 = 0x00000000 0xfc000000>; dma-ranges =3D <0x00000000 0x00000000 0x00000000 = 0x00000000 0x00000004 0x00000000>; phandle =3D <0x000000d6>; pcie@7d500000 { compatible =3D "brcm,bcm2711-pcie", = "brcm,bcm7445-pcie"; reg =3D <0x00000000 0x7d500000 0x00000000 = 0x00009310>; device_type =3D "pci"; #address-cells =3D <0x00000003>; #interrupt-cells =3D <0x00000001>; #size-cells =3D <0x00000002>; interrupts =3D <0x00000000 0x00000094 0x00000004 = 0x00000000 0x00000094 0x00000004>; interrupt-names =3D "pcie", "msi"; interrupt-map-mask =3D <0x00000000 0x00000000 = 0x00000000 0x00000007>; interrupt-map =3D <0x00000000 0x00000000 = 0x00000000 0x00000001 0x00000001 0x00000000 0x0000008f 0x00000004>; msi-controller; msi-parent =3D <0x0000002c>; ranges =3D <0x02000000 0x00000000 0xc0000000 = 0x00000006 0x00000000 0x00000000 0x40000000>; dma-ranges =3D <0x02000000 0x00000004 0x00000000 = 0x00000000 0x00000000 0x00000002 0x00000000>; brcm,enable-ssc; phandle =3D <0x0000002c>; pci@1,0 { #address-cells =3D <0x00000003>; #size-cells =3D <0x00000002>; ranges; reg =3D <0x00000000 0x00000000 = 0x00000000 0x00000000 0x00000000>; usb@1,0 { reg =3D <0x00010000 0x00000000 = 0x00000000 0x00000000 0x00000000>; resets =3D <0x0000002d = 0x00000000>; }; }; }; . . . xhci@7e9c0000 { compatible =3D "generic-xhci"; status =3D "disabled"; reg =3D <0x00000000 0x7e9c0000 0x00000000 = 0x00100000>; interrupts =3D <0x00000000 0x000000b0 = 0x00000004>; power-domains =3D <0x00000013 0x00000006>; phandle =3D <0x000000d9>; }; Note the lack of nesting of xhci@7e9c0000 relative to pcie@7d50000 . >> rman_manage_region: request: start 0x1, end 0x1 >> pcib0: rman_reserve_resource: start=3D0xc0000000, end=3D0xc00fffff, = count=3D0x100000 >> rman_reserve_resource_bound: request: [0xc0000000, = 0xc00fffff], length 0x100000, flags 102, device pcib1 >> rman_reserve_resource_bound: trying 0xffffffff <0xc0000000,0xfffff> >> considering [0xc0000000, 0xffffffff] >> truncated region: [0xc0000000, 0xc00fffff]; size 0x100000 (requested = 0x100000) >> candidate region: [0xc0000000, 0xc00fffff], size 0x100000 >> allocating from the beginning >> rman_manage_region: request: start 0x600000000, = end 0x6000fffff >> panic: Failed to add resource to rman >> cpuid =3D 0 >> time =3D 1 >> KDB: stack backtrace: >> db_trace_self() at db_trace_self >> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >> vpanic() at vpanic+0x1a4 >> panic() at panic+0x48 >> pcib_add_window_resources() at pcib_add_window_resources+0xf4 >> pcib_alloc_window() at pcib_alloc_window+0xfc >> pcib_attach_common() at pcib_attach_common+0xa18 >> pcib_attach() at pcib_attach+0x14 >> device_attach() at device_attach+0x3fc >> device_probe_and_attach() at device_probe_and_attach+0x80 >> bus_generic_attach() at bus_generic_attach+0x1c >> pci_attach() at pci_attach+0xec >> device_attach() at device_attach+0x3fc >> device_probe_and_attach() at device_probe_and_attach+0x80 >> bus_generic_attach() at bus_generic_attach+0x1c >> device_attach() at device_attach+0x3fc >> device_probe_and_attach() at device_probe_and_attach+0x80 >> bus_generic_new_pass() at bus_generic_new_pass+0x100 >> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >> bus_set_pass() at bus_set_pass+0x50 >> mi_startup() at mi_startup+0x1e0 >> virtdone() at virtdone+0x68 >> KDB: enter: panic >> [ thread pid 0 tid 100000 ] >> Stopped at kdb_enter+0x4c: str xzr, [x19, #1280] >> db> >=20 >=20 For reference from an old log: pcib1: irq 91 at device 0.0 on pci0 pcib0: rman_reserve_resource: start=3D0xc0000000, end=3D0xc00fffff, = count=3D0x100000 pcib1: domain 0 pcib1: secondary bus 1 pcib1: subordinate bus 1 pcib1: memory decode 0xc0000000-0xc00fffff pci1: on pcib1 pcib1: allocated bus range (1-1) for rid 0 of pci1 pci1: domain=3D0, physical bus=3D1 found-> vendor=3D0x1106, dev=3D0x3483, revid=3D0x01 domain=3D0, bus=3D1, slot=3D0, func=3D0 class=3D0c-03-30, hdrtype=3D0x00, mfdev=3D0 cmdreg=3D0x0000, statreg=3D0x0010, cachelnsz=3D0 (dwords) lattimer=3D0x00 (0 ns), mingnt=3D0x00 (0 ns), maxlat=3D0x00 (0 = ns) intpin=3Da, irq=3D0 powerspec 3 supports D0 D3 current D0 MSI supports 4 messages, 64 bit map[10]: type Memory, range 64, base 0, size 12, memory disabled pcib1: slot 0 INTA is routed to irq 92 bcm_xhci0: irq 92 at = device 0.0 on pci1 bcm_xhci0: note: xhci firmware not found. bcm_xhci0: note: installing xhci firmware. bcm_xhci0: note: xhci firmware detected; firmware is revision 138a1. pcib1: allocated memory range (0xc0000000-0xc0000fff) for rid 10 of = bcm_xhci0 bcm_xhci0: Lazy allocation of 0x1000 bytes rid 0x10 type 3 at 0xc0000000 bcm_xhci0: 32 bytes context size, 64-bit DMA bcm_xhci0: attempting to allocate 1 MSI vectors (4 supported) bcm_xhci0: using IRQ 93 for MSI bcm_xhci0: MSI enabled bcm_xhci0: (New XHCI DeviceId=3D0x34831106) usbus0 on bcm_xhci0 bcm_xhci0: usbpf: Attached =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sat Feb 10 22:09:20 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXPyX0TTwz5BSS0; Sat, 10 Feb 2024 22:09:24 +0000 (UTC) (envelope-from imb@protected-networks.net) Received: from mail.protected-networks.net (mail.protected-networks.net [IPv6:2001:470:8d59:1::8]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.protected-networks.net", Issuer "R3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXPyW0sY6z4hWH; Sat, 10 Feb 2024 22:09:23 +0000 (UTC) (envelope-from imb@protected-networks.net) Authentication-Results: mx1.freebsd.org; none Received: from [IPV6:2600:4040:53d9:8200:f21f:afff:fe66:957e] (unknown [IPv6:2600:4040:53d9:8200:f21f:afff:fe66:957e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: imb@mail.protected-networks.net) by mail.protected-networks.net (Postfix) with ESMTPSA id B6B0F6E626; Sat, 10 Feb 2024 17:09:21 -0500 (EST) Message-ID: Date: Sat, 10 Feb 2024 17:09:20 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird From: Michael Butler Subject: Re: Recent commits reject RPi4B booting: pcib0 vs. pcib1 "rman_manage_region: request" leads to panic To: Mark Millard , FreeBSD ARM List , Current FreeBSD Cc: John Baldwin , Warner Losh , Bakul Shah References: <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5.ref@yahoo.com> <76AB969F-5BC5-4116-8AF4-3ED2CABEBBA5@yahoo.com> <2FE8FA48-180B-4F0D-BCD8-F7F33053B0F7@iitbombay.org> <986D2CD6-6241-4EBE-8BD2-9821AB693BA7@yahoo.com> Content-Language: en-NZ Autocrypt: addr=imb@protected-networks.net; keydata= xsDiBETHZAURBACJicNaIbVVVZahtQcdJeogtTLjCYAdj4kFMpy6Y3Ac19UNWDM+TrD4yFPi 5nc/pp9M/5Q4RNBr6a97fTYroTaq+vDwWdklOHwD2ZXs7FqwWOtVSIPT/rev5fUvwEF2VFYE sNDbpE5HHpP/oFUw5scEJZVyOBJSGvYb1IhV55NWswCgzkUGbG8A3s+oZXkHqTCYGW/seukD +wTo/L835xLpbTJxoxEKeGA3aWifSsRvpWWHyXye6sTkSN3SmtE9A8Pqmdb1dBEO0eOms6GD RamvCFgdvg2HesAv9l7L/7Mm9iKJs6uTAa+taIQslpumGh4PRc94IepVFzAa4Ef/FA4mWx9w P/EqNsKUPE2U5HI1decbopkxH/d/A/9Hupc10lPsXVMACd54/YZRsSTTcArheekm8qE/f8Hl 1Q7At+yuFgfMll4QPAhefnrLUanXF1bWtxG5PmaJktDYp3HOmy43giZgacgt+a3TVd6vu8Gs DnI4FOfYllq7mZFezMIulCWUYtnkMEXEeyzp39dygi7blPIjckWlQ2sc380rTWljaGFlbCBC dXRsZXIgPGltYkBwcm90ZWN0ZWQtbmV0d29ya3MubmV0PsJgBBMRAgAgBQJEx2QFAhsDBgsJ CAcDAgQVAggDBBYCAwECHgECF4AACgkQQv9rrgRC1JL7mgCdEnPeo22kqT/bES+D78QSGhNR r8cAn2xOMeu6pBrc2tDY8Ky/70HBctmjzsFNBETHZA4QCACKbm/PMn4QcyDEvIn4MF+t2E1A zgiBAkPCMtWT1CcqeUj13OwNM8qJD/mBWjCZCnr1hKVbvzOmgKaM4uDCWIcSCdoDTJx1DqMx abr+EpHz1fL6aagEOKHz5sCYOkDXt3zzZ/5RBMdkEJwunXYtAbu5e68oty+d0DFzAM3pBp6l GC0TE3VutmFR/KK66rf0KB83YQBf/IAtyqsRIQPP9t0SLfJ+kqKXf73nvAUFEtb21gZSzhTm QP87QKyQvenE8o4PQ2tEslq2jICB7pGcqIrwP4o3Hl4V+HXi3lA26MMJ5rakQB2sKKWroPVQ BiRXO+W8Qf+0oQFq38oMXR5sPOs/AAMFB/sEKcjzvkwviZOsDElthxtgrmqUNKC9G/4Fw0tK k6fMynv+bcKz85k2uWOIfefUKBFoQ0SCphU4jquJENqqy6BPTkXePlIJok2/GkF7xtHm2FPq tTTuYmoBrGsls28Z9dn2LcBwFHz59SSWM9JFPIvFr9HCkKtp6zPUsJd5b02+0wgzDubTMQS9 M2LwGSh9xK6xl4MGgngl22b0TZDh5qHwmsywOX6SbGsQfeNpkptJ4gPjShypusFyF+pevnCM wTfUPCBd/AFbu2fHFQjA8sgkr5IqXuc4PoiIBXc9upoFpDqGkYssAKbzGcRsK94a8hRROJV9 bzPyYempIWaPXr2EwkkEGBECAAkFAkTHZA4CGwwACgkQQv9rrgRC1JKqhwCeOov6gTo8eWte es3gbLr2n2b5AXMAoItSlajet574lkouzY3u3scSRfiE In-Reply-To: <986D2CD6-6241-4EBE-8BD2-9821AB693BA7@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:6939, ipnet:2001:470::/32, country:US] X-Rspamd-Queue-Id: 4TXPyW0sY6z4hWH X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated I have stability problems with anything at or after this commit (b377ff8) on an amd64 laptop. While I see the following panic logged, no crash dump is preserved :-( It happens after ~5-6 minutes running in KDE (X). Reverting to 36efc64 seems to work reliably (after ACPI changes but before the problematic PCI one) kernel: Fatal trap 12: page fault while in kernel mode kernel: cpuid = 2; apic id = 02 kernel: fault virtual address = 0x48 kernel: fault code = supervisor read data, page not present kernel: instruction pointer = 0x20:0xffffffff80acb962 kernel: stack pointer = 0x28:0xfffffe00c4318d80 kernel: frame pointer = 0x28:0xfffffe00c4318d80 kernel: code segment = base 0x0, limit 0xfffff, type 0x1b kernel: = DPL 0, pres 1, long 1, def32 0, gran 1 kernel: processor eflags = interrupt enabled, resume, IOPL = 0 kernel: current process = 2 (clock (0)) kernel: rdi: fffff802e460c000 rsi: 0000000000000000 rdx: 0000000000000002 kernel: rcx: 0000000000000000 r8: 000000000000001e r9: fffffe00c4319000 kernel: rax: 0000000000000002 rbx: fffff802e460c000 rbp: fffffe00c4318d80 kernel: r10: 0000000000001388 r11: 000000007ffc765d r12: 000f000000000000 kernel: r13: 0002000000000000 r14: fffff8000193e740 r15: 0000000000000000 kernel: trap number = 12 kernel: panic: page fault kernel: cpuid = 2 kernel: time = 1707573802 kernel: Uptime: 6m19s kernel: Dumping 942 out of 16242 MB:..2%..11%..21%..31%..41%..51%..62%..72%..82%..92% kernel: Dump complete kernel: Automatic reboot in 15 seconds - press a key on the console to abort On 2/10/24 13:04, Mark Millard wrote: > > > On Feb 9, 2024, at 23:44, Bakul Shah wrote: > >> $ git bisect good >> b377ff8110e3489eb6e6b920b51a2384dfc4eb0b is the first bad commit >> >>> On Feb 9, 2024, at 8:13 PM, Mark Millard wrote: >>> >>> Summary: >>> >>> pcib0: mem 0x7d500000-0x7d50930f irq 80,81 on simplebus2 >>> pcib0: parsing FDT for ECAM0: >>> pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 >>> . . >>> rman_manage_region: request: start 0x600000000, end 0x6000fffff >>> panic: Failed to add resource to rman >>> >>> >>> Detail: >>> >>> >>> . . >>> pcib0: mem 0x7d500000-0x7d50930f irq 80,81 on simplebus2 >>> pcib0: parsing FDT for ECAM0: >>> pcib0: PCI addr: 0xc0000000, CPU addr: 0x600000000, Size: 0x40000000 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: PCI addr: 0x0, CPU addr: 0x0, Size: 0x0 >>> pcib0: Bus is not cache-coherent >>> rman_reserve_resource_bound: request: [0xfd500000, 0xfd50930f], length 0x9310, flags 100, device pcib0 >>> rman_reserve_resource_bound: trying 0x1fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x1fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x31bfffff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x33296fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39bf1fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c02fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c06fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c07fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c08fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c2afff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c36fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x39c37fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3b03ffff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3b04ffff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3b2fffff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3ee61fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3ee63fff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0x3fffffff <0xfd500000,0x930f> >>> rman_reserve_resource_bound: tried 0xfbffffff <0xfd500000,0x930f> >>> considering [0xfc000000, 0xfd5d1fff] >>> truncated region: [0xfd500000, 0xfd50930f]; size 0x9310 (requested 0x9310) >>> candidate region: [0xfd500000, 0xfd50930f], size 0x9310 >>> splitting region in three parts: [0xfc000000, 0xfd4fffff]; [0xfd500000, 0xfd50930f]; [0xfd509310, 0xfd5d1fff] >>> rman_manage_region: request: start 0xc0000000, end 0xffffffff >>> pcib0: hardware identifies as revision 0x304. >>> pcib0: note: reported link speed is 5.0 GT/s. >>> rman_reserve_resource_bound: request: [0x51, 0x51], length 0x1, flags 0, device pcib0 >>> rman_reserve_resource_bound: trying 0 <0x51,0> >>> rman_reserve_resource_bound: tried 0 <0x51,0> >>> rman_reserve_resource_bound: tried 0x1 <0x51,0> >>> rman_reserve_resource_bound: tried 0x2 <0x51,0> >>> rman_reserve_resource_bound: tried 0x3 <0x51,0> >>> rman_reserve_resource_bound: tried 0x4 <0x51,0> >>> rman_reserve_resource_bound: tried 0x5 <0x51,0> >>> rman_reserve_resource_bound: tried 0x6 <0x51,0> >>> rman_reserve_resource_bound: tried 0x7 <0x51,0> >>> rman_reserve_resource_bound: tried 0xc <0x51,0> >>> rman_reserve_resource_bound: tried 0xd <0x51,0> >>> rman_reserve_resource_bound: tried 0xe <0x51,0> >>> rman_reserve_resource_bound: tried 0xf <0x51,0> >>> rman_reserve_resource_bound: tried 0x10 <0x51,0> >>> rman_reserve_resource_bound: tried 0x11 <0x51,0> >>> rman_reserve_resource_bound: tried 0x12 <0x51,0> >>> rman_reserve_resource_bound: tried 0x17 <0x51,0> >>> rman_reserve_resource_bound: tried 0x18 <0x51,0> >>> rman_reserve_resource_bound: tried 0x1a <0x51,0> >>> rman_reserve_resource_bound: tried 0x1b <0x51,0> >>> rman_reserve_resource_bound: tried 0x22 <0x51,0> >>> rman_reserve_resource_bound: tried 0x23 <0x51,0> >>> rman_reserve_resource_bound: tried 0x24 <0x51,0> >>> rman_reserve_resource_bound: tried 0x25 <0x51,0> >>> rman_reserve_resource_bound: tried 0x26 <0x51,0> >>> rman_reserve_resource_bound: tried 0x27 <0x51,0> >>> rman_reserve_resource_bound: tried 0x28 <0x51,0> >>> rman_reserve_resource_bound: tried 0x29 <0x51,0> >>> rman_reserve_resource_bound: tried 0x4e <0x51,0> >>> rman_reserve_resource_bound: tried 0x4f <0x51,0> >>> considering [0x50, 0xffffffffffffffff] >>> truncated region: [0x51, 0x51]; size 0x1 (requested 0x1) >>> candidate region: [0x51, 0x51], size 0x1 >>> splitting region in three parts: [0x50, 0x50]; [0x51, 0x51]; [0x52, 0xffffffffffffffff] >>> pci0: on pcib0 >>> rman_manage_region: request: start 0, end 0xff >>> rman_reserve_resource_bound: request: [0, 0], length 0x1, flags 0, device pci0 >>> rman_reserve_resource_bound: trying 0xff <0,0> >>> considering [0, 0xff] >>> truncated region: [0, 0]; size 0x1 (requested 0x1) >>> candidate region: [0, 0], size 0x1 >>> allocating from the beginning >>> pci0: domain=0, physical bus=0 >>> found-> vendor=0x14e4, dev=0x2711, revid=0x00 >>> domain=0, bus=0, slot=0, func=0 >>> class=06-04-00, hdrtype=0x01, mfdev=0 >>> cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) >>> lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) >>> intpin=a, irq=0 >>> powerspec 3 supports D0 D3 current D0 >>> secbus=1, subbus=1 >>> rman_reserve_resource_bound: request: [0x1, 0x1], length 0x1, flags 0, device (null) >>> rman_reserve_resource_bound: trying 0 <0x1,0> >>> rman_reserve_resource_bound: tried 0 <0x1,0> >>> considering [0x1, 0xff] >>> truncated region: [0x1, 0x1]; size 0x1 (requested 0x1) >>> candidate region: [0x1, 0x1], size 0x1 >>> allocating from the beginning >>> pcib1: irq 91 at device 0.0 on pci0 > > Looking at an old log shows that the next normal output was: > > pcib0: rman_reserve_resource: start=0xc0000000, end=0xc00fffff, count=0x100000 > > and somewhat later there was: > > pcib1: allocated memory range (0xc0000000-0xc0000fff) for rid 10 of bcm_xhci0 > > I'll give more text at the end of this message. Basically the > sequence is assocaited with xhci0. The count=0x100000 looks > to be from the reg for xhci@7e9c0000. > > scb { > compatible = "simple-bus"; > #address-cells = <0x00000002>; > #size-cells = <0x00000002>; > ranges = <0x00000000 0x7c000000 0x00000000 0xfc000000 0x00000000 0x03800000 0x00000000 0x40000000 0x00000000 0xff800000 0x00000000 0x00800000 0x00000006 0x00000000 0x00000006 0x00000000 0x00000000 0x40000000 0x00000000 0x00000000 0x00000000 0x00000000 0x00000000 0xfc000000>; > dma-ranges = <0x00000000 0x00000000 0x00000000 0x00000000 0x00000004 0x00000000>; > phandle = <0x000000d6>; > pcie@7d500000 { > compatible = "brcm,bcm2711-pcie", "brcm,bcm7445-pcie"; > reg = <0x00000000 0x7d500000 0x00000000 0x00009310>; > device_type = "pci"; > #address-cells = <0x00000003>; > #interrupt-cells = <0x00000001>; > #size-cells = <0x00000002>; > interrupts = <0x00000000 0x00000094 0x00000004 0x00000000 0x00000094 0x00000004>; > interrupt-names = "pcie", "msi"; > interrupt-map-mask = <0x00000000 0x00000000 0x00000000 0x00000007>; > interrupt-map = <0x00000000 0x00000000 0x00000000 0x00000001 0x00000001 0x00000000 0x0000008f 0x00000004>; > msi-controller; > msi-parent = <0x0000002c>; > ranges = <0x02000000 0x00000000 0xc0000000 0x00000006 0x00000000 0x00000000 0x40000000>; > dma-ranges = <0x02000000 0x00000004 0x00000000 0x00000000 0x00000000 0x00000002 0x00000000>; > brcm,enable-ssc; > phandle = <0x0000002c>; > pci@1,0 { > #address-cells = <0x00000003>; > #size-cells = <0x00000002>; > ranges; > reg = <0x00000000 0x00000000 0x00000000 0x00000000 0x00000000>; > usb@1,0 { > reg = <0x00010000 0x00000000 0x00000000 0x00000000 0x00000000>; > resets = <0x0000002d 0x00000000>; > }; > }; > }; > . . > xhci@7e9c0000 { > compatible = "generic-xhci"; > status = "disabled"; > reg = <0x00000000 0x7e9c0000 0x00000000 0x00100000>; > interrupts = <0x00000000 0x000000b0 0x00000004>; > power-domains = <0x00000013 0x00000006>; > phandle = <0x000000d9>; > }; > > Note the lack of nesting of xhci@7e9c0000 relative to > pcie@7d50000 . > >>> rman_manage_region: request: start 0x1, end 0x1 >>> pcib0: rman_reserve_resource: start=0xc0000000, end=0xc00fffff, count=0x100000 >>> rman_reserve_resource_bound: request: [0xc0000000, 0xc00fffff], length 0x100000, flags 102, device pcib1 >>> rman_reserve_resource_bound: trying 0xffffffff <0xc0000000,0xfffff> >>> considering [0xc0000000, 0xffffffff] >>> truncated region: [0xc0000000, 0xc00fffff]; size 0x100000 (requested 0x100000) >>> candidate region: [0xc0000000, 0xc00fffff], size 0x100000 >>> allocating from the beginning >>> rman_manage_region: request: start 0x600000000, end 0x6000fffff >>> panic: Failed to add resource to rman >>> cpuid = 0 >>> time = 1 >>> KDB: stack backtrace: >>> db_trace_self() at db_trace_self >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x38 >>> vpanic() at vpanic+0x1a4 >>> panic() at panic+0x48 >>> pcib_add_window_resources() at pcib_add_window_resources+0xf4 >>> pcib_alloc_window() at pcib_alloc_window+0xfc >>> pcib_attach_common() at pcib_attach_common+0xa18 >>> pcib_attach() at pcib_attach+0x14 >>> device_attach() at device_attach+0x3fc >>> device_probe_and_attach() at device_probe_and_attach+0x80 >>> bus_generic_attach() at bus_generic_attach+0x1c >>> pci_attach() at pci_attach+0xec >>> device_attach() at device_attach+0x3fc >>> device_probe_and_attach() at device_probe_and_attach+0x80 >>> bus_generic_attach() at bus_generic_attach+0x1c >>> device_attach() at device_attach+0x3fc >>> device_probe_and_attach() at device_probe_and_attach+0x80 >>> bus_generic_new_pass() at bus_generic_new_pass+0x100 >>> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >>> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >>> bus_generic_new_pass() at bus_generic_new_pass+0xb0 >>> bus_set_pass() at bus_set_pass+0x50 >>> mi_startup() at mi_startup+0x1e0 >>> virtdone() at virtdone+0x68 >>> KDB: enter: panic >>> [ thread pid 0 tid 100000 ] >>> Stopped at kdb_enter+0x4c: str xzr, [x19, #1280] >>> db> >> >> > > For reference from an old log: > > pcib1: irq 91 at device 0.0 on pci0 > pcib0: rman_reserve_resource: start=0xc0000000, end=0xc00fffff, count=0x100000 > pcib1: domain 0 > pcib1: secondary bus 1 > pcib1: subordinate bus 1 > pcib1: memory decode 0xc0000000-0xc00fffff > pci1: on pcib1 > pcib1: allocated bus range (1-1) for rid 0 of pci1 > pci1: domain=0, physical bus=1 > found-> vendor=0x1106, dev=0x3483, revid=0x01 > domain=0, bus=1, slot=0, func=0 > class=0c-03-30, hdrtype=0x00, mfdev=0 > cmdreg=0x0000, statreg=0x0010, cachelnsz=0 (dwords) > lattimer=0x00 (0 ns), mingnt=0x00 (0 ns), maxlat=0x00 (0 ns) > intpin=a, irq=0 > powerspec 3 supports D0 D3 current D0 > MSI supports 4 messages, 64 bit > map[10]: type Memory, range 64, base 0, size 12, memory disabled > pcib1: slot 0 INTA is routed to irq 92 > bcm_xhci0: irq 92 at device 0.0 on pci1 > bcm_xhci0: note: xhci firmware not found. > bcm_xhci0: note: installing xhci firmware. > bcm_xhci0: note: xhci firmware detected; firmware is revision 138a1. > pcib1: allocated memory range (0xc0000000-0xc0000fff) for rid 10 of bcm_xhci0 > bcm_xhci0: Lazy allocation of 0x1000 bytes rid 0x10 type 3 at 0xc0000000 > bcm_xhci0: 32 bytes context size, 64-bit DMA > bcm_xhci0: attempting to allocate 1 MSI vectors (4 supported) > bcm_xhci0: using IRQ 93 for MSI > bcm_xhci0: MSI enabled > bcm_xhci0: (New XHCI DeviceId=0x34831106) > usbus0 on bcm_xhci0 > bcm_xhci0: usbpf: Attached > > > === > Mark Millard > marklmi at yahoo.com > > From nobody Sun Feb 11 13:44:14 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXpjy74cCz59lmG; Sun, 11 Feb 2024 13:44:54 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXpjy1xQ4z4NGW; Sun, 11 Feb 2024 13:44:54 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=LysA+huN; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of marietto2008@gmail.com designates 2a00:1450:4864:20::535 as permitted sender) smtp.mailfrom=marietto2008@gmail.com Received: by mail-ed1-x535.google.com with SMTP id 4fb4d7f45d1cf-557dcb0f870so3103885a12.2; Sun, 11 Feb 2024 05:44:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707659092; x=1708263892; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=aoU8HxDHuFe4dNNwrvlsbmgdEM7Auq2rSysvOPm7j30=; b=LysA+huNAVRtfFE6ibu+wS8bDeKbnz+IGEjmfpVjFoqSk6TXjYl7gM2atJaqY1doB+ VVaI5jONy9rftL+Xxu1Ym5iv7n+MqbsdPdQbds0Ep243U2mbW1jGbcBLEBWSmyRxhw1T GvNcsuaaiKaGaC2je5eDXia4Hk4k9EQtEdmidyJS4TqQ2Z3A9u+JfZHQS3F+BmDsdhtV WFNGpIQys7VdtSNhGKX8C2FT3eNegU6bLfDVdSLjiPljQQHAJelqN2FB+ACZ+Uzx6oDP sS6A0jg9x+ij/UZcv3G3+oFa+5uOXhmq0ttW1T7Hzj4ue0SuMbFY9RcFLo3Q4u7eUsIY IxpQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707659092; x=1708263892; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=aoU8HxDHuFe4dNNwrvlsbmgdEM7Auq2rSysvOPm7j30=; b=HdqZyWmg2FJHB3rhxffmPEy4bHWv4qKihFirnMwTFFbA6hwxvIHqFjPmpl2V2emaQ0 efhynfb1yl2qgm87KI17m28RThzLVgkiOX9ppSD9E+KnnIkVNtOGtlIfmJ8GVizTXeEG za3ocRyDi1oUgOgxT7SyEqlUq1tkdnBHFPiL2JA0e1lO2teVNMENPFxTdwqi7dZZpZDc 5Wisu0xDRwRpTvkXp+sJwhlFOIqI2EPAIZxwfEpAJiBHM7/qKmSn+wdHmxBCbnUOb8KZ g1zBJgqcyhkESF44stoZ938Tt7xa0hF5b0F3XQTndPVTa/yA9gc4FshB7cYr0zqWcV9k UMFQ== X-Gm-Message-State: AOJu0Yw0OTHruzrjnHTQF3qzYxGMZgP3dxV8I+PQQK8e92CD6kjo3Qve esBOS1Qo6HNflq7nDFyRZMNpy8q6eQTlER4w3J8DI1SzrJFJ6rS+b87qHS9FI7J7THXgHo6+aRH pFImJLOHDUJy/2yR8FkTWQDgWfsYLT/comVmZow== X-Google-Smtp-Source: AGHT+IF2hw4DW1h/1mvQo4aa/dtoQ2kYp64dP0qMk99U/7QFZ1nCBZK5g3IT4CIy/0khC+93nwBSjdpzl2N2fcTlPp8= X-Received: by 2002:a17:906:a298:b0:a38:891b:4a69 with SMTP id i24-20020a170906a29800b00a38891b4a69mr2720875ejz.51.1707659091282; Sun, 11 Feb 2024 05:44:51 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Mario Marietto Date: Sun, 11 Feb 2024 14:44:14 +0100 Message-ID: Subject: How to use the L4 Microkernel with a FreeBSD userland. To: freebsd-arm , FreeBSD Mailing List , freebsd-hackers , FreeBSD Current , Warner Losh Content-Type: multipart/alternative; boundary="000000000000888e3c06111b5da2" X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[gmail.com]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::535:from]; MLMMJ_DEST(0.00)[freebsd-arm@freebsd.org,freebsd-questions@freebsd.org,freebsd-hackers@freebsd.org,freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_FIVE(0.00)[5]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_ALL(0.00)[]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+] X-Rspamd-Queue-Id: 4TXpjy1xQ4z4NGW --000000000000888e3c06111b5da2 Content-Type: text/plain; charset="UTF-8" Hello to everyone. I'm trying to understand how to use the L4 Microkernel with a FreeBSD userland. I've asked the same to a L4 developer,but he told me that he does not know FreeBSD,so I'm here to ask the same question. First of all I'm sure that it can be done,because it is written clearly on their website : http://os.inf.tu-dresden.de/L4Re/download/snapshots/ on the section : Host system requirements The host system shall be a 64bit-based system with a recent Linux distribution installed and at least 2GB of free disk space. All necessary tools required by the build are available from the provided packages of the Linux distributions, including cross compilers. But there are also other cross compiler packages available (see below). You might want to run make check_build_tools in the src/l4 directory to verify the common tools are installed. *You are free to use any Linux distribution you like, or even BSDs or any of its derivatives.* But then you should know the game. Especially tool versions should be recent, as installed on the listed distributions below. We are confident that the snapshot works on the following distributions: - Debian 11 or later - Ubuntu 22.04 or later Let's say I want to use the L4 microkernel + FreeBSD 14 on my Raspberry Pi 4,the first step I did was to build L4Re for the Rpi,according with this instructions : http://os.inf.tu-dresden.de/L4Re/rpi.html This is the log file of the compilation,that hasn't given any error : https://pastebin.ubuntu.com/p/6SwN2mpJBM/ Or I could have taken a pre built image of the L4 microkernel here : http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ At this point the tutorial says that I should use a Linux distro. They suggest the official distro for the Raspberry Pi 4,that's RaspBian. But I don't want to use Linux as a userland,I want to use FreeBSD. The question now is : what should I do to achieve that goal ? How can I link the L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I link it to the kernel of FreeBSD ? Can someone explain to me the missing step ? thanks. -- Mario. --000000000000888e3c06111b5da2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello to everyone.

I'm t= rying to understand how to use the L4 Microkernel with a FreeBSD userland. = I've asked the same to a L4 developer,but he told me that he does not k= now FreeBSD,so I'm here to ask the same question. First of all I'm = sure that it can be done,because it is written clearly on their website :




on the section :

Host system requirements

The host system shall be a 64bit-based system with a recent Linux distribution installed and at least 2GB of free disk space.

All necessary tools required by the build are available from the provide= d packages of the Linux distributions, including cross compilers. But there are also other cross compiler packages available (see below). You might want to run make check_build_tools in the src/l4 directory to verify the common tools are installed.

You are free to use any Linux distribution you like, or even BSDs or = any of its derivatives. But then you should know the game. Especially tool versions should be recent, as installed on the listed distributions below.<= /p>

We are confident that the snapshot works on the following distributions:=

  • Debian 11 or later
  • Ubuntu 22.04 or later

=
Let's say I want to use the L4 microkernel + FreeBSD 14 on m= y Raspberry Pi 4,the first step I did was to build L4Re for the Rpi,accordi= ng with this instructions :




This is the log file of the compil= ation,that hasn't given any=C2=A0 error :

=


=
Or I could have taken a pre built image of the L4 microkernel here : <= br>





At this point the tutorial says that I shou= ld use a Linux distro. They suggest the official distro for the Raspberry P= i 4,that's RaspBian. But I don't want to use Linux as a userland,I = want to use FreeBSD. The question now is : what should I do to achieve that= goal ? How can I link the L4 microkernel with the ubldr bootloader of Free= BSD ? Or should I link it to the kernel of FreeBSD ? Can someone explain to= me the missing step ? thanks.

--
Mario.
--000000000000888e3c06111b5da2-- From nobody Sun Feb 11 18:58:56 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXxhZ4pldz5BDc2 for ; Sun, 11 Feb 2024 18:59:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-20.consmr.mail.gq1.yahoo.com (sonic314-20.consmr.mail.gq1.yahoo.com [98.137.69.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXxhZ28Pwz3xVX for ; Sun, 11 Feb 2024 18:59:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707677948; bh=ERUKiBtI58RHPtSZ7ux75H78mj/VV1AqRsTe4xBOD6A=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=j8LrXfTJSEoLgzw+ITdrp+aFi6KazmrFuU+QRwpRqHvEL6SWmkTF9ML1efdUtJRNZ1nWmMi5A7mLAbdGZcl9dFqnzNyixrPGesRhjSP/rp8A0kz+KufS49z0LZsyZ843apEySuEL34Q+HORNMUJuA+IJid7Sq9BpJiGxPPH+2vJ5ssKPKdVidNvVQng5nBHa3W7pyvpgAFH8RguvRIidQOjwvlDDFelr9uCUotCEvjIA198swyv1wfRXkJIhi7InX3UFN68wv+W59z+BOf1dmts9zjwyl2VVLi9rT3bjIvGVG1gNXfMrXDP8I7EeYysJQVh4OtIjWUvKEXCK8BY7Fg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707677948; bh=gSnvhV60gsEG16E4vJ0j1b2aSlf9tzPXrh4zOtVkLXU=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Uc4gfoPA537O1FDjvzHdl9Kw0Ashlcc0SBni6w7caxgF4txH4eG6xDGgA0ka/T3QJ32dW0bXO/YRG7lprpg19JYEE+D7shsj1UrWBGZg/aDgTS5enoUH638GyTCDGE2RP1DtCOHTB67ustwUU0MJpdW/uH9ndmZu27KkJJMHp5nU18l0hUPbZZz/VyJnKrFaHTPLpigIha4A3VtpNM68uaHu6oHETzPghzmJgUnbySXlF0Kxh2GOJHNG7Hyj0W65cLpiDP21ChFC/MjZCHA7bpUuV1JUHxm548aM5hzhjh1UzbNE13oZmDFJDcdzRIbQQn4AmFBC+XGRFOLm+CYt3g== X-YMail-OSG: mgpH_VMVM1la9QtxEeidTDOsi.l8EltLTl2Nm4Wxl2QbWUO.vpxUVKelCubS_n5 OWbQ.m3nHh3Ax9I0lExekL8mjQ78bnvUykhFqdRS7ApKyeTk9Vn.3TuYAenZ7Fh_b7k8uLiJerxp aIvx0wTcxfPGxV2.KYKAAtwliNOhFRMlTm6XdBkyS4gj_yg_xfw.UifBjVkdRPq76Lgz8dE3h91H 9jcXlV8889Ifb9mJBmdKBqM5U4bR4z2LW0BO88Ap9sjrBHDNyVSGSdQ47..X_lYgHgNcPrDAY38x wenP4zP1K.pyafOWU6.04c7vgEDJ0HXZ8P_UUC0hhMhIS9hR6AOFOe9t7rmEfMqHSVJ23JJhG0yG Y7Il2oGdPFtL9i03THi8cSJDoSiGWELRgLx0Tfo0pzjYqXcBD3hY2AmwkIts6wWh5RdmOr.6yF0z wtOy79XnvtTUY8mpbDLVJYKftDo7dHVlmmeO_APpWzoTA1nAT4QUsQsihomK9Ihfv.ZE_p3lC1c3 k9jU.BjEQCntwoN3PBQGRc85aMyhTtdBSUQfokf1.vyVFXVy4DTzIh3FiNIS3y0pi04SUnYKgYsl _1h.lWgude2.QSi5RIY27HVCqPwMg5nEWI9G9dxwau0YP6qMh1PJykw7LWAiYUQJWCf0hoxJgno8 D45qx2NGG3xJvBlgQGW8INSISDsRxCrGe6u44hFgtakTJ_4R24nfHzuGfzvlJB2BViV02H_HKcyC 2o0gaTxAinfiCdIshbXj1lYQ0kcbx3mGUpSbB1FnBpmeVw50UD2oc2tC.o1JER9Sq_M_g6iE634n xKga1Cub6zqftDxYaJka4CMt6bmuiZJTYLyHW8jY6IK6vf46zWUN.rR9MCC9KZfHCzxqCcaqyGbK Fg5G4AyBVUwbn1tBBOCIA589lYwOaS3LmcHxDDNXmOH9vOFbSoNhttGZCeDM.Ge49mTY0h68sBeN f7LdRucfe_jLLv5oCIZ70y1ereSgztDiLghHi1ib1UViHDID2smTVhGlU.EmkalQopktMb1eMVyX OVtPOkOAbN.J8IdaQxmMdSyPa0geQe5pBMNN2meKh1vNuB2GVSfxwvGR0U7l3w.rco2a16qtrYkF 4Iji1eoGaypt5ISc7f4Xe3iEAtOWL5Kj_rV7bBr21QEyK8PxQIctpjfd0yVFvZjesdgrYmM6h1Ra oPUJ7rKXt5yAkQhZjAX9S0REJyX8.fr6ZMuhsiNL67jUACGgWTz.0jnqUevYy7WoimBLjh3lPgwk 7lhXncaQaXtxxC_y4K7N4mbj372ElJvAuGiqdAf02g9oXjR3iiZzw7GBvqDwLoL_xuoohDUr4mhS 6NxMI7kmuOixiNI_ijb0.dxW7MZhTKHr25rYfT_opAxo_o_2fWEGwd3gLF6F2Rhh3L8A5ebFXb82 AgZG0sxFfgzZkqLcC8RMqo8BIRkXzTK5yivm83BRsDQWbDxsBSrIsqlBzjzNfV_uJMhfjhn4ubTd jz6IOr.idQkdONTYlC1cmAebm4V98nXCs0BMoqWtGno3aIDUsnaAlT7kxbJaDEUleen1VXbRWH7N eCDWf39sR6Ewei9mJ0EbuFrbhOTWDYsZwBMijcN.p7q148MtjvID9AtHMBFi1LxREGSeZQAiz6.n yBCz4e.1ZZvvTasucs4azfeQAz.K6L122Ap0qWNUBuph_MhezFaJ_ZZzqERgIwJtVQi_CYfjJTHC 2F1iXrZcy9rr3KU6rB95w0hYkke4kshJr5HlpU6c.6oeILoqBIaggNT7aX4eFQR44e0WnGCdUMp7 5DKIlaqBZQqZbEjZC.ygJi94HtwjC6uI6LZjIJjFRuUVDcVJoUYAHq1LRZj88nHQg2AfonQPbbGo vDsmIRO2BmbNVufsbty8bVhZoSNqjKgJVo4NRueTtpJjzddHdd4dghN_cZBaF50Pdl_.uHIg71U6 qUtACKf261CW_BtwvOTvy0TavVZH3hnuzBH_nMtCLmD7eZNpHON.ZkxHtWhlvm2mlC6PRe4sGgFC 9UAr9Ln.Nn7.281nZI38Jr_RkvMMQ2EVlfXP6mAxqxOERRMi1CwIhPZ5pIE3bKGSxDZ51ZbYA8Ni DMMHT8bCRiwqLtW.lJ.Xt.TPGGY7jrmmStznqmGBWTqbRmXUnLHutPHD_oH5njBpjWo69pVQ.l5a nKmmY3OMQBplvosGIHCjzqApjnn2KpXEodQtcTZwShJYheeNsByqM_mstHMKWdRpkI9yvBDFVz2V zEc2sU5WWidQoRl.Yibn8JUBrZ3GJUR0R8eZYv30Lu0N5wARX_UihrjzTA1Ajz5CMmZW8QXdiTfg - X-Sonic-MF: X-Sonic-ID: 06ec5f7b-a3df-41a2-89a7-e52fc4b44799 Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Sun, 11 Feb 2024 18:59:08 +0000 Received: by hermes--production-gq1-5c57879fdf-6xjwd (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID c29727df83a37efa3b609b333e58f94e; Sun, 11 Feb 2024 18:59:07 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: How to use the L4 Microkernel with a FreeBSD userland. From: Mark Millard In-Reply-To: Date: Sun, 11 Feb 2024 10:58:56 -0800 Cc: freebsd-arm , FreeBSD Mailing List , freebsd-hackers , FreeBSD Current , Warner Losh Content-Transfer-Encoding: quoted-printable Message-Id: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> References: To: Mario Marietto X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4TXxhZ28Pwz3xVX X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated On Feb 11, 2024, at 05:44, Mario Marietto = wrote: > I'm trying to understand how to use the L4 Microkernel with a FreeBSD = userland. I've asked the same to a L4 developer,but he told me that he = does not know FreeBSD,so I'm here to ask the same question. First of all = I'm sure that it can be done,because it is written clearly on their = website : >=20 >=20 > http://os.inf.tu-dresden.de/L4Re/download/snapshots/ >=20 >=20 > on the section : > Host system requirements > The host system shall be a 64bit-based system with a recent Linux = distribution installed and at least 2GB of free disk space. > All necessary tools required by the build are available from the = provided packages of the Linux distributions, including cross compilers. = But there are also other cross compiler packages available (see below). = You might want to run make check_build_tools in the src/l4 directory to = verify the common tools are installed. > You are free to use any Linux distribution you like, or even BSDs or = any of its derivatives. But then you should know the game. Especially = tool versions should be recent, as installed on the listed distributions = below. > We are confident that the snapshot works on the following = distributions: > =E2=80=A2 Debian 11 or later > =E2=80=A2 Ubuntu 22.04 or later >=20 > Let's say I want to use the L4 microkernel + FreeBSD 14 on my = Raspberry Pi 4,the first step I did was to build L4Re for the = Rpi,according with this instructions : >=20 >=20 > http://os.inf.tu-dresden.de/L4Re/rpi.html=20 >=20 > This is the log file of the compilation,that hasn't given any error : >=20 >=20 > https://pastebin.ubuntu.com/p/6SwN2mpJBM/ >=20 >=20 > Or I could have taken a pre built image of the L4 microkernel here :=20= >=20 >=20 > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ >=20 >=20 >=20 > At this point the tutorial says that I should use a Linux distro. They = suggest the official distro for the Raspberry Pi 4,that's RaspBian. But = I don't want to use Linux as a userland,I want to use FreeBSD. The = question now is : what should I do to achieve that goal ? How can I link = the L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I = link it to the kernel of FreeBSD ? Can someone explain to me the missing = step ? thanks. QUOTING the "Configuring yourself" section: The make setup step configures predefined setups for both the L4Re = microkernel (Fiasco) and the L4Re user-level software, and connects both = together so the images for the target system can be built. END QUOTE So L4Re has its own user-level software, not just a kernel. There is no = use of a Linux or FreeBSD user-level software when L4Re is booted. (They are just used for building.) "The host system" is just a host for building the L4Re parts and = assembling the image from the parts. The "Pulling it together" section = is about combining the parts (including the microkernel and the = user-level software) to make the overall image that does not include = Linux or FreeBSD code. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Feb 11 19:43:59 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXyj363TMz5BJHW; Sun, 11 Feb 2024 19:44:39 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-ej1-x636.google.com (mail-ej1-x636.google.com [IPv6:2a00:1450:4864:20::636]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXyj34JSmz45Hw; Sun, 11 Feb 2024 19:44:39 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x636.google.com with SMTP id a640c23a62f3a-a3ca40db065so14449066b.2; Sun, 11 Feb 2024 11:44:39 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707680676; x=1708285476; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=c7i/Wmbp8GH6io4XHdLDqNSfDIn68zOaOkCMVjkau88=; b=ilMLWumyDXtGuYxdayBI9W0pq4p6PTIrLZpMxgCsUPbzBXWOQXLv5VWjbgtk9NQH6z P3tshmnBOXcWELKgaINxB/gx8u90tMrtn/QsoQY79nFfIJQ9BK5AsiwokYrvL2j7xwaZ dSaQqRj1cwz5lDhJm5EWe8UZAkd3FraSa4CttKo5jxomWbN1i1aJO2X9dG/mrSGhucXG zKqAZbXu6GGv6D8A7+HhEWDhGKyVxyBemHhSPtquKM2VEZVhALPx63ciOTTgbtNndN1C 335WIxwP2mZ7HXs0ynyA4pcCJhNsIxSMeXL98Eks5ng17xWEv1jzAzVJTGvWsz47JXFS 0vzw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707680676; x=1708285476; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=c7i/Wmbp8GH6io4XHdLDqNSfDIn68zOaOkCMVjkau88=; b=qJlU4AeTKw4Qr4K8QCihlSOX+t8I3Bxi1J15i/eJk2WLW2qAeziLW2F/dQA7i7LvaL /iZ2sybDhkdTmIpxAm5QaPFLVnH7WGDI6Yy6baQ6DCTB99mh2jLsfZF9I1v6s77DqU68 ISc0f6Lu45ovlvxbBPUnQ9Ep7cGNuLorZ4nJ+agL8Z2oCE1wi8DQc2b73wz+ZKwZotPG 0k4XcVchYcyY1vtr3CuUK7vaiT3ScGy5dFYtD4ttoGrO+4jcRJWIV9NblruLtkZEHSQS YSHAK2gsWJf0DOBosOQUdx2DwcietDlXZnatQHMDANKOqwVPXHaeJSw2eXwJFCFEEJnT XfWg== X-Gm-Message-State: AOJu0YyXcZ+DPbjohIu5ZzdTt0SCBeA2uBy3HFLHuRhm8zFiLoHvKNWp zOqCqVjC8zS1g1kEoKXXwZMsgN+CmPtKEfb+lfJpOUD9r5vV3JsQjK8cMN1sjvFvDx3PVnP8sJK nOPTYiLkVG419UhQ16nGXgsxNl1Y= X-Google-Smtp-Source: AGHT+IEuN10vP66h8m0ASuv9tnzGtgSlnqltSiT+E5CNHRZhegI59udvYLrSs0oXTRchIYAJeTizp1RZRRVXdUWrKfw= X-Received: by 2002:a17:906:f190:b0:a38:3907:8ee0 with SMTP id gs16-20020a170906f19000b00a3839078ee0mr3123643ejb.51.1707680676290; Sun, 11 Feb 2024 11:44:36 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> In-Reply-To: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> From: Mario Marietto Date: Sun, 11 Feb 2024 20:43:59 +0100 Message-ID: Subject: Re: How to use the L4 Microkernel with a FreeBSD userland. To: Mark Millard Cc: freebsd-arm , FreeBSD Mailing List , freebsd-hackers , FreeBSD Current , Warner Losh Content-Type: multipart/alternative; boundary="00000000000019a36f0611206470" X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4TXyj34JSmz45Hw X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated --00000000000019a36f0611206470 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable ok. But what does this mean ? That I can use whatever Linux distro I want ? Or even the FreeBSD world ? On Sun, Feb 11, 2024 at 7:59=E2=80=AFPM Mark Millard wr= ote: > > > On Feb 11, 2024, at 05:44, Mario Marietto wrote: > > > I'm trying to understand how to use the L4 Microkernel with a FreeBSD > userland. I've asked the same to a L4 developer,but he told me that he do= es > not know FreeBSD,so I'm here to ask the same question. First of all I'm > sure that it can be done,because it is written clearly on their website : > > > > > > http://os.inf.tu-dresden.de/L4Re/download/snapshots/ > > > > > > on the section : > > Host system requirements > > The host system shall be a 64bit-based system with a recent Linux > distribution installed and at least 2GB of free disk space. > > All necessary tools required by the build are available from the > provided packages of the Linux distributions, including cross compilers. > But there are also other cross compiler packages available (see below). Y= ou > might want to run make check_build_tools in the src/l4 directory to verif= y > the common tools are installed. > > You are free to use any Linux distribution you like, or even BSDs or an= y > of its derivatives. But then you should know the game. Especially tool > versions should be recent, as installed on the listed distributions below= . > > We are confident that the snapshot works on the following distributions= : > > =E2=80=A2 Debian 11 or later > > =E2=80=A2 Ubuntu 22.04 or later > > > > Let's say I want to use the L4 microkernel + FreeBSD 14 on my Raspberry > Pi 4,the first step I did was to build L4Re for the Rpi,according with th= is > instructions : > > > > > > http://os.inf.tu-dresden.de/L4Re/rpi.html > > > > This is the log file of the compilation,that hasn't given any error : > > > > > > https://pastebin.ubuntu.com/p/6SwN2mpJBM/ > > > > > > Or I could have taken a pre built image of the L4 microkernel here : > > > > > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ > > > > > > > > At this point the tutorial says that I should use a Linux distro. They > suggest the official distro for the Raspberry Pi 4,that's RaspBian. But I > don't want to use Linux as a userland,I want to use FreeBSD. The question > now is : what should I do to achieve that goal ? How can I link the L4 > microkernel with the ubldr bootloader of FreeBSD ? Or should I link it to > the kernel of FreeBSD ? Can someone explain to me the missing step ? than= ks. > > QUOTING the "Configuring yourself" section: > The make setup step configures predefined setups for both the L4Re > microkernel (Fiasco) and the L4Re user-level software, and connects both > together so the images for the target system can be built. > END QUOTE > > So L4Re has its own user-level software, not just a kernel. There is no > use of a Linux or FreeBSD user-level software > when L4Re is booted. (They are just used for building.) > > "The host system" is just a host for building the L4Re parts and > assembling the image from the parts. The "Pulling it together" section is > about combining the parts (including the microkernel and the user-level > software) to make the overall image that does not include Linux or FreeBS= D > code. > > > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > > --=20 Mario. --00000000000019a36f0611206470 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
ok. But what does this mean ? That I can use whatever Linu= x distro I want ? Or even the FreeBSD world ?

On Sun, Feb 11, 2024 at 7= :59=E2=80=AFPM Mark Millard <marklm= i@yahoo.com> wrote:


On Feb 11, 2024, at 05:44, Mario Marietto <marietto2008@gmail.com> wrote:

> I'm trying to understand how to use the L4 Microkernel with a Free= BSD userland. I've asked the same to a L4 developer,but he told me that= he does not know FreeBSD,so I'm here to ask the same question. First o= f all I'm sure that it can be done,because it is written clearly on the= ir website :
>
>
> http://os.inf.tu-dresden.de/L4Re/download= /snapshots/
>
>
> on the section :
> Host system requirements
> The host system shall be a 64bit-based system with a recent Linux dist= ribution installed and at least 2GB of free disk space.
> All necessary tools required by the build are available from the provi= ded packages of the Linux distributions, including cross compilers. But the= re are also other cross compiler packages available (see below). You might = want to run make check_build_tools in the src/l4 directory to verify the co= mmon tools are installed.
> You are free to use any Linux distribution you like, or even BSDs or a= ny of its derivatives. But then you should know the game. Especially tool v= ersions should be recent, as installed on the listed distributions below. > We are confident that the snapshot works on the following distribution= s:
>=C2=A0 =C2=A0 =C2=A0=E2=80=A2 Debian 11 or later
>=C2=A0 =C2=A0 =C2=A0=E2=80=A2 Ubuntu 22.04 or later
>
> Let's say I want to use the L4 microkernel + FreeBSD 14 on my Rasp= berry Pi 4,the first step I did was to build L4Re for the Rpi,according wit= h this instructions :
>
>
> http://os.inf.tu-dresden.de/L4Re/rpi.html
>
> This is the log file of the compilation,that hasn't given any=C2= =A0 error :
>
>
> https://pastebin.ubuntu.com/p/6SwN2mpJBM/
>
>
> Or I could have taken a pre built image of the L4 microkernel here : <= br> >
>
> http://os.inf.tu-dresden.= de/download/snapshots/pre-built-images/arm64/
>
>
>
> At this point the tutorial says that I should use a Linux distro. They= suggest the official distro for the Raspberry Pi 4,that's RaspBian. Bu= t I don't want to use Linux as a userland,I want to use FreeBSD. The qu= estion now is : what should I do to achieve that goal ? How can I link the = L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I link it t= o the kernel of FreeBSD ? Can someone explain to me the missing step ? than= ks.

QUOTING the "Configuring yourself" section:
The make setup step configures predefined setups for both the L4Re microker= nel (Fiasco) and the L4Re user-level software, and connects both together s= o the images for the target system can be built.
END QUOTE

So L4Re has its own user-level software, not just a kernel. There is no use= of a Linux or FreeBSD user-level software
when L4Re is booted. (They are just used for building.)

"The host system" is just a host for building the L4Re parts and = assembling the image from the parts. The "Pulling it together" se= ction is about combining the parts (including the microkernel and the user-= level software) to make the overall image that does not include Linux or Fr= eeBSD code.


=3D=3D=3D
Mark Millard
marklmi at yahoo.com



--
Mario.
--00000000000019a36f0611206470-- From nobody Sun Feb 11 20:00:48 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXz413lsrz5BKQf for ; Sun, 11 Feb 2024 20:01:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXz4119FJz4Cgl for ; Sun, 11 Feb 2024 20:01:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707681662; bh=nRBfDPkCYE85Wau2G25TyzYXbF0mgqYwC04LR2rPHkw=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=cmH3sXX/cvz2ArIThwBjxh45imwE1ITGIH11GfMjLtKPc2KwLQaWm16fzrUsm0T6/3lXTRToBVS7xo6+iLkyEHvMmFsLXiJkPGztE/VgXx/NglcBNhqxgU11PFHFnFRHroFbjS+OqEufC/pAn62+bwKkgR8qjV2CN7dCohHXrw1mjwj3X8m92KbE4aUaNTWL4dl4j+nUGnrZD3FQ5mhpYCGmM5sP58Kz+sgQfFU1txjTd4MMxgKURTY4v3oZCVsQG2reIFor0P1Yw4C/x4/NPZsnZ1FD6A+eQYdGQ/OIV8ooHgLXWxASfY4cVQDYJWOBodccC2PSNmiC49HU5DDlYw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707681662; bh=3d7+ezZdjJUyEaaZVBrYRqYt3u6lfQNWPheWoXLxa3k=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=c/Itixve0dSpi3CbQf23VnCpepTH6pnezFletLnd351X28/hsFol/JJzBIjvYSjfWQj+0NICfy31NfsdtEk6OatdoXIvSIcKHCLa/wTF4mThgfHQ8+uilgNZbqI/Aomx4ab9/pHjbvEJ/d7wcP2Czcz+JjT1HnCGzk39HVEta2jR8a7SSvwplIVn7dKa35VXE8R3YRdeoUUOdGuueRX6O8v1bQjkwAdmlFkigjUqI0mWxOFlUPHWDl48DPE7ltaDNNoVS4iXCUaVGYf0QD4WnZoYjzCo0AslGZkS2JYYo0T3glO8lJ/LDU8HH5YJtpdJF+wdXWuooZHIKPjhyRwTXA== X-YMail-OSG: aIo4oEkVM1lWLS04P9nhpVsQNdQwV7DCYprp95p7n3asHz6Ah8.hg7EA0CyhCX5 m_tnje5zqwqsuT8_GSKDs3ucJG45lvOZ0IExjakxFjpWbWBvHIhOlo42sVDGar3UdXcaotcXg54f CkY2ArvDwR4I.MAH969QzIv8ftkGiP7VKu5mQopJf1piNHjTY3pWz0To25S52rNEZnd9acjxIu_T 7otobseuVhp_JeBhMxshV6R8H1XcIhOYMY9oNnxdh95q_et2QvjuKZJ3kjKNTmH5UPWQwHFJ_pFB _fU4GTP89RHKgl8uSxyw06P_qyYkUv0_7NRuNSaHhx45CiWGzz1qveTwy5FkK10zzWqzfDoKKnI9 pDhRrZ8.eVSqgHpX.NfcA_eLYYWyBl0br4E4y4navKiOxvxn2SiOIZb298nI6zf25zUvyTzWzjAe Y6cf0EnumqCEysNt126CEhUCtxCsbzch.nzwiLmT5yM80o_vM88mVJeyvmzUaUZ0LZGaqbG6yE2C 38437wu4k_lyN2PH.M5gmSteAWJ94NAhaHfHOMgOf3yliFJ2.T6ajrJ.l8VCcXHcpzVpGddxNk4K t8JLioPj9aBJHFMetI58LQUAVfUPiTT9BsNw92dsPDOZRCSo4qos5lhaDkBcnnStLE1ES8wYpJ_D jGIp6d51ifKC9HfoL7VHHEGh6fOhx12UrQlSHyiC2iU3Zzi57VklkTnGC1Wu1yJlpzAQaq9SxbIe HoI0ttO5h4z.XtqgVWZMZ1_kb4KirNQpG6hpeMi33FxhkrB8v7FHWkhzQeSIKthdtYP76.4hvxfm k8VfqYdtnDalF3l2hT58q3NmzggwVLSZJyaBgbx.mWg7uzPpOJquvS477..pPKvV8hcdzYtqX3jT 2r5P8kQHZelV9Vaj6SLYFMCmQIxYVf3ZNe9KQNilZQXILOwWnHMgfGdkwyE7mNPc2TEZKAI.x965 RuDVRA907hsW1DxapU6RfykDLrnbwHC_nhPeONwlkExxz.kg3N_dMcgzGOG_kVC41RBnuuPui29p TEbc_hPl3xIsTxhVl2_GOkDH7pjpNw9aURYxmxDIrRfpbcxXoV4dDJcI6pyKQybqO.qblzf9d7M4 jOwb8Wih5nZACDElI7zdK1oUaExzIZYeJ6BhBbXL.yZcRxbxZ3CaGECW4DghHvI._JaITfIdVyTK i.VuoSCB1D1QWrXinlqwNX7PqKx5Wcllc0ri5FSvER1Br4NdQsiuRyq4de7pO8KkvFL2toJ3B8fS HfAuKpUqrDS4jcCNpcmCim.XZu6nLSzCpT3WiGOrW6l6kTcGt11x_5Ja8msIQ9sshYWaZz.EroRP pzLcVsVQm1uLMhGTVILCON76LMUQEiYD6ovPD3b_ELu5WDWI0Fz.i_h3UzYgDruv4iFCTL1A6wQR VSwmZRdDWn8T80EJFPBeq6W3p9p7RYNdFWAY4yExRAKumiOT6LX1O29LigmY9kJMPzP22BaQHxT3 LhjVEpQVobF2YRqefsjk_9JyHZSrIyRQ6_2fgh6PWht289mUHqSmxppavq3PR3HrWL6XEXaufDRF NuCFPogjD7vzISBDXlf51.QDDQC_kMYuMYsVcxti8d7Ca8ugMC3EL5earf_L9QiLeDaqd7Xg_pUr bhoxEfiGqWshGUlXa2uoKpQXgPPBIlBkWi1Lw83hgD..BbymriGjeMyZ1QlPr9h6GqfEXBoGJQi9 Y3Gzk9gh74YQ52kYNTkt3rKOJ6bUyDoFnSKUWlSqmG8ZNn1doUsLAtK3T2YiZiyDIdMv2jZkcuh0 tXrKgwK0kyCbg_aE2T2pl6ETErSELQl6Od6h45MZN2T2VJKYM33S65ZA8rqY9L_NxNzKpw77fAdk T8xvAFj.NraOLTpq6UC_ztQK_VKxO6H0sOPnof_EH6k.lT7NlcL_LYeNR.sVEqooe8GXlftqBAmj YkJTvnok5juY3cLz0RkLpbTuPb8PSz24GOr90Uc0oHKXNl0pFaZX74RK5QoTO.KQeJThUcz7W4HY qzn9CepFx2MOTtk0OTkEtDKrN42xbmKflEMqBIxzXezdMKRPfqglf3.WRNyVENpQj39Yajsp2ZSE rECi2MsfW2Dljuwj6OK4j9BvwuPRSL4eFNl1s86k.fb6aDjzKlhpH3uwvPg_sXmyyXLbVp7ZZG0G 5nl0GLobEZTuAGnA5348MZ82Isxf1bxGmVAiPzwK0NApAWf4jGX8np3pzx7gH0SWlox6DVzW4gTI 39WEcoC2ajNKbXhrY_AHwCghZ6tF.qtMWp.hQQblggF6WuBx2slVaj3DgmJXh.wjTTJpKGArjE_8 - X-Sonic-MF: X-Sonic-ID: c23f1db3-244e-474d-87e2-32a31b7eef38 Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sun, 11 Feb 2024 20:01:02 +0000 Received: by hermes--production-gq1-5c57879fdf-8lthq (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID a63ff5a372a596a694591fecdda62661; Sun, 11 Feb 2024 20:00:59 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: How to use the L4 Microkernel with a FreeBSD userland. From: Mark Millard In-Reply-To: Date: Sun, 11 Feb 2024 12:00:48 -0800 Cc: freebsd-arm , freebsd-hackers , FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: References: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> To: Mario Marietto X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4TXz4119FJz4Cgl X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated [Only replying to what I've subscribed to --and I dropped Warner as well.] On Feb 11, 2024, at 11:43, Mario Marietto = wrote: > ok. But what does this mean ? That I can use whatever Linux distro I = want ? Or even the FreeBSD world ? Only to build L4Re. The LR4e built will not contain any Linux userland materials, nor any FreeBSD userland materials. LR4e has its own userland materials that will be present instead. http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ already contains pre-built .elf and .uimage files Why not use one of those on the RPi4B? By size (larger), the most complete ones for the RPi4B seem to be (both formats): = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-multi_rpi4.elf = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-multi_rpi4.uimage = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-basic_rpi4.elf = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-basic_rpi4.uimage > On Sun, Feb 11, 2024 at 7:59=E2=80=AFPM Mark Millard = wrote: >=20 >=20 > On Feb 11, 2024, at 05:44, Mario Marietto = wrote: >=20 > > I'm trying to understand how to use the L4 Microkernel with a = FreeBSD userland. I've asked the same to a L4 developer,but he told me = that he does not know FreeBSD,so I'm here to ask the same question. = First of all I'm sure that it can be done,because it is written clearly = on their website : > >=20 > >=20 > > http://os.inf.tu-dresden.de/L4Re/download/snapshots/ > >=20 > >=20 > > on the section : > > Host system requirements > > The host system shall be a 64bit-based system with a recent Linux = distribution installed and at least 2GB of free disk space. > > All necessary tools required by the build are available from the = provided packages of the Linux distributions, including cross compilers. = But there are also other cross compiler packages available (see below). = You might want to run make check_build_tools in the src/l4 directory to = verify the common tools are installed. > > You are free to use any Linux distribution you like, or even BSDs or = any of its derivatives. But then you should know the game. Especially = tool versions should be recent, as installed on the listed distributions = below. > > We are confident that the snapshot works on the following = distributions: > > =E2=80=A2 Debian 11 or later > > =E2=80=A2 Ubuntu 22.04 or later > >=20 > > Let's say I want to use the L4 microkernel + FreeBSD 14 on my = Raspberry Pi 4,the first step I did was to build L4Re for the = Rpi,according with this instructions : > >=20 > >=20 > > http://os.inf.tu-dresden.de/L4Re/rpi.html=20 > >=20 > > This is the log file of the compilation,that hasn't given any error = : > >=20 > >=20 > > https://pastebin.ubuntu.com/p/6SwN2mpJBM/ > >=20 > >=20 > > Or I could have taken a pre built image of the L4 microkernel here :=20= > >=20 > >=20 > > = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ > >=20 > >=20 > >=20 > > At this point the tutorial says that I should use a Linux distro. = They suggest the official distro for the Raspberry Pi 4,that's RaspBian. = But I don't want to use Linux as a userland,I want to use FreeBSD. The = question now is : what should I do to achieve that goal ? How can I link = the L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I = link it to the kernel of FreeBSD ? Can someone explain to me the missing = step ? thanks. >=20 > QUOTING the "Configuring yourself" section: > The make setup step configures predefined setups for both the L4Re = microkernel (Fiasco) and the L4Re user-level software, and connects both = together so the images for the target system can be built. > END QUOTE >=20 > So L4Re has its own user-level software, not just a kernel. There is = no use of a Linux or FreeBSD user-level software > when L4Re is booted. (They are just used for building.) >=20 > "The host system" is just a host for building the L4Re parts and = assembling the image from the parts. The "Pulling it together" section = is about combining the parts (including the microkernel and the = user-level software) to make the overall image that does not include = Linux or FreeBSD code. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Feb 11 20:19:37 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TXzTl3nW1z5BLw9 for ; Sun, 11 Feb 2024 20:19:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4TXzTk3JwJz4GhH for ; Sun, 11 Feb 2024 20:19:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HnxfKdX2; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707682792; bh=xR6OX2014z4HIfz/Wd4YLO5QueVY6B1wIqKoV3Y3mQs=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=HnxfKdX2BdKvh+qr3hYZ4xZJN86j7M9GFnfqN9wl3AB/kT7yZPJVBsacad+M6SvQUYiwjV6TIYxT7YkSdC5cIu/57TWvitiOWqdpyoKivzdho4vmMQ7LZQDMDGTzlwgJdDrHwjDN19fM2Sy4mZCD06yD+VBrdseyn9dFfg5LMKc+5rDgrl75jrmzReDbDA2zoUtBLyRpUx4dLk8GenW5T1iSoTsR1RT8IDI0hesFM80ZsGGFcDuyhJ4MDG9asfTnfA47xzZZiOzcJq/6myfmtklhdkgg5W9OOUMHQJl91paNCMVsS0vbU96f2qFgvTkqgx+k0Pv+HvdOuOnnSA1azQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1707682792; bh=vJV5jWMYMxoXt5whtMzteQPKdKPfy+lPO/JJeo/CNUb=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=oGYvpIBVrihjD7F8mVn6EthML9Qxij3zWnLmdGqCd7DJgp4uwUIlZkXs6IJk6NWAr8HNNpKq4TppDAYrAWHUsmhjTA6j0HukhiS3kCOB+oplp95/AYfWS8OqtYaHvn2gwiO7yovn+R/T2yzoBDuxnrzWC+iPwvBmP3yN/NIOx2vAYNj2WM5fKTKUXBIssHOdqeddGGl6ytzArquAdn9eZ+SnH8OMuPCfKz1N0vB80ttO7ykKw6Kb3ArfIuV+S4MuCkRX8/KSrjlUpOuUONQBLGKZYXSU1J96mBvsMtG2t+sblMJVhBIal8osUmT6RN4c0Ll3RmdyIKB/i1GppKdJ3Q== X-YMail-OSG: _hCjVlcVM1mrQh5OY_Jq2BPpzjblsounr.0al0q_XfHrpc6Qs1FGJD7n9ru073n DM3oOpp6SgErsZg7sAl.18JzBOUiTgm8zA5bDgLWHmM0H.Prow_aSdV2NQIwZMM0vPJn51t6f9qt E_LwyxGlOnXRU2lO0uemqUVnw3jOR5Pj5J6mNpuq_rv2PKFJBNf_ZFqRi5FqEQWlQ8o2nEiV3J3R 728oA88aQfqLnWFi0S3qhDwEY5VdP.xws9wUjF3NIb_edtOAgWdLy1ifk6CIv1XfEadk6RHDWz1I LUx0nCldpGrKoBjXpgRYaUK2c9VRPxl_8VdaU5D7vhg636nCghQPAeViGZ.5J8bwzfe1ubJxeV7k D5aKn1JjZ9KNEiauflNF9umC0LW4JAeuQSA_39kqsgsuZUMnGzqqedF3EKJfadAe.5rNY6mEFdAl UG385I.u540oJugk1oBZ5j3jegvA.oL.t7nouH.kB6nE2Q6eWkaVgdJKlIAis2RgtkiOqQ7uqTmz B2n1cOCeEiB4Zm3fJT8UXRAHypPt9Kmu8U0Vx7SGsc4zcbTYbEhFoQbhkDDidpxbSobkgwIZWg2e Q7X7NI_VjJc9LgNHV3qpmn3sY3B_gNBJISs67qz3COKnO06ORrhgB9MSF7G4XZikvPzwIH2KSvX8 6hcw2O4SQE8qi05l4gcDTQMqOrFgTjYJ3lua6ZUyn.ePpp0zgJWv1Ky2G3.oCnlgmAFds5LN9huw _AitC2QsCEKSCzJhE4Kk3_wLR15oZ3txvkhUeo6qlzCBKP2f58bDTnv7W3.XIvc1_sqLmkhabYjM jUAgX4eJZjnHZHEOB6lPiK9POj.peKwVUFkXtsZgOwL9W0_27x2K6Sj0h5c5WhWm4RfGLTHYKSg0 rurJJhXfX7euwCL2enKAisnGZFbrOCi2jSxnYrNLmtQhDRf1xtvSYQCHSHE32Jx8ExlSMXZ_iDM2 4Zp5oC1CISBImPuuFY6u7X2LHr6.QRCmRDu1iw3ESqNEB6F1kghQJfz3IqhLC.VDcLW65RbUrURp kWF_w2A5aLXfOY5fTD_rUZQflHz.I5YQj6nAQLRjYKxgdnAr.jSI9NCvcP5bhSOXF8qvmy0JeB.2 YW_663g7zUSpiMqYpFrU2wRmgJlMFeTC6TJ7DcRPf8j3IdWxe3araCEEYcXlst1IBJSqt5yR26HL 8y0eOW1NgW3D_bwEyJG982UyoIwW.qilp8OfX45j0ekUObQ71l8GgLR_RV8FwvvjhtN.SP_djPwp Hg9X1A6spTotCkwEHjey.jGB9DEfBw4hwJJvzTnFGZtzOzkBFK3NT_cOXxR0Z9S5lCM9aeaXtkmu qGdQZE96ecxXfIPWKnA2DAhpoLJWWXW7Q20N8SIHlxY5tnhsLsudiqSp50_ScZgarSEjjY3HtG97 u7da7QS_eVLA_mNIZMk1vSBIeliDZgcO2a7ijkVsb_.1leQLiWYEzanXyaH5NBLXIqVxlvCS3ID9 3me0nc9SSW1H7agVyUJDPAZ.mg5QN1zdkS6NTAWk6BHtK4gIZXWhOtkg1GKvuNO7v3k_clQnXJtJ 6wfOfAQuXSBucxfTbtjFAEAdCeNZNLBzAt5MberS_6yZDvuYoaKIaBkcEfcTxJhP9FouuA1ZXdam PwYjLnVpLAl9PsXCn62xFSiW_7W_AbNd2oTUEfAOay9EXPLzO6fK9hMMH3bwkJa7YAnZl_59XWwR do0PazeS3B6z5Fw_sKnY0K0E.77jPj.lH7R.8s8FblDwN2Br.TOhGjTSzixCgJPFAYrZMaaHlM0w RjuSvthPzKwrhLtGTusyhjLraJAc50fTvCcv_FsLjTM8NDL8DUus0HfmlTzHajaKEK3d_Fk.9V15 Libp7nOioygk7Dx8SjnNG2VjCXCHPU4Ec9yurG4FUf.0gbX2mqqPY.Bq4EkTttYYFcWTB8IMhdDw _YFpagegq7RrI4_MGzjGxpIAIz2bwFPN5h9DVddq0CwkB0.2K9BDMrrGT9Uy1H_MKa4TWMcdXwg5 5jiVe2L.SS821F8MUX.lxtaReUvnZTeVeTIvesocb9aXxwMYD_YpxscQTQRPnu84JAma2JrbHokh hpFAnoxB06jFnIRXzL7h1vhC7jEmB04M18UROpenlwAPgz0mWa2TiL0WjryK_S7sDxl7DGNQPE6D Vkm6Y_iT2OKOPjaetQdh2RnkrMWDCXhMHChdhV32yoCVIEwh5BA_caTeYZeRNHaimF0d8gZz6f1S ApUmSlGjrdkZ_1IluVK3XYIQ1g5VZsQROY7mVbnCNwkyOVdddMP1g3rozL97kOjW1ev9__Oq.yT3 x X-Sonic-MF: X-Sonic-ID: 18dc93b6-771f-446c-95fe-00cca58ac448 Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Sun, 11 Feb 2024 20:19:52 +0000 Received: by hermes--production-gq1-5c57879fdf-4h5cs (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d515e58ab47f5f7684b95deda0e6d8ee; Sun, 11 Feb 2024 20:19:48 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: How to use the L4 Microkernel with a FreeBSD userland. From: Mark Millard In-Reply-To: Date: Sun, 11 Feb 2024 12:19:37 -0800 Cc: freebsd-arm , freebsd-hackers , FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: <440C30BB-5093-4ECB-94BE-21C73D461D0C@yahoo.com> References: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> To: Mario Marietto X-Mailer: Apple Mail (2.3774.400.31) X-Spamd-Bar: --- X-Spamd-Result: default: False [-4.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; TO_DN_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.31:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.31:from] X-Rspamd-Queue-Id: 4TXzTk3JwJz4GhH On Feb 11, 2024, at 12:00, Mark Millard wrote: > [Only replying to what I've subscribed to --and I dropped > Warner as well.] >=20 > On Feb 11, 2024, at 11:43, Mario Marietto = wrote: >=20 >> ok. But what does this mean ? That I can use whatever Linux distro I = want ? Or even the FreeBSD world ? >=20 > Only to build L4Re. >=20 > The LR4e built will not contain any Linux userland materials, > nor any FreeBSD userland materials. LR4e has its own userland > materials that will be present instead. >=20 > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ >=20 > already contains pre-built .elf and .uimage files Why not use one > of those on the RPi4B? >=20 > By size (larger), the most complete ones for the RPi4B seem to be > (both formats): >=20 > = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-multi_rpi4.elf > = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-multi_rpi4.uimage >=20 > = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-basic_rpi4.elf > = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boot= strap_vm-basic_rpi4.uimage May be you are wanting to run FreeBSD in a virtual machine in the LR4e environment? For example, http://os.inf.tu-dresden.de/L4Re/screens.html shows a "Virtualized Linux running in a window" that is using a virtual machine environment to run Linux in, not directly using the Linux userland with the microkernel. It also shows an example of "A vritual machine" that shows a GNU GRUB running in the virtual machine. For this the pre-built images should be sufficient: no need to build your own L4Re. It is the virtual machine configuration that would be then at issue. >> On Sun, Feb 11, 2024 at 7:59=E2=80=AFPM Mark Millard = wrote: >>=20 >>=20 >> On Feb 11, 2024, at 05:44, Mario Marietto = wrote: >>=20 >>> I'm trying to understand how to use the L4 Microkernel with a = FreeBSD userland. I've asked the same to a L4 developer,but he told me = that he does not know FreeBSD,so I'm here to ask the same question. = First of all I'm sure that it can be done,because it is written clearly = on their website : >>>=20 >>>=20 >>> http://os.inf.tu-dresden.de/L4Re/download/snapshots/ >>>=20 >>>=20 >>> on the section : >>> Host system requirements >>> The host system shall be a 64bit-based system with a recent Linux = distribution installed and at least 2GB of free disk space. >>> All necessary tools required by the build are available from the = provided packages of the Linux distributions, including cross compilers. = But there are also other cross compiler packages available (see below). = You might want to run make check_build_tools in the src/l4 directory to = verify the common tools are installed. >>> You are free to use any Linux distribution you like, or even BSDs or = any of its derivatives. But then you should know the game. Especially = tool versions should be recent, as installed on the listed distributions = below. >>> We are confident that the snapshot works on the following = distributions: >>> =E2=80=A2 Debian 11 or later >>> =E2=80=A2 Ubuntu 22.04 or later >>>=20 >>> Let's say I want to use the L4 microkernel + FreeBSD 14 on my = Raspberry Pi 4,the first step I did was to build L4Re for the = Rpi,according with this instructions : >>>=20 >>>=20 >>> http://os.inf.tu-dresden.de/L4Re/rpi.html=20 >>>=20 >>> This is the log file of the compilation,that hasn't given any error = : >>>=20 >>>=20 >>> https://pastebin.ubuntu.com/p/6SwN2mpJBM/ >>>=20 >>>=20 >>> Or I could have taken a pre built image of the L4 microkernel here :=20= >>>=20 >>>=20 >>> = http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ >>>=20 >>>=20 >>>=20 >>> At this point the tutorial says that I should use a Linux distro. = They suggest the official distro for the Raspberry Pi 4,that's RaspBian. = But I don't want to use Linux as a userland,I want to use FreeBSD. The = question now is : what should I do to achieve that goal ? How can I link = the L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I = link it to the kernel of FreeBSD ? Can someone explain to me the missing = step ? thanks. >>=20 >> QUOTING the "Configuring yourself" section: >> The make setup step configures predefined setups for both the L4Re = microkernel (Fiasco) and the L4Re user-level software, and connects both = together so the images for the target system can be built. >> END QUOTE >>=20 >> So L4Re has its own user-level software, not just a kernel. There is = no use of a Linux or FreeBSD user-level software >> when L4Re is booted. (They are just used for building.) >>=20 >> "The host system" is just a host for building the L4Re parts and = assembling the image from the parts. The "Pulling it together" section = is about combining the parts (including the microkernel and the = user-level software) to make the overall image that does not include = Linux or FreeBSD code. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Sun Feb 11 21:20:31 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4TY0rS00skz5BRxS; Sun, 11 Feb 2024 21:21:12 +0000 (UTC) (envelope-from marietto2008@gmail.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4TY0rR5BFgz4S9F; Sun, 11 Feb 2024 21:21:11 +0000 (UTC) (envelope-from marietto2008@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-a389ea940f1so264287466b.3; Sun, 11 Feb 2024 13:21:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1707686469; x=1708291269; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=xeHtVQdAQLEHf2UQBfps7ap101IjZY+AJevs+m2/nuc=; b=G8b+A4pvuIT2zuo31Iv1kTSqYASYAhsmRqq8nMPmG2rmVYsjM0XVUq1JJ7t8dN6ckb uXmLqq3tiEI1SFyhd4c645igoyjCj3yyKy2LdbbFQmqeWqDrKhm9PxCAFyDyzpOqS4Ue CQIzBL42EVesf3hUBm2tPUDig/dmbL5789vFRevsDNG/4Ko8KqCATFwmMVpUL5vBuTWt xDcPZdpLd4Y2C2rYxICJrneufwEQQ8usdZiIjdkNpGb48ybFnuvFrnfYtxvGO1pcxEr0 HAQ3s6tdMi5tP5RLEkfvsz2uGQGrTwGGSdw6z1+ijU4kxX73Hi6lf7DRs4iQI2L7CgLK tNLg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1707686469; x=1708291269; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=xeHtVQdAQLEHf2UQBfps7ap101IjZY+AJevs+m2/nuc=; b=PvSUuTThqQPmZaflVyFRd1bmuEvDx56ypr3Tukz7Kv0CAVrMDwy6P3s885i1k895ke XCoKJ09Lc2E6sc6o7DfEwT5qexFQbJ7t49wjY7YKTTeZx6sdGuW+aj4WQ4gxu24p0YBk pCYsKP6C+0uoE6CwQ/Ip0rQwPh+UzZfMd59EDS5moTJjMMOYNOZeAzr7mt9VczJHasSm pBBKTyBFxH/D9SJBabn2v3f0+hO89CA4YYX64ixYWmrPX+t/Vr0XICVrmIOwz1sG4Jll TIpFTscCgsNCaoRi238kqPBZoKZB3LVnyBry0RVhMlaIm+LsJqrLJf8gcAB/Vfet+Vn4 9dmQ== X-Forwarded-Encrypted: i=1; AJvYcCUrNSfBUyAOgMC+v4kuOpzLwDvrtKxIvRODzqAvHCb0JYqT21xhx6lvHXaT/ntEmWJlq2FwXdUkZ+B45/a3tqPTYni8Vz3Fr132SQ0fFoIzyf/2w96gstzk2kUu7BlTZMeARd01P+qLrA== X-Gm-Message-State: AOJu0YynXk5six7qGx7EuicIiGnVuypOSVdq7r7E+MINBd3+lMTYkiQY gHY4kpWNMkb0PcCLFI0VrLQI2RsOWLAamaTBrge+JunBDd7qetfwUrPKxShwQ795k23ZzC2M3wb qmhT72CcttgqHlJAx4CnaQMXUNh7wfj3CTcc= X-Google-Smtp-Source: AGHT+IH/73crJOAJhtQAqCPoynkT4lUI57qk/itols7gYu5KccUi/FdHuoeSZ138iHMp7kZe42lVSabAc2BW9UAtS3U= X-Received: by 2002:a17:906:6890:b0:a3c:7dd9:4d37 with SMTP id n16-20020a170906689000b00a3c7dd94d37mr1672057ejr.31.1707686468426; Sun, 11 Feb 2024 13:21:08 -0800 (PST) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <071E080E-C0E6-40F0-A0DF-4FCC22FC004D@yahoo.com> In-Reply-To: From: Mario Marietto Date: Sun, 11 Feb 2024 22:20:31 +0100 Message-ID: Subject: Re: How to use the L4 Microkernel with a FreeBSD userland. To: Mark Millard Cc: freebsd-arm , freebsd-hackers , FreeBSD Current Content-Type: multipart/alternative; boundary="000000000000569ef8061121bd60" X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4TY0rR5BFgz4S9F X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated --000000000000569ef8061121bd60 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I will do it as soon as I get all the necessary tools to turn on the Raspberry Pi 4b. I was thinking that L4 worked like the old project coLinux,where Linux ran as a list of processes under WIndows. In my sick mind I'd thought that L4 allows FreeBSD to run as a list of processes with the L4 microkernel itself on "top" of it. Do you know if something like this exists ? On Sun, Feb 11, 2024 at 9:01=E2=80=AFPM Mark Millard wr= ote: > [Only replying to what I've subscribed to --and I dropped > Warner as well.] > > On Feb 11, 2024, at 11:43, Mario Marietto wrote: > > > ok. But what does this mean ? That I can use whatever Linux distro I > want ? Or even the FreeBSD world ? > > Only to build L4Re. > > The LR4e built will not contain any Linux userland materials, > nor any FreeBSD userland materials. LR4e has its own userland > materials that will be present instead. > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/ > > already contains pre-built .elf and .uimage files Why not use one > of those on the RPi4B? > > By size (larger), the most complete ones for the RPi4B seem to be > (both formats): > > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boo= tstrap_vm-multi_rpi4.elf > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boo= tstrap_vm-multi_rpi4.uimage > > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boo= tstrap_vm-basic_rpi4.elf > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boo= tstrap_vm-basic_rpi4.uimage > > > > On Sun, Feb 11, 2024 at 7:59=E2=80=AFPM Mark Millard wrote: > > > > > > On Feb 11, 2024, at 05:44, Mario Marietto > wrote: > > > > > I'm trying to understand how to use the L4 Microkernel with a FreeBSD > userland. I've asked the same to a L4 developer,but he told me that he do= es > not know FreeBSD,so I'm here to ask the same question. First of all I'm > sure that it can be done,because it is written clearly on their website : > > > > > > > > > http://os.inf.tu-dresden.de/L4Re/download/snapshots/ > > > > > > > > > on the section : > > > Host system requirements > > > The host system shall be a 64bit-based system with a recent Linux > distribution installed and at least 2GB of free disk space. > > > All necessary tools required by the build are available from the > provided packages of the Linux distributions, including cross compilers. > But there are also other cross compiler packages available (see below). Y= ou > might want to run make check_build_tools in the src/l4 directory to verif= y > the common tools are installed. > > > You are free to use any Linux distribution you like, or even BSDs or > any of its derivatives. But then you should know the game. Especially too= l > versions should be recent, as installed on the listed distributions below= . > > > We are confident that the snapshot works on the following > distributions: > > > =E2=80=A2 Debian 11 or later > > > =E2=80=A2 Ubuntu 22.04 or later > > > > > > Let's say I want to use the L4 microkernel + FreeBSD 14 on my > Raspberry Pi 4,the first step I did was to build L4Re for the Rpi,accordi= ng > with this instructions : > > > > > > > > > http://os.inf.tu-dresden.de/L4Re/rpi.html > > > > > > This is the log file of the compilation,that hasn't given any error = : > > > > > > > > > https://pastebin.ubuntu.com/p/6SwN2mpJBM/ > > > > > > > > > Or I could have taken a pre built image of the L4 microkernel here : > > > > > > > > > http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64= / > > > > > > > > > > > > At this point the tutorial says that I should use a Linux distro. The= y > suggest the official distro for the Raspberry Pi 4,that's RaspBian. But I > don't want to use Linux as a userland,I want to use FreeBSD. The question > now is : what should I do to achieve that goal ? How can I link the L4 > microkernel with the ubldr bootloader of FreeBSD ? Or should I link it to > the kernel of FreeBSD ? Can someone explain to me the missing step ? than= ks. > > > > QUOTING the "Configuring yourself" section: > > The make setup step configures predefined setups for both the L4Re > microkernel (Fiasco) and the L4Re user-level software, and connects both > together so the images for the target system can be built. > > END QUOTE > > > > So L4Re has its own user-level software, not just a kernel. There is no > use of a Linux or FreeBSD user-level software > > when L4Re is booted. (They are just used for building.) > > > > "The host system" is just a host for building the L4Re parts and > assembling the image from the parts. The "Pulling it together" section is > about combining the parts (including the microkernel and the user-level > software) to make the overall image that does not include Linux or FreeBS= D > code. > > > =3D=3D=3D > Mark Millard > marklmi at yahoo.com > > --=20 Mario. --000000000000569ef8061121bd60 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I will do it as soon as I get all the necessary tools= to turn on the Raspberry Pi 4b. I was thinking that L4 worked like the old= project coLinux,where Linux ran as a list of processes under WIndows. In m= y sick mind I'd thought that L4 allows FreeBSD to run as a list of proc= esses with the L4 microkernel itself on "top" of it. Do you know = if something like this exists ?=C2=A0


<= /div>
O= n Sun, Feb 11, 2024 at 9:01=E2=80=AFPM Mark Millard <marklmi@yahoo.com> wrote:
[Only replying to what I've subscrib= ed to --and I dropped
Warner as well.]

On Feb 11, 2024, at 11:43, Mario Marietto <marietto2008@gmail.com> wrote:

> ok. But what does this mean ? That I can use whatever Linux distro I w= ant ? Or even the FreeBSD world ?

Only to build L4Re.

The LR4e built will not contain any Linux userland materials,
nor any FreeBSD userland materials. LR4e has its own userland
materials that will be present instead.

http://os.inf.tu-dresden.de/do= wnload/snapshots/pre-built-images/arm64/

already contains pre-built .elf and .uimage files Why not use one
of those on the RPi4B?

By size (larger), the most complete ones for the RPi4B seem to be
(both formats):

htt= p://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/bootstra= p_vm-multi_rpi4.elf
= http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boots= trap_vm-multi_rpi4.uimage

htt= p://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/bootstra= p_vm-basic_rpi4.elf
= http://os.inf.tu-dresden.de/download/snapshots/pre-built-images/arm64/boots= trap_vm-basic_rpi4.uimage


> On Sun, Feb 11, 2024 at 7:59=E2=80=AFPM Mark Millard <marklmi@yahoo.com> wrote:<= br> >
>
> On Feb 11, 2024, at 05:44, Mario Marietto <marietto2008@gmail.com> wrote: >
> > I'm trying to understand how to use the L4 Microkernel with a= FreeBSD userland. I've asked the same to a L4 developer,but he told me= that he does not know FreeBSD,so I'm here to ask the same question. Fi= rst of all I'm sure that it can be done,because it is written clearly o= n their website :
> >
> >
> > http://os.inf.tu-dresden.de/L4Re/downl= oad/snapshots/
> >
> >
> > on the section :
> > Host system requirements
> > The host system shall be a 64bit-based system with a recent Linux= distribution installed and at least 2GB of free disk space.
> > All necessary tools required by the build are available from the = provided packages of the Linux distributions, including cross compilers. Bu= t there are also other cross compiler packages available (see below). You m= ight want to run make check_build_tools in the src/l4 directory to verify t= he common tools are installed.
> > You are free to use any Linux distribution you like, or even BSDs= or any of its derivatives. But then you should know the game. Especially t= ool versions should be recent, as installed on the listed distributions bel= ow.
> > We are confident that the snapshot works on the following distrib= utions:
> >=C2=A0 =C2=A0 =C2=A0=E2=80=A2 Debian 11 or later
> >=C2=A0 =C2=A0 =C2=A0=E2=80=A2 Ubuntu 22.04 or later
> >
> > Let's say I want to use the L4 microkernel + FreeBSD 14 on my= Raspberry Pi 4,the first step I did was to build L4Re for the Rpi,accordin= g with this instructions :
> >
> >
> > http://os.inf.tu-dresden.de/L4Re/rpi.html > >
> > This is the log file of the compilation,that hasn't given any= =C2=A0 error :
> >
> >
> > https://pastebin.ubuntu.com/p/6SwN2mpJBM/
> >
> >
> > Or I could have taken a pre built image of the L4 microkernel her= e :
> >
> >
> > http://os.inf.tu-dre= sden.de/download/snapshots/pre-built-images/arm64/
> >
> >
> >
> > At this point the tutorial says that I should use a Linux distro.= They suggest the official distro for the Raspberry Pi 4,that's RaspBia= n. But I don't want to use Linux as a userland,I want to use FreeBSD. T= he question now is : what should I do to achieve that goal ? How can I link= the L4 microkernel with the ubldr bootloader of FreeBSD ? Or should I link= it to the kernel of FreeBSD ? Can someone explain to me the missing step ?= thanks.
>
> QUOTING the "Configuring yourself" section:
> The make setup step configures predefined setups for both the L4Re mic= rokernel (Fiasco) and the L4Re user-level software, and connects both toget= her so the images for the target system can be built.
> END QUOTE
>
> So L4Re has its own user-level software, not just a kernel. There is n= o use of a Linux or FreeBSD user-level software
> when L4Re is booted. (They are just used for building.)
>
> "The host system" is just a host for building the L4Re parts= and assembling the image from the parts. The "Pulling it together&quo= t; section is about combining the parts (including the microkernel and the = user-level software) to make the overall image that does not include Linux = or FreeBSD code.


=3D=3D=3D
Mark Millard
marklmi at yahoo.com



--
Mario.
--000000000000569ef8061121bd60--