From nobody Sun Oct 8 11:34:31 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S3Knk6Fw7z4wMdw for ; Sun, 8 Oct 2023 11:34:34 +0000 (UTC) (envelope-from garyj@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.15.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S3Knj3m0yz3cxL for ; Sun, 8 Oct 2023 11:34:33 +0000 (UTC) (envelope-from garyj@gmx.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmx.de header.s=s31663417 header.b="XbCU5G/F"; spf=pass (mx1.freebsd.org: domain of garyj@gmx.de designates 212.227.15.15 as permitted sender) smtp.mailfrom=garyj@gmx.de; dmarc=pass (policy=none) header.from=gmx.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1696764871; x=1697369671; i=garyj@gmx.de; bh=eifhtZ/zvy43Li9pIOonN4UxRC1NnumPgYehM/MsOv0=; h=X-UI-Sender-Class:Date:From:To:Subject:Reply-To; b=XbCU5G/F67FU/+BG48CbfwjD8QrLfcnqeQeNoo0VeKQA2Fctl4rGRdGrkY4sfN8pDrhmAklTDtT eq0WewImE7SIGjjVOtpyFVw5IXhdBWSxnlEaI4I6nPnYCfupXkoyQXbpy6WXCfmgQ5vdXl8x6lpiV zU0GP4az2Sk+/dZNzoFS3bmZlNdQcSj9NzoUlGmfaEq0GjJdLDgi976tiRXcf20lD6xjcVjuSWnIx mEjLfyAD6wEiHFObSdrLqpKuX9A9T5TfRGFNjWuWPXoNuAbib8y/vrQ7eA1czJOHCl1RF4rzKfHDJ bukCIOoAMm7rtmSnciu8QowPCYGDx4NUdEig== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from ernst.home ([217.226.57.134]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MIx3I-1r8m7h1bNi-00KTsR for ; Sun, 08 Oct 2023 13:34:31 +0200 Date: Sun, 8 Oct 2023 11:34:31 +0000 From: Gary Jennejohn To: current@freebsd.org Subject: 'teken_utf8_bytes_to_codepoint' [-Wunused-function] Message-ID: <20231008133431.274b9184@ernst.home> Reply-To: garyj@gmx.de X-Mailer: Claws Mail 3.19.1 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:h4WQsckM8s0YNGrhM/yGHQyZVvee7BQwNHpxKvlTcQ9C0PKrIzX uG6IAczAka8jY/IAUIbv0i+xLstNs9ZDBQN7xbXzt0c8Vtem14eY0SwHO1sA7qpQ2C0YcxA /AlpJQgrB5burfu69lOsN40YNNggvSA0a5CenPXhnEDhEZCsFlh9UBOgC8mDr330CtxJenJ JV7fi7LlKZI6xD71HiubQ== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:CxBSqf+UiEg=;Y89XhSABEjIOp2dQl9LlgaI5/1C 5VR3lz2evgskXU5wzqvk8FF22d1JSSysUecdtAxmHwYX9aiOweyCqicCvjOZW3pFU6pMRkV4E 3FmyjMVw4W3+6e3Fb4n9d+Dbl4t4wDzUU2lALmt+Ng0VuKHhEKsKgg9iEL28l3/zP6IWVgOtt 8gNBtgGH4UlY8i5yMIqZ4UPcuwQoShdD1B0w8sf/ebTmk82+O7WH7I2pDCjDdwNvdLW70Abq7 cTh6XOdLC9UM+FIabQIikt0L63WizSvTUPtK8XNuDJ0tiPBTxkmjGc2mEStKV7fcCzjvDQPM3 FKZcLoIL6N7Qo17sBPpCVpiNKqAEeNCIGHrKqgi30v3o7MilnmwXDvFf2VHPpot2SJG8RbvdL BfQLONiVBdqjsYMDpky7Zos7mZV40OecQBeCDvWftUdjNnxI9gXnTpaxNFXAojijukqCSpZ3g iutjIqPYLJ5UOj7Q1mBz32pGejbTxwNSj5b1XbVl3lFwcfxYjIO2RnPBgaSHqPy5oi9zIIomw Qti+LL6QW0nqie1tnkZe8ZHpHW2FJVkMEWiE6Bt4v9DF4pWBiRL4o5OaTx6j0nDhQ4I4IRmeg UnUARl5hwzx3Dmdej3+ji/vFr77tjx6Ne+oOVLpCvtouunuBWyy+MYmosqnBuPTH/gXMOeqyC Sm5USmt+ZXseFLOx80tp6b5rBZpGgDPj6ZpOY3FndOZtlnmuB3wKJxg9vA3OqAPfCPPGOUo0t SGYRsd3FRe9FxHKoXcfLVNuENR/OFjBf1UtYfifEaXAwoi0mYaVXgpKSaEKna5RawgOtPLBZJ hm6Yg41lDy7mbFLSBnnvHwmkaeNxFrhAXIDtNetJvC5XmWemvHWQbYtu4LXvyFYA9NZWo2Fmk RQ3vStOwhPCZE076U+qC6DvgJdrbhcMqWrxhDIIPk8wpDn5ig1RnQD8DEZllOm/u+M202xACh 9kCE+26b+KTmzOVAYW4+9Pm6Ph4= X-Spamd-Bar: - X-Spamd-Result: default: False [-1.69 / 15.00]; NEURAL_SPAM_LONG(1.00)[0.998]; NEURAL_HAM_SHORT(-0.82)[-0.821]; NEURAL_HAM_MEDIUM(-0.66)[-0.664]; DMARC_POLICY_ALLOW(-0.50)[gmx.de,none]; R_SPF_ALLOW(-0.20)[+ip4:212.227.15.0/25]; RWL_MAILSPIKE_VERYGOOD(-0.20)[212.227.15.15:from]; R_DKIM_ALLOW(-0.20)[gmx.de:s=s31663417]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[212.227.15.15:from]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; BLOCKLISTDE_FAIL(0.00)[217.226.57.134:server fail]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; FROM_HAS_DN(0.00)[]; FREEMAIL_REPLYTO(0.00)[gmx.de]; TO_MATCH_ENVRCPT_ALL(0.00)[]; HAS_REPLYTO(0.00)[garyj@gmx.de]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE]; FREEMAIL_ENVFROM(0.00)[gmx.de]; REPLYTO_ADDR_EQ_FROM(0.00)[]; FREEMAIL_FROM(0.00)[gmx.de]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; DKIM_TRACE(0.00)[gmx.de:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S3Knj3m0yz3cxL I just updated my current sources and did a buildworld and buildkernel. This warning was spit out, although it didn't result in buildkernel failing: In file included from /usr/src/sys/teken/teken.c:70: /usr/src/sys/teken/teken_wcwidth.h:128:1: warning: unused function 'teken_utf8_bytes_to_codepoint' [-Wunused-function] teken_utf8_bytes_to_codepoint(uint8_t bytes[4], int nbytes) ^ 1 warning generated. Just FYI. =2D- Gary Jennejohn From nobody Sun Oct 8 15:52:53 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S3RX2035pz4wMyd for ; Sun, 8 Oct 2023 15:53:06 +0000 (UTC) (envelope-from oleglelchuk@gmail.com) Received: from mail-yw1-x112e.google.com (mail-yw1-x112e.google.com [IPv6:2607:f8b0:4864:20::112e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S3RX13fN0z3MRK for ; Sun, 8 Oct 2023 15:53:05 +0000 (UTC) (envelope-from oleglelchuk@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112e.google.com with SMTP id 00721157ae682-5a1d0fee86aso45283117b3.2 for ; Sun, 08 Oct 2023 08:53:05 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1696780384; x=1697385184; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=6mL8CsOAMcgNgblAPbftbFj1Mqh+/xAE1kEZqECNqLc=; b=RcpPbhD0IGCH6eWCP7EHBJBPLRdiXMBtdmZjBHr9Eb7DjZ0MUt76SCTsyiateVcBE3 Unl73l0awKJdz48nMWR5iRDVfXukdzyPUz7G7sSiiSkB0ThCWntmQgunBjDoPw93/lw1 iG4DuKw7Ie+uTqqmk6ONYZ8FCBRXDlR9GwhDnaoUngfIh/9PM7J8twKFDCiH88M/tqz4 Pah1DN2aHKqezAnuUEUvHxfO6MKYFMSyDbdiBxaTirdYAvsfRh3XUQrg6QeYN6dLf2eP vv6/sXNhfcvCJlYwEX01YRO3ieuDekdbuCOLTPIf9A8KXYMsgH0SLGdvXbvy4iGPHKIB gR/A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696780384; x=1697385184; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=6mL8CsOAMcgNgblAPbftbFj1Mqh+/xAE1kEZqECNqLc=; b=jXO5cftQw/CUqsqniZH1GBkDA3KMwM1hSKYntIq/i6Q6Lhl3rUdLdipyPrrswhxgxb Xlfxv51OvgpjG5HlRtEE9kyIcQn2WaJYaIDi+X8+e1mrzkqW6XeTn0sDSDWhVTmG67R6 zbPQDOJAOUscgCOVbxBDNoG1jutMK2q9Wisc49iIOFw8V0YACwv+0t7/cw4PPoMKLSKc SIBbfZfDqx6gTSCQBQXGsXs95anuBuaBWdmb+yhdBuN8F/X6q0UMrqkAYcu9d23SQFDl dBswym/zLQNu3U8hJ872rn2juw8MV0fpyNphAly5NiA1Ry+Chu/B5izi0RbeMhzbYIER r2CQ== X-Gm-Message-State: AOJu0Yx4aZUxXthK0Or0pWpoImT9eyAOdCe7xAlnbfm9g1R2kaaCeDtj QL4dc7OD3GaV3cp0b+VpmrUsw5GQLcdjNpNz6dbm1MatG1B8eA== X-Google-Smtp-Source: AGHT+IEW/T+74LZxs/wV+ldnARAkNj8IcDgYeIj1Ko0HBIqHglIjaEsq5wOeTUfqj0/ewh21D2PoHDP6qd+CWRe/mHQ= X-Received: by 2002:a81:7357:0:b0:583:307d:41bc with SMTP id o84-20020a817357000000b00583307d41bcmr14552026ywc.27.1696780384488; Sun, 08 Oct 2023 08:53:04 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <20231008133431.274b9184@ernst.home> In-Reply-To: <20231008133431.274b9184@ernst.home> From: Oleg Lelchuk Date: Sun, 8 Oct 2023 11:52:53 -0400 Message-ID: Subject: Re: 'teken_utf8_bytes_to_codepoint' [-Wunused-function] To: garyj@gmx.de Cc: current@freebsd.org Content-Type: multipart/alternative; boundary="0000000000001453f3060736785d" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4S3RX13fN0z3MRK --0000000000001453f3060736785d Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I typed "stty iutf8" after updating to the latest world and kernel and the backspace key still seems to erase only one byte when erasing Russian letters. For example, I compile this program: #include #include int main() { std::cout << "Enter something: "; std::string sentence; std::getline(std::cin,sentence); std::cout << sentence << std::endl; } And when running the program, I type something using Russian letters, use the backspace key to erase some letters, hit enter, and what I see on the screen is some garbage. My LANG variable is set to C.UTF-8. On Sun, Oct 8, 2023 at 10:00=E2=80=AFAM Gary Jennejohn wrote= : > I just updated my current sources and did a buildworld and buildkernel. > > This warning was spit out, although it didn't result in buildkernel > failing: > > In file included from /usr/src/sys/teken/teken.c:70: > /usr/src/sys/teken/teken_wcwidth.h:128:1: warning: unused function > 'teken_utf8_bytes_to_codepoint' [-Wunused-function] > teken_utf8_bytes_to_codepoint(uint8_t bytes[4], int nbytes) > ^ > 1 warning generated. > > Just FYI. > > -- > Gary Jennejohn > > --0000000000001453f3060736785d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I typed "stty iutf8" after=C2=A0updating to the = latest world and kernel and the backspace key still seems to erase only one= byte when erasing Russian letters. For example, I compile this program:
#include <iostream>
#include <string>

int main()
{
	std::cout << "Enter something: ";
	std::string sentence;
	std::getline(std::cin,sentence);
	std::cout << sentence << std::endl;
}
And when running the program, I type=
 something using Russian letters, use the backspace key to erase some lette=
rs, hit enter, and what I see on the screen is some garbage. My LANG variab=
le is set to C.UTF-8.

On Sun, Oct 8, 2023 at 10:00=E2=80=AFAM Ga= ry Jennejohn <garyj@gmx.de> wrote= :
I just updated= my current sources and did a buildworld and buildkernel.

This warning was spit out, although it didn't result in buildkernel
failing:

In file included from /usr/src/sys/teken/teken.c:70:
/usr/src/sys/teken/teken_wcwidth.h:128:1: warning: unused function
'teken_utf8_bytes_to_codepoint' [-Wunused-function]
teken_utf8_bytes_to_codepoint(uint8_t bytes[4], int nbytes)
^
1 warning generated.

Just FYI.

--
Gary Jennejohn

--0000000000001453f3060736785d-- From nobody Mon Oct 9 06:02:01 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S3pMs13q1z4wbj8 for ; Mon, 9 Oct 2023 06:02:17 +0000 (UTC) (envelope-from cglogic@protonmail.com) Received: from mail-4318.protonmail.ch (mail-4318.protonmail.ch [185.70.43.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "protonmail.com", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S3pMq6YlKz4XRd for ; Mon, 9 Oct 2023 06:02:15 +0000 (UTC) (envelope-from cglogic@protonmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=protonmail.com header.s=protonmail3 header.b=FhKRqsMF; spf=pass (mx1.freebsd.org: domain of cglogic@protonmail.com designates 185.70.43.18 as permitted sender) smtp.mailfrom=cglogic@protonmail.com; dmarc=pass (policy=quarantine) header.from=protonmail.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail3; t=1696831332; x=1697090532; bh=jDEeFVy5BLq1jiuJGpxyKWHoxqywy/84Z67RmBVtHVk=; h=Date:To:From:Subject:Message-ID:In-Reply-To:References: Feedback-ID:From:To:Cc:Date:Subject:Reply-To:Feedback-ID: Message-ID:BIMI-Selector; b=FhKRqsMFGo8xaj60YsaCN8uzS0Zk2T6MdrL0u3rFE+8NkzSRvk3AkT6il5ke2fKEL sTOzel0gnHQcYmxrFGrxcEh2mpUSeMMbnt0K3aYzBOK5iyxH0O+HwsHzxhdbaRBb+3 x34J+Z/ibOY+CsxVjpgYerx5aUrFwvQgTtCeTIXgk9ktrLAfPH9PqGK82uEPPbyhcs H3aRatBGPCQk+deenu2OlL4oc/HGwgV/mJTvrG+IE2xvnYatf4Y6ziCgUvVgehng0t MkrlJRVsqb0TkRS0n2uVbA9Te0tVbgh2p2PhwP+rTiyz4bz9wSjBbsZyJDnGwppcAq 1YAQysQtmCfHQ== Date: Mon, 09 Oct 2023 06:02:01 +0000 To: FreeBSD CURRENT From: cglogic Subject: Re: 14-ALPHA2 panic on cold boot Message-ID: In-Reply-To: References: Feedback-ID: 25313618:user:proton List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="b1_s8y9oPVOZLqoYIuNrsKWXeZeA44b1YGDyIBsD0LZJ4" X-Spamd-Bar: - X-Spamd-Result: default: False [-1.64 / 15.00]; MIME_BASE64_TEXT_BOGUS(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-0.996]; NEURAL_SPAM_SHORT(0.66)[0.656]; DMARC_POLICY_ALLOW(-0.50)[protonmail.com,quarantine]; RWL_MAILSPIKE_EXCELLENT(-0.40)[185.70.43.18:from]; R_DKIM_ALLOW(-0.20)[protonmail.com:s=protonmail3]; R_SPF_ALLOW(-0.20)[+ip4:185.70.43.0/24]; MIME_BASE64_TEXT(0.10)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; FREEMAIL_ENVFROM(0.00)[protonmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[protonmail.com]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[protonmail.com:+]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; HAS_PHPMAILER_SIG(0.00)[]; ASN(0.00)[asn:62371, ipnet:185.70.43.0/24, country:CH]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4S3pMq6YlKz4XRd This is a multi-part message in MIME format. --b1_s8y9oPVOZLqoYIuNrsKWXeZeA44b1YGDyIBsD0LZJ4 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: base64 SnVzdCB0ZXN0ZWQgMTQuMC1CRVRBNSBhbmQgdGhlIGlzc3VlIGlzIG5vIGxvbmdlciBwcmVzZW50 LgoKTXkgZ3JhdGl0dWRlIHRvIE1hcmsgYW5kIGFsbCBpbnZvbHZlZC4KCi0tLS0tLS0gT3JpZ2lu YWwgTWVzc2FnZSAtLS0tLS0tCk9uIE1vbmRheSwgU2VwdGVtYmVyIDI1dGgsIDIwMjMgYXQgMTI6 MTIgUE0sIE1hcmsgSm9obnN0b24gPG1hcmtqZGJAZ21haWwuY29tPiB3cm90ZToKCj4gWWVzLiBJ J3ZlIGJlZW4gdHJhdmVsaW5nIGZvciB0aGUgcGFzdCBjb3VwbGUgb2Ygd2Vla3MgYW5kIHNvIGhh dmVuJ3QgYmVlbiBjb21taXR0aW5nIHBhdGNoZXMsIGJ1dCBJJ2xsIGJlIGhvbWUgdG9tb3Jyb3cg YW5kIHBsYW4gdG8gY29tbWl0IGFuZCBtZXJnZSBENDE4ODMuCj4KPiBPbiBNb24uLCBTZXAuIDI1 LCAyMDIzLCAwNjo1OSBjZ2xvZ2ljLCA8Y2dsb2dpY0Bwcm90b25tYWlsLmNvbT4gd3JvdGU6Cj4K Pj4gQW55IGNoYW5jZSB0aGF0IGh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9ENDE4ODMgd2ls bCBiZSBtZXJnZWQgaW50byAxNC4wIGJlZm9yZSByZWxlYXNlPwo+Pgo+PiAtLS0tLS0tIE9yaWdp bmFsIE1lc3NhZ2UgLS0tLS0tLQo+PiBPbiBTdW5kYXksIFNlcHRlbWJlciAxMHRoLCAyMDIzIGF0 IDU6MTQgUE0sIGNnbG9naWMgPGNnbG9naWNAcHJvdG9ubWFpbC5jb20+IHdyb3RlOgo+Pgo+Pj4g Rm9yIHRob3NlIHdobyBpbnRlcmVzdGVkIG9yIGFmZmVjdGVkIGJ5IHRoaXMgaXNzdWUuCj4+Pgo+ Pj4gTG9va3MgbGlrZSB0aGlzIHJlZ3Jlc3Npb24gd2FzIGludHJvZHVjZWQgYnkgaHR0cHM6Ly9y ZXZpZXdzLmZyZWVic2Qub3JnL0QzNDExNwo+Pj4gQ3VycmVudGx5IGFjdGl2ZSBQUiBpcyBodHRw czovL2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcuY2dpP2lkPTI2ODM5Mwo+Pj4g SXQgY29udGFpbnMgYSBwYXRjaCBwcm9wb3NlZCBieSBvbmUgb2YgdXNlcnMuCj4+PiBCdXQgdGhl IFBSIGNhbid0IG1vdmUgZm9yd2FyZCB3aXRob3V0IGNvbW1pdHRlcnMgYXR0ZW50aW9uLgo+Pj4K Pj4+IC0tLS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLS0tCj4+PiBPbiBUdWVzZGF5LCBBdWd1 c3QgMjl0aCwgMjAyMyBhdCAxMTowOSBBTSwgY2dsb2dpYyA8Y2dsb2dpY0Bwcm90b25tYWlsLmNv bT4gd3JvdGU6Cj4+Pgo+Pj4+IEhlbGxvIGRlYXIgRnJlZUJTRCBjb21tdW5pdHksCj4+Pj4KPj4+ PiBSZWNlbnRseSBJIHRyaWVkIHRvIGJvb3QgZnJvbSBGcmVlQlNEIDE0LUFMUEhBMiBpbWFnZSBh bmQgZ290IHBhbmljIG9uIGZpcnN0IGJvb3QgYWZ0ZXIgcG93ZXIgb24uCj4+Pj4gTXkgaGFyZHdh cmUgaXMgQU1EIFJ5emVuIDkgNTkwMFggb24gQVNVUyBST0cgU1RSSVggQjU1MC1FIEdBTUlORy4K Pj4+PiBJdCdzIHJlbGF0ZWQgdG8gYXVkaW8gY2hpcCBBTEMxMjIwIGluaXRpYWxpemF0aW9uLgo+ Pj4+Cj4+Pj4gSWYgSSByZW1lbWJlciBjb3JyZWN0bHksIHdoZW4gSSB0cmllZCBGcmVlQlNEIDEz LVNUQUJMRSwgYXJvdW5kIDIgeWVhcnMgYWdvLCBubyBwYW5pYyB3YXMgb2JzZXJ2ZWQuCj4+Pj4g QnV0IGF0IHRoYXQgdGltZSBteSBHUFUgd2FzIHVuc3VwcG9ydGVkIGJ5IGRybS1rbW9kLiBTbyBJ IGluc3RhbGxlZCBMaW51eCBhbmQgdXNlZCBpdCBmb3IgMiB5ZWFycy4KPj4+PiBPbiBMaW51eCwg bm8gc3VjaCBhIHBhbmljIG9ic2VydmVkLiBOb3cgZHJtLWttb2Qgc3VwcG9ydHMgbXkgR1BVIGFu ZCBJIHdhbnQgbW92ZSB0byBGcmVlQlNELgo+Pj4+Cj4+Pj4gQWxzbyB0cmllZCAxMy4yLCBnb3Qg dGhlIHNhbWUgcGFuaWMuCj4+Pj4gQ2FuJ3QgdHJ5IGVhcmxpZXIgRnJlZUJTRCAxMyByZWxlYXNl cywgYXMgdGhleSBhcmUgbm90IGF2YWlsYWJsZSBmb3IgZG93bmxvYWQgYW55bW9yZS4KPj4+Pgo+ Pj4+IEkgZm91bmQgdHdvIHJlbGF0ZWQgYnVnIHJlcG9ydHM6Cj4+Pj4gaHR0cHM6Ly9idWdzLmZy ZWVic2Qub3JnL2J1Z3ppbGxhL3Nob3dfYnVnLmNnaT9pZD0yNjQzMDUKPj4+Pgo+Pj4+IGh0dHBz Oi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzCj4+Pj4K Pj4+PiBNeSBiYWNrdHJhY2UgaXMgdGhlIHNhbWUgYXMgaW4gcmVwb3J0ZWQgaXNzdWVzLiBTbyBJ IGRpZCBub3Qgd3JpdGUgaXQgZnJvbSBhIHNjcmVlbiB0byBhIHBhcGVyLgo+Pj4+Cj4+Pj4gQXMg SSB1bmRlcnN0YW5kLCB0aGlzIGJ1ZyBhZmZlY3RzIGFsbCBBTUQgWmVuMiwgWmVuMyBhbmQgWmVu NCBjb21wdXRlcnMgYW5kIGxhcHRvcHMuCj4+Pj4KPj4+PiBXZSBhcmUgbmVhciBGcmVlQlNEIDE0 LjAgcmVsZWFzZSBub3csIG1heWJlIGl0IHdpbGwgYmUgcG9zc2libGUgdG8gZml4IGl0IGJlZm9y ZSByZWxlYXNlLgo+Pj4+Cj4+Pj4gVGhhbmtzLg== --b1_s8y9oPVOZLqoYIuNrsKWXeZeA44b1YGDyIBsD0LZJ4 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwg MjU1KTsiPjxzcGFuPkp1c3QgdGVzdGVkIDE0LjAtQkVUQTUgYW5kIHRoZSBpc3N1ZSBpcyBubyBs b25nZXIgcHJlc2VudC48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFs LCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tn cm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwgMjU1KTsiPjxzcGFuPjxicj48L3NwYW4+PC9kaXY+ PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6IEFyaWFsLCBzYW5zLXNlcmlmOyBmb250LXNpemU6IDE0 cHg7IGNvbG9yOiByZ2IoMCwgMCwgMCk7IGJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwg MjU1KTsiPjxzcGFuPk15IGdyYXRpdHVkZSB0byBNYXJrIGFuZCBhbGwgaW52b2x2ZWQuPC9zcGFu Pjxicj48L2Rpdj48ZGl2IGNsYXNzPSJwcm90b25tYWlsX3NpZ25hdHVyZV9ibG9jayIgc3R5bGU9 ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXplOiAxNHB4OyI+DQo8L2Rp dj4NCjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OiBBcmlhbCwgc2Fucy1zZXJpZjsgZm9udC1zaXpl OiAxNHB4OyI+PGJyPjwvZGl2PjxkaXYgY2xhc3M9InByb3Rvbm1haWxfcXVvdGUiPg0KICAgICAg ICAtLS0tLS0tIE9yaWdpbmFsIE1lc3NhZ2UgLS0tLS0tLTxicj4NCiAgICAgICAgT24gTW9uZGF5 LCBTZXB0ZW1iZXIgMjV0aCwgMjAyMyBhdCAxMjoxMiBQTSwgTWFyayBKb2huc3RvbiAmbHQ7bWFy a2pkYkBnbWFpbC5jb20mZ3Q7IHdyb3RlOjxicj48YnI+DQogICAgICAgIDxibG9ja3F1b3RlIGNs YXNzPSJwcm90b25tYWlsX3F1b3RlIiB0eXBlPSJjaXRlIj4NCiAgICAgICAgICAgIDxkaXYgZGly PSJhdXRvIj48ZGl2Plllcy4gSSd2ZSBiZWVuIHRyYXZlbGluZyBmb3IgdGhlIHBhc3QgY291cGxl IG9mIHdlZWtzIGFuZCBzbyBoYXZlbid0IGJlZW4gY29tbWl0dGluZyBwYXRjaGVzLCBidXQgSSds bCBiZSBob21lIHRvbW9ycm93IGFuZCBwbGFuIHRvIGNvbW1pdCBhbmQgbWVyZ2UgRDQxODgzLjxi cj48YnI+PGRpdiBjbGFzcz0iZ21haWxfcXVvdGUiPjxkaXYgY2xhc3M9ImdtYWlsX2F0dHIiIGRp cj0ibHRyIj5PbiBNb24uLCBTZXAuIDI1LCAyMDIzLCAwNjo1OSBjZ2xvZ2ljLCAmbHQ7PGEgaHJl Zj0ibWFpbHRvOmNnbG9naWNAcHJvdG9ubWFpbC5jb20iIHJlbD0ibm9yZWZlcnJlciBub2ZvbGxv dyBub29wZW5lciIgdGFyZ2V0PSJfYmxhbmsiPmNnbG9naWNAcHJvdG9ubWFpbC5jb208L2E+Jmd0 OyB3cm90ZTo8YnI+PC9kaXY+PGJsb2NrcXVvdGUgc3R5bGU9Im1hcmdpbjowIDAgMCAuOGV4O2Jv cmRlci1sZWZ0OjFweCAjY2NjIHNvbGlkO3BhZGRpbmctbGVmdDoxZXgiIGNsYXNzPSJnbWFpbF9x dW90ZSI+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6 MTRweCI+PHNwYW4gc3R5bGU9ImRpc3BsYXk6IGlubGluZSAhaW1wb3J0YW50OyBiYWNrZ3JvdW5k LWNvbG9yOiByZ2IoMjU1LCAyNTUsIDI1NSk7Ij5BbnkgY2hhbmNlIHRoYXQgPC9zcGFuPjxzcGFu PjxhIHRhcmdldD0iX2JsYW5rIiBzdHlsZT0iY29sb3I6IGJsdWU7IiBocmVmPSJodHRwczovL3Jl dmlld3MuZnJlZWJzZC5vcmcvRDQxODgzIiByZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVu ZXIiPmh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9ENDE4ODM8L2E+IHdpbGwgYmUgbWVyZ2Vk IGludG8gMTQuMCBiZWZvcmUgcmVsZWFzZT88L3NwYW4+PGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZv bnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPg0KPC9kaXY+DQo8ZGl2 IHN0eWxlPSJmb250LWZhbWlseTpBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij48YnI+ PC9kaXY+PGRpdj4NCiAgICAgICAgLS0tLS0tLSBPcmlnaW5hbCBNZXNzYWdlIC0tLS0tLS08YnI+ DQogICAgICAgIE9uIFN1bmRheSwgU2VwdGVtYmVyIDEwdGgsIDIwMjMgYXQgNToxNCBQTSwgY2ds b2dpYyAmbHQ7PGEgcmVsPSJub3JlZmVycmVyIG5vZm9sbG93IG5vb3BlbmVyIiB0YXJnZXQ9Il9i bGFuayIgaHJlZj0ibWFpbHRvOmNnbG9naWNAcHJvdG9ubWFpbC5jb20iPmNnbG9naWNAcHJvdG9u bWFpbC5jb208L2E+Jmd0OyB3cm90ZTo8YnI+PGJyPg0KICAgICAgICA8YmxvY2txdW90ZSB0eXBl PSJjaXRlIj4NCiAgICAgICAgICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMt c2VyaWY7Zm9udC1zaXplOjE0cHgiPkZvciB0aG9zZSB3aG8gaW50ZXJlc3RlZCBvciBhZmZlY3Rl ZCBieSB0aGlzIGlzc3VlLjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMt c2VyaWY7Zm9udC1zaXplOjE0cHgiPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFs LHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPkxvb2tzIGxpa2UgdGhpcyByZWdyZXNzaW9uIHdh cyBpbnRyb2R1Y2VkIGJ5IDxzcGFuPjxhIHRhcmdldD0iX2JsYW5rIiByZWw9Im5vcmVmZXJyZXIg bm9mb2xsb3cgbm9vcGVuZXIiIGhyZWY9Imh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMzQx MTciPmh0dHBzOi8vcmV2aWV3cy5mcmVlYnNkLm9yZy9EMzQxMTc8L2E+PC9zcGFuPjwvZGl2Pjxk aXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPjxz cGFuIHN0eWxlPSJkaXNwbGF5OiBpbmxpbmUgIWltcG9ydGFudDsgYmFja2dyb3VuZC1jb2xvcjog cmdiKDI1NSwgMjU1LCAyNTUpOyI+Q3VycmVudGx5IGFjdGl2ZSBQUiBpcyA8L3NwYW4+PHNwYW4g c3R5bGU9ImJhY2tncm91bmQtY29sb3I6IHJnYigyNTUsIDI1NSwgMjU1KTsiPjxhIHRhcmdldD0i X2JsYW5rIiByZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVuZXIiIGhyZWY9Imh0dHBzOi8v YnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzIiBzdHlsZT0i Y29sb3I6IGJsdWU7Ij5odHRwczovL2J1Z3MuZnJlZWJzZC5vcmcvYnVnemlsbGEvc2hvd19idWcu Y2dpP2lkPTI2ODM5MzwvYT48L3NwYW4+PGJyPjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5 OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPkl0IGNvbnRhaW5zIGEgcGF0Y2ggcHJv cG9zZWQgYnkgb25lIG9mIHVzZXJzLjwvZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFs LHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPkJ1dCB0aGUgUFIgY2FuJ3QgbW92ZSBmb3J3YXJk IHdpdGhvdXQgY29tbWl0dGVycyBhdHRlbnRpb24uPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1p bHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+PGJyPjwvZGl2PjxkaXY+DQogICAg ICAgIC0tLS0tLS0gT3JpZ2luYWwgTWVzc2FnZSAtLS0tLS0tPGJyPg0KICAgICAgICBPbiBUdWVz ZGF5LCBBdWd1c3QgMjl0aCwgMjAyMyBhdCAxMTowOSBBTSwgY2dsb2dpYyAmbHQ7PGEgcmVsPSJu b3JlZmVycmVyIG5vZm9sbG93IG5vb3BlbmVyIiB0YXJnZXQ9Il9ibGFuayIgaHJlZj0ibWFpbHRv OmNnbG9naWNAcHJvdG9ubWFpbC5jb20iPmNnbG9naWNAcHJvdG9ubWFpbC5jb208L2E+Jmd0OyB3 cm90ZTo8YnI+PGJyPg0KICAgICAgICA8YmxvY2txdW90ZSB0eXBlPSJjaXRlIj4NCiAgICAgICAg ICAgIDxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0 cHgiPkhlbGxvIGRlYXIgRnJlZUJTRCBjb21tdW5pdHksPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+PGJyPjwvZGl2PjxkaXYgc3R5 bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPlJlY2VudGx5 IEkgdHJpZWQgdG8gYm9vdCBmcm9tIEZyZWVCU0QgMTQtQUxQSEEyIGltYWdlIGFuZCBnb3QgcGFu aWMgb24gZmlyc3QgYm9vdCBhZnRlciBwb3dlciBvbi48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZh bWlseTpBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij5NeSBoYXJkd2FyZSBpcyA8c3Bh bj5BTUQgUnl6ZW4gOSA1OTAwWCBvbiBBU1VTIDxzcGFuPlJPRyBTVFJJWCBCNTUwLUUgR0FNSU5H Ljwvc3Bhbj48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1z ZXJpZjtmb250LXNpemU6MTRweCI+SXQncyByZWxhdGVkIHRvIGF1ZGlvIGNoaXAgPHNwYW4+QUxD MTIyMCBpbml0aWFsaXphdGlvbi48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6 QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+PHNwYW4+PGJyPjwvc3Bhbj48L2Rpdj48 ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij48 c3Bhbj5JZiBJIHJlbWVtYmVyIGNvcnJlY3RseSwgd2hlbiBJIHRyaWVkIEZyZWVCU0QgMTMtU1RB QkxFLCBhcm91bmQgMiB5ZWFycyBhZ28sIG5vIHBhbmljIHdhcyBvYnNlcnZlZC48L3NwYW4+PC9k aXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRw eCI+PHNwYW4+QnV0IGF0IHRoYXQgdGltZSBteSBHUFUgd2FzIHVuc3VwcG9ydGVkIGJ5IGRybS1r bW9kLiBTbyBJIGluc3RhbGxlZCBMaW51eCBhbmQgdXNlZCBpdCBmb3IgMiB5ZWFycy48L3NwYW4+ PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6 MTRweCI+PHNwYW4+T24gTGludXgsIG5vIHN1Y2ggYSBwYW5pYyBvYnNlcnZlZC4gTm93IGRybS1r bW9kIHN1cHBvcnRzIG15IEdQVSBhbmQgSSB3YW50IG1vdmUgdG8gRnJlZUJTRC48L3NwYW4+PC9k aXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRw eCI+PHNwYW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcmlhbCxz YW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij48c3Bhbj5BbHNvIHRyaWVkIDEzLjIsIGdvdCB0aGUg c2FtZSBwYW5pYy48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fu cy1zZXJpZjtmb250LXNpemU6MTRweCI+PHNwYW4+Q2FuJ3QgdHJ5IGVhcmxpZXIgRnJlZUJTRCAx MyByZWxlYXNlcywgYXMgdGhleSBhcmUgbm90IGF2YWlsYWJsZSBmb3IgZG93bmxvYWQgYW55bW9y ZS48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtm b250LXNpemU6MTRweCI+PHNwYW4+PGJyPjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZh bWlseTpBcmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij48c3Bhbj5JIGZvdW5kIHR3byBy ZWxhdGVkIGJ1ZyByZXBvcnRzOjwvc3Bhbj48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpB cmlhbCxzYW5zLXNlcmlmO2ZvbnQtc2l6ZToxNHB4Ij48c3Bhbj48c3Bhbj48YSB0YXJnZXQ9Il9i bGFuayIgaHJlZj0iaHR0cHM6Ly9idWdzLmZyZWVic2Qub3JnL2J1Z3ppbGxhL3Nob3dfYnVnLmNn aT9pZD0yNjQzMDUiIHJlbD0ibm9yZWZlcnJlciBub2ZvbGxvdyBub29wZW5lciI+aHR0cHM6Ly9i dWdzLmZyZWVic2Qub3JnL2J1Z3ppbGxhL3Nob3dfYnVnLmNnaT9pZD0yNjQzMDU8L2E+PC9zcGFu Pjxicj48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJp Zjtmb250LXNpemU6MTRweCI+PHNwYW4+PHNwYW4+PGEgdGFyZ2V0PSJfYmxhbmsiIGhyZWY9Imh0 dHBzOi8vYnVncy5mcmVlYnNkLm9yZy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzIiBy ZWw9Im5vcmVmZXJyZXIgbm9mb2xsb3cgbm9vcGVuZXIiPmh0dHBzOi8vYnVncy5mcmVlYnNkLm9y Zy9idWd6aWxsYS9zaG93X2J1Zy5jZ2k/aWQ9MjY4MzkzPC9hPjwvc3Bhbj48YnI+PC9zcGFuPjwv ZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0 cHgiPjxzcGFuPjxicj48L3NwYW4+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWws c2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+PHNwYW4+PHNwYW4gc3R5bGU9ImRpc3BsYXk6IGlu bGluZSAhaW1wb3J0YW50OyBiYWNrZ3JvdW5kLWNvbG9yOiByZ2IoMjU1LCAyNTUsIDI1NSk7Ij5N eSBiYWNrdHJhY2UgaXMgdGhlIHNhbWUgYXMgaW4gcmVwb3J0ZWQgaXNzdWVzLiBTbyBJIGRpZCBu b3Qgd3JpdGUgaXQgZnJvbSBhIHNjcmVlbiB0byBhIHBhcGVyLjwvc3Bhbj48YnI+PC9zcGFuPjwv ZGl2PjxkaXYgc3R5bGU9ImZvbnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0 cHgiPjxzcGFuPjxzcGFuIHN0eWxlPSJkaXNwbGF5OiBpbmxpbmUgIWltcG9ydGFudDsgYmFja2dy b3VuZC1jb2xvcjogcmdiKDI1NSwgMjU1LCAyNTUpOyI+PGJyPjwvc3Bhbj48L3NwYW4+PC9kaXY+ PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+ QXMgSSB1bmRlcnN0YW5kLCB0aGlzIGJ1ZyBhZmZlY3RzIGFsbCBBTUQgWmVuMiwgWmVuMyBhbmQg WmVuNCBjb21wdXRlcnMgYW5kIGxhcHRvcHMuPC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6 QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1m YW1pbHk6QXJpYWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+V2UgYXJlIG5lYXIgRnJlZUJT RCAxNC4wIHJlbGVhc2Ugbm93LCBtYXliZSBpdCB3aWxsIGJlIHBvc3NpYmxlIHRvIGZpeCBpdCBi ZWZvcmUgcmVsZWFzZS48L2Rpdj48ZGl2IHN0eWxlPSJmb250LWZhbWlseTpBcmlhbCxzYW5zLXNl cmlmO2ZvbnQtc2l6ZToxNHB4Ij48YnI+PC9kaXY+PGRpdiBzdHlsZT0iZm9udC1mYW1pbHk6QXJp YWwsc2Fucy1zZXJpZjtmb250LXNpemU6MTRweCI+VGhhbmtzLjwvZGl2PjxkaXYgc3R5bGU9ImZv bnQtZmFtaWx5OkFyaWFsLHNhbnMtc2VyaWY7Zm9udC1zaXplOjE0cHgiPg0KPC9kaXY+DQoNCiAg ICAgICAgPC9ibG9ja3F1b3RlPjxicj4NCiAgICA8L2Rpdj4NCiAgICAgICAgPC9ibG9ja3F1b3Rl Pjxicj4NCiAgICA8L2Rpdj48L2Jsb2NrcXVvdGU+PC9kaXY+PC9kaXY+PC9kaXY+DQoNCiAgICAg ICAgPC9ibG9ja3F1b3RlPjxicj4NCiAgICA8L2Rpdj4= --b1_s8y9oPVOZLqoYIuNrsKWXeZeA44b1YGDyIBsD0LZJ4-- From nobody Mon Oct 9 11:56:42 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S3yDt07DKz4wK5n for ; Mon, 9 Oct 2023 11:56:46 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from mx.catwhisker.org (mx.catwhisker.org [107.204.234.170]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S3yDr55fYz4Rc0 for ; Mon, 9 Oct 2023 11:56:44 +0000 (UTC) (envelope-from david@catwhisker.org) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of david@catwhisker.org designates 107.204.234.170 as permitted sender) smtp.mailfrom=david@catwhisker.org; dmarc=none Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.17.1/8.15.2) with ESMTP id 399BugLV014921 for ; Mon, 9 Oct 2023 11:56:42 GMT (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.17.1/8.17.1/Submit) id 399BugNU014920 for current@freebsd.org; Mon, 9 Oct 2023 04:56:42 -0700 (PDT) (envelope-from david) Date: Mon, 9 Oct 2023 04:56:42 -0700 From: David Wolfskill To: current@freebsd.org Subject: "make installworld" fails for main-n265819-af5e348c61da Message-ID: Reply-To: current@freebsd.org Mail-Followup-To: current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="bc2XwlkywE1Jlae2" Content-Disposition: inline X-Spamd-Bar: / X-Spamd-Result: default: False [-0.40 / 15.00]; REPLYTO_EQ_TO_ADDR(5.00)[]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; R_SPF_ALLOW(-0.20)[+ip4:107.204.234.170]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; MLMMJ_DEST(0.00)[current@freebsd.org]; DMARC_NA(0.00)[catwhisker.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:7018, ipnet:107.192.0.0/12, country:US]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; HAS_REPLYTO(0.00)[current@freebsd.org]; MID_RHS_MATCH_FROMTLD(0.00)[]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[david]; ARC_NA(0.00)[]; BLOCKLISTDE_FAIL(0.00)[107.204.234.170:server fail]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S3yDr55fYz4Rc0 --bc2XwlkywE1Jlae2 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable This is for an in-place source update; machine is currently running: freebeast(15.0-C)[15] uname -aUK FreeBSD freebeast.catwhisker.org 15.0-CURRENT FreeBSD 15.0-CURRENT #427 mai= n-n265811-38ecc80b2a4e: Sun Oct 8 17:42:28 UTC 2023 root@freebeast.cat= whisker.org:/common/S4/obj/usr/src/amd64.amd64/sys/GENERIC amd64 1500001 15= 00001 Sources were updated to main-n265819-af5e348c61da. Excerpt from the build typescript: =2E.. >>> Installing everything started on Mon Oct 9 11:26:45 UTC 2023 make[3]: "/common/S4/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1:= Using cached toolchain metadata from build at freebeast.catwhisker.org on = Mon Oct 9 10:49:37 UTC 2023 =2E.. install -o root -g wheel -m 444 rk_grf.4.gz /usr/share/man/man4/ install -o root -g wheel -m 444 rk_i2c.4.gz /usr/share/man/man4/ install -o root -g wheel -m 444 rk_pinctrl.4.gz /usr/share/man/man4/ rm -f /usr/share/man/man4/aarch64/armv8crypto.4 /usr/share/man/man4/aarch64= /armv8crypto.4.gz; install -l h -o root -g wheel -m 444 /usr/share/man/ma= n4/armv8crypto.4.gz /usr/share/man/man4/aarch64/armv8crypto.4.gz install: link /usr/share/man/man4/armv8crypto.4.gz -> /usr/share/man/man4/a= arch64/armv8crypto.4.gz: No such file or directory *** Error code 71 Stop. make[7]: stopped in /usr/src/share/man/man4/man4.aarch64 *** Error code 1 So... a couple of things: * This is an amd64 machine, building native. I didn't specify anything with respect to aarch64, and have nothing about aarch64 mentioned in /etc/*.conf. * While my build procedure is based on the information in src/UPDATING, I took the liberty (over a decade ago) to augment those instructions with a couple of additional steps just prior to issuing "make installworld": * One of those is to move /usr/include aside; * The other is to just completely remove /usr/share/man (recursively). In each case, this is not because I don't want the hierarchy in question; rather, it is because I want to be sure there is nothing extraneous in either. "make hierarchy" has (in the past) been invoked by "make installworld" and everything has been fine. Prior to the above-described failure, I had an earlier one: =2E.. >> etcupdate -p OK Mon Oct 9 11:10:29 UTC 2023 >> /usr/include.old removed Mon Oct 9 11:10:29 UTC 2023 >> /usr/include moved aside Mon Oct 9 11:10:29 UTC 2023 >> /usr/share/man removed Mon Oct 9 11:10:29 UTC 2023 make[1]: "/common/S4/obj/usr/src/amd64.amd64/toolchain-metadata.mk" line 1:= Using cached toolchain metadata from build at freebeast.catwhisker.org on = Mon Oct 9 10:49:37 UTC 2023 -------------------------------------------------------------- >>> Install check world -------------------------------------------------------------- =2E.. installing DIRS CONFSDIR install -d -m 0755 -o root -g wheel /etc installing DIRS NLSDIR install -d -m 0755 -o root -g wheel /usr/share/nls install -o root -g wheel -m 444 btree.3.gz /usr/share/man/man3/ install: /usr/share/man/man3/: No such file or directory *** Error code 71 Stop. make[5]: stopped in /usr/src/lib/libc *** Error code 1 I checked src/Makefile.inc1; it was last updated by: | commit 1a18383a52bc373e316d224cef1298debf6f7e25 | Author: Pierre Pronchery | Date: Fri Sep 15 17:14:16 2023 +0200 |=20 | libcrypto: link engines and the legacy provider to libcrypto Since I didn't see anything obvious that might have caused the observed failure, I tweaked my procedure so that after removing /usr/share/man, it then issued: mkdir -p /usr/share/man/man{1,2,3{,lua},4,5,6,7,8,9} Which appears to have got me through the initial issue. I mention this in case there's a chance it might possibly be relevant. Peace, david --=20 David H. Wolfskill david@catwhisker.org "I am not a member of any organized political party =E2=80=94 I am a Democr= at." - Will Rogers (Huh. Wonder what he'd say given recent events....) See https://www.catwhisker.org/~david/publickey.gpg for my public key. --bc2XwlkywE1Jlae2 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iNUEARYKAH0WIQSr0Kzv+UJRY3wfOii0+6PfV4Ix1AUCZSPqel8UgAAAAAAuAChp c3N1ZXItZnByQG5vdGF0aW9ucy5vcGVucGdwLmZpZnRoaG9yc2VtYW4ubmV0QUJE MEFDRUZGOTQyNTE2MzdDMUYzQTI4QjRGQkEzREY1NzgyMzFENAAKCRC0+6PfV4Ix 1FovAP9PW4KN0gft1rqYsJ11W5bABAyvBEwvXvkrstXfYEPcZAEA+Q3IkxziTP7n GSZIVpXg9Daah3yRSUtflzeK4vsR7wQ= =9UJ3 -----END PGP SIGNATURE----- --bc2XwlkywE1Jlae2-- From nobody Mon Oct 9 16:51:05 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S44nC4h9zz4x2gt for ; Mon, 9 Oct 2023 16:51:43 +0000 (UTC) (envelope-from arunodhayam89@gmail.com) Received: from mail-io1-xd2c.google.com (mail-io1-xd2c.google.com [IPv6:2607:f8b0:4864:20::d2c]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S44nB559xz3cpy for ; Mon, 9 Oct 2023 16:51:42 +0000 (UTC) (envelope-from arunodhayam89@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b="Iurzqom/"; spf=pass (mx1.freebsd.org: domain of arunodhayam89@gmail.com designates 2607:f8b0:4864:20::d2c as permitted sender) smtp.mailfrom=arunodhayam89@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-io1-xd2c.google.com with SMTP id ca18e2360f4ac-79f909071c3so195469439f.0 for ; Mon, 09 Oct 2023 09:51:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1696870301; x=1697475101; darn=freebsd.org; h=to:subject:message-id:date:from:mime-version:from:to:cc:subject :date:message-id:reply-to; bh=mh4lUfMaXromjilLyY0dn6XEazCjjVLDlGpmUeebdxM=; b=Iurzqom/KVKQ5XUAVEzkNcy+Qom1PqjkTA1Ujf6OFEaOpnMtaaPG50i2t8cXkVLlnw nbkx63plu8VIUmzIipyJEKYQh+ftVgvPnKStpVyDrWOQmPIXXHjeB9xPsniobfWZRDdm QM8wwJa7QToRYLdVbeJiMXviNm0/94n8SGhKQW1f66CSobtmDDfmukHMXt4yQRcJL7G1 /X47hTd8Qajf9bNzmegrKoH5JKJaXqoB61O3RhYy98ixkkDAJTAHkpIKBPNRTXrnCIUY pAJxkVb2ttOtKa9jRUc/aL+yc9l6+acQE09dX5syJ5TsJwEPqCQKtbw/KOFao1i4Nr/n 5wsA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696870301; x=1697475101; h=to:subject:message-id:date:from:mime-version:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=mh4lUfMaXromjilLyY0dn6XEazCjjVLDlGpmUeebdxM=; b=UhtnnQeoFqdXOiHtYxBqyRXglseNqhZVzH+kZ6iYuEyahs3VeVz8xyLWclPvpH3PHP hcEAJ/cf8Gex1SNcQJtGpJj++9ShqFJiF1KoJ9tSPEhexqk10/V66LKPnd2v1zTyte12 gV+9TtqQT0XJQHLg/9VieXbx9IK2otb/m4ipOg0U6+sYMKoS/xEjl+AI08Xd9ivyQZWk PHhjSDyvOnLJ8G62sz7LEuVh/B6lQPfK4LOdg2HJx5AlMPmMvdegLT7QjDA6+iZFvX3T QGUzXjti4oyvFhfC5em82HE6p8bKRFcDVeBzu1WvbyJEIEMlZrZLwsKXuYfggb0UOqHI RP0Q== X-Gm-Message-State: AOJu0YwfE17gIHX4nResNQ/kP6aylY01O5s5b8STJY080eAqXvixuMAI zgH0zAGZ87Ozt/Ks+3oGHik569iUEnXu1Z8H9W095Zamn7Jj7fpW X-Google-Smtp-Source: AGHT+IFsWa/CvdDNm3EooWKeZMlP7r+3K5g7Z4yrtWX1dTFT47N7dP8DnQ7JBJUtH4UZj5FTj0Ma31Pi4e649tqbAeM= X-Received: by 2002:a5e:9404:0:b0:785:ca70:46a2 with SMTP id q4-20020a5e9404000000b00785ca7046a2mr18680967ioj.4.1696870301168; Mon, 09 Oct 2023 09:51:41 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Arun Varghese Date: Mon, 9 Oct 2023 22:21:05 +0530 Message-ID: Subject: LOR seen on 13.x kernel To: freebsd-current@freebsd.org Content-Type: multipart/alternative; boundary="00000000000087fb2f06074b67b8" X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.90 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; NEURAL_HAM_SHORT(-0.98)[-0.983]; NEURAL_HAM_LONG(-0.92)[-0.920]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; BLOCKLISTDE_FAIL(0.00)[2607:f8b0:4864:20::d2c:server fail]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::d2c:from]; DKIM_TRACE(0.00)[gmail.com:+]; MID_RHS_MATCH_FROMTLD(0.00)[]; TO_DN_NONE(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org] X-Rspamd-Queue-Id: 4S44nB559xz3cpy --00000000000087fb2f06074b67b8 Content-Type: text/plain; charset="UTF-8" Hi All, Seeing the below LOR in the 13.x kernel, is this a known issue ? Could this cause vnode to max out and slow down the system. Is there a patch available?(or can we ignore this ?) kernel: Waiting (max 60 seconds) for system process `vnlru' to stop...done kernel: Waiting (max 60 seconds) for system process `bufdaemon' to stop...done kernel: Waiting (max 60 seconds) for system process `syncer' to stop... kernel: Syncing disks, vnodes remaining...114 lock order reversal: kernel: 1st 0xfffff80003b26068 syncer (syncer) @ kern/vfs_subr.c:1853 kernel: 2nd 0xfffff800038902d8 devfs (devfs) @ ufs/ffs/ffs_vfsops.c:1632 kernel: KDB: stack backtrace: kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0x fffffe022f899630 kernel: witness_checkorder() at witness_checkorder+0xc87/frame 0x fffffe022f8996c0 kernel: __lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe022f8997f0 kernel: vop_stdlock() at vop_stdlock+0x3c/frame 0xfffffe022f899810 kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV+0xab/frame 0xfffffe022f899840 kernel: _vn_lock() at _vn_lock+0x43/frame 0xfffffe022f8998a0 kernel: ffs_sync() at ffs_sync+0x2f9/frame 0xfffffe022f899970 kernel: sync_fsync() at sync_fsync+0xfa/frame 0xfffffe022f8999b0 kernel: VOP_FSYNC_APV() at VOP_FSYNC_APV+0xc4/frame 0xfffffe022f8999e0 kernel: sched_sync() at sched_sync+0x338/frame 0xfffffe022f899a70 kernel: fork_exit() at fork_exit+0x71/frame 0xfffffe022f899ab0 kernel: fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe022f899ab0 Regards Arun --00000000000087fb2f06074b67b8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
<= div id=3D"gmail-:1au" class=3D"gmail-a3s gmail-aiL">
H= i All,
Seeing the below LOR in the 13.x kernel, is this a kno= wn issue ?
Could this cause vnode to max out and slow down the sy= stem.
Is there a patch available?(or can we ignore this ?)

=
kernel: Wa= iting (max = 60 seconds) for system process `vnlru' to stop...done
<= br>
kernel: Waiting (max 60 seconds) for system process `bufdaemon= 9; to stop...done

kernel: Waiting (<= span style=3D"color:rgb(220,220,170)">max 60 seconds) for system proce= ss `syncer' to stop...

kernel: Syncing disks, vnodes remaining...114 lock order reversal:

kernel: 1st 0xfffff80003b26068 syncer (syncer) = @ kern/vfs_s= ubr.c:1853

kernel: 2nd 0xfffff800038902d8 devfs (devfs) @ ufs/= ffs/ffs_vfsops.c:1632

kernel: KDB: stack backtrace:

kernel: db_trace_self_wrapper() at db_trace_self_wrapper+0= x2b/frame 0xfffffe022f899630

kernel: witness_checkorder() at witness= _checkorder+0xc87/frame 0x= fffffe022f8996c0

kernel: _= _lockmgr_args() at __lockmgr_args+0x745/frame 0xfffffe0= 22f8997f0

kernel: vop_stdlock() at vop_stdlock+0x= 3c/frame 0xfffffe022f899810

kernel: VOP_LOCK1_APV() at VOP_LOCK1_APV= +0xab/frame 0xfffffe022f899840

kernel: _vn_lock() at _vn_l= ock+0x43/frame 0xfffffe022f8998a0

kernel: ffs_sync()= at ffs_sync+0x2f9/frame 0= xfffffe022f899970

kernel: = sync_fsync() at sync_fsync+0xfa/frame 0xfffffe022f8999b= 0

kernel: VOP_FSYNC_APV() at VOP_FSYNC_APV+0xc4/frame 0xfffffe022f8999e0 <= /div>
kernel: sched_sync() at sched_sync+= 0x338/frame = 0xfffffe022f899a70

kernel: fork_exit() at fork_exit+0x71/frame 0xfffffe022f899ab0

kernel: fork_trampoline() = at fork_trampoline+0xe/frame 0xfffffe022f899ab0=

Regards
Arun<= br>
<= /div>
--00000000000087fb2f06074b67b8-- From nobody Tue Oct 10 00:21:27 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S4GmP4gWrz4wn86 for ; Tue, 10 Oct 2023 00:21:41 +0000 (UTC) (envelope-from bakul@iitbombay.org) Received: from mail-pl1-x62a.google.com (mail-pl1-x62a.google.com [IPv6:2607:f8b0:4864:20::62a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S4GmN5XvQz3gHs for ; Tue, 10 Oct 2023 00:21:40 +0000 (UTC) (envelope-from bakul@iitbombay.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=iitbombay-org.20230601.gappssmtp.com header.s=20230601 header.b=VpW2UKlh; spf=pass (mx1.freebsd.org: domain of bakul@iitbombay.org designates 2607:f8b0:4864:20::62a as permitted sender) smtp.mailfrom=bakul@iitbombay.org; dmarc=none Received: by mail-pl1-x62a.google.com with SMTP id d9443c01a7336-1c877f27e8fso40423525ad.1 for ; Mon, 09 Oct 2023 17:21:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iitbombay-org.20230601.gappssmtp.com; s=20230601; t=1696897299; x=1697502099; darn=freebsd.org; h=to:cc:date:message-id:subject:mime-version :content-transfer-encoding:from:from:to:cc:subject:date:message-id :reply-to; bh=2iadDKsnee1O8HJd1yl1JUyCXiH9IPZQKusC59Ej4LM=; b=VpW2UKlh9iwkvMISh7B/ED44fsTfvtNV3nsaDauGnSjgpcDK0h/Y103f8cgKRRJ58m UK0fuzAs4k2Ivu4ikZoJT/Qm4ExjAHlZLrIoykqLNbu5PP3Ofco0OT04FTXntvoiSin2 TsEZa59OzcHZO36NMMZHqRnfBMGyBPFwdQ7voHvPkMe1BLiMaCajjpq4J4lDfKU4kQ0C 8OBUYgyOwC6yXYynwRYuZ70LS4MVnwccEus/oU59cVGbPFouJP9qJ22OYsCqaSYEPywj nSIUP1rqR9ZVbTbOiLOE/i76CizcQuNYR2qWwkbZBFdDxxq7PH/Oohxs+1MHrJJ6q7IR hBXg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1696897299; x=1697502099; h=to:cc:date:message-id:subject:mime-version :content-transfer-encoding:from:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=2iadDKsnee1O8HJd1yl1JUyCXiH9IPZQKusC59Ej4LM=; b=IZXw1L0oRnCHUQNQ2Uo712GQ4DzQ+7F3yQ+n6Ifj33VHpeRK4KnYs2zmMsmf2Zqu7B fr5clif1P0lrEqAbB0wPE0EtBt7c7P0msLlMAqjfhkFuS0sivgji9FBTUhqB9oq0wrfx i3eqNHS+4mwjDZXh6SonRJlHq2Ud75ELvK3UX6BLPp4dd96od8o38xow+Kmys2Y9BaVR dtU/Ydot+bsYOyvrcZKhRDS5tZycNddjyiL3u2EQnAZ2OCBIdgHHoCJuX3wDYMjtPxW3 EUmfOL4Y4eGffrZ+LNKQSMHlcVvT/daLN6yIklguZhB+uh6YuQuONsaYlgclgGONn0ym 70Hg== X-Gm-Message-State: AOJu0Yx50Fj3Fakt6Eus5pfqgAP1GN7nxkrKKwDRicYP/9cW/WdphkkT n0tWnsrXsRSRClWbWZ2qk+J+NcjquizuWiJa5mk= X-Google-Smtp-Source: AGHT+IFYWb+FMBVxONBWUQ6e595SgT2Bd5TaBoJ8uE/kQlEzPsxi8bLNTrOpRKHWPoP8G9KYO/EtUQ== X-Received: by 2002:a17:902:e5c1:b0:1c8:9901:85d0 with SMTP id u1-20020a170902e5c100b001c8990185d0mr9045183plf.46.1696897298884; Mon, 09 Oct 2023 17:21:38 -0700 (PDT) Received: from smtpclient.apple (107-215-223-229.lightspeed.sntcca.sbcglobal.net. [107.215.223.229]) by smtp.gmail.com with ESMTPSA id p20-20020a170902ead400b001c3e732b8dbsm10325137pld.168.2023.10.09.17.21.38 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 09 Oct 2023 17:21:38 -0700 (PDT) From: Bakul Shah Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.100.2.1.4\)) Subject: bhyve -G Message-Id: Date: Mon, 9 Oct 2023 17:21:27 -0700 Cc: virtualization@freebsd.org To: FreeBSD CURRENT X-Mailer: Apple Mail (2.3774.100.2.1.4) X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.99 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36:c]; R_DKIM_ALLOW(-0.20)[iitbombay-org.20230601.gappssmtp.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; FREEFALL_USER(0.00)[bakul]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[iitbombay.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::62a:from]; BLOCKLISTDE_FAIL(0.00)[107.215.223.229:server fail,2607:f8b0:4864:20::62a:server fail]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; DKIM_TRACE(0.00)[iitbombay-org.20230601.gappssmtp.com:+]; TO_DN_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S4GmN5XvQz3gHs Any hints on how to use bhyve's -G option to debug a VM kernel? I can connect to it from gdb with "target remote :" & bhyve stops the VM initially but beyond that I am not sure. Ideally this should work just like an in-circuit-emulator, not requiring anything special in the VM or kernel itself. Thanks! From nobody Tue Oct 10 17:26:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S4jWT05YMz4x4KC for ; Tue, 10 Oct 2023 17:27:01 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Received: from smtp052.goneo.de (smtp052.goneo.de [85.220.129.60]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S4jWR6cYrz3Crj for ; Tue, 10 Oct 2023 17:26:59 +0000 (UTC) (envelope-from freebsd@walstatt-de.de) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=walstatt-de.de header.s=DKIM001 header.b=YGc+dEVc; spf=none (mx1.freebsd.org: domain of freebsd@walstatt-de.de has no SPF policy when checking 85.220.129.60) smtp.mailfrom=freebsd@walstatt-de.de; dmarc=none Received: from hub1.goneo.de (hub1.goneo.de [IPv6:2001:1640:5::8:52]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by smtp5.goneo.de (Postfix) with ESMTPS id 6C2E0240D23 for ; Tue, 10 Oct 2023 19:26:52 +0200 (CEST) Received: from hub1.goneo.de (localhost [127.0.0.1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (No client certificate requested) by hub1.goneo.de (Postfix) with ESMTPS id CBA0A240D8E for ; Tue, 10 Oct 2023 19:26:50 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=walstatt-de.de; s=DKIM001; t=1696958810; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=830Y6gUT4AuZAZ+7mwXEQ8mXQLcnYnE9jikVq0A89Aw=; b=YGc+dEVcCNUm+7O/G0jxysu2C841GTu8j0QHzYhCpbnt5StEz+Oqnpearl9dU8U6m41BfN V8eI5XOchIkiPhtpiDUuBVu9UlR5o1f+wrL78IOEYHvhqSbEBy5UkvLF75ACAQlLjMO+SE LvJJFnm4BvpOV6GKEScKjcCi/jqD4MV0hn7KkRCfH1wPxCqdCUvDYq/hTvF/OTqr3hDwid BHVRWdEl99KztcT7L58reUWSttiRoafclC06KV/1BhAyiqYKlsaHXDL1AwO+3t5ThJ64VK pmfD4cUktCOpXNWaNu2eHq5vxlgBeEx+nGowTRiar4bnJMd6t60XQLuX0m/GTw== Received: from thor.intern.walstatt.dynvpn.de (dynamic-078-055-111-189.78.55.pool.telefonica.de [78.55.111.189]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (prime256v1) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by hub1.goneo.de (Postfix) with ESMTPSA id 4115724099A for ; Tue, 10 Oct 2023 19:26:50 +0200 (CEST) Date: Tue, 10 Oct 2023 19:26:22 +0200 From: FreeBSD User To: FreeBSD CURRENT Subject: epair/vbridge: no IPv6 traffic egress until first IPv6 packet flows in Message-ID: <20231010192649.54272d49@thor.intern.walstatt.dynvpn.de> Organization: walstatt-de.de List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-UID: 74e2aa X-Rspamd-UID: 97142c X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.22 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.92)[-0.925]; R_DKIM_ALLOW(-0.20)[walstatt-de.de:s=DKIM001]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[walstatt-de.de:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_SPF_NA(0.00)[no SPF record]; BLOCKLISTDE_FAIL(0.00)[78.55.111.189:server fail,2001:1640:5::8:52:server fail,85.220.129.60:server fail]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_ALL(0.00)[]; HAS_ORG_HEADER(0.00)[]; ASN(0.00)[asn:25394, ipnet:85.220.128.0/17, country:DE]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DMARC_NA(0.00)[walstatt-de.de]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S4jWR6cYrz3Crj Hello, at first: observation is below, marked [OBSERVATION]. Running recent CURRENT (FreeBSD 15.0-CURRENT #26 main-n265831-3523f0677ef: Mon Oct 9 14:00:42 CEST 2023 amd64), I've configured a bridge (bridge0), the hosts's interface igb0 (I350-T2 two port Gigabit Network Connection ) is member of that bridge and so a couple of epair(4) devices belonging to a couple of jails. IP filter is ipfw, each jail does have profile "WORKSTATION" configured and enabled, so the host itself. On those hosts I use the standard rc facility. Additionally, following MIB knobs are set to the following values: net.link.bridge.pfil_local_phys: 0 net.link.bridge.pfil_member: 0 net.link.bridge.pfil_bridge: 0 net.link.bridge.pfil_onlyip: 0 and net.link.ether.inet.allow_multicast: 0 net.link.ether.inet.log_arp_permanent_modify: 1 net.link.ether.inet.log_arp_movements: 1 net.link.ether.inet.log_arp_wrong_iface: 1 net.link.ether.inet.garp_rexmit_count: 0 net.link.ether.inet.max_log_per_second: 1 net.link.ether.inet.maxhold: 16 net.link.ether.inet.wait: 20 net.link.ether.inet.proxyall: 0 net.link.ether.inet.maxtries: 5 net.link.ether.inet.max_age: 1200 net.link.ether.arp.log_level: 6 net.link.ether.ipfw: 0 On epairs as well as on the main hosts igb0 NIC, both IPv4 and IPv6 are configured, IPv6 uses ULA and setup doesn't has anything fancy. Pinging and connecting to hosts "outside" the box of the host in question (all FreeBSD CURRENT/14-STABLE) is possible without ANY(!) restriction or something nonregular. [OBSERVATION] JAILs can ping any(!) IPv4 host in the net, the main-jail-bearing-host (main-host) itself or any host on the configured bridge() (important: jail -> main-host). JAILs can ping IPv6 any host on the bridge() or in the net or in the internet, BUT NOT the main-host (igb0-owner). NO IPv6 related service FROM jail TOWARD main-host is possible, it is all blocked (and I do not know what blocks or how ...). Disbaling IPFW via "ipfw disable firewall" on all jails and main-host doesn't have any effect in this state. BUT: if the main-host IPv6 pings a jail on that bridge (packet flowing into (the) jail/ingress from jail's perspective), the jail itself suddenly is then able to ping or do network traffic in IPv6! Other jails remain dead that way for IPv6 until I ping them. I haven't or I'm unable to check(ed) why ipv6-icmp is mysteriously "opening" the connection. SSH'ing via IPv6/TCPv6 from the main-host into a jail (tcp/22) works also perfectly and works as the "openener" - a stuck ping -6 towards the main-host then immediately starts flowing. I remember that such a similar problem occured somewhere around FreeBSD 10/11 and the problem vanished somehow in the vain of development/patching. Even disabling IPFW on all entities or switching to profile "open" doesn't help. Some services, like LDAP, nslcd do not work from jails if the jail remains in the initial state. That troubles me. Pinging via IPv6 icmp the jail seems to loosen all restraints, LDAP works, ping works, everything on IPv6 is normal as expected. But the JAIL has to be pinged from the outside first! As stated, I'm out of ideas here and what troubles me most is the fact even LDAP doesn't work until the jail is pinged via icmp6 first time.After this "init", everything is normal. IPv4 seems to be unharmed ... Thanks for your patience and reading, Kind regards oh -- O. Hartmann From nobody Wed Oct 11 11:23:49 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S59Q05qb4z4xGhW for ; Wed, 11 Oct 2023 11:23:52 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S59Q05M6bz4RG0; Wed, 11 Oct 2023 11:23:52 +0000 (UTC) (envelope-from kp@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697023432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TEN0ax0BVR90ZapJJeAlz66tbL4G8JRJt0jBVTy2Xs8=; b=q3O2VvZKOX/4Z0aV7dVwsjSj5N62SWd4QFFHq8D5gdd39ITrFgP7WBwYaFyViLzcpYAk64 +EtKjYpLE37P3i1jGOERVGUjvuU4DdAErjnfdoDte4PN84retk6w1aJbGDASpift+10hEc Gx6yauckLP4Y1W3zUl5cDY3gm1bHMgRkId7onZEdcLdNOcPvHbFXVY5ovJn71rDPm6cjK6 mJGOJv4rirEreAVgdrP9TuDY8Gf0hr2+nN2c4Y8O078Sc4qyxSc9dW7whTFzG/RgncAW50 OpS3FcmpqHw5SHeaFZKO1pyQuHMeq+27Txo+GLJEiJrzWHZGyCeIhrqqLcZ6sA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697023432; a=rsa-sha256; cv=none; b=nGlYR9kdEbzhQ3zCB14FvHZqweSHL/FU17+pPTCAAcw/ZIs/O5najMJQAgwckMmi6RGP3Y zTKtox7Onn5/JUwW/PlW/YRqXHaV/fbXG+Bl5paRsz21cV4Wsf4Hbioq0oExwZuqjzUH6I ZUBRrnQ2R8H1TuUPJ5485hDK32Q90IFV/YWqxiGQt/i2FrUsQiB213miMWko8Iga3eejh+ B/DFQ6rPIqO32xqdRwipEsSD4XZoFZz/H5pWKjS0AD1meU9TB37bIe7QYQDQWAeuuvUw9g p92p/BXjFUQEyRLgAdtg6TObqieJIrBoGyCOsrkby3rB8pRLHcZ1JC/QdrOpJg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697023432; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=TEN0ax0BVR90ZapJJeAlz66tbL4G8JRJt0jBVTy2Xs8=; b=AMWd0WZd1NKVjXu5EesmYmsshJ3sN82e+7ex0DMJA3X7seGg9hp/HaaspvIAgQZzgvV9bw lJXORvYGfpE1PLJA4jPfh7CRvabtYP7XI7T345d3amJSEf8Xfs76ouh802VRCcyyb7z3gg W9fhhD6TSGrzTdyC7h5HRXsWkZ2BchjgEtWd6YJhWJUvTC8zXQ6u1CKM/g9CbXO0yzEWQE PHkx91y1GkaMGT6b/aLG7xkmYXtatRWaQcUgF+zihw66J0mlE//pjCDv8wip7sDZzpObst AxinA5BbCeajMZ7JZ6TX3dkdDnC8NUmNhixZzrINFKJdQWHDhb9+ofAFe5MVDA== Received: from venus.codepro.be (venus.codepro.be [5.9.86.228]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mx1.codepro.be", Issuer "R3" (verified OK)) (Authenticated sender: kp) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S59Q03ht5z1Zkg; Wed, 11 Oct 2023 11:23:52 +0000 (UTC) (envelope-from kp@FreeBSD.org) Received: by venus.codepro.be (Postfix, authenticated sender kp) id EF96A308AF; Wed, 11 Oct 2023 13:23:49 +0200 (CEST) From: Kristof Provost To: FreeBSD User Cc: FreeBSD CURRENT Subject: Re: epair/vbridge: no IPv6 traffic egress until first IPv6 packet flows in Date: Wed, 11 Oct 2023 13:23:49 +0200 X-Mailer: MailMate (1.14r5937) Message-ID: <678C861F-F42A-445C-AC59-85B4FB68953C@FreeBSD.org> In-Reply-To: <20231010192649.54272d49@thor.intern.walstatt.dynvpn.de> References: <20231010192649.54272d49@thor.intern.walstatt.dynvpn.de> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain Content-Transfer-Encoding: quoted-printable On 10 Oct 2023, at 19:26, FreeBSD User wrote: > Hello, > > at first: observation is below, marked [OBSERVATION]. > > Running recent CURRENT (FreeBSD 15.0-CURRENT #26 main-n265831-3523f0677= ef: Mon Oct 9 14:00:42 > CEST 2023 amd64), I've configured a bridge (bridge0), the hosts's inter= face igb0 (I350-T2 two > port Gigabit Network Connection ) is member of that bridge and so a cou= ple of epair(4) devices > belonging to a couple of jails. > > On epairs as well as on the main hosts igb0 NIC, both IPv4 and IPv6 are= configured, IPv6 uses > ULA and setup doesn't has anything fancy. > Do not assign addresses to bridge member interfaces. Assign the addresses= to the bridge itself. Misconfiguring that breaks multicast, which almost certainly explains all= of your symptoms. Best regards, Kristof From nobody Thu Oct 12 00:47:02 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5WDx66w6z4wxt7 for ; Thu, 12 Oct 2023 00:47:13 +0000 (UTC) (envelope-from me+fbsd@cameronkatri.com) Received: from mail.cameronkatri.com (mail.cameronkatri.com [159.203.168.97]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.cameronkatri.com", Issuer "ZeroSSL RSA Domain Secure Site CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5WDw5zXTz3dt3 for ; Thu, 12 Oct 2023 00:47:12 +0000 (UTC) (envelope-from me+fbsd@cameronkatri.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=cameronkatri.com header.s=20220128 header.b=R0s85nLr; spf=pass (mx1.freebsd.org: domain of me+fbsd@cameronkatri.com designates 159.203.168.97 as permitted sender) smtp.mailfrom=me+fbsd@cameronkatri.com; dmarc=pass (policy=reject) header.from=cameronkatri.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=cameronkatri.com; s=20220128; t=1697071623; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=wI6WTTcAscpbkCB1iwwgTD/5CPWw0OwMHvvSKwd8O6o=; b=R0s85nLrCfumeKP8z0ZgC7nJ2Urt7BjmBRtzMWtiEaNuaKhBbqC1IsWK/qfcGVFVYNf58t tC50JkQANchf88CvX8PE6MOoLcKxOZhTfP+EBvUeHPRyOpGDca/w7HI+loNHIgrz3cuGQ1 qccMLZQC1Zu/Dh5YggGjKI++UcO7kXI= Received: from [192.168.1.143] (c-73-84-80-103.hsd1.fl.comcast.net [73.84.80.103]) by mail (OpenSMTPD) with ESMTPSA id 1281b20c (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Thu, 12 Oct 2023 00:47:03 +0000 (UTC) Message-ID: <4b68300a-3a0d-4ad3-adf0-5ba974fd391b@cameronkatri.com> Date: Wed, 11 Oct 2023 20:47:02 -0400 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: FreeBSD 14.0-BETA5 Now Available To: freebsd-current@freebsd.org References: <20231006224150.GF1307@FreeBSD.org> Content-Language: en-US From: Cameron Katri In-Reply-To: <20231006224150.GF1307@FreeBSD.org> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[cameronkatri.com,reject]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[cameronkatri.com:s=20220128]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; DKIM_TRACE(0.00)[cameronkatri.com:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:14061, ipnet:159.203.160.0/20, country:US]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[me]; ARC_NA(0.00)[]; TAGGED_FROM(0.00)[fbsd]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; TO_DN_NONE(0.00)[]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S5WDw5zXTz3dt3 On 10/6/23 18:41, Glen Barber wrote: > The fifth BETA build of the 14.0-RELEASE release cycle is now available. > > > > === Virtual Machine Disk Images === > > VM disk images are available for the amd64, i386, and aarch64 > architectures. Disk images may be downloaded from the following URL > (or any of the FreeBSD download mirrors): > > https://download.freebsd.org/releases/VM-IMAGES/14.0-BETA5/ > > > The disk images are available in QCOW2, VHD, VMDK, and raw disk image > formats. The image download size is approximately 135 MB and 165 MB > respectively (amd64/i386), decompressing to a 21 GB sparse image. > The FreeBSD-14.0-BETA5-arm64-aarch64-zfs.raw.xz (maybe others, I didn't check) has a rc.conf with a ton of repeated lines. I tried looking at why this would be, but the release scripts to create this image went right over my head. $ sudo mdconfig FreeBSD-14.0-BETA5-arm64-aarch64-zfs.raw md0 $ sudo zpool import -R /mnt -t 4016146626377348012 vm-zpool $ wc -l /mnt/etc/rc.conf 36 /mnt/etc/rc.conf $ sort -u /mnt/etc/rc.conf growfs_enable="YES" hostname="freebsd" ifconfig_DEFAULT="DHCP inet6 accept_rtadv" zfs_enable="YES" zpool_reguid="zroot" zpool_upgrade="zroot" $ > > > > Regards, > > Glen > > Please consider donating to help support my FreeBSD work: > https://www.gofundme.com/f/gjbbsd > https://paypal.me/gjbbsd > > Love FreeBSD? Support this and future releases with a donation to > the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ > > -- Cameron Katri Email: me@cameronkatri.com PGP Fingerprint: 7D3B36CEA40FCC2181FB6DCDBAFFD97826540F1C From nobody Thu Oct 12 05:08:43 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5d336r4zz4xFSB for ; Thu, 12 Oct 2023 05:09:03 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5d320Xvnz4fDG for ; Thu, 12 Oct 2023 05:09:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=eYmq49rc; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.146 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1697087339; bh=hKpEOjNwLgVqMZxi5iSYQBjdQfsKuQ+80vPONnjeYNE=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=eYmq49rc2kA3JYLA7uwFSTCBN8F48AD0HWcc3ZoURmVEwPDNKOCNYJi29kx3+9xLJ89IZNPrcaga1omaHARgK55Xs/in0Seo+TjSY6vqeRglmXXQSRCJnvTljaAnSgYO34no8IC0rjPHTSeIiVXMnTAzEgpaQmdJGsZP4V90bl3cZOaOYFmsT7maqw3DBBMCgwXVlRwJYCTRSQTgTGSk2bMrDPrGucc4InioraJglvqYffdZH61PwFKtwgEtA1d3MWtSVx2h4H4sIaKFh814qGQ1rrceKxcPttjlHGh+bV+VEcIex5iAunFvPHX+4PGDIDemGMVgZe8qw7XNUckRhw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1697087339; bh=FyHo83UFYzIo3EUSSunHAmov/XDIaPa7jP3xNbl9PJT=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=ujQR58PFPlg3o/jL75wgtBwHfmcZ7ElPo3OA38HkLACObhBooV6XVMVIReiyPgBvNH8/FP8hNDRnVvBk1YBVsAJTKHukejie+HqlIZS8nDZCGn3JFqGGAln6/DwIgzsbT/6aGtLGjHVfRD2wZrw8OnC4e+ceRQ26OPi8YNYyWdohaQ4JC02xHBd5T+TXhGtUv0FqJD9KP9H48BwnH8PRo6oe0oEW6DisycJQYes1xTmXhvUVrmPO8xqaaA7VkF9CN4G4j1pN4QX5e6Z7kEVI3fJ+b2jxVOSRwdi3rIqdZwhi0e++6vEKkSi9H+uwQxBLcNnppFpfeQ+RLmlInNaH0A== X-YMail-OSG: HISCJ9cVM1nvsV.AoaHqcRC1Of4P6Z3oXTh5QGLTbkBpPBNbrt4ZmKrTuofO4R3 SHy7qf3usecE.mHsdxy_TP_TrMgXR8F8vg.vMGKar_8giI4jS6CrQgaNZ128Mkl83irUseDHt_.k hU5iElv4zZF5ULWj3w4sBAliyxlLz1DtSHcshai_IZ8rpaqpkh45R9VKHZozRnD4dBzoGK0IZ0E5 pHKmXRPkmxvQXrG.g8iYt61qeLKfmecA6TmwgDD1.Kbh_WA9hYAu5zWGedKvIObN0efhe_vMyCpt fsKwjfSCIWpghns10tscOvhBa324O8rqipHdnQDWp2O5xTkMJiDkBS41gf3psn0w8fLUhL_1eBJg 4rUHbkBKfObqAvXBMD9XSEdJPTWvLzzBA8fGvWQNRK5VKhh57YWsVQmBw.6cHRO_UrckDYHwmKo9 pYAhw5fZ3GPLeEodAhByPuOoLkuNF6KsvWXvRv4OpVgw12lhnCUcTGwtA77UJ2vV.3ZbYJe9W8IY Qo2FZ_8cXlvmJICng9KlsqqFvTWJ5Qg3k1AmorcaAXdZ390QJ93LE8WPya1gnTS7s6k5ehP7pmHK LUa2sBHqUKBnhMa8VcyfLqp3YAAUxft6a8djfPkECR1SRrp4OvPb2eN0eu1Cha0X7YgDPhc8lmmM jy5W_tNxBHxFbN7hIWQkDC6PNNc3uFK2mLdou2aOCRFM50F81xMhkh5pdIBMe6DZM1dXvGD7l8PY 4c4XniMpLPPGPSJO3FZSUdxHvnxufKzb5cCaxkmBkSExGrb85SMcglpLsAdTTMyy_2DfebN5OBin gwdGwOLIpYOe20HELhOUB5_hrWiJIPCi9ZF8FdgQBojuTB4kV0HE35UBjGO4kz9Tfqsx9S1OgTTu Njifjun1GlasnllrDLAexjI7GeB7qjEcBZZzTUA0KC4S6l8VYnB6MZSIzA802uzxEvjBt9VXFg1S gOzFPQc3t.6lCH_yfrJ2cfTDo97.x4O7cL5qV8G07PGau9m__YQa6kjr8RwNkAGYQzy4JzfAw0c1 9xFQF7FO.npWhglS6hKGLndcCeYzxJZd2NR_7TQ4Z8Fdy2seE4Dqh0p93vA1l2o0XIPiGLFuAwzm LV8D6EqoaXJzPDjeL54z8pCHHQPJPp.VjEQfrorxsrBww_GMj.nyPlwSyVpJn5iUdwA6SK27.3ZG pOZleA7aUoprnnwqv1OIjoxvM8zyOv4fVcwKKgiEA1fEcC4iixcDRGFi6aBWd6lQeC8aRlCLpIbC Ug8Lm4fh5KrM3LNPIs4pdo39y6wOkyKCW1RSx3K22VjCmJVhnz_s3thhwD0l0Qxtlh1LIgCCx6ED j9weNL0Y7.5HjiKBh3q5KsHOZMevSNSseEvkAzCudKzqFAvQPB6RpV1V5jxRmO17JHyif8U1L4LO Z.VdUX9M434uRRYJLFU9dNpKjS2pdJ0hrfQxMWpi5oj2vf8Obp6X8GiYXhJMtuFid01nJYgBcF_R q1lcUyYZjbwPg4YBxfa4iXBis_qrt.YLr7.c7RFz2AkQMSSgibqNgoQfwX6vkJXEAl3IH4ywjFG_ .w20C1Noy1d5mkaKphM4VyP5ZWEf2fKGD9698nHQZ8Hxsi014rCXEXDQlGu_KvjbACL_AM57.1fF jmhEIWq5fFgYgqVy5._r_ZXN5Pp83E0EIlSN9SsUb9n2coVrGXEc2j_9o0Ov360RuYTi9LUnei1B omMUWDcnmj8.wogHcMSkFlq0dQxdjkOo0cLH_ZvKV3Mru9A4Crs9_.xugjIq95yGdOnvvdGxs5uQ IJTosziOGREW3g4jmLOdFgdq_4SqsCW7SHSByHkJmtH_DcPFyYL.oF93lMEGubxwMU6mg4M6iMxe .8sok7074LFxLvnRo7gFwlNwfiS_0Wl.gVkuXcRbcrj8ipk.EiNxBdCGnJvH5Aq2jdY9egnZssVS cnyCg0H6X3xwOVLiJ0APx7W7MXTaQ7GDTJtMSUyRUNflv61vdz1dBvNJ2Va26cceU9DAy8JAF10c 74yF3KYIW9N9m2eqjUN_GZ4GaA5pXLxTSZ9SrLSlqt1_ojf._JvSAwCWtoLjWqWl_2Cq35DGdKtp 1IpzqBCQEOa6dlAPoUjVcV8yRVsZtZahnRpqH6qrdmPympduFB50GkAb.tjFIvWuHOnSB2drGS92 w75wqvjykMizfbkoCHCl06154PXp_8As1MyMsszvzbLDhEfBx7MH57HvD6VbcRW2IWhwv1vYshN8 gCHjAetllAq8iDwloAMjexl3juJOHG_iwmnlvlmz0w.Zssze5R9NWFRJea.k.Sx2ciSVjk5tOa5d wgIXt X-Sonic-MF: X-Sonic-ID: e130c1c3-066d-41df-8d6d-49210aca6e47 Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Thu, 12 Oct 2023 05:08:59 +0000 Received: by hermes--production-bf1-74bfc65597-mrz6v (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 5a302c01b64b707248e69ca8db498afe; Thu, 12 Oct 2023 05:08:55 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.100.2.1.4\)) Subject: RE: git: 989c5f6da990 - main - freebsd-update: create deep BEs by default [really about if -r for bectl create should just go away] Message-Id: <6AA52432-32DF-4C2D-B061-F207521F7397@yahoo.com> Date: Wed, 11 Oct 2023 22:08:43 -0700 To: Kyle Evans , Current FreeBSD X-Mailer: Apple Mail (2.3774.100.2.1.4) References: <6AA52432-32DF-4C2D-B061-F207521F7397.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.146:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.146:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S5d320Xvnz4fDG Kyle Evans wrote on Date: Thu, 12 Oct 2023 02:54:13 UTC : > The branch main has been updated by kevans: >=20 > URL: = https://cgit.FreeBSD.org/src/commit/?id=3D989c5f6da99081b1f2b76ec09e91078e= 531e1250 >=20 > commit 989c5f6da99081b1f2b76ec09e91078e531e1250 > Author: Kyle Evans > AuthorDate: 2023-10-12 02:51:07 +0000 > Commit: Kyle Evans > CommitDate: 2023-10-12 02:54:03 +0000 >=20 > freebsd-update: create deep BEs by default >=20 > The -r flag to bectl needs to go away, and we need to just do the = right > thing. In the meantime, we can apply an -r in freebsd-update as a > minimal fix to stop creating partial backups in these (non-default) = deep > BE setups. These notes about not about the specific commit, nor about if -r like = behavior should be the default for bectl create. The notes are about if the currently "not -r" bectl create behavior = should become impossible vs. being supported --or, more accurately, what layouts are = possible. (In case I'm misreading the implications of the -r wording.) The primary = reason I use zfs is to use bectl, not for the other kinds of reasons zfs is = typically used for. I use the likes of: BE Active Mountpoint Space Created build_area_for-main-CA72 - - 1.99G 2023-09-20 10:19 main-CA72 NR / 4.50G 2023-09-21 10:10 NAME CANMOUNT MOUNTPOINT zopt0 on /zopt0 . . . zopt0/ROOT on none zopt0/ROOT/build_area_for-main-CA72 noauto none zopt0/ROOT/main-CA72 noauto none zopt0/poudriere on = /usr/local/poudriere zopt0/poudriere/data on = /usr/local/poudriere/data zopt0/poudriere/data/.m on = /usr/local/poudriere/data/.m zopt0/poudriere/data/cache on = /usr/local/poudriere/data/cache zopt0/poudriere/data/images on = /usr/local/poudriere/data/images zopt0/poudriere/data/logs on = /usr/local/poudriere/data/logs zopt0/poudriere/data/packages on = /usr/local/poudriere/data/packages zopt0/poudriere/data/wrkdirs on = /usr/local/poudriere/data/wrkdirs zopt0/poudriere/jails on = /usr/local/poudriere/jails zopt0/poudriere/ports on = /usr/local/poudriere/ports zopt0/tmp on /tmp zopt0/usr off /usr zopt0/usr/13_0R-src on /usr/13_0R-src zopt0/usr/alt-main-src on /usr/alt-main-src zopt0/usr/home on /usr/home zopt0/usr/local on /usr/local zopt0/usr/main-src on /usr/main-src zopt0/usr/ports on /usr/ports zopt0/usr/src on /usr/src zopt0/var off /var zopt0/var/audit on /var/audit zopt0/var/crash on /var/crash zopt0/var/db noauto /var/db zopt0/var/db/pkg on /var/db/pkg zopt0/var/db/ports on /var/db/ports zopt0/var/log on /var/log zopt0/var/mail on /var/mail zopt0/var/tmp on /var/tmp where every "CANMOUNT on" for a zopt0/[a-z]... prefixed row ( not zopt0/ROOT/* ) is used when booting any of: zopt0/ROOT/build_area_for-main-CA72 noauto none zopt0/ROOT/main-CA72 noauto none So: shared, not duplicated. The update sequence creates a snapshot of zopt0/ROOT/main-CA72 and then creates a zopt0/ROOT/new-main-CA72 from that which is then mounted and that is what the installkernel and installworld update. Dismount. Temporarily activate it. Reboot. Destroy build_area_for-main-CA72 . Rename main-CA72 to build_area_for-main-CA72 . Rename new-main-CA72 to main-CA72 . (It, then, again looks like the above.) I sometimes also temporarily have a zopt0/ROOT/alt-main-CA72 that also shares to avoid duplication. (I'll not get into the details, but build_area_for-main-CA72 is used to do the buildworld buildkernel and is what I can revert to in case of problems discovered later. I've not shown the build tree areas above, just to keep things simpler. They too are shared across the BE's.) I've no reason to want to maintain duplicates of any of that " shared across zopt0/ROOT/* " material: no deep BE setup desired. I've got such a set up (up to naming differences) as my default boot media for each of: ThreadRipper 1950X, HoneyComb, Windows DevKit 2023, MACCHIATObin Double Shot. I also sometimes use such boot media with the 8 GiByte RPI4B's. (The smaller capacity systems [all aarch64/armv7] basically just boot UFS media --that I normally produce from the HoneyCmb's bectl based boot context.) If such ends up as unsupportable, it will effectively eliminate my reason for using bectl (and, so, zfs): the sharing is important to my use. =3D=3D=3D Mark Millard marklmi at yahoo.com From nobody Thu Oct 12 05:12:59 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5d7f4xMqz4xG23 for ; Thu, 12 Oct 2023 05:13:02 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5d7f4JZSz4jDq; Thu, 12 Oct 2023 05:13:02 +0000 (UTC) (envelope-from kevans@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697087582; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1PzQuexNLhf/+s6a8WFs5RCsUU7o8XCndgx/jHdR90A=; b=vklNZez3iC7I/+lQqfi75Q8pOBdo1juoV2V1U7X5spfsJG8/IzepUjxBBL6W8O/dG49UWg 9jLgYaNRCgMqTA7EDy6Qeeol6vfqpeNYsyYzGJfnNaGYxe80zQL83mbI+Ouwdvj4yXm6Aa OHl1yi33vxle6H/NG7LZ3v2K9OjElFleCH7iKM9FfmPhExk6pDorQXgdTnm0FBzKOGJADk ss4lxD3toXb+bkg7R8SW3i7g5sip/tyJF65B8xsizCKlF+wegmcLXr+mB/ksLvosr4QfSn OsJHBHx/guOrsQsBGcfNBwDFqhS+qmQ9+5N5LgPRbxQqkdugb58Yg0oGe8MtMw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697087582; a=rsa-sha256; cv=none; b=MfgXdg3dDXQd+xCbCBbOqyXTDeiR6e77EoFRxsKurZRW0ynmr0roxCaqWtIB05rTCMysmM pMFluTp9gOo9kzsLKYTWD8RaMvyl9MeCLUxNhSEXkbkBIqykdEcEeFFPJQDXEaaBc5P2Fl pB3p2HA7vAG9pvwENJhacP0QWvfIX+dkw00CqPfene4CH+tghpkllWJEK89a8PpGU8q5Q0 8WGf6lxT9Du8K9GnJA+kNMpAAJN5l3Gn7zt0oUDOIhHFZM24vdo37MQUrFDHihyLogZQhy asXbueceGk8Cqvv4UxGFOx6xzx1iZLGluq4cqxW2YmTt3MSPUvYGM9BGucvzfg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697087582; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1PzQuexNLhf/+s6a8WFs5RCsUU7o8XCndgx/jHdR90A=; b=jVLTUAXZtXolUXgu530grck9TuH2H6xLMXUEkes6pWYBUIbHCHrV06eopG/MjdB59TRhup Kk46O6IQak44Xl9+HTBQwi8GK5Y/s7e40kdNgFQTzvxKvmS1SEesb6EFMjLmPlAslnQZHo YRvr9qBRq4SB9CJpz2ss+SA2TMU8sW3jnG4v8CBpu/8Tgbmdm2+ZnCysphzChWp+asa4Po 6u9O69qfqmZLUj98wFQalxFA3zihhVq113ScHCkdy8icfwrfOy8RvMcmi1KAiJPuZUCkzI ABd9hO8Yu3DQ36OQoQM/PA7p7gynF6hthmPGTtmnUCFP/3Oa1z9cZ0xzmnCuGg== Received: from [10.9.4.95] (unknown [209.182.120.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: kevans/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S5d7f1lJTzBRl; Thu, 12 Oct 2023 05:13:02 +0000 (UTC) (envelope-from kevans@FreeBSD.org) Message-ID: <6b3e4f84-9d98-4e4f-a60f-952d59eb3008@FreeBSD.org> Date: Thu, 12 Oct 2023 00:12:59 -0500 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: git: 989c5f6da990 - main - freebsd-update: create deep BEs by default [really about if -r for bectl create should just go away] Content-Language: en-US To: Mark Millard , Current FreeBSD References: <6AA52432-32DF-4C2D-B061-F207521F7397.ref@yahoo.com> <6AA52432-32DF-4C2D-B061-F207521F7397@yahoo.com> From: Kyle Evans In-Reply-To: <6AA52432-32DF-4C2D-B061-F207521F7397@yahoo.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit On 10/12/23 00:08, Mark Millard wrote: > Kyle Evans wrote on > Date: Thu, 12 Oct 2023 02:54:13 UTC : > >> The branch main has been updated by kevans: >> >> URL: https://cgit.FreeBSD.org/src/commit/?id=989c5f6da99081b1f2b76ec09e91078e531e1250 >> >> commit 989c5f6da99081b1f2b76ec09e91078e531e1250 >> Author: Kyle Evans >> AuthorDate: 2023-10-12 02:51:07 +0000 >> Commit: Kyle Evans >> CommitDate: 2023-10-12 02:54:03 +0000 >> >> freebsd-update: create deep BEs by default >> >> The -r flag to bectl needs to go away, and we need to just do the right >> thing. In the meantime, we can apply an -r in freebsd-update as a >> minimal fix to stop creating partial backups in these (non-default) deep >> BE setups. > > These notes about not about the specific commit, nor about if -r like behavior > should be the default for bectl create. > > The notes are about if the currently "not -r" bectl create behavior should become > impossible vs. being supported --or, more accurately, what layouts are possible. > (In case I'm misreading the implications of the -r wording.) The primary reason > I use zfs is to use bectl, not for the other kinds of reasons zfs is typically > used for. > > [...] > > I've got such a set up (up to naming differences) as my default > boot media for each of: ThreadRipper 1950X, HoneyComb, > Windows DevKit 2023, MACCHIATObin Double Shot. I also sometimes use > such boot media with the 8 GiByte RPI4B's. (The smaller capacity > systems [all aarch64/armv7] basically just boot UFS media --that I > normally produce from the HoneyCmb's bectl based boot context.) > > If such ends up as unsupportable, it will effectively eliminate my > reason for using bectl (and, so, zfs): the sharing is important to > my use. > -r should do the right thing in all cases, the only real difference from w/o -r is that it'll recurse into subordinates of the BE dataset. For the common case, including yours, that means there's no functional difference and negligible overhead added (because we still have to try to iterate over childfren, even if there are none). Thanks, Kyle Evans From nobody Thu Oct 12 06:38:07 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5g35038qz4xLDd for ; Thu, 12 Oct 2023 06:39:13 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5g3447xsz4vjp; Thu, 12 Oct 2023 06:39:12 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; none List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1697092737; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=A1WymM1L5+bT0x23nlbcFq3WRyITEJh7z1yf706tKhU=; b=RXqrubvEauqDrM8qaQRw0vvJRExlqRjEniGK1IhSREwr02SpznwxD+wRmZIQoFxL4whl7N Z1fOeMhECux0+VdkCmXC6cV9Zs7AAKI/HvcEMPp15D4IYgYJTcVRUZWZ4V1CPz/8szzB9R q6IDffpp1qKBJcXEe56CkxkmUfY5J33aYMb712Zq23pbTlwrPz7jJ4OBi8y07lbehHisbF WyCtwNmVaa8SXKW1hRemqB8MNU4SFiBh17cHmAIlFLbwkzVsC39SLROZUSdbT5oenMWUeG mjWEEzkvXO0PShnqADK9jbYeHEu+N6uvmUOo1BVP3yKzP8y627srIKR0qaYwSg== Date: Thu, 12 Oct 2023 08:38:07 +0200 From: Alexander Leidinger To: Mark Millard Cc: Kyle Evans , Current FreeBSD Subject: Re: git: 989c5f6da990 - main - freebsd-update: create deep BEs by default [really about if -r for bectl create should just go away] In-Reply-To: <6AA52432-32DF-4C2D-B061-F207521F7397@yahoo.com> References: <6AA52432-32DF-4C2D-B061-F207521F7397.ref@yahoo.com> <6AA52432-32DF-4C2D-B061-F207521F7397@yahoo.com> Message-ID: <9cd8008661363f6ca97fdd9d25cab8bb@Leidinger.net> X-Sender: Alexander@Leidinger.net Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_830f16000e43470e5c8cac3c48dcdea0"; micalg=pgp-sha256 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE] X-Rspamd-Queue-Id: 4S5g3447xsz4vjp This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_830f16000e43470e5c8cac3c48dcdea0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Am 2023-10-12 07:08, schrieb Mark Millard: > I use the likes of: > > BE Active Mountpoint Space Created > build_area_for-main-CA72 - - 1.99G 2023-09-20 10:19 > main-CA72 NR / 4.50G 2023-09-21 10:10 > > NAME CANMOUNT MOUNTPOINT > zopt0 on /zopt0 > . . . > zopt0/ROOT on none > zopt0/ROOT/build_area_for-main-CA72 noauto none > zopt0/ROOT/main-CA72 noauto none > zopt0/poudriere on > /usr/local/poudriere > zopt0/poudriere/data on > /usr/local/poudriere/data > zopt0/poudriere/data/.m on > /usr/local/poudriere/data/.m > zopt0/poudriere/data/cache on > /usr/local/poudriere/data/cache > zopt0/poudriere/data/images on > /usr/local/poudriere/data/images > zopt0/poudriere/data/logs on > /usr/local/poudriere/data/logs > zopt0/poudriere/data/packages on > /usr/local/poudriere/data/packages > zopt0/poudriere/data/wrkdirs on > /usr/local/poudriere/data/wrkdirs > zopt0/poudriere/jails on > /usr/local/poudriere/jails > zopt0/poudriere/ports on > /usr/local/poudriere/ports > zopt0/tmp on /tmp > zopt0/usr off /usr > zopt0/usr/13_0R-src on /usr/13_0R-src > zopt0/usr/alt-main-src on /usr/alt-main-src > zopt0/usr/home on /usr/home > zopt0/usr/local on /usr/local [...] > If such ends up as unsupportable, it will effectively eliminate my > reason for using bectl (and, so, zfs): the sharing is important to > my use. Additionally/complementary to what Kyle said... The -r option is about zop0/ROOT/main-CA72 zop0/ROOT/main-CA72/subDS1 zop0/ROOT/main-CA72/subDS2 A shallow clone is only taking zop0/ROOT/main-CA72 into account, while a -r clone is also cloning subDS1 and subDS2. So as Kyle said, your (and my) use case are not affected by this. Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_830f16000e43470e5c8cac3c48dcdea0 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmUnlFwACgkQEg2wmwP4 2IYmDA/+KfhyZWEiRdUE7piT8D3Wyg3tYsAmLHq+ZuRY0EM+mIcsUP1JObh5lQ49 WPnpjHln9P9Jd428JzqeCQ/6cu1G1b2x5eYDFU6JOtLYob3sT81q62sjwSVQ2lqj ms/0usXtDORDUjnOCWkctpqm/ruwQVTWdvwDNTIl5mdX8bj0eVatfZpJoFA4ERYX 7Q8DYG+QqnpHX6mZfJhsg89uSTfQSfQTehM3iMGSDSYNuM9C6T5rh2RBD9kjA60c 6C8eHDuNQgJ0TfQ/v/aLCoUGOFUk79bJfnZmyaZ0nEZGTrE9Ct0yx+6ekgPLGj8t 5MJE6lHn35+hR50y5e7A2UIoBcDJoNFgIgWiuMzi8qGSN5pWAy5FXsoPuCzH37oz F1UyLSDH8Xnat3PUAeMl73xRxegDJhR2jxUKaOd/loJTGwsIw7G8bfACmMtqiRl0 O8YF20oaXLNsjKgc7Otk48eUfkiQq3Uyrx7nDSiyR1xu4wR49OTatzP15bdefMpm O9VPveEcTdmUL1uONc3x5xTbyMBA8D60IjHaxAIPpti1kk9tRvj0c49OLEBmpDny UgxRidFbuSHJPZfB1Xcg5x/49fcdEM+fe1E3bk0FGivR75y9GHXamYDtb45dV7VD 4/c1Op6tW1HkaQeOg++6t9giJOcbnHKLzOYfWUGQrlqyYssXyVY= =yNjz -----END PGP SIGNATURE----- --=_830f16000e43470e5c8cac3c48dcdea0-- From nobody Thu Oct 12 17:32:46 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5xYH0D2qz4wgXb for ; Thu, 12 Oct 2023 17:32:51 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5xYG2kqRz3LwQ for ; Thu, 12 Oct 2023 17:32:50 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=XXEaQXEk; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=JTrHGvZg; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.26 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 7DE395C01A5 for ; Thu, 12 Oct 2023 13:32:49 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute1.internal (MEProxy); Thu, 12 Oct 2023 13:32:49 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to; s=fm2; t=1697131969; x=1697218369; bh=9dRsdqL5RHEzsQdioe+R21J33 aZWVmNy5w0aY0bzRYk=; b=XXEaQXEkD9NmebfJSGtqVxNZGMk+IUZMjhSMV1Yfu YdmLTUPC5AtoHGWX32KbItYjDzjm7ib+Xs2evPVQOUAh8C9J4njy4xtrWcSJVJn+ PQznlPh7Wi7hij25FAa5u2d1opsm7qVTj6BgVtpE3k+McZ9v7CbzhzIoUzP1wNnH cjbHnlbbxapkA8zdfqLCEATqkL2XIgLpacIZOFGqO9ZOSOxKtRsJ2B2OQsfAvzBt QjBHc5GWk2CWG3PfBHscV1Eid6bShSwSVYEpxKjEKOUkUSnt4+nUEZRlNtH8B0jS vySQViZq+1jPuYVj5qduG7akQZoTEtJ4FoiwUT8pKhcuA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm2; t= 1697131969; x=1697218369; bh=9dRsdqL5RHEzsQdioe+R21J33aZWVmNy5w0 aY0bzRYk=; b=JTrHGvZgyJmxb2uPzwNKNvPqjviByp3TmDL4siEpg/7RiSFDo5a 8pXlGDMscNv88MUFDIlgTctYx7Dql+FTVFxFt3a97HmXSua1RR5h6YXpLrNFnJrD cxn9BptGuVzr/1qXZPVQfstMFkjaaIhOwXAB+pAa89P/RtYdCuibEPRumMM+PvzT l0A3gm2Hun+TpCxMekYKXHmWPBMoRmXP+t7idCpP7Vpfq78So/arbSAaKS8JpjFc yavBasHUMfu9R1kai0TGeXTDg+rx+bZkRkvf9YJisaOLpcH17J0eOjbwnS+zNCSN RWm76SQvPgOiFfAjK9jlD+Kcz6RII7wVnNg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedriedtgddutdegucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgrthht vghrnhepveduffeivdfffffghfegfeejfefftdeiteehteekfefhvdefgfettdeuheegff eunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepvhho ihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 12 Oct 2023 13:32:48 -0400 (EDT) Date: Thu, 12 Oct 2023 18:32:46 +0100 From: void To: freebsd-current@freebsd.org Subject: how to set vfs.zfs.arc.max in 15-current ? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.44 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.997]; NEURAL_HAM_SHORT(-0.74)[-0.743]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.26:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S5xYG2kqRz3LwQ Is there a new way to set arc.max in 15-current? It's no longer settable (except to "0") in main-n265801 (Oct 7th) while multiuser. # sysctl vfs.zfs.arc.max=8589934592 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=8589934592: Invalid argument -- From nobody Thu Oct 12 18:27:49 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S5ymr5krCz4wksg for ; Thu, 12 Oct 2023 18:27:56 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from omta002.cacentral1.a.cloudfilter.net (omta002.cacentral1.a.cloudfilter.net [3.97.99.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S5ymq6GpFz3Rwt for ; Thu, 12 Oct 2023 18:27:55 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of cy.schubert@cschubert.com has no SPF policy when checking 3.97.99.33) smtp.mailfrom=cy.schubert@cschubert.com; dmarc=none Received: from shw-obgw-4004a.ext.cloudfilter.net ([10.228.9.227]) by cmsmtp with ESMTPS id qsrWq969e6aAfr0PbqQFSj; Thu, 12 Oct 2023 18:27:55 +0000 Received: from spqr.komquats.com ([70.66.152.170]) by cmsmtp with ESMTPSA id r0PZqcqpTg1rfr0Paqq6x3; Thu, 12 Oct 2023 18:27:55 +0000 X-Authority-Analysis: v=2.4 cv=f9pbuc+M c=1 sm=1 tr=0 ts=65283aab a=y8EK/9tc/U6QY+pUhnbtgQ==:117 a=y8EK/9tc/U6QY+pUhnbtgQ==:17 a=kj9zAlcOel0A:10 a=bhdUkHdE2iEA:10 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=EkcXrb_YAAAA:8 a=X8yteK5oenFR1dyTPeUA:9 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 a=LK5xJRSDVpKd5WXXoEvA:22 Received: from slippy.cwsent.com (slippy [10.1.1.91]) by spqr.komquats.com (Postfix) with ESMTP id B44EA5F7 for ; Thu, 12 Oct 2023 11:27:49 -0700 (PDT) Received: by slippy.cwsent.com (Postfix, from userid 1000) id AA34F185; Thu, 12 Oct 2023 11:27:49 -0700 (PDT) X-Mailer: exmh version 2.9.0 11/07/2018 with nmh-1.8+dev Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: freebsd-current@freebsd.org Subject: Re: how to set vfs.zfs.arc.max in 15-current ? In-reply-to: References: Comments: In-reply-to void message dated "Thu, 12 Oct 2023 18:32:46 +0100." List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Thu, 12 Oct 2023 11:27:49 -0700 Message-Id: <20231012182749.AA34F185@slippy.cwsent.com> X-CMAE-Envelope: MS4xfJH9gqygRs9vqRzmyC+W8CJf5ogI4fj1/gOIMWXS1JqVkhwuKbEayu8DfedSCyjfMJ7N+imEJNqAWsFnWxz3YtlU08tnPReMhZjCican8LLcHxf3XOdQ XIEJee7nl0LgTuDX09Tr4gFfKKtmW59qr/K5tUIkEUY+X49t962z0s3ekI/nIKFilGMYbgVsm92wWMBjXhAbK4qMgBSTVOmTw5M= X-Spamd-Bar: / X-Spamd-Result: default: False [-0.70 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; AUTH_NA(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[3.97.99.33:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[cschubert.com]; MIME_TRACE(0.00)[0:+]; REPLYTO_EQ_FROM(0.00)[]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_THREE(0.00)[4]; TO_DN_NONE(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:16509, ipnet:3.96.0.0/15, country:US]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; R_SPF_NA(0.00)[no SPF record] X-Rspamd-Queue-Id: 4S5ymq6GpFz3Rwt In message , void writes: > Is there a new way to set arc.max in 15-current? > > It's no longer settable (except to "0") in main-n265801 (Oct 7th) > while multiuser. > > # sysctl vfs.zfs.arc.max=8589934592 > vfs.zfs.arc.max: 0 > sysctl: vfs.zfs.arc.max=8589934592: Invalid argument Try reducing your arc.max by an order of 10. This suggests that it's probably failing in param_set_arc_max() in the val >= arc_all_memory() comparison.. -- Cheers, Cy Schubert FreeBSD UNIX: Web: https://FreeBSD.org NTP: Web: https://nwtime.org e^(i*pi)+1=0 From nobody Thu Oct 12 22:59:44 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S64pY07qRz4x30Z for ; Thu, 12 Oct 2023 22:59:49 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S64pX0fWSz4MWh for ; Thu, 12 Oct 2023 22:59:48 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=aCJmL9go; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=HL+SLAnj; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id 8DB2E5C0269 for ; Thu, 12 Oct 2023 18:59:46 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute3.internal (MEProxy); Thu, 12 Oct 2023 18:59:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1697151586; x=1697237986; bh=dY Wsw5WZk013LeDDEej2dFu9HKy/JQv2fDqrtFkKt9k=; b=aCJmL9go3a586dK+nR KN1AHRf/6JhDLaVeX5D+tmntOYPHGQiwWjjyC52MYx/h/bKeL+gVPe9XwzeBoH5/ KiRQOP7LDOEw6WJZy6/7XRhGH9+a1eWx+41m/53cyO0pw+ON0luFBiIZ76rNSpjD l8YgsKDhyeAVpt3eLOcEQnnzPsxOwcwfJ5NOQ5uZcVMmAbRS78YSPYhlrPbCtq0M oFcRB4C4tvF+EGzS8bL2/++cGyTQRknQ4nQ5sMIEgJNVfdoR/ZG2yFVF5QA6ybq3 ser90Ny4fgmfKVZRO9rdLxy/8bZ/Y0mBe4g4KqhpIB6oDsm/L/pmm9+WXwRODpLV I63w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1697151586; x=1697237986; bh=dYWsw5WZk013L eDDEej2dFu9HKy/JQv2fDqrtFkKt9k=; b=HL+SLAnjclBTSovrkipwPpO3B5Jua 3VMLHQCekWKtuLTOI/pZjjogEenAczhCmo06wrczDVviJCt8p72fjDF/G+Fv0ZPN 0Oa2fmX24mgR3tNEhxKeWxnOCGknDggy6J3PaB7hc73tecna9lXmhcmfKEgKoJqV WV1HH6i4B5iicy0p5d9KEoSc5O2XPnfgnMeU5FuDW5VJCOeVBXeVMTB/Ur2HpWMM x6mQIx7GO5USfiu0RRWcziJk22b+d3SM5s+yKW6EJn9FlY8CmDDgISNnBhlca6wk AbcbilHFWQHeuCPde6+cpLFSsaHsX/4FOXqJnSumNQgo0C8YF5yE1o+7g== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedriedugdduiecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 12 Oct 2023 18:59:46 -0400 (EDT) Date: Thu, 12 Oct 2023 23:59:44 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: how to set vfs.zfs.arc.max in 15-current ? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20231012182749.AA34F185@slippy.cwsent.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <20231012182749.AA34F185@slippy.cwsent.com> X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.55 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-0.99)[-0.995]; NEURAL_HAM_MEDIUM(-0.95)[-0.952]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; NEURAL_HAM_SHORT(-0.00)[-0.005]; RCVD_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S64pX0fWSz4MWh On Thu, Oct 12, 2023 at 11:27:49AM -0700, Cy Schubert wrote: >In message , void writes: >> Is there a new way to set arc.max in 15-current? >> >> It's no longer settable (except to "0") in main-n265801 (Oct 7th) >> while multiuser. >> >> # sysctl vfs.zfs.arc.max=8589934592 >> vfs.zfs.arc.max: 0 >> sysctl: vfs.zfs.arc.max=8589934592: Invalid argument > >Try reducing your arc.max by an order of 10. This suggests that it's >probably failing in param_set_arc_max() in the val >= arc_all_memory() >comparison.. Hi, thanks for replying. Sadly, your suggestion doesn't work in this case: root@beer:/usr/src# sysctl vfs.zfs.arc.max=8589934592 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=8589934592: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=858993459 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=858993459: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=85899345 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=85899345: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=8589934 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=8589934: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=858993 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=858993: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=85899 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=85899: Invalid argument root@beer:/usr/src# sysctl vfs.zfs.arc.max=8589 vfs.zfs.arc.max: 0 sysctl: vfs.zfs.arc.max=8589: Invalid argument -- From nobody Fri Oct 13 03:40:57 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6C393nVfz4wMRX for ; Fri, 13 Oct 2023 03:41:09 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6C382JTNz3FlS for ; Fri, 13 Oct 2023 03:41:08 +0000 (UTC) (envelope-from pete@nomadlogic.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=nomadlogic.org header.s=04242021 header.b=E34B1Ltr; spf=pass (mx1.freebsd.org: domain of pete@nomadlogic.org designates 66.165.241.226 as permitted sender) smtp.mailfrom=pete@nomadlogic.org; dmarc=pass (policy=quarantine) header.from=nomadlogic.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nomadlogic.org; s=04242021; t=1697168460; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=701FwNRPc3nu7tgAmk87df25JaaQ5OghELGsvoQ1cmw=; b=E34B1Ltrmkm02eHmkFyx2Nhj/R5YPTb6LR9kX1NZNYbJA0/5MTobVW73fSXqIx25TTHqws Q1d0RSXHj7M8TgHf64JyGyyigTdq/fubV7QSNCA1cXKMkU1P/ttSpmFEr6Q5gVFW+1LbYq INcrVsLzXIYGAPnGIyi4ZmSIKGB11tk= Received: from [192.168.1.240] (cpe-24-24-168-214.socal.res.rr.com [24.24.168.214]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 795a528f (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO) for ; Fri, 13 Oct 2023 03:40:59 +0000 (UTC) Message-ID: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> Date: Thu, 12 Oct 2023 20:40:57 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-US To: freebsd-current@freebsd.org From: Pete Wright Subject: nvme timeout issues with hardware and bhyve vm's Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[nomadlogic.org,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[nomadlogic.org:s=04242021]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[nomadlogic.org:+]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; RCVD_TLS_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4S6C382JTNz3FlS hey there - i was curious if anyone has had issues with nvme devices recently. i'm chasing down similar issues on my workstation which has a physical NVMe zroot, and on a bhyve VM which has a large pool exposed as a NVMe device (and is backed by a zvol). on the most recent bhyve issue the VM reported this: Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432416007567 vs 13737432371683671 Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432718499597 vs 13737432371683671 Oct 13 02:52:52 emby kernel: nvme1: timeout with nothing complete, resetting Oct 13 02:52:52 emby kernel: nvme1: Resetting controller due to a timeout. Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_WAITING Oct 13 02:52:52 emby kernel: nvme1: resetting controller Oct 13 02:52:53 emby kernel: nvme1: waiting Oct 13 02:53:23 emby syslogd: last message repeated 114 times Oct 13 02:53:23 emby kernel: nvme1: controller ready did not become 1 within 30500 ms Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:1 cid:119 nsid:1 lba:4968850592 len:256 Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:1 sqid:1 cid:119 cdw0:0 Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:6 cid:0 nsid:1 lba:5241952432 len:32 Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:123 nsid:1 lba:4968850336 len:256 Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:1 sqid:3 cid:123 cdw0:0 Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:0 nsid:1 lba:5242495888 len:256 Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:3 cid:0 cdw0:0 Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 lba:528 len:16 Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:5 cid:0 nsid:1 lba:4934226784 len:96 Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:3 cid:0 cdw0:0 Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 lba:6442449936 len:16 Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:3 cid:0 cdw0:0 Oct 13 02:53:25 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 lba:6442450448 len:16 Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:3 cid:0 cdw0:0 Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:5 cid:0 cdw0:0 Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 m:0 dnr:0 sqid:6 cid:0 cdw0:0 Oct 13 02:53:25 emby kernel: nvd1: detached I had similar issues on my workstation as well. Scrubbing the NVMe device on my real-hardware workstation hasn't turned up any issues, but the system has locked up a handful of times. Just curious if others have seen the same, or if someone could point me in the right direction... thanks! -pete -- Pete Wright pete@nomadlogic.org From nobody Fri Oct 13 03:45:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6C8Y2cH8z4wMcM for ; Fri, 13 Oct 2023 03:45:49 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x62d.google.com (mail-ej1-x62d.google.com [IPv6:2a00:1450:4864:20::62d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6C8Y0bVtz3Gqr for ; Fri, 13 Oct 2023 03:45:49 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x62d.google.com with SMTP id a640c23a62f3a-99bdeae1d0aso269820166b.1 for ; Thu, 12 Oct 2023 20:45:48 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1697168745; x=1697773545; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ONgu5ezs6e/tZk7MKHoLTAN985ZOfaUowBpa2nVDm20=; b=cZekgxQStSyAKRsuFCtsUhUhMbM8ynOmenNAhejDLUIZs/EeQ99TQbnMZl7W0P7yh/ umA+zATs2VxsDHJiwum/H3EI+hSuCDpq0Ef5ocpyESRuHhGgqMBWd0/d7cW4P5I+HDEi u7onxi8srFSWLzIFWzb9DnSsEmppRSSAlsc6aCow19JEJ+cdIdQQcmqPGshBnON4FGqE pr+eU5wX/7WvN5JNy6sWgydZy26vtSTbMwSaCb4mT3f5CZt9eQ2RXs65xsuXyHZoVAum 7MXmYF7ok3AQnyFgG2QukRGCfHaIzvjAHKU8g0y7PDX2kpKTAZYQbqq1m7r4ldHj2eY5 kR5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697168745; x=1697773545; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ONgu5ezs6e/tZk7MKHoLTAN985ZOfaUowBpa2nVDm20=; b=Q6RsGBOJyKDWdRmJPnKW2U5cNDjHrSqpI2GU5W7HbxaqZgERDMxynurWSJRFP5ApOl C/8pHd9ar7weu5xkYLfodwejwUKba78FnHPpGySCzi6QhXIQhfQ3nVdRlRjDdc9bhboZ D9PfiTNJ6eNf9jbqjvNIVnnNuSslO16mDFwNLHF3jm93YyZ+Lk+VxnDFDkSekXbqDp1a npyvCcfrZqdSh+jsf1fFFnee9B3DVaJ9kwS1hG3Jfy0cVnRH0aRM0Aj/6Bhb8BXra4B2 f0mnPC4Jj7wC+qTpiRHdLQGxAQelPfMj4IHzt+nqTQv6cIi1gKzsrmr4VN6jTslZ2Pit qhqQ== X-Gm-Message-State: AOJu0YxUK7DG1iq4AfLra73eMm0dS7NtXSaU5ZBbhn6TKI/8fzycLoD5 v4oQvIOKsw9SOjAoC6gAqMeU++E5hUeY+fWFu0IV4g== X-Google-Smtp-Source: AGHT+IFUBHIpSQBmKdUU/5sd9u8dDC3LDB6+pG193OT2ZyxVt311Y2zPFiubwPVouT4LqDMemwpWiwH0GrUhNrOpMks= X-Received: by 2002:a17:906:304c:b0:9b2:b768:3cfc with SMTP id d12-20020a170906304c00b009b2b7683cfcmr21765885ejd.1.1697168744279; Thu, 12 Oct 2023 20:45:44 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> In-Reply-To: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> From: Warner Losh Date: Thu, 12 Oct 2023 21:45:32 -0600 Message-ID: Subject: Re: nvme timeout issues with hardware and bhyve vm's To: Pete Wright Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="0000000000002086d3060790e45c" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4S6C8Y0bVtz3Gqr --0000000000002086d3060790e45c Content-Type: text/plain; charset="UTF-8" What version is that kernel? Warner On Thu, Oct 12, 2023, 9:41 PM Pete Wright wrote: > hey there - i was curious if anyone has had issues with nvme devices > recently. i'm chasing down similar issues on my workstation which has a > physical NVMe zroot, and on a bhyve VM which has a large pool exposed as > a NVMe device (and is backed by a zvol). > > on the most recent bhyve issue the VM reported this: > > Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432416007567 vs > 13737432371683671 > Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432718499597 vs > 13737432371683671 > Oct 13 02:52:52 emby kernel: nvme1: timeout with nothing complete, > resetting > Oct 13 02:52:52 emby kernel: nvme1: Resetting controller due to a timeout. > Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_WAITING > Oct 13 02:52:52 emby kernel: nvme1: resetting controller > Oct 13 02:52:53 emby kernel: nvme1: waiting > Oct 13 02:53:23 emby syslogd: last message repeated 114 times > Oct 13 02:53:23 emby kernel: nvme1: controller ready did not become 1 > within 30500 ms > Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o > Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:1 cid:119 nsid:1 > lba:4968850592 len:256 > Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:1 sqid:1 cid:119 cdw0:0 > Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o > Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:6 cid:0 nsid:1 > lba:5241952432 len:32 > Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:123 nsid:1 > lba:4968850336 len:256 > Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:1 sqid:3 cid:123 cdw0:0 > Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:0 nsid:1 > lba:5242495888 len:256 > Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:3 cid:0 cdw0:0 > Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 lba:528 len:16 > Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:5 cid:0 nsid:1 > lba:4934226784 len:96 > Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:3 cid:0 cdw0:0 > Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 > lba:6442449936 len:16 > Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:3 cid:0 cdw0:0 > Oct 13 02:53:25 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 > lba:6442450448 len:16 > Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:3 cid:0 cdw0:0 > Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:5 cid:0 cdw0:0 > Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0 > m:0 dnr:0 sqid:6 cid:0 cdw0:0 > Oct 13 02:53:25 emby kernel: nvd1: detached > > > > I had similar issues on my workstation as well. Scrubbing the NVMe > device on my real-hardware workstation hasn't turned up any issues, but > the system has locked up a handful of times. > > Just curious if others have seen the same, or if someone could point me > in the right direction... > > thanks! > -pete > > -- > Pete Wright > pete@nomadlogic.org > > --0000000000002086d3060790e45c Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
What version is that kernel?
=
Warner=C2=A0

On Thu, Oct 12, 2023, 9:= 41 PM Pete Wright <pete@nomadlogi= c.org> wrote:
hey there - i = was curious if anyone has had issues with nvme devices
recently.=C2=A0 i'm chasing down similar issues on my workstation which= has a
physical NVMe zroot, and on a bhyve VM which has a large pool exposed as a NVMe device (and is backed by a zvol).

on the most recent bhyve issue the VM reported this:

Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432416007567 vs 13737432371683671
Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_START 13737432718499597 vs 13737432371683671
Oct 13 02:52:52 emby kernel: nvme1: timeout with nothing complete, resettin= g
Oct 13 02:52:52 emby kernel: nvme1: Resetting controller due to a timeout.<= br> Oct 13 02:52:52 emby kernel: nvme1: RECOVERY_WAITING
Oct 13 02:52:52 emby kernel: nvme1: resetting controller
Oct 13 02:52:53 emby kernel: nvme1: waiting
Oct 13 02:53:23 emby syslogd: last message repeated 114 times
Oct 13 02:53:23 emby kernel: nvme1: controller ready did not become 1
within 30500 ms
Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o
Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:1 cid:119 nsid:1
lba:4968850592 len:256
Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:1 sqid:1 cid:119 cdw0:0
Oct 13 02:53:23 emby kernel: nvme1: failing outstanding i/o
Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:6 cid:0 nsid:1
lba:5241952432 len:32
Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:123 nsid:1
lba:4968850336 len:256
Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:1 sqid:3 cid:123 cdw0:0
Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:3 cid:0 nsid:1
lba:5242495888 len:256
Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:3 cid:0 cdw0:0
Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1 lba:528 len:16=
Oct 13 02:53:23 emby kernel: nvme1: WRITE sqid:5 cid:0 nsid:1
lba:4934226784 len:96
Oct 13 02:53:23 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:3 cid:0 cdw0:0
Oct 13 02:53:23 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1
lba:6442449936 len:16
Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:3 cid:0 cdw0:0
Oct 13 02:53:25 emby kernel: nvme1: READ sqid:3 cid:0 nsid:1
lba:6442450448 len:16
Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:3 cid:0 cdw0:0
Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:5 cid:0 cdw0:0
Oct 13 02:53:25 emby kernel: nvme1: ABORTED - BY REQUEST (00/07) crd:0
m:0 dnr:0 sqid:6 cid:0 cdw0:0
Oct 13 02:53:25 emby kernel: nvd1: detached



I had similar issues on my workstation as well.=C2=A0 Scrubbing the NVMe device on my real-hardware workstation hasn't turned up any issues, but=
the system has locked up a handful of times.

Just curious if others have seen the same, or if someone could point me in the right direction...

thanks!
-pete

--
Pete Wright
pete@nomadlogic.org

--0000000000002086d3060790e45c-- From nobody Fri Oct 13 04:53:07 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6DfF4q4Pz4wRRV for ; Fri, 13 Oct 2023 04:53:09 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6DfF2z0Qz3NVD for ; Fri, 13 Oct 2023 04:53:09 +0000 (UTC) (envelope-from pete@nomadlogic.org) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nomadlogic.org; s=04242021; t=1697172787; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=IiLOxvdjQYrNow/yFNfijRjNPycqfXmQjpmiWFGoZvc=; b=vMfFy40xMAupyQAhlQrV5LrfD3JBKJuPfa5Gne8l5jcwpS1rLRQ1tJ49o7QfkKI5WEzr6T GtZeujengAygdOHddahpd5oqQDJwky6TJtAF+bL/4z59af0sh3l/za6C9tRUmJIJUQbxEv 3ZNWrCaRLP3YkuyY+a1ZcwJbqTxTf9I= Received: from [192.168.1.240] (cpe-24-24-168-214.socal.res.rr.com [24.24.168.214]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 343b44fc (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Fri, 13 Oct 2023 04:53:07 +0000 (UTC) Message-ID: <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> Date: Thu, 12 Oct 2023 21:53:07 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: nvme timeout issues with hardware and bhyve vm's Content-Language: en-US To: Warner Losh Cc: FreeBSD Current References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> From: Pete Wright In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US] X-Rspamd-Queue-Id: 4S6DfF2z0Qz3NVD On 10/12/23 8:45 PM, Warner Losh wrote: > What version is that kernel? oh dang i sent this to the wrong list, i'm not running current. the hypervisor and vm are both 13.2 and my workstation is a recent 14.0 pre-release build. i'll do more homework tomorrow and post to questions or a more appropriate list. -pete -- Pete Wright pete@nomadlogic.org From nobody Fri Oct 13 06:12:47 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6GQN4G5Mz4wX4r for ; Fri, 13 Oct 2023 06:13:00 +0000 (UTC) (envelope-from otis@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6GQN3dL4z3WTM; Fri, 13 Oct 2023 06:13:00 +0000 (UTC) (envelope-from otis@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697177580; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+H3LzEG5jm61O98lX/+ziSqVPqOZM62HP9KSQyC2T/8=; b=sVRk8PR7YEzekuvqYzYSsg4qA7N6TgQRYonfeyPi+HDHOXdr/68NZWtkhvVTWPgQyCyikD UIPvgmULD0Ssf5FXHXiO8QYICNg6BfnnD6pceSTAprKdWZ7V1qin26SnNQJbfrRrCKNkFC D+OH8wZIO2Qzd+igq8MsCXTt4kpg6nyi5xZGJfy+hLBuLGo8qaKPQidXTo9b+LcXyE1ccj sKKWWG6oRcFs+9ApJjCb4OEnMgDIJeKfVLbQjIjmH8Cy85DilaPFQtT+hUTzgarYDBl0Ot 6AEEgST93RefOn/j3hmXihOPtcqxyetmCEkhYRO1i4YdBBtOT1rJx0Dih0DwqQ== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697177580; a=rsa-sha256; cv=none; b=U9Qf+o0OVvB3Eagykn9k847Br98lfWVQ25q7iQ//O8DE0oVOKnRHPoTldQs1KNFe5qZB+4 0HRZP9OMe4QMrgb+U3vTAZLXSeMZuoryPrKJudL3HYK5d2LVp3jt/cOPVfkdZ59luM6ITC jZp3Nhf8oTl0ImJzVdhsRSvMfxOxaj5PkAO7yKq00NhENVF5qv71QE4pH5l2ZzgKPJheG1 /ZVl3jHaOyZWe7ZrOnEW9eZVnvaLm+Nq43epFoixR4U8JT4x0cQtCHL86UiRYqkcaWmcpv hKJT1Plv/8aZeg5slBdMtuUo7mwIEtMlDloZlXpBmAa+gRkL1JQ++NI8+s9u3g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697177580; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=+H3LzEG5jm61O98lX/+ziSqVPqOZM62HP9KSQyC2T/8=; b=p1V1bZXspHfe+MwCgvbBTUTGlTJHnQ+7PchveHWUgYFdyg1vBl0haJ3wG39XGwTkItl7DF qfSZI223FNsm7uJjHK8Ucf43EYllGN+7FxE1IveO2E1MCNB7yCB7QeYnnE7br0XxZqc9eJ r+ls690J5RB9B01FKjjGoplkJ9Ght//nZztcp+8pWcMkfCR968nIoMuRcIJyf+68pecd+v qd9US+bhxJZaZ76MVmf0GOV+nXk2rYBCXId5AtdWUPDlhEGn5Nu0Gqo1VwbqQfJNdduzrD fD0Ve989jv/nIQTJzIQWmroj0IW9ieUg0z/uK/7yEScTYQsZHT8NRIesuKjxKw== Received: from ns2.wilbury.net (ns2.wilbury.net [92.60.51.55]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "svc.wilbury.net", Issuer "R3" (verified OK)) (Authenticated sender: otis) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S6GQN1w4fz197L; Fri, 13 Oct 2023 06:13:00 +0000 (UTC) (envelope-from otis@FreeBSD.org) Received: from smtpclient.apple (gw-upc.owhome.net [188.167.168.254]) (Authenticated sender: juraj@lutter.sk) by svc.wilbury.net (Postfix) with ESMTPSA id D971D61F9B; Fri, 13 Oct 2023 08:12:57 +0200 (CEST) Content-Type: text/plain; charset=utf-8 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: how to set vfs.zfs.arc.max in 15-current ? From: Juraj Lutter In-Reply-To: Date: Fri, 13 Oct 2023 08:12:47 +0200 Cc: freebsd-current@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> References: <20231012182749.AA34F185@slippy.cwsent.com> To: void X-Mailer: Apple Mail (2.3731.700.6) > On 13 Oct 2023, at 00:59, void wrote: >=20 >> Try reducing your arc.max by an order of 10. This suggests that it's >> probably failing in param_set_arc_max() in the val >=3D = arc_all_memory() >> comparison.. >=20 > Hi, thanks for replying. Sadly, your suggestion doesn't work in this = case: >=20 > root@beer:/usr/src# sysctl vfs.zfs.arc.max=3D8589934592 > vfs.zfs.arc.max: 0 > sysctl: vfs.zfs.arc.max=3D8589934592: Invalid argument Set also vfs.zfs.arc.min to some value higher than zero. =E2=80=94 Juraj Lutter otis@FreeBSD.org From nobody Fri Oct 13 06:35:15 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6Gw86pG3z4wYpr for ; Fri, 13 Oct 2023 06:35:20 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6Gw66rfYz3Yd6 for ; Fri, 13 Oct 2023 06:35:18 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=op0Yxekq; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=i21prXaQ; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.28 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 1A7D05C0222 for ; Fri, 13 Oct 2023 02:35:18 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Fri, 13 Oct 2023 02:35:18 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1697178918; x=1697265318; bh=pT k45hdgC6cvUlVKhaGAu0rKHfdVAE2+VBlQV3n6yeA=; b=op0YxekqkPTHTccXD9 uzfqwNT07VwnUetc6nJ+FaHJY0Vb3rui54XevUBLCoAjec9wwoTqlhMw2IC7sWRm 03Liciu7i41qmUrrBqYeTTrkHKAosPE5p9KpxkRKiEtVB82Mb1qJ1TonbTOQ652r crHpD+2Gy38TrLSL+PhLNZgehPAPNPYpjiGJrfQwpw2SPHvNNqw+za1mXuUgcRh4 cEBtl84C9HZ4Df4Pi2LdUkGQfhjyj1CksArkPgHyRY8tL0VmSH0kiUTEhaPRJO+h Xi/GOEKX9aJmD5J6+T831Zoz5lG/Ia+zkSojDiacmoGoVKTSamr0/rKxpOzQkJ0s 8vLA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1697178918; x=1697265318; bh=pTk45hdgC6cvU lVKhaGAu0rKHfdVAE2+VBlQV3n6yeA=; b=i21prXaQ196cV9R24aH4dFL94p613 ZwkH6YoppQGYuLyormlF6SGIfdo2tDz8icW2rg1f/UbCObrEYc8zk+kyYTmYD/yL /d4WJyBwNn1E+p5MZDFUlKjbqcNejor0Au9qN7N5jXdekgnrqx+/JFBZKC1K0nRZ +KjqGLf5BiDleEwez5CofZmmpFEIY5YT2VH1VTEKx/1bKzXSQGNkOS2PoZKOyN7h st76I/Po8Y+QhQV7cwp5qeDr5HMtrfL/AClwhUxOQIFInp4Zba8hFoemXz9CO2bM he8wBVP+kFasAMfF0P6H9Kwzdx0C74z3bglI6bDl6nqkea2cHNIM2Pveg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedriedugddutdekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 13 Oct 2023 02:35:17 -0400 (EDT) Date: Fri, 13 Oct 2023 07:35:15 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: how to set vfs.zfs.arc.max in 15-current ? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20231012182749.AA34F185@slippy.cwsent.com> <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.70 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; NEURAL_HAM_MEDIUM(-1.00)[-0.996]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.28]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.28:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.28:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S6Gw66rfYz3Yd6 On Fri, Oct 13, 2023 at 08:12:47AM +0200, Juraj Lutter wrote: >Set also vfs.zfs.arc.min to some value higher than zero. aha! that worked!!! :D root@beer:/root# sysctl vfs.zfs.arc.min=1073741824 vfs.zfs.arc.min: 0 -> 1073741824 root@beer:/root# sysctl vfs.zfs.arc.max=8589934592 vfs.zfs.arc.max: 0 -> 8589934592 root@beer:/root# thank you! -- From nobody Fri Oct 13 06:46:08 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6H8w0n5mz4wZQJ for ; Fri, 13 Oct 2023 06:46:24 +0000 (UTC) (envelope-from tsoome@me.com) Received: from mr85p00im-ztdg06021701.me.com (mr85p00im-ztdg06021701.me.com [17.58.23.196]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6H8v24Stz3Zym for ; Fri, 13 Oct 2023 06:46:23 +0000 (UTC) (envelope-from tsoome@me.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=me.com header.s=1a1hai header.b=Ez6T794n; spf=pass (mx1.freebsd.org: domain of tsoome@me.com designates 17.58.23.196 as permitted sender) smtp.mailfrom=tsoome@me.com; dmarc=pass (policy=quarantine) header.from=me.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=me.com; s=1a1hai; t=1697179581; bh=kczvI/Hf0wkqp/myo/p5dSy+Bsy8yjBf8/53TyAr1h8=; h=From:Content-Type:Mime-Version:Subject:Date:To:Message-Id; b=Ez6T794nn2l3fWYOwlyHS1rdG2Pm2pbBcAX1VsVg9kXHJ4pz4EJTucNAuLPOxavQS ih4USo0pNuSjbZSAOcdoOxHK/elGebcNJ10K6oxuOnmwHD1j47mhVhWYwnH/Zi0pwB /4Jr6wrkK99r9KKKUMnk8wQ2EolIXTz9YYhz4cKlVQBtYfoYwLakJDScxIh4RT44Ko aOWhRtJWas8UunenmXLj1Bfn8eRUEz3RsX7QxUr6AA0H1Sle2afMWWXNdvpnxH+n36 uhl1s2Ilf5VkhVzB47qr6BmZCGVjsvrnq4QGWKgV5A2bo6f6xdwMVotkxuW2R4WI2P qEdMtAAEcxalA== Received: from smtpclient.apple (mr38p00im-dlb-asmtp-mailmevip.me.com [17.57.152.18]) by mr85p00im-ztdg06021701.me.com (Postfix) with ESMTPSA id C3DDF263335C for ; Fri, 13 Oct 2023 06:46:20 +0000 (UTC) From: Toomas Soome Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.100.2.1.4\)) Subject: Re: how to set vfs.zfs.arc.max in 15-current ? Date: Fri, 13 Oct 2023 09:46:08 +0300 References: <20231012182749.AA34F185@slippy.cwsent.com> <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> To: Current FreeBSD In-Reply-To: Message-Id: <65CDDDE1-42E4-4DA7-B331-E721E9FBF1C1@me.com> X-Mailer: Apple Mail (2.3774.100.2.1.4) X-Proofpoint-GUID: eCJ1nVcs6t3ihNKyY5vJRJtKVUIjykGF X-Proofpoint-ORIG-GUID: eCJ1nVcs6t3ihNKyY5vJRJtKVUIjykGF X-Proofpoint-Virus-Version: =?UTF-8?Q?vendor=3Dfsecure_engine=3D1.1.170-22c6f66c430a71ce266a39bfe25bc?= =?UTF-8?Q?2903e8d5c8f:6.0.425,18.0.816,17.0.605.474.0000000_definitions?= =?UTF-8?Q?=3D2022-01-18=5F01:2022-01-14=5F01,2022-01-18=5F01,2020-01-23?= =?UTF-8?Q?=5F02_signatures=3D0?= X-Proofpoint-Spam-Details: rule=notspam policy=default score=0 malwarescore=0 spamscore=0 phishscore=0 mlxscore=0 bulkscore=0 clxscore=1015 suspectscore=0 adultscore=0 mlxlogscore=945 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2308100000 definitions=main-2310130057 X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.58 / 15.00]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.998]; NEURAL_HAM_LONG(-1.00)[-0.996]; NEURAL_HAM_MEDIUM(-0.98)[-0.981]; DMARC_POLICY_ALLOW(-0.50)[me.com,quarantine]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[me.com:s=1a1hai]; R_SPF_ALLOW(-0.20)[+ip4:17.58.0.0/16]; ONCE_RECEIVED(0.10)[]; RCVD_IN_DNSWL_LOW(-0.10)[17.58.23.196:from]; MIME_GOOD(-0.10)[text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[17.58.23.196:from]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; FREEFALL_USER(0.00)[tsoome]; DWL_DNSWL_NONE(0.00)[me.com:dkim]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[me.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[me.com]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; FREEMAIL_ENVFROM(0.00)[me.com]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ASN(0.00)[asn:714, ipnet:17.58.16.0/20, country:US]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4S6H8v24Stz3Zym > On 13. Oct 2023, at 09:35, void wrote: >=20 > On Fri, Oct 13, 2023 at 08:12:47AM +0200, Juraj Lutter wrote: >=20 >> Set also vfs.zfs.arc.min to some value higher than zero. >=20 > aha! that worked!!! :D >=20 > root@beer:/root# sysctl vfs.zfs.arc.min=3D1073741824 > vfs.zfs.arc.min: 0 -> 1073741824 > root@beer:/root# sysctl vfs.zfs.arc.max=3D8589934592 > vfs.zfs.arc.max: 0 -> 8589934592 > root@beer:/root#=20 > thank you! > --=20 >=20 That is a bit odd, arc min used to be 64MB as lowest value - that is, it = should never be 0. rgds, toomas= From nobody Fri Oct 13 08:03:10 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6Jts2SSlz4wfcG for ; Fri, 13 Oct 2023 08:04:21 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6Jtr0hxRz4KT0 for ; Fri, 13 Oct 2023 08:04:20 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=leidinger.net header.s=outgoing-alex header.b=V4dKDkhc; spf=pass (mx1.freebsd.org: domain of Alexander@Leidinger.net designates 2a00:1828:2000:313::1:5 as permitted sender) smtp.mailfrom=Alexander@Leidinger.net; dmarc=pass (policy=quarantine) header.from=leidinger.net List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1697184243; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=NZz894xQk3j4295ebKg3rgWPJCxxxkjqxb8H+fZydic=; b=V4dKDkhcp+cYtBcWW6zxm22aWp2iz1rwtsLqkfXRMymRf/PvBIVyJCgJX6BVdJdv7yNOQB qTtTgdarfU0Z/LpVPPg9oL+r5e/3xMhQzNLlzm/Vt0e/z1PusPVlS9M2mA6Y45J/uL7VDN 6HlbUlBZdTYgXAv52MwlPxGMrVWyDC3+qXDsKfHAxGMAPYspgTSFR2mLTGbRkEP2GeG4OM LSNfJi0sGE4026Ssh05Mfs4/2MPjpe+ECIHmbHJMYUhOW9BKTf+XYsvOzG/WbuiNyHQK8a ZDPpLXWqXgws2+gOqO7osLrNW4kArNSKxRDktWyR267JLBMdnI+XSO91PQ/jWA== Date: Fri, 13 Oct 2023 10:03:10 +0200 From: Alexander Leidinger To: Current Subject: issue: poudriere jail update fails after recent changes around certctl Message-ID: <7b44912e0d3ff033ab27923aeeae5caf@Leidinger.net> X-Sender: Alexander@Leidinger.net Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_b25665bf52bbcaf2d923501a5ee0367d"; micalg=pgp-sha256 X-Spamd-Bar: ----- X-Spamd-Result: default: False [-5.76 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_SHORT(-0.97)[-0.975]; NEURAL_HAM_LONG(-0.92)[-0.922]; NEURAL_HAM_MEDIUM(-0.77)[-0.768]; DMARC_POLICY_ALLOW(-0.50)[leidinger.net,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_DKIM_ALLOW(-0.20)[leidinger.net:s=outgoing-alex]; MLMMJ_DEST(0.00)[current@freebsd.org]; RCVD_COUNT_ZERO(0.00)[0]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; HAS_ORG_HEADER(0.00)[]; TO_DN_ALL(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[leidinger.net:+]; HAS_ATTACHMENT(0.00)[]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE]; RCPT_COUNT_ONE(0.00)[1]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4S6Jtr0hxRz4KT0 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_b25665bf52bbcaf2d923501a5ee0367d Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset=US-ASCII; format=flowed Hi, some change around certctl (world from 2023-10-09) has broken the poudriere jail update command. The complete install finishes, certctl is run, and then there is an exit code 1. This is because I have some certs listed as untrusted, and this seems to give a retval of 1 inside certctl. Testcase: set a cert as untrusted and try to use "poudriere jail -u -j YOUR_JAIL_NAME -m src=/usr/src" Relevant log: ---snip--- -------------------------------------------------------------- >>> Installing everything completed on Fri Oct 13 10:00:04 CEST 2023 -------------------------------------------------------------- 83.55 real 103.83 user 109.42 sys certctl.sh: Skipping untrusted certificate ad088e1d (/space/poudriere/jails/poudriere-x11/etc/ssl/untrusted/ad088e1d.0) [some more untrusted] *** [installworld] Error code 1 make[1]: stopped in /space/system/usr_src 1 error make[1]: stopped in /space/system/usr_src make: stopped in /usr/src [00:01:32] Error: Failed to 'make installworld' ---snip--- Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_b25665bf52bbcaf2d923501a5ee0367d Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmUo+cwACgkQEg2wmwP4 2IYObw/+OcQyUOv5Bp8R2Js+Nml6rUKCPm/+C2hsHL7i/qmClW/+jNUCD8cKh75o gKdlQndF8rJ36u0tzF8CD6M3nxMUo7rgGujykkUEAtk5T7GHjEUZWml8m0bwYFTE pi2PO6okUWdgsff8A8NVDPe6+Y0Rhf0Em7D7h9HDleT3M1/XvArtzT+z54mwjKBX RFT4u3UcnKJYo7s1sSkCElcaDdsJfD2HtXAhaiq1p0QRWdiQhVYYJgrTyXcBciFh dQvkOnOw3rcRQ1PfGlTtQ2/Fe5jhB6lfQAaoWSzCGgf95URWS6t6j1XK+lrP57Wf hvR7zhETccKiw4iPrAHvEKkkUjIxr3u6+dXnsTW+RkAvBT3ai5BP+duhnLybsy3N YCcqc9FLOSWONe+uJK938FoHYnu8NmEFXY7PkMfTA3lmhdSV7HBtKtguZAx331uG FkX+lIR8FwBQBOqIJxQV2V7xknJCjKJa+zJAiWiDn4wLYmxoVxf6mwxs0hXjv4Hp HUPpJRI4sd6ZWC9U+LhLI8Zput3fK2+puI7nW/+JCglzZw5fiQSkNptk2t2EJqTA RiAl8IJ5WOsQrJWE75IK5dF1aLrAVGJUfqAcWBXS5HpaqUrujiXTaOKaPQwjcwnN 17tTTCcsUrXHb/H0oRT4t4/9JWrvhBj0a1eD2Ea9bM9divzFcfE= =W82L -----END PGP SIGNATURE----- --=_b25665bf52bbcaf2d923501a5ee0367d-- From nobody Fri Oct 13 09:00:06 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6L7H72xJz4wk0S for ; Fri, 13 Oct 2023 09:00:11 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6L7H1CZxz4Nxx for ; Fri, 13 Oct 2023 09:00:11 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm2 header.b=Wa9yxcD0; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=VGFzeor8; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.26 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 3F8055C032B for ; Fri, 13 Oct 2023 05:00:09 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute4.internal (MEProxy); Fri, 13 Oct 2023 05:00:09 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm2; t=1697187609; x=1697274009; bh=La vItDarmpzZzcejH0AqgdD80uGwR0IEVouVu67c2ss=; b=Wa9yxcD0AcweKKAW32 frQOwjwnzRTxkxTZBwwZJsPOHVOf32lCTnn/VE0K0UvOuWxUHjEDOcAEJsplcq6h JByzpCqrNkWYxHClq7nKlrHV2rBE1kwEnQL/sdY51q486nwuIVZ+3CQWn2ItgFI8 BtmBAUyQWWhKfHU6c/uhuvSjNhvJz+709l8PsNUIsqAjeOyNbWFBE0ystN2sbkzx wIlF6dLQ6h66bLB8iER/4VZxZq7lW33jdPRr4kntDOTgcMO+jSlYP/2XhSgnN5tW mcpAkGkX7KdQPvTHixjWqm1P/WhKhuUvyWeCHhy9gFDwDlX7fpSvK4V0sQ9DD/1o s4ww== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1697187609; x=1697274009; bh=LavItDarmpzZz cejH0AqgdD80uGwR0IEVouVu67c2ss=; b=VGFzeor8mCvMsztpii1taXGEFLuW4 A0Jxrc3UDrasXC9JXUANsO9/Y46uqwM6v5wLBhtiYJzqadYZ21wJBMR/kRD3JNbN NoJdjY10jF67IWlkgEVd2igUt/JrPEvqmM6QKZjiAXqP89j43PIY2d2g1oP2pI5v GzM/WP3qVHMzdX8UQX4SzydIbsST0d0U+J7stAp7YRPZCQaNdYdz05ibbGLCNH26 12Z8e47eUGLdeaEvp9m/qjOuU7NNo+qfvivHURmxFskcERgGtqaWAWzWViKQA5zP SRjNnwmx9hIPGUC5g4vDfRulhEiqlfe5oTVj9bIDJaCeRF0e7oWYipdhA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedriedvgddtkecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehttdertd dttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdqmhdrfhhmqeenucggtffrrght thgvrhhnpeekleduvdelhfeileefgffghfffkedtheellefgudfgvdegkeejjedutdehhe fgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehv ohhiugesfhdqmhdrfhhm X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Fri, 13 Oct 2023 05:00:08 -0400 (EDT) Date: Fri, 13 Oct 2023 10:00:06 +0100 From: void To: freebsd-current@freebsd.org Subject: Re: how to set vfs.zfs.arc.max in 15-current ? Message-ID: Mail-Followup-To: freebsd-current@freebsd.org References: <20231012182749.AA34F185@slippy.cwsent.com> <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> <65CDDDE1-42E4-4DA7-B331-E721E9FBF1C1@me.com> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <65CDDDE1-42E4-4DA7-B331-E721E9FBF1C1@me.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.13 / 15.00]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; SUBJECT_ENDS_QUESTION(1.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; NEURAL_HAM_SHORT(-0.43)[-0.428]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm2,messagingengine.com:s=fm2]; RWL_MAILSPIKE_GOOD(-0.10)[66.111.4.26:from]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S6L7H1CZxz4Nxx On Fri, Oct 13, 2023 at 09:46:08AM +0300, Toomas Soome wrote: >That is a bit odd, arc min used to be 64MB as lowest value - that is, it should never be 0. It was the default here (i.e. the value wasn't set in either loader.conf or sysctl.conf) world+kernel was built/installed today the 13th main-n265915-be91b4797e2c (amd64) -- From nobody Fri Oct 13 13:24:29 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6S0V3KF3z4x1DG for ; Fri, 13 Oct 2023 13:24:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x629.google.com (mail-ej1-x629.google.com [IPv6:2a00:1450:4864:20::629]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6S0V1TFMz3Gy9 for ; Fri, 13 Oct 2023 13:24:42 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x629.google.com with SMTP id a640c23a62f3a-9adb9fa7200so428492066b.0 for ; Fri, 13 Oct 2023 06:24:42 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1697203481; x=1697808281; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=ZHBhyjK0Jx5frm+7luKWL2XozMklgUw2v+DaFMDImLk=; b=zxJDdtf2gdBhVIsneL1539SNuwDJ2zwF62wi0bUvY7oQNfQyyAoASP2IE0DWcTimAO M/DdkZztxarOiM1L9ojaC0NMyueX+9wTpss7c1VT4lxrq1WFGO7dRu11Ao7NmXmmQGsL CWCmLDsKGK74XEiggc/QpZW6fz+/RCnFjAF+gxlRXDVcag80r2GEXibHem7eo9U2mkps D0G5i8oBQGtE2u9yH+Ll4fnkgo1gbxIf5v7XZUzSFa/88mt4kPvakbkazOXjaJAeX545 W4QTBDHPRDz+1miRs/b2Lr0PlRoxS32IoctEBmOycHDB0IlCeayuzBwjRLWDi5b09ijf Zb2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697203481; x=1697808281; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ZHBhyjK0Jx5frm+7luKWL2XozMklgUw2v+DaFMDImLk=; b=isf0XzmWHuR9ccMrqYY71SK8hWriWoG2ZVmq91L5EgA4oMfiVv//gv8IoKJBpsmwMa 3GPOPhD/v27m/LAJIrq1NhQ1VtPxBSDZl2Bu6L7LNShAJHolG5MtDP6S3aEqEHu6H/wv Onv52+s52JA9PJrvIdbpPrpR8rq1IT8XiUoIO6gHyLoEZaPUXf0afn/UTOlHh4ohG44R nqy4kPv0jIY7xgRDE8D5ba38RLz8SNzs3xsEF8q1SKk3MIEtPBf7wBXZ2Zcw7iNKlDwX pMHs/B/34tmJBZx65VN1eYzlDaFBkaFktIRlW0Le1SoXNtAfY707v0cKmFHzpOEJGmiJ WtVA== X-Gm-Message-State: AOJu0YyxDaC+3QYwHXHrUZ9rXUNEFjr5gYkvVd0FFOImH6pxAMJqDmxl quh0mEECYzwInFl7AQRD5b7jDJ75rAARvmaDaFUkKbol+ws0TJw6Ds8= X-Google-Smtp-Source: AGHT+IFBbs6w4zk3ty3Mc0vIqkibphbqeSvqhJD+HUyZiDFFk6AwN9eAectU0aVqJF1D5YaPBYTf3rLHSxGPVYNpnSc= X-Received: by 2002:a17:906:fe09:b0:9ae:5df2:2291 with SMTP id wy9-20020a170906fe0900b009ae5df22291mr81580ejb.1.1697203480569; Fri, 13 Oct 2023 06:24:40 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> In-Reply-To: <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> From: Warner Losh Date: Fri, 13 Oct 2023 07:24:29 -0600 Message-ID: Subject: Re: nvme timeout issues with hardware and bhyve vm's To: Pete Wright Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="0000000000009250b0060798faca" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4S6S0V1TFMz3Gy9 --0000000000009250b0060798faca Content-Type: text/plain; charset="UTF-8" On Thu, Oct 12, 2023, 10:53 PM Pete Wright wrote: > > > On 10/12/23 8:45 PM, Warner Losh wrote: > > What version is that kernel? > > oh dang i sent this to the wrong list, i'm not running current. the > hypervisor and vm are both 13.2 and my workstation is a recent 14.0 > pre-release build. i'll do more homework tomorrow and post to questions > or a more appropriate list. > Are the messages from the VM? Stable/14 should have the important nvme changes I've made lately. The bhyve in 13.2 is lacking a number of nvme fixes that have gone into current and stable/14. It's hard to say where the fault is coming from. Warner -pete > > -- > Pete Wright > pete@nomadlogic.org > --0000000000009250b0060798faca Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Thu, Oct 12, 2023, 10:53 PM Pete Wright <pete@nomadlogic.org> wrote:


On 10/12/23 8:45 PM, Warner Losh wrote:
> What version is that kernel?

oh dang i sent this to the wrong list, i'm not running current.=C2=A0 t= he
hypervisor and vm are both 13.2 and my workstation is a recent 14.0
pre-release build.=C2=A0 i'll do more homework tomorrow and post to que= stions
or a more appropriate list.
<= br>
Are the messages from the VM? Stable/14 should h= ave the important nvme changes I've made lately. The bhyve in 13.2 is l= acking a number of nvme fixes that have gone into current and stable/14. It= 's hard to say where the fault is coming from.
<= br>
Warner

-pete

--
Pete Wright
pete@nomadlogic.org
--0000000000009250b0060798faca-- From nobody Fri Oct 13 15:42:43 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6W3p4Q0nz4x8YM for ; Fri, 13 Oct 2023 15:42:46 +0000 (UTC) (envelope-from des@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6W3p3pfvz3WPk; Fri, 13 Oct 2023 15:42:46 +0000 (UTC) (envelope-from des@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697211766; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3DZNQ+OxEWQ4w++aQh5bTCQeEIR8xLf0mspKE4XDrO0=; b=Jjlts6MZw7C5PPZU6POF+x1YenZnOx21OPMRkapfEtP5TJ5eJYyIewQIF/XNcmcVJASzHT MYocQbUDaJrJ3oTLgZYKEXOmXO04KWZZv/2agmXD/ednwX5G29FxERNCfnFiiB3YBWqIsx 0sHAvEeUoHa+3BKcLybSW1a13JOGejuNrDPmvT1Ft8ECO/OOl08wO4Fu6Y2ZHc7GYK28nv 0iKlUpwgrV8Y0cq3LW3wMhXqeNAUSZMNve7y5hmgp2fyIYCqi0H1ep7h4ZQ9ZQQO1B08Tz N47sB+RJnYWPIy3SsokmIQsIah0VZIkAn5XRNMpkodb0NXEEY3H7ZfmgqFeM0g== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697211766; a=rsa-sha256; cv=none; b=L1tSu3Fzaf7l8Y/CVE8K4/35huicaAgMolF42aRKGEiqHXCDWPVhOKDI0m59mfctqnMmAE xjFaKmXDqpja2FOhZHFGEiF7cC2mambC9DX53D6Q3ckudKb2gXAIDSo89akDEYAo9Kzjbr XzmgGi48dQ8DNzM+dQgY8yONpj/fUn3EuE1BqCApndPZzpiaqSZLRMYSKnMBPVfEHq/rbd zGinbkrzslXoUF3afQM2BdIydvd8jyd04YO7mK0oEue/ztA/m1srHS5Oe3KaJKkGdpWYGT g3N6TT0Eletk/mV0HMhzBoRj27pf6S4mFegQRWcDHGAs2eSiX3NbF0lZXI/fBA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697211766; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=3DZNQ+OxEWQ4w++aQh5bTCQeEIR8xLf0mspKE4XDrO0=; b=bD0qNTyfBT3+JVHjLDtPjjW27fclvX6LbS5MH6V1yTUpWB8UwjmRdNbrxzvwGVHrzYoBNi lNU0T3N9NRKwSIJ0MCX2Ez7PQDStYbnx7yWCKOwWkqELTF/TWzmTW2riaWvuphMyNGmhS6 tu4GPhDchvkfatCNS4ScI6CFCMTgGZzsagvZxqEuffyUjLHldgQ51xpoohuksIdM3W2Kv2 7edYER+45Ruk5rI+ghMlJOLf5e93nkUuniK6044YmBPxqknfJQgcKafzroaDEL1s1sjSYH K14AjLBfwhHhbqAKU4YEuEIiQPj9Uwrax8MP2xdn1aBwQ89A7F5hGdsEfHIrFQ== Received: from ltc.des.no (48.115.65.81.rev.sfr.net [81.65.115.48]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: des) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S6W3p2CG3z1LgH; Fri, 13 Oct 2023 15:42:46 +0000 (UTC) (envelope-from des@freebsd.org) Received: by ltc.des.no (Postfix, from userid 1001) id E1E0576C61; Fri, 13 Oct 2023 17:42:43 +0200 (CEST) From: =?utf-8?Q?Dag-Erling_Sm=C3=B8rgrav?= To: Alexander Leidinger Cc: Current Subject: Re: issue: poudriere jail update fails after recent changes around certctl In-Reply-To: <7b44912e0d3ff033ab27923aeeae5caf@Leidinger.net> (Alexander Leidinger's message of "Fri, 13 Oct 2023 10:03:10 +0200") References: <7b44912e0d3ff033ab27923aeeae5caf@Leidinger.net> User-Agent: Gnus/5.13 (Gnus v5.13) Date: Fri, 13 Oct 2023 17:42:43 +0200 Message-ID: <86cyxi34wc.fsf@ltc.des.no> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Alexander Leidinger writes: > some change around certctl (world from 2023-10-09) has broken the > poudriere jail update command. The complete install finishes, certctl > is run, and then there is an exit code 1. This is because I have some > certs listed as untrusted, and this seems to give a retval of 1 inside > certctl. This only happens if a certificate is listed as both trusted and untrusted, and I'm pretty sure the previous version would return 1 in that case as well. Can you check? DES --=20 Dag-Erling Sm=C3=B8rgrav - des@FreeBSD.org From nobody Fri Oct 13 15:50:58 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6WFT3796z4x9V0 for ; Fri, 13 Oct 2023 15:51:09 +0000 (UTC) (envelope-from mad@madpilot.net) Received: from mail.madpilot.net (vogon.madpilot.net [159.69.1.99]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6WFS3bbLz3c24 for ; Fri, 13 Oct 2023 15:51:08 +0000 (UTC) (envelope-from mad@madpilot.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=madpilot.net header.s=bjowvop61wgh header.b="V ZyzunE"; spf=pass (mx1.freebsd.org: domain of mad@madpilot.net designates 159.69.1.99 as permitted sender) smtp.mailfrom=mad@madpilot.net; dmarc=pass (policy=quarantine) header.from=madpilot.net Received: from mail (mail [IPv6:fd5c:5351:d272::3]) by mail.madpilot.net (Postfix) with ESMTP id 4S6WFJ6NRSz6dVv for ; Fri, 13 Oct 2023 17:51:00 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=madpilot.net; h= content-transfer-encoding:content-type:content-type:in-reply-to :from:from:references:content-language:subject:subject:date:date :message-id:received; s=bjowvop61wgh; t=1697212259; x= 1699026660; bh=dwvzbaEdFicGH1dlx9eM5Eh5SUow1qBST6bsumeU40Y=; b=V ZyzunEjbjEMS+QR8xWS4t8MahSRmODb36FPgRvESpYbvmrHVKrV3WxnjZgPpL/x/ ajxQZY1gavXZKbnsbpKO1hBnw/QR1me9zhIMHEh+5+EBeNBy9njemgB9zRZtEieA CT5RgHjLb1ncUroq376cIIzlgDZFk6nGlwMu5TNv/gbzUpM1ff5Hl22EKej0nodt pShaUAhfMdDKQ9Qp99O1HjoJPMnHXCKQ2V0ArXQ5YUDKUqIdYlZ0iK0x3koGyRwu 2zCXm4n51/klqJxvIM8dYY7QqawL39tOELdjdQ0JZUFDtF59ucxd/uzT+isWCwCM mF/AWQOViS2zmGy8FIKMQ== Received: from mail.madpilot.net ([IPv6:fd5c:5351:d272::3]) by mail (mail.madpilot.net [IPv6:fd5c:5351:d272::3]) (amavisd-new, port 10026) with ESMTP id QO2kCLOOWwAn for ; Fri, 13 Oct 2023 17:50:59 +0200 (CEST) Message-ID: <65208074-1dc3-4804-b319-d96fa335dcd1@madpilot.net> Date: Fri, 13 Oct 2023 17:50:58 +0200 Subject: Re: issue: poudriere jail update fails after recent changes around certctl Content-Language: en-US, it To: freebsd-current@freebsd.org References: <7b44912e0d3ff033ab27923aeeae5caf@Leidinger.net> <86cyxi34wc.fsf@ltc.des.no> From: Guido Falsi Autocrypt: addr=mad@madpilot.net; keydata= xsBNBE+G+l0BCADi/WBQ0aRJfnE7LBPsM0G3m/m3Yx7OPu4iYFvS84xawmRHtCNjWIntsxuX fptkmEo3Rsw816WUrek8dxoUAYdHd+EcpBcnnDzfDH5LW/TZ4gbrFezrHPdRp7wdxi23GN80 qPwHEwXuF0X4Wy5V0OO8B6VT/nA0ADYnBDhXS52HGIJ/GCUjgqJn+phDTdCFLvrSFdmgx4Wl c0W5Z1p5cmDF9l8L/hc959AeyNf7I9dXnjekGM9gVv7UDUYzCifR3U8T0fnfdMmS8NeI9NC+ wuREpRO4lKOkTnj9TtQJRiptlhcHQiAlG1cFqs7EQo57Tqq6cxD1FycZJLuC32bGbgalABEB AAHNHkd1aWRvIEZhbHNpIDxtYWRAbWFkcGlsb3QubmV0PsLAeAQTAQIAIgUCT4b6XQIbAwYL CQgHAwIGFQgCCQoLBBYCAwECHgECF4AACgkQGuaGDlbL0pOWigf/YVTVf3+ZRnzeGP7CjGV1 Wrrxzjc8h8W64NZasV0XLHGFjl5MYwtm9jJ9gbL8Ubtqstey7lYpjOk2fG6YDhY5eptWCpR6 1QqYrioukhCfKbodSk6PnIZcx719nJVK2P7ihdFEN78TavpBwqIf9hGEcKkMpbRFQv1mYvXD hKVwQGY+8bkH/a/pAWmIyD4qMfKCMurH5DexxEt5SYWu5BB5hd/DWyZ0wuZ+F79KMPzLBPJW 5cpdLNbrvenSqFZGJEGhtTp7GFJJr6lTy8VLBArxmFHiY5jGyR45eZEGDcz86FfGgvPnnpi7 aNCc/ROdF7fnZYPh8uZGGjQbd4EYK4xMzc7BTQRTEHtBARAAoWGsNx6g90r8gcNKaiPpJBiK y8ztV2FyV5LsT0OgQBW3vIxt/odtsxVNNjpyS/BNZCyzLAsFc1WrGBzhYsmPN9SGB5/5YTvk zf5YViU5VAsZlj/MRWCZrWtpic4c0A7N4csOYReNtk/q8YB4PIFsZ9A+kTuoZhnu5t5PdfBA 74+SVwKu84+PZk9wDEY1LbFVT8vM42oKsmoswlIhwJ2xuJI/gbk+cMUe0yiRpNjo4Svw4RB8 4B6uFwdRr/PtS7xi2Zqoof5AaQT9YSBpGpKJOe/Qk5MP4PF6Fqq+go89n77Y2kJkwcHaLoD/ GJ+ZDASIiMRe1y54FHOQ1RCTGGpnJLXdKuGhwv3J21pU8HNlq0ASNQMMQmYAwtUWzjmp/KEy I1qkcmjafcxb8TmiaoK8SQN1Zf96fc/sIrZN6Z5oOCEyyCQ0prH/PTA2jlRkKQ487PTGk2JS KU5VuS57Nlk2DrnvjWp57aV9eFAhpnrrJPuGmFz83/Pc8gC0t7N7i7VVHYRcC5naxYB2UoI1 OUkyxpT/HvQFXXVZ3/KmdXMzrx191AggCPWIwUAP+VcaURSYpeDk6/ZVAOVOe1ChqcJisCD7 wK20/OOvJ2AtkWreGu1CZ9zSx7nK/VYdLr34GxQ4bT1G+9rBQNnFSNbX2TJ431Mdo1GCjDeR K4CtSnrNKYkAEQEAAcLAXwQYAQgACQUCUxB7QQIbDAAKCRAa5oYOVsvSkw3nCADhsKRf+rAR ULTpOh5HoLam62ZJZAyCkNqqu/rke5uj5AaaDY/h7BNhBDiDqhhZLTeofGpVVaErPsWN+tX5 0fypsIt9KAhy90GFrtrIZlWuyK4wsoZvDfp9yaRk+lIM58dw/Rcfxn670JaPTFSRPECVn/uL qBhJSkbYlY212YT9fxVUTJe6wIvDLQrQEjrQD/h1FMhfcLhAqsndltRd6DPvTKeMd/6VAxn0 hkoBKhEy5LkWjM9CHppu+bBkQ91/kj2uJQSXO8euonwHHS3c+6N2i2H7I0emcHGu07wuRB2t Dnw/RLBxohffdPZT2kbxuG7lhVHzwVDw5DRwSw8GkOdy In-Reply-To: <86cyxi34wc.fsf@ltc.des.no> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: - X-Spamd-Result: default: False [-2.00 / 15.00]; MISSING_MIME_VERSION(2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[madpilot.net,quarantine]; R_SPF_ALLOW(-0.20)[+mx]; R_DKIM_ALLOW(-0.20)[madpilot.net:s=bjowvop61wgh]; MIME_GOOD(-0.10)[text/plain]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:24940, ipnet:159.69.0.0/16, country:DE]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[madpilot.net:+]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Queue-Id: 4S6WFS3bbLz3c24 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org On 13/10/23 17:42, Dag-Erling Smørgrav wrote: > Alexander Leidinger writes: >> some change around certctl (world from 2023-10-09) has broken the >> poudriere jail update command. The complete install finishes, certctl >> is run, and then there is an exit code 1. This is because I have some >> certs listed as untrusted, and this seems to give a retval of 1 inside >> certctl. > > This only happens if a certificate is listed as both trusted and > untrusted, and I'm pretty sure the previous version would return 1 in > that case as well. Can you check? > ON an unrelated note, I noticed the new certctl in head requires .pem (and any other extension, if I remember correctly) files to contain a "Certificate:" line. While I have no objection to the requirement, it is not documented in the man page, or anywhere else, I did have to look at the script source to discover this. Maybe a little note about this requirement in the man page should be added. -- Guido Falsi From nobody Fri Oct 13 17:47:36 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6Yr04qKwz4wYWr for ; Fri, 13 Oct 2023 17:47:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Received: from mail.nomadlogic.org (mail.nomadlogic.org [66.165.241.226]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mail.nomadlogic.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6Yr023NKz4M9j for ; Fri, 13 Oct 2023 17:47:44 +0000 (UTC) (envelope-from pete@nomadlogic.org) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nomadlogic.org; s=04242021; t=1697219257; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6IjYQStR+shGBrNznB5LGFbmzTAsq6U2l0icSoWa/ns=; b=s5n1gT9Bw8xhiFwceEzuc9Xq5NUv0dT1dIk5ZFlLlBLKY5PCqRfOwDAJmOYZ28g3Z26bXY nR4GNDLoPU77ZaCJUNindW6Wlkvsc71rDb3V7DyTYNieBtoqB4m2qpLQhAhWqLhJtj/qdc VxrmZLBZW9vRDuC86sYYNNLFeTCDPQc= Received: from [192.168.1.240] (cpe-24-24-168-214.socal.res.rr.com [24.24.168.214]) by mail.nomadlogic.org (OpenSMTPD) with ESMTPSA id 7ce3c543 (TLSv1.3:TLS_AES_256_GCM_SHA384:256:NO); Fri, 13 Oct 2023 17:47:36 +0000 (UTC) Message-ID: <0c4f8149-89dd-4635-a5ed-4766fffd2553@nomadlogic.org> Date: Fri, 13 Oct 2023 10:47:36 -0700 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: nvme timeout issues with hardware and bhyve vm's Content-Language: en-US To: Warner Losh Cc: FreeBSD Current References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> From: Pete Wright In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:29802, ipnet:66.165.240.0/22, country:US] X-Rspamd-Queue-Id: 4S6Yr023NKz4M9j On 10/13/23 6:24 AM, Warner Losh wrote: > > > On Thu, Oct 12, 2023, 10:53 PM Pete Wright > wrote: > > > > On 10/12/23 8:45 PM, Warner Losh wrote: > > What version is that kernel? > > oh dang i sent this to the wrong list, i'm not running current.  the > hypervisor and vm are both 13.2 and my workstation is a recent 14.0 > pre-release build.  i'll do more homework tomorrow and post to > questions > or a more appropriate list. > > > Are the messages from the VM? Stable/14 should have the important nvme > changes I've made lately. The bhyve in 13.2 is lacking a number of nvme > fixes that have gone into current and stable/14. It's hard to say where > the fault is coming from. > the messages i posted in the start of the thread are from the VM itself (13.2-RELEASE). The zpool on the hypervisor (13.2-RELEASE) showed no such issues. Based on your comment about the improvements in 14 I'll focus my efforts on my workstation, it seemed to happen regularly so hopefully i can find a repo case. thanks warner! -pete -- Pete Wright pete@nomadlogic.org From nobody Fri Oct 13 20:20:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6dDH11vHz4wjy9 for ; Fri, 13 Oct 2023 20:20:31 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x329.google.com (mail-wm1-x329.google.com [IPv6:2a00:1450:4864:20::329]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6dDG2KnWz4fB2 for ; Fri, 13 Oct 2023 20:20:30 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=jQqz5zpb; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::329 as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x329.google.com with SMTP id 5b1f17b1804b1-4064867903cso29310735e9.2 for ; Fri, 13 Oct 2023 13:20:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697228425; x=1697833225; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:autocrypt:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=qQ/wNWqqvWsAB9nL758+YoO7fHj7WlL5mx4PiePNYCs=; b=jQqz5zpbp9qp/nbZQuQqNv5bW8dhkzSjU81sXjTcn6G/44EW+Dyiq+fwWAGiyGBrVp j+mdbWI13vFyZKc+Ns6yqq89RxPLy8na2Hs/rQ5TPc8r7lFlgIiRBqKHRrvWSdOSGOUS +WuWh/VgY1fSZByllHd298sVDepJ707xlqoAgwo/7aucefg/8A2OYk5k/+OcwhVdERV0 cv2NOOfWss63vzi6q1lh5p/p6OUuBuPSE2+kNmd4d0rE6zK7HfmsnUkiRy2Hs9mQsCww 3PQzerZsQaI7cKjaymI1Tv70uCjEnZA7wobDHXLcNncU/4RQ0VOniY+EBcn+N1TIg1oM gNpg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697228425; x=1697833225; h=content-transfer-encoding:in-reply-to:autocrypt:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=qQ/wNWqqvWsAB9nL758+YoO7fHj7WlL5mx4PiePNYCs=; b=Vp663JG+yzmf7MS3S6QFf4jFgCRBZuOYOWiv69lwthnnjQIcPcXJEsUJddVqpXTLUz 0XxQUCVjeUuZoYs6PFCtqB5PACJsTBUbIa+00AHHhtAo/OlqTSJ3zhQ0gF/dr+e5sx3U H/CPdIh7sGg237BjbensYn8IaZnWkVOpJOFiPZTqNe6sgGpyEpSyfe2jcwoTRBrbuxsz 6q4Bj9kA+qUtkFcP3JCJ3uGBb1UyM5N4YPklN1bzOr5V2VGvvFQFkx469FmRhiyPbtu7 7C9J4eMn6uflEprc/sQPaXg2WFNnx8mpaqmV+W6ym5YBNn7/6xoReRuEeNfXMKzJxSUf /J6w== X-Gm-Message-State: AOJu0YxGvffFl99FcgifjudROhCoTNfiYwkrGmn9zUC/6pY2SI3pFuN3 kCfoUcyHvuQKjnVyoV5zM7htgzPr1p5wxA== X-Google-Smtp-Source: AGHT+IEpxCV3SF5nhBcjpeQpzLjIoKVbPgh2ilZS98lR5mAw6KuBoUo2I1dlSDwaiR6AqPy2k2NXxQ== X-Received: by 2002:a05:600c:1c0a:b0:407:5b54:bb0c with SMTP id j10-20020a05600c1c0a00b004075b54bb0cmr9248915wms.19.1697228424968; Fri, 13 Oct 2023 13:20:24 -0700 (PDT) Received: from [192.168.1.6] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id k27-20020a05600c1c9b00b0040531f5c51asm42031wms.5.2023.10.13.13.20.24 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 13 Oct 2023 13:20:24 -0700 (PDT) Message-ID: Date: Fri, 13 Oct 2023 21:20:22 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: vfs.zfs.arc.min (was: how to set vfs.zfs.arc.max in 15-current ?) Content-Language: en-US To: freebsd-current@freebsd.org References: <20231012182749.AA34F185@slippy.cwsent.com> <695E4868-EF98-4CBE-A0CE-CEF10A009D65@FreeBSD.org> <65CDDDE1-42E4-4DA7-B331-E721E9FBF1C1@me.com> From: Graham Perrin Autocrypt: addr=grahamperrin@gmail.com; keydata= xsFNBGKYt7ABEAClu83dJ3ZKfVgPOk9YKRv0Z+dl2b88+k9R4vwAmElgguYdKE7yhnQNhhWM v9vi6AFrBMc2oJdVHJ2OrXfwpELBFIgiSMEWNsC4e+Z3HtSajcl+pFZsP7ciiSoycj/w3wIV kAZoVGbhyIbNG7fbCEJ8q81TbfsGypV3bRmbZVvGNecBguYiooBtz2Qht1p3itXMkIA6P9pS YDl+6QddZLyUUAjAnFv2QDoYSHLnaDUWw4oONZsB0SKVu8jMIBh4uJZoYEOvdvc9jQQdOpA2 CAgA6ulfm42Ikr9lKBUUCtjqiWAhJ7iXOTyHAIdR4Mf8alCE6tdTq6dHdIt+GktTY7oYNyL2 3aD3C7I5waU0SFXvJcOMG10QLfwYQMOQoYQ9XJ0U5A28WYiDcylDdUWT7SappP1e1ZMeJWWO y14mxxNzHaJSI4rK8P/p5tp3Q7SSC4k5gMh9zKba3K2ApCWNbVLGvXsJeQkZZNvu70tE81ey AHI5iZcB6D7WaHysBUmsKaEpbcmm1ZThTnGL0SHEl5to5Jab5Fg6O+Cnly5sVz5lX/v8Aosx kKNei7SCVqXOVtteQeGxWbXWbhPgbMyc0Gi3DuxBI/yvJ43k/rJysQlLGLWfJx/UXprwLluC PDK9EvKEB+fD1Z349uzp1sKr3ihpySbyKI8fpudftnAz4EsoCwARAQABzSZHcmFoYW0gUGVy cmluIDxncmFoYW1wZXJyaW5AZ21haWwuY29tPsLBlAQTAQoAPhYhBFk/5bLDBwftvJcvCrdn SG9KGNQLBQJimMMBAhsDBQkFo5qABQsJCAcDBRUKCQgLBRYDAgEAAh4FAheAAAoJELdnSG9K GNQLbHAQAJi998y42bEbq5HmABYovmAEtQj33YSUWyc9QRmAHpN8Er3lTKsgmZcVChB5Fu/d go2oYynDjlVpA7+wiSmg4AG78mOYbg/e19XMhrH0keDKqZXFkU+G7agR0mF09qvpQZ9MTJYZ 2u7FtytZK665UfipOdV8eGn2hFC/WynjUwEzKyryBgbbLAEbfOPeZNry4h2ZPWbtTvx/PE/V X3Vh2oGqYx69DCGz+0xEhy62ZKbkX5SL8LUf/1WViyCVzsHasFxmFxYPWIfBy8ayQ7xapz7M cSXSQyu4oDT4qh9eZiGP9/aAcZKHcV6t9y77JGhUJ/5O1sANKMa3YhgimE+Z86LHYa1IH774 PHj1nAXBwS+Cj/1l/NQoQcyjvOj8zuCsMJVaLMb6B46YsReP4+3yBLpyeBC//t6zWPbgAkWW VjROC0dXUAMTFpnA6NZe3UghG+Nc4fnCLGOhc2nyWFYHIaYV6Hv1ITFSem9DdeNnR1CFm1VM TJ7i7TuqYM+WZTkoUsTf4c46hS/ZNJZSCxh0s9yYr+BYk3XBbd+ElaZ1dJE6cuSVdw15+P2h DnprurxC4byl4YFkn+UAVvQsOgeq6aSHLOHX0weYu1OLoiPYsTdyGhne72+kDhEEdFD5aHdQ PFrbQIrqWLV0a04++0ZwGpNvXtgnWhDdAQJDwGsSSwbLzsFNBGKYt7ABEADRb1tZuh7DPYET 0wK6fe7owbYgM+RfKhmcrGgR2HI9M2q6+0WKF/ITnggWdIW2Ecc4z2boLz/cwvPGCS7/YxZM 61KklGCwuS7q1s04XnHDWHuFxfXQPzAdVmNO3bYoMZbJjHXs6sB2u5ksiwPwaMAWWaGkviSj c5pwvHCiTmX5vH5CBj/Vi+5ESyX38vK4JM5S/m4ouI/6M9biyFgimV+v3vVyCxJCT1gI9g4o GIh1qq5S433b1fihn4yHPf8XOKyBpA/QcwLONViBqJL5nnOxpsh344rNxn2R7CcRzzicOV+e 2IbMem4lwNWQlZKoRotKXZi9LqN5mynSBYqAUdoZum0QinWT9F22B0Qex5PH1zAt9i2W91Vd kcPB3LwkRXj07ycRtsSzpgPA6fLc6AsoWFslHl8kVOO5eJIA4xhjlPa+W8lguQHZ0iX+5uAv 2eAgXR2swADuHPuENNFStmsgAMl8OOOgtq75yA5TpyIzxMuXV9Nmp0VfIaUM/IdLdmxhc1pC c320l5fYMHVLFAReWEbSj2QH8YzWfpXHIegutWWYEbH9SiDXgS9KoKmCJV/Qa+x6/b8y3pOZ vnIbCDaynC2Yr50s8gRa9kb54JE8Z+p8r16U3SEsK3PtUi0RF0e51danCVHrrE6/Hat2XUO/ 6nnYgVgFOrLao6Gh/VMs8wARAQABwsF8BBgBCgAmFiEEWT/lssMHB+28ly8Kt2dIb0oY1AsF AmKYt7ACGwwFCQWjmoAACgkQt2dIb0oY1Av7qg//YjCZg8VXyMzXssgIQpROKKqh5V0UBSQl rM3tq4tWhyg0HVMugQj0Om+iNPsEEOGHkm6tyhHMzlKGpAc/l0iAM+8twIyg44Yo5+DcfFXr OMTbTw9T9jDsWOkOBksxy29iYhgpqpWdDBnhXvrJp/FNAiX8CfzrIOZeFPydDoEiKBEXAxfe a9o5J/JeVnZiUeoiFe7i68nZGsb4JxhPczNfqW12t0Ll5/ibjszg5BgjXiLao0KqbWNh4bS5 CVwH90Or+5qqWgzWPeBiuz+rN2QXE/V/fL44GEj1YKASCqmaiYRgjoRFubz1aq1wCXMXY3Iq d4525rscUgS7HBxbblnyTodUPaamN/2nSzcmE/Pkx8MApDSgZCIhs0RTAg+/AoX4HULV1rSE TQwMrBEQt84Tw5W5rHsvXKr4ZEsJUpbPLWYTISsp23nHR+vZtL/Ug+OWCmHC7X7D21xk/xVJ 4sA1RLJBKdCHtnyA4Unv/kNS1KVGxHnITVyw1a71QJADu4qsdtM5u6CyYUhqhM1oseWtV6j+ Qi8KC/G4C3AgZf06fe2fVl42z2grTabL4bC6FQXMwTX2dsm5NakWjUCmUL8uwsQE7ZA4zKxo EYI1YV9q1birpzncYRupr1qnMoggMUHWq0IBYshFQrEO8PeVUZBw7/GfAeh3argdw2Qu748T Cyw= In-Reply-To: <65CDDDE1-42E4-4DA7-B331-E721E9FBF1C1@me.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.68 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.99)[-0.995]; NEURAL_HAM_SHORT(-0.69)[-0.694]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; FREEFALL_USER(0.00)[grahamperrin]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::329:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; SUBJECT_HAS_QUESTION(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S6dDG2KnWz4fB2 On 13/10/2023 07:46, Toomas Soome wrote: > >> On 13. Oct 2023, at 09:35, void wrote: >> >> On Fri, Oct 13, 2023 at 08:12:47AM +0200, Juraj Lutter wrote: >> >>> Set also vfs.zfs.arc.min to some value higher than zero. >> aha! that worked!!! :D >> >> root@beer:/root# sysctl vfs.zfs.arc.min=1073741824 >> vfs.zfs.arc.min: 0 -> 1073741824 >> root@beer:/root# sysctl vfs.zfs.arc.max=8589934592 >> vfs.zfs.arc.max: 0 -> 8589934592 >> root@beer:/root# >> thank you! >> -- >> > That is a bit odd, arc min used to be 64MB as lowest value - that is, it should never be 0. > > rgds, > toomas 0 here, when not set. describes the effect of 0, on the same page does not. A gap in documentation upstream? From nobody Fri Oct 13 22:57:28 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6hjR45zJz4wv7W; Fri, 13 Oct 2023 22:57:31 +0000 (UTC) (envelope-from gjb@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "freefall.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6hjR3qnnz4r1j; Fri, 13 Oct 2023 22:57:31 +0000 (UTC) (envelope-from gjb@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697237851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=FykJ5h3sPWySoKJODp6JrBE5OOE4KuaVAj29fMe2c3k=; b=E3FR1R/LLE4LIzKOo2wqXSgIE4K1obL1likwoljXbvBtfeh/qieXqDpOD5seAUYHxFxN/R X+5dIVBMCqUQ+WAL174thioxquGB+tUbB8TYniA7CzxWn3O4Er8IMObFuHi/4GjFHvtihC pAgFnQBdLnBwWVqdcooejgML2LqRwmAZ/tsytu2+BtIZyv1oz502tHFU9VFew9dUzCqD9Q JZZDzwEfpMVcX+LACHT2YgL9sSJky0xFq824asm/o7C3My46SWC3ehi1zvKoEfP6zbBDGq a9QyB0jR0oXo1i0ivERh+I/y4+MXEOsp7Z12D4sr1vdG3R4vJj5dF+urrETsiw== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697237851; a=rsa-sha256; cv=none; b=GWjVrveEf6kwViSlooW1bI25Lq+pzzI1iZ6OJMSoJJTdozb7GXFl7uG1awKAm7zJ7LFSHv Ww9rHS2G+gIkQrF6EQtpqFL5ZCDpVb4OwakWey8y1PaPLFrAp0uWXbHuWBXXc0c93ZVlhm NJNBNawZ2s1t7L7ztQvVzsUSbDVcEEZIP2s5mExSPn1Z4ycH/mxtA+eUsqhW6Z/FTM8OmA v3Owuqm4cP/gNStfKPlhu8ldr3Kw9BwQHvnURYJCDw6m389+qjglY1UfgTzuNojQowEBEP TMGWBfLEoMugK4Kh1xIogqlGUUfjScKrzHDqClXB3kcRQz30l96fYKT8strrcw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697237851; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type; bh=FykJ5h3sPWySoKJODp6JrBE5OOE4KuaVAj29fMe2c3k=; b=Jjupr8xV5rJuiwHLmHiohOkab/IIKWKuCB+duq0JfQ/Y2vPSWc88JnjyHhy7JuK3oNIJQf zqHNqVfa019TqYat0JcZko8WsLfVuE/nyck+NiRxchxdGE74lD7njWdzSFPazZfML5j7WE U1J+d1ufL4Wb+YyGFoZeMyhj5FHw3eCvTL4+jVO24xLkm5FdHLOOBcF+0RmDvXEqc5dLxP Aqd9RGA+oB7UDUyclOmCt1FSBzLcTbT5d62Ya+QXhcON4r3aCjRJCnfv5S4j1oc6gTlu/y /WdHnXGaNP3iEGDyszzsurrVOADjt9UCQP+VP7/HyPSXGsUk6OaNF70mdgmizg== Received: from FreeBSD.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 2A4EF10292; Fri, 13 Oct 2023 22:57:31 +0000 (UTC) (envelope-from gjb@freebsd.org) Date: Fri, 13 Oct 2023 22:57:28 +0000 From: Glen Barber To: freebsd-current@freebsd.org, freebsd-stable@freebsd.org, freebsd-snapshots@freebsd.org Cc: FreeBSD Release Engineering Team Subject: FreeBSD 14.0-RC1 Now Available Message-ID: <20231013225728.GY1307@FreeBSD.org> List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; x-action=pgp-signed -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA256 The first RC build of the 14.0-RELEASE release cycle is now available. Installation images are available for: o 14.0-RC1 amd64 GENERIC o 14.0-RC1 i386 GENERIC o 14.0-RC1 powerpc GENERIC o 14.0-RC1 powerpc64 GENERIC64 o 14.0-RC1 powerpc64le GENERIC64LE o 14.0-RC1 powerpcspe MPC85XXSPE o 14.0-RC1 armv7 GENERICSD o 14.0-RC1 aarch64 GENERIC o 14.0-RC1 aarch64 RPI o 14.0-RC1 aarch64 PINE64 o 14.0-RC1 aarch64 PINE64-LTS o 14.0-RC1 aarch64 PINEBOOK o 14.0-RC1 aarch64 ROCK64 o 14.0-RC1 aarch64 ROCKPRO64 o 14.0-RC1 riscv64 GENERIC o 14.0-RC1 riscv64 GENERICSD Note regarding arm SD card images: For convenience for those without console access to the system, a freebsd user with a password of freebsd is available by default for ssh(1) access. Additionally, the root user password is set to root. It is strongly recommended to change the password for both users after gaining access to the system. Installer images and memory stick images are available here: https://download.freebsd.org/releases/ISO-IMAGES/14.0/ The image checksums follow at the end of this e-mail. If you notice problems you can report them through the Bugzilla PR system or on the -stable mailing list. If you would like to use Git to do a source based update of an existing system, use the "releng/14.0" branch. A summary of changes since 14.0-BETA5 includes: o A race condition in swap_pager_swapoff_object() had been fixed. o Various updates to the Linux KPI, 802.11, iwlwifi, and rtw88. o And other miscellaneous fixes. A list of changes since 13.2-RELEASE is available in the releng/14.0 release notes: https://www.freebsd.org/releases/14.0R/relnotes/ Please note, the release notes page is not yet complete, and will be updated on an ongoing basis as the 14.0-RELEASE cycle progresses. === Virtual Machine Disk Images === VM disk images are available for the amd64, i386, and aarch64 architectures. Disk images may be downloaded from the following URL (or any of the FreeBSD download mirrors): https://download.freebsd.org/releases/VM-IMAGES/14.0-RC1/ BASIC-CI images can be found at: https://download.freebsd.org/releases/CI-IMAGES/14.0-RC1/ The partition layout is: ~ 16 kB - freebsd-boot GPT partition type (bootfs GPT label) ~ 1 GB - freebsd-swap GPT partition type (swapfs GPT label) ~ 20 GB - freebsd-ufs GPT partition type (rootfs GPT label) The disk images are available in QCOW2, VHD, VMDK, and raw disk image formats. The image download size is approximately 135 MB and 165 MB respectively (amd64/i386), decompressing to a 21 GB sparse image. Note regarding arm64/aarch64 virtual machine images: a modified QEMU EFI loader file is needed for qemu-system-aarch64 to be able to boot the virtual machine images. See this page for more information: https://wiki.freebsd.org/arm64/QEMU To boot the VM image, run: % qemu-system-aarch64 -m 4096M -cpu cortex-a57 -M virt \ -bios QEMU_EFI.fd -serial telnet::4444,server -nographic \ -drive if=none,file=VMDISK,id=hd0 \ -device virtio-blk-device,drive=hd0 \ -device virtio-net-device,netdev=net0 \ -netdev user,id=net0 Be sure to replace "VMDISK" with the path to the virtual machine image. === Amazon EC2 AMI Images === FreeBSD/amd64 EC2 AMI IDs are available in the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/amd64/base/ufs/14.0/RC1 /aws/service/freebsd/amd64/base/zfs/14.0/RC1 /aws/service/freebsd/amd64/cloud-init/ufs/14.0/RC1 /aws/service/freebsd/amd64/cloud-init/zfs/14.0/RC1 FreeBSD/arm64 EC2 AMI IDs are available in the Systems Manager Parameter Store in each region using the keys: /aws/service/freebsd/arm64/base/ufs/14.0/RC1 /aws/service/freebsd/arm64/base/zfs/14.0/RC1 /aws/service/freebsd/arm64/cloud-init/ufs/14.0/RC1 /aws/service/freebsd/arm64/cloud-init/zfs/14.0/RC1 === Vagrant Images === FreeBSD/amd64 images are not available for this build. === Upgrading === The freebsd-update(8) utility supports binary upgrades of amd64, i386, and aarch64 systems running earlier FreeBSD releases. Systems running earlier FreeBSD releases can upgrade as follows: # freebsd-update upgrade -r 14.0-RC1 During this process, freebsd-update(8) may ask the user to help by merging some configuration files or by confirming that the automatically performed merging was done correctly. # freebsd-update install The system must be rebooted with the newly installed kernel before continuing. # shutdown -r now After rebooting, freebsd-update needs to be run again to install the new userland components: # freebsd-update install It is recommended to rebuild and install all applications if possible, especially if upgrading from an earlier FreeBSD release, for example, FreeBSD 12.x. Alternatively, the user can install misc/compat12x and other compatibility libraries, afterwards the system must be rebooted into the new userland: # shutdown -r now Finally, after rebooting, freebsd-update needs to be run again to remove stale files: # freebsd-update install == ISO CHECKSUMS == o 14.0-RC1 amd64 GENERIC: SHA512 (FreeBSD-14.0-RC1-amd64-bootonly.iso) = e22610b512e8118e60f55e708674d7682eff3255f799fb81a4a0c67bdb554727b615f5c47969e6393cffa222b3743dcfc143dba434fa21ef016fea2da75980fc SHA512 (FreeBSD-14.0-RC1-amd64-bootonly.iso.xz) = 3a73c97a0da5e50ad84800d436d7226a9440ded7614477899e01426a6c2136d0d1643a416253a4c8e026a4afb8319d59caf19079655be0116d49c33103b93342 SHA512 (FreeBSD-14.0-RC1-amd64-disc1.iso) = 4071afbed55de8519466074e6969371a92592b16be93bef2756776aad4e7d7a3fb8432128f8a77f9b3659ae3663ecdf98ea0fcbd0d59456287a7c4c31bd53298 SHA512 (FreeBSD-14.0-RC1-amd64-disc1.iso.xz) = 5b34d3a798e145bdae164b01f26f62dfcdb72a1bf66d28f551700440ba763ccbce9195eaf01daef6eefc97ebcd5dbbb23179b7d5c931bd2b5a240e49cd333cf0 SHA512 (FreeBSD-14.0-RC1-amd64-dvd1.iso) = fb458b42870bdbb4835f5fd06899d4995667b973f249be6c386f225ee9f472057e8a14390aa1a3e8ed483c44fb09a74ac1b1e8beba40351a0e9b4a57a089b1b7 SHA512 (FreeBSD-14.0-RC1-amd64-dvd1.iso.xz) = 8804d9bd3c5e04d266a55894c580b2004f0550bb03d03b7a877494ccc2eafc1201c44699a7de3da1631cec339b39b8536c3bf1543626d9ccf987bb0e7e833547 SHA512 (FreeBSD-14.0-RC1-amd64-memstick.img) = 25aefc26d6e16f6dce9d6a5c34609c991cf420c310c92803520ca0472d4f834eba2d5e3ac046c0f17e0abd178c87ba34654508c5ec8d697095fc487c762a0089 SHA512 (FreeBSD-14.0-RC1-amd64-memstick.img.xz) = d59b528b97d1f39fa9ba80e204c10ce59ef09de19932fdfde6dbc52361fd5fe88d3c1472833d55c7b07a1d038f578e26a8b7e107cb22765f28938a143bada4db SHA512 (FreeBSD-14.0-RC1-amd64-mini-memstick.img) = d680062e0c82d82a598e41ee0d70a4d929324fde7bfb8ab3588c68d9a635111411fccfcfd9d154ac1e8692e91c0be1a6568d2bc60bb6dffe9bdfce8f9ea0101c SHA512 (FreeBSD-14.0-RC1-amd64-mini-memstick.img.xz) = 1e353a41fcbd24c7c5981f8868a77cc41fae8bbe0897ede317df6f9ab46903426279cfc97bd1ccf967ac1acb932175157ecb6b83b4c90749373025f56ac09091 SHA256 (FreeBSD-14.0-RC1-amd64-bootonly.iso) = c88fba341b2b68c40b74984c6a209ac871ebf7339adebc86a71bdf7cea3d82c6 SHA256 (FreeBSD-14.0-RC1-amd64-bootonly.iso.xz) = ba48679e9e28987c0527137e7bb854b162303443e18b14aacd7210666db6d6f9 SHA256 (FreeBSD-14.0-RC1-amd64-disc1.iso) = e478244f369805e31a458b3561c4cdf681ea660a8719b1951b2fc6ff7dd308dc SHA256 (FreeBSD-14.0-RC1-amd64-disc1.iso.xz) = c414e6373eb7800ab8127e3e32c9447ee2318dc00ef01176dcebe0585159ac10 SHA256 (FreeBSD-14.0-RC1-amd64-dvd1.iso) = 1e9c99b2c6c2290d723495eba50c80b74b56d0050744e0164dc949ca3aec8467 SHA256 (FreeBSD-14.0-RC1-amd64-dvd1.iso.xz) = 3bfe3fda5a0d75824e29017ebb475e76c53990d8232d97e164e7b7aa42f4750e SHA256 (FreeBSD-14.0-RC1-amd64-memstick.img) = 00af8fce7db2ccd812d0b83c3381b12bd311981eeaef9b35968dedb7933117c4 SHA256 (FreeBSD-14.0-RC1-amd64-memstick.img.xz) = 1f8a6ae3290d2607379d1e8323333bc26d472e170d6f0d73d535f88ec8d5bb90 SHA256 (FreeBSD-14.0-RC1-amd64-mini-memstick.img) = d707f59319afa8f17fe6d6076ecd18434fccedf0b9ca9aa244b271a928175cd2 SHA256 (FreeBSD-14.0-RC1-amd64-mini-memstick.img.xz) = fd54dac350d89d7ee3cb878963df0301f42f990573bed5ecd2dc99c038c6527d o 14.0-RC1 i386 GENERIC: SHA512 (FreeBSD-14.0-RC1-i386-bootonly.iso) = c7ba6d0c9b875f27d01256ecda06ee9ee66541ddc4c7086eea78dec96c28dcb76f423f622ee187793f8720e8971c82b3247cefe6b62b23e081c71853ce7a05e8 SHA512 (FreeBSD-14.0-RC1-i386-bootonly.iso.xz) = 8a1546f2feb8100ddc09ef2c0cbe8d55ff4fc34def28cb0b6f172221e427d1b8fd12932956724c67c895d53513527ade1e082975af7540fd6a850f6eedc61fa8 SHA512 (FreeBSD-14.0-RC1-i386-disc1.iso) = ef0a7bbb351c05cc8228aefadda3d0f3ffbdab013cf28c2b7ec1da87e740288859da0a8c91644ed23e09f98f453de0a184f99b85403a18000a8396f9de3724b1 SHA512 (FreeBSD-14.0-RC1-i386-disc1.iso.xz) = cc53367c84581bc75de1e7aed962acb8ba4a8d49d389a0b4690fa68fd7e0bd3e05a72bd67896680d9da0b5e3fb7eb687d8411c84eee515c1b9261f3d6f596efa SHA512 (FreeBSD-14.0-RC1-i386-dvd1.iso) = 74e4d693c8a06676c163148eabe6cb4abf8ba39c36b78fc240662436a076feb50404399f4f5ec2e7d29d317409a09bfa27f8a349cf0ede80ab871233de5d588a SHA512 (FreeBSD-14.0-RC1-i386-dvd1.iso.xz) = adb44531bb8e383ceadc21fd313411bb25bde5bd45ba792f2258ff351367953e430cf6b54180fd1dfc5cbdfedc91d73e5a6fff5c84509fdd00436a99daf040c1 SHA512 (FreeBSD-14.0-RC1-i386-memstick.img) = 6daad3ed2da3b8df3e69e6bcc7773718a32f0b3929d1a2ba8f996c50a6e283d7312f2fceb3af40ecf38fd26af53dade1ca0fe9e8c5005e68a53421441257d91b SHA512 (FreeBSD-14.0-RC1-i386-memstick.img.xz) = 1a80504ac45386fe7e7f73b1b9a4fcb2dda909623acfd156c193a3b3469febdac0a57478d7e9d3ea7c043b8bbaa31bd0ec7d89b4bf3e1be493f8ce356592b228 SHA512 (FreeBSD-14.0-RC1-i386-mini-memstick.img) = 05798d0aff78d5bb4b112c1c1b1b9fe865f67abc9f01be7aee9370740608093ca597e423e3ee29d35639d0a37b4aacf74b1d753a7d8540c8192a170949de283c SHA512 (FreeBSD-14.0-RC1-i386-mini-memstick.img.xz) = 37b4772bb4821002e95464f3e644352b8e543b38d3a8fec88a1babd36433231f30a9ce136fe08fe90cd9cf3e3d94482fb556ac8f8bc20862f662bb072bb5d052 SHA256 (FreeBSD-14.0-RC1-i386-bootonly.iso) = c7f151a0b4b8608f6064ae4b715291a940fbcb719b89b392b8d72f66d0c32942 SHA256 (FreeBSD-14.0-RC1-i386-bootonly.iso.xz) = 3327bf9842fa768d3d1f1257436096f8c4ff8b719689136009c81ef64b3780b2 SHA256 (FreeBSD-14.0-RC1-i386-disc1.iso) = d618fa224ef5d7fd3510969631674905a2e75267a149a0351f88dca1aa9b78c0 SHA256 (FreeBSD-14.0-RC1-i386-disc1.iso.xz) = f7e4001e28ae50e51834f89c8248fdb2cc3905ff3f87329fcb82f0d34a57f1ac SHA256 (FreeBSD-14.0-RC1-i386-dvd1.iso) = d59417fc0ed26b9b2c1e3c1838a84b24cf2ff1a5d78244c24278426cc2919174 SHA256 (FreeBSD-14.0-RC1-i386-dvd1.iso.xz) = 37585be211535f62fcba7c877e8503212b7fabca274a31fbfbd8ac04985d26f5 SHA256 (FreeBSD-14.0-RC1-i386-memstick.img) = 4174ce5479c893d45543e9caa5c6da02ab3e31917c1c6edc4fc2a9745b990dea SHA256 (FreeBSD-14.0-RC1-i386-memstick.img.xz) = e694f2a5f80e32512567d8619f56ad1ab7cb66e92b4526f03fd5a514dd216b7b SHA256 (FreeBSD-14.0-RC1-i386-mini-memstick.img) = 8719be1d797fca1416461cf71d875311b779c974ee745342622ab690251d3201 SHA256 (FreeBSD-14.0-RC1-i386-mini-memstick.img.xz) = 7470b6444d03c60b27ad8e68918260e4a123de15c0afaee301434847bee68aa7 o 14.0-RC1 powerpc GENERIC: SHA512 (FreeBSD-14.0-RC1-powerpc-bootonly.iso) = 02d0fa6b624c0db04ec00b463933c8a89935e74335d0878f69b7e5f5f652160599178b91b2f09e892f1720788897df89d3e89cd72246895689f8d610b4fe5b22 SHA512 (FreeBSD-14.0-RC1-powerpc-bootonly.iso.xz) = e72ed1b50ff647f3439b450864b6e1bd58d53a2a792ea0f3a95c4bbc3d4545381642e7374ba050f54ac13e928225abc85494996a7a553af50c5a7cc36dfbe33f SHA512 (FreeBSD-14.0-RC1-powerpc-disc1.iso) = 20b3e51ea28e7d202c5c0bb3cc99a3b7ad1e63ffc0d395d34cea8bfc2fce45f8326263967dac2c2cf25f430141d807e9a6282b74a980bbdc0ef3e307c8c1fc1f SHA512 (FreeBSD-14.0-RC1-powerpc-disc1.iso.xz) = 3d174ae8acc027a57398c491893bbcfab370241f577ed22d59784aff10cbeffcb421a37354f75ae3ee52930397beaae1d40777944cab5caf55def766177349d6 SHA256 (FreeBSD-14.0-RC1-powerpc-bootonly.iso) = 158cb8573093b9ea3fbdd508af9b800abad2ae5a61e32cc430d795221cb17120 SHA256 (FreeBSD-14.0-RC1-powerpc-bootonly.iso.xz) = 2508fc48c90b4bc87c2068d07d8b027f5913e5f5a34224f274d71095f14e9428 SHA256 (FreeBSD-14.0-RC1-powerpc-disc1.iso) = 793e801c1fdbf12ee6cb243a6ef8bd6ad2a8b2f4a45b88376521b1013dbd1684 SHA256 (FreeBSD-14.0-RC1-powerpc-disc1.iso.xz) = ae84295e697d13df4b1872c36464f643d52d0cc9ac4b30dc02afe8dd575f24c2 o 14.0-RC1 powerpc64 GENERIC64: SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64-bootonly.iso) = 0d0a47209c1194b253ae8f5b4316d4221acd438ab87f0c16aef75ce415b4a3713b303c93f8d317a9df62481bd740ceba2362e6cf0dd9b7b53eb5ff463d60041c SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64-bootonly.iso.xz) = 8c423fc7cb38dcab90ffaad586c3985ad759d2d6b87c24312d537ada812257e08bb6a1c973f11b5dbad3461d338b64188d001cd078979a6cb77ddf8d4ce6b8aa SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64-disc1.iso) = a7ea5b5f1cdb98bcf85b16126d57f142a9bc5c2fa5a4aced9229ce90abe9662cc228a5c90dbef90443b055d5aed9641726b4733721d4987a37085391104f5355 SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64-disc1.iso.xz) = d84b81d2b7f7b4c307783ebbfd93533dd523e3396f6e8f6501f921161fd0975f2438ec070e9e837744736d76cd517a2fa3666ffce6093f98e4c80bb97ea56350 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64-bootonly.iso) = 7c5754da6a6b84f8c689c3600cefeda11de7275c84f8043ad4d16efd44077aa0 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64-bootonly.iso.xz) = 48bb811083eca177ea0cc3808f2d31cc8d88822671ac08ca4c65f0fbe3ceebe5 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64-disc1.iso) = 2cd74c13e654a7e40f5461899c98de9be7e2c3e2d6cae049b77b3f29bb9d0322 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64-disc1.iso.xz) = e402f5dd1ec613174eb994fc9f4011c86d4c74ac9a04905e7284d356d3e78901 o 14.0-RC1 powerpc64le GENERIC64LE: SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64le-bootonly.iso) = 016ee6bde00e40953cc9a87cc1d07c3f2885670614bfaf38360c87dbc78956db1f144c3df417bc6a6ded0cad45733b0d6543593bdbd272fb09e03a9ba5e757dc SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64le-bootonly.iso.xz) = e9a312fe40f31223353d327e08e86605712892df2164ce56ff383ba7bfba6db3bf55e85fc5a9aa83127755e0262bc64a425b1fae95e3aeec4ce59fc5d9fdb5cf SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64le-disc1.iso) = 6c45a87a0d2bbfcad13089c15142804d86ba0fcee1c2dd51fcb2888b5b6d2681f0bf3acff7bdea92c67d63dc3fe53b2217e5fb0068faaa8e4cdda002b79b95c8 SHA512 (FreeBSD-14.0-RC1-powerpc-powerpc64le-disc1.iso.xz) = d73f4f885e0b1402f903212039078d010d67591bf3adcae61e06db595d5fac1116967edc45c691e3ce8e25e6fec74f3b0a2ecf2c1fb7d91992a652bafd228d0e SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64le-bootonly.iso) = 6fa4bfaa4f641c1b3e9cd8934c8cfdbcafbcdb1e21c4f27ce86a8e0270143297 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64le-bootonly.iso.xz) = 29111c9cee20935b39d019092cb38b3dab9335c129fdd867f43ec1c97545b3ea SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64le-disc1.iso) = 50761df173f8e7c6044450900b771760d4df1b14a24095c99fc7bb8a530b2cd5 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpc64le-disc1.iso.xz) = f52c5dc58ffe7718a0cb1429bbb312bbb68042e7b34b0eeb710ad14a530ba38c o 14.0-RC1 powerpcspe MPC85XXSPE: SHA512 (FreeBSD-14.0-RC1-powerpc-powerpcspe-bootonly.iso) = ddf1fde64dfe946b70c00f506379bb16595b582e123405c2ab103de19e737121d83417cbffb1e6ad6a652993edd4c2cc45abcadccfa9ca2efe90eab5cda6722a SHA512 (FreeBSD-14.0-RC1-powerpc-powerpcspe-bootonly.iso.xz) = ca7081d118793381e7c8cda6aacbffc517265e1f4227e2a96364c7e1094d5fbf2dcd81abaf9eaabc5d0b395b049a6662aeb79cf2e2e2fe537390ef1c8b590568 SHA512 (FreeBSD-14.0-RC1-powerpc-powerpcspe-disc1.iso) = dea650a114dca5e6c9d7e0ab02ec95352c1c734a4c14754495318bbe3107e38d3cde159f5d7d0cd207430833ee0ed5f2f3a92ccf7ab7b3aa3f0e51ef03818af4 SHA512 (FreeBSD-14.0-RC1-powerpc-powerpcspe-disc1.iso.xz) = 8c8ac57c2220381b5e16b40ebcf93a19c161d1bf4a56f5666d5944fe1dd62b140653a06d825b110f623223c7a2a09fc8ca574cce5ed7c234e6926443f8b954c8 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpcspe-bootonly.iso) = dcf88bebe6d07fe65a987703db66ffe59186b3d3411348bba7d045defca96d0d SHA256 (FreeBSD-14.0-RC1-powerpc-powerpcspe-bootonly.iso.xz) = 05c859878ad45945250856ef9a040ffb3a951f9a6251f3be173323856a35917c SHA256 (FreeBSD-14.0-RC1-powerpc-powerpcspe-disc1.iso) = 9a980e7eea27861533cd2a7ce34171d730e78be158685c5135b885447dc39a94 SHA256 (FreeBSD-14.0-RC1-powerpc-powerpcspe-disc1.iso.xz) = 6f45ce2ce803bd17081d75374d07201ec05de92105004b56cfb87f94a594a633 o 14.0-RC1 armv7 GENERICSD: SHA512 (FreeBSD-14.0-RC1-arm-armv7-GENERICSD.img.xz) = ffc8789b08beaccb36e6bd82e2750f62f927f4a4a88455a4d73ae5804fbd47bb40fe552452a3a48c65cec1a761a1bbebd9aa9fd08811066bb7afd4964d693d8d SHA256 (FreeBSD-14.0-RC1-arm-armv7-GENERICSD.img.xz) = e37d88e0b3a4e225166d5f618558e05500ccf99bfb4caf7b8fcf9118b2a23826 o 14.0-RC1 aarch64 GENERIC: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-bootonly.iso) = 14cc58e2482b214085eee45a4b0ee17192614058c3814728cac266b628a72615d2fb7332f1e50790bfd616f66cd823a166445d9fccb803751115f057663168c1 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-bootonly.iso.xz) = 216b51020bfc7babec0a10e34a3e0c8879f4609e9ce54033517025c27d318a262231eed57b7824cdcd3c3d21af456292e69470c25dab3dd489e99c7fe0fcda7d SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-disc1.iso) = 9a505187656bd6d8cd4b0bd344320b3167a9c2d5d6d6c925252fb6cd477a4bec68d2073d93a3f7bb2cd21490471194c7a30e4afd6db7428bd1107ff5fdfb79fd SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-disc1.iso.xz) = b6acdccfbcffa21f893d0de8fec1f0cdbe132134ebc3431a85a927c2e0540e331e272134a8756558a37ab7d94f4625bed15a5bb6a20aafb3a00dd4266806139a SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-dvd1.iso) = 322cdd736168658767f61dbfed44d42f93516a64514e12d6235fe54c2f3cfe36cc1617dfae1322b3df590d3a5e818f83b7d8a6da30cd8f62450779a61264a673 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-dvd1.iso.xz) = 3fa93e9b64902379f2e64c37a3426a85423147c35f6c46e85276a4ed61e66f9fcfddfae6ec8349d64408d54dc4290b2aa3b08a8b58a626021f1b2ab74f6052e7 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-memstick.img) = 04647910f299222c097ad9b2471d35fc4c61025471deae193ac52fd9f6509a6f52987d4d8ed4b0ad17e2e4b6bfa92e8f548a3b0e7a6ac4de4d35fd28d16c3a7f SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-memstick.img.xz) = bca110200c28c52be1f673320f4d1bf9b49354eaf870f265f257e2d36ea571701d39f89de461ddb703bd5b1bcb49bee3660bd0c320ab3f98628c4136c67cc190 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-mini-memstick.img) = 457d12c50c30cbf2d5e86badf98bf97765deccb9c147fb94b6021a24f769edfb4902d8834df82e800db611d9cb2d92d4c6216cb2cc0e7caf3c4f8075e047c1c7 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-mini-memstick.img.xz) = 112c83d53a1877aa2ead214f6c791e0d8d86a4504a815e29862f790ac7fc2e21957fd11f8649fb87eeff8dd970acf60e540792d73aa8d68d0efcc70a9f9ee654 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-bootonly.iso) = 473e840b7aae584cd0bbd6f98b416317556665058e7f057db741341c7bc1969e SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-bootonly.iso.xz) = 1bcb41f9a24bfeb343c098632a555ae728b0252cb5f6d56290a46de660e544b4 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-disc1.iso) = 1253a3a58faf17c417c2c19dc32d4b8b15db1805dc213c4127a648cd72f1d3f8 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-disc1.iso.xz) = 04c9c1571bb9d71cba4bead1bb8f68697f092efef95bdecc9bee4b075fefb103 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-dvd1.iso) = 5f05430faffb58ef0d9070b85472e6d941eb2f37ba0bc41cdf98a86341701c29 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-dvd1.iso.xz) = 3c8eedd979f15adbcb161517f953a8a3acc91a272393991ab1d73a81e1540667 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-memstick.img) = fc67f9f4ff87a9e1a74d023fbc925df5409583f9bdfb623a94307180a89d1222 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-memstick.img.xz) = 40d9375960501b582fedd830637075052ca3a1ea12535b5783e214827bb2563d SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-mini-memstick.img) = 2bcb0b2646e6a44e60f6e019fc8a7a90dc63cf67c3198c76bf28343bac62c5d8 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-mini-memstick.img.xz) = 790b52d043c473a2d758559e18367e54ed1cba67e60a01f5a17dc4150cfaacee o 14.0-RC1 aarch64 RPI: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-RPI.img.xz) = e76965f38fbb95181ae5fbdcb9646bc7c0b51b642ccd19735d7ab4a72e835a7c9cbaa8f72e229d7452c22f09225b42e5d8c546c22eb21405ab26b6fe33ecdc4f SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-RPI.img.xz) = c7c9ecfc63040c87d783d9f9a2803c9491c12f7a7a8ff1312cfce128d5199c59 o 14.0-RC1 aarch64 PINE64: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-PINE64.img.xz) = 8a6f783463ed15a541fecf460f50fcd6008e5c366e6c3e6f6a0dad029d4869d1dfb8a022b79ceac51600890b2b57d6533487b1307fd66443a02edc028a1d43a0 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-PINE64.img.xz) = 8630d9d27ca3ca916d7a76ff2df0eeb36770d877e13692bbc3eb2057d66bd17f o 14.0-RC1 aarch64 PINE64-LTS: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-PINE64-LTS.img.xz) = 260acf27d99e49acd5e3bb21d3064bdf5dedbdb49fb06e6c920e63739b3639797a9a8dc9e976897e874050085ea4ee62e4ca7a34cfa116912059689257ee195c SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-PINE64-LTS.img.xz) = 68da307f40ce775f95e3fa78d1264c30c113756ff7d405a2f98d28a9a67c6205 o 14.0-RC1 aarch64 PINEBOOK: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-PINEBOOK.img.xz) = be15aded883129347952b5905d5a4a88b8e7360b4d8e3033ec2257132220ff1a7d0826043ae6c17adf90373bff2dd15aa92faad23939f0e142f3f40a2416a35d SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-PINEBOOK.img.xz) = 84d092ec0dc5078574790e7bfa303c02f427fe0d33f5145956bc05c118d12521 o 14.0-RC1 aarch64 ROCK64: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ROCK64.img.xz) = b41082063f8aca4796e3ea118d8abd17d4979e5269f4faf7df5da28a1f3790e12b2f39d56192c5352b6aea41c556b270341dc229f66fec659356ffdf173fe150 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ROCK64.img.xz) = c105c98134de1339b23f440559335bc8ac84ccbe933ee63a992a23c8d5370234 o 14.0-RC1 aarch64 ROCKPRO64: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ROCKPRO64.img.xz) = 3c8948e55b5689d27bc16757d6bfbc2e353283c4e0d7de66998f9765b6a278f666169cfa7012faae2d85e0bc9ee9d6bc8f376f8a2bf8e92c8822ed9733b1a037 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ROCKPRO64.img.xz) = c4c50161c7811f889eb04682995b61187c3821b45070678bae6e8f7e3b5faba9 o 14.0-RC1 riscv64 GENERIC: SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-bootonly.iso) = f3476e186667b399d36fb747caf788dc41315274913b815873cc3d5cb56dfe6c6404b51dca6f6c453b58f179dc8e212265884edf52995533f0e756c9357216cc SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-bootonly.iso.xz) = 6292189a1433e843d295b016ad0a5753c37c6ed1d5ba619a02f9a0de363f5d2a1f23b1aa2a2549969adde094f22e426ee6271cdc8429273daec29aae692854ae SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-disc1.iso) = ebba33b365d3340c075fa8f1867dc3b69ff9b5071ba4b4b5332b77211ca6a4cd30daaa28d2471bb3b55bd1695d84bc4ad001c5e3fa4dbba0b6c5fcb5192443c8 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-disc1.iso.xz) = 318fd46c2cc0400efe698cb85490290b84c7d990ea4d16a3878ec91905bca19754819f198e064114e8d92c4c1ab332e683c2e52eb712c13fc3b668e1da409a6d SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-memstick.img) = 87d1d74051ed33a0feb7e9642f8b643e658fc3048b8b26143496ce7debf0a4d0fc667d9a0bdcc3c6001310ce377500e81fe67fd19348e1f73aef68e2420bcb09 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-memstick.img.xz) = 47de16329561dae7b5650561e905fb6c068476f62a9541fab4fd1ee88cb95db38ae7b083b90669c6dc8e644330298499bd9ea0ed76824c3c137786c112b478d2 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-mini-memstick.img) = 987146afb9c88e60ab3b637e69d21de6eea6bdab787dcd9126fb3d75d9cc4e0cf563846925db817520f16414124b275002d0049491029de2547af275cbdcaa63 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-mini-memstick.img.xz) = f0e4075cd93cf536cbf895ec9ab24914e1daca6ac4250630e2a11c1b41c2e4a7dfdfaf1d34141c6c507ba568767a7df3f28a9bee9042ac76ff6a2db6a636c533 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-bootonly.iso) = 5ac49ef6f3e8fa7d0a3cc68e3337d0444cb69f91424ff565affa502573368e02 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-bootonly.iso.xz) = 77e84a4850295c9747c7f5f8735d3eeae708fe7b67aa771e59da4d3e1b701cde SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-disc1.iso) = 1fdcca852e6fb8af3cbd7dbfdd0e94f0d1e9495c4221af61782e820f8bf90fb5 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-disc1.iso.xz) = 662e67c06970ae4632948e1dc9efb8b6d10751dbb7d26916d0908a942f91ddb1 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-memstick.img) = 3ce683dd62cbc325205c4af2039e2d1d6b25cd529eef6862640970d8a522919b SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-memstick.img.xz) = cb521b3edd067ff1e5ed5e6b073aabae852296c884406f7baafcac01d8ba337e SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-mini-memstick.img) = 5d30ce82997c68ae068dfdab2580edaf2e19368de938cb17654c134c36f19053 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-mini-memstick.img.xz) = 7dd7b5f0e01a821197ed8db28d317e0e2c2af80de61e880c5888effc93c4d8ab o 14.0-RC1 riscv64 GENERICSD: SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-GENERICSD.img.xz) = 22bf5d9242d00a942510da45f030ca876c0ab40abc416f587111b298454094c5760d7b80794ab3553f6261dfd18932553d9d18f7840df9aadbf7dd8fdc523e40 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-GENERICSD.img.xz) = 0b2033fd5cd5b4ea4a11b60285064651406a57c71f55bf3445fb43c889610baa == VM IMAGE CHECKSUMS == o 14.0-RC1 amd64: SHA512 (FreeBSD-14.0-RC1-amd64-ufs.qcow2.xz) = 6ed612fe431780a071c24910e922618e2d6d39c218ea9a4f93ac7e384ea37d85950390f7bb94a2d9137fab210d2d28b1a13bf0527ba8c62d17a9c5f85d12724f SHA512 (FreeBSD-14.0-RC1-amd64-ufs.raw.xz) = 1994d41ecded153fbf8f2cb79c59f81fcad5ac0938e613168279716f487cd041df18abe72a192e1ca6c5813a5a85b1f736883947f05090480769773741384ea5 SHA512 (FreeBSD-14.0-RC1-amd64-ufs.vhd.xz) = 4fb8b18f5b0bcff7a8ab243a85b289820e8d6a204b821bcd9d33dc7e1889932efe6f88f5c8539d1cf557bcba860ab9897e639e877347654d728ea09fed3f81aa SHA512 (FreeBSD-14.0-RC1-amd64-ufs.vmdk.xz) = c5360b7b4e5e6e8deaccb738bd7b302cbd654681dd952f77c301f41572a699cecfe8fefa2277c6801527c90974e8285817cfec416f6ddbde22635affe6cbcaf3 SHA512 (FreeBSD-14.0-RC1-amd64-zfs.qcow2.xz) = 2b3e2461de242bcb752f74614c2c0d80f9901436a9b2fdaf88f11dd9d15fd9d494a26a358016ac637b11b98ebfd84f1f8232aa5db291af1d751ce4cd363254cd SHA512 (FreeBSD-14.0-RC1-amd64-zfs.raw.xz) = a921d23d644a89638f3e147a26e568d372709987e2cebcd12079348633ee46ec1490283f30b9dd2eedf8c9b5184da720e3d26d842c64026bb8a00f40b2acdd6d SHA512 (FreeBSD-14.0-RC1-amd64-zfs.vhd.xz) = 80ea46165159013a10c3d0e1b21c80efc66ce62ec619ac0f580e58d3a65cd2fa9f04c8c321115ad4a6e15228e52636b0a9706806daac12710426d309e60a0506 SHA512 (FreeBSD-14.0-RC1-amd64-zfs.vmdk.xz) = 21ba0dd60d5e246fe552dbe5fbc28e82eaf2773c0aa7500313b9cd754ad5e57b27d21fbd09f41b2acb363aa298fdf8ab39bbe553fc1053a9b734cd41a43ea525 SHA512 (FreeBSD-14.0-RC1-amd64.qcow2.xz) = 6ed612fe431780a071c24910e922618e2d6d39c218ea9a4f93ac7e384ea37d85950390f7bb94a2d9137fab210d2d28b1a13bf0527ba8c62d17a9c5f85d12724f SHA512 (FreeBSD-14.0-RC1-amd64.raw.xz) = 1994d41ecded153fbf8f2cb79c59f81fcad5ac0938e613168279716f487cd041df18abe72a192e1ca6c5813a5a85b1f736883947f05090480769773741384ea5 SHA512 (FreeBSD-14.0-RC1-amd64.vhd.xz) = 4fb8b18f5b0bcff7a8ab243a85b289820e8d6a204b821bcd9d33dc7e1889932efe6f88f5c8539d1cf557bcba860ab9897e639e877347654d728ea09fed3f81aa SHA512 (FreeBSD-14.0-RC1-amd64.vmdk.xz) = c5360b7b4e5e6e8deaccb738bd7b302cbd654681dd952f77c301f41572a699cecfe8fefa2277c6801527c90974e8285817cfec416f6ddbde22635affe6cbcaf3 SHA256 (FreeBSD-14.0-RC1-amd64-ufs.qcow2.xz) = 891de3d179cee6fc955f4e3c0255b628c23f8b46c0afb38d0ac121722df60bed SHA256 (FreeBSD-14.0-RC1-amd64-ufs.raw.xz) = 1835318ac047c232225bf996f93262899411dc6b18ad2de31b5a29727750a892 SHA256 (FreeBSD-14.0-RC1-amd64-ufs.vhd.xz) = 24e1a3323084244035bbc42e56edb6c1e35d3cb291d48e87c8edd583ec6c4e1f SHA256 (FreeBSD-14.0-RC1-amd64-ufs.vmdk.xz) = 65957e4ae49f6e92f857c7f71998f9f7e7ed198d69fff9581524f8079dfedfd5 SHA256 (FreeBSD-14.0-RC1-amd64-zfs.qcow2.xz) = b5f00e780a3e9f2a6195b4e7cb32443259cfec28889f579d44823409661199a1 SHA256 (FreeBSD-14.0-RC1-amd64-zfs.raw.xz) = 503b3e1273a058bdb2bb68b45c318812ea7737aa855dadab699356cf160787d9 SHA256 (FreeBSD-14.0-RC1-amd64-zfs.vhd.xz) = 5aa1784c3b2426f68da0ad7c79a4954fe8512475118cb4eacf79a2339ad51fb3 SHA256 (FreeBSD-14.0-RC1-amd64-zfs.vmdk.xz) = 5c1b05190ea8fb72d025f00762898511fefefbc4e256cac9e3fc1e73ef96034c SHA256 (FreeBSD-14.0-RC1-amd64.qcow2.xz) = 891de3d179cee6fc955f4e3c0255b628c23f8b46c0afb38d0ac121722df60bed SHA256 (FreeBSD-14.0-RC1-amd64.raw.xz) = 1835318ac047c232225bf996f93262899411dc6b18ad2de31b5a29727750a892 SHA256 (FreeBSD-14.0-RC1-amd64.vhd.xz) = 24e1a3323084244035bbc42e56edb6c1e35d3cb291d48e87c8edd583ec6c4e1f SHA256 (FreeBSD-14.0-RC1-amd64.vmdk.xz) = 65957e4ae49f6e92f857c7f71998f9f7e7ed198d69fff9581524f8079dfedfd5 o 14.0-RC1 i386: SHA512 (FreeBSD-14.0-RC1-i386-ufs.qcow2.xz) = 3e80e5992b0e92d5b5ba78068da3e111acb5e6881d3f86a4033ccff2e73d41bd6717dca28b21d244a85d5cec5a6a7e486b8346e63fc938f610c6f003f717325f SHA512 (FreeBSD-14.0-RC1-i386-ufs.raw.xz) = 6e5808bdb9e068bb5211f7e90861101b68ded1d4a818386a7532e1a71ee373af7291c706f4b0157ed7d1217db08a4296791d7b52d6d637846da7c94fb48d295e SHA512 (FreeBSD-14.0-RC1-i386-ufs.vhd.xz) = 96230457600a477842ca028c1f59aa4b7d0ec5203e25dfbfd5ab2d0e91ba3920a50729e73caa2a478fcfdd60f7ca0e4c2f5e55e8bafa6bf7f75c2cefef17395c SHA512 (FreeBSD-14.0-RC1-i386-ufs.vmdk.xz) = c1cf9e4de4612fedb9e48044921d809c416d34aae58b21d1c5bed174e805043bf8373dec6cf46734b143b9300effcd8a2212006b653b8d7e5f89cbcbcf22e476 SHA512 (FreeBSD-14.0-RC1-i386-zfs.qcow2.xz) = aaebf1fe0f59d022ad2b4ff70b5c70e5bb3a5b54bf3efb924a4efca7d7716e18669bb228fed8ebedd7aefda2285e847c0a07985feeb83c4d89c98a75b485a47f SHA512 (FreeBSD-14.0-RC1-i386-zfs.raw.xz) = 2fc5f5c9ac21733eede0a2f7d1512118310ed196b9825470cb9a8fed0d5cfff8c9e3aff5843ec2bfdafb70541827e13a6afee739294a24030d0e3aca76d4b9ec SHA512 (FreeBSD-14.0-RC1-i386-zfs.vhd.xz) = f64b556d08df27c88ad5a7521086a30fc9bf4a4f478c27ff9289208f6cc5c21143cb9751cef766f6b81f5ee0cb1c417c6f6663f91d8d8a73801ccf8349b788b5 SHA512 (FreeBSD-14.0-RC1-i386-zfs.vmdk.xz) = 2d980196e0aad2dadb5ee2f978030e875ee6d7dd5ffb5e82d39932c1458371b7bbad12dc0b066ab4a7cd1ea3917d20203d71e15ed9e24db3fe3ebf3b75c8f991 SHA512 (FreeBSD-14.0-RC1-i386.qcow2.xz) = 3e80e5992b0e92d5b5ba78068da3e111acb5e6881d3f86a4033ccff2e73d41bd6717dca28b21d244a85d5cec5a6a7e486b8346e63fc938f610c6f003f717325f SHA512 (FreeBSD-14.0-RC1-i386.raw.xz) = 6e5808bdb9e068bb5211f7e90861101b68ded1d4a818386a7532e1a71ee373af7291c706f4b0157ed7d1217db08a4296791d7b52d6d637846da7c94fb48d295e SHA512 (FreeBSD-14.0-RC1-i386.vhd.xz) = 96230457600a477842ca028c1f59aa4b7d0ec5203e25dfbfd5ab2d0e91ba3920a50729e73caa2a478fcfdd60f7ca0e4c2f5e55e8bafa6bf7f75c2cefef17395c SHA512 (FreeBSD-14.0-RC1-i386.vmdk.xz) = c1cf9e4de4612fedb9e48044921d809c416d34aae58b21d1c5bed174e805043bf8373dec6cf46734b143b9300effcd8a2212006b653b8d7e5f89cbcbcf22e476 SHA256 (FreeBSD-14.0-RC1-i386-ufs.qcow2.xz) = 763015d1d9cadc589fffbcb4f4eea8944f163ed2cdd9270a37c90d9ad6b6de8f SHA256 (FreeBSD-14.0-RC1-i386-ufs.raw.xz) = 8257e73e98dee886d93e1fbb3d718fcead46d8085411b770a62d6f623763df6a SHA256 (FreeBSD-14.0-RC1-i386-ufs.vhd.xz) = 7f4da9ec8027b3b6d8c528d70d38c6f0b9e4ec818a1df5c5d2c423a5ec472db4 SHA256 (FreeBSD-14.0-RC1-i386-ufs.vmdk.xz) = 7dc5ffe9a130ec035ae5a4b85fadfb3a910afe4a7e11209f3e58f27ab0547746 SHA256 (FreeBSD-14.0-RC1-i386-zfs.qcow2.xz) = ece655375dd5375bc8f8d0b8acbae025d701817bfd8d9f39a041dcc1f9f814cc SHA256 (FreeBSD-14.0-RC1-i386-zfs.raw.xz) = 1e96668fcdb1697e01f5f69fc9a6a42c0db89a68c5a5411d54dd3ebd423fb0a3 SHA256 (FreeBSD-14.0-RC1-i386-zfs.vhd.xz) = f0d547a1d0e24b456d7fcfad2b2cd4e6425a798de9d167e934c7a21fdc9782c0 SHA256 (FreeBSD-14.0-RC1-i386-zfs.vmdk.xz) = 4c169f31a95d6436044c72c936370f7426d04ff6c5f1c5fe7483199b230846f7 SHA256 (FreeBSD-14.0-RC1-i386.qcow2.xz) = 763015d1d9cadc589fffbcb4f4eea8944f163ed2cdd9270a37c90d9ad6b6de8f SHA256 (FreeBSD-14.0-RC1-i386.raw.xz) = 8257e73e98dee886d93e1fbb3d718fcead46d8085411b770a62d6f623763df6a SHA256 (FreeBSD-14.0-RC1-i386.vhd.xz) = 7f4da9ec8027b3b6d8c528d70d38c6f0b9e4ec818a1df5c5d2c423a5ec472db4 SHA256 (FreeBSD-14.0-RC1-i386.vmdk.xz) = 7dc5ffe9a130ec035ae5a4b85fadfb3a910afe4a7e11209f3e58f27ab0547746 o 14.0-RC1 aarch64: SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.qcow2.xz) = 2a985ee787b1a2feeb966380bcb5084e846452034b8ffe03b5dccd608343d1e22614b66ef5e55e48769179ba51ac2a2dc1cfd8071664a3364883f4553ee9f894 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.raw.xz) = 861f97bd74097deb2e29d23bca98d8cab7404509ab4b68d70f108eb33659955caafebfced718e44bfada1063f81811e075b0585550fc821ec1e46503d3b5681e SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.vhd.xz) = e5e30388b528fe7df6b1d6b30fbd2199d98037e2544d5e1efd1a11a80ec358f41c937fd7d2b200e3d9f3b2895d6305fc4760de93a688c93012574db12fb3f7c3 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.vmdk.xz) = 828307532960cf7f558d1e32a58b1266ccccf5145fa67b3974b780c6029758f26f162dd396a9026d53976a7d12aeaceeb58f216e702a961fd1a5f3d08493dd31 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.qcow2.xz) = 18f1cd3845ca716ac3ad8c92e1beebdda453faa46874358370afabaafb464d3d09e3879bca8c3e3bd4f3c9d9aa0f471ebc5a0a994d85b84b9471b1b79e08456c SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.raw.xz) = e86f0dedf38bf570b2aeb4eb00c9b37373b1706478dada9004cf70f84eb106556458b9a367c8455251883eeb261678b99022cdff4cc782e331e9d4993df9670c SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.vhd.xz) = 4cd7abeb90300580cb5fdc00d1cce89d3245aef31a63ff3c28e2b2f3afee65d99cd804affeccb2c3691f22e511d67a0b6966d75c9940e610ccde76986d870e7b SHA512 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.vmdk.xz) = eb018fe51e285f91f6995d4e5e2015b518c80db56d35b5549ac262b7e24e5914ac322a01f38a075f81cdf970dab5b281ad9ab4f7fa70cd19c065bfaf38c5c867 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64.qcow2.xz) = 2a985ee787b1a2feeb966380bcb5084e846452034b8ffe03b5dccd608343d1e22614b66ef5e55e48769179ba51ac2a2dc1cfd8071664a3364883f4553ee9f894 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64.raw.xz) = 861f97bd74097deb2e29d23bca98d8cab7404509ab4b68d70f108eb33659955caafebfced718e44bfada1063f81811e075b0585550fc821ec1e46503d3b5681e SHA512 (FreeBSD-14.0-RC1-arm64-aarch64.vhd.xz) = e5e30388b528fe7df6b1d6b30fbd2199d98037e2544d5e1efd1a11a80ec358f41c937fd7d2b200e3d9f3b2895d6305fc4760de93a688c93012574db12fb3f7c3 SHA512 (FreeBSD-14.0-RC1-arm64-aarch64.vmdk.xz) = 828307532960cf7f558d1e32a58b1266ccccf5145fa67b3974b780c6029758f26f162dd396a9026d53976a7d12aeaceeb58f216e702a961fd1a5f3d08493dd31 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.qcow2.xz) = c6c7cd52d2f779ca69c83a2e68fa6f58ec2f471b0c38c4422e80f2dab81bfb4d SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.raw.xz) = 58d49fca90e7933f015509ada15256ccc21877d729ee7cbf0b62c66d6c0cacb6 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.vhd.xz) = 0db30e70e762d061594250f8896e1c381ac49d26e057867bfb4f172d59d76ccb SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-ufs.vmdk.xz) = 24fad71a92c3942b84befb8b5427c0ff9c7db5dceec1c67008d717ce7ec5b13d SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.qcow2.xz) = 9e7d167622a8bc193981b670ba850505b965b8e303268269084d6424f505ee74 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.raw.xz) = 872599cc905b18e2f43496e7e239c300ee790c53007f3dbb258283812055d1a3 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.vhd.xz) = 946791e1b79b97c395adfc046c61308aae571797b4b5802b8e00414f929fef4c SHA256 (FreeBSD-14.0-RC1-arm64-aarch64-zfs.vmdk.xz) = 6b288c4bd290f16974813b8c78b71b1a2fb11ceb59ca4401149c2002dd2e4d44 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64.qcow2.xz) = c6c7cd52d2f779ca69c83a2e68fa6f58ec2f471b0c38c4422e80f2dab81bfb4d SHA256 (FreeBSD-14.0-RC1-arm64-aarch64.raw.xz) = 58d49fca90e7933f015509ada15256ccc21877d729ee7cbf0b62c66d6c0cacb6 SHA256 (FreeBSD-14.0-RC1-arm64-aarch64.vhd.xz) = 0db30e70e762d061594250f8896e1c381ac49d26e057867bfb4f172d59d76ccb SHA256 (FreeBSD-14.0-RC1-arm64-aarch64.vmdk.xz) = 24fad71a92c3942b84befb8b5427c0ff9c7db5dceec1c67008d717ce7ec5b13d o 14.0-RC1 riscv64: SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.qcow2.xz) = b22beda0d5861293b5852c0f98b9a4eacc757585fc8ac584c6ebeaa443a2bf542a66ab3b34ea31aa7db86ce40219025b183f042bc8f12cf94d1781d2de45a527 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.raw.xz) = a5f9cca94a601aaab5c0cc664fbce9bb20ab635d92309addfbb06e41453d59f75f901e3e1c099173d0030105052c0ca8cd783ecf9fe8f0f589eb84694b34de9e SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.vhd.xz) = b246ec13626c0af46b7889d585f452866feccf30bdaa42a8b67cd16e7aef86a191454587bbcad841e332d9d0e5dd6b78ee9b7f31a85d84cb8efd4a21a8ded81f SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.vmdk.xz) = 0b4e7790b21c15257dfa1136b13f027086604caf94fdd5c3c932e1092630f705ac533be0c434f2b6316edd852bb56a6f77f3489aa88bf27ca8fc9eab85b902fe SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.qcow2.xz) = 7925c54e24bceee07c9370b4dc05c7d26993cbfb514f6ebc70afc4668a96a600f70966b460e27485ca15b594147b4e10a2c81527f48a97755ff5e4fe78654193 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.raw.xz) = dee865b5142f12ced0ab595af883a835b89940869d96e7d7e8e192a0c7a0329e7ab98ba21668ca1aa2c88b9c16b3bee6af3b5de62367f3b5ede5c9c038f7057e SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.vhd.xz) = 5e8c8294538a23abdda4d40297b0e81c6187a9549bfaad24f9119f386df7952dabb2e97a592b5b7ba7e3971e4229c61bafdcb3c1f993c6abebe9481669b263e3 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.vmdk.xz) = 0d7bf3bdaf70237a3aa4bd3e5393588a19579b52440520c2c041130d83645c2e1c276e9b45a3f936dac4c9af04a4d3792decd7b60b3871d7b34997ae8f616ad8 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64.qcow2.xz) = b22beda0d5861293b5852c0f98b9a4eacc757585fc8ac584c6ebeaa443a2bf542a66ab3b34ea31aa7db86ce40219025b183f042bc8f12cf94d1781d2de45a527 SHA512 (FreeBSD-14.0-RC1-riscv-riscv64.raw.xz) = a5f9cca94a601aaab5c0cc664fbce9bb20ab635d92309addfbb06e41453d59f75f901e3e1c099173d0030105052c0ca8cd783ecf9fe8f0f589eb84694b34de9e SHA512 (FreeBSD-14.0-RC1-riscv-riscv64.vhd.xz) = b246ec13626c0af46b7889d585f452866feccf30bdaa42a8b67cd16e7aef86a191454587bbcad841e332d9d0e5dd6b78ee9b7f31a85d84cb8efd4a21a8ded81f SHA512 (FreeBSD-14.0-RC1-riscv-riscv64.vmdk.xz) = 0b4e7790b21c15257dfa1136b13f027086604caf94fdd5c3c932e1092630f705ac533be0c434f2b6316edd852bb56a6f77f3489aa88bf27ca8fc9eab85b902fe SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.qcow2.xz) = 34b40bfc17ea3493673707d17f9ce93690296030393c71f891eef04c880fffaa SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.raw.xz) = dba6a050415032c575f1de4f063987ec84384ce043f002eabeed3a9d1e4badfd SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.vhd.xz) = 6651e11b3d635ece35c1dbbef7bccfaf755fc8d788818f5a07ab1342e1336492 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-ufs.vmdk.xz) = a60ac9c7efdaa96314532b633e398623e0988ff51157785d880be3333c1baae3 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.qcow2.xz) = 2be3213ceacc43ac429c06b29750f8bd3259ef4073b662c81393807911fd596d SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.raw.xz) = dbc11d8e4fed4d7db2bc38b5dc8952f7e5428788206a27a01d813f8600a8086e SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.vhd.xz) = 0a7c8296374a2ea3567a87d7904c27285750797139e04239832b3c204a9ddf9c SHA256 (FreeBSD-14.0-RC1-riscv-riscv64-zfs.vmdk.xz) = cfed1add6f993ccbbd89637828474b560fafcb3e2787ba1bd98e1aae7435a80a SHA256 (FreeBSD-14.0-RC1-riscv-riscv64.qcow2.xz) = 34b40bfc17ea3493673707d17f9ce93690296030393c71f891eef04c880fffaa SHA256 (FreeBSD-14.0-RC1-riscv-riscv64.raw.xz) = dba6a050415032c575f1de4f063987ec84384ce043f002eabeed3a9d1e4badfd SHA256 (FreeBSD-14.0-RC1-riscv-riscv64.vhd.xz) = 6651e11b3d635ece35c1dbbef7bccfaf755fc8d788818f5a07ab1342e1336492 SHA256 (FreeBSD-14.0-RC1-riscv-riscv64.vmdk.xz) = a60ac9c7efdaa96314532b633e398623e0988ff51157785d880be3333c1baae3 o 14.0-RC1 amd64 BASIC-CI: SHA512 (FreeBSD-14.0-RC1-amd64-BASIC-CI.raw.xz) = affbcaf97bbfd14fbf15dcc03bfcae324ccd051390c35d5bd9945053b149bfc690705d4b96c802f711b4713af365574e188037ed50388e841212b9de60be3edb SHA256 (FreeBSD-14.0-RC1-amd64-BASIC-CI.raw.xz) = 219a8f2248663b42c55817d12ca7ba688cbdaa1e1c72318f104121bf5d89e1c3 Regards, Glen Please consider donating to help support my FreeBSD work: https://www.gofundme.com/f/gjbbsd https://paypal.me/gjbbsd Love FreeBSD? Support this and future releases with a donation to the FreeBSD Foundation! https://www.freebsdfoundation.org/donate/ -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEEjRJAPC5sqwhs9k2jAxRYpUeP4pMFAmUpy1gACgkQAxRYpUeP 4pM7DQ//ZVeisxBSt3z++4ur0yd/HpG0ebQDstz+HgHgBr4KIJ3dh3aNFPsFBti/ XzEKfRDFF77103E4k0h1aDjnyu+EoGlEV9BGR5es6TnIyTDWHDztESvWLj8zfHxt try+/3ynXu6l0BlUfXI/Jf3i6pvkgeNE6Nc+/T/IdCMDqccRDVyBid9vZxRwNp/0 V5LWy5BXowlEfE7hJMEPswrvLIACemf2D3p59kP66J03RRTTFrnFGoN5FI3HpWhG 1cWSj8jC3kDyFsO3aMVT9+Z4V3fqxWsayb6o1ytm/aVMmOq85amuPVi2zraKJatg a4e7u6wG3x6SfLCavCCAMBFlxerT/FxL0l0TdjYHW65Fx+2R37VB1fl3kaccw2yj TKFlt4qaUwYqTrVuy0WrEz7i4ZNuVxxScMaKv6nwAK40isnjrRT5tr48/1Q1QOHu Q+MOAclRQgrsDT2FvnT2VIJseSWjB1O7KZsBHSWfo6G9PYSGDhur9GELBW+61EZl EwgP5LALCLQz14WAzZs4VmQ5XVTyiQ/zwcowwJOCNNPxZrpUPdLg12+PtgX644c5 c64VvzWEk60iO9y4RNXoO3SGDEewvNAQEw5nVBrX2PN2QcyoVh9FWDQHUiTA7QFt qeaqDTaNclONTlgzg51JcbEXcOd14LVc7k3rnfT11bdSYpC+AJs= =Dniv -----END PGP SIGNATURE----- From nobody Sat Oct 14 02:34:26 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S6nWf2krJz4x8mb for ; Sat, 14 Oct 2023 02:34:22 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x632.google.com (mail-ej1-x632.google.com [IPv6:2a00:1450:4864:20::632]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S6nWd5qkkz4FHD for ; Sat, 14 Oct 2023 02:34:21 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x632.google.com with SMTP id a640c23a62f3a-9b2cee55056so467025166b.3 for ; Fri, 13 Oct 2023 19:34:21 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1697250860; x=1697855660; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=Hj1Cj0uX5MOmkHBdeuZKZgp819CvW/N6KkEGJFM/OtY=; b=qsk7Augo58qJi1TiOzEcTw8LVuJjtjVx1/K2zoUCun4ZmdSiC9RjOCyIYHZHC9Ga0q WpEQynjY1eEIRLARlI/yTrXtmsox+kpMywrN8Ew6SR9im2Z+2Q2c/DtrhmPFSnORmlx/ YvxRM+GqiwFLmxLePgzLoQZEMljrwgSYrDLDcOrbPuvWqZh0jx7t8TuemOV7vd3cASrm 1IbWKQh2kEeeSTXTN+ToiSeRq7dOm4PbJhgLe6Gc2HdNLDXPM8UnDWY7BxyKLxNO7v0O C288Kg/qLoneKaT4GbNxBec7QGreoWHir6ZF12wgrGUlS4AWoL9kcHLlsmklp20B5wDC aWnA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697250860; x=1697855660; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Hj1Cj0uX5MOmkHBdeuZKZgp819CvW/N6KkEGJFM/OtY=; b=NF3waoNTcvg2m/EYny+nBZHZ34NzE6DUHeUCYDBgkHs0DvMjSChFwD7RJtfhrChLN0 pqysqHwK81hYWEtZe9S1U/5S9C7NTLJesuVO9tb2ZdYOomL95qAx5sZyuehzELRxpgep uSmSk1X6p5wAT8NSktPNLX+WfSyiejyINdF6wO6BU/mzUOOat+0BoPB9Jx9lpjwrbc0r YXjvr7XvYQaZH/pWnlQuh0ll9PBDTSEHnLiHPCvw3zVn6mvcwAGBYGUn9GAzuZHRP20w ZKq5mnvhyyHyvEeKRX9bqPkLwl2OdIUpmU9oskNe00d+565Rp3zyI7uSmR04lAf+h7tG mCDw== X-Gm-Message-State: AOJu0YwDdUrkiA6sZF606w2kBQCjYtiAjbGFRLs6QIyZ9KqbnYoSnlGD 6LNxfonP9lZP2zU7KMrFpz60Z2KnXbSiajW7aTLeOTqUuIDqlOw4 X-Google-Smtp-Source: AGHT+IH0Rg4p5idbnYsnHVsvMsm0V7OxyUSMQM/fJf3Wl3hgyiWwccUlUmxeHcuIZtxElK1DDQxmH5k+SVhJcYjoHW8= X-Received: by 2002:a17:906:cb:b0:9ae:4eb7:ae8b with SMTP id 11-20020a17090600cb00b009ae4eb7ae8bmr28269273eji.7.1697250860196; Fri, 13 Oct 2023 19:34:20 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 References: <90d3e532-8ea7-4eea-8e31-8c363285a156@nomadlogic.org> <0ad493d5-1c1e-4370-977a-118f46ebd677@nomadlogic.org> <0c4f8149-89dd-4635-a5ed-4766fffd2553@nomadlogic.org> In-Reply-To: <0c4f8149-89dd-4635-a5ed-4766fffd2553@nomadlogic.org> From: Warner Losh Date: Fri, 13 Oct 2023 20:34:26 -0600 Message-ID: Subject: Re: nvme timeout issues with hardware and bhyve vm's To: Pete Wright Cc: FreeBSD Current Content-Type: multipart/alternative; boundary="0000000000009df5b20607a40240" X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Rspamd-Queue-Id: 4S6nWd5qkkz4FHD --0000000000009df5b20607a40240 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Fri, Oct 13, 2023 at 11:47=E2=80=AFAM Pete Wright = wrote: > > > On 10/13/23 6:24 AM, Warner Losh wrote: > > > > > > On Thu, Oct 12, 2023, 10:53 PM Pete Wright > > wrote: > > > > > > > > On 10/12/23 8:45 PM, Warner Losh wrote: > > > What version is that kernel? > > > > oh dang i sent this to the wrong list, i'm not running current. th= e > > hypervisor and vm are both 13.2 and my workstation is a recent 14.0 > > pre-release build. i'll do more homework tomorrow and post to > > questions > > or a more appropriate list. > > > > > > Are the messages from the VM? Stable/14 should have the important nvme > > changes I've made lately. The bhyve in 13.2 is lacking a number of nvme > > fixes that have gone into current and stable/14. It's hard to say where > > the fault is coming from. > > > > > the messages i posted in the start of the thread are from the VM itself > (13.2-RELEASE). The zpool on the hypervisor (13.2-RELEASE) showed no > such issues. > > Based on your comment about the improvements in 14 I'll focus my efforts > on my workstation, it seemed to happen regularly so hopefully i can find > a repo case. > Let me now if you see similar messages in stable/14. I think I've fixed all the issues with timeouts, though you shouldn't ever seem them in a vm setup unless something else weird is going on. Warner --0000000000009df5b20607a40240 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Fri, Oct 13, 2023 at 11:47=E2=80= =AFAM Pete Wright <pete@nomadlogi= c.org> wrote:


On 10/13/23 6:24 AM, Warner Losh wrote:
>
>
> On Thu, Oct 12, 2023, 10:53 PM Pete Wright <pete@nomadlogic.org
> <mailto:pe= te@nomadlogic.org>> wrote:
>
>
>
>=C2=A0 =C2=A0 =C2=A0On 10/12/23 8:45 PM, Warner Losh wrote:
>=C2=A0 =C2=A0 =C2=A0 > What version is that kernel?
>
>=C2=A0 =C2=A0 =C2=A0oh dang i sent this to the wrong list, i'm not = running current.=C2=A0 the
>=C2=A0 =C2=A0 =C2=A0hypervisor and vm are both 13.2 and my workstation = is a recent 14.0
>=C2=A0 =C2=A0 =C2=A0pre-release build.=C2=A0 i'll do more homework = tomorrow and post to
>=C2=A0 =C2=A0 =C2=A0questions
>=C2=A0 =C2=A0 =C2=A0or a more appropriate list.
>
>
> Are the messages from the VM? Stable/14 should have the important nvme=
> changes I've made lately. The bhyve in 13.2 is lacking a number of= nvme
> fixes that have gone into current and stable/14. It's hard to say = where
> the fault is coming from.
>


the messages i posted in the start of the thread are from the VM itself (13.2-RELEASE).=C2=A0 The zpool on the hypervisor (13.2-RELEASE) showed no =
such issues.

Based on your comment about the improvements in 14 I'll focus my effort= s
on my workstation, it seemed to happen regularly so hopefully i can find a repo case.

Let me now if you see simi= lar messages in stable/14. I think I've fixed all the=C2=A0
i= ssues with timeouts, though you shouldn't ever seem them in a vm setup<= /div>
unless something else weird is going on.

Warner
--0000000000009df5b20607a40240-- From nobody Sat Oct 14 11:07:11 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S70vW29dXz4xckk for ; Sat, 14 Oct 2023 11:07:19 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Received: from smtp-bc0c.mail.infomaniak.ch (smtp-bc0c.mail.infomaniak.ch [45.157.188.12]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "relay.mail.infomaniak.ch", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S70vT3QfKz3HVY for ; Sat, 14 Oct 2023 11:07:17 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=pyret.net header.s=20231006 header.b=mqbdWMXH; spf=pass (mx1.freebsd.org: domain of daniel.engberg.lists@pyret.net designates 45.157.188.12 as permitted sender) smtp.mailfrom=daniel.engberg.lists@pyret.net; dmarc=pass (policy=reject) header.from=pyret.net Received: from smtp-3-0000.mail.infomaniak.ch (unknown [10.4.36.107]) by smtp-3-3000.mail.infomaniak.ch (Postfix) with ESMTPS id 4S70vN1R6bzMpvQs for ; Sat, 14 Oct 2023 11:07:12 +0000 (UTC) Received: from unknown by smtp-3-0000.mail.infomaniak.ch (Postfix) with ESMTPA id 4S70vM6R8xz3Z for ; Sat, 14 Oct 2023 13:07:11 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=pyret.net; s=20231006; t=1697281632; bh=QY3rjCS6ph0xSmLjVbfzLVO3xM0dP1oNgy4DpBJFJrM=; h=Date:Subject:From:Reply-To:To:From; b=mqbdWMXHzEWQjOjoXADIsBmifA8FFA2+TN87HbxV5B0rEYLCrR1rHBUOb6XulVgZt 19BN/8vfMUE7S3RJ1LHnasSwA/rRKgGvJNGBSI1V8an7LsONUI2v51KKTB94QZjkwF tNJnrFsvTgPZORvjOatb3FJjdlMXxvG+yKNG+3lyCeCJFOrY0P93NDrbkpGgkL04xU fQo452EmdhdbieifughliUQlYSOr+8Qboecu4RMJ4LTv4Gqrf0X/varsNq/EIq1DkP kgw8s5LZP0sA8hEbqGGDmhuIsKcRZO/Z5M+AxXMA70SmJNLdrDn0WEYX/j1Y2EkAXF 2Kwy0LRs8bU+Q== Message-ID: Date: Sat, 14 Oct 2023 13:07:11 +0200 Subject: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) From: Daniel Engberg Reply-To: Daniel Engberg To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_=_swift_1697281631_d4351fc410acd4aad135b08fb6150933_=_" X-WS-User-Origin: eyJpdiI6ImI1UXFXaFRmM2lUZmpRTFdhNGg4RVE9PSIsInZhbHVlIjoiSGV3UmNjcGtBZG9ZeFVtUHYyaWYwUT09IiwibWFjIjoiYjNhMGRjZmVkMmQ4OGI0OTdiZTE1MTFlNDFjYzVhZjc5ZTc2Y2Y2OGI4ZmM1MGQ0MGExNmIyYzBjZmM5NTI5MSIsInRhZyI6IiJ9 X-WS-User-Mbox: eyJpdiI6Ik5vcUxuWEIwZUNqa05xV25NNmFYb1E9PSIsInZhbHVlIjoiTG41czd2RGxiNmVVZkZSNTU1c2hkUT09IiwibWFjIjoiNWYxZWM2MGRlODhkMzQ3Mzg0Mzc2ZDc2NTBjODBjNDQxYzlkZDA4MThlOWJjOWZjNzA4YzFlMmEyYTFlM2E1ZCIsInRhZyI6IiJ9 X-WS-Location: eJxzKUpMKykGAAfpAmU- X-Mailer: Infomaniak Workspace (1.3.569) X-Infomaniak-Routing: alpha X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.49 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.995]; DMARC_POLICY_ALLOW(-0.50)[pyret.net,reject]; RWL_MAILSPIKE_EXCELLENT(-0.40)[45.157.188.12:from]; R_DKIM_ALLOW(-0.20)[pyret.net:s=20231006]; R_SPF_ALLOW(-0.20)[+ip4:45.157.188.8/29]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[45.157.188.12:from]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:29222, ipnet:45.157.188.0/22, country:CH]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; REPLYTO_EQ_FROM(0.00)[]; DKIM_TRACE(0.00)[pyret.net:+]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; HAS_REPLYTO(0.00)[daniel.engberg.lists@pyret.net] X-Rspamd-Queue-Id: 4S70vT3QfKz3HVY --_=_swift_1697281631_d4351fc410acd4aad135b08fb6150933_=_ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, After updating BIOS on my Asus motherboard (ProArt X670E-CREATOR W= IFI) the kernel fails to allocate resources for a bunch of devices incl= uding USB and built-in SATA. This behaviour is also observed on at least = ASRock boards too so it doesn't seem to be a specific issue to one=C2= =A0manufacturer or model. If anyone has any ideas how to fix this I'd be = grateful. I've tried turning off and on "Fast boot" in BIOS without an= y success, enabing SR-IOV makes the kernel hang during boot. dmesg w= ith older bios (working): https://forums.freebsd.org/threads/sata-driv= es-show-in-bios-but-wont-show-in-dev.89656/page-2#post-620854 dmesg wi= th new bios (not working): https://reviews.freebsd.org/P612 Relat= ed PR: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272507 = If you need to more information or testing just ask and please CC me w= hen replying. Best regards, Daniel --_=_swift_1697281631_d4351fc410acd4aad135b08fb6150933_=_ Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable

Hi,

After updating B= IOS on my Asus motherboard (ProArt X670E-CREATOR WIFI) the kernel fails to = allocate resources for a bunch of devices including USB and built-in SATA. = This behaviour is also observed on at least ASRock boards too so it doesn't= seem to be a specific issue to one manufacturer or model. If anyone h= as any ideas how to fix this I'd be grateful.

= I've tried turning off and on "Fast boot" in BIOS without any success, enab= ing SR-IOV makes the kernel hang during boot.

= dmesg with older bios (working):

<= /div>
dmesg with new bios (not working):
=

Related PR:

If you need to m= ore information or testing just ask and please CC me when replying.

Best regards,
Daniel

=
--_=_swift_1697281631_d4351fc410acd4aad135b08fb6150933_=_-- From nobody Sat Oct 14 11:22:38 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S71FQ5q34z4xdRy for ; Sat, 14 Oct 2023 11:22:50 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S71FQ4v19z3KMC for ; Sat, 14 Oct 2023 11:22:50 +0000 (UTC) (envelope-from eduardo@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697282570; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=KOmKX6KkvRv1yWAUZIIkfEdhRMtxcANtBa9S9Wo2evs=; b=FgF0HHZNl4zSfWeGbxYQVzd5EyKapUqT3IMOf1MHqm5ID8dmLXnKBSYQr9aIt+1u2hl9UY fflld6k2cn/q3PWRY9gK3nY0HkOkYyGUefgzDNJMJaRhn4aKHf2UtSCeiIgguHFIYGtdK6 +sFc/5/+RcCgpKIUYrKFe2vQc6/cZ4UujK9PAihYry5rAC1Gjw8foM6AenpGbC666M/58s hCoqF3SXYPCL359c8CcVL5box70VuACeHX5bVbL0D28WaZo30ExCpFTiHjsC6QOpORlowO YywvFNkODqrqJB+bG/4EIsrGUc1Re9gqrkPfqumzQHvsnJL/d0KwbLAHI4QeFA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1697282570; a=rsa-sha256; cv=none; b=bkyb0iYj9n6jN2dXXIxf1TtYAuuXVoOvzoKaaCJl0cSyaTbakVTNIot3h7g1DyS5nB4ryZ 4x4aRFUsdw/vX/ftxbrS+3bnoJndMAYwQpmL0jUmMvtexXjyXKfn0NrZ3RwSeE21PT8Asj iFzjr0voeusTUcogJWmx0vVVDTJSeVRkceLruPOWxn+3iVp/hBjtixjdvOYZMMtbB6p8jp AQlzjLGo3vX0PDQ+0UV4OZK6Qgf03dbIChwdVmxZpjtvc9QGcJ70kYJaIyomjsG+dSe6G+ Y1MYBNa6b7ukYX9A1BJe8rSdfYiezIZbyxloyNVrmb3TPCjavwWEzBak38x3jw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1697282570; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=KOmKX6KkvRv1yWAUZIIkfEdhRMtxcANtBa9S9Wo2evs=; b=InJ8WQJwFHcMB0/ZLSzxAVygTKxbYbTWdglaQd4Xd7xJfp+wRpb/r/+1TaLLMy8pssEa+W A4RbiB4XyHAC0p0p44Un1nVUIaxr3+6yTfeuIDCzCXiwASbfg6+GxaGMLT0ii0LT2HzfVn azukFval6oNEu157XD+Osg/vvap72LdXMBrw68X/hC59zXSULp+IoyPQCeaB9YPiYtBjwJ OAx1J4gqh+ApFY9APZ/FLWF6cerbHbBTvrl5F1Km7HTSKWuR4L4xU8P1fQcT/aVx0SfIFX 5+8YNjGg0HAI0EsH+ShRTNa8QIiQZJO9n0r7n9agjF7KWnlms151Xrzq2AwISg== Received: from mail-qt1-f182.google.com (mail-qt1-f182.google.com [209.85.160.182]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) (Authenticated sender: eduardo) by smtp.freebsd.org (Postfix) with ESMTPSA id 4S71FQ3x0NzkJb for ; Sat, 14 Oct 2023 11:22:50 +0000 (UTC) (envelope-from eduardo@freebsd.org) Received: by mail-qt1-f182.google.com with SMTP id d75a77b69052e-418148607c2so15479131cf.3 for ; Sat, 14 Oct 2023 04:22:50 -0700 (PDT) X-Gm-Message-State: AOJu0YzsOlCNinxILqxSP2HL8nBAr5yV9hNxtpl3NWXSTRakLvuSyipc NZsoos10YsOs62s4NRavvZkCaGXJjRlhq9jrPrY= X-Google-Smtp-Source: AGHT+IHfJIrKKXMH8lOS41g6mPh7Xm64XtITRiPJNhLNJkqJMFs/iRRvOAe0zFatDfpYTGogUCcK4f41HqdkQ/xR8uI= X-Received: by 2002:a05:622a:d2:b0:419:5424:5699 with SMTP id p18-20020a05622a00d200b0041954245699mr32435677qtw.29.1697282569753; Sat, 14 Oct 2023 04:22:49 -0700 (PDT) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 From: Nuno Teixeira Date: Sat, 14 Oct 2023 12:22:38 +0100 X-Gmail-Original-Message-ID: Message-ID: Subject: poudriere jail upgrade 14.0-BETA5 -> 14.0-RC1 continues to fail To: FreeBSD CURRENT Content-Type: multipart/alternative; boundary="000000000000a75fc00607ab6420" --000000000000a75fc00607ab6420 Content-Type: text/plain; charset="UTF-8" Hello all, I did try updating BETA1 -> BETA2, BETA2 -> BETA3, ..., BETA5 -> RC1 in poudriere: `poudriere jail -u -j JAIL -t 14.0-RC1` All fails with: --- /usr/src/sys/x86/x86/cpu_machdep.c /usr/src/tests/sys/netpfil/pf/pfsync.sh /usr/src/usr.bin/man/man.sh /var/db/etcupdate/log To install the downloaded upgrades, run "/tmp/poudriere.3homsGor/freebsd-update.1BURpmmK install". Installing updates... done. No updates are available to install. Run '/tmp/poudriere.3homsGor/freebsd-update.1BURpmmK fetch' first. [00:11:17] Error: Fail to upgrade system --- Any clues? Thanks, -- Nuno Teixeira FreeBSD Committer (ports) --000000000000a75fc00607ab6420 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello all,

I did try updatin= g BETA1 -> BETA2, BETA2 -> BETA3, ..., BETA5 -> RC1 in poudriere:<= /div>

`poudriere jail -u -j JAIL -t 14.0-RC1`
=
All fails with:
---
<snip>
/usr/src/sys/x86/x86/cpu_machdep.c
/usr/src/tests/sys/netpfil/pf/pfsy= nc.sh
/usr/src/usr.bin/man/man.sh
/var/db/etcupdate/log
To install= the downloaded upgrades, run "/tmp/poudriere.3homsGor/freebsd-update.= 1BURpmmK install".
Installing updates... done.
No updates are av= ailable to install.
Run '/tmp/poudriere.3homsGor/freebsd-update.1BUR= pmmK fetch' first.
[00:11:17] Error: Fail to upgrade system
---

Any clues?

Than= ks,

--
=
Nuno TeixeiraFreeBSD Committer (ports)
--000000000000a75fc00607ab6420-- From nobody Sat Oct 14 13:05:22 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S73Wp56Wzz4wksx for ; Sat, 14 Oct 2023 13:05:26 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Received: from smtp-42a8.mail.infomaniak.ch (smtp-42a8.mail.infomaniak.ch [84.16.66.168]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "relay.mail.infomaniak.ch", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S73Wn0SMbz3Rlr for ; Sat, 14 Oct 2023 13:05:24 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=pyret.net header.s=20231006 header.b="cBj/GkXL"; spf=pass (mx1.freebsd.org: domain of daniel.engberg.lists@pyret.net designates 84.16.66.168 as permitted sender) smtp.mailfrom=daniel.engberg.lists@pyret.net; dmarc=pass (policy=reject) header.from=pyret.net Received: from smtp-3-0000.mail.infomaniak.ch (unknown [10.4.36.107]) by smtp-3-3000.mail.infomaniak.ch (Postfix) with ESMTPS id 4S73Wk4x8jzMq1ND for ; Sat, 14 Oct 2023 13:05:22 +0000 (UTC) Received: from unknown by smtp-3-0000.mail.infomaniak.ch (Postfix) with ESMTPA id 4S73Wk2vdKz3X for ; Sat, 14 Oct 2023 15:05:22 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=pyret.net; s=20231006; t=1697288722; bh=+ujjss+APckbFgWTKYDO2H9rcpedYkuoRDMQdUOORKQ=; h=Date:Subject:From:Reply-To:To:References:In-Reply-To:From; b=cBj/GkXLScInBS9GnONjU72S+5G/U4rXLnlIG9gPLCuJOBJoSt8QgwHN/yvyz+PGA +VIV8mbmeYmidCSRydO829+Kr4Mid9ZL34fpvw/BKxyZkL7eDJXHawloWsy0P3S7Fi FIhlytZyY3oZpQp9wWjSd52J0ya1u4F3++A7NWkxHR9grZ/hywRivUZWEXG0M2gGgt yYDDjZcyUuKfAl5TpdI+9ZW2etkRQtSQBRJu/L367CzLWulBh2lMmQW7y+9fsajdYj acUh+weu3f0LwGxMgKEjOPDl7lcKyCG8gqD0j92d9r8DpxIjZK4IUWx6Hh4tysowqE 3J6Uo+vxXsh5Q== Message-ID: Date: Sat, 14 Oct 2023 15:05:22 +0200 Subject: Re: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) From: Daniel Engberg Reply-To: Daniel Engberg To: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_=_swift_1697288722_cd716282394d8355858d63566797c769_=_" X-WS-User-Origin: eyJpdiI6IjVrT05xRXNFcXZlQWtEcGc0MWh1YWc9PSIsInZhbHVlIjoiWi95VDFkVGlQVmc2UTNYUmYrRGNqdz09IiwibWFjIjoiNTc5ODhjYjkwYzhiNmU3YjJjNTBlZmI3ZGI4ZDQzNDMzOTIwMDlhYjM0YjRmMTNiZDNjOTQ0YTRmNzEwY2RhMSIsInRhZyI6IiJ9 X-WS-User-Mbox: eyJpdiI6Ik1qY1MvZ0NXNndhbmg2Q3JUeDRMQ1E9PSIsInZhbHVlIjoiUEtlN2dESnBxV2doT0JKU0ExNnBQZz09IiwibWFjIjoiOTA4NWI4NTNiZTM1YzM4ODYzZTkzYzY4MzhiYjUzMzQ1OTY3NDU1ZTEwN2Q2MjU2ZTY2N2EzYTYyZDUyMzAyZSIsInRhZyI6IiJ9 X-WS-Location: eJxzKUpMKykGAAfpAmU- X-Mailer: Infomaniak Workspace (1.3.569) References: In-Reply-To: X-Infomaniak-Routing: alpha X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; DMARC_POLICY_ALLOW(-0.50)[pyret.net,reject]; RWL_MAILSPIKE_EXCELLENT(-0.40)[84.16.66.168:from]; R_DKIM_ALLOW(-0.20)[pyret.net:s=20231006]; R_SPF_ALLOW(-0.20)[+ip4:84.16.66.168/29]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[84.16.66.168:from]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:29222, ipnet:84.16.64.0/19, country:CH]; RCVD_TLS_LAST(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; REPLYTO_EQ_FROM(0.00)[]; DKIM_TRACE(0.00)[pyret.net:+]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; HAS_REPLYTO(0.00)[daniel.engberg.lists@pyret.net] X-Rspamd-Queue-Id: 4S73Wn0SMbz3Rlr --_=_swift_1697288722_cd716282394d8355858d63566797c769_=_ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2023-10-14T13:07:11.000+02:00, Daniel Engberg wrote: >=C2=A0Hi, >=C2=A0 >=C2=A0After=C2=A0updating= =C2=A0BIOS=C2=A0on=C2=A0my=C2=A0Asus=C2=A0motherboard=C2=A0(ProArt=C2=A0X67= 0E-CREATOR >=C2=A0WIFI)=C2=A0the=C2=A0kernel=C2=A0fails=C2=A0to=C2=A0allo= cate=C2=A0resources=C2=A0for=C2=A0a=C2=A0bunch=C2=A0of=C2=A0devices >= =C2=A0including=C2=A0USB=C2=A0and=C2=A0built-in=C2=A0SATA.=C2=A0This=C2= =A0behaviour=C2=A0is=C2=A0also=C2=A0observed=C2=A0on >=C2=A0at=C2=A0least= =C2=A0ASRock=C2=A0boards=C2=A0too=C2=A0so=C2=A0it=C2=A0doesn't=C2=A0seem= =C2=A0to=C2=A0be=C2=A0a=C2=A0specific=C2=A0issue >=C2=A0to=C2=A0one=C2= =A0manufacturer=C2=A0or=C2=A0model.=C2=A0If=C2=A0anyone=C2=A0has=C2=A0any= =C2=A0ideas=C2=A0how=C2=A0to=C2=A0fix >=C2=A0this=C2=A0I'd=C2=A0be=C2= =A0grateful. >=C2=A0 >=C2=A0I've=C2=A0tried=C2=A0turning=C2=A0off=C2= =A0and=C2=A0on=C2=A0"Fast=C2=A0boot"=C2=A0in=C2=A0BIOS=C2=A0without=C2= =A0any >=C2=A0success,=C2=A0enabing=C2=A0SR-IOV=C2=A0makes=C2=A0the=C2= =A0kernel=C2=A0hang=C2=A0during=C2=A0boot. >=C2=A0 >=C2=A0dmesg=C2= =A0with=C2=A0older=C2=A0bios=C2=A0(working): >=C2=A0 >=C2=A0https://for= ums.freebsd.org/threads/sata-drives-show-in-bios-but-wont-show-in-dev.89656= /page-2#post-620854 >=C2=A0 >=C2=A0dmesg=C2=A0with=C2=A0new=C2=A0bios= =C2=A0(not=C2=A0working): >=C2=A0 >=C2=A0https://reviews.freebsd.org/P6= 12 >=C2=A0 >=C2=A0Related=C2=A0PR: >=C2=A0 >=C2=A0https://bugs.free= bsd.org/bugzilla/show_bug.cgi?id=3D272507 >=C2=A0 >=C2=A0If=C2=A0you= =C2=A0need=C2=A0to=C2=A0more=C2=A0information=C2=A0or=C2=A0testing=C2=A0jus= t=C2=A0ask=C2=A0and=C2=A0please=C2=A0CC=C2=A0me >=C2=A0when=C2=A0replying= . >=C2=A0 >=C2=A0Best=C2=A0regards, >=C2=A0 >=C2=A0Daniel In a= ddition to the above, 13.2-RELEASE fails in the same way, also 15.0-CURRE= NT (20231005-8818f0f1124e-265728). In addition to that, USB also fails to= init so USB devices won't work once the kernel boots. Best regards,= Daniel --_=_swift_1697288722_cd716282394d8355858d63566797c769_=_ Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable
On 2023-10-14T13:07:11.000+02:00, Daniel Engberg <daniel.engberg.li= sts@pyret.net> wrote:

Hi,

<= div>After updating BIOS on my Asus motherboard (ProArt X670E-CREATOR WIFI) = the kernel fails to allocate resources for a bunch of devices including USB= and built-in SATA. This behaviour is also observed on at least ASRock boar= ds too so it doesn't seem to be a specific issue to one manufacturer o= r model. If anyone has any ideas how to fix this I'd be grateful.
=

I've tried turning off and on "Fast boot" in BIOS witho= ut any success, enabing SR-IOV makes the kernel hang during boot.
=

dmesg with older bios (working):

dmesg with new bios (not w= orking):

Related PR:

If you need to= more information or testing just ask and please CC me when replying.

Best regards,
Daniel
<= /blockquote>

In addition to the above, 13.2-RELEAS= E fails in the same way, also 15.0-CURRENT (20231005-8818f0f1124e-265728). = In addition to that, USB also fails to init so USB devices won't work once = the kernel boots.

Best regards,
Dani= el
--_=_swift_1697288722_cd716282394d8355858d63566797c769_=_-- From nobody Sat Oct 14 13:36:34 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S74Cy1Ktfz4wmjN for ; Sat, 14 Oct 2023 13:36:46 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S74Cx36d5z3VG3; Sat, 14 Oct 2023 13:36:45 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; none Received: from kalamity.joker.local (123-1-80-101.area1b.commufa.jp [123.1.80.101]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 39EDaY4W046178; Sat, 14 Oct 2023 22:36:34 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sat, 14 Oct 2023 22:36:34 +0900 From: Tomoaki AOKI To: Nuno Teixeira Cc: FreeBSD CURRENT Subject: Re: poudriere jail upgrade 14.0-BETA5 -> 14.0-RC1 continues to fail Message-Id: <20231014223634.a0a4056cde9f6b76a4d9f6cc@dec.sakura.ne.jp> In-Reply-To: References: Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP] X-Rspamd-Queue-Id: 4S74Cx36d5z3VG3 On Sat, 14 Oct 2023 12:22:38 +0100 Nuno Teixeira wrote: > Hello all, > > I did try updating BETA1 -> BETA2, BETA2 -> BETA3, ..., BETA5 -> RC1 in > poudriere: > > `poudriere jail -u -j JAIL -t 14.0-RC1` > > All fails with: > --- > > /usr/src/sys/x86/x86/cpu_machdep.c > /usr/src/tests/sys/netpfil/pf/pfsync.sh > /usr/src/usr.bin/man/man.sh > /var/db/etcupdate/log > To install the downloaded upgrades, run > "/tmp/poudriere.3homsGor/freebsd-update.1BURpmmK install". > Installing updates... done. > No updates are available to install. > Run '/tmp/poudriere.3homsGor/freebsd-update.1BURpmmK fetch' first. > [00:11:17] Error: Fail to upgrade system > --- > > Any clues? > > Thanks, > > -- > Nuno Teixeira > FreeBSD Committer (ports) Shortage on /tmp? If not, what happens when you run `/tmp/poudriere.3homsGor/freebsd-update.1BURpmmK fetch` as suggested by pudriere? Or possibly your nearest mirror not yet has needed updates to fetch? FYI: I'm using src upgrading and created poudriere jail as below `poudriere jail -c -v stable/14 -a amd64 -K kernname -j jailname \ -m src=/usr/src` and didn't yet encountered problems on updating poudriere jail. This way, poudriere uses pre-built objects under /usr/obj as default. Regards. -- Tomoaki AOKI From nobody Sat Oct 14 14:12:04 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S750m6C6Qz4wpmm for ; Sat, 14 Oct 2023 14:12:08 +0000 (UTC) (envelope-from garyj@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.15.18]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S750m2jl9z3Xsm for ; Sat, 14 Oct 2023 14:12:08 +0000 (UTC) (envelope-from garyj@gmx.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1697292725; x=1697897525; i=garyj@gmx.de; bh=TPOIqNid/mrAZGF23y+EhxiFrlNsL4m9o42OQhK9kDM=; h=X-UI-Sender-Class:Date:From:To:Cc:Subject:In-Reply-To:References:Reply-To; b=K93pvZkFXOBVuG63tWcN2EwgQKTzIhnIhzB7cTj4Tzeqd4wPzt+RmOM6xx34tYjD9QDU9CvZV8D au6RsUDP0CZQLDyiwqKPC7gPWV2yw8k4rNAjecHsEpkVdR5l5GMTwqCV/YmUspnY7Xj0c5uDInnB/ Ic/UhphjB2+orqupmFNnBNKtTj86ebTKrMUw57iMrsQfSJPe7FE3aNFxo4rvMYtyJTTMUQtrKprEf 8FYY95yJXXdn6O8NyAmYrYiAu2MS2rhY/EQ91pz4QJ7FY0OmQgtcJer1LlmoWCrhfG5OofULZQfaL EKNlxP1/Ay2UxRinZXeW94OEOyxCmCZOW8qw== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from ernst.home ([217.226.57.134]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1Mt75H-1rgTbo13iT-00tUUD; Sat, 14 Oct 2023 16:12:05 +0200 Date: Sat, 14 Oct 2023 14:12:04 +0000 From: Gary Jennejohn To: Daniel Engberg Cc: freebsd-current@freebsd.org Subject: Re: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) Message-ID: <20231014161204.7845849b@ernst.home> In-Reply-To: References: Reply-To: garyj@gmx.de X-Mailer: Claws Mail 3.19.1 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:rDweZQhZaJjhgXx1rGXXltkrnLZLDKQ93zjHOz867MqV3nhN0RM /YZKxouSoNiwctNexPPRmhrDJAIS96rWuEB+6AsSjnaZShATbcz2DmL1ghWsgw/jexfPyef DbY2M2gX9updv0eoGXfIGWBK+vGDxwCYdL+EAOzXrNHQ/Zrac0vtigI+AYTyY8SGOOVnQSx N9gA+JXU/9RhHTpVzSCvw== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:vtZeGGhXQgE=;6OpWmFRuHyzF24qaMGBv3wVU5VK yto4A4zbHifls0u6SENsjy4Io7H/h27jMWhQPhzewohype9xU2mdYUc2fosprrJwlwGc+yEQD KVO21AaxT1CCN66IImO3IVnHF9gg+IJpeBTK3ds9e6QNjKGsVV8LT2LVozHF9Go/F0InDPKi7 lvItzQPdtvsQK5ENyEaIDRJ0020bsxrUP6JI4lLsAF3rxhu3Yy7L2Wu/R9ryaZL0c49/zbk9I cbHop8fuEFl9cMyoVqgPMf4BCn15zoY0+Z7OMuzkbQnK1UGBXjTA0mnYKG9t7aEG6tfNYpnoN lCduPciomKj1QR0pu+tegdmeU+iREoqDD54+YkEvpAs+rHujkbycfYGISSKrUJUOUP69MctQb XG5OFhnYN+9YNQngzshRlL4e9rkzrUyp3KkTW1MUYwM5FmZt743e5dBcXqKBNz1oy/2ISmvII dKGOU6beZGets5pOFxuz+GPUF6WQzN+FJszsEbuKkUtjBhs8C6lak0iebI5vzpVTZvoDyXXFZ Lr+hacBScwA3Am6i5jA+dUWAJY9cNEV3DGlflgVUFyfDE/4f/keNOLCwZj7rxxI6U5Ug6YH05 STos7v7gM5scUhxfUSOq4O/AXtcyaLd96pYwOYo6284Rx8VXBT4sSnF3+A+mZ4V5UrndIifeP 3wuoZGcw5pnO/ceZXofsV/gKbI8GaV+xpf11QgXn5hgAM4WLdZPB4pkiUss2SOCwn+meV4uy9 ZCnsiQQkwSR50pBHQ9mioR0j//l851/tq3+q1pN3RjKD3u3rXUj90uEzPqLbuAjGLnJAXckTO BVYlnV6TLMlyGso6OoOhHAMGxYXg6JAhjHIY/8Kx5qV3CViXEsqYd18ush/NLR7MvlS0wYzQz VT49Nb6ADPwsTS7rruscuwselnALotgBRZqjDJSQnkOQgwLk5d8kGPhiExsijg3dst8SbntSO cttA0JSS6rZ43gGrExR/SrKb9WY= X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Queue-Id: 4S750m2jl9z3Xsm On Sat, 14 Oct 2023 15:05:22 +0200 Daniel Engberg wrote: > On 2023-10-14T13:07:11.000+02:00, Daniel Engberg > wrote: > > >=A0Hi, > >=A0 > >=A0After=A0updating=A0BIOS=A0on=A0my=A0Asus=A0motherboard=A0(ProArt=A0X= 670E-CREATOR > >=A0WIFI)=A0the=A0kernel=A0fails=A0to=A0allocate=A0resources=A0for=A0a= =A0bunch=A0of=A0devices > >=A0including=A0USB=A0and=A0built-in=A0SATA.=A0This=A0behaviour=A0is=A0a= lso=A0observed=A0on > >=A0at=A0least=A0ASRock=A0boards=A0too=A0so=A0it=A0doesn't=A0seem=A0to= =A0be=A0a=A0specific=A0issue > >=A0to=A0one=A0manufacturer=A0or=A0model.=A0If=A0anyone=A0has=A0any=A0id= eas=A0how=A0to=A0fix > >=A0this=A0I'd=A0be=A0grateful. > >=A0 > >=A0I've=A0tried=A0turning=A0off=A0and=A0on=A0"Fast=A0boot"=A0in=A0BIOS= =A0without=A0any > >=A0success,=A0enabing=A0SR-IOV=A0makes=A0the=A0kernel=A0hang=A0during= =A0boot. > >=A0 > >=A0dmesg=A0with=A0older=A0bios=A0(working): > >=A0 > >=A0https://forums.freebsd.org/threads/sata-drives-show-in-bios-but-wont= -show-in-dev.89656/page-2#post-620854 > >=A0 > >=A0dmesg=A0with=A0new=A0bios=A0(not=A0working): > >=A0 > >=A0https://reviews.freebsd.org/P612 > >=A0 > >=A0Related=A0PR: > >=A0 > >=A0https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272507 > >=A0 > >=A0If=A0you=A0need=A0to=A0more=A0information=A0or=A0testing=A0just=A0as= k=A0and=A0please=A0CC=A0me > >=A0when=A0replying. > >=A0 > >=A0Best=A0regards, > >=A0 > >=A0Daniel > > In addition to the above, 13.2-RELEASE fails in the same way, also > 15.0-CURRENT (20231005-8818f0f1124e-265728). In addition to that, USB > also fails to init so USB devices won't work once the kernel boots. > Considering that none of the current FreeBSD versions work I suspect that you'll have to flash the previous BIOS version to get a working system again. =2D- Gary Jennejohn From nobody Sat Oct 14 14:26:16 2023 X-Original-To: current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S75L53D8nz4wqJP for ; Sat, 14 Oct 2023 14:27:09 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Received: from mailgate.Leidinger.net (mailgate.leidinger.net [IPv6:2a00:1828:2000:313::1:5]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature ECDSA (P-256) client-digest SHA256) (Client CN "mailgate.leidinger.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S75L46hyPz3ZdL; Sat, 14 Oct 2023 14:27:08 +0000 (UTC) (envelope-from Alexander@Leidinger.net) Authentication-Results: mx1.freebsd.org; none List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=leidinger.net; s=outgoing-alex; t=1697293594; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=ChOp+2UpFWjKRTuyGM98Qj0r3W6fEX3F6wjM+auIfzc=; b=qWVMnBm/wffEwCBqCiYIOy672O/G08sVBSBUZOkQr+YJ7fZVdWsjAOtYp+VG+6B+syhCKO IvI0RIv/ZHx6Rbys9OP93u6QhDrZYcOihCEYSPYjpSC5e65jbJWe1QuDRruboG0wEL+bzB 2VZgRli+Shc7r3IMJ+auLBTrMPkrR4sISM7vAd3zKBAIKCWZuS4i/JV30uEEaqIiSgEkhL rOeuyp02x6+vhGCYusorTluyn+oSyZ4Wm8uwVZiLKtRaxl0muxWpACcy46szGT3I3S0sYu QA7EM6mW8YyfDZVaLBBHF/SD5/p1m3/JPBeW48WQ4n3Oxlq4nqo6jZlh0N/JiQ== Date: Sat, 14 Oct 2023 16:26:16 +0200 From: Alexander Leidinger To: =?UTF-8?Q?Dag-Erling_Sm=C3=B8rgrav?= Cc: Current Subject: Re: issue: poudriere jail update fails after recent changes around certctl In-Reply-To: <86cyxi34wc.fsf@ltc.des.no> References: <7b44912e0d3ff033ab27923aeeae5caf@Leidinger.net> <86cyxi34wc.fsf@ltc.des.no> Message-ID: <24e275f3b561c096577c00c001f3ec57@Leidinger.net> X-Sender: Alexander@Leidinger.net Organization: No organization, this is a private message. Content-Type: multipart/signed; protocol="application/pgp-signature"; boundary="=_fba7f2d4d66d605fa58229dcbf4c6b9b"; micalg=pgp-sha256 X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:34240, ipnet:2a00:1828::/32, country:DE] X-Rspamd-Queue-Id: 4S75L46hyPz3ZdL This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --=_fba7f2d4d66d605fa58229dcbf4c6b9b Content-Transfer-Encoding: 8bit Content-Type: text/plain; charset=UTF-8; format=flowed Am 2023-10-13 17:42, schrieb Dag-Erling Smørgrav: > Alexander Leidinger writes: >> some change around certctl (world from 2023-10-09) has broken the >> poudriere jail update command. The complete install finishes, certctl >> is run, and then there is an exit code 1. This is because I have some >> certs listed as untrusted, and this seems to give a retval of 1 inside >> certctl. > > This only happens if a certificate is listed as both trusted and > untrusted, and I'm pretty sure the previous version would return 1 in > that case as well. Can you check? I compared /usr/share/certs/untrusted/ with /usr/share/certs/trusted/ and some of them match with certs in /usr/share/certs/trusted/. Nothing in /usr/local/etc/ssl/untrusted/, one cert (as hash) in /usr/local/etc/ssl/blacklisted/ which is also in /usr/share/certs/untrusted/. If FreeBSD provides some certs as trusted (as part of e.g. installworld), and I have some of them listed in untrusted, I would not expect an error case, but a failsafe action of not trusting them and not complaining... am I doing something wrong? Bye, Alexander. -- http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF --=_fba7f2d4d66d605fa58229dcbf4c6b9b Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc; size=833 Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEER9UlYXp1PSd08nWXEg2wmwP42IYFAmUqpRYACgkQEg2wmwP4 2IZtARAAhvTkZjIlFc1WlDkSkmP8T5SVR3uSNESRK5nGfY0LC2jtSvK06J3+DxLK UGG8UCu8beF75XiO2dlbwc5CYbNgrIYBsrNpf9H9f6E9E59hyDHgin+kZpgZQV4a 50YwN+JN+I5pfXjEL5SMvgnbggkuLEaGWTzMyFcryLpua0bop2UydMdzqCysRuNY 4pi4R3XhMaPVnWrEWvCAMEzOsUcwyOkpVaw2lPB3tjWOdxA8hAB8j1ndEV9+0n6g 5daBAZLQDkPYv/53QiQ/C4BihRPYtqspXZxmi8RyO6DTQfmrh8zEtFZP1A0XxRdC owSq9LhjGKYG0jVJmVn59R5PN0Dff3xQOVjLTOrwlexKyO8j5cGWLtetsz5uNK8K RBLnAF5KkUOz1L0nWGcz+cJVXcV7XZSrh2r9Ok5GYQXQkbXnvcglxYXaFdowWKiN frm53QJ5/WKUUZ0B6Y1hOgHi8eMraPl+Nenp5aI54vFor90Zi9WUNO8NgQbFXlRb NRl5Jd312bslRYDkz8xk/6xlPrkRfmIzPJVBheiXRwOVxjpIBRWIuOqdfknxUun3 2TDxFX7qOLjCVQCruKvESJbj/eABMj9RHDpu2M5Kf09o7RTx0DwTFR0BYfbLh4rc MeFQUOHBENq9H01uRS4ppk/KZWKukeSMcCnUkwRzr9wzImpGq40= =jgKY -----END PGP SIGNATURE----- --=_fba7f2d4d66d605fa58229dcbf4c6b9b-- From nobody Sat Oct 14 14:29:41 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S75P64P4Gz4wqfl for ; Sat, 14 Oct 2023 14:29:46 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Received: from smtp-190e.mail.infomaniak.ch (smtp-190e.mail.infomaniak.ch [185.125.25.14]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "relay.mail.infomaniak.ch", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S75P52DT9z3cKn for ; Sat, 14 Oct 2023 14:29:45 +0000 (UTC) (envelope-from daniel.engberg.lists@pyret.net) Authentication-Results: mx1.freebsd.org; none Received: from smtp-3-0000.mail.infomaniak.ch (unknown [10.4.36.107]) by smtp-3-3000.mail.infomaniak.ch (Postfix) with ESMTPS id 4S75P16gLGzMq1p3; Sat, 14 Oct 2023 14:29:41 +0000 (UTC) Received: from unknown by smtp-3-0000.mail.infomaniak.ch (Postfix) with ESMTPA id 4S75P148Rnz3Z; Sat, 14 Oct 2023 16:29:41 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=pyret.net; s=20231006; t=1697293781; bh=EzigQyMZU9aRjSXWVIp1Uq+yfQnYTzNZqV/T4HS9r74=; h=Date:Subject:From:Reply-To:To:Cc:References:In-Reply-To:From; b=nBlCNDYVqf7HKU8kitrMS/9MrcPsdSrdQ0algk81nGEZCk69GpK3g0Q0lFtFoIxUL 7967NIVyMgav9DDbXU6xQfIG6r5lXfYvtoHMsUwHTBlC/1xIk5gh8RqE8dkf3h/FD+ WWyxjM5LDhcBeAD05pHcannC1mJyB3Lx0Xw+ddhKiUWS0PGpy5gs9yNn7cqWM7xrhZ eeSXSjSI6GDHkgjNI+gtYEXBYPJu2OVgBzqjQNxwehbdFdoaF01Wg7v8qOfbCTSYaX 2ctcDOrSN1GpD8QmdE75F+jXap1IzrfeOUMLnWftmg0Ue88fvkLR57Lhu4YKSDKnVq K5vY96SGYA6Gg== Message-ID: <39208aff4c6519a80ca0741e41810fc8@mail.infomaniak.com> Date: Sat, 14 Oct 2023 16:29:41 +0200 Subject: Re: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) From: Daniel Engberg Reply-To: Daniel Engberg To: garyj@gmx.de Cc: freebsd-current@freebsd.org List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="_=_swift_1697293781_c6be3ad2054c9a98ed54571b46ee38b9_=_" X-WS-User-Origin: eyJpdiI6ImtNb0hKMU15OStNc3haQWxlNVNzaXc9PSIsInZhbHVlIjoiVEJRTWhvVmg4R2lsSFZWZnNSREhQUT09IiwibWFjIjoiNjkyNmQ5MmQ4NDdjNmRkYmE0ZjgzMzJhODYwZTdiOWI2NjIwNGJjNDg0NGEwMmI2NzU3ZGRjZGM2NGNkYzkxNSIsInRhZyI6IiJ9 X-WS-User-Mbox: eyJpdiI6ImlLaWQvSklkeFUzZnN3SHpmb2xZdEE9PSIsInZhbHVlIjoiWnFsZmZaZHlndWFPL3o1UkIvY0hxQT09IiwibWFjIjoiMTRhODc5ZGI4MjZlNmU3OTE4MmQ0ODUwYWVhNDcxYjU5OTVhNDdjODBjMWE5MDI5Zjk2YjZhMGY0NDkyODNhMCIsInRhZyI6IiJ9 X-WS-Location: eJxzKUpMKykGAAfpAmU- X-Mailer: Infomaniak Workspace (1.3.569) References: <20231014161204.7845849b@ernst.home> In-Reply-To: <20231014161204.7845849b@ernst.home> X-Infomaniak-Routing: alpha X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:29222, ipnet:185.125.24.0/22, country:CH] X-Rspamd-Queue-Id: 4S75P52DT9z3cKn --_=_swift_1697293781_c6be3ad2054c9a98ed54571b46ee38b9_=_ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2023-10-14T16:12:04.000+02:00, Gary Jennejohn wrote: = >=C2=A0On=C2=A0Sat,=C2=A014=C2=A0Oct=C2=A02023=C2=A015:05:22=C2=A0+0200= >=C2=A0 >=C2=A0Daniel=C2=A0Engberg=C2=A0=C2=A0wrote: >=C2=A0 >>=C2=A0=C2=A0On=C2=A02023-10-14T13:07:11.000+02= :00,=C2=A0Daniel=C2=A0Engberg >>=C2=A0=C2=A0 >>=C2=A0=C2=A0=C2=A0=C2=A0wrote: >>=C2=A0=C2=A0 >>>=C2=A0=C2= =A0=C2=A0Hi, >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0After= =C2=A0updating=C2=A0BIOS=C2=A0on=C2=A0my=C2=A0Asus=C2=A0motherboard=C2= =A0(ProArt >>>=C2=A0=C2=A0=C2=A0X670E-CREATOR >>>=C2=A0=C2=A0=C2=A0 >= >>=C2=A0=C2=A0=C2=A0=C2=A0WIFI)=C2=A0the=C2=A0kernel=C2=A0fails=C2=A0to= =C2=A0allocate=C2=A0resources=C2=A0for=C2=A0a=C2=A0bunch=C2=A0of >>>= =C2=A0=C2=A0=C2=A0devices >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2= =A0=C2=A0including=C2=A0USB=C2=A0and=C2=A0built-in=C2=A0SATA.=C2=A0This= =C2=A0behaviour=C2=A0is=C2=A0also >>>=C2=A0=C2=A0=C2=A0observed=C2=A0on= >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0at=C2=A0least=C2= =A0ASRock=C2=A0boards=C2=A0too=C2=A0so=C2=A0it=C2=A0doesn't=C2=A0seem=C2= =A0to=C2=A0be=C2=A0a=C2=A0specific >>>=C2=A0=C2=A0=C2=A0issue >>>=C2= =A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0to=C2=A0one=C2=A0manufacturer= =C2=A0or=C2=A0model.=C2=A0If=C2=A0anyone=C2=A0has=C2=A0any=C2=A0ideas=C2= =A0how=C2=A0to >>>=C2=A0=C2=A0=C2=A0fix >>>=C2=A0=C2=A0=C2=A0 >>>= =C2=A0=C2=A0=C2=A0=C2=A0this=C2=A0I'd=C2=A0be=C2=A0grateful. >>>=C2=A0= =C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0I've=C2=A0tried=C2=A0turning= =C2=A0off=C2=A0and=C2=A0on=C2=A0"Fast=C2=A0boot"=C2=A0in=C2=A0BIOS=C2=A0wit= hout=C2=A0any >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0success,= =C2=A0enabing=C2=A0SR-IOV=C2=A0makes=C2=A0the=C2=A0kernel=C2=A0hang=C2= =A0during=C2=A0boot. >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2= =A0dmesg=C2=A0with=C2=A0older=C2=A0bios=C2=A0(working): >>>=C2=A0=C2= =A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0https://forums.freebsd.org/threads/s= ata-drives-show-in-bios-but-wont-show-in-dev.89656/page-2#post-620854 >>>= =C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0dmesg=C2=A0with=C2=A0new= =C2=A0bios=C2=A0(not=C2=A0working): >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0= =C2=A0=C2=A0=C2=A0https://reviews.freebsd.org/P612 >>>=C2=A0=C2=A0=C2= =A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0Related=C2=A0PR: >>>=C2=A0=C2=A0=C2= =A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0https://bugs.freebsd.org/bugzilla/show_bug= .cgi?id=3D272507 >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0If= =C2=A0you=C2=A0need=C2=A0to=C2=A0more=C2=A0information=C2=A0or=C2=A0testing= =C2=A0just=C2=A0ask=C2=A0and=C2=A0please >>>=C2=A0=C2=A0=C2=A0CC=C2=A0me= >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0when=C2=A0replying.= >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0Best=C2=A0regards, = >>>=C2=A0=C2=A0=C2=A0 >>>=C2=A0=C2=A0=C2=A0=C2=A0Daniel >>=C2=A0=C2= =A0 >>=C2=A0=C2=A0=C2=A0In=C2=A0addition=C2=A0to=C2=A0the=C2=A0above,= =C2=A013.2-RELEASE=C2=A0fails=C2=A0in=C2=A0the=C2=A0same=C2=A0way, >>= =C2=A0=C2=A0also >>=C2=A0=C2=A0 >>=C2=A0=C2=A0=C2=A015.0-CURRENT=C2= =A0(20231005-8818f0f1124e-265728).=C2=A0In=C2=A0addition=C2=A0to=C2=A0that,= >>=C2=A0=C2=A0USB >>=C2=A0=C2=A0 >>=C2=A0=C2=A0=C2=A0also=C2=A0fails= =C2=A0to=C2=A0init=C2=A0so=C2=A0USB=C2=A0devices=C2=A0won't=C2=A0work=C2= =A0once=C2=A0the=C2=A0kernel >>=C2=A0=C2=A0boots. >=C2=A0 >=C2=A0Cons= idering=C2=A0that=C2=A0none=C2=A0of=C2=A0the=C2=A0current=C2=A0FreeBSD= =C2=A0versions=C2=A0work=C2=A0I=C2=A0suspect >=C2=A0 >=C2=A0that=C2= =A0you'll=C2=A0have=C2=A0to=C2=A0flash=C2=A0the=C2=A0previous=C2=A0BIOS= =C2=A0version=C2=A0to=C2=A0get=C2=A0a=C2=A0working >=C2=A0 >=C2=A0syste= m=C2=A0again. >=C2=A0 >=C2=A0-- >=C2=A0 >=C2=A0Gary=C2=A0Jennejohn= Hi, That's true although I'm going to guess it's going to be an = ongoing issue as at least one user with an ASRock board also has similar= issues (see PR). Looking into if downgrade is possible too. Best re= gards, Daniel --_=_swift_1697293781_c6be3ad2054c9a98ed54571b46ee38b9_=_ Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable



On 2023-10-14T16:12:04.000+02:00, Gary= Jennejohn <garyj@gmx.de> wrote:
On Sat, 14 Oct 2023 15:05:2=
2 +0200

  On 2023-10-14T13:07:11.000+02:00, Daniel Engberg

Hi,

Afte= r updating BIOS on my Asus motherboard (ProArt X670E-CREATOR
= WIFI) the kernel fails to allocate resources for a bunch of devices
including USB and built-in SATA. This behaviour is also observed= on
at least ASRock boards too so it doesn't seem to be a s= pecific issue
to one manufacturer or model. If anyone has a= ny ideas how to fix
this I'd be grateful.
<= br>
I've tried turning off and on "Fast boot" in BIOS without a= ny
success, enabing SR-IOV makes the kernel hang during boo= t.

dmesg with older bios (working):


dmesg with new bios (not working):


Related PR:
=


If you = need to more information or testing just ask and please CC me
when replying.

Best regards,
<= div>
Daniel

I= n addition to the above, 13.2-RELEASE fails in the same way, also
=
15.0-CURRENT (20231005-8818f0f1124e-265728). In addition to that, USB=
also fails to init so USB devices won't work once the kerne= l boots.


Consider= ing that none of the current FreeBSD versions work I suspect
= that you'll have to flash the previous BIOS version to get a working
system again.

--
Gary Je= nnejohn
Hi,

=
That's true although I'm going to guess it's going to be an ongoing is= sue as at least one user with an ASRock board also has similar issues (see = PR). Looking into if downgrade is possible too.

Best regards,
Daniel
--_=_swift_1697293781_c6be3ad2054c9a98ed54571b46ee38b9_=_-- From nobody Sat Oct 14 14:33:32 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S75TY2J5bz4wqxh for ; Sat, 14 Oct 2023 14:33:37 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4S75TW6LBsz3dWb for ; Sat, 14 Oct 2023 14:33:35 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of junchoon@dec.sakura.ne.jp has no SPF policy when checking 153.125.133.21) smtp.mailfrom=junchoon@dec.sakura.ne.jp; dmarc=none Received: from kalamity.joker.local (123-1-80-101.area1b.commufa.jp [123.1.80.101]) (authenticated bits=0) by www121.sakura.ne.jp (8.16.1/8.16.1/[SAKURA-WEB]/20201212) with ESMTPA id 39EEXWE1055188 for ; Sat, 14 Oct 2023 23:33:33 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Sat, 14 Oct 2023 23:33:32 +0900 From: Tomoaki AOKI To: freebsd-current@freebsd.org Subject: Re: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) Message-Id: <20231014233332.8f44810859a0b482dadc5104@dec.sakura.ne.jp> In-Reply-To: <20231014161204.7845849b@ernst.home> References: <20231014161204.7845849b@ernst.home> Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-Spamd-Bar: - X-Spamd-Result: default: False [-1.35 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; AUTH_NA(1.00)[]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.85)[-0.846]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; ONCE_RECEIVED(0.10)[]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; R_DKIM_NA(0.00)[]; HAS_ORG_HEADER(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; R_SPF_NA(0.00)[no SPF record]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DMARC_NA(0.00)[sakura.ne.jp]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4S75TW6LBsz3dWb On Sat, 14 Oct 2023 14:12:04 +0000 Gary Jennejohn wrote: > On Sat, 14 Oct 2023 15:05:22 +0200 > Daniel Engberg wrote: > > > On 2023-10-14T13:07:11.000+02:00, Daniel Engberg > > wrote: > > > > > Hi, > > >  > > > After updating BIOS on my Asus motherboard (ProArt X670E-CREATOR > > > WIFI) the kernel fails to allocate resources for a bunch of devices > > > including USB and built-in SATA. This behaviour is also observed on > > > at least ASRock boards too so it doesn't seem to be a specific issue > > > to one manufacturer or model. If anyone has any ideas how to fix > > > this I'd be grateful. > > >  > > > I've tried turning off and on "Fast boot" in BIOS without any > > > success, enabing SR-IOV makes the kernel hang during boot. > > >  > > > dmesg with older bios (working): > > >  > > > https://forums.freebsd.org/threads/sata-drives-show-in-bios-but-wont-show-in-dev.89656/page-2#post-620854 > > >  > > > dmesg with new bios (not working): > > >  > > > https://reviews.freebsd.org/P612 > > >  > > > Related PR: > > >  > > > https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=272507 > > >  > > > If you need to more information or testing just ask and please CC me > > > when replying. > > >  > > > Best regards, > > >  > > > Daniel > > > > In addition to the above, 13.2-RELEASE fails in the same way, also > > 15.0-CURRENT (20231005-8818f0f1124e-265728). In addition to that, USB > > also fails to init so USB devices won't work once the kernel boots. > > > > Considering that none of the current FreeBSD versions work I suspect > that you'll have to flash the previous BIOS version to get a working > system again. > > -- > Gary Jennejohn Or check in detail for defaults on BIOS (UEFI firmware) settings changes. Hopefully, these are usually described in readme or update notes or something alike. If any, try reverting back to the previous defaults except you intentionally changed on previous BIOS. Sometimes BIOS vendors change their BIOS defaults to something FreeBSD dislikes. -- Tomoaki AOKI From nobody Sat Oct 14 15:19:29 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S76VY6n61z4wtKh for ; Sat, 14 Oct 2023 15:19:33 +0000 (UTC) (envelope-from garyj@gmx.de) Received: from mout.gmx.net (mout.gmx.net [212.227.17.20]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "mout.gmx.net", Issuer "Telekom Security ServerID OV Class 2 CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S76VY38Hbz4CwG for ; Sat, 14 Oct 2023 15:19:33 +0000 (UTC) (envelope-from garyj@gmx.de) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.de; s=s31663417; t=1697296770; x=1697901570; i=garyj@gmx.de; bh=hQVtwl8nO29DrdxDVe7Dn5aXJ1ikGq9F18+Rlo/Thg4=; h=X-UI-Sender-Class:Date:From:To:Cc:Subject:In-Reply-To:References:Reply-To; b=rrdHCZIV0oqUOs29mMhprn03APCx+LZfqPdmrXku/VuoDuYl475vJ4dj0Hl6JZgFREobEDF13OD gso20nQ4Gjg1WIwXl67cTNzBPoPGYHx7AtdozL2rb9h/+MNq9Jlp6yDGnHvvtFxfXTO5bUFu7Hw2p Y9Lj12i8SugAf6RKhEi03rNVjHtzYZwJNl69bm6D4Xwet0QNP78rqeQ1Y09cPghZ0+E5gbPfMBHPU TchxolBFosXXVmGS/V5fvGBu1vvz+R8wLGdc16TKjYuMKqT55WXJjm1w1IZXLsq252vOGp+pezjJB pYj0SagiueTTt0penyya7w0+T4MAHTIfRACQ== X-UI-Sender-Class: 724b4f7f-cbec-4199-ad4e-598c01a50d3a Received: from ernst.home ([217.226.57.134]) by mail.gmx.net (mrgmx104 [212.227.17.168]) with ESMTPSA (Nemesis) id 1M2wGi-1qqb1y04jM-003NqJ; Sat, 14 Oct 2023 17:19:30 +0200 Date: Sat, 14 Oct 2023 15:19:29 +0000 From: Gary Jennejohn To: Daniel Engberg Cc: freebsd-current@freebsd.org Subject: Re: AMD Zen 4 (Ryzen 7000) resource allocation issues (on 14.0) Message-ID: <20231014171929.47a0b08e@ernst.home> In-Reply-To: <39208aff4c6519a80ca0741e41810fc8@mail.infomaniak.com> References: <20231014161204.7845849b@ernst.home> <39208aff4c6519a80ca0741e41810fc8@mail.infomaniak.com> Reply-To: garyj@gmx.de X-Mailer: Claws Mail 3.19.1 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:2kmKUwyCJAGJu1rlplfUgoU2ohTHzVopJrmm7Gy4t2kiB4MAfDW FNSKUZk2UdAQ4XJMFAvLOZhCxXh/J6lTDSIvzuEiNeNV34GDIHVLu0dE67gW/ftIJOOWsBV EVOi6MafRpHtRC/uOxoYA995K3joSygWvSq43I1+WUepbU6t5Yb/frsIoGZPGzwuGiJPDME Kudsa+oRDl3Lco261HYsw== X-Spam-Flag: NO UI-OutboundReport: notjunk:1;M01:P0:TeVFJg/ts00=;uO2OHFCGm4PymjsE+JK3IPaIHIo hLd0dzDsp/kSRxMWEVuNEUNjTzyeZBZ6SsOs9LjPQpmm/o2iQIpAyGTr6a25va+Dw6uVR+Kny +X2Cwg0wv8pF7shVUz0e2SjmsydKwB/ORl2horkVxlHMsQJGOWb4B3h5lCvrk8X7+VgIGGXLK GphYEXKPRtOh8jSYM9TDfr6BnhjxxH1saCG5wkQjQ88zxn26qoN25I4JlEVWCqTxSJZdI7jB1 OgIVBFRCC5P7bQy/LlW0xffyL++OyS5W+sWdlnyPYReHbV8hDbVpVH8Tk+euf/49cJyHi9TzN T9QH58jHlQMkf7uNK8IluW4oWsPQWOLOSqIr2g/2HYTM+t2dDHMU+8kUO84BsTif2s6KnZwCf aYK0bq41ANStrxCA1VrlmdPWi2ICBYPp0hslTRqUO/48i0oCxN55Wr71hieNla4LLpPNJ7Z6o ZFcGlPNO2h0Xufs9vJhq0GwkOKt8B8V1UAKS8vx85ctXKjcoJsUF0RgA5/7J/Op8YlCSCyomr 8vYtZ/Si9B8wdtfjSnDMHSQY3V8i4dH5lzWI0GTE4azYTUkWPF/3lrTD/UNuiVTL9UpG34Lnd DSxb8d8T3Zuy9t057Id0VV2sWQJCnjYtf2UjTOr09AWbqA7e3pjEJVUW+prsfaG0lLBcmbE4q WjXO5kwSwCDF23GRDtuFAprraq1aUsAMoS77RfpVBC7a0GDQIa212WIvc3T/JZ3dg3A6E9vVU JRIJtyNXwaoIzKO1iRMSSzaUvK3PP9+OThYlsugzu84fgWjmYUmeLUiX7pPBpAcxEqc7234cd bZm/QJhG45ELujiXIgADc+P2kJf1mM+J0QB4nu4ryMJNg8JlI2SKDCExq11pweJOEjKdvRmpA b4QI+Wkk1dep+hQm5gc+IAse1bq29o/438qVj/ogxntDuJx1S0Bu6R+5z8etd0sgwvoIIbG2I BtYQZic+WyrpnKW2FIdaG8MwJlI= X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:8560, ipnet:212.227.0.0/16, country:DE] X-Rspamd-Queue-Id: 4S76VY38Hbz4CwG On Sat, 14 Oct 2023 16:29:41 +0200 Daniel Engberg wrote: > On 2023-10-14T16:12:04.000+02:00, Gary Jennejohn wrote: > [SNIP] > >=A0Considering=A0that=A0none=A0of=A0the=A0current=A0FreeBSD=A0versions= =A0work=A0I=A0suspect > >=A0 > >=A0that=A0you'll=A0have=A0to=A0flash=A0the=A0previous=A0BIOS=A0version= =A0to=A0get=A0a=A0working > >=A0 > >=A0system=A0again. > >=A0 > >=A0-- > >=A0 > >=A0Gary=A0Jennejohn > > Hi, > > That's true although I'm going to guess it's going to be an ongoing > issue as at least one user with an ASRock board also has similar > issues (see PR). Looking into if downgrade is possible too. > I wonder whether Linux would work with your BIOS. If it does that may give developers some pointers to what needs to be changed in FreeBSD. No need to install Linux, I think. Just boot it from a memstick and maybe you can get the boot trace. =2D- Gary Jennejohn From nobody Sat Oct 14 15:38:04 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4S76w23blRz4wvDd for ; Sat, 14 Oct 2023 15:38:10 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Received: from mail-wm1-x32f.google.com (mail-wm1-x32f.google.com [IPv6:2a00:1450:4864:20::32f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4S76w15jx3z4GZg for ; Sat, 14 Oct 2023 15:38:09 +0000 (UTC) (envelope-from grahamperrin@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=c2Pqy1ch; spf=pass (mx1.freebsd.org: domain of grahamperrin@gmail.com designates 2a00:1450:4864:20::32f as permitted sender) smtp.mailfrom=grahamperrin@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wm1-x32f.google.com with SMTP id 5b1f17b1804b1-405361bb94eso35977505e9.0 for ; Sat, 14 Oct 2023 08:38:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1697297887; x=1697902687; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:autocrypt:from:references:cc :to:content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=+43QyTGFeVNTNkYrjpb48YEvaNzOuO40pIFJVuvg98M=; b=c2Pqy1chRZoL8O8UgoxNDO4nbTRJnKqK42CSE32RyJLevoPMFkskor+Ty84Muzig7O G9WgFjYFrizYZB0Bxn0fEUa0g4V+g0T0YpbjjB1MI3oFpChIjTqinUCd6drYXbe+mZTU zTo8QzcWHnoupNJn5rcbJ/JOxDROoB7YltutikQMpbmrL1+gANEUHUDl8jAIxuTuSA82 V+g62+oixk2BvSHwamemADJbRDCxm9IaI2USF5GVLjyE7sXq86SqbQehhIukpQa+1LjQ BXNsYwdwPqWtREQF5fVeZwm6bIGBRvT6MaD26m2+yh95r6q6YzMRApAHGtOfnYCdoHPO FS+w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1697297887; x=1697902687; h=content-transfer-encoding:in-reply-to:autocrypt:from:references:cc :to:content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=+43QyTGFeVNTNkYrjpb48YEvaNzOuO40pIFJVuvg98M=; b=wBFy/Neg+9yPzAAYr69/K1cFfXiZYJ8ACVZdAuICpK+7Nd16PrSEMuT0SshTz6ipxk v5a23WufXWDD8CD/UMEyua0YdFQcyDKfpy5ndtxPyPrwOO66K/JzIItD35ZAgy0GK5T1 UFMYNYhiIzNRghfBgzvSC/A3XOkoPdYguNkRv+rgG2e17CXsXDe5rHKTq+17+a2yExW4 DZn+0ta5QbYGiQBTq1gZyZKXZP8mD4IyX7Kq81976dqbCsjn8hXNsbHfu5NMysjRos9+ AN0P6agj9RppeeabvENw63bJV5HB9cwjgDmhL4GIepxO6W1emT0Ki4+GZo6jFg4+Zrvg Hm9Q== X-Gm-Message-State: AOJu0YwmMqDVTIrA846j1/OtXEB6uMjBdFmTMDzqbWlDI7bcHWulvu5E 5Gmr3UGSdp69/Si8Eqq2Rrw= X-Google-Smtp-Source: AGHT+IHt+FTR3zHITXNuI9zn2HkRwa77VqHIp6zYGrdiU31xfjsHiDlN1IwI4l3qgcauG2PXtKUrmw== X-Received: by 2002:a05:600c:2191:b0:405:36a0:108f with SMTP id e17-20020a05600c219100b0040536a0108fmr27173795wme.41.1697297886585; Sat, 14 Oct 2023 08:38:06 -0700 (PDT) Received: from [192.168.1.6] (80-42-66-93.dynamic.dsl.as9105.com. [80.42.66.93]) by smtp.gmail.com with ESMTPSA id m22-20020a05600c4f5600b0040303a9965asm2343814wmq.40.2023.10.14.08.38.05 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 14 Oct 2023 08:38:06 -0700 (PDT) Message-ID: <84712139-f7d8-41b5-a122-7ab1b24ffd61@gmail.com> Date: Sat, 14 Oct 2023 16:38:04 +0100 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: kernel 100% CPU Content-Language: en-US To: Mateusz Guzik Cc: FreeBSD CURRENT References: <95e9f65b-58c4-ef3a-a5d1-b794179e4252@gmail.com> <23c596e7-d710-c17d-a4e7-b21c99a4fe00@gmail.com> <5528e510-2d79-ebc9-b3f4-79d5fb80f38f@gmail.com> From: Graham Perrin Autocrypt: addr=grahamperrin@gmail.com; keydata= xsFNBGKYt7ABEAClu83dJ3ZKfVgPOk9YKRv0Z+dl2b88+k9R4vwAmElgguYdKE7yhnQNhhWM v9vi6AFrBMc2oJdVHJ2OrXfwpELBFIgiSMEWNsC4e+Z3HtSajcl+pFZsP7ciiSoycj/w3wIV kAZoVGbhyIbNG7fbCEJ8q81TbfsGypV3bRmbZVvGNecBguYiooBtz2Qht1p3itXMkIA6P9pS YDl+6QddZLyUUAjAnFv2QDoYSHLnaDUWw4oONZsB0SKVu8jMIBh4uJZoYEOvdvc9jQQdOpA2 CAgA6ulfm42Ikr9lKBUUCtjqiWAhJ7iXOTyHAIdR4Mf8alCE6tdTq6dHdIt+GktTY7oYNyL2 3aD3C7I5waU0SFXvJcOMG10QLfwYQMOQoYQ9XJ0U5A28WYiDcylDdUWT7SappP1e1ZMeJWWO y14mxxNzHaJSI4rK8P/p5tp3Q7SSC4k5gMh9zKba3K2ApCWNbVLGvXsJeQkZZNvu70tE81ey AHI5iZcB6D7WaHysBUmsKaEpbcmm1ZThTnGL0SHEl5to5Jab5Fg6O+Cnly5sVz5lX/v8Aosx kKNei7SCVqXOVtteQeGxWbXWbhPgbMyc0Gi3DuxBI/yvJ43k/rJysQlLGLWfJx/UXprwLluC PDK9EvKEB+fD1Z349uzp1sKr3ihpySbyKI8fpudftnAz4EsoCwARAQABzSZHcmFoYW0gUGVy cmluIDxncmFoYW1wZXJyaW5AZ21haWwuY29tPsLBlAQTAQoAPhYhBFk/5bLDBwftvJcvCrdn SG9KGNQLBQJimMMBAhsDBQkFo5qABQsJCAcDBRUKCQgLBRYDAgEAAh4FAheAAAoJELdnSG9K GNQLbHAQAJi998y42bEbq5HmABYovmAEtQj33YSUWyc9QRmAHpN8Er3lTKsgmZcVChB5Fu/d go2oYynDjlVpA7+wiSmg4AG78mOYbg/e19XMhrH0keDKqZXFkU+G7agR0mF09qvpQZ9MTJYZ 2u7FtytZK665UfipOdV8eGn2hFC/WynjUwEzKyryBgbbLAEbfOPeZNry4h2ZPWbtTvx/PE/V X3Vh2oGqYx69DCGz+0xEhy62ZKbkX5SL8LUf/1WViyCVzsHasFxmFxYPWIfBy8ayQ7xapz7M cSXSQyu4oDT4qh9eZiGP9/aAcZKHcV6t9y77JGhUJ/5O1sANKMa3YhgimE+Z86LHYa1IH774 PHj1nAXBwS+Cj/1l/NQoQcyjvOj8zuCsMJVaLMb6B46YsReP4+3yBLpyeBC//t6zWPbgAkWW VjROC0dXUAMTFpnA6NZe3UghG+Nc4fnCLGOhc2nyWFYHIaYV6Hv1ITFSem9DdeNnR1CFm1VM TJ7i7TuqYM+WZTkoUsTf4c46hS/ZNJZSCxh0s9yYr+BYk3XBbd+ElaZ1dJE6cuSVdw15+P2h DnprurxC4byl4YFkn+UAVvQsOgeq6aSHLOHX0weYu1OLoiPYsTdyGhne72+kDhEEdFD5aHdQ PFrbQIrqWLV0a04++0ZwGpNvXtgnWhDdAQJDwGsSSwbLzsFNBGKYt7ABEADRb1tZuh7DPYET 0wK6fe7owbYgM+RfKhmcrGgR2HI9M2q6+0WKF/ITnggWdIW2Ecc4z2boLz/cwvPGCS7/YxZM 61KklGCwuS7q1s04XnHDWHuFxfXQPzAdVmNO3bYoMZbJjHXs6sB2u5ksiwPwaMAWWaGkviSj c5pwvHCiTmX5vH5CBj/Vi+5ESyX38vK4JM5S/m4ouI/6M9biyFgimV+v3vVyCxJCT1gI9g4o GIh1qq5S433b1fihn4yHPf8XOKyBpA/QcwLONViBqJL5nnOxpsh344rNxn2R7CcRzzicOV+e 2IbMem4lwNWQlZKoRotKXZi9LqN5mynSBYqAUdoZum0QinWT9F22B0Qex5PH1zAt9i2W91Vd kcPB3LwkRXj07ycRtsSzpgPA6fLc6AsoWFslHl8kVOO5eJIA4xhjlPa+W8lguQHZ0iX+5uAv 2eAgXR2swADuHPuENNFStmsgAMl8OOOgtq75yA5TpyIzxMuXV9Nmp0VfIaUM/IdLdmxhc1pC c320l5fYMHVLFAReWEbSj2QH8YzWfpXHIegutWWYEbH9SiDXgS9KoKmCJV/Qa+x6/b8y3pOZ vnIbCDaynC2Yr50s8gRa9kb54JE8Z+p8r16U3SEsK3PtUi0RF0e51danCVHrrE6/Hat2XUO/ 6nnYgVgFOrLao6Gh/VMs8wARAQABwsF8BBgBCgAmFiEEWT/lssMHB+28ly8Kt2dIb0oY1AsF AmKYt7ACGwwFCQWjmoAACgkQt2dIb0oY1Av7qg//YjCZg8VXyMzXssgIQpROKKqh5V0UBSQl rM3tq4tWhyg0HVMugQj0Om+iNPsEEOGHkm6tyhHMzlKGpAc/l0iAM+8twIyg44Yo5+DcfFXr OMTbTw9T9jDsWOkOBksxy29iYhgpqpWdDBnhXvrJp/FNAiX8CfzrIOZeFPydDoEiKBEXAxfe a9o5J/JeVnZiUeoiFe7i68nZGsb4JxhPczNfqW12t0Ll5/ibjszg5BgjXiLao0KqbWNh4bS5 CVwH90Or+5qqWgzWPeBiuz+rN2QXE/V/fL44GEj1YKASCqmaiYRgjoRFubz1aq1wCXMXY3Iq d4525rscUgS7HBxbblnyTodUPaamN/2nSzcmE/Pkx8MApDSgZCIhs0RTAg+/AoX4HULV1rSE TQwMrBEQt84Tw5W5rHsvXKr4ZEsJUpbPLWYTISsp23nHR+vZtL/Ug+OWCmHC7X7D21xk/xVJ 4sA1RLJBKdCHtnyA4Unv/kNS1KVGxHnITVyw1a71QJADu4qsdtM5u6CyYUhqhM1oseWtV6j+ Qi8KC/G4C3AgZf06fe2fVl42z2grTabL4bC6FQXMwTX2dsm5NakWjUCmUL8uwsQE7ZA4zKxo EYI1YV9q1birpzncYRupr1qnMoggMUHWq0IBYshFQrEO8PeVUZBw7/GfAeh3argdw2Qu748T Cyw= In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.98 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; FREEFALL_USER(0.00)[grahamperrin]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::32f:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4S76w15jx3z4GZg On 03/09/2023 20:25, Mateusz Guzik wrote: > … > > Sorry mate, neglected to specify: collect sysctl -a once you run into > the problem. > > Once I look at that I'm probably going to ship some debug patches to > narrow it down. I had what might be the same issue this afternoon, for the first time in weeks. With the slowdown, it took a few minutes for me to find your email, unfortunately the symptoms subsided moments before finding it. So, I collected the information, but it's probably another missed opportunity (the information collected too late). The busy period lasted for around six minutes: root@mowa219-gjp4-8570p-freebsd:~ # poudriere bulk -j main -J 3 -Ctv devel/pkgconf [00:00:00] Creating the reference jail... done [00:00:01] Mounting system devices for main-default [00:00:02] Warning: Using packages from previously failed, or uncommitted, build: /usr/local/poudriere/data/packages/main-default/.building [00:00:02] Mounting ccache from: /usr/.ccache [00:00:02] Mounting ports from: /usr/local/poudriere/ports/default [00:00:02] Mounting packages from: /usr/local/poudriere/data/packages/main-default [00:00:02] Mounting distfiles from: /usr/ports/distfiles [00:00:02] Copying /var/db/ports from: /usr/local/etc/poudriere.d/main-options [00:00:02] Appending to make.conf: /usr/local/etc/poudriere.d/make.conf /etc/resolv.conf -> /usr/local/poudriere/data/.m/main-default/ref/etc/resolv.conf [00:00:02] Starting jail main-default [00:00:02] Will build as nobody:nobody (65534:65534) [00:00:05] Logs: /usr/local/poudriere/data/logs/bulk/main-default/2023-10-14_16h16m30s [00:00:05] Loading MOVED for /usr/local/poudriere/data/.m/main-default/ref/usr/ports [00:00:06] Ports supports: FLAVORS SELECTED_OPTIONS [00:00:06] Inspecting ports tree for modifications to git checkout... yes [00:06:39] Ports top-level git hash: e843b8293c (dirty) …