From nobody Mon Dec 4 11:08:23 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SkLWD4MGXz53FSC for ; Mon, 4 Dec 2023 11:08:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SkLWD3J2nz4W3w for ; Mon, 4 Dec 2023 11:08:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701688104; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=KVCjjnDz8WMb1Due0spe2IZgHw1FVyB2mNxIJ4cNV3M=; b=A5p/+F0bqubZqiRQXbyle7eMX/M03wpFqoaivJoiRcMOd6c79hdvn8jW/TqAIGf+9XTumS zOHqYuFMTzfuCAS0PzNs9tVbRdbtyK12LegmiGaYBfOkupIzLCg+eO2AkRct8oqXSpKHzw +sLG0hGXKKki4d4nPcwATKIZqSaRlJsrvYjx3v08VQDu40SLOwc1Iz38FHA4IkMEUErmxf 65HW3/ftJFZV1+2Rdx52xH7OcjT7KyIEL3aOWl0mfG5Gb2ar74DYaaHpK6h6OsJka80g9x +PuykSMxHfPmhle6XkTEoRmn8X/CLG9jTIl35+sLXG1MOWnLhXCTsgCMVHSwyQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701688104; a=rsa-sha256; cv=none; b=EC7TjkZmi21BtJVfRQMc02L+9yWJ7cM2mxADF15I9++ZaR4X9jj2PH23TSgihuImD+2RJG nwX9mOny2SLLCUxUzxUrlV2gm311Bz8mLM1CF8bxasoj16E0v/PkCp1IUisduKpTmzofue 6EixL0SYuEx4c+VX634jmH2uTCxhp6myRaJN8pobzlftuwdnRJaSRZu7dQnGrux0mYmOBB 6yH+kc/FuKXxiYXgUXV6w65yldo1gbzhAVurPdrFJc9yoQVtSM1q9DN45WsqI5p6mGgphU 06pG99hPSkMvF/UGViJYhqPlsEh5h4z/xzDwSjhBzC8LaTM8diiuLb8o6UEBSA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SkLWD2FTDz8jF for ; Mon, 4 Dec 2023 11:08:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4B8OMh017923 for ; Mon, 4 Dec 2023 11:08:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4B8OnV017922 for fs@FreeBSD.org; Mon, 4 Dec 2023 11:08:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265625] .zfs/snapshot directory is always readable (also by non-privileged users) Date: Mon, 04 Dec 2023 11:08:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jbe@magnetkern.de X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265625 --- Comment #5 from jbe@magnetkern.de --- There are more security implications of this issue, e.g. when /etc/passwd, /etc/group, ~/.ssh/authorized_keys etc. get modified while a snapshot exist= s. This can lead to people gaining access to files that they never were suppos= ed to see. Also see: https://forums.FreeBSD.org/threads/91178/post-631660 and https://github.com/openzfs/zfs/discussions/9028#discussioncomment-3331782 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 4 22:40:56 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SkdtJ3pcRz52vnx for ; Mon, 4 Dec 2023 22:40:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SkdtJ2Vdhz4RBw for ; Mon, 4 Dec 2023 22:40:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701729656; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=EFidjg3B15WU8jHIWXfToMtXADZsBiDkdJ9MJTDB9Qw=; b=ClmvMHUDuHjkeyJtcl+U74G8clC5qboyVcWivxtdkKlwhoFc5xkLqOk8WAuORm6WOoZtNX 0lqZs4CgOg+H5mu9bTzl2Oa4qpNjM/u3Wf2/JJXwARUgjAhG8LiZ6nJBFuE8KwmwCu7bOm drujLgKTJj1tpiLAmudh+cqR5pemnYHYmlL8jqEDviTAhKNCh7sMPENKzfYn8bGXwqtN0v pwve3lP+0dVRKP7hGIii1JeRDKnbejbj49HNlpaWfMny5FDHq79Mlo31a8oZ4H8qGJiRkP lJ1rLhe+mK/uo+bLaoerM6EVTbAg6wh3rdw6Q7q16Apb8K1URRQrnriVU0KxAw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701729656; a=rsa-sha256; cv=none; b=PT8/aU3FBhKztuVYb4dVsfka+loyqBW6jlR5CE1IEUrQd3u+V2FFZ3fE1ispuJg0FPykrM 9yXZWdm0HaC+odf9ZyiqTC7jE50gzpHQAsZAIyNstGaRLiKZ0V1aOX9TM4sgcI8334TObH LpBIEcZGowLgTMTiQvsQiyMClZ/+MBMLd4Dsy5U3QCIxd1MPT2OI12wlE4wJHBEWWvlhDY d1AytH6e8XmHkB+9e9mN3wSnXg9mkkLrBTmL4jO8UPExnnwGh9pptcVm+eP77Mz+yDmS2q MuFPeDbLH7P1VLY09uLphp4IFXKs7Z5FaGNc1ea3yZJbZXflqN2bwEBiVB4NWA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SkdtJ1YSdzl0Z for ; Mon, 4 Dec 2023 22:40:56 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4MeuqN008271 for ; Mon, 4 Dec 2023 22:40:56 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4Meuak008270 for fs@FreeBSD.org; Mon, 4 Dec 2023 22:40:56 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 272325] Page fault, possible ZFS related Date: Mon, 04 Dec 2023 22:40:56 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@orsolic.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272325 --- Comment #11 from bsd_orsolic --- Created attachment 246786 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D246786&action= =3Dedit smart-nvme --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 4 22:41:52 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SkdvP0HFmz52vfc for ; Mon, 4 Dec 2023 22:41:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SkdvN5N04z4Rkv for ; Mon, 4 Dec 2023 22:41:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701729712; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NDZXuu2mDyb1jlDZ5HFyETS0lp8Ew9rElF2pCoSa0qA=; b=KKdhUaxpLVjhcI6MZXKnDA1NEJtzNClOyubNZinmp06qJd5eO8dyUxlDKhxLhwFOzdMmTl VYLSIl0270nWBrEVDk22KtB90BPTviKlrQ/Q9+im8XBLLk8aN38PmArhSuTg2lpNMoyi5m i003nne09oshAh5LnEIz2dz4/Z2UrWl6+69AmLiRkVxPOYDP4nUyotWpcvRD5BnIRRJeTI jf2F4chMlBBJzvUyn4xZMJd4kzHz15yakistpUt8CLbJkd2NudropGq3iEUFVoWZVPHJ8u 3HvlHtDp7J9kO8cyEvYa4jV5aCV53n95Fo27WSEdNcfNIGVzYWPCJTfhlWglsQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701729712; a=rsa-sha256; cv=none; b=H8Enlxsw9iKw/si7lIbpMyDCJAcfRFbLkoNbsEATx+FtWTZ3BarZYa5dJzwRtcEp9s++ag IGbXMrfwK/AjtUnLWcJpc1+8mX9AeCsACcIh3jDCnQDNRLP3ft50dT5HuJAic/KqODJeAr M8WUWWRvvHeltL74ExPbUHQcxAN7QGzpSpi3bBwlQIxURTAtxfjvKQjQuuDENHb84wr0gF gOrpz7dJk3yz0t6j5Oo+vvk2SmmuQSGMNEc2v0oT+dAoVqR3Zwu1L5y7oZ0wPLameRiMQ1 XWcRouHvdYBcCAPPTkMKMNo8StXuiSpwMrfGfvLE+hi3T46wtyJ9HN3wHWqGcA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SkdvN4RLpzlQR for ; Mon, 4 Dec 2023 22:41:52 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4MfqPg013142 for ; Mon, 4 Dec 2023 22:41:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4Mfqaj013141 for fs@FreeBSD.org; Mon, 4 Dec 2023 22:41:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 272325] Page fault, possible ZFS related Date: Mon, 04 Dec 2023 22:41:52 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@orsolic.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272325 --- Comment #12 from bsd_orsolic --- Created attachment 246787 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D246787&action= =3Dedit smart-hdd0 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 4 22:42:14 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Skdvq0yCJz52vpG for ; Mon, 4 Dec 2023 22:42:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Skdvp6RL8z4Rs6 for ; Mon, 4 Dec 2023 22:42:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701729734; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=/brg35ZLR5fCeRsM6Q6lXL/aMAZS8RHSQ8g855wulHM=; b=TJ3HsSGt5OeqOM1kQenAnIei0/tZxvC4/x27C1ckCUWWH39nuqoKWeJR5S4s3pxCN6ZUXT JvqiBwGve3ASOairU+r0rmFpDpuA4EYKW/CMpoPjF8WKFGCvEnE1yBSHt+aUqoRMGMzrWq YiPPsiSl18SqvTfKLKLOATeumBgDlMs1YMaf0t4KeQ0exK7/k5HOQdTfbj5OdEWWyFaueQ ZMgGKvwgKjikW66GHvNYwb+KREW+Awh9Dp8vdVMFG2hTb/Tq2s5v+UV4BY5Lgk8SypkVSF ssjyhWRRpKXXYD7Z52+K4LFdSK9Xo1cP4DruucS0LcxfzCks5L1+aPjztmmysQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701729734; a=rsa-sha256; cv=none; b=g4vfzH9UfCIdHnl4+T3A6T4zfNhunWJWKBBP36oGbpUxNCBQlXv+0EXoBOgDRgj6sQuEYf cFYYPJNU+vuKe230jc3CVAKpNuggq+sKcM2xpScma2yIHIDr4Ll0ZwK7XFmXE7SwINvqrV 57jA5O2Dm3Us52ANd43Mk5qqdJL4rCQ5/PEUDfw1lUbwcA1HiPM22w7EcTiVQ5oVwSiwqW Av4NHz8X69pXXdoepKvlDJ6kx8VlfQJeXi6W4244AOlVlYMqZCzlvHmnjyCj2soU2kLQiH YOTPq8w6CnZopS1yqtOLuzK0l2pPaOaF0CBdxALidZgDO5okv//1iJqZX8m0zQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Skdvp5VpPzlFH for ; Mon, 4 Dec 2023 22:42:14 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4MgEVG017486 for ; Mon, 4 Dec 2023 22:42:14 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4MgEDg017485 for fs@FreeBSD.org; Mon, 4 Dec 2023 22:42:14 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 272325] Page fault, possible ZFS related Date: Mon, 04 Dec 2023 22:42:14 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@orsolic.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: attachments.created Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272325 --- Comment #13 from bsd_orsolic --- Created attachment 246788 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=3D246788&action= =3Dedit smart-hdd1 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 4 22:43:33 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SkdxK5Xzyz52vb1 for ; Mon, 4 Dec 2023 22:43:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SkdxK4RxDz4SPJ for ; Mon, 4 Dec 2023 22:43:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701729813; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bztWqulm2mv+CBXiPM/HKpyU9jwlIkRHHK2InbNIWHs=; b=IjDi58J4+Qdd4TPpNo3cBwyGottIxu0+K6bje0VhVWIsrKeyEaC0wnUdzI3FpUa6Cb55MH iL3uaGeUNAE6jOYosnwByZzwPmgFQj/7J+Qb8e0BKXj1hxuxu6RQ/MZW1YC5cEH+GqE6MW IUg9yDYUgwg94TaeumfWsgRG/hjHkjAd4q9TXeemtESUun0ZNf3vph9qnQqXs6fnbpp4Dn QL8/AWiqzvxedj99OyP0IM5Lg9c9D9Xoz26/NSZTss4zGj3Y7ktRi4Cl/ErsvXPmoCpq0r keIhkRu4OvbUMv4LioJqOeBYun8X6fMcTLHyspEESCBRoosNEIJleDCa4NCY1g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701729813; a=rsa-sha256; cv=none; b=ZQTU2MscLinBNKUP8seaVdRXlc4clEEQPGBKItgHdRV8g0kxkP4xc2ZsD3FMjBU14IDYFv cCfW+PE6UA02ecHfrfWcRyohwkHGjsS8UzfJlw+TMsI2D89HMxbFc0CKWCdHsUkk6hu4l1 oey6HSgvBvrCDXoH60w5kBnfJEdy2qdbdMMNXx6xVNXx+f6HiiOf8b/ePuXRWASDo1NqvT GbCpiFDqFqJBSsCbROr94mDxW6BeHSzZx52KeBvmpSIA5kEdD2XyYXv7chZ2Kzc1s0wpOj HS6utdsPF8ew4I7F07CMt5xoo/uLT/kAcw6b6TT+5/5ZkAJBRFn00ZD/LDLI4g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SkdxK3VyhzlQl for ; Mon, 4 Dec 2023 22:43:33 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4MhXdI019825 for ; Mon, 4 Dec 2023 22:43:33 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4MhXA9019824 for fs@FreeBSD.org; Mon, 4 Dec 2023 22:43:33 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 272325] Page fault, possible ZFS related Date: Mon, 04 Dec 2023 22:43:33 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.2-RELEASE X-Bugzilla-Keywords: crash, needs-qa X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: bsd@orsolic.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D272325 --- Comment #14 from bsd_orsolic --- (In reply to Graham Perrin from comment #9) zpool scrub of mirrored mechanical disk finishes without error. zpool scrub of single NVMe disk finishes with (semi?) error: scan: scrub repaired 0B in 00:20:58 with 0 errors on Thu Nov 30 14:56:10 = 2023 errors: 3 data errors, use '-v' for a list But "show -v" shows more than 3 errors (189 to be exact), all are in contai= ned inside my home partition's snapshots, like: pool/encrypted/home:<0x1> pool/encrypted/home@auto_daily-2023-12-03_02.01.00--1w:<0x1> pool/encrypted/home@auto_hourly-2023-12-02_22.00.00--2d:<0x1> pool/encrypted/home@auto_hourly-2023-12-02_20.00.00--2d:<0x1> All that error can be fixed with "clear" and "scrub": scan: scrub repaired 0B in 00:13:29 with 0 errors on Mon Dec 4 23:37:59 = 2023 Smartctl from disks attached Regarding related PR: that's a fascinating find and reply for a decade old = PR! I also have PCI cards (which are all passed to VMs): Intel 4xGbit, Intel Wi= fi, integrated 2.5Gbit, cheap Asmedia USB controller. Although I did not experienced crashes at 3AM after I upgraded to 14.0 bran= ch --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Dec 4 22:55:59 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SkfCh0kpBz52wHb for ; Mon, 4 Dec 2023 22:56:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SkfCg5dPFz4Tm3 for ; Mon, 4 Dec 2023 22:55:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701730559; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=8uxW4aWgRDA7pWg4TVjr663x9yxWLo3aWEL/slQgZDM=; b=HCHPQQvTm7yZwkzLZInpU86IE1hcIWH/7D3UddM/4Az0vred4zDY6PwNGd5t3VWR52IX8w aflu52w0NUecd8mjxCB4umjKsBUt6dV1jI2bWayMyUJqy2K0FfZxURNoLWTskZnFaoXmby zvN/4FE1r4tYin5Tj9fKARi+Q/xba5IkAbQv8/4jAn2lgBArzBR51Ds/kfF8E+Px2D4ffn M/fUmDSh9SWN4rNAPhOnH5vyTlYDtJfONMak8HsXOyzmujWcKR6GclRuukAgJLs+cV1pSI HFNw2WYM2qUUYX8+vP7xajD/njdjFvsb0DfTo6VoBHnaOgsDm2VttC44NiQLhQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701730559; a=rsa-sha256; cv=none; b=LUzMejzZVA0Lp7yFuR03PAKDTrporN2YQJ0IPTHltWKB1buu/Qv4UJbMlP0sdGRUo8UP0G OeC97mIEYt82cWPpNHRZFTgdiSKnYtD6jK86MlhEAiEnKXOZdam0zkdbdk0x34kJczRBK2 dHb93qWow/yP1o82mRB4SlLXnFNzqS3CMfZdW+PNqaug8U64tQaGG8mYdFQXYBp00u/LHD pISyGlNODf9xSVUmS6ZVRWzBSljLcLYVmvD5giduhTmaMxUOpOhQfvQ3PxlAePi741Djpj UiCwXudxam+/nC9oagj7qf2C/Y9xdxfK2EQbkxqI88VbRay1d4w5HFJ1NgIhYw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SkfCg4jKXzknx for ; Mon, 4 Dec 2023 22:55:59 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B4Mtxqo035328 for ; Mon, 4 Dec 2023 22:55:59 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B4MtxvU035327 for fs@FreeBSD.org; Mon, 4 Dec 2023 22:55:59 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 265625] .zfs/snapshot directory is always readable (also by non-privileged users) Date: Mon, 04 Dec 2023 22:55:59 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: delphij@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D265625 Xin LI changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |delphij@FreeBSD.org --- Comment #6 from Xin LI --- I think this can probably be addressed by changing `zfsctl_ctldir_mode` (sys/contrib/openzfs/module/os/freebsd/zfs/zfs_ctldir.c) to `S_IRUSR | S_IX= USR` (or `S_IRUSR | S_IXUSR | S_IRGRP | S_IXGRP`) with a loader tunable, so the = .zfs is only accessible by root (or root plus the wheel group). --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 5 18:28:42 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Sl8Dq1T2bz53JPy for ; Tue, 5 Dec 2023 18:28:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Sl8Dq0NJdz3cdd for ; Tue, 5 Dec 2023 18:28:43 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701800923; a=rsa-sha256; cv=none; b=M1GdIDcT7dIxJT09rUsT/VnkQWP51aHbfS4gjHLtoJbM4rnPopS4LZ3SJFq37iqZIvC1QE Hj5fpc80BviUpTFxsXZ4y5iH6CQR/pCIaTmveXBwBuIwNRNG0dV7LTU7JcKAUwZ2xLW6jG sISEN1ykvH6vA6mfh+XP912h7r/NpLY0Ekv+aNYyz+Y0XPCuLfwtKATxKwdv+eEIFsZsSH tCcs1ZHP+ZN/VFTa+lHsPNK9S9Vtav9i8zYkJfPFxrNA++SZogGB+RQSk89HonwtpVaxSM aTWIWTjUNyoDtWtU8NCUZkY5wzGHrKMa39YNbBwoBxK7yh/rYyDMjvEugI78Ew== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701800923; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=VpAhq1/4EVXeYjXikKBH+eoxHXfg4XZx/svwye7TlI0=; b=EllhdecvlnaLTKHQDAd1zQJ9RsccYuP/IVthfur2q3DNAQ6H2YLV4yoPwPohPGzhdyDYwi T5uVinZmaCJ93COlT5YVKxdSwBNvDSxhV6Kx4CBiJwHMhWFQ8Qcv7KV9YuIT1vvrCjD2Gs oGu212o8kpkHATieg50hvYNVIns1GPa7PO8JfBRwPBxP00Rzc/IktYzFua0c2OCAiEzwHC FNcEL5CEHJGo5ryZ80mtR87IGbvLkj7vVzU3Cw3m3zxeZfedggsGjF1atoFALjSj1udQQy xjnKXXLEncxYSveOW0VqGvKmdu3Q/ziphybcoiath/LmplZhCAhqSK3bWp7C8Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Sl8Dp6VNvz5R3 for ; Tue, 5 Dec 2023 18:28:42 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B5ISgbW097626 for ; Tue, 5 Dec 2023 18:28:42 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B5ISg3o097625 for fs@FreeBSD.org; Tue, 5 Dec 2023 18:28:42 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275306] 14.0-RELEASE: ossl(4) causes data corruption on encrypted ZFS filesystems/volumes Date: Tue, 05 Dec 2023 18:28:42 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275306 --- Comment #19 from commit-hook@FreeBSD.org --- A commit in branch releng/14.0 references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3D9fd62386ad6e6f5c5298cda66c5c18943= 73e4379 commit 9fd62386ad6e6f5c5298cda66c5c1894373e4379 Author: Mark Johnston AuthorDate: 2023-11-29 17:51:55 +0000 Commit: Mark Johnston CommitDate: 2023-12-04 14:02:05 +0000 ossl: Keep mutable AES-GCM state on the stack ossl(4)'s AES-GCM implementation keeps mutable state in the session structure, together with the key schedule. This was done for convenience, as both are initialized together. However, some OCF consumers, particularly ZFS, assume that requests may be dispatched to the same session in parallel. Without serialization, this results in incorrect output. Fix the problem by explicitly copying per-session state onto the stack at the beginning of each operation. PR: 275306 Reviewed by: jhb Fixes: 9a3444d91c70 ("ossl: Add a VAES-based AES-GCM implementation for amd64") MFC after: 3 days Differential Revision: https://reviews.freebsd.org/D42783 Approved by: so Security: FreeBSD-EN-23:17.ossl (cherry picked from commit 5c0dac0b7a012f326edab06ad85aee5ad68ff120) (cherry picked from commit 84ef0a84ecaa4f5d9bcfed3ce10c288953491e7e) sys/crypto/openssl/ossl_aes.c | 29 +++++++++++++++-------------- 1 file changed, 15 insertions(+), 14 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Dec 5 18:43:37 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Sl8Z14JyPz53K3k for ; Tue, 5 Dec 2023 18:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Sl8Z137h3z3gML for ; Tue, 5 Dec 2023 18:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701801817; a=rsa-sha256; cv=none; b=eABKhq7Yq+72+AjiyQB0qy/rRt/z4ruIm0fRg0M6PTqIwQOSrsHT2FTAYVGFMzL7fs8KCX 5tHdqGYdr3K5jnZQjsKjRIdnGni3Ve+3EXsVIDXfuznC7n9TAefg/4diwHaN4BRwplDvvw T+kkVbZNfh+RInTtp5nIulXliLk1uOlhSBuGqc2H13/kwlld/FhhOTY60X9I3S9zQ+e4Uq f2KIkpd2gHqKd3SaRrvl1WOWswjh1gejzh+k6ieezGkwNfyoP03LzpTXgJFejRPg38D3h3 JdInRF2gAukAjfaUYPfkl99KcdmgQDf1Y4MPezcw0LoaX1ZRzkRvuL6epR++Jg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701801817; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=v64k/zOAU7aTU62gw0habd8MSvesoAA7y0D2E0++Byw=; b=PnROG3uMALFHHvhZnrTp2n28PYgMcsG63amhgiqx8vvTxt+RhzC2fIHmlqVltNyhgcWqt8 GOHXkGaajslKlZiE3Xb0CKZS+cjrALNyhtqDF9K6CEWPjDxW2C+SLSIs8L7CVuj9/TVwSb pxFpoYTHk6a9PHXimm+ZtCX64oAkqBMoILnE8R08HSoJd2YCBLxiyWkctObBkcOxgYJpiP hTqK93z5rqr+Y68BRTnwdC1XOp5dJy0SOQWBIuw2h5cT9PVXG4bQu0ow+Jt0m/0oXSxMfs b5O/CV7Jq2V5mNLH4jGkx61Yz8xPEzsEuEX34qxOVHGvTuwylOcwa6gBV6gd0w== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Sl8Z12Cmpz5pS for ; Tue, 5 Dec 2023 18:43:37 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B5Ihbbg025888 for ; Tue, 5 Dec 2023 18:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B5Ihblw025887 for fs@FreeBSD.org; Tue, 5 Dec 2023 18:43:37 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275306] 14.0-RELEASE: ossl(4) causes data corruption on encrypted ZFS filesystems/volumes Date: Tue, 05 Dec 2023 18:43:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275306 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|Open |Closed --- Comment #20 from Mark Johnston --- Fixed in 14.0-RELEASE-p2. (In reply to Lexi from comment #17) I'm afraid I can't say for sure one way or another. I would expect it to w= ork since ZFS encryption is per-dataset, but I wouldn't be confident in that without testing. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 7 12:17:05 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmCv55TtSz52t5c for ; Thu, 7 Dec 2023 12:17:05 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmCv470dBz3Pq4 for ; Thu, 7 Dec 2023 12:17:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701951425; a=rsa-sha256; cv=none; b=USoFKELRGs+nFrsuf39pmNr0DYmEcZSUJ1LoolCnb3GkGFZQwL6YblwG7JpmvE23qEdvv8 152xLnDqGcAhHzmSerh5oCvaBKCrE2TferULU4TLr++cSLkr/SjfKA//zbRif2ogzimV4F tkyth39/dostgbRI6pehiEbmhc2w3LIpYweNWmzCGuhq/RF7IaVoPaapBpW9+Lkgg01Emm PquOmrx+k5deC+ELykgPD+h2z4JbeiaXMz77xmm8GAA6af3zlqbQnkkVXIOopdXN7gBH7D teH/sTbSzYgf72khpo8uSIQVgVqQDVG3vsbVFxAlMGCoyp8q7cHDAcrtUQ6eUg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701951425; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=sZ0FI7xwtTcQjc5GT1fIN6ZQDue7ZNoluU2qRZxXSu8=; b=Yj1Qq3tPP6o0e/1jI9McindLCbwtWcWkQ11h0OQbqSGwxJboZKLLTx66jdLBlqlI823izx 3T8ry6qW6bTJFXEpni2jDGVSGQdUj6vWTePaAgpfq48/iCPc6gqLFFHwWDJdVY8R/WLS/C rcHr3Nm/eEvfX4dD//GyfaXuOjnKyeWTwRCuDgnx5TGOnAnIC1Q0MmcOSMZ1qG3U9ow17O l93aJbec8mcnQQak+Yfpl9ANmsoxKWBBT4UB4V4I8I32ePytj6EFN4e+401BIryO61AKLT n/k7WLA8au+P4yn7fWB/MN81LadCLNqfoNXp+6gEtF6HjyVF6TbpbSJhfZurBA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmCv463tfzcBt for ; Thu, 7 Dec 2023 12:17:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B7CH4UQ065397 for ; Thu, 7 Dec 2023 12:17:04 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B7CH4VM065396 for fs@FreeBSD.org; Thu, 7 Dec 2023 12:17:04 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275570] self-referential nullfs mount over tmpfs in combination with MNT_UPDATE results in a hang Date: Thu, 07 Dec 2023 12:17:05 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275570 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 7 12:32:35 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmDDz3Xprz52v8g for ; Thu, 7 Dec 2023 12:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmDDz20t3z3STg for ; Thu, 7 Dec 2023 12:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701952355; a=rsa-sha256; cv=none; b=aFkwDX+4zseE20HVZU6G/YOXku9UA31ew+ibFqDuVWHKkHfBJOBei7aHDFVMkMY3abmEtm 6IweKfRqUvD2kR4oXopv+49zhwqOP0qMaXjAfyLIdhpS/z9VyULPJ6cHUvuCAAg2uB3AcE FbG7gDWJDpXd3yQI5iYh2mc3XuCgHuFxisPdY4lbyMpnxK1jDKNa1rC1kOtkYBIpKe1bhb Q7CgnXnGrHZxBGRb9krOc7Guwj6EgRo5w5Kj59a3/qqqMdbfQdkF8SWFYXU2DmtlTOPM/H UolZamZQLWRcCtcKZaMQfqn60bYxi/CKWEXybY0RGCk0qXoaNnMMEri2RnAjGQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701952355; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=lgrdHfqABbvoEscRlWEvhxE3q87yH1S33ti75N3OgWE=; b=MTVjSToxwifzA/BBRjxuFTbjgKIR722MkYKr3Jhj9WcCCsdsYfioMUpuw73ED8iJam9Kzm Pl85m0y8G2uBoK4JaKVjEd3yAusKFdpHBuKg2TTh3BJGzi1GVsngc/9RZh9LpP79lA/04W vU1Rf9wZKkZ4E0iTQrNRDtaYVReN64grok+IksXx1N9cMU4MQ8Tv7b1hAaoM/jtj7dhiE+ xyt/912oYO7M6fomo8ubhscdbAVl0UYHuaEtp+uPtkZvYZTKMJ2UKaA/8y5FL3+L5xFhmp zOCUTIyoG1D3ri4cehngszinYibsx4R/PEVk5NCsmguirI7tlKEH8B0MJQ85jg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmDDz14Skzd03 for ; Thu, 7 Dec 2023 12:32:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B7CWZX6093297 for ; Thu, 7 Dec 2023 12:32:35 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B7CWZ4h093296 for fs@FreeBSD.org; Thu, 7 Dec 2023 12:32:35 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275597] Samba: smbd sometimes aborts by PANIC when 'vfs objects = cap' Date: Thu, 07 Dec 2023 12:32:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: crash X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to keywords Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275597 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|ports-bugs@FreeBSD.org |fs@FreeBSD.org Keywords| |crash --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Thu Dec 7 14:13:20 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmGTN1hl2z533Nd for ; Thu, 7 Dec 2023 14:13:28 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmGTM4St4z3gl6 for ; Thu, 7 Dec 2023 14:13:27 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=NVuLPR8c; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=zJxVIQj0; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.nyi.internal (Postfix) with ESMTP id C74105C00B3 for ; Thu, 7 Dec 2023 09:13:23 -0500 (EST) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Thu, 07 Dec 2023 09:13:23 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :message-id:mime-version:reply-to:sender:subject:subject:to:to; s=fm1; t=1701958403; x=1702044803; bh=KKcOqlUpOkUxJcnLrrka69RzU zx5XTuY8hrskpNsDd0=; b=NVuLPR8cCNF+zoo4ycL9A28H2gphfufFpFmz0QyJ5 MBfhD1OAWcQA3tkbH4hKSZE4ufJ2VyeTykro38Wg/WtQhiIN9CQSIZ5byjdcKoNZ zn0lG+emuihKu3R9GQPyS64AlUugOgKFXaFJZ5HUdL/f77j03EyMwLvwkQXQ/Q5n bMykk1ECiguteunTZ1mtFhaPnVVGuTx5Eyj8xVuki1T0mVBYUGk5b2ypE94XRUqh DMAnPEgE/VdXsbHudPrmGfBR01CdJmQ8nC1IkLQhL9QgigKe7Hl+0mviCD6ifVyz k9KEGk3215X1a5Fk5DohYuu8FRYpXJOqfVVycBtbT34oA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:message-id :mime-version:reply-to:sender:subject:subject:to:to:x-me-proxy :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t= 1701958403; x=1702044803; bh=KKcOqlUpOkUxJcnLrrka69RzUzx5XTuY8hr skpNsDd0=; b=zJxVIQj0YGLRzrawHvNMIZwJBH3i/OkyzqMI21obh7edbC8gXcq s1QZ+cVlLwTgwI/0bZyNST4bOhmBXZc/t06DBnOUTqISCjmoV0NH/muMhNg6jQpb VSVgxhsDmCJKQp5pEEo5BsK5JsoCwNPrHYVM1xYVngMZEMva5Iq8bubE8fDzhSk6 +9fwwBlyLTfnwCnE54CJQxffGxByZrilqNMggDd/ZK+t3rW3kPKdiNaw/BMIkoeH 81DRuLAJH8KehGLdRyv6PEIqTRweruq6svTMDZcf3307zL74zymwfHVaY+qrfXSa riZPQ35EMUQj/e0hcPLapKfVjXKyVFkg+WQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrudekfedgtdduucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkgggtugesthdtredttd dtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgrthht vghrnhepveduffeivdfffffghfegfeejfefftdeiteehteekfefhvdefgfettdeuheegff eunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepvhho ihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 7 Dec 2023 09:13:23 -0500 (EST) Date: Thu, 7 Dec 2023 14:13:20 +0000 From: void To: freebsd-fs@freebsd.org Subject: periodic trim for ufs2 ssds Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.27:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SmGTM4St4z3gl6 X-Spamd-Bar: ---- Hello list, Is there a way or a port available to invoke trim for ufs formatted ssds while multiuser & mounted? I know zfs has this ability, with the zpool -t poolname command and it runs fine while multiuser. I can't find an equivalent for ufs though. Is there one? -- From nobody Thu Dec 7 14:20:10 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmGdN5btXz534GJ for ; Thu, 7 Dec 2023 14:20:24 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x634.google.com (mail-ej1-x634.google.com [IPv6:2a00:1450:4864:20::634]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmGdN17rqz4CxJ for ; Thu, 7 Dec 2023 14:20:24 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=bsdimp-com.20230601.gappssmtp.com header.s=20230601 header.b=hBTzZEJm; spf=none (mx1.freebsd.org: domain of wlosh@bsdimp.com has no SPF policy when checking 2a00:1450:4864:20::634) smtp.mailfrom=wlosh@bsdimp.com; dmarc=none Received: by mail-ej1-x634.google.com with SMTP id a640c23a62f3a-9e1021dbd28so125290766b.3 for ; Thu, 07 Dec 2023 06:20:24 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1701958822; x=1702563622; darn=freebsd.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=xXm4zoYGeniTg0vw94BdfTxCWOfXEYzUBocHzDILDGw=; b=hBTzZEJm/QsA9P4VE1VYsiBuHYm5GZESeI7rSDzPjS3Itw7g5hYptaAfyNIRmCyCvS /dGy7+fvrY1V2ASMtFknaabfCvKk2gji9cr5nVUk7KaV2csxOXlqylJKno+8NvdseDfK Wds4cXM/ZSRhRM7lxpnMawqSfTMxMEH/mqTwv5UvgNjW1AeZUfh9Q+MLZH9llslidMLo mcqQ9NfmXPr9tApAAXzRDMsBb8MVGjoacyJ7Q85dsQd0f2Qakptmgq+2/UwXaUnr6Mi4 hOd6k1dcf6f6FmRcyQqW4E0tapa/NRlNegrlkboExJnbS4QeabTmgex2E1LJc4k9VqvG YvcQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1701958822; x=1702563622; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=xXm4zoYGeniTg0vw94BdfTxCWOfXEYzUBocHzDILDGw=; b=cV5WyZxHMQmDNGkwAutkAqKWkx1WIG5bOjpLGY2zPWeVO+IGw5ruLRvQ3OYbg/G7wR IzYokJ9gyIbVBf4F1VC77tF2N/EcMX0NEoTneOLhxDF7B0iiGcvo2ozVUB6kaUi0e3pB j+c/if0sXaJs5tHVzHLkBxQ678EWbxPMixEecY4nvw7nR1xXLFsruouE4znK1ShYJa46 lkgVp61H6sxYKEdCKhJuOrMANa1VOEWH6fqqF+xFidwUQpp/oCiKpS9o8zFoWcYc7D8q FGrjgsUDMK0arEjzvhkHOpSExMdbfVj3DoSnbKwNCSCwR9rf19yM44fM3W6dJ0lb20Zv 92hg== X-Gm-Message-State: AOJu0Yw2TCVJB0JSSORQq95C0NXLD5XV+8O0bGFqCGIx8Tlm5Z3QEbuJ Q7gp5ELb1gDNN17RHnfq/ihCna/9efye2a7HQ12TtSUob82LFr5N X-Google-Smtp-Source: AGHT+IFRf4t0mMRi9jtMLYWbzGUYtj8Hjsy4IM9mq+bj9fryhs9NHGnnkNkN9h3XadV+TVgurxG5BPxFO/j6DN0+P2M= X-Received: by 2002:a17:906:f2cf:b0:a1b:e80a:b68 with SMTP id gz15-20020a170906f2cf00b00a1be80a0b68mr1524256ejb.143.1701958822122; Thu, 07 Dec 2023 06:20:22 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: In-Reply-To: From: Warner Losh Date: Thu, 7 Dec 2023 07:20:10 -0700 Message-ID: Subject: Re: periodic trim for ufs2 ssds To: FreeBSD FS Content-Type: multipart/alternative; boundary="00000000000003ebba060bec2b04" X-Spamd-Result: default: False [-3.00 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FORGED_SENDER(0.30)[imp@bsdimp.com,wlosh@bsdimp.com]; R_DKIM_ALLOW(-0.20)[bsdimp-com.20230601.gappssmtp.com:s=20230601]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::634:from]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_COUNT_ONE(0.00)[1]; R_SPF_NA(0.00)[no SPF record]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; TO_DN_ALL(0.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; DKIM_TRACE(0.00)[bsdimp-com.20230601.gappssmtp.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; DMARC_NA(0.00)[bsdimp.com]; FROM_NEQ_ENVFROM(0.00)[imp@bsdimp.com,wlosh@bsdimp.com] X-Rspamd-Queue-Id: 4SmGdN17rqz4CxJ X-Spamd-Bar: -- --00000000000003ebba060bec2b04 Content-Type: text/plain; charset="UTF-8" On Thu, Dec 7, 2023, 7:13 AM void wrote: > Hello list, > > Is there a way or a port available to invoke trim for ufs formatted > ssds while multiuser & mounted? > You need to tunefs that on and it will happen as you go. There is no way to batch this up to do it in the background. But there's no advantage to trimming a block multiple times... :). Warner I know zfs has this ability, with the zpool -t poolname command > and it runs fine while multiuser. I can't find an equivalent for > ufs though. Is there one? > -- > > --00000000000003ebba060bec2b04 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Thu, Dec 7, 2023, 7:13 AM void <void@f-m.fm> wrote:
Hello list,

Is there a way or a port available to invoke trim for ufs formatted
ssds while multiuser & mounted?

You need to tunefs that on and it will h= appen as you go. There is no way to batch this up to do it in the backgroun= d. But there's no advantage to trimming a block multiple=C2=A0times... = :).

Warner

I know zfs has this ability, with the zpool -t poolname command
and it runs fine while multiuser. I can't find an equivalent for
ufs though. Is there one?
--

--00000000000003ebba060bec2b04-- From nobody Thu Dec 7 14:40:47 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmH4y0WvBz535Xy for ; Thu, 7 Dec 2023 14:40:50 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmH4x4NVbz4GdQ for ; Thu, 7 Dec 2023 14:40:49 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=BSYfzkqM; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=Mav1pqTJ; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id 50C4B5C020F for ; Thu, 7 Dec 2023 09:40:49 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Thu, 07 Dec 2023 09:40:49 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm1; t=1701960049; x=1702046449; bh=KN Fo0CuX6fg7NkBVHQ8+AHxARHC4ux3N2TAPzawQCcA=; b=BSYfzkqMJV8a3pXdGe LYJZndNE9+h1aW3YNrfGeQB6LeCBTvEV/IfaI1zOl3rKCGxNf+R2C+7iB9q/N8dD 41fvvroyz1gzJg3eO1tOMlYZ9bIA4+8nF7iWFnoGv28W8SUhxEvaWNHDadxCwf97 im0ffsw9pLQD+qgLqgf4SEYMqmyA46fLcqLaKvmiVlJCN0s6Ag7jG4/h2QHLQyMq yqslP1Vn6VUbxOM2/6BVF1a7V3aI/P6d4nLmBowQNq3EQqQiI2uHFK4KuL6FjgNv 1epHc5WzkB5diPAZ6ruqrcDVoyfYA5PnshIaCkR7j7xciXVxHX1AhqaRdkdd56Zm UJuQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm1; t=1701960049; x=1702046449; bh=KNFo0CuX6fg7N kBVHQ8+AHxARHC4ux3N2TAPzawQCcA=; b=Mav1pqTJLjjRLjD7DwvDVf75crh49 AU01xcwTWpkfRp5/hAr0XXkY9F6Ea+oW/9DljaQwVws8V4Amo3JAypA5yQJd901I MOQq+rYXbQCnpFXpKrGndKYRMPmjUl5c1y1X/gRr5QTXZYiZ0RNHF3kYoGVM7xoD beQwn6cD9kBLHCxLGawQWGTXCg0CqOclvlyn8Ro03vB1hlR+kx3cB3FUuC+fA0MH /ywjlc2wDqG1sttYq1cHrECX9XMGeclX3YH4bTnxYoJl6mRnpv5bHD8veLuHh2xc riiqHQA511qL5OGQCeX9AlyX/DMjSUaOVe/qTOAWKA7wRqm/xSiouDb7A== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrudekfedgtdejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtro dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepieevgfefgeffhffggfeitdejjefhteeffefgleefieevleevjeeuieduge elgffgnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 7 Dec 2023 09:40:48 -0500 (EST) Date: Thu, 7 Dec 2023 14:40:47 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: periodic trim for ufs2 ssds Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.27:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SmH4x4NVbz4GdQ X-Spamd-Bar: ---- On Thu, Dec 07, 2023 at 07:20:10AM -0700, Warner Losh wrote: >You need to tunefs that on and it will happen as you go. There is no way to >batch this up to do it in the background. But there's no advantage to >trimming a block multiple times... :). ok, thanks. (I should have mentioned 14-stable amd64 context) I booted single-user then ran: fsck -y /dev/ada0s1a fsck_ffs -E /dev/ada0s1a tunefs -t /dev/ada0s1a fsck_ffs -E /dev/ada0s1a then booted multiuser will console/messages or some other log show when it runs? smartctl(8) makes no mention of trim. -- From nobody Thu Dec 7 15:21:44 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmJ095MV3z538ZJ for ; Thu, 7 Dec 2023 15:21:45 +0000 (UTC) (envelope-from SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmJ094Tggz4MG3 for ; Thu, 7 Dec 2023 15:21:45 +0000 (UTC) (envelope-from SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl) Authentication-Results: mx1.freebsd.org; none Date: Thu, 7 Dec 2023 16:21:44 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1701962504; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=2XNU9CMIp/mALKnC+B0VEvDfpLx1wrpA9Gg2WIWWaHw=; b=H5vdu9QvWYP2zpqLFLRQq6M1gxrPO9Rj4OJtp1+Phw/rDIooKAsOUizbVJcgjhB1Fo9z8e DqFdf01mmm7km+cyAkVyUpDyLPnmgJR/9x38nrGQsl6Z6YMQA/Nd1RJtaDjyMvjsx8/ETZ 5vdnJZdJtvLYX5iSbRhlhZoEdn+JsxW3Ix0t6ZCTlvgpbGdVC2XyElAwV7GEDZyT9PrT/k 9Zc/uSDrvkhmwkqatbJOoZSvksq+itRryA1aYpKffwODumZr4SdYR348Ca8+ULOKkTVFXS fw6W6EsY0KZJ99OmrltAezw0TvPn0bimcyBcdZI3A1V3pcAM1taI/UipoMIMNQ== From: Ronald Klop To: void Cc: freebsd-fs@freebsd.org Message-ID: <66097626.208187.1701962504337@localhost> In-Reply-To: References: Subject: Re: periodic trim for ufs2 ssds List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_208186_1038978366.1701962504334" X-Mailer: Realworks (681.40) Importance: Normal X-Priority: 3 (Normal) X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4SmJ094Tggz4MG3 ------=_Part_208186_1038978366.1701962504334 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: void Datum: donderdag, 7 december 2023 15:40 Aan: freebsd-fs@freebsd.org Onderwerp: Re: periodic trim for ufs2 ssds > > On Thu, Dec 07, 2023 at 07:20:10AM -0700, Warner Losh wrote: > > >You need to tunefs that on and it will happen as you go. There is no way to > >batch this up to do it in the background. But there's no advantage to > >trimming a block multiple times... :). > > ok, thanks. > > (I should have mentioned 14-stable amd64 context) > > I booted single-user then ran: fsck -y /dev/ada0s1a > fsck_ffs -E /dev/ada0s1a > tunefs -t /dev/ada0s1a > fsck_ffs -E /dev/ada0s1a > > then booted multiuser > > will console/messages or some other log show when it runs? > smartctl(8) makes no mention of trim. > -- > > > > A tool like "gstat -d" will show columns for deletion which means trim. Regards, Ronald. ------=_Part_208186_1038978366.1701962504334 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit

Van: void <void@f-m.fm>
Datum: donderdag, 7 december 2023 15:40
Aan: freebsd-fs@freebsd.org
Onderwerp: Re: periodic trim for ufs2 ssds

On Thu, Dec 07, 2023 at 07:20:10AM -0700, Warner Losh wrote:

>You need to tunefs that on and it will happen as you go. There is no way to
>batch this up to do it in the background. But there's no advantage to
>trimming a block multiple times... :).

ok, thanks.

(I should have mentioned 14-stable amd64 context)

I booted single-user then ran: fsck -y /dev/ada0s1a
fsck_ffs -E /dev/ada0s1a
tunefs -t /dev/ada0s1a
fsck_ffs -E /dev/ada0s1a

then booted multiuser

will console/messages or some other log show when it runs?
smartctl(8) makes no mention of trim.
-- 
 


A tool like "gstat -d" will show columns for deletion which means trim.

Regards,
Ronald.
  ------=_Part_208186_1038978366.1701962504334-- From nobody Thu Dec 7 15:25:37 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmJ4j1slkz538y2 for ; Thu, 7 Dec 2023 15:25:41 +0000 (UTC) (envelope-from SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl) Received: from smtp-relay-int.realworks.nl (smtp-relay-int.realworks.nl [194.109.157.24]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmJ4h3HWBz4MVC for ; Thu, 7 Dec 2023 15:25:40 +0000 (UTC) (envelope-from SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=klop.ws header.s=rw2 header.b=TpjVnxmf; spf=pass (mx1.freebsd.org: domain of "SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl" designates 194.109.157.24 as permitted sender) smtp.mailfrom="SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl"; dmarc=pass (policy=quarantine) header.from=klop.ws Date: Thu, 7 Dec 2023 16:25:37 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=klop.ws; s=rw2; t=1701962737; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=firszJfizSsaUywyzqMp6ei5QMWEaG2GxO5e65bFSHc=; b=TpjVnxmfgoJ0y8uFIp58xgs705ondBYnqLFBtOYafVAI34lkEUfleS3r8KzRmNBfHcjcTF KLVMqPDNI3i9POmcpHYKCD8vfHIBbGQNMPk2bW+kAAXo8YlgqPQd6ttjGg7+zjHUrNLaJb p9rGvtruAVatV7hU6Em7rclRvLQzOsXGFz6Ck1CnhXJoM/dpTTu8tzmtBo65Ribj1ONLaF s2Q1+PWUnc0jX51af/e1pTe9a9NTH+lpzQf1R7OYk7TSXFzYgP8WPiiKk0OxOlkv6be5T1 XMPKhrOMttrw1GqTTE+7jdZcEMKrrBnlDfxHeyUl73YRDEm6MH6IyoUFhghfWQ== From: Ronald Klop To: void Cc: freebsd-fs@freebsd.org Message-ID: <1001525509.209637.1701962737772@localhost> In-Reply-To: <66097626.208187.1701962504337@localhost> References: <66097626.208187.1701962504337@localhost> Subject: Re: periodic trim for ufs2 ssds List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="----=_Part_209636_1570173428.1701962737770" X-Mailer: Realworks (681.40) Importance: Normal X-Priority: 3 (Normal) X-Spamd-Result: default: False [-3.20 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[klop.ws,quarantine]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[ronald-lists@klop.ws,SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl]; R_SPF_ALLOW(-0.20)[+ip4:194.109.157.0/24]; R_DKIM_ALLOW(-0.20)[klop.ws:s=rw2]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FREEMAIL_TO(0.00)[f-m.fm]; RCVD_COUNT_ZERO(0.00)[0]; ARC_NA(0.00)[]; DKIM_TRACE(0.00)[klop.ws:+]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; HAS_X_PRIO_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; ASN(0.00)[asn:3265, ipnet:194.109.0.0/16, country:NL]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[ronald-lists@klop.ws,SRS0=aNgP=HS=klop.ws=ronald-lists@realworks.nl] X-Rspamd-Queue-Id: 4SmJ4h3HWBz4MVC X-Spamd-Bar: --- ------=_Part_209636_1570173428.1701962737770 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Van: Ronald Klop Datum: donderdag, 7 december 2023 16:21 Aan: void CC: freebsd-fs@freebsd.org Onderwerp: Re: periodic trim for ufs2 ssds > > > Van: void > Datum: donderdag, 7 december 2023 15:40 > Aan: freebsd-fs@freebsd.org > Onderwerp: Re: periodic trim for ufs2 ssds >> >> On Thu, Dec 07, 2023 at 07:20:10AM -0700, Warner Losh wrote: >> >> >You need to tunefs that on and it will happen as you go. There is no way to >> >batch this up to do it in the background. But there's no advantage to >> >trimming a block multiple times... :). >> >> ok, thanks. >> >> (I should have mentioned 14-stable amd64 context) >> >> I booted single-user then ran: fsck -y /dev/ada0s1a >> fsck_ffs -E /dev/ada0s1a >> tunefs -t /dev/ada0s1a >> fsck_ffs -E /dev/ada0s1a >> >> then booted multiuser >> >> will console/messages or some other log show when it runs? >> smartctl(8) makes no mention of trim. >> -- >> >> >> >> > > > A tool like "gstat -d" will show columns for deletion which means trim. > > Regards, > Ronald. > This can give you some info too. $ sysctl -a | grep trim <118>Creating and/or trimming log files. kern.cam.da.1.trim_ticks: 0 kern.cam.da.1.trim_goal: 0 kern.cam.da.1.trim_lbas: 0 kern.cam.da.1.trim_ranges: 0 kern.cam.da.1.trim_count: 0 kern.cam.da.0.trim_ticks: 0 kern.cam.da.0.trim_goal: 0 kern.cam.da.0.trim_lbas: 75835864 kern.cam.da.0.trim_ranges: 62293 kern.cam.da.0.trim_count: 57020 ... Regards, Ronald. ------=_Part_209636_1570173428.1701962737770 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit

Van: Ronald Klop <ronald-lists@klop.ws>
Datum: donderdag, 7 december 2023 16:21
Aan: void <void@f-m.fm>
CC: freebsd-fs@freebsd.org
Onderwerp: Re: periodic trim for ufs2 ssds

 

Van: void <void@f-m.fm>
Datum: donderdag, 7 december 2023 15:40
Aan: freebsd-fs@freebsd.org
Onderwerp: Re: periodic trim for ufs2 ssds

On Thu, Dec 07, 2023 at 07:20:10AM -0700, Warner Losh wrote:

>You need to tunefs that on and it will happen as you go. There is no way to
>batch this up to do it in the background. But there's no advantage to
>trimming a block multiple times... :).

ok, thanks.

(I should have mentioned 14-stable amd64 context)

I booted single-user then ran: fsck -y /dev/ada0s1a
fsck_ffs -E /dev/ada0s1a
tunefs -t /dev/ada0s1a
fsck_ffs -E /dev/ada0s1a

then booted multiuser

will console/messages or some other log show when it runs?
smartctl(8) makes no mention of trim.
-- 
 


A tool like "gstat -d" will show columns for deletion which means trim.

Regards,
Ronald.
 
This can give you some info too.

$ sysctl -a | grep trim
<118>Creating and/or trimming log files.
kern.cam.da.1.trim_ticks: 0
kern.cam.da.1.trim_goal: 0
kern.cam.da.1.trim_lbas: 0
kern.cam.da.1.trim_ranges: 0
kern.cam.da.1.trim_count: 0
kern.cam.da.0.trim_ticks: 0
kern.cam.da.0.trim_goal: 0
kern.cam.da.0.trim_lbas: 75835864
kern.cam.da.0.trim_ranges: 62293
kern.cam.da.0.trim_count: 57020
...

Regards,
Ronald.
  ------=_Part_209636_1570173428.1701962737770-- From nobody Thu Dec 7 15:33:59 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmJGM5yxjz539Gb for ; Thu, 7 Dec 2023 15:34:03 +0000 (UTC) (envelope-from void@f-m.fm) Received: from out3-smtp.messagingengine.com (out3-smtp.messagingengine.com [66.111.4.27]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmJGM0C9nz4Nxb for ; Thu, 7 Dec 2023 15:34:03 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm1 header.b=i0Cf0mTL; dkim=pass header.d=messagingengine.com header.s=fm1 header.b=jgt9bCZ9; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 66.111.4.27 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id 6389D5C0134 for ; Thu, 7 Dec 2023 10:34:02 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Thu, 07 Dec 2023 10:34:02 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:sender :subject:subject:to:to; s=fm1; t=1701963242; x=1702049642; bh=J5 Dx8YwlnZviCgKf4+AszwgaYnqbRywEg6GStwCC2WI=; b=i0Cf0mTLwFbASyukXn GqQE1ZMQJHpmq6ENA3hFLzeKYJ3oKnmzY9c1kres444OSpIvqy/is1wM+5q+togT OXD9+H9oMPVC6ckOyAQPEDU9f74vGRljrL02og3sJbVzakX0F0QA0T+T8ynFKW7w k6HfnPytqTAz4cVf/4fYt2LJ1wDO3gTKTDnvzvA7Fz6cVihhz5exwxHKuTvujH81 7QTYVDxta70LfgvUODacfRWQc4yS6+gEK1g+h7oExJXDcWkiCbp2qL+FyCUDsw1Z qV1t6ahzPQ99UXzlfI1+CF74yKkWbxoqvJzVNs0pW/ri2Wl7ajQ3mUYQs32IFmel OTpg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm1; t=1701963242; x=1702049642; bh=J5Dx8YwlnZviC gKf4+AszwgaYnqbRywEg6GStwCC2WI=; b=jgt9bCZ9QsFtXEN5X3CvJZ5NhJxOX RwsOD9Ryxc+NMEIDxDyZLJzbZKJsUnQULdcy1Tw8Ws0T5EkAEDtYBzzm0B3+J0x4 rGm6JFGGrXZT2uyEY9FkLhwAFVXolEoLUu2ibtE9DCr+10WMSY7wgQ+mKL5FSjlS GPnsxV8sdsK+71Qu7aV/KmNaZlhZsw4DymyTdDq+J4PVieD8K0F/Vb0Z3kzW9/Fx WkmfL7PaJDWy/TIfmxyYpx60MIKV3X3Ji0eVU7YN0wVLnWkWr+3bfkeTXoLlq/GV /jbfem3J45oUK6HrYKCEgacni3sPRqjdisDW/JFG2eykLLdKi9asn2bnw== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvkedrudekfedgudekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuffkfhggtggujgesthdtre dttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhmrdhfmheqnecuggftrfgr thhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgfdugfdvgeekjeejuddthe ehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhep vhhoihgusehfqdhmrdhfmh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 7 Dec 2023 10:34:01 -0500 (EST) Date: Thu, 7 Dec 2023 15:33:59 +0000 From: void To: freebsd-fs@freebsd.org Subject: Re: periodic trim for ufs2 ssds Message-ID: Mail-Followup-To: freebsd-fs@freebsd.org References: <66097626.208187.1701962504337@localhost> <1001525509.209637.1701962737772@localhost> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: <1001525509.209637.1701962737772@localhost> X-Spamd-Result: default: False [-5.00 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.998]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; RWL_MAILSPIKE_EXCELLENT(-0.40)[66.111.4.27:from]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm1,messagingengine.com:s=fm1]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.27:from]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; RCVD_VIA_SMTP_AUTH(0.00)[] X-Rspamd-Queue-Id: 4SmJGM0C9nz4Nxb X-Spamd-Bar: ---- On Thu, Dec 07, 2023 at 04:25:37PM +0100, Ronald Klop wrote: >>A tool like "gstat -d" will show columns for deletion which means trim. >> >>Regards, >>Ronald. >This can give you some info too. > >$ sysctl -a | grep trim ><118>Creating and/or trimming log files. >kern.cam.da.1.trim_ticks: 0 >kern.cam.da.1.trim_goal: 0 >kern.cam.da.1.trim_lbas: 0 >kern.cam.da.1.trim_ranges: 0 >kern.cam.da.1.trim_count: 0 >kern.cam.da.0.trim_ticks: 0 >kern.cam.da.0.trim_goal: 0 >kern.cam.da.0.trim_lbas: 75835864 >kern.cam.da.0.trim_ranges: 62293 >kern.cam.da.0.trim_count: 57020 thanks for both of those suggestions -- From nobody Thu Dec 7 19:47:03 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmPtJ2B6Nz53Vv9 for ; Thu, 7 Dec 2023 19:47:04 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmPtH4tNNz4mw4 for ; Thu, 7 Dec 2023 19:47:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701978423; a=rsa-sha256; cv=none; b=jqvfsPQUb4zrxAUfxqPs1wtHt5wCXAj+Oys4Dc4w++WhGy7wLh9tyT86uKKyMafh7Q0l3X KnToQeaSeDtD9uhBfAyNOAPX43s1D/IXeLYFQEbN1FklyoFhcWCTiUxJ3cVsj60nAaF3jG SA5yiOmcqKhc50NvO4mf7cz7q/7+CoTQkttrNRNFgkfwE7yA7Xm11jGBqU8DaAu3UxD9hj sFPalXu154I5TlshO2xhB+J++BbgX33QJ3mSvgW8juVpYuQFzT1Ze5G22INy4J5kRqY9gk xBgy0w1uchpI53/NXQMLftc6soIiDLmCzn5ceGQBmKr/lMNK5yZivndKKF3JjQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701978423; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=Vrg7sKnL0juAgAp0N3f8lTg88Msr5kiXbU+3jzvV7x8=; b=xLXcB5Hhh9imp7PVX2qwTHSH+5fswuAZ5ruWgRNLGrw5GsszuocZqwyTXJwLVKAoCV2sFl p353KJBijdTEWZ5lICy+wpAv/LaeVnsk4vNcz/SveT9l50dqUeiL4Wl4n03rqR5ea7Jz9o IPMVN7IHnmsyPd409S94nFJtSoteC44m0T+iFZ6ay4Xgbb1mkHIDixu0+w1c+qsISqQDoQ 1PEx0/caJVPHpFqkdlwJxH1jgrikiCMug0CRs5merO8Ou0gfWLf2G9NSWQRNg0YfSc9hOL ZyiPL+pDw2YtDOtSASHrX9dB2cCqwdfxFvLzNsFgX1hVcqUVd9+wJHfiWh4ICw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmPtH3mb2zqdc for ; Thu, 7 Dec 2023 19:47:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B7Jl302087370 for ; Thu, 7 Dec 2023 19:47:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B7Jl3Ms087369 for fs@FreeBSD.org; Thu, 7 Dec 2023 19:47:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Thu, 07 Dec 2023 19:47:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: linimon@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 Mark Linimon changed: What |Removed |Added ---------------------------------------------------------------------------- Assignee|bugs@FreeBSD.org |fs@FreeBSD.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 8 01:00:00 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmXqP338hz52wkJ for ; Fri, 8 Dec 2023 01:00:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmXqN5nlDz4JFk for ; Fri, 8 Dec 2023 01:00:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1701997200; a=rsa-sha256; cv=none; b=dJWlQbE2+Q/jcAyY2RhprXUO2+4UGqvXKtA92dctSHpgJiWKR1YtcB+l4Yh/IVBfYGByI7 ya++TMUh5c8aOFy2r6Ji981iu8t6v7u9dRF9hLvsn8edOWLv0zrirQy2TfaT92/pYx9Mdz YjKE18ZNKq4EMSo+pvCQBqW+35L1HzwMSVN2saAWC6b10MYj5OPhzlPpgaOXwiRk+qhXkj cc09a7PaIaRMyvioGvBfRFPU/RbgehYYR94eaT/R7K9hqr0w8W1DZ+4ufvRn90IIdu/JZe LigPnC8fiXCFE1zSNv35EjGy01Z3Xe46tFYSnmXo6jCR1IakrgElchTGUFrdmA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1701997200; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=MjDjpdzsRnmeWHGu3/100YZvQwkCP9972XYw+7dk09s=; b=k6S7/h+fWv8OWcOHvFo0rMfi5NeghEekIG910p4jfJApz5llDVQoAyyQNz8lCgG45LYetz xs6HmDsHzQRf/K+b/DE6zFWfExu0QKPZSU0x5PBIVeTuLjgH/OAuEkMcdMs5baX0iU1Se+ ZmcHN0S4ZvXylT9QETBWy+N4GuLU+Ow51RmAt80tbrmORM8susLpEK5Pi83c74zA0B9mPg sKZbwjq/KsRIuWhmmCG9tViF010pltLOhJUblniAuunj8BEE9g6LUZeLkRWncaH066qBtx wEBD9UmG1QB0lSSgBcdr8apIuIqJSU9iIfAXCnO2ZAquLlVVhCp8Gtptq0Dgvw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmXqN4lCyz108M for ; Fri, 8 Dec 2023 01:00:00 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B8100ql094806 for ; Fri, 8 Dec 2023 01:00:00 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B81000b094800 for fs@FreeBSD.org; Fri, 8 Dec 2023 01:00:00 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 08 Dec 2023 01:00:00 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: seigo.tanimura@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #4 from Seigo Tanimura --- (In reply to Mark Johnston from comment #3) A quick update: 7 hours passed; building emulators/mame, the final port. arc_prune keeps running at 50 - 100% CPU usage. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 8 04:50:55 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Smdxq4sGwz53HRQ for ; Fri, 8 Dec 2023 04:50:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Smdxq0Z9Kz4fcn for ; Fri, 8 Dec 2023 04:50:55 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702011055; a=rsa-sha256; cv=none; b=QjZyiQZ8tyt0JZfxj8FeQH3fjam938OEEbRlsQeQZCtzGHZnveIdWKxrw+9zya8wNWD/8d QHO97MBCltlJj25P4rdyH2uuVO+jk1De4XaDBUlQKd2jER/Hl7+1wlwWbgU23nVQ2cUsp5 kmEN7ltBiFLQrKtS52QAeMDRuPiT1IQ6J92/GlK7EBMYgaw9H8yVPk7rp4ftN8HaSd9JOu m1u1k4QPNdwBU9CoF3OCe2BwK+N7ID+a1ea4EBrqy6+jDxJMsX1TjpJh8rupufFWkqfCtn iTqU1ug8a+lar6jAqLUzD1c7SuUqdhhZKDnHgGwVxy12rmL7vBq0wWwt/IF72w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702011055; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=7XgFIsbZ/ThJtJrCVyG1tbundztzruv4DyK5vZx1vcY=; b=GtfZrSigInKYz9c9gFYFNu9uQvDkKvi9QSv9BfVXDfn6AAqXt1gF+AkXIsuVYuhuGXvmp1 N6zqX4T74Lm+dRyUXzCuNI6kVc5vUvEkdtjhsqahSvfrcHglqYXy4uGROrFCZkUEsUmNrA CNevQbLVSVJWVB0R9R9UHdbef69jXtL+IXByPJCqB0TUhUN72Uj3xyVPOjnOoUlbnLGu8m 6aiq71i8f8WCVvGi3AKtmgbleTTEHy21UmQuYw6QJxP2SuG/iuzWi3a9icVOFVcxkDpZMr 88t26gLhj+SAz3XhTUczmKLFmMFb/gVKkpyF3ZGKaGkQ4qgnyBLV7sLCHLAaMA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Smdxp6kwjz165B for ; Fri, 8 Dec 2023 04:50:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B84osh4062758 for ; Fri, 8 Dec 2023 04:50:54 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B84osHm062757 for fs@FreeBSD.org; Fri, 8 Dec 2023 04:50:54 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 08 Dec 2023 04:50:55 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: seigo.tanimura@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #5 from Seigo Tanimura --- (In reply to Mark Johnston from comment #3) The build has completed. Build time: 07:40:56 (278 pkgs / hr) arc_prune stopped shortly after poudriere finished. The pileup of arc_prune has indeed been fixed by FreeBSD-EN-23:18.openzfs, but the essential problem should be in somewhere else. Right now, I am testing with the following setup after the reboot: - vfs.vnode.vnlru.max_free_per_call: 10000 (out-of-box) - vfs.zfs.arc.prune_interval: 1000 (my fix enabled) About 2 hours after the start, the CPU usage of arc_prune was at 20 - 25% w= ith the occasional drops. Poudriere was working on lang/rust and lang/gcc12 at that time. A correction of the description: > * Test Environment: VM & OS > - RAM: 20 GB (not 16 GB) A note on the ZFS configuration: > vfs.zfs.arc_max=3D4294967296 (4GiB) This limit has been added because this host is a build server, not a file server. AFAIK, ZFS tends to take up to about 1/4 of the available RAM for = the ARC. While that may be fair as a file server, an application server wants = more RAM in general. Under the limit above, the demand upon the ARC pruning is expected and the = OS must be ready to deal with that. > arc_prune_async() is rather dumb on FreeBSD, as you point out: it tries t= o reclaim vnodes from the global free list, but doing so might not alleviat= e pressure. Really we want some way to shrink a per-mountpoint or per-file= system cache. I thought you would say that; I almost thought of the same thing more than = 20 years ago while implementing the initial version of vnlru along with Matt Dillon :) The per-mountpoint / per-filesystem vnode design has at least two challenge= s: A) Balancing the vnodes across the mountpoints / filesystems, and B) Splitting the name cache. I suspect B) is the more difficult one. As of now, the global name cache allows the vnode lookup in a single place with just one pass. The behaviour and performance under the per-mountpoint / per-filesystem name cache would depend on the interaction across multiple filesystems, and hence be very complicated to analyse and tune. The interval between the ARC pruning executions is much more simple and yet effective, under my key findings out of the first test in the description: - The ARC pruning indeed works as long as that is a one-shot run. - The modern hardware is fast enough to walk through all vnodes, again as l= ong as that is a one-shot run. - The ARC pruning and vnlru are the vnode maintainers, not the users. They must guarantee the fairness upon the vnode use to the true vnode users, nam= ely the user processes and threads. (and maybe the NFS server threads for a net= work file server) After the current build, I will try vfs.vnode.vnlru.max_free_per_call=3D400= 0000.=20 This value is the same as vfs.vnode.param.limit, so there will be no limit = upon the ARC pruning workload except for the giveup condition. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 8 10:17:49 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmnC12kFdz53kq6 for ; Fri, 8 Dec 2023 10:17:49 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmnC06xHlz3dLX for ; Fri, 8 Dec 2023 10:17:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702030669; a=rsa-sha256; cv=none; b=gcTP2Vfy6b1s1LqFYCdwQBMEUxKcGyS4WEosZMF5o0hzG9AGDXoYNM+PplZ19IwoFk3R/z 2jlt1BE5GSpCq9Jjn1y5IiZbF8EUCWlFEWLyZqzEnBwCShWxCKypqExz8O6hebZCTMzYHm MJJ76XcWsVLR5c5O823sEJG/ZUlrxx0dcsKn0QjE6SSn61Q/ZeqVZ6ox7C4KoD8c7PF1jn WfUU7EXrI3nYan/WXirONj4izUil8W6MQ0fusbZO0C/15ZZ2qSBQVDOjAhXtoJDR+ICkCv w8ZCbgzAsXIWBKn19ZmOtrfFBsLcAEIF/t2XulcuMJI1jQ1qmZH+itGqscvJvQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702030669; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=isQALFR8YuRgEHeS4hOs5tGBJDKuKESqnGOFyipLsYQ=; b=TZMlS3gjWx3rAHc/oMrrk1sc400ncDF5VZcYGw9+/FO2H9NAtv1TWxMYEVVDfsE+fAdyGc wfHhl7VXjsX1S7HHTzJHLyalxz/9qrYJBRNaIEduHtLPavTD5PJUcyv24VV5Aoyi1apFa7 xPfn+Ok+7/2Ecadz45DXEC4CJ26tNOCyOPXc0fNzmHR5gY2TroroM1ezyvYak0cnUNHTYt N3LXX27MlWm2SZ4GpiXELszfC94NFkphE2p5V3WNIpBuGaU2XLMD7ZuRkc7lDqPN+tPIib JNe5yvdkqbZhMn0D1Icg2J+d2svikd2PSI5GaQE5dPjWmKnqngOAQrEZuElYww== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmnC061Jdz1qw for ; Fri, 8 Dec 2023 10:17:48 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B8AHmBf090019 for ; Fri, 8 Dec 2023 10:17:48 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B8AHmax090018 for fs@FreeBSD.org; Fri, 8 Dec 2023 10:17:48 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 08 Dec 2023 10:17:49 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: seigo.tanimura@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #6 from Seigo Tanimura --- (In reply to Seigo Tanimura from comment #5) The build under the following setting have completed: - vfs.vnode.vnlru.max_free_per_call: 10000 (out-of-box) - vfs.zfs.arc.prune_interval: 1000 (my fix enabled) Build time: 07:11:02 (292 pkgs / hr) Max vfs.vnode.stats.count: ~2.2M Max ARC memory size: ~5.6GB NB devel/ocl-icd failed because pkg-static was killed by the kernel for tak= ing too long to page in. 31 ports were skipped because of this failure. This error was often seen on 14.0-RELEASE-p0, indicating an obstacle upon the executable file access. This result is better than the baseline (14.0-RELEASE-p2) and worse than my original fix shown in the description. Although prune_interval avoided the contention upon vnode_list_mtx somehow, this setup also limited the ARC pru= ning performance, introducing another pressure including the overcommit upon the= ARC memory size. I conclude this setup is not optimal nor recommended. ----- Ongoing test: - vfs.vnode.vnlru.max_free_per_call: 4000000 (=3D=3D vfs.vnode.vnlru.max_free_per_call) - vfs.zfs.arc.prune_interval: 1000 (my fix enabled) This setup allows the unlimited workload to the ARC pruning under the configured interval. Another object of this test is the measurement of the vnode number ZFS requ= ests the OS to reclaim. As long as this value is below 100000 (vfs.vnode.vnlru.max_free_per_call in my first test), the system behaviour = and test results are expected to be the same as my first test. A glance on 30 minutes after the build start: - The activity of arc_prune is mostly the same as the first test; the CPU u= sage occasionally surges up to 30%, but it does not stay for more than 1 second = so far. - The average number of the vnodes ZFS requests to reclaim: ~44K. - vfs.vnode.stats.count: ~1.2M. - The default vfs.vnode.vnlru.max_free_per_call of 10K did regulate the A= RC pruning work. - I will keep my eyes on this figure, especially if it exceeds 100K. - The ARC memory size is strictly regulated as configured by vfs.zfs.arc_ma= x. - The ARC pruning starts when the ARC memory size reaches ~4.1GB. - The ARC pruning does not happen as long as the ARC memory size is below 4.0GB. The finding regarding the ARC memory size is something new to me. Maybe the vnode number requested for the reclaim by ZFS is calculated very carefully = and precisely, so we should actually honour that figure to keep the system heal= thy. I first treated this test as an extreme case, but maybe this should be evaluated as a working setup. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 8 11:03:19 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmpCd0fWpz53nbB for ; Fri, 8 Dec 2023 11:03:25 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Received: from smtp2-g21.free.fr (smtp2-g21.free.fr [IPv6:2a01:e0c:1:1599::11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmpCc1DW9z4FLY for ; Fri, 8 Dec 2023 11:03:24 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=free.fr header.s=smtp-20201208 header.b=nyml17hm; spf=pass (mx1.freebsd.org: domain of olivier.freebsd@free.fr designates 2a01:e0c:1:1599::11 as permitted sender) smtp.mailfrom=olivier.freebsd@free.fr; dmarc=pass (policy=none) header.from=free.fr Received: from ravel.localnet (unknown [90.118.140.172]) (Authenticated sender: olivier.freebsd@free.fr) by smtp2-g21.free.fr (Postfix) with ESMTPSA id DFD532003CC for ; Fri, 8 Dec 2023 12:03:19 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=free.fr; s=smtp-20201208; t=1702033399; bh=odYiQQAK76Guwsf7OLbtz31qb/GGLvTBvP0KA40ipkM=; h=From:To:Subject:Date:In-Reply-To:References:From; b=nyml17hmr7MlR8oScXqY0s0lH6DQkK6oERhwRcu7OlizjFrmmF3eGi0CLHD2vHMpC dH6l+aehRQRn0xKpAikOSdJnomof1vqntGe3X/fRCvv8XbcB5MOctd4XUe2FN/eVMT jBNMNVSerV5ar0+fi0Qtr7KkBH6xxmaK6wN49tDL36HzEb3d4+ocutN6O2++0zIiJG fagZEJoTM3x2vnO7VnjYdJeXG3rK/IcCetviYpiUtS4EdKZZxr/VN6JWcqDqyqGrrB 98eJiV5Hh4XQ1MDRZJXTD84nzyuxLzjXdOc8BzbSozursarbKVKeS6s34/ETxzGr5R gBtVA1jm2mWdA== From: Olivier Certner To: freebsd-fs@freebsd.org Subject: Re: periodic trim for ufs2 ssds Date: Fri, 08 Dec 2023 12:03:19 +0100 Message-ID: <2959153.slGk94SIus@ravel> In-Reply-To: References: List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="UTF-8" X-Spamd-Result: default: False [-2.90 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; CTE_CASE(0.50)[]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[free.fr,none]; R_SPF_ALLOW(-0.20)[+ip6:2a01:e0c:1:1599::11]; R_DKIM_ALLOW(-0.20)[free.fr:s=smtp-20201208]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[free.fr:dkim]; FREEMAIL_ENVFROM(0.00)[free.fr]; DKIM_TRACE(0.00)[free.fr:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[free.fr]; ARC_NA(0.00)[]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; FROM_EQ_ENVFROM(0.00)[]; ASN(0.00)[asn:12322, ipnet:2a01:e00::/26, country:FR]; RCVD_TLS_ALL(0.00)[] X-Rspamd-Queue-Id: 4SmpCc1DW9z4FLY X-Spamd-Bar: -- Hi, Did you consider trying 'fsck_ffs -B -E' on a toy system? From a glance at the code, these flags are not exclusive and should do what you expect. If that works, then you also have the option of not turning on trim on the FS and instead periodically doing it at once, like you can do on ZFS. Regards. -- Olivier Certner From nobody Fri Dec 8 11:04:25 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmpDp3bXFz53nnk for ; Fri, 8 Dec 2023 11:04:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmpDp1P5Qz4Fws for ; Fri, 8 Dec 2023 11:04:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702033466; a=rsa-sha256; cv=none; b=AglNdqMpA37ND0bJ+t7bk5tSNOkJ5Cdy+Ivm86clzdjCXdLPQxYN68iXLqbYHZ3njxqCkR t/a03lEkAZd+OWbauf1lBThGncJCAqbmLjE/7qtI+pPYkr36EEb+qcR23936qc45CyeMZs SNIj3xPQYJfeWmmb5m65XMRM7W0hTxZ5FmWZ36je73EN51VvYbFjSvvcEngGUji+HKhdlo JGuo4hwpy+vp+XvMqp28+2OarmCDc/ym2BVV3VqUQIS233+sHT8PaAaFpAr9qXGp/rdPyn 35PBY/AsAow2jPa3LhB8ExVDjFtIq33+WE/RUBwBHW+0kFc+4cugPFrrGIZJgg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702033466; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=A6ERq/5/mnu5FSXljKcEt9r/le1Xdke4Xxl8nut6GUc=; b=aTxO7yosV2I4Ro3GulaLL4LG1Jr60ov4naBldq30koyYfZz6JtJCzNlmBsQQuJD9/foPal DCKGNNxZvnzDpMtOX51//JJBuDzzoOKoYUWDjIE8j0wof2kCZhLxREjmgej/5UgKcwTeSb 1GMWbwjDQapVGCXECLsPMgxE2qq7YvQjCTT7o5uPkoCXsaRFbeQLyKn5TTdaTD4nt4OP7z 7gPjhhmzVE1T2dxxYO4kpn01cNy6Xk+AcXoExv4TWfMej4gEe/tY84YGta12xmcoake9PK BwFwpvSSQAaIxmau5T+/QUb10cfzo04Ez/DHq0YDEJ2dz9WKeCWEIyWTBcSmCw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4SmpDp0V6Gz3M6 for ; Fri, 8 Dec 2023 11:04:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B8B4QPZ064128 for ; Fri, 8 Dec 2023 11:04:26 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B8B4QBt064127 for fs@FreeBSD.org; Fri, 8 Dec 2023 11:04:26 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 08 Dec 2023 11:04:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: seigo.tanimura@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #7 from Seigo Tanimura --- (In reply to Seigo Tanimura from comment #6) Update: 1:25:00 since the build start, building lang/gcc12 and lang/rust. vfs.vnode.stats.count is ~1.4M. arc_prune tends to stick at about 20 - 25%= of the CPU with the occasional drops. The ARC memory is stable at ~4.6GB. The average vnode number requested for the reclaim by ZFS has exceeded 100K. I understand that the files generated by the builds exceed the upper limit = of the ARC memory. Arc_prune hence has to run continuously, though the interv= al avoids the starvation upon vnode_list_mtx. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Fri Dec 8 14:13:07 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmtQn4hhsz542kr for ; Fri, 8 Dec 2023 14:13:21 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Received: from mail-ej1-x631.google.com (mail-ej1-x631.google.com [IPv6:2a00:1450:4864:20::631]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmtQn0yRSz4Z1Q for ; Fri, 8 Dec 2023 14:13:21 +0000 (UTC) (envelope-from wlosh@bsdimp.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-ej1-x631.google.com with SMTP id a640c23a62f3a-a196f84d217so254946366b.3 for ; Fri, 08 Dec 2023 06:13:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdimp-com.20230601.gappssmtp.com; s=20230601; t=1702044799; x=1702649599; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=/RSC1kl9eTA8hPITJXV+FPANxbc2f4NoV/yRJ/3ama0=; b=GGSejR4iT/3WqhjELpHHyyw9W2EvQ3aQnnohDOcjzf/bbPPrL9zeiEsJkSywqkAtLu cxI3oG+/jk0GJ/MQwx2b2UG/ZoA5aCjhXpYBxWLScF9ZyK9mPgFMhjUnwM6NZ4J/UZ+3 Kqvk3NVetelEyo1VhuypiIut2mnRlxpz0XJCtvrzjrnj6gBipqGKd9zl42wXO1+F26na 4FgCb63NVVCpyW9zujUPx5fozXDk7njQWXrAgyaDxa/A1p2unPYmKHqQErAdBXv1rhML 1QYN9460iu4N6+JHEzQn2Z8D9KVIThI3L7MZvSLf20gf9/G1Bt1ntcdozX7SnzpOHLso epIQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1702044799; x=1702649599; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=/RSC1kl9eTA8hPITJXV+FPANxbc2f4NoV/yRJ/3ama0=; b=s1RZp6t+p8hWFjjp6gBTGIopkw//71s473h/6hhFo391P4JvNjBp4bfOt0k2EYKGUy p248DhdTB+NwKl7/3vqz4h5KXSxu3ZeSfhSY2qBO9P41DzfgCZ7ISd81v3JkRnLFO1zz 9ih/CohttsEA5KcqwI3uXvYTa1tItwCn3DIlLLbQoiGt4ILW51I8RzapQiF8mF7sQ4fu MD0XnpIFuJ/OAzHE4eddxbvGmB4/vSY/wf45RWp4Cvc05wfbELFzoYzSI0/dXaE2NE4R DrpHJurtKw62wPiALl4ko2CXXE26jvvNnpEwIOxc+w4GyTSMMxzXaAsF2Pu6klAUWCW5 PsUQ== X-Gm-Message-State: AOJu0Yzn4PH1qSjgaOGPnIDrN3gvn3w6jEu++WKwPGQjNnGtHIawmM+A uJqLnNjCAM5x/VBbpLkTLd1IcBUNcWuj2rUa8dZFKA== X-Google-Smtp-Source: AGHT+IFei6SZ4OHcP/jqV7AhGTJM1VccCvt5onwfIzSK6QREEgGLL6zJghOuvcd3X/vFceoXDjU7pb1ijOxhuvCS2zQ= X-Received: by 2002:a17:907:cb28:b0:a19:a1ba:8cd8 with SMTP id um40-20020a170907cb2800b00a19a1ba8cd8mr18563ejc.118.1702044799234; Fri, 08 Dec 2023 06:13:19 -0800 (PST) List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 References: <2959153.slGk94SIus@ravel> In-Reply-To: <2959153.slGk94SIus@ravel> From: Warner Losh Date: Fri, 8 Dec 2023 07:13:07 -0700 Message-ID: Subject: Re: periodic trim for ufs2 ssds To: Olivier Certner Cc: FreeBSD FS Content-Type: multipart/alternative; boundary="000000000000a68690060c002fa2" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4SmtQn0yRSz4Z1Q --000000000000a68690060c002fa2 Content-Type: text/plain; charset="UTF-8" On Fri, Dec 8, 2023, 4:03 AM Olivier Certner wrote: > Hi, > > Did you consider trying 'fsck_ffs -B -E' on a toy system? From a glance > at the code, these flags are not exclusive and should do what you expect. > I wouldn't expect that to work... If that works, then you also have the option of not turning on trim on the > FS and instead periodically doing it at once, like you can do on ZFS. > I'd go the other way. I'd turn trim on for UFS and monitor the system under load. Newer drives I've evaluated have much better pathological behavior than the drives of a few years ago... there's a lot of left over fud about how it's always terrible... Warner Regards. > > -- > Olivier Certner > > > > --000000000000a68690060c002fa2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


On Fri, Dec 8, 2023, 4:03 AM Olivier Certner <olivier.freebsd@free.fr> wrote= :
Hi,

Did you consider trying 'fsck_ffs -B -E' on a toy system?=C2=A0 Fro= m a glance at the code, these flags are not exclusive and should do what yo= u expect.


I wouldn't expect that to work...=

If that works, then you also have the option of not turning on trim on the = FS and instead periodically doing it at once, like you can do on ZFS.

I'= d go the other way. I'd turn trim on for UFS and monitor the system und= er load. Newer drives I've evaluated have much better pathological beha= vior than the drives of a few years ago... there's a lot of left over f= ud about how it's always terrible...

<= div dir=3D"auto">Warner

=
Regards.

--
Olivier Certner



--000000000000a68690060c002fa2-- From nobody Fri Dec 8 14:55:08 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SmvM50mg6z545H9 for ; Fri, 8 Dec 2023 14:55:13 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Received: from smtp2-g21.free.fr (smtp2-g21.free.fr [IPv6:2a01:e0c:1:1599::11]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SmvM45by5z4cn8 for ; Fri, 8 Dec 2023 14:55:12 +0000 (UTC) (envelope-from olivier.freebsd@free.fr) Authentication-Results: mx1.freebsd.org; none Received: from ravel.localnet (unknown [90.118.140.172]) (Authenticated sender: olivier.freebsd@free.fr) by smtp2-g21.free.fr (Postfix) with ESMTPSA id 09B7420039C; Fri, 8 Dec 2023 15:55:08 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=free.fr; s=smtp-20201208; t=1702047310; bh=hbMu1qk/fAo0BA1FhmOYW9ZoueqYtoHQbDypfwycxAE=; h=From:To:Cc:Subject:Date:In-Reply-To:References:From; b=FiQxQSzbGfKyGk9OYpS/xPyAEno+XGu60NVWrcs73fsdPomlxAZ+JE1MTS1wzlAO7 v9PXP4GwlGawkmMdPYHXoaJxiUL/105NUKnrnm1o0VobMaEjuBLJfdoBT/7ukRbmho K5bvZDevqNSIHzIOgpcX/eN/4RsOB5gp95edFKCSCBLpJTugAAmayFxov2+p6W9LIn Rlt3c+amlvtungZUlq6ntklV9YMw7DLWXg+wBbAbnRMfSemNF86RzfMY+GewavYwKG KCd09HHFPNyK/Dkhb8ehIYMGHCqEuo6NCNrPJTouxQFF0j6Aty2OOHeRKZG2oDJ2Xs 3qaj358vhX9mQ== From: Olivier Certner To: Warner Losh Cc: FreeBSD FS Subject: Re: periodic trim for ufs2 ssds Date: Fri, 08 Dec 2023 15:55:08 +0100 Message-ID: <85152060.0ko45tJjV3@ravel> In-Reply-To: References: <2959153.slGk94SIus@ravel> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="UTF-8" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12322, ipnet:2a01:e00::/26, country:FR] X-Spamd-Bar: ---- X-Rspamd-Queue-Id: 4SmvM45by5z4cn8 > I wouldn't expect that to work... Indeed, it can't possibly work if fsck cannot know the inflight block allocations, which I don't think it can know. So I'd say instead that, if 'fsck_ffs -B -E' doesn't spit out an error, then it's probably a bug... > I'd go the other way. I'd turn trim on for UFS and monitor the system under > load. Newer drives I've evaluated have much better pathological behavior > than the drives of a few years ago... there's a lot of left over fud about > how it's always terrible... Personally, I've never bothered and have always turned trimming on on UFS, without practical problems. Regards. -- Olivier Certner From nobody Fri Dec 8 17:47:28 2023 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Smz9s0WPTz536xG for ; Fri, 8 Dec 2023 17:47:29 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Smz9r5lQPz3Wl6 for ; Fri, 8 Dec 2023 17:47:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1702057648; a=rsa-sha256; cv=none; b=eEoHeupySW6z4Fbqm0gzjLHzjMDYhpaCCRMEnE/X12O0RpCY0+uXrZ210B994s7RzBpBkn XzU33UdU4KGOscctxllEUHLq8vYXZBZLtnvmFGzVtn0oQ5JW+Hs1GHLgD/af2maKm6EAJj +TWCPhCnP4aggLG6FSJ8OWxK7SWYZ3vQo8TpbqH76p16HlUO8AttipC0RhtYYDZ+BiAH63 xqZjvqyYah+tfJcE66NuRWKM/FfeyUOKpRsH1VJ7dYecS67vqbGoBpvIlxOsrh1BSs3Tjg HAvCiztr8UnZ+ITdi/xV4yz+WAylyxDKj+XQXNZlChSEtbZa0m3wG8xx5wO6kQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1702057648; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=bbqSnlK9LCqoUovvboZep8hKjqZPNYGeGJssheNRN/c=; b=mBfXKg2PtOBvwa0SO2XjcQGFskx3BRk4ujw/WwXmQJQ8prhP+Cuvf4X+rCPSfvp2hK6HBj j7nf86CqBn+4J80wuGZK00+ddzMpoSA2CTuB9Hvzlh0cuHTEUkBkzqTF4FWQ9/rblcB/dC 9PFQfa7jH2uAIUlKPLmdpf12eiS83ibTGShYzbURF52xBhwQlDRyicuj+TFi3llcYhy+8K BFxzdBUMmvoMKUDg6uTPqxc5PN6+dlFPJO+sJ2ZWhchN1adMjZctAhy3h5wOBlbtWo467I K3QiUUlzyUq1LUbEsWKASdgGI4zbHl7xhSp4O01k86Z3pgaBt7Wbl2/Z+Iw95g== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Smz9r4nnMzWMg for ; Fri, 8 Dec 2023 17:47:28 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 3B8HlS0e094045 for ; Fri, 8 Dec 2023 17:47:28 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 3B8HlSup094044 for fs@FreeBSD.org; Fri, 8 Dec 2023 17:47:28 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 08 Dec 2023 17:47:28 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: seigo.tanimura@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #8 from Seigo Tanimura --- (In reply to Seigo Tanimura from comment #7) Done. Build time: 07:14:10 (295 pkgs / hr) ARC memory size: ~5.8GB just when the final build finished, ~4.0 GB after cleaning up all of the poudriere builders. The final performance was rather like the case of vfs.vnode.vnlru.max_free_per_call=3D10000. arc_prune kept the CPU usage of= 20 - 40% after the build of lang/gcc12 until the end. Inside the ARC memory, "Other" of top(1) recorded ~2.0GB just when the final build finished. This value is the sum of: - kstat.zfs.misc.arcstats.bonus_size - kstat.zfs.misc.arcstats.dnode_size - kstat.zfs.misc.arcstats.dbuf_size Maybe I have work out the way to track them... --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Dec 9 02:19:51 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SnBYL62qrz53q5v for ; Sat, 9 Dec 2023 02:20:06 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-25.consmr.mail.gq1.yahoo.com (sonic311-25.consmr.mail.gq1.yahoo.com [98.137.65.206]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4SnBYK5FTrz3T8N for ; Sat, 9 Dec 2023 02:20:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=dMdekeZ+; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.206 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1702088404; bh=PlEL0IudgolPR6RzIndNCsjkr3jvock2HFn9lGQJsEk=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=dMdekeZ+AEJS4hf0T1D2D0EVYvxljHXXzEwZ+u3b+5uCQLoTzJzYWLMPj0zPjyfzDjPbi86WFwB3pRBNX5cvDq4/CTjDVJCOuZLgY2LJLov67VUZ2HQ6FZg99s6U/JyExBdEho9NEbeumN4NEvLl/3ZExyO0m51+lqBNr51iNFTxlinBkNf9AUYA587x+HBA6KUXDC/bXG6bV/p0lE9yF0vYBfdfqvkToRsV2DwyN0QBnRN/c6wWq5tFnmQ/vYzVHKxJnt38pxl4ST2wd2y+KMWsXbhNc3fquq8NSBxSpmAIu4Grkjj0R/DOqg2S4L+cp9tPp/7u1JPWy89wWJkDmg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1702088404; bh=sMl1NOzMH6jEs8ihdR2/zQOvzHhWFDUzna8kj7nazpM=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=JoMQ0khWAnOFfPs9Bz1TJ3M9ed/XO226NLMErXouzNRdqKzVXK65FQt3fV6HBUqwtdZp0JjaRgGiOHT5w4CC0he05bPQ1jAFJVj40nD7T8hiNk3mzRYq1E87+BF00didDOdsB/iax/BzuR2zD1eHyBG/TDbgNsQ3T99i7LDP957XLcqISvXH8MyyJCVrEx/8ex09wlvtatpiQVM/1gDL1/TZx/8otUarbKaquEsIbuS7I7/HjmxAChVi14TBjKYYabGmDp5FpdglHiEvyenlXBsMo5rzcQmMSUHcQEwWt2IrrVuFXX+TU8vvllZTxMHAkiaCH++x9pR5vg5Yj2hutQ== X-YMail-OSG: nw9lYgkVM1nqlz2pewhEP6xbBNXdjBGVutsFRvpZMtOU5mw7B34MsV0deVDO12P QBmy4J7.abcE8C4r.nnQAocFsq3xw7nBIbgmJL75tLdQJ7oGAMOlwJgxP0BXLd74F8A1pkKXQL4S Fp07dYSS8JV2FwMErwsMaqAoVw6tV99k4FWO49gAQ8u_CH1tApxr3yQ2tA6Z.jb_43hBMjJsl5SW JgAK720XaDe2QqZ5CD3WqWaP0_htbChfkwC4Lwo2uCzy15B1sKVSR6oVya_bSXxJtT58Ku9Tzu4K AXmkCB7HBv2ZttufWAGjId.3k4nGJeYfkKKhqDioPYQaHinryQ4H2n.LMKpB4CN2uLJr6w_AqRNW gLrvPkuxlonLggL0Ou22hH8NjboQ1MLQsi19nvS5plO57xo0oq8Bdi3iYCkyMHav1bz2QxKKkPK7 VzVLPG6ps.Y4oNb9Vfvs2l9DDD4KWVc.quc.FwXnM7AnGjjLo0p21mlmyfOvRQvuhJ82Mr7x1mxT oTzP7PsNok5cRazWkAonmfEMeE9ycRqn9omGsOB5BM9uqN4OTLoUW.NFNW8KE.aRMTcC.yHXrnfb e8IYoPYV1v.gl9k2NXhSGnPyeDl.eZ25GKQrWpr0.LiHcxST7VOlgL.4B7R_2d4rWKK1XVpd0ssL d_rXnUIsEAfgqlnro8RUIsnnFthETudtr9KkNBIw_.SrCvA.KPQnOzFjuCY0u0FXs_LSJdI0CfYr nnoYOxedBOANR1yeWwuzxDvzyXJlomwKJzYVOJyCxms_xIsipDhH2xQEYM.ffI0h7Dp5YULHaw44 KBiio.pzdST4UbE0XDEevB_S7grF0eMil2uMG3hYpIQnhk.TCsRGcBYLlBcGc.urnTpBxWVhU6T. tBFx4jPSi2pe5bjb0oAbQzx2EvAFArgCgUTHkMwtgyq5NN6Ux550z2G_0C6A5K3c.EnDGNvhSpQd 1uIHPyUQRHdgW.Ow.J4UdfKfsa3orlHxfD5XHItoCCVnf52Tg4IfoYMZ_pLH3LOBKMAr_VRSicFa o.VLpgElYmxmEitUXJ.bfue7JWqC8Me72fmr0OKtTv7X4.gOpv7wamN6j3zguvZHE7XtwY8Kk1cL _Kp.7XagKqy1Qs_j8cwtzoKdbWBaeLYvMCjV31dB92exL7E7f1nYJDXnPZ_O33jOXi_muXzZfsAa LVEUoHnLczSBfBJnq3Q4T64mc04mLWec2cOfUqlRFHJaUoQunH97w4hqRBEMQMCDNzEkm0kuSfzz 1iBvzvpC4_wTeVwxGlQFMzlGZzIhNyvfCEA3EmBGRFACMb1tmx0JRFE8RQaLcoyEyurLj8bwf.Xn 5OQSl8xUpuG3nuzTmUM3RZw5uEqS_iouTHt9bUz0ukXwMTz3R.CgIxc3yGmu9wAZAJfCeM6Jd2yz ZjS3XXjxIx31oWkdWCh1X1GS4vMeXNPggFeavhkBWZCn2FwSVEbysNYaXkqIwaqE8RRrPiAApsAS LAdzkdztGhGKaVGO9Rfet.jwzufkU_kgnX_lGeD6sMQ7nbof__OGfqm5VEX5iGVedi4lRu6u.5xo ph_axHI3mbTpMPCChNnxWN0jRNaVv23xNaO3uUk8ZUtzg7vnnI9u6K6ABJifQnNJjTIZUFbh03AI uXVms4WfBO_t.llZbmwkRnfo0saA_AVyqNux9TOKXna_LYNREtssUH0DhAKxrSfNSaJjruH.oX0C xvzF4VV9hG3ZYXChvHNVjYn_OWkvFBrLE6etDrx9gbc_KYgjwoYfLB5QLPWU5fmOEWlzeeQLTa7q JCJtanV4T_mQlES4PNKr9CEPuhbHoE.8p0qmXF3kZ3CET9huXMrwjQsr05m2WSdURvM2gWf4H73l fdogDgPCGq_NLlViWUb9Ogc9tmROra0X1rN2k53IscxCIids0jr0ByZgQVw5ASL73EbkMKFQ9WjF 3u5PhokXBpuEFPye2vu6ZhwQO8Dkx9CG.RLHzVlRIhBT5A8yzpycpyseMEB7aq4UPgjbXViL13LK wVBkEKEu_Bfq3zJN4TOptcsgDsxUe1hlzJDCaLhIuK6kPdMdu4AsHh6tscRS191Z7RSTcfk1m7pk Sj4S0PVgAwf5scyrxixjV57Jx1jVmRqcmKFr7bfPB9bBx4uLX4Ghjzh1bcTtWNfYjPuibOx.JKin d1TY7rYLKvghIyu1RUfUBEYti3DfRCu0yOThM3_oYi4Kf4ZYBXuFwHnaWPThDOuXyXWQm0oyx1PW QBqLaDHJq__DW3RGjrqkgaBoiPu3NRLkBjdbNuLRfIZsG.2GO.0oQ3CTl9czcA7u6LRd5g9wpauN 6WQ-- X-Sonic-MF: X-Sonic-ID: 0523d794-c601-49a5-b4d9-87de304c231b Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sat, 9 Dec 2023 02:20:04 +0000 Received: by hermes--production-gq1-64499dfdcc-zpkjd (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID d1b982e492ff8297652d17f4e8e3e20c; Sat, 09 Dec 2023 02:20:01 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.200.91.1.1\)) Subject: Re: periodic trim for ufs2 ssds Message-Id: Date: Fri, 8 Dec 2023 18:19:51 -0800 To: olivier.freebsd@free.fr, freebsd-fs@freebsd.org X-Mailer: Apple Mail (2.3774.200.91.1.1) References: X-Spamd-Result: default: False [-3.43 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.93)[-0.925]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MLMMJ_DEST(0.00)[freebsd-fs@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.206:from]; MID_RHS_MATCH_FROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.206:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_NONE(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCPT_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_TO(0.00)[free.fr,freebsd.org]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4SnBYK5FTrz3T8N X-Spamd-Bar: --- Warner Losh wrote on Date: Fri, 08 Dec 2023 14:13:07 UTC : > On Fri, Dec 8, 2023, 4:03 AM Olivier Certner > wrote: > > > Hi, > > > > Did you consider trying 'fsck_ffs -B -E' on a toy system? From a glance > > at the code, these flags are not exclusive and should do what you expect. > > > > > I wouldn't expect that to work... > > If that works, then you also have the option of not turning on trim on the > > FS and instead periodically doing it at once, like you can do on ZFS. > > > > I'd go the other way. I'd turn trim on for UFS and monitor the system under > load. Newer drives I've evaluated have much better pathological behavior > than the drives of a few years ago... there's a lot of left over fud about > how it's always terrible... Also, possibly try use of: # sysctl -d vfs.ffs.dotrimcons vfs.ffs.dotrimcons: enable BIO_DELETE / TRIM consolidation possibly via loader.conf : # grep trim /boot/loader.conf vfs.ffs.dotrimcons=1 One can sometimes use: # gstat -spod for monitoring alternatives and get an idea if on-the-fly trim is rate limiting activity compared to not having it enabled. === Mark Millard marklmi at yahoo.com