From nobody Fri Mar 22 18:36:48 2024 X-Original-To: fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4V1WJL4qltz5F3Vw for ; Fri, 22 Mar 2024 18:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4V1WJL3ns4z4r5j for ; Fri, 22 Mar 2024 18:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1711132610; a=rsa-sha256; cv=none; b=OuIO6rUZ4LLLHHjYxR0tta9I0eyULOSR3qcANX+9+T9hVg/EYurmiUOwPNHWkMGLrryFDY 30CIlDmVj6WNOgV4luRArZ0OeAnkZuVtwfd4XC4JLRXFybZJcYMDBPB34D6dgrPiA0ORQI XtiQv3n84N2j3a9/UOV4wju88zGagUAKTB52pIdJzr+tTbBw2zwJZ878c2eDBww0fIZgUl bqV6Bf8yeA9seYq/rmCpcz85nmBmAjzNUP/i66VXP/JOivhF4TShyIIKR9gsjkM4+zQAw2 JJw0m+v9zGYkzHDgxhVKNLkKq249M8xo4NjaqnUK05AlJ8qQ7M7cn3IMaxY6iQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1711132610; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=cbFJ7yD0hRhf9jPrpQI/qZDQraTj63yB5YeNRQp0fY8=; b=HAidNPkS8J/pXRyZeQnrBl0JRT0LzDrXTtPbVtCt+I7wysHEcbS/IksrXyyCZRVbmNzoS0 F8qcqXYjr+7Cn3djLYVp5rp0gKFAaNlF0gAy9Y5jo5JzLw/c7LXordQxVwfMmIPpWgGKdH lXXFBm5QDtQEebJikPwzB1Jas86QwIo2Gco+XhzT1j+3bBViIVHbMQvOlu8ljAJlk9i/cR 1RFhwZlRsFzcIiv1bMJyKCXSfuwWfYfPDsogu1FjhtnSWPfhHbf4aZ0nYpmbKPgGVp6K9w +fAU1ZhrCy9fzUwdIYfvIEXLwsvD+OESYJ7cxz1vF0QAIOg2TGw/L0OqoU7xDQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4V1WJL3LQfzDsV for ; Fri, 22 Mar 2024 18:36:50 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 42MIaog5079576 for ; Fri, 22 Mar 2024 18:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 42MIao9G079575 for fs@FreeBSD.org; Fri, 22 Mar 2024 18:36:50 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: fs@FreeBSD.org Subject: [Bug 275594] High CPU usage by arc_prune; analysis and fix Date: Fri, 22 Mar 2024 18:36:48 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: mfburdett@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: fs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D275594 --- Comment #95 from mark burdett --- After upgrading to 13.3, what I saw, on hardware that occasionally has spik= es of memory usage and is using zfs swap (I know, it's not really recommended = to use swap at all, much less zfs swap :) was that a process would be killed d= ue to slow memory allocation: (mysqld), jid 0, uid 88, was killed: a thread wa= ited too long to allocate a page At this point, mysqld is automatically restarted with much lower memory usa= ge, and thus no need to swap or arc prune, and the problem was temporarily solv= ed.=20 This happened before I had a chance to look at specific parameters, like CPU usage, but I am assuming it might be related to this issue. For more peace= of mind, I made various changes to avoid unexpected high memory usage on this system, and things have been stable. --=20 You are receiving this mail because: You are the assignee for the bug.=