From nobody Thu Feb 29 16:02:42 2024 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Tlwx02Hs0z5CR7M for ; Thu, 29 Feb 2024 16:03:00 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-19.consmr.mail.gq1.yahoo.com (sonic313-19.consmr.mail.gq1.yahoo.com [98.137.65.82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Tlwwz2yxZz4sVh for ; Thu, 29 Feb 2024 16:02:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=XzivtZN6; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.82 as permitted sender) smtp.mailfrom=marklmi@yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1709222575; bh=pcitlcnWOabPzg+WzS1XzMWnfLbV4lDj1xvwUifkkpc=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=XzivtZN6sE+0uUxu6v+NECdVHbwqfqGzmXgQu/J9B6hWlnW0XvRy8XPZ5gInbwlIT7DYjUcdkhQ8QMr3m5PuNOE9okkrqRO4HPdmUiR09ci7hqrVNGRYOCsXErbPNNikYnGYrRS7TnCWuvaokK5mxhswBsSlMx5cnXQZmmPtV2H6KD8hGdbwdrAc8TtFr/V1znMlr0eayY4PE7aZXGx07KOS0CP5W5BAji7UF8sVHX+oLYCza3mGxHwztkPc/wGdY9ReqboURQaBA/EvYjW4V+CaVAnSaV7ZFc1lNVwWwn7jfU+p7vSauIXjrdMPZsMUX7qo/SZm79PcKuggBYKFfw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1709222575; bh=rFnEULDbIP1+MreXgodn5ai/GwN7hpHgy2CLt93pLjz=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=Zsqb3MgNab8Bpf2oXgn0tj7tZyDpQvdJvBI2uwuE5EaVp/pkZ8viNWUV+QrwhXBw9pBM/wTodJ0dMyVsPrrcz3Pyq4NpRRQZT6VgNQ+4vGNDO8Ayux7/cVxwJGcDIeQTjIV0rsA7/uwqi9PjmHc4bXT9+k3oOK792oGfupdjI8PfaCQLJyBD6oVPRJ7yvTEAoawIkeOrbVsIaSTrVksU7lUfSYo3oUoEk3eSfZNo1PSf3VC/RkvKQ1MjtDIdWnbyn8pj0oEp1xDdqCB1WRAlMUlwl4qshM8+crEsReeCgRPSNVRNyfKpc4ifBJuFqv+kd0RomBF8P9TuE5rWPl/avA== X-YMail-OSG: iKbbwCEVM1mRHJFDoC0Ps51Y.V1zX72_wT_VmDOGB98niSXl2xz3VFyT7oHZYQA 0wpxlMxiy0OdfJRbL25cqyIxssZzU6kMKmEUys8mGbIEWbdTL4VNjGqhYwLS_hc6jNJBRQrMq_qi vooY.b_8R2XkqWr4T6PF6KySmQcbWvzJeQVJ9Ho5iXGAmQ_d7vhB.mvf5qgGoFT2aXsD5ZFZySG4 ybWksdd5bsJ4OiyYhBQiHuiFezhIRCHHUg.UJ43.w_HChqtjmy2GIJk6DkrYtYICU2MyyZNpWNsH l0LbyQWxdW0FYgZFBjbIlAcDGDj7BJqL0D6Dv35ALoR.ilPtySjmoAD4fyMY1.shGKQUoAzneIAO NkVA7xv_58jj99LpzMXd9xzHO9ex6dm5McyVnFfCqZMTS.VzY.HA5LUTB881GaETpKBjVLflF3Gh 1kcsWcwrPtDNqH9AdgdFtNii3IPYJGzZbW16DLtiSQHHOgc2wv31_56fxBolO_RHmZDS7duO_.qf 6sfaUpJ3t39lwlXAS3vIuc4kcde8xketiJG8Z.f4HVFtz7mdZIEAUQXLqr3KI2znWCUNOB46JEN7 sy4YW.oHihRG2FNNluWXrGHzGoIwu_O1CkY1SXDuV7L_Jk63ol0qWNtABcmWi5WpGpof_8xlIyk8 j2.Qvlunv9lDkxnzrhL0Uhfb4ePb2r93zFhFUZbg7atUFX3gISfff_fuijlNUTN4MrfKlL6Mk3.I eHHXLjxvyMtkeGPJvs4srPbnDxX32d7j5pZjRcthFPaZZcoWJu6Bao4kPH8GrhvD8sGCHoYQWuIA 9WId1.WtBWpkvb2sCogXfT1QO2d5jbI0LTQvBFHUggouUut3nBsM1hmBvftWQPhSFX_CNUljLUWc KzSOqSNsTv_4XdjzpVpHGmMEkdYGYTSE_VlLn02xI5aB4fhOFGA.08q.mNeHoZ_qZCK_WUWujuFW zUYZx5z0r5j0d4pTxlcyhwGXQZDCWsj_cr.Gs1I7HfWSAmDbEUNSsI4ofC6K4fftVUwIHvmRyHom _35J0kX2SYEDGTGBEOYTUNSXlFu2cJhU0GM9JzMqZSHOA3U3mc3oiZZDQfhTGA0.N1iIcTRxd8PF 0MNtrAG_sX9kWCXAGHXu80cP5hDr4QWK7rUo0GBr3zmSLPL4MB.ovn9F4t0zJ_Zlv1.3.D_kyksV eaZLYNydCd_d51CtNm.vey4VN8tgGAeIc5dhzMLPE5W2HfnPnlUcO0IvuLnCWmqmpf9riD8dtpg1 QupDHxy1g1OoRbyKqCEvPf6j0LX.Azxe.tljCm8FouV_YJ8aS7KsoaxcXM5plwyEknZ48I2OwMtV mddZ1sA03Rs6Bf1oNkB.kkewxd1fO91zbCAmrtRS0KuWw_nt3l.aE0kYXrY3Z3Y.LZfkxLMKsQOi cuXDKQ4IG7uEUS9xmWMpeVE7MV5Lwdo2eduSeCOny72pNrMSmvTBJmoVJiPEdGNZVbN6dax.HoQw vHWI.zNyG5YSarRelxWE9DxEWjTg7kKd1nCAFjrRrcfeLUZII3pzNcsGi5KCL7zZ.MVFr.Jce3jS Ul3zj1j9yxub4pDFYxHWj7ihliVGpk1RvXgT0ntY3aNdbS1ugY8Uc83j61XgY5gDpf1WSkNhu8Uh IsJ77wPCmmS_eRo0VuqmE7CePzNn4a4IEcGooFOx1JaIxkWArwn0zNznzCcOTC_30y8cMLXxu0jY q9HWWKe7s0a2sHpeY7aYATlY3q5FTCXWroMitHS5e5oN4eHnHmbWmA4eaSNX3VGIvvWBTxKcW5zs XHf1QICLnJxaYu44bZG99eQYZoStSboZ_BcKdCmsKmtnoNLpNbNLo4YzMshQCRsJUkWny.PIEhF0 .84f2iYaaYo.k_TwjCSlgdFzNfPhpOV9WnD4RNtBXqptOMvf2U.wg1d.reDXi.dh7LmWiM_BiCWI I6wOjH1gq4V35vCroeUrSUyupz63STJiMLfvWQZ7R6lANFEzTyIHfgyhWjzbQgCHXFkRcU0riAwX ROoLniK6dCzkT0OVx_whaHCEJSkLwaZXSgkfgf6uCzYFwq_8ExJ5eeB2rpJ83SJUNARERpUa18TA wY4WmdtMT4BAzRRu.wF5y_HdNdPVZRjkvFUDzxAcxDkfiGcqcYF0_judxNiTO5tzt_M71ACg51v6 zyHJZUibNZGiQcJ1vjw1vh1mR8ujkzbrVlKUpIOwBO7Q2QwYn5OOuN3QL2sz7FqCfyifESEjR09N 92MYhn.NFL0yB8uTX4CkK1MQGcaTtEi70Atn9UIOdLhl2izZlYJzDzsrSsagB.ooMMKAmFpWMApf rWOJLYQ-- X-Sonic-MF: X-Sonic-ID: 63b3f007-7d3c-459d-858c-c2605ba7a7e1 Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Thu, 29 Feb 2024 16:02:55 +0000 Received: by hermes--production-gq1-5c57879fdf-vxz7c (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 18d7993375fc4c9e88db11713d51fd9b; Thu, 29 Feb 2024 16:02:54 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.400.31\)) Subject: Re: 13-STABLE high idprio load gives poor responsiveness and excessive CPU time per task Message-Id: <426089C7-A15C-4B04-BC47-D1F77089C492@yahoo.com> Date: Thu, 29 Feb 2024 08:02:42 -0800 Cc: "Edward Sanford Sutton, III" To: Peter , FreeBSD-STABLE Mailing List X-Mailer: Apple Mail (2.3774.400.31) References: <426089C7-A15C-4B04-BC47-D1F77089C492.ref@yahoo.com> X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.994]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_CC(0.00)[hotmail.com]; TO_DN_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; DKIM_TRACE(0.00)[yahoo.com:+]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; MLMMJ_DEST(0.00)[freebsd-stable@freebsd.org]; APPLE_MAILER_COMMON(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.82:from]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.82:from] X-Rspamd-Queue-Id: 4Tlwwz2yxZz4sVh Peter 'PMc' Much wrote on Date: Thu, 29 Feb 2024 13:40:05 UTC : > On 2024-02-27, Edward Sanford Sutton, III wrote: > > More recently looked and see top showing threads+system processes > > shows I have one core getting 100% cpu for kernel{arc_prune} which has > > 21.2 hours over a 2 hour 23 minute uptime. > > Ack. > > > I started looking to see if > > https://www.freebsd.org/security/advisories/FreeBSD-EN-23:18.openzfs.asc > > was available as a fix for 13 but it is not (and doesn't quite sound > > like it was supposed to apply to this issue). Would a kernel thread time > > at 100% cpu for only 1 core explain the system becoming unusually > > unresponsive? > > That depends. This arc_prune issue does usually go alongside with some > other kernel thread (vm-whatever) also blocking, so you have two cores > busy. How many remain? > > There is an updated patch in the PR 275594 (5 pieces), that works for > 13.3; I have it installed, and only with that I am able to build gcc12 > - otherwise the system would just OOM-crash (vm.pageout_oom_seq=5120 > does not help with this). The kernel has multiple, distinct OOM messages. Which type are you seeing? : "failed to reclaim memory" "a thread waited too long to allocate a page" "swblk or swpctrie zone exhausted" "unknown OOM reason %d" Also, but only for boot verbose: "proc %d (%s) failed to alloc page on fault, starting OOM\n" vm.pageout_oom_seq is specific to delaying just: "failed to reclaim memory" === Mark Millard marklmi at yahoo.com