From nobody Wed Aug 23 20:37:09 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RWJ1K3P1bz4rLdR for ; Wed, 23 Aug 2023 20:37:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic307-55.consmr.mail.gq1.yahoo.com (sonic307-55.consmr.mail.gq1.yahoo.com [98.137.64.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RWJ1J4zy7z3Dvs for ; Wed, 23 Aug 2023 20:37:24 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692823043; bh=KH2isnGzwYUN8xH4wwYgL4cl9PnsMcCzBQdZjJ3OCbA=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=X1P7TVG2H1Gv4Hbf58aF3LUM41jaiEuWYdWX+WQcGkdwIdOHRblBz/BbGZS2419G7yTUo89wvM3PRXlm2fFjAUN47EIlUvOa/5a9iEpyM1YtxWafVhJOti1gtMBmsVB8WLDuBWrlofQ5EsAL/j1u6NdeqZdgt5GvIx1ouhJ8HXGxcZ/CF5b0kOaa90BTJjjJNgOQioYLGUSoJOagOiaDUI+5Ida3bv4Hf110Y93fXBrgGLw3MRfRi2TXAZ/wwYvAYiprzDXIXDmD1uJnXPmFTsN6Jt3vSgVxH77MtFt/h37BXJ7QwejoPOq50xJWwEPeFWeqeUtYbVW2cibK+KRiHA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692823043; bh=iSBBJEhn6q7sD5mlU+Ox/FypCuJW1Ycznvn/naYG5ay=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=EfXorG0gRtrm58fy87fPa2HKRJ0ciCkTl1AVmltfBeU0OQx43FGDeSY3Zyk+z05X4iaKwxQdMNS6IdXTKpSx9PXgxAFr1ymemzXDoG+QNe0Mfq2ulDmp9suNQJXrMClFdh5SPnoOHRQkGaPC4m4Os6tMB0Qr88Kh6vRU7Syl8c8vKJwpurBMnwBqoy6VCbZXNaSXhcklYwlGysoUGKx+ZhIK1LHqOcNktKUOQk1ZdezIeRYz1QVXIcCnGLHf1R624Ufwt8Wn+NJIUQr6bDOsuiTXCELq7h5eR0x31auDOF582hb8E50DaQeixvHa09muNjCIo028QvTq35lAcEt5Gg== X-YMail-OSG: 22w0o3MVM1lwK4FNacEsoqWbpW0GNjKKM2dwtYLc8tVHXbtBMUv1yqNdv9ZcKY7 A5iTN_zFog6SSbqu2bkyU4d3.MWobRFOp2c06VU.DhxWrYmG53OFSgaLUYTQW..Hof3SNwpgJ7ag Q8TF.VGU9T3re1ADMap1fzltbPLrjshH1h0E26OP.aq7VnWVG4Ms19sedptFxA7O7D3DrxBoqstu wA9VrUPOWcRI0dYzZDT0XBrVaZTFSIfKx1ryIal1ZoLic7waZuq6S5m0LfeoV0bCXBZY9zBUeObJ 8FIvRIUXAf00arjMsLo4RAq9M70pbT9rrpCNyNKwTmfaWficWVyfnzuv_901flfnxgAO934sAqWt MnFiTFM2BwfeJUmdewepgqj.wLnAt4yjUxMhiepKaL7GL0Q1vK8h4EnrR4N61uYUBhlvxx_A37h9 c4JpWwBXJVKNv3EOtyyZTuB.0dMznjbt0QADHEv4BuUb27G7XaNGtuzbY7QnfL9PzI.2sDphi.sB zee.T6JJUkupGCH9rxsRIUlC32YWcMgQC5LzFuqxhJeT5OTVmNF4QnqR_NCQ4wctigaBxLSlDy5r H1fsJXcp8YrrkI3kcbaxbRArLyvsiSWhqmB7pxn.D7vC.xjfWtz.RZ8D7nxfL_9YZYMsNLszHK_h JQfiozoRfxhEeQ2JjiikL7yGtZIOsvMqZ1J66HPN8aOo_emx3F9cwL_vCGtYlyc1Qp0Lzc5aFmv9 dvsHFknX5Sx7szJlhUt8osMJvyIs_GLHCnLQilxPWiZyUcsFOYc3Iw1oCLkNhHdAerV2lHAhyEes wP7uMn61flDm7hk8dVVMte3eL0Q3mzlqvvKXck94Soo_khiUluh0ka0I0JcLeJDZe1wXMSFn2AuT u0QNHyH3HWFT1tTBU8W6u9HnI75SJiH2.egEXh0NuI4AQ89TqcEMECO7gS8P6_iPfHRauHyBUk5u rzf_Cf3GXjsUeB2RoCIkDQWCfJ5c_5fpQiCNhbC2ovkc2rzHilQB.qMlms8GS31cY9LgF3DhpEo_ LgG62N3.TecuB8x4XPAwkTukWYSEl6hnr4ySGntPjIIG4P8sqjUHgpsiCSHQpTI6obe.Ehpke8dV 1mlkNLnGkeKUPnX_lF7z2uuP6mvz2Tz8TihpLlLh8GBlqqmjqRcxPrMPtSNMu8ZuiD9s16z831cQ CJRqVp7W_lSRAzppqoJeJ8sgMhVj4qE0y9i57CmwjSAR6dHko2L0C1BqgE9nJSekzBZHTd9J5HAA itxCIeuX4TteMpcSKLNP9EuUKWrRYKQLiCfXbwt99VZ1Ts1krUmXpHLRENqBovZnCjfchwPBdNw1 7byNkFQQkp49dDgzyu6wUsqbEKwsUYgMjWKJsw8qcTP9Ezsk4NHyNNOYDrxvX3mFoehXlYy8sARP zs1BuY3MXYjOoEYVHAHHKkjYuTTTeO1sifPK2SFI83YSxvTRB2tLLvuMKrSsJ_k5BC3WHqCx5Ryk sw0fOkVEDSAri9N3TgJ6XQehlPMNUp2N9mMKRvAepN3XzqC2fCWg1FUIGPkfwIUIWDPBYcYjoLJJ ySKqyPvqpcK5qmurcgpJJQtehvcSdLQn2ltMoRB0iUJe9w31MZcYK07BFq.tnARcsXtucFojvAOC C4Owl19p_cnkfPQiJaGL4W0ziAa6XZdjNnYisreJA2Yorc0jwmEpprA2ViOcZpSddN7bUvZsr6Z0 _4WzGGGHtJ.BtLzC_r0pOa3VnquByJaaiCpWvDwObt_OD.AzpGgTdoxE.ugPsZK4AwUyhRrTSIms E4spNYuSuyy7_NkGvz8nQMq_GYIvmnO8qUkB3EjqW_E6S4LK2Vl0sXIX0QFKxU_E2xrX5KRvTARh R.GW6D8_O.Plghp1JbWBTXPateAVRDQWZYGAcRpJFM1bLWJxavM6wjrxn0HFicwy0Lpu8onrBwGm jNL3DBTBC1vvXVRDnwxQKZ1Jv7psz_PLJ6xNZsY3p024acUjIegYxrBkKWzs6tF_TxL6SIQSoC63 peAl3e5LTeGtCTWECnjjpfVWAsgz2hGggxudmWofM3UO5JXlp72Pq.vj3rF85J.BwYJgxRZPuymi RjG16W2DQ1od0s3LnorjL2QkgfjkC8Zf5oc02OQpiPnrZjJBkzHtSQeXPK5HQU57yQsgfHtBw_.8 VKFD8VrZVPA2jwZaaFcu5nWSSsRFfdFGezOxYinMkvXeNQiL2G9H_iUezmUCVpvKMbGM.cQSj5xU jLUoa846cyDaFWf04OFyCqxL.S4o.OzYQ4gg8ReHZ3r.3D4VK1GMjAcIdfYfIHONm7X5aR1QlCg- - X-Sonic-MF: X-Sonic-ID: 831ed6a1-9c1e-48b3-a86a-21223f7f34e4 Received: from sonic.gate.mail.ne1.yahoo.com by sonic307.consmr.mail.gq1.yahoo.com with HTTP; Wed, 23 Aug 2023 20:37:23 +0000 Received: by hermes--production-gq1-6b7c87dcf5-m4lb7 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 313664c8eea31570ad9db9f264ff0949; Wed, 23 Aug 2023 20:37:19 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS deadlock in 14 From: Mark Millard In-Reply-To: Date: Wed, 23 Aug 2023 13:37:09 -0700 Cc: Current FreeBSD Content-Transfer-Encoding: quoted-printable Message-Id: <1AC87B79-6B65-402B-B65F-CCFFCC503861@yahoo.com> References: <4FFAE432-21FE-4462-9162-9CC30A5D470A.ref@yahoo.com> <4FFAE432-21FE-4462-9162-9CC30A5D470A@yahoo.com> To: Alexander Motin X-Mailer: Apple Mail (2.3731.700.6) X-Rspamd-Queue-Id: 4RWJ1J4zy7z3Dvs X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] On Aug 23, 2023, at 11:40, Alexander Motin wrote: > On 22.08.2023 14:24, Mark Millard wrote: >> Alexander Motin wrote on >> Date: Tue, 22 Aug 2023 16:18:12 UTC : >>> I am waiting for final test results from George Wilson and then will >>> request quick merge of both to zfs-2.2-release branch. Unfortunately >>> there are still not many reviewers for the PR, since the code is not >>> trivial, but at least with the test reports Brian Behlendorf and = Mark >>> Maybee seem to be OK to merge the two PRs into 2.2. If somebody else >>> have tested and/or reviewed the PR, you may comment on it. >> I had written to the list that when I tried to test the system >> doing poudriere builds (initially with your patches) using >> USE_TMPFS=3Dno so that zfs had to deal with all the file I/O, I >> instead got only one builder that ended up active, the others >> never reaching "Builder started": >=20 >> Top was showing lots of "vlruwk" for the cpdup's. For example: >> . . . >> 362 0 root 40 0 27076Ki 13776Ki CPU19 19 4:23 = 0.00% cpdup -i0 -o ref 32 >> 349 0 root 53 0 27076Ki 13776Ki vlruwk 22 4:20 = 0.01% cpdup -i0 -o ref 31 >> 328 0 root 68 0 27076Ki 13804Ki vlruwk 8 4:30 = 0.01% cpdup -i0 -o ref 30 >> 304 0 root 37 0 27076Ki 13792Ki vlruwk 6 4:18 = 0.01% cpdup -i0 -o ref 29 >> 282 0 root 42 0 33220Ki 13956Ki vlruwk 8 4:33 = 0.01% cpdup -i0 -o ref 28 >> 242 0 root 56 0 27076Ki 13796Ki vlruwk 4 4:28 = 0.00% cpdup -i0 -o ref 27 >> . . . >> But those processes did show CPU?? on occasion, as well as >> *vnode less often. None of the cpdup's was stuck in >> Removing your patches did not change the behavior. >=20 > Mark, to me "vlruwk" looks like a limit on number of vnodes. I was = not deep in that area at least recently, so somebody with more = experience there could try to diagnose it. At very least it does not = look related to the ZIL issue discussed in this thread, at least with = the information provided, so I am not surprised that the mentioned = patches do not affect it. Thanks for the information. Good to know. I'll redirect this to be a = different discussion. =3D=3D=3D Mark Millard marklmi at yahoo.com