From nobody Fri Aug 18 23:03:53 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSHW31GtKz4rF3h for ; Fri, 18 Aug 2023 23:04:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-21.consmr.mail.gq1.yahoo.com (sonic305-21.consmr.mail.gq1.yahoo.com [98.137.64.84]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSHW15DTnz4lY3 for ; Fri, 18 Aug 2023 23:04:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=jcNDYR1T; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.84 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692399851; bh=azT+f4evV9xwf+4GNihp8vcHoD8JhdezvhsOvdDCs84=; h=From:Subject:Date:Cc:To:References:From:Subject:Reply-To; b=jcNDYR1TgTAB3M5NfvDOJ/J94CusKpdXK9G/uYXrtgHxn+Sx9WhPv5ljj6PCzYYFKvpDS9gELpiQh4U+irM4PFkNw0mg0jajvB+LcnpBkefthOyRveNy8iKnhw7GkxfxAnkxJbAMKS1qjbuPvsxLnEXE96cOncqFgaSxcVK7GEv9Gqw4ldXlkyw2otssu58K+99Qu7K/KH5JerTzTWBXMsGLgBQ+bazIKEbBcLFG5rJD7APOsqotXH5XJGZ0BVhYZ9DvisHE6r1cazFELKndnh3WV4/jhU3WCS1jgvuitFaeCILn9qhQYbGynkNDYYOPEgkLWkM+nDpAtfhaCFd1Vg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692399851; bh=D7P2eWMYKnKfVYKXMjO+Ovr/8t6FHe/ANA+6jiwzlDv=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=fwsCQtGLIfDBn/gT5R0SAEU56eIbqqMFP4LFgwh+S8/rnOf6N2jNUjWiFzg2KC/YIbf5xkcw0iRgHAhevXzsd7v4GCWtL7yFfBzriV4FvUZSYLfi2uZN46jpYI0WScq08eG1JnHSiMdlgk3Rcx4zbeDQu5yxpoAesvoVnoaaquogBpVYiPnqPFcwekYTPCHics9oWk1nJdfbNEYqdIfpdwgth03hrPsFSLiOY+tA+PI0/N9vOoq9Tz2gcnLAKk48HgImG14xK1aVc/6f6JVzGVR4OBkkZkPjZwPAJ632WwqnO/i+k5SR2vxA9NRM7f5QUwlJBeV6CVhkGu/HUIWzUg== X-YMail-OSG: LTtymzgVM1lSihlYVupuLFWgBFo_dROjZUvYIe7WeykYKATCd6C7pouJoVqwsGu 8S7LZuxOb31EsOlgeS7TJ3E9i8pr2hFW1I5QFMFv7mhLE60u0tjGI2SY4.AATNEwgHTFizhD9Jjk kCx9kD2ydSf._B7A_z38GdHVr1b8NWYLEFihif2Okqjz1jg4umhgJg7h8Xh9Dvte9TYF42P7_Qhl wOAP9Dqr3jdBmlMiiH_6E_gHsx7NYwmj8L_c3_8pkPG5VJ.Zwq_.UcGNUlQizfJYt6tyCBFll6.T tseW.SrU4UvxDP3OIiVY45GG1H6wl1mPWfwYI1dGmqfUMgsUcF0MZetEv4omOH6QBibKfPmqJ95e 3j3rylvFYogKZTSQGdSvZGLtEYDzKclFRJJaJtCKnVHaen_Phiit8dzvjXrjokxuUt1VwY6Tesyf YEgQKpVEzsgeWQFsHRHSVUVDbs6n93fbMd5fRQ61qWSbVS0Hqay.FGwe5LHcQ6E1jNXlL41Xh19e WYO.l4q0yD.7T4y5T3uSzmapz4IpgO5UmEx8WO9vSUGOmZQRv.KY5Ao3o0nYwGLn3bEK4yj6KoWo gh3UkjOTkA8PZ29HbxgobDocjaFtNy5KtsVTr0PWmuW5cay9xAf1_zqqiUjeepsfeniw2TTL5cPr Q7Dm7jrkYjFk2p_BSc1KIDdJlZoMZDRpAlch_QhWwWMRuzrCNXYVZTJljdZz_JlEne8grzXbfUXo wkUamzwM7AtCw3PNLvwDHzsFRtaKHyXLB4IAedSojxiZwVKcWj_mrbWFqWP78qz.CMzObdO.MGL6 VRImiRb0WhFZYHhsIko6Tn109X89qHUiFAIpqKpm470uYHL4V5tDmRaRDcVzhn0lCDpGonPpVqWo kwk1mEMVViYu.bwQw6rzwxucZJuD6RbYZtQOq0_UNUWIdLcIQzlnBuSBkzY9znML0FXduyTqvdge sNAcArnfGDR8vRmUGfmNEMAW6l6aPA6fubdjtWD2v.IYhVRGVtxM6flzkLNtpMx3n3AI4Yf4QxIF QEw15cTlUxC.6tTy223iQglBdw1iHV_DIzyQzwpjZU5NHRLyekZuBDOXqgAEocdnkVjczskuNkyG 7MV8hvE8wEEhS.xzBlNB2Loc8tUGrEaoMdbmx2TbAev3jXt8lKK.vBgN8hOryF.PPVtE2L8cgh8f igdVpWSJ_Nzrw6udmWd9MWK7HDfcojh73AGEwe2SHmSICC7u1PrKtoRMGn7o7IFfrJjrL2_we3MK GzZApIP1sqp.qmLBgIE5t5jPYS2gFAIAS.DiFQmm5znU2araNCRTj035joFDTxDbmz5rxEI3Dt07 G3OwBzt.G7SvPTc2qsbyDckUqDzr__6813l.Vl_d_DctIn9pp_1jb8Bj9b9QobdXoxryEKEkHJQ_ Gr3VJkjmeAF20_oldfAS8QZgPrBuzaE_js_.NASbJbxawixUXahbXbF_O5FctqaFBluDELMaEQvb bbuCjzQBqsQpIdhqvCAYQmOIcT0WrFKcJNvafZ6OKfWXJLzzdU2vbmonPZlyliWdnXUWEt.mYAv_ uJNnCE.1ltbCv_0z61XoP0PkmJ6BvXdSGiJBGs16js5V7R.NzMHckGEnpkwBr6_SImGr1X_ppjX5 db.v0wtp2Fti7st_GJAA1vAeIT9cQZgQQAHme9fbZkrDnbR7ivZ5WqqyvdCP_JXG7ppuo6qcneLM xlbqFqVfrXghW_XvojJKK9X13Rf5M1uviAv7b4_pfYyC3DBjSPDFEpqVYUF2mp1rWf0Ez_vXBiO_ hca1fEg8BbYWMSCcIcHCeiAGTNUVWXdu1_AyAf_NWkQyg3vOTadBoV0ZTps5S80V_X3T5GZXSqoO FZ1sMBN3Kod3ZAdA.6SCG.ojvLw3LBoduF9YncnI7JdnuapXuIPtHOSnLIzglfb1fAoVos2sevHZ wljEaTEwNiEoc.mrelpnmyYrg.id0PVPkigQ4ZfUnlLzz4AaWTY4sOKsXurbbOZVRIEx5RyTHg8r wuSbEQutRIK6S3li7UTYt0InLS_ldNtFBL09lUpCWErnNvVfPYlBL.WAYJAKxvX6TU5Ik1V_coq9 9BZMrAhXLqQjeC4dQBjQkjDSJkzqNfmuEAgIDk30LTVp5h.CcOFLl2wjPEJz6M7YWvcsj_ZMqxdc s9k7s0ql5Pdz2l1w2yd5ZTTwTK.q98NZ9ebpL4RDf0S_UyXjEtmLWfzJ52Un01.kKwyVF3ga4_qZ 0KKT.ptXOw0yKMQtKvqB50Rlc_Vjw23P2cj9Q.vooaDbRWvM1TTlSWnrJ9xayW664.uPJ9Lg9p72 zFmJaFQ-- X-Sonic-MF: X-Sonic-ID: 2acbb994-e1b8-43a1-a954-66e54631765b Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Fri, 18 Aug 2023 23:04:11 +0000 Received: by hermes--production-ne1-7b767b77cc-7tm2h (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID f1fb688c6a0f2a647cf8a45fb25b917f; Fri, 18 Aug 2023 23:04:05 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: ZFS deadlock in 14 Message-Id: <59FCB309-4A55-4924-98C4-7ACCA70FD299@yahoo.com> Date: Fri, 18 Aug 2023 16:03:53 -0700 Cc: kevin.bowling@kev009.com, Cy Schubert To: des@freebsd.org, Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <59FCB309-4A55-4924-98C4-7ACCA70FD299.ref@yahoo.com> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; RCPT_COUNT_THREE(0.00)[4]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.84:from]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; ARC_NA(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.84:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RSHW15DTnz4lY3 I believe the below quoted messages were reports of deadlocks based on after the following 2 MFV being in place in their environments: Thu, 10 Aug 2023 . . . =E2=80=A2 git: cd25b0f740f8 - main - zfs: cherry-pick fix from = openzfs Martin Matuska=20 =E2=80=A2 git: 28d2e3b5dedf - main - zfs: cherry-pick fix from = openzfs Martin Matuska Kevin Bowling wrote on Date: Fri, 11 Aug 2023 03:32:51 UTC : > Spoke too soon still seeing zfs lockups under heavy poudriere workload > after the MFVs. Regression time matches what has been reported here. > . . . > > In message > > > om> > > , Kevin Bowling writes: > > > The two MFVs on head have improved/fixed stability with poudriere = for > > > me 48 core bare metal. Cy Schubert wrote on Date: Sat, 12 Aug 2023 04:55:40 UTC : > The poudriere build machine building amd64 packages also panicked. But = with: >=20 > Dumping 2577 out of 8122 = MB:..1%..11%..21%..31%..41%..51%..61%..71%..81%..91 > % >=20 > __curthread () at /opt/src/git-src/sys/amd64/include/pcpu_aux.h:59 > 59 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(struct=20 > pcpu > , > (kgdb) #0 __curthread () at = /opt/src/git-src/sys/amd64/include/pcpu_aux.h:5 > 9 > #1 doadump (textdump=3Dtextdump@entry=3D1) > at /opt/src/git-src/sys/kern/kern_shutdown.c:407 > #2 0xffffffff806c10e0 in kern_reboot (howto=3D260) > at /opt/src/git-src/sys/kern/kern_shutdown.c:528 > #3 0xffffffff806c15df in vpanic ( > fmt=3D0xffffffff80b6c5f5 "%s: possible deadlock detected for %p (%s),=20= > blocked > for %d ticks\n", ap=3Dap@entry=3D0xfffffe008e698e90) > at /opt/src/git-src/sys/kern/kern_shutdown.c:972 > #4 0xffffffff806c1383 in panic (fmt=3D) > at /opt/src/git-src/sys/kern/kern_shutdown.c:896 > #5 0xffffffff8064a5ea in deadlkres () > at /opt/src/git-src/sys/kern/kern_clock.c:201 > #6 0xffffffff80677632 in fork_exit (callout=3D0xffffffff8064a2c0 = , > arg=3D0x0, frame=3D0xfffffe008e698f40) > at /opt/src/git-src/sys/kern/kern_fork.c:1162 > #7 > (kgdb) >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com