From owner-freebsd-stable@freebsd.org Fri May 21 20:11:34 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id E143C63AE2E for ; Fri, 21 May 2021 20:11:34 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FmyRn4GFXz4tpd for ; Fri, 21 May 2021 20:11:33 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1621627891; bh=I8c4kQ2OhT7pQ8MdjsF6TDVTdg2dlpWNA0G0MumWfyF=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=LWZPoGREdupmyEgTi+TUe2mD2Sta5Yu87qlz+5ZgSLfe9wEoJc6E3modr6OkfEWCjxBF4l/RdP4KqgJslF62pD98gO2mz7t5xUDDbUsHzCBOVGmdIJRPdcp8jCEEOXsF08ovGjJlBCgEhTy8dzrMLEd9QJX8J7FCZXRAgABAu7/QUwN2y1bwsoOMP9zCuvwKhb41KYAjzjeFJy81qus+Y8AhAqDzonA4iusgcSbLuNMMVLOaOqP6NFoOE9vUicC9j9Uu5T6IfWjQtGOkmbLKNwTpXyILTHsw7d/2KjFCetaon/+mn+sUegav2qWtoFF+OXAMrA10DOHZxJXFF7giFA== X-YMail-OSG: Ds0fAAoVM1lfjvt5yKAtu5WHitnAdcXiiVux0tg1iOCOx5MlJti2XDnnBWGzjvd DRB59hfZATTZs_jUo2oriRp7VsZAZEaOmw.CDwXsMxd.5JsZOTphsPON6hUaBAd11I0Dx8zEYLT_ P.qs64e.rs._MPM3YiaT3wBQHJRMYYWx9737ribclBkwg8ZR56vFIgmVPPkxyTsoqqknRbx.HFFe YiqkZH6oFFZ4xZmzXQ0mNMLAqyHDAYxAX1G2ZFfu5.VV834sDPYFDm64flRwlr1DtmRJhySGeNZ1 ulAB2fwduu1XYkkjIyZ5AjHEViFYCGc6lIRaf.feU1uwGJSXllpox91M2zT5_wc8V1wyfo2_utct QegeHNp5L8k95TyKYMrl.A5.UYrMhfqn1Q2xEHe2a._hWR0df8FWWaDTYHxEymeyfdFJrqxOxb4t u742ntXLjbUv5.XRmGYZk1V.bWW7GdVWfd_2aYZEAZYFUuSCAkeHmAowaR0_UrVOgOrOpL_gKjrN SzwWU73sa7BhD2fTrwucszIwF_8JAzGIxdVw3I28UwlOy7Zn3qgT9U7p4iQo66nFqZoGf6W0e95d hj_ZPhdsQgdixVWSg5zDLuSHk66Yx3S5QjchtPn9p66WYbTr_9EuZ49ECzdMHPMRMd_o09h7j1Wx F1KWzlYSiJsveJA2LerfRNSvdzaBLptuAs8xXdmVsvGaclnrXvSKKaFuyLS6Le_kE5iACfayPwZy imZiekEhvrZXl9YcjhvnLebNxyoRGzJtolcszfU8rzOBcND1BBgdvRFmMIkM_mSjb0K5RNGAemVM Le1uxFQadA2FCkwzTuXZffh9AqH2oQwltetRf8cg2Vs.vka0yM5yPryNP1M0MMgs_HodUV8ZiiFQ AA4CPMc2ZMdl4y7sWdb2Nf5YRbD52ssyCfh3PhFWRXR_Hj70DXW7_dMhtHqK_Yc9wv1o6OwmzBGR M4SeEtViQ5iuFtEMVGmRsWvykRsOrUOg6qP3faPV5sshcZ3VJnRXW4KBw2gm9AR87kf18vtkgdc5 vmmv1oCP3TaY5Mfw1kRdP_2PzAqJddxHppxlmY7NnwM4KOjiTHeJLIB0ok7k6gECoFtHIeBEy2zB GGJ7aZUb5mkqOBj_N0hMUi58k8jgq2h8Glkt90WAOMxhnYYvwC6VOrt53eIlg0bWp_1iYUMvA1cC rpzGrALpwx4g1ogu7kFqvmMpy6qzRkw0N0EbrivMo3wHVvkpAgHXCdWh0kI.lxvpRSk3U6WGMswJ 7ncSQIU2sLLVxycUms0XQPFVB1tWhkYZ705szbE2KhxIhalUvgWe1n4b1KdCXhiZ5wedk3K61Xaf _FUSry3VffJKoiFEPOlJ20L6BxGjD543tQpzbA9nqFjDcoI_xlSortJpIp_37RXsVt6SN3es5H7m PLscdwcXgcv.VUtC9NUDavbcdAsQyGtNwXSkWKygHZsLgaaMxNWUsSGmXe6CX3USBdAYJD8hu418 5zim9W.SdZMiAQB.tVUr.K.hw5gtnhPAKqZhLaFdsGREstV9XztEz5ccbsxAG6Yu2RVvjv7MJOUE OM9VcuhiopTInzsd8GQP5XG9tHKOcLeve3yjbY73YYmkrZSsY0ROyelgoiqdS.F4YML33p2Y__Kg CpKDOekY.y.zAXPFr639fyZq8lEnxtYq7ont5Z2UnV6hZsucaoWguyqpEBjTQL3Cy5QWsFFAOYwg 9VN6jQ4UjfVeXEXMqeENepNgOomZJ1fMYLcozmCQ6XMfxP0hHLc24Alx_IxaptDqdrgyAxgFH3w. 3nEdDEdkq7lAKNEVl3ltFZAyLee0zG1HtaLOyZgFRPeL_n7GDv_9n43M90KporzzePK_jj3uoZeJ QcburriIduWftS.cc6ss26wQNzWz0ch53iVlDSxhctXVppMqMV2n4vjCcJ8i0UemsmN4dQkiM2lg m73gryM9t3C5FxRrlUayKd_NR9MNYZ78YuVa.CqIuAA36e8z5B6h_q8gc_qJIjEXS._wiWkpiR9w eQQvWA.YY15wTPM6X8Uq6x.Kf2hlvsQghyAAJBxjmcAcNmd2dtu9XSms3yvSae.Dy2ZsAfPy3zEV hoEIVaxMflpY62X8PPMMobErNnCWutXm0ETO69bqL3DO._nJmD5_UwLglLhX2MeA8mb4qrB9IAQq YDjrdQLO4z9HfzUNqha1gxSZtQoYIUDbr3rk9SGRp12IyTaOa1s3pSddRT7pjaAUg8Z2ksRXKCgv .YsBAFIeRRtHJiW.J_HCmOCOoccSgs4m_DtFfVBHSWytLE09iM6Qdb8CxR_.6LJQXprz2eiztwiL NFGbNGux1Pxmhc2rQQw8.UVOA8cxTqxDfi5wJktkYuZuvDlI_cRvFnhRs7m4ACzgyyw3hueILbmo Gf783wkk_jjeU2nk_TENQba5GQ8zuoc3Ii3UCGBYt9K8cItzZhEeP2Q961KhKayCsrc0C65pBiJ9 BuvsX1Shv..wVdxJM8oiDGWLDcrvApQsQSPr1DBlZ56RBJZKZuqaPyhWeK_Onkpb7siBJrOUEGXw gw2OAUwbBaIDZLy1sIBmda4Sfcyc1QMCG6dhk9LDZgPzbT7KuAM0pSM1Gsn4G1Av_4uLk0_cibIA VJ_ENTgLZ6u6p2irSFzaWEmecY1X27wymVrMblQTZbhSb40iWcWGh0VyQKIQ96eKVccaUlv1QEtf 9Q0QFTaHGpJvC9HOuxK6X8r85lUcN4AEj9g3iGIRkJPu7.gYHar3miSpHWZ6gFaLEILblv64- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Fri, 21 May 2021 20:11:31 +0000 Received: by kubenode562.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 21fd93dd2eafde656015b7b910054021; Fri, 21 May 2021 20:11:29 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: Re: releng/13 release/13.0.0 : odd/incorrect diff result over nfs (in a zfs file systems context) From: Mark Millard In-Reply-To: Date: Fri, 21 May 2021 13:11:28 -0700 Cc: FreeBSD-STABLE Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <508C3B05-79E5-49ED-8032-DA7DF249E154@yahoo.com> References: <623369D9-5EE5-4FEF-B9AD-56499E8F1C09.ref@yahoo.com> <623369D9-5EE5-4FEF-B9AD-56499E8F1C09@yahoo.com> <04D7264A-206B-4281-B452-779B01EA3327@yahoo.com> <34E915B3-30DF-408C-A931-C39188F3EB0F@yahoo.com> To: Rick Macklem X-Mailer: Apple Mail (2.3654.80.0.2.43) X-Rspamd-Queue-Id: 4FmyRn4GFXz4tpd X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.205:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.205:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.205:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.205:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 May 2021 20:11:35 -0000 On 2021-May-21, at 09:00, Rick Macklem wrote: > Mark Millard wrote: >> On 2021-May-20, at 22:19, Rick Macklem = wrote: > [stuff snipped] >>> ps: I do not think that r367492 could cause this, but it would be >>> nice if you try a kernel with the r367492 patch reverted. >>> It is currently in all of releng13, stable13 and main, although >>> the patch to fix this is was just reviewed and may hit main soon. >>=20 >> Do you want a debug kernel to be used? Do you have a preference >> for main vs. stable/13 vs. release/13.0.0 based? Is it okay to >> stick to the base version things are now based on --or do you >> want me to update to more recent? (That last only applies if >> main or stable/13 is to be put to use.) > Well, it sounds like you've isolated it to the genet interface. > Good sluething. > Unfortunately, NFS is only as good as the network fabric under it. > However, it's usually hangs or poor performance. Except maybe > for the readdir issue that Jason Bacon reported and resolved via > an upgrade, this is a first. > --> In the old days, I would have expected IP checksums to catch > this, but I'm guessing the hardware/net driver are doing them > these days? Well, why is it that ls -R, find, and diff -r all get file name problems via genet0 but diff -r gets no problems comparing the content of files that it does match up (the vast majority)? Any clue how could the problems possibly be unique to the handling of file names/paths? Does it suggest anything else to look into for getting some more potentially useful evidence? I'll note that netstat -I ue0 -d and netstat -I genet0 -d do not report changes in Ierrs or Idrop in a before vs. after failures comparison. (There may be better figures to look at for all I know.) I tried "ifconfig genet0 -rxcsum -rxcsum -rxcsum6 -txcsum6" and got no obvious change in behavior. > W.r.t. reverting r367492...the patch to replace r367492 was just > committed to "main" by rscheff@ with a two week MFC, so it > should be in stable/13 soon. Not sure if an errata can be done > for it for releng13.0? That update is reported to be causing "rack" related panics: = https://lists.freebsd.org/pipermail/dev-commits-src-main/2021-May/004440.h= tml reports (via links): panic: _mtx_lock_sleep: recursed on non-recursive mutex so_snd @ = /syzkaller/managers/i386/kernel/sys/modules/tcp/rack/../../../netinet/tcp_= stacks/rack.c:10632 Still, I have a non-debug update to main building and will likely do a debug build as well. llvm is rebuilding, so the builds will take a notable time. > Thanks for isolating this, rick > ps: Co-incidentally, I've been thinking of buying an RBPi4 as a toy. I'll warn that the primary "small arm" development/support folk(s) do not work on the RPi*'s these days, beyond committing what others provide and the like. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)