From owner-freebsd-net@freebsd.org Thu Mar 18 12:42:26 2021 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 1613E573CC7 for ; Thu, 18 Mar 2021 12:42:26 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) Received: from NAM11-DM6-obe.outbound.protection.outlook.com (mail-dm6nam11on2064.outbound.protection.outlook.com [40.107.223.64]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4F1RW436cnz3PhL for ; Thu, 18 Mar 2021 12:42:24 +0000 (UTC) (envelope-from Richard.Scheffenegger@netapp.com) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=b3pSgi197LJ7Ff7a/MG3ZUOqfs5TzUNuxFk9/nF55m6dDdV/MIjBtCu3RJbrLIGK3oKwd2XQf6WnviJPObGqobc0eby3WGChE1qC0ICHqX5MDbEmh2AgCTGB5xOgY50YFcsL2pSkDkKly00aVtYxtFRRDBqrwVjYdxtXs/ANj1aK0BcRygyC8zGbSguEztA0Vr/hA3ttqvtZ/tTIGHMPEZcmPGPyi/bm9A88ixnjbhv/XJ2KrMvdOriBppioo500p6C/dSRVZvneTyl/MIrRnEKU1MzMKxWTx89zKZKz5n2/EykFPTRImnktMfw9ZUlaX5pQ+4176gHsazlwZZ+ZCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xsp8LHPzOuxjNv+aVk8fDJh/XkiZMOsAoDSTgmRBT4c=; b=VaeFHCa3lUHiyJpz7JEMkyyVR9n+gWP26MtUqLdhLCCVKraFOPfWYkAURJ3/Dx3ivsBzbmmGcokgBZqFfffRcvl9BY4kujXaO4+nrCzfju7ao9LOIZb2+UqFohB6yEmtFTniO26dOqT0nWsdv4nMm3XzHkZMePF/H5Znl1xk61nz05uLs0LUP7fpUEVcflYl3OHP75+kTdlC8e0Sv1c6d+uyfjtqDA1kcKuD4Ye/kdi+JKDmVcZdN3mJoUEL7CCWmKZPRPLviGSWZA4vqCn6A/uE0py7EwdduNcCKZ11AMBVLozotVxLSedlugkzIfRVcwv/oocuAuSovHaPnHMmmQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=netapp.com; dmarc=pass action=none header.from=netapp.com; dkim=pass header.d=netapp.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=netapp.com; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xsp8LHPzOuxjNv+aVk8fDJh/XkiZMOsAoDSTgmRBT4c=; b=L8hAJ+JRkANYodH3ON76kB8wAdFZxdmsCEonG8cJbt9FivG3El+urYt86FM6fQ6R4v6dVLrpbLIdFx9D/7rZVDlQvVusZ5UBgVX1E4gJ87S0d6Vu1VBRTuOkCjk9PYhK6S0PgIWZFeCNaH09OoiYCSFTQ1k8cNcMLsC8vSeCMSHpECUUh5W7Hpsa3t9EXLff6i+ycf/QWincVpH3jMDc+hsMWspkIqs59/5U1M1ysCRU+uu5FyBCfRz2XYurZxmkrvtJw3Ikd8t1D0PuTay7ibrXkNiALKyOD//MO5qCeQFz81Q2I0It6thbfy85hzoBD69z2FBU06o+ar2oT9zwmA== Received: from SN4PR0601MB3728.namprd06.prod.outlook.com (2603:10b6:803:51::24) by SN7PR06MB7309.namprd06.prod.outlook.com (2603:10b6:806:f6::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3955.18; Thu, 18 Mar 2021 12:42:21 +0000 Received: from SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef]) by SN4PR0601MB3728.namprd06.prod.outlook.com ([fe80::ccb:944d:e270:63ef%6]) with mapi id 15.20.3955.018; Thu, 18 Mar 2021 12:42:21 +0000 From: "Scheffenegger, Richard" To: Rick Macklem , Jason Breitman , "freebsd-net@freebsd.org" Subject: AW: NFS Mount Hangs Thread-Topic: NFS Mount Hangs Thread-Index: AQHXG1GB6agsoGWN0UqRoZFo/qoHTaqItMcAgAD7PVA= Date: Thu, 18 Mar 2021 12:42:21 +0000 Message-ID: References: <3750001D-3F1C-4D9A-A9D9-98BCA6CA65A4@tildenparkcapital.com>, <33693DE3-7FF8-4FAB-9A75-75576B88A566@tildenparkcapital.com> In-Reply-To: Accept-Language: de-AT, en-US Content-Language: de-DE X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [185.236.167.136] x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 45acea10-86ca-4f6f-1835-08d8ea0b463f x-ms-traffictypediagnostic: SN7PR06MB7309: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: Vs2GBcidVwFLEBAXyN6HdblF48gOh6CR1s6Ybs2is1DJYuJAeH5v9DOAOl+yEfFJqi4zXdTUVXsMqeiqO1Ld3aowxqnC7JxI7A9woeHCcSG9NOA4vn3g5q+EBKJeYzXtPSUVqxd2I3xXcDkU7eSdBcVvlmjJ4A5mOBaERLBwkCtd6mAypYcKAwxIMGhK+aFGjsg95iWyXEJWKQeqQRLNs2PwFEhol4Dt8f//hLKdTIPi3DUo3ksNeDuIPl9FjVngv+d13wrXtD9XEgvDC66JBq0oViw/KdwtoHXJ4wh7KQHtBKzbbWllcUZdkmZewS/+62z6m1oAvi1IXzs+YfnXb9U/0FHYqg4FbdCi/JCpbUbz2Y4NSj7Ncdpuajyk7lN7iA9N+FO7y4sPRy0eAitSUggSVSvQaEsXfjfs049NOEq6jzIU8e9sm1QP1A7G6VC3qwqv9NnTQYQWD9ymBWK9ZeWbvu+Asq4Aj99gd2ChXBlHo1PPRVeMItzSvHOrxAmW4f4/enmkhoX6Kq70BiFXMG/9Ougfl+exab1/LAlZ40vefDUgqGQo2n3DHJat6MTPlrCmpiMAa1MnUnUTWJzFUqQSvXHFzysbu6jN3kKG3G5tehxMUK7gGujWL6wR1aOn x-forefront-antispam-report: CIP:255.255.255.255; CTRY:; LANG:en; SCL:1; SRV:; IPV:NLI; SFV:NSPM; H:SN4PR0601MB3728.namprd06.prod.outlook.com; PTR:; CAT:NONE; SFS:(4636009)(396003)(136003)(376002)(39860400002)(346002)(366004)(64756008)(4744005)(66946007)(5660300002)(9686003)(296002)(7696005)(316002)(33656002)(83380400001)(66476007)(110136005)(71200400001)(55016002)(66446008)(66556008)(76116006)(6506007)(26005)(186003)(7116003)(8936002)(8676002)(86362001)(52536014)(2906002)(38100700001)(478600001); DIR:OUT; SFP:1101; x-ms-exchange-antispam-messagedata: =?us-ascii?Q?0ZilYZ/mv7Z/Kue0UnnGQUPCXwtGI1MazAwds+cAI11FSXhDzk1TYHZdWOv2?= =?us-ascii?Q?u74TqFKYcA9F0cD+MxMiiBx9NRq1u8mIGXWoC+riCGe3mmpDsQEmu23o9gAC?= =?us-ascii?Q?7K65H2itJJ3/CbmwHYW/BSTnzkaYztS3kU9QiC9o86I74HpyODD/kwJjsYau?= =?us-ascii?Q?9a2oEv+WCSSwAi6Kh1kvmMU7CL8w5tdA1qVpk6xYpXNiPjY/kk1TxzjLPRbl?= =?us-ascii?Q?vp1YI1LP0T3yrcROBG7II0wG+A4fi4Ge/zaK87qe/DzDVVwexUx12EAQKAH2?= =?us-ascii?Q?lVSP4ZuIC0ksyEBfyUxiiMSYUWs0Hiq0Iqh8Rk4mS0YKWKhfBwOdMH+/ShJC?= =?us-ascii?Q?eJ88z1h55yE721M3kTUVM8b9r9IcRTZwyUUnS+aPoR30pgIqGou1lntUBupy?= =?us-ascii?Q?iwhYjjqUbqC2s+L663T+D0UScHFh3QrQMxrDA7TUjMWHvCi2CfbVUmUDP/0B?= =?us-ascii?Q?U59wc7CcxuMVeuAultZrxZkvn1OIljQJy3JC/CE/gWqUuy1t8yhnXtXqbjl2?= =?us-ascii?Q?zMHXR3Ko6sbXJHUCeeh1ct1QUMyW6U9u7POz7dHHp9l42t92UR/anNeYV8JB?= =?us-ascii?Q?6S6JXIEe3ekwJ+12jJuA6HElXJU6B73AQPbPDo6R8U/VEhHRxD1Uf9opdHU7?= =?us-ascii?Q?R7bFx65eWRCoh0fef3kMN3rA8/wHZZhqH3bWQOjAJy7+nXHWeA3EmpogkfOp?= =?us-ascii?Q?OTMsv57jtnD8JLlLiyep1RTAdb9KBHbKCfBpRlMCRASsGk8AEyXNwa9KRvLM?= =?us-ascii?Q?xpr0I6nrTYQ2ebotx8N31U+qoGYyB7SXJJ37gmiZuvJ/+LxePAWWAw6UU9GP?= =?us-ascii?Q?ar+/y2jZIAypFmMIkTKrcEp2e2YGri6NLtEPO6R1dIUcu7cmfaLLeE6U6VAI?= =?us-ascii?Q?pYw6YBocotKxS2Wl1meZ4+iUkau/B/JMnbni+3ZEM3HNuNbDTs5Kp4xLmBCY?= =?us-ascii?Q?VebObvjnZg0VgcZCL024TmLe4NucG8bo3pELKTvwVSIMRllhg4fZLoBqOY0T?= =?us-ascii?Q?XUliCmXmD87M8duDKF5C9GQWdlcQmJrgcbNleW0j9o15kL4yboUpT/Y2nUZd?= =?us-ascii?Q?8+IZMk8OSX1E9s7Ee/jpNZLD2U7NAY17AL6eSD49PPmOIBliXCNfN8MX1hdm?= =?us-ascii?Q?QgDlO579VBiY3+1V8jvU20z9ytOyktxJWZr6o6gzlKSPplP0CxBsA1P9kEV/?= =?us-ascii?Q?Cs8Gf6pROfRYHoxKzsb8Qn9S0eJjtw2Ev6zq8m5YyJMlX9f41onbipLGesY6?= =?us-ascii?Q?Tj5E9+qgs9CM0ABLfC/LrwK2mO0rp3W9PjnrOtn7azahK6WWVvL61rXziNCc?= =?us-ascii?Q?G3z6TMWAoIYi1P573Hih5f51?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: netapp.com X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: SN4PR0601MB3728.namprd06.prod.outlook.com X-MS-Exchange-CrossTenant-Network-Message-Id: 45acea10-86ca-4f6f-1835-08d8ea0b463f X-MS-Exchange-CrossTenant-originalarrivaltime: 18 Mar 2021 12:42:21.5575 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 4b0911a0-929b-4715-944b-c03745165b3a X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: msiLCIylhMbbeWYX45urp1bbW7LOqlj3u5FOnC2pZCFsre87fS5VqTCJc443gHCooN25a6eUpZkyStyeOUOrpg== X-MS-Exchange-Transport-CrossTenantHeadersStamped: SN7PR06MB7309 X-Rspamd-Queue-Id: 4F1RW436cnz3PhL X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=netapp.com header.s=selector1 header.b=L8hAJ+JR; arc=pass (microsoft.com:s=arcselector9901:i=1); dmarc=pass (policy=none) header.from=netapp.com; spf=pass (mx1.freebsd.org: domain of Richard.Scheffenegger@netapp.com designates 40.107.223.64 as permitted sender) smtp.mailfrom=Richard.Scheffenegger@netapp.com X-Spamd-Result: default: False [-6.00 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; HAS_XOIP(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:40.107.0.0/16]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[netapp.com:+]; DMARC_POLICY_ALLOW(-0.50)[netapp.com,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[40.107.223.64:from]; ARC_ALLOW(-1.00)[microsoft.com:s=arcselector9901:i=1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:8075, ipnet:40.104.0.0/14, country:US]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[netapp.com:s=selector1]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[40.107.223.64:from:127.0.2.255]; DWL_DNSWL_LOW(-1.00)[netapp.com:dkim]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[40.107.223.64:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[40.107.223.64:from]; MAILMAN_DEST(0.00)[freebsd-net] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Mar 2021 12:42:26 -0000 >>Output from the NFS Client when the issue occurs # netstat -an | grep=20 >>NFS.Server.IP.X >>tcp 0 0 NFS.Client.IP.X:46896 NFS.Server.IP.X:2049 = FIN_WAIT2 >I'm no TCP guy. Hopefully others might know why the client would be stuck = in FIN_WAIT2 (I vaguely recall this means it is waiting for a fin/ack, but = could be wrong?) When the client is in Fin-Wait2 this is the state you end up when the Clien= t side actively close() the tcp session, and then the server also ACKed the= FIN.=20 This will last for ~2 min or so, but is asynchronous. However, the same 4-t= uple can not be reused during this time. With other words, from the socket / TCP, a properly executed active close()= will end up in this state. (If the other side initiated the close, a passi= ve close, will not end in this state)