From nobody Wed Jun 2 01:09:17 2021 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4A24AEFDCAC for ; Wed, 2 Jun 2021 01:09:19 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660046.outbound.protection.outlook.com [40.107.66.46]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FvrXH0mmCz3DML; Wed, 2 Jun 2021 01:09:18 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=h3vIrKdoxN5vDZBL0VONBqG3Uvll4j5kUfEMX3mlI07YDBx63CrggvWRKZIdmxvDQs089N8Wsm9ZScyLCUGo3gbNbYYLQwPdRz6BTzgTbuHf/hreaXTWprPe01nCSQob/8qM7fD3+EGWj7JiV7EkRWjBnhor8BpVx7r1iTN/o9lQic7OGjdDOjtucRqHoUTmEm9s5s6yuHITAUxmIrQS7XL841gfV+u2hF+md1PPOhEAZbjv02N6ynBQLqTgdrTz2yF5Ult/zuMu4fL9P8MgMTtckECIHLKt3oCna5w2P2I/BUtJDYDS0+Uq0LAMJnCdHANbsC/NIgIiAEsObMB7OQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uQ7jzKt3OWjGnPjYmToVk494AMTLIpp8V501gJMrZNw=; b=WgsXTSrWTC3SmP3NxGcGOENJ/y2+eVakMoj0nwUKdqO6Mp4wAS89ERuSgyWoE+xtUD4x6Hnrx14lSPHA71EfCFHU8S2/YBLP31nnQORdmdnpqDhjAAjV0VX5vj26IHhCQqgeSms3PJOJKgcyWu4CMT8RUb4jzSxqom0fv73ECxzinaOHOf4Y0XdMLbpMWBuN8XaKXOw+ZlRXfGld7wxH/RQrNT+jqBuKHUqgeM6vMf/Yibp8rt3aBQLlHAH2H53fb3b3V45UusBpfjGZxZ4JOckkrGxckfQg4o2K4hlWOnL55hMJPoALDjMi6PrxlqPmKJUkl1KHRC4Qy1N7txlQCg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=uQ7jzKt3OWjGnPjYmToVk494AMTLIpp8V501gJMrZNw=; b=TZftstxCMSi6+GOwyBtVDBDlJ875MUfvRgHcTgBVGiqejN/cpZrqhV60JqpO6Hzd/QY6iSKKOkL/BIdCy4XrxD+ky9YoTFYOslQS8a3LXe4VvF5zqTzFAjSS9R1059ifSpDdclYiFsh0XIXmAT9u8npDJSw+Q5unnryPLCV0dJgJaGiSMi3PRqPNpq6RrqkoGiz1slOBkH28S1E19SLoFEBdbPzGl6essGHy2oWlfJsvZ9t267q84YjcTRHUy37/WrCVM1DcKBnIc9Q3+KyG/Bc+zJwGeTo80wIbpsMrQUgCBmfY47Oo+046hm+gsmLj13rWxpj5Kx4Tw7TNLDVDvg== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQXPR0101MB1783.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:1c::12) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4173.30; Wed, 2 Jun 2021 01:09:17 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::583:528b:dbac:37bf]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::583:528b:dbac:37bf%4]) with mapi id 15.20.4173.030; Wed, 2 Jun 2021 01:09:17 +0000 From: Rick Macklem To: Alan Somers , freebsd-fs Subject: Re: "nfs server not responding, timed out" with Linux client and 13.0-RELEASE server Thread-Topic: "nfs server not responding, timed out" with Linux client and 13.0-RELEASE server Thread-Index: AQHXVywsIrYOTtPEfEe2cYpb6iKr1qr/6J93 Date: Wed, 2 Jun 2021 01:09:17 +0000 Message-ID: References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: 663f2961-b89c-4c02-ddc9-08d925630b5e x-ms-traffictypediagnostic: YQXPR0101MB1783: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:8273; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 2Y7c2+rNFWepslOejdJLQBcIKy1ilkSHMUaoIV/7jeifaLw0qFDKu0W/CSActpAC0GNJPccDPhFgcaC55HLhtXPwmh6QY2C0+5VQJ4NRRuPMJjoIGL+cRuPVWcw4DCIDQtH3GiItbZYhpj46JoXuCfe2ZNlaQRsqt2BPuRIz6GjpmrIZ2QbYnG+BOwZ5n7vd9+3lHBo74QH36KE7y95piK1r+3H3s7pHQSwt5QvfpAER+zo9iQfDbujIwqb36AafsGqyLWiXhErlC0vG/czGm/9kVHl+ZCgJRm3Ht4q6ExlRr9tdGiaZnrpshHpsqRRoHyCl3zAqzjNZslD0q/yLZYzVNZVY8F27hQthIk/lDBnxnSzRVH/ICHOlNCxV27+6Y4cJoQfEDdgo+w2GP12ZWtmydSvb2NNZZAHheDujDBMawhvg+1NkmuY6JVHD/9oENZ0W+gTPggHXsuVGWR1rg1cp6ImdMxmFoYjO1d1ehvg8ejjUtsnz0OMkDNNYoTXqgH2ayfu+yuo+aoWzx9yIBz2FHtTOSvr8mup7q8kZLLvqD8WS09nIvFHWBOwsBeGR+/1ycUPhCqb9QYhHvYdqz0Yg3A3+YUXkLkqLGzsDdzk= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(346002)(39850400004)(366004)(396003)(136003)(376002)(83380400001)(64756008)(66446008)(122000001)(66946007)(4744005)(86362001)(71200400001)(66556008)(8936002)(9686003)(478600001)(5660300002)(76116006)(52536014)(450100002)(2906002)(316002)(786003)(110136005)(8676002)(186003)(66476007)(55016002)(33656002)(6506007)(7696005)(38100700002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?fjn44dyN3nPrg7NmTsn6z96kC417gxId6lhKO2K/ZRvDICqdSXdm2CMsYi?= =?iso-8859-1?Q?0ZAR7/QOMJ1Y95AIMuWxrWbvHeQUEDzvLMC/QqwPxRS00sC9BURj7pkajO?= =?iso-8859-1?Q?UyQ8U86Yd7+2JqMw5lXHXkE3dPZyZBdcr4mqeplyG0zL8O+r/6z7HdN5L/?= =?iso-8859-1?Q?6PAvBNi5LaMN7rqlMgivmYPh86+bnxM+g8xao0DFkeH7/1wbGXfmvk9BjG?= =?iso-8859-1?Q?uYiNaupYWBpRRMzxwqehA2hZvcli1/8/Ep68DXa50/90XITbpv4p8+y2TL?= =?iso-8859-1?Q?WN5RHGR6Tfe7gj2WHZbyoHLlooS55MIjGnQxNFbZoJ88g7et4YlT6L39vx?= =?iso-8859-1?Q?Sq3Yojy/bslwBXIQhCdLabvjr/JGDxW08g2WURHMzi6z9HlE3j5dgGsm12?= =?iso-8859-1?Q?t+bivgiJa7QYcKeUT5equm7+qDAn4XRjiB4ySf7x6RxYZtS1U2w6/XsiqV?= =?iso-8859-1?Q?Nnz9mGg8nPpHLbwa+8d+ueeVgsUmUbuJuzsBCdyT5hPz/uYamRWSDDdjxa?= =?iso-8859-1?Q?6i3PoKSGTsHyxmQ1cpioCllDL2TITRyjkR5MW0+YzPZsup5FeDhjsqWVZG?= =?iso-8859-1?Q?hXdcl5Z/CQ0aRE4XtbWYXjzs80yjFhMzzeHDj6E/GRmcrT3DqXcIGB9fuO?= =?iso-8859-1?Q?iR3h6rVKNi7L43AC1HD97mL7FqiKd8LjdPXDLvB2Yq9LKX9C8dKDZBtUsK?= =?iso-8859-1?Q?ePQATQE9i5UvhhpHD7gc3dXL01COESk/WpIzaQBgvDPt4kMQ7nIj+HTaV1?= =?iso-8859-1?Q?BrIbKUmUn/TEk8hP8Rin+FOR1f9btMVJDqtqHiwoCbXPcyuJ0RtlB4ill9?= =?iso-8859-1?Q?yYBTyM8U4N/SrVSKdiziA6w/t4nPQ+9ueGOtQ5yfIsjF7CLn9lnl2/endv?= =?iso-8859-1?Q?4R5NFLMMgZzbvQFIhLPYKKpq+Iwq0c6sq3xtFssaKwawjmG8tVESYhzPcG?= =?iso-8859-1?Q?AfE124LGl72PPJz6i69CFd0Jp97UWDgOebkaSrlqqsDkfqrasZyBSt8RO5?= =?iso-8859-1?Q?jCXwNDF7mAz4gVlWTZGI9aoYI60XUEOhetqw2embCspLxdYE041niX5pbZ?= =?iso-8859-1?Q?LjYWn6PVOrYPOWmwc1C+DhvozHrJ8GdIyOE8utky18CPiVTYDfslFWo3Bo?= =?iso-8859-1?Q?iZnCJOTiUKsQKK9ojNYtoQW549ubCL1CKS0bGiGizGog8GXW20vmjprsbw?= =?iso-8859-1?Q?a+wjxFDpaH2rplalzuv/Ab0VnyMRaUtdoo2Dnm9rzoIoe3XNxOn4BjOdEY?= =?iso-8859-1?Q?NbIa/Z5Zw5nyuBt5kGCl23CYyebShJpiYa148OLCcvDM5LBM6ei/Nqgc04?= =?iso-8859-1?Q?kSn3kQxt/ivIi7GkOuhEIv3l9BncG4JrxmVHz/C2AJKd9vR3QDVYYIAlov?= =?iso-8859-1?Q?Kzq+rYLM7N+WgithRWD2yoWNz0FIvITZ9pwaOJn6JTMBYqn/vRp9pkahkY?= =?iso-8859-1?Q?iMls7TZVRDN29wB3?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: 663f2961-b89c-4c02-ddc9-08d925630b5e X-MS-Exchange-CrossTenant-originalarrivaltime: 02 Jun 2021 01:09:17.1412 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: sUrdvRTbFSN96aYgV0uQ9VlQccZDkBs0imqY40urqtLPY9EpbgFAm0ljLMaWBa+dm+W3a+1k8NpAqYI0GI/nyw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQXPR0101MB1783 X-Rspamd-Queue-Id: 4FvrXH0mmCz3DML X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N Alan Somers wrote:=0A= >I have several Linux NFS clients (Debian, with various 4.9 kernels)=0A= >mounting NFS 4.0 from both Solaris and FreeBSD (mostly 12.2-RELEASE)=0A= >servers. I frequently see kernel messages in the clients about "nfs:=0A= >server not responding, timed out" for both the FreeBSD and=0A= >Solaris servers. It usually recovers after a few seconds. However, on th= e=0A= >sole 13.0-RELEASE server, the hangs last for minutes to hours.=0A= >=0A= >tcpdump/wireshark shows the NFS client sending a "V4 Call SEQUENCE" packet= =0A= >every 5-10 seconds, all with the same sessionid. The server responds with= =0A= >a TCP ACK, but sends no NFS-level response. I've seen this with both NFS= =0A= >4.0 and 4.2.=0A= >=0A= >NFS delegations are disabled, and nfsdumpstate shows that the client has= =0A= >callbacks enabled, with 2-4 opens, openowners, locks, and lockowners.=0A= >=0A= >Can anybody suggest how to fix or further debug this problem?=0A= See PR#256280 for the ways to fix this, rick=0A= =0A= -Alan=0A=