From nobody Mon May 31 15:52:38 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 0DCD1DFB03E for ; Mon, 31 May 2021 15:52:40 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) Received: from CAN01-QB1-obe.outbound.protection.outlook.com (mail-eopbgr660070.outbound.protection.outlook.com [40.107.66.70]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mail.protection.outlook.com", Issuer "DigiCert Cloud Services CA-1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Fv0DR5xRNz3nRQ; Mon, 31 May 2021 15:52:39 +0000 (UTC) (envelope-from rmacklem@uoguelph.ca) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=VNs/c1Z/SctZk3D+sNrTaMDxZpJZWHTaGf5vytbsUMoqg9Qznj4KJh91jqSyUEvFws5yyPBFsTeWDsmIuyI3AfY3zZBrG+5YEDmUA6xZxBpmitYESj7feo5vn4V93+Gi1W5ph6KjcQjZb5hDPas6sU8AYuIbKE1fg9nk6tx6mSrY32EIi3xf8fudroqW7ydwJQg+WCiP5mrCBiUBtaGFXfGl9KV2Y7St4tINa98wr7L/k66+inNfrm8mKli3Fn7YRmcSiYtKr7hpIwIYn+Lk0/bf0SuQLIYbrgpPJTXdKpsOzJvlM95YSleufGObklumlaM/j0YlZfeF7scYNTR9dQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=QBgatUmWdqdvIZcTKomum5mMKQ1J/e4AIe69xj9qjWo=; b=FdESybHD+O11JB+Gysw4TDLaHo96EDvEz1BiLLAiE5CN9G5NWoJ7HuBw9GpvbZDMG37AvvompUJJ701wHD7vLAKffEGpF4lzBFIroQPwjC1ofVc/VuLUX4YM8+O+2qIckr4Srg2mEVgN5LcNZiSRuE44msDAmZ58eqTTQiUs7XAYWjYS4frjkGz/ZxFJevmofPRlpYIykkpgpucbeO5mo4GdIQucQP9NAb1VzYdM1lRtA6A+UvpOh71o3pDSraIwe7MzzMx/DJ98txToJbVGSQJSlwggCK/rp9EMj1vAY7wPOretWeJBm5dGfftBEZ6bWfVMDCetK+Lqwiue6Dv0dQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=uoguelph.ca; dmarc=pass action=none header.from=uoguelph.ca; dkim=pass header.d=uoguelph.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=uoguelph.ca; s=selector1; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=QBgatUmWdqdvIZcTKomum5mMKQ1J/e4AIe69xj9qjWo=; b=HwTd4bUm0SCOXFFHbpbHGuDWhoTSyqGhYi/WRLB6h3OWz4w+B5U+/HQA04I9mYN/gYfQv7kRX91AL+OU6pz8fAiBKbIa7889Shfa6cd0UIV0DusgPx9o9jsZcXUkGzCQyEUIwr21xm7YeZtKZvR+kkKRDIBYsJEuy0QxdN4F5dMCdPlf54qnRACgMZwPCcytqgATv8Ue0GP6EhDxDjYBvwY23Fjv7w4mfr0RGavjybqTgigL4BQCWxA5RP0lQolngnaRDCkrDB3mVkSMauxt1Ut3/o7l2SG2tTczjOEEwRyE1SQyIVIJgocEI6zNwAIkETzP1wJnpmiwQ70zFo1Lxw== Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c00:19::29) by YQBPR0101MB4777.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:c01:18::8) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4173.28; Mon, 31 May 2021 15:52:38 +0000 Received: from YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::583:528b:dbac:37bf]) by YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM ([fe80::583:528b:dbac:37bf%4]) with mapi id 15.20.4173.030; Mon, 31 May 2021 15:52:38 +0000 From: Rick Macklem To: Mateusz Guzik , Dimitry Andric CC: FreeBSD Current , Rick Macklem Subject: Re: Panics in recent NFS server Thread-Topic: Panics in recent NFS server Thread-Index: AQHXViaWmOgwBnlD30uTFQ19JhtRYar9qgCAgAABKICAAATmgIAADI3i Date: Mon, 31 May 2021 15:52:38 +0000 Message-ID: References: , In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-office365-filtering-correlation-id: ca186920-3174-422b-965f-08d9244c1dbc x-ms-traffictypediagnostic: YQBPR0101MB4777: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:283; x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: cM/iHX1is4kFB6Lif82lxVYCzh74UAm8T45nBnhzalocbZ2nYuo7DYHrFFpRgaJKChyYlki0Gk+hMrbLnpFfiFmgWI/1QYxG0NbpD5Ls1NdZaEdnUbnFVG8ZlRCN+RR+UhCU9qfsjGB4fNLgB15NAOF46tJcbbuTp/gY8TsoOjZPKDraCSLIPJFRTVn58P/1wi80j7MDrBdNqzx42LGqBsatrCVKpPGxfn+nr8+Pt8lKUhDPo/7n3pwywI545v47nr1wn7ge8c5Bb5Ms9GK1KFPNIA1oAtlk7ElVW7CYuipb4a5wWLIUgVebQewQVn+mPvxm44XlJxJuE9sY24fjBefnMa5TMFV+IqxzM/tQ87P+M1FlahI3CFjh13lxikKdJnlLLI/VldxTmoE2FKHljhWDR8WiWIXgAgs53QJGimk1pUQK2/u6NEE9UlYKJfCCfbb4xC/NkRdEvE7Wy0RY7sqn+Fo2X/M9uzYjMUwVD6GrrhEh6xKOsx6ANRl1AOP7EXz7sKWbq6IKvoL93+5DwJBGS1ZRsEfuqgsSmteeYY1izn/4G48kaZEHbCt0j29ixY3ndP3cIbQ+B5qNn27b0dXReaTlpMa3vE18Fbb+q64= x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(376002)(346002)(39860400002)(366004)(136003)(396003)(6506007)(33656002)(5660300002)(86362001)(8676002)(66446008)(66556008)(8936002)(52536014)(7696005)(76116006)(55016002)(83380400001)(4326008)(186003)(478600001)(71200400001)(38100700002)(122000001)(54906003)(110136005)(786003)(9686003)(316002)(64756008)(66946007)(66476007)(2906002);DIR:OUT;SFP:1101; x-ms-exchange-antispam-messagedata: =?iso-8859-1?Q?8lGRkNIaCNRE4mEenDlyHoNW6m+CY68IlVe/BUf860CXkrcMXsbj9zMFMU?= =?iso-8859-1?Q?CZkpK2opQ/6i4fZCIfCsTa5+p87yVzUS7/KdjVCkVnvfdcyE0csND5uOSj?= =?iso-8859-1?Q?9Fiz4dksJmOCJAhuwGH2pnaJeBuTLFQyyAdXcidL4z/QDKmNJhJUt/nyfE?= =?iso-8859-1?Q?okCL7hkJU+FNq2ybFMoHFSLWC1Z/JckjonyhSv4HT2M2mPRrE2Rx6nfnsP?= =?iso-8859-1?Q?qgvA5+1gBwn3Z7tK4t9/LBuRlQfhzzBT4e/UuX0gj+zq0elroD0bBgWkqn?= =?iso-8859-1?Q?gXlxSObdDrweo4SXglILIU9vwqk46YrflFpjUTUL6Mh9nXar1rV5NVV/ux?= =?iso-8859-1?Q?m3V+0qTkdceC+eSB1G+XZv0sBnRlXM+1dXQ0R6FK/sG0B0Yab8L3K5KBFE?= =?iso-8859-1?Q?hO+IOu1++Rm1bB+Ma+2UxngCw4zzHe9lcC6xiUNy9Mb2zkiuCHSyCUGIW1?= =?iso-8859-1?Q?qdocAXE8eKk0llOi+x74C3QMoyMFSuyioc5CIp/OV9625eYfRXGteHfFQr?= =?iso-8859-1?Q?48QigIh8dQfQEoXQQGP305mv/Dqx2ZZXjZRv3dWwld5yGxNdzPBGigc3T9?= =?iso-8859-1?Q?P4YrfnJWV4crNx7eFJXPy0RnF/Do6J0wVM1xXyWqIJRsH0q4ak2Br2x0pC?= =?iso-8859-1?Q?mK/bZFVBkmWMsFth+jCyd8TRUN1eANBNK+Pb038+Yme9aknHgfFsOQTofJ?= =?iso-8859-1?Q?AwR//v/pNK3RNJlhAzYS7DaxHuzl1Xxt/6zGYOa5rwxwPCMyPQdL+cJrEY?= =?iso-8859-1?Q?3NxPM8fqta3qnN7oo5jokSXoipV1+1jV857R2iWJ6oAqQ4EGEIz4TAiTJ7?= =?iso-8859-1?Q?V3KkUZR4XxXchMQpIobO3QTW7l5+APpYTAzCfhje0d7mD/nRVz3V8by4dq?= =?iso-8859-1?Q?EsEhhILMJFPRfvYaZNo7nAdd7oMZupaGL9zzckImilZkeIm47dqVYgQbY2?= =?iso-8859-1?Q?z5XQ7lhPtNVG/Jq2I0c2vl9b5Ji5R7VRZv4tJtymlJWQiuC/ICEB44jovw?= =?iso-8859-1?Q?xF9dEoXNWsgiOpCZIIFukMHe4Zs9p0AYSol9i1aXirK3odVxOWr7YzEt6G?= =?iso-8859-1?Q?mEKiP4cu05mdpZSVsR+TK+H6+W+5p5jXVB32iZeHVvfqxwXBy8k2Tzx9D4?= =?iso-8859-1?Q?VevWjz2zroIwR7Wqy7YLD4wylVEGUdj6E2VJAwBV4XGVCvlfK5xvf16+EU?= =?iso-8859-1?Q?AuTs+nBAxjk+4lS7NOV6xyih0lpbF7SoViKVIgJSGrUIP1cXh1o9ViiBMz?= =?iso-8859-1?Q?Vr9t12ToeDbAl6Ap/8D8PHQM3Jb1BZAnlCV8KC2Ze5lFeG68CGQ3MF58MP?= =?iso-8859-1?Q?z0LbjFSbCWLJ9oIVCcev2eL5RVFUqsL//Re9TZU2BP3hKJO3MavcdGtuqc?= =?iso-8859-1?Q?0gAw/eFBIOK3wBc+aIfw+PJiSyk3dxXpvXImBTkbo+K2plPnqGDNY=3D?= x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org MIME-Version: 1.0 X-OriginatorOrg: uoguelph.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YQXPR0101MB0968.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: ca186920-3174-422b-965f-08d9244c1dbc X-MS-Exchange-CrossTenant-originalarrivaltime: 31 May 2021 15:52:38.3929 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: be62a12b-2cad-49a1-a5fa-85f4f3156a7d X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: dnLye7lyXoUkj5CVa+OoPJyRB1pYwiFKnsalfV0ZRq9F2DWiKIZUuPyQWEO2bYKw4IpSXVc70Va+bQ0l+WdzCQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: YQBPR0101MB4777 X-Rspamd-Queue-Id: 4Fv0DR5xRNz3nRQ X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] X-ThisMailContainsUnwantedMimeParts: N Mateusz Guzik wrote:=0A= >I reproduced the panic, things work for me with the patch below.=0A= >However, there may be more to it so I'm going to ask Rick to weigh in.=0A= >but short version is that length returned by nfsrv_parsename is off by=0A= >one compared to copyinstr.=0A= Yes, it appears that, now, ni_pathlen includes the nul termination characte= r.=0A= I don't think that was always the case, but I can't be bothered to search= =0A= back through the commits to try and find when it changed.=0A= =0A= As such, this patch looks fine and you can consider it reviewed by me.=0A= =0A= rick=0A= =0A= diff --git a/sys/fs/nfsserver/nfs_nfsdsubs.c b/sys/fs/nfsserver/nfs_nfsdsub= s.c=0A= index 2b6e17752544..8c7db36bbd05 100644=0A= --- a/sys/fs/nfsserver/nfs_nfsdsubs.c=0A= +++ b/sys/fs/nfsserver/nfs_nfsdsubs.c=0A= @@ -2065,7 +2065,7 @@ nfsrv_parsename(struct nfsrv_descript *nd, char=0A= *bufp, u_long *hashp,=0A= }=0A= }=0A= *tocp =3D '\0';=0A= - *outlenp =3D (size_t)outlen;=0A= + *outlenp =3D (size_t)outlen + 1;=0A= if (hashp !=3D NULL)=0A= *hashp =3D hash;=0A= nfsmout:=0A= =0A= =0A= On 5/31/21, Mateusz Guzik wrote:=0A= > On 5/31/21, Mateusz Guzik wrote:=0A= >> It's probably my commit d81aefa8b7dd8cbeffeda541fca9962802404983 ,=0A= >> I'll look at this later.=0A= >=0A= > Well let me rephrase. While the panic was added in said commit, I=0A= > suspect the bug is on nfs side -- it has its own namei variant which I=0A= > suspect is managing ni_pathlen in a manner different than the=0A= > original, it just happens to not panic on kernels prior to the above=0A= > change.=0A= >=0A= >>=0A= >> On 5/31/21, Dimitry Andric wrote:=0A= >>> Hi,=0A= >>>=0A= >>> I recently upgraded a -CURRENT NFS server from 2021-05-12 to today=0A= >>> (2021-05-31), and when the first NFS client attempted to connect, I got= =0A= >>> this=0A= >>> panic:=0A= >>>=0A= >>> panic: lookup: expected nul at 0xfffff800104b3002; string [dim]=0A= >>>=0A= >>> cpuid =3D 0=0A= >>> time =3D 1622463863=0A= >>> KDB: stack backtrace:=0A= >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame=0A= >>> 0xfffffe00747e89b0=0A= >>> vpanic() at vpanic+0x187/frame 0xfffffe00747e8a10=0A= >>> panic() at panic+0x43/frame 0xfffffe00747e8a70=0A= >>> lookup() at lookup+0xad2/frame 0xfffffe00747e8b10=0A= >>> nfsvno_namei() at nfsvno_namei+0x1a4/frame 0xfffffe00747e8bc0=0A= >>> nfsrvd_lookup() at nfsrvd_lookup+0x191/frame 0xfffffe00747e8eb0=0A= >>> nfsrvd_dorpc() at nfsrvd_dorpc+0xfab/frame 0xfffffe00747e90c0=0A= >>> nfssvc_program() at nfssvc_program+0x604/frame 0xfffffe00747e92a0=0A= >>> svc_run_internal() at svc_run_internal+0xa72/frame 0xfffffe00747e93d0= =0A= >>> svc_run() at svc_run+0x250/frame 0xfffffe00747e9430=0A= >>> nfsrvd_nfsd() at nfsrvd_nfsd+0x33c/frame 0xfffffe00747e9590=0A= >>> nfssvc_nfsd() at nfssvc_nfsd+0x473/frame 0xfffffe00747e9aa0=0A= >>> sys_nfssvc() at sys_nfssvc+0xc7/frame 0xfffffe00747e9ac0=0A= >>> amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe00747e9bf0=0A= >>> fast_syscall_common() at fast_syscall_common+0xf8/frame=0A= >>> 0xfffffe00747e9bf0=0A= >>> --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip =3D 0x8011aa59a, rsp = =3D=0A= >>> 0x7fffffffe4e8, rbp =3D 0x7fffffffe780 ---=0A= >>> KDB: enter: panic=0A= >>>=0A= >>> __curthread ()=0A= >>> at /share/dim/src/freebsd/src-dim/sys/amd64/include/pcpu_aux.h:55= =0A= >>> 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" (offsetof(stru= ct pcpu,=0A= >>> (kgdb) #0 __curthread ()=0A= >>> at /share/dim/src/freebsd/src-dim/sys/amd64/include/pcpu_aux.h:55= =0A= >>> #1 doadump (textdump=3Dtextdump@entry=3D0)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:399=0A= >>> #2 0xffffffff804cca5a in db_dump (dummy=3D,=0A= >>> dummy2=3D, dummy3=3D, dummy4=3D)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:575=0A= >>> #3 0xffffffff804cc912 in db_command (last_cmdp=3D,=0A= >>> cmd_table=3D, dopager=3Ddopager@entry=3D1)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:482=0A= >>> #4 0xffffffff804cc58d in db_command_loop ()=0A= >>> at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:535=0A= >>> #5 0xffffffff804cfd06 in db_trap (type=3D, code=3D>> out>)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/ddb/db_main.c:270=0A= >>> #6 0xffffffff80c69f17 in kdb_trap (type=3Dtype@entry=3D3,=0A= >>> code=3Dcode@entry=3D0,=0A= >>> tf=3Dtf@entry=3D0xfffffe00747e88e0)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/subr_kdb.c:727=0A= >>> #7 0xffffffff810d7aee in trap (frame=3D0xfffffe00747e88e0)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/amd64/amd64/trap.c:576=0A= >>> #8 =0A= >>> #9 kdb_enter (why=3D0xffffffff812d3d27 "panic", msg=3D)= =0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/subr_kdb.c:506=0A= >>> #10 0xffffffff80c1d248 in vpanic (=0A= >>> fmt=3D0xffffffff8129dfef "%s: expected nul at %p; string [%s]\n",= =0A= >>> ap=3D, ap@entry=3D0xfffffe00747e8a50)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:907=0A= >>> #11 0xffffffff80c1cfd3 in panic (=0A= >>> fmt=3D0xffffffff81e9b9c8 "=3D\t)\201\377\377\377\377")= =0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:843=0A= >>> #12 0xffffffff80cfa992 in lookup (ndp=3Dndp@entry=3D0xfffffe00747e8d90)= =0A= >>> at /share/dim/src/freebsd/src-dim/sys/kern/vfs_lookup.c:919=0A= >>> #13 0xffffffff80b33f84 in nfsvno_namei (nd=3Dnd@entry=3D0xfffffe00747e9= 100,=0A= >>> ndp=3Dndp@entry=3D0xfffffe00747e8d90, dp=3D,=0A= >>> dp@entry=3D0xfffff80010544380, islocked=3D,=0A= >>> islocked@entry=3D0,=0A= >>> exp=3Dexp@entry=3D0xfffffe00747e8fd8, p=3Dp@entry=3D0xfffffe00bbfa3= 000,=0A= >>> retdirp=3D0xfffffe00747e8e78)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdport.c:597=0A= >>> #14 0xffffffff80b266a1 in nfsrvd_lookup (nd=3D0xfffffe00747e9100,=0A= >>> isdgram=3D, dp=3D0xfffff80010544380,=0A= >>> vpp=3D0xfffffe00747e9010,=0A= >>> fhp=3D0xfffffe00747e9074, exp=3D0xfffffe00747e8fd8)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdserv.c:607=0A= >>> #15 0xffffffff80b1073b in nfsrvd_compound (nd=3D0xfffffe00747e9100,=0A= >>> isdgram=3D0,=0A= >>> tag=3D0xf , taglen=3D6,= =0A= >>> minorvers=3D4294967294)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdsocket.c:1098= =0A= >>> #16 nfsrvd_dorpc (nd=3Dnd@entry=3D0xfffffe00747e9100,=0A= >>> isdgram=3Disdgram@entry=3D0,=0A= >>> tag=3D0xf , taglen=3D6,= =0A= >>> minorvers=3D4294967294)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdsocket.c:626=0A= >>> #17 0xffffffff80b24c44 in nfs_proc (nd=3D0xfffffe00747e9100,=0A= >>> xid=3D, xprt=3D0xfffff80003a14e00, rpp=3D)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:402=0A= >>> #18 nfssvc_program (rqst=3D0xfffff80010455800, xprt=3D0xfffff80003a14e0= 0)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:288=0A= >>> #19 0xffffffff80edead2 in svc_executereq (rqstp=3D0xfffff80010455800)= =0A= >>> at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1037=0A= >>> #20 svc_run_internal (grp=3D, grp@entry=3D0xfffff800100e= 6100,=0A= >>> ismaster=3Dismaster@entry=3D1)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1313=0A= >>> #21 0xffffffff80eddf80 in svc_run (pool=3D)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1392=0A= >>> #22 0xffffffff80b251ec in nfsrvd_nfsd (td=3D,=0A= >>> td@entry=3D0xfffffe00bbfa3000, args=3Dargs@entry=3D0xfffffe00747e96= 60)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:561=0A= >>> #23 0xffffffff80b3ec93 in nfssvc_nfsd (td=3D0xfffffe00bbfa3000,=0A= >>> uap=3D)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdport.c:3714=0A= >>> #24 0xffffffff80e6f647 in sys_nfssvc (td=3D0xfffffe00bbfa3000,=0A= >>> uap=3D0xfffffe00bbfa33e8)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/nfs/nfs_nfssvc.c:111=0A= >>> #25 0xffffffff810d891e in syscallenter (td=3D)=0A= >>> at=0A= >>> /share/dim/src/freebsd/src-dim/sys/amd64/amd64/../../kern/subr_syscall.= c:189=0A= >>> #26 amd64_syscall (td=3D0xfffffe00bbfa3000, traced=3D0)=0A= >>> at /share/dim/src/freebsd/src-dim/sys/amd64/amd64/trap.c:1156=0A= >>> #27 =0A= >>> #28 0x00000008011aa59a in ?? ()=0A= >>>=0A= >>> Is anybody seeing this too? :)=0A= >>>=0A= >>> I can probably bisect, but it'll take quite a while.=0A= >>>=0A= >>> -Dimitry=0A= >>>=0A= >>>=0A= >>=0A= >>=0A= >> --=0A= >> Mateusz Guzik =0A= >>=0A= >=0A= >=0A= > --=0A= > Mateusz Guzik =0A= >=0A= =0A= =0A= --=0A= Mateusz Guzik =0A=