From nobody Mon May 31 14:09:18 2021 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 6643CC7E33F for ; Mon, 31 May 2021 14:09:30 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4FtxxQ2S5Tz3C7X; Mon, 31 May 2021 14:09:30 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from tensor.andric.com (tensor.andric.com [87.251.56.140]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "tensor.andric.com", Issuer "R3" (verified OK)) (Authenticated sender: dim) by smtp.freebsd.org (Postfix) with ESMTPSA id 061DDF157; Mon, 31 May 2021 14:09:30 +0000 (UTC) (envelope-from dim@FreeBSD.org) Received: from smtpclient.apple (unknown [IPv6:2001:470:7a58:0:65d3:dfba:f1bc:9672]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by tensor.andric.com (Postfix) with ESMTPSA id D6A6249AF9; Mon, 31 May 2021 16:09:27 +0200 (CEST) From: Dimitry Andric Content-Type: multipart/signed; boundary="Apple-Mail=_6A6D3FD3-DE95-479E-84F0-A77F55B44979"; protocol="application/pgp-signature"; micalg=pgp-sha1 List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.100.0.2.22\)) Subject: Panics in recent NFS server Message-Id: Date: Mon, 31 May 2021 16:09:18 +0200 Cc: Rick Macklem To: FreeBSD Current X-Mailer: Apple Mail (2.3654.100.0.2.22) X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_6A6D3FD3-DE95-479E-84F0-A77F55B44979 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi, I recently upgraded a -CURRENT NFS server from 2021-05-12 to today = (2021-05-31), and when the first NFS client attempted to connect, I got = this panic: panic: lookup: expected nul at 0xfffff800104b3002; string [dim] cpuid =3D 0 time =3D 1622463863 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe00747e89b0 vpanic() at vpanic+0x187/frame 0xfffffe00747e8a10 panic() at panic+0x43/frame 0xfffffe00747e8a70 lookup() at lookup+0xad2/frame 0xfffffe00747e8b10 nfsvno_namei() at nfsvno_namei+0x1a4/frame 0xfffffe00747e8bc0 nfsrvd_lookup() at nfsrvd_lookup+0x191/frame 0xfffffe00747e8eb0 nfsrvd_dorpc() at nfsrvd_dorpc+0xfab/frame 0xfffffe00747e90c0 nfssvc_program() at nfssvc_program+0x604/frame 0xfffffe00747e92a0 svc_run_internal() at svc_run_internal+0xa72/frame 0xfffffe00747e93d0 svc_run() at svc_run+0x250/frame 0xfffffe00747e9430 nfsrvd_nfsd() at nfsrvd_nfsd+0x33c/frame 0xfffffe00747e9590 nfssvc_nfsd() at nfssvc_nfsd+0x473/frame 0xfffffe00747e9aa0 sys_nfssvc() at sys_nfssvc+0xc7/frame 0xfffffe00747e9ac0 amd64_syscall() at amd64_syscall+0x12e/frame 0xfffffe00747e9bf0 fast_syscall_common() at fast_syscall_common+0xf8/frame = 0xfffffe00747e9bf0 --- syscall (155, FreeBSD ELF64, sys_nfssvc), rip =3D 0x8011aa59a, rsp =3D= 0x7fffffffe4e8, rbp =3D 0x7fffffffe780 --- KDB: enter: panic __curthread () at /share/dim/src/freebsd/src-dim/sys/amd64/include/pcpu_aux.h:55 55 __asm("movq %%gs:%P1,%0" : "=3Dr" (td) : "n" = (offsetof(struct pcpu, (kgdb) #0 __curthread () at /share/dim/src/freebsd/src-dim/sys/amd64/include/pcpu_aux.h:55 #1 doadump (textdump=3Dtextdump@entry=3D0) at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:399 #2 0xffffffff804cca5a in db_dump (dummy=3D, dummy2=3D, dummy3=3D, = dummy4=3D) at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:575 #3 0xffffffff804cc912 in db_command (last_cmdp=3D, cmd_table=3D, dopager=3Ddopager@entry=3D1) at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:482 #4 0xffffffff804cc58d in db_command_loop () at /share/dim/src/freebsd/src-dim/sys/ddb/db_command.c:535 #5 0xffffffff804cfd06 in db_trap (type=3D, = code=3D) at /share/dim/src/freebsd/src-dim/sys/ddb/db_main.c:270 #6 0xffffffff80c69f17 in kdb_trap (type=3Dtype@entry=3D3, = code=3Dcode@entry=3D0, tf=3Dtf@entry=3D0xfffffe00747e88e0) at /share/dim/src/freebsd/src-dim/sys/kern/subr_kdb.c:727 #7 0xffffffff810d7aee in trap (frame=3D0xfffffe00747e88e0) at /share/dim/src/freebsd/src-dim/sys/amd64/amd64/trap.c:576 #8 #9 kdb_enter (why=3D0xffffffff812d3d27 "panic", msg=3D) at /share/dim/src/freebsd/src-dim/sys/kern/subr_kdb.c:506 #10 0xffffffff80c1d248 in vpanic ( fmt=3D0xffffffff8129dfef "%s: expected nul at %p; string [%s]\n", ap=3D, ap@entry=3D0xfffffe00747e8a50) at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:907 #11 0xffffffff80c1cfd3 in panic ( fmt=3D0xffffffff81e9b9c8 "=3D\t)\201\377\377\377\377") at /share/dim/src/freebsd/src-dim/sys/kern/kern_shutdown.c:843 #12 0xffffffff80cfa992 in lookup (ndp=3Dndp@entry=3D0xfffffe00747e8d90) at /share/dim/src/freebsd/src-dim/sys/kern/vfs_lookup.c:919 #13 0xffffffff80b33f84 in nfsvno_namei (nd=3Dnd@entry=3D0xfffffe00747e9100= , ndp=3Dndp@entry=3D0xfffffe00747e8d90, dp=3D, dp@entry=3D0xfffff80010544380, islocked=3D, = islocked@entry=3D0, exp=3Dexp@entry=3D0xfffffe00747e8fd8, p=3Dp@entry=3D0xfffffe00bbfa3000= , retdirp=3D0xfffffe00747e8e78) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdport.c:597 #14 0xffffffff80b266a1 in nfsrvd_lookup (nd=3D0xfffffe00747e9100, isdgram=3D, dp=3D0xfffff80010544380, = vpp=3D0xfffffe00747e9010, fhp=3D0xfffffe00747e9074, exp=3D0xfffffe00747e8fd8) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdserv.c:607 #15 0xffffffff80b1073b in nfsrvd_compound (nd=3D0xfffffe00747e9100, = isdgram=3D0, tag=3D0xf , taglen=3D6, minorvers=3D4294967294) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdsocket.c:1098 #16 nfsrvd_dorpc (nd=3Dnd@entry=3D0xfffffe00747e9100, = isdgram=3Disdgram@entry=3D0, tag=3D0xf , taglen=3D6, minorvers=3D4294967294) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdsocket.c:626 #17 0xffffffff80b24c44 in nfs_proc (nd=3D0xfffffe00747e9100, xid=3D, xprt=3D0xfffff80003a14e00, rpp=3D) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:402 #18 nfssvc_program (rqst=3D0xfffff80010455800, xprt=3D0xfffff80003a14e00) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:288 #19 0xffffffff80edead2 in svc_executereq (rqstp=3D0xfffff80010455800) at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1037 #20 svc_run_internal (grp=3D, = grp@entry=3D0xfffff800100e6100, ismaster=3Dismaster@entry=3D1) at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1313 #21 0xffffffff80eddf80 in svc_run (pool=3D) at /share/dim/src/freebsd/src-dim/sys/rpc/svc.c:1392 #22 0xffffffff80b251ec in nfsrvd_nfsd (td=3D, td@entry=3D0xfffffe00bbfa3000, args=3Dargs@entry=3D0xfffffe00747e9660)= at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdkrpc.c:561 #23 0xffffffff80b3ec93 in nfssvc_nfsd (td=3D0xfffffe00bbfa3000, uap=3D) at = /share/dim/src/freebsd/src-dim/sys/fs/nfsserver/nfs_nfsdport.c:3714 #24 0xffffffff80e6f647 in sys_nfssvc (td=3D0xfffffe00bbfa3000, uap=3D0xfffffe00bbfa33e8) at /share/dim/src/freebsd/src-dim/sys/nfs/nfs_nfssvc.c:111 #25 0xffffffff810d891e in syscallenter (td=3D) at = /share/dim/src/freebsd/src-dim/sys/amd64/amd64/../../kern/subr_syscall.c:1= 89 #26 amd64_syscall (td=3D0xfffffe00bbfa3000, traced=3D0) at /share/dim/src/freebsd/src-dim/sys/amd64/amd64/trap.c:1156 #27 #28 0x00000008011aa59a in ?? () Is anybody seeing this too? :) I can probably bisect, but it'll take quite a while. -Dimitry --Apple-Mail=_6A6D3FD3-DE95-479E-84F0-A77F55B44979 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.2 iF0EARECAB0WIQR6tGLSzjX8bUI5T82wXqMKLiCWowUCYLTuDgAKCRCwXqMKLiCW o30RAKCACOZxyQ8GioFJKfWMWVY4laV+GwCdGr+21OPXWp6QxVsmtps8KkiOlM0= =ft5j -----END PGP SIGNATURE----- --Apple-Mail=_6A6D3FD3-DE95-479E-84F0-A77F55B44979--