Date: Fri, 13 Oct 2017 04:36:34 -0700 From: David Wolfskill <david@catwhisker.org> To: current@freebsd.org Subject: @r324591: panic: UNR inconsistency: items 0 found 7 (line 361) Message-ID: <20171013113634.GR1287@albert.catwhisker.org>
next in thread | raw e-mail | index | archive | help
--w5H9inKjI0oWCkP3
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
This occurred after I had booted & smoke-tested my laptop, then
issued "sudo shutdown -r now"; it's *possible* that there was also
a (similar?) problem shutting down yesterday (@r324542), but the
screen had gone dark and declined to shed any light, so I'm not
sure on that point.
uname strings (yesterday & today):
FreeBSD g1-252.catwhisker.org 12.0-CURRENT FreeBSD 12.0-CURRENT #429 r3245=
42M/324546:1200051: Thu Oct 12 05:09:28 PDT 2017 root@g1-252.catwhisker=
=2Eorg:/common/S4/obj/usr/src/sys/CANARY amd64
FreeBSD g1-252.catwhisker.org 12.0-CURRENT FreeBSD 12.0-CURRENT #430 r3245=
91M/324591:1200051: Fri Oct 13 03:58:11 PDT 2017 root@g1-252.catwhisker=
=2Eorg:/common/S4/obj/usr/src/sys/CANARY amd64
Panic message, kernel buffer & stack trace from today:
panic: UNR inconsistency: items 0 found 7 (line 361)
Unread portion of the kernel message buffer:
<118>Writing entropy file:.
<118>Writing early boot entropy file:.
<118>.
<118>Terminated
<118>Oct 13 11:09:19 g1-252 syslogd: exiting on signal 15
<5>wlan0: link state changed to DOWN
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `bufdaemon' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop...=20
Syncing disks, vnodes remaining... 10 9 9 5 2 2 1 1 1 0 0 0 0 0 done
All buffers synced.
lock order reversal:
1st 0xfffff8000efdd5f0 ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1274
2nd 0xfffff8000efdd068 syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2768
stack backtrace:
#0 0xffffffff80a95693 at witness_debugger+0x73
#1 0xffffffff80a95512 at witness_checkorder+0xe02
#2 0xffffffff80a07e9e at lockmgr_lock_fast_path+0x1ae
#3 0xffffffff80fb2c20 at VOP_LOCK1_APV+0xe0
#4 0xffffffff80b0ed26 at _vn_lock+0x66
#5 0xffffffff80afdfd6 at vputx+0x156
#6 0xffffffff80af5a38 at dounmount+0x4d8
#7 0xffffffff80aff75b at vfs_unmountall+0x6b
#8 0xffffffff80adb6a3 at bufshutdown+0x393
#9 0xffffffff80a31b49 at kern_reboot+0x189
#10 0xffffffff80a31964 at sys_reboot+0x3c4
#11 0xffffffff80e4ab5b at amd64_syscall+0x7ab
#12 0xffffffff80e29b5b at Xfast_syscall+0xfb
lock order reversal:
1st 0xfffff8000efde7c8 devfs (devfs) @ /usr/src/sys/kern/vfs_mount.c:1274
2nd 0xfffff8000efde240 syncer (syncer) @ /usr/src/sys/kern/vfs_subr.c:2768
stack backtrace:
#0 0xffffffff80a95693 at witness_debugger+0x73
#1 0xffffffff80a95512 at witness_checkorder+0xe02
#2 0xffffffff80a07e9e at lockmgr_lock_fast_path+0x1ae
#3 0xffffffff80fb2c20 at VOP_LOCK1_APV+0xe0
#4 0xffffffff80b0ed26 at _vn_lock+0x66
#5 0xffffffff80afdfd6 at vputx+0x156
#6 0xffffffff80af5a38 at dounmount+0x4d8
#7 0xffffffff80aff75b at vfs_unmountall+0x6b
#8 0xffffffff80adb6a3 at bufshutdown+0x393
#9 0xffffffff80a31b49 at kern_reboot+0x189
#10 0xffffffff80a31964 at sys_reboot+0x3c4
#11 0xffffffff80e4ab5b at amd64_syscall+0x7ab
#12 0xffffffff80e29b5b at Xfast_syscall+0xfb
lock order reversal:
1st 0xfffff8000ee3b7c8 ufs (ufs) @ /usr/src/sys/kern/vfs_mount.c:1274
2nd 0xfffff8000ee3bd50 devfs (devfs) @ /usr/src/sys/ufs/ffs/ffs_vfsops.c:1=
414
stack backtrace:
#0 0xffffffff80a95693 at witness_debugger+0x73
#1 0xffffffff80a95512 at witness_checkorder+0xe02
#2 0xffffffff80a07e9e at lockmgr_lock_fast_path+0x1ae
#3 0xffffffff80fb2c20 at VOP_LOCK1_APV+0xe0
#4 0xffffffff80b0ed26 at _vn_lock+0x66
#5 0xffffffff80d3c5f3 at ffs_flushfiles+0x93
#6 0xffffffff80d1fef2 at softdep_flushfiles+0x82
#7 0xffffffff80d3ebc7 at ffs_unmount+0x77
#8 0xffffffff80af5a78 at dounmount+0x518
#9 0xffffffff80aff75b at vfs_unmountall+0x6b
#10 0xffffffff80adb6a3 at bufshutdown+0x393
#11 0xffffffff80a31b49 at kern_reboot+0x189
#12 0xffffffff80a31964 at sys_reboot+0x3c4
#13 0xffffffff80e4ab5b at amd64_syscall+0x7ab
#14 0xffffffff80e29b5b at Xfast_syscall+0xfb
panic: UNR inconsistency: items 0 found 7 (line 361)
cpuid =3D 0
time =3D 1507892985
KDB: stack backtrace:
db_trace_self_wrapper() at 0xffffffff803a762b =3D db_trace_self_wrapper+0x2=
b/frame 0xfffffe0ba17c0620
vpanic() at 0xffffffff80a3234c =3D vpanic+0x19c/frame 0xfffffe0ba17c06a0
kassert_panic() at 0xffffffff80a321a6 =3D kassert_panic+0x126/frame 0xfffff=
e0ba17c0710
check_unrhdr() at 0xffffffff80a8ea10 =3D check_unrhdr+0x230/frame 0xfffffe0=
ba17c0760
delete_unrhdr() at 0xffffffff80a8eb13 =3D delete_unrhdr+0x13/frame 0xfffffe=
0ba17c0780
tmpfs_free_tmp() at 0xffffffff83214a4f =3D tmpfs_free_tmp+0x6f/frame 0xffff=
fe0ba17c07a0
tmpfs_unmount() at 0xffffffff832152b0 =3D tmpfs_unmount+0x1f0/frame 0xfffff=
e0ba17c07f0
dounmount() at 0xffffffff80af5a78 =3D dounmount+0x518/frame 0xfffffe0ba17c0=
860
vfs_unmountall() at 0xffffffff80aff75b =3D vfs_unmountall+0x6b/frame 0xffff=
fe0ba17c0890
bufshutdown() at 0xffffffff80adb6a3 =3D bufshutdown+0x393/frame 0xfffffe0ba=
17c08e0
kern_reboot() at 0xffffffff80a31b49 =3D kern_reboot+0x189/frame 0xfffffe0ba=
17c0920
sys_reboot() at 0xffffffff80a31964 =3D sys_reboot+0x3c4/frame 0xfffffe0ba17=
c0980
amd64_syscall() at 0xffffffff80e4ab5b =3D amd64_syscall+0x7ab/frame 0xfffff=
e0ba17c0ab0
Xfast_syscall() at 0xffffffff80e29b5b =3D Xfast_syscall+0xfb/frame 0xfffffe=
0ba17c0ab0
--- syscall (55, FreeBSD ELF64, sys_reboot), rip =3D 0x40ebfa, rsp =3D 0x7f=
ffffffe708, rbp =3D 0x7fffffffe7f0 ---
KDB: enter: panic
__curthread () at ./machine/pcpu.h:232
232 __asm("movq %%gs:%1,%0" : "=3Dr" (td)
(kgdb) #0 __curthread () at ./machine/pcpu.h:232
#1 doadump (textdump=3D0) at /usr/src/sys/kern/kern_shutdown.c:318
#2 0xffffffff803a498b in db_dump (dummy=3D<optimized out>,=20
dummy2=3D<unavailable>, dummy3=3D<unavailable>, dummy4=3D<unavailable>)
at /usr/src/sys/ddb/db_command.c:572
#3 0xffffffff803a4749 in db_command (last_cmdp=3D<optimized out>,=20
cmd_table=3D<optimized out>, dopager=3D<optimized out>)
at /usr/src/sys/ddb/db_command.c:479
#4 0xffffffff803a44e4 in db_command_loop ()
at /usr/src/sys/ddb/db_command.c:532
#5 0xffffffff803a777f in db_trap (type=3D<optimized out>, code=3D<optimize=
d out>)
at /usr/src/sys/ddb/db_main.c:248
#6 0xffffffff80a75813 in kdb_trap (type=3D3, code=3D-61456, tf=3D<optimize=
d out>)
at /usr/src/sys/kern/subr_kdb.c:654
#7 0xffffffff80e495db in trap (frame=3D0xfffffe0ba17c0550)
at /usr/src/sys/amd64/amd64/trap.c:536
#8 <signal handler called>
#9 kdb_enter (why=3D0xffffffff813999e1 "panic", msg=3D<optimized out>)
at /usr/src/sys/kern/subr_kdb.c:444
#10 0xffffffff80a32369 in vpanic (fmt=3D<optimized out>, ap=3D0xfffffe0ba17=
c06e0)
at /usr/src/sys/kern/kern_shutdown.c:772
#11 0xffffffff80a321a6 in kassert_panic (
fmt=3D0xffffffff813a341e "UNR inconsistency: items %u found %u (line %d=
)\n")
at /usr/src/sys/kern/kern_shutdown.c:669
#12 0xffffffff80a8ea10 in check_unrhdr (uh=3D<optimized out>, line=3D361)
at /usr/src/sys/kern/subr_unit.c:246
#13 0xffffffff80a8eb13 in delete_unrhdr (uh=3D0xfffff8000ec78500)
at /usr/src/sys/kern/subr_unit.c:361
#14 0xffffffff83214a4f in tmpfs_free_tmp (tmp=3D0xfffff8000eee0900)
at /usr/src/sys/fs/tmpfs/tmpfs_vfsops.c:347
#15 0xffffffff832152b0 in tmpfs_unmount (mp=3D0xfffff8000ef6d000,=20
mntflags=3D<optimized out>) at /usr/src/sys/fs/tmpfs/tmpfs_vfsops.c:323
#16 0xffffffff80af5a78 in dounmount (mp=3D0xffffffff81b89ec0 <cnputs_mtx+24=
>,=20
flags=3D524288, td=3D0xfffff8000a8d7560) at /usr/src/sys/kern/vfs_mount=
=2Ec:1369
#17 0xffffffff80aff75b in unmount_or_warn (mp=3D<optimized out>)
at /usr/src/sys/kern/vfs_subr.c:4028
#18 vfs_unmountall () at /usr/src/sys/kern/vfs_subr.c:4062
#19 0xffffffff80adb6a3 in bufshutdown (show_busybufs=3D1)
at /usr/src/sys/kern/vfs_bio.c:1305
#20 0xffffffff80a31b49 in kern_reboot (howto=3D0)
at /usr/src/sys/kern/kern_shutdown.c:372
#21 0xffffffff80a31964 in sys_reboot (td=3D0xfffff8000a8d7560,=20
uap=3D0xfffff8000a8d7910) at /usr/src/sys/kern/kern_shutdown.c:248
#22 0xffffffff80e4ab5b in syscallenter (td=3D0xfffff8000a8d7560)
at /usr/src/sys/amd64/amd64/../../kern/subr_syscall.c:132
#23 amd64_syscall (td=3D0xfffff8000a8d7560, traced=3D0)
at /usr/src/sys/amd64/amd64/trap.c:917
#24 <signal handler called>
#25 0x000000000040ebfa in ?? ()
Backtrace stopped: Cannot access memory at address 0x7fffffffe708
(kgdb)=20
[Above cribbed from core.txt.2.]
I will copy the core and a few other possibly-interesting bits to
<http://www.catwhisker.org/~david/FreeBSD/head/r324591/>; other
bits that may be of interest (e.g., verbose dmesg.boot) may be found
=66rom <http://www.catwhisker.org/~david/FreeBSD/history/>. [This
is residential ADSL, so it's not high-bandwidth, especially for
data going from me to you.]
Here's what's in place:
albert(11.1-S)[12] dirs
~/public_html/FreeBSD/head/r324591=20
albert(11.1-S)[13] ls -lTh
total 423949
-rw-r--r-- 1 david staff 155K Oct 13 04:14:46 2017 core.txt.2
-rw-r--r-- 1 david staff 36K Oct 13 04:14:46 2017 core.txt.2.gz
-rw-r--r-- 1 david staff 513B Oct 13 04:14:30 2017 info.2
-rw-r--r-- 1 david staff 360B Oct 13 04:14:30 2017 info.2.gz
-rw-r--r-- 1 david staff 860M Oct 13 04:14:34 2017 vmcore.2
-rw-r--r-- 1 david staff 157M Oct 13 04:14:34 2017 vmcore.2.gz
albert(11.1-S)[14]=20
I note that my build machine (kept in lock-step for SVN revisions,
but running a GENERIC kernel) had no hint of an issue -- either
yesterday or today.
Peace,
david
--=20
David H. Wolfskill david@catwhisker.org
Unsubstantiated claims of "Fake News" are evidence that the claimant lies a=
gain.
See http://www.catwhisker.org/~david/publickey.gpg for my public key.
--w5H9inKjI0oWCkP3
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2
iQF8BAEBCgBmBQJZ4KVCXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w
ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXRDQ0I3Q0VGOTE3QTgwMUY0MzA2NEQ3N0Ix
NTM5Q0M0MEEwNDlFRTE3AAoJEBU5zECgSe4Xzy0IALNlsFBXTOXg7Z9TtIApXTxv
/z7AtUM65Fc/R6fU96DmgZUkqTbHXGwnseCU8517PT52nMw2ofihlHaLo3aA2DCu
iAiP2g3n9ibF27QTMya38mRIQ9/HqZrYw+jlAcEgbzoZVkLx10J/rTLBVHKH8MFI
lSutBECKHgpvwwibNZ2z4x5q43A1pfoa9M5UftXID49mJaM3h6Y6jW+AItts5l8L
HoD6DkwgTMCEY6S4JbWyjs8b8r7wxkhYpwNPiwOUWGkrfMKGEyLCFR8Un7jgIGGN
nCI5SLzDzedsb8bVNl2PnhAD70SRwnSJJSPunwcvDb9TYMmm+4VhtG9Gjrn9Avk=
=Fva0
-----END PGP SIGNATURE-----
--w5H9inKjI0oWCkP3--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20171013113634.GR1287>