Date: Thu, 23 Feb 2012 23:45:58 +0900 (JST) From: Hiroki Sato <hrs@FreeBSD.org> To: stable@FreeBSD.org Subject: another panic in 8.3-PRERELEASE Message-ID: <20120223.234558.1101656075598772176.hrs@allbsd.org>
next in thread | raw e-mail | index | archive | help
----Security_Multipart(Thu_Feb_23_23_45_58_2012_702)--
Content-Type: Text/Plain; charset=us-ascii
Content-Transfer-Encoding: 7bit
Hi,
This is another reproducible panic. This seems to happen only when
top(1) is running for a long time (a sysctl() call for
CTL_KERN.KERN_PROC.KERN_PROC_PROC MIB triggered it).
----
pool.allbsd.org dumped core - see /var/crash/vmcore.0
Thu Feb 23 23:21:52 JST 2012
FreeBSD pool.allbsd.org 8.3-PRERELEASE FreeBSD 8.3-PRERELEASE #8: Thu Feb 23 04:40:54 JST 2012 hrs@pool.allbsd.org:/usr/obj/usr/src/sys/POOL amd64
panic:
GNU gdb 6.1.1 [FreeBSD]
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB. Type "show warranty" for details.
This GDB was configured as "amd64-marcel-freebsd"...
Unread portion of the kernel message buffer:
Fatal trap 12: page fault while in kernel mode
cpuid = 4; apic id = 04
fault virtual address = 0x800e96000
fault code = supervisor write data, protection violation
instruction pointer = 0x20:0xffffffff809440cb
stack pointer = 0x28:0xffffff86c63890b0
frame pointer = 0x28:0xffffff86c6389100
code segment = base 0x0, limit 0xfffff, type 0x1b
= DPL 0, pres 1, long 1, def32 0, gran 1
processor eflags = interrupt enabled, resume, IOPL = 0
current process = 47211 (top)
lock order reversal: (Giant after non-sleepable)
1st 0xffffff0244b85568 process lock (process lock) @ /usr/src/sys/kern/kern_proc.c:1211
2nd 0xffffffff80d74c80 Giant (Giant) @ /usr/src/sys/dev/usb/input/ukbd.c:2018
KDB: stack backtrace:
Dumping 23903 out of 24550 MB:..1%..11%..21%..31% (CTRL-C to abort) (CTRL-C to abort) ..41%..51%..61%..71%..81%..91%
Reading symbols from /boot/kernel/geom_mirror.ko...Reading symbols from /boot/kernel/geom_mirror.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/geom_mirror.ko
Reading symbols from /boot/kernel/zfs.ko...Reading symbols from /boot/kernel/zfs.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/zfs.ko
Reading symbols from /boot/kernel/opensolaris.ko...Reading symbols from /boot/kernel/opensolaris.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/opensolaris.ko
Reading symbols from /boot/kernel/ipfw.ko...Reading symbols from /boot/kernel/ipfw.ko.symbols...done.
done.
Loaded symbols for /boot/kernel/ipfw.ko
#0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263
263 if (textdump_pending)
(kgdb) #0 doadump () at /usr/src/sys/kern/kern_shutdown.c:263
#1 0xffffffff801f8cfc in db_fncall (dummy1=Variable "dummy1" is not available.
)
at /usr/src/sys/ddb/db_command.c:548
#2 0xffffffff801f9031 in db_command (last_cmdp=0xffffffff80d37f40, cmd_table=Variable "cmd_table" is not available.
) at /usr/src/sys/ddb/db_command.c:445
#3 0xffffffff801f9280 in db_command_loop ()
at /usr/src/sys/ddb/db_command.c:498
#4 0xffffffff801fb369 in db_trap (type=Variable "type" is not available.
) at /usr/src/sys/ddb/db_main.c:229
#5 0xffffffff8069dff1 in kdb_trap (type=12, code=0, tf=0xffffff86c6389000)
at /usr/src/sys/kern/subr_kdb.c:548
#6 0xffffffff809461ed in trap_fatal (frame=0xffffff86c6389000, eva=Variable "eva" is not available.
)
at /usr/src/sys/amd64/amd64/trap.c:820
#7 0xffffffff809468b5 in trap (frame=0xffffff86c6389000)
at /usr/src/sys/amd64/amd64/trap.c:326
#8 0xffffffff8092d2f4 in calltrap ()
at /usr/src/sys/amd64/amd64/exception.S:228
#9 0xffffffff809440cb in copyout () at /usr/src/sys/amd64/amd64/support.S:258
#10 0xffffffff80675f1f in sysctl_old_user (req=0xffffff86c63899c0,
p=0xffffff86c6389470, l=1088) at /usr/src/sys/kern/kern_sysctl.c:1276
#11 0xffffffff8065f6a6 in sysctl_out_proc_copyout (ki=0xffffff86c6389470,
req=0xffffff86c63899c0) at /usr/src/sys/kern/kern_proc.c:1085
#12 0xffffffff8065ff6c in sysctl_out_proc (p=0xffffff0244b85470,
req=0xffffff86c63899c0, flags=Variable "flags" is not available.
) at /usr/src/sys/kern/kern_proc.c:1114
#13 0xffffffff8066245e in sysctl_kern_proc (oidp=Variable "oidp" is not available.
)
at /usr/src/sys/kern/kern_proc.c:1302
#14 0xffffffff806756e8 in sysctl_root (oidp=Variable "oidp" is not available.
)
at /usr/src/sys/kern/kern_sysctl.c:1455
#15 0xffffffff8067598e in userland_sysctl (td=0x0, name=0xffffff86c6389a80,
namelen=3, old=0x800e96000, oldlenp=Variable "oldlenp" is not available.
)
at /usr/src/sys/kern/kern_sysctl.c:1565
#16 0xffffffff80675e3a in __sysctl (td=0xffffff0396ec5460,
uap=0xffffff86c6389bc0) at /usr/src/sys/kern/kern_sysctl.c:1491
#17 0xffffffff80945809 in amd64_syscall (td=0xffffff0396ec5460, traced=0)
at subr_syscall.c:114
#18 0xffffffff8092d5ec in Xfast_syscall ()
at /usr/src/sys/amd64/amd64/exception.S:387
#19 0x0000000800abecfc in ?? ()
Previous frame inner to this frame (corrupt stack?)
(kgdb)
----
db> show alllocks
Process 1169 (sshd) thread 0xffffff0022cfa460 (100715)
exclusive sx so_rcv_sx (so_rcv_sx) r = 0 (0xffffff0022d358f0) locked @ /usr/src/sys/kern/uipc_sockbuf.c:148
Process 865 (nfsd) thread 0xffffff00221b8000 (100611)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff02430e7d80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00221b28c0 (100595)
shared lockmgr zfs (zfs) r = 0 (0xffffff053a49fd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00221b3460 (100593)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff01e3aa87f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002219a8c0 (100590)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0570d1f620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00221a2460 (100579)
shared lockmgr zfs (zfs) r = 0 (0xffffff0566a86d80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022193460 (100574)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff05cbbc4ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022194000 (100572)
shared lockmgr zfs (zfs) r = 0 (0xffffff001d4137f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022195000 (100569)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff056d8cb620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002218f000 (100549)
shared lockmgr zfs (zfs) r = 0 (0xffffff02a8fcbd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002218f8c0 (100547)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0482a7d7f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022188460 (100534)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff01d13d0ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002218a000 (100532)
shared lockmgr zfs (zfs) r = 0 (0xffffff0071c7e620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002218a8c0 (100530)
shared lockmgr zfs (zfs) r = 0 (0xffffff017cc947f8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222fa8c0 (100525)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff014757aba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0366c7f9d0) locked @ /usr/src/sys/kern/vfs_lookup.c:504
Process 865 (nfsd) thread 0xffffff00222fb000 (100524)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff01b735b448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022183000 (100515)
shared lockmgr zfs (zfs) r = 0 (0xffffff058c41c098) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff0022183460 (100514)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff01dc0ebd80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222f28c0 (100505)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff04b1503098) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222f5460 (100500)
shared lockmgr zfs (zfs) r = 0 (0xffffff05d7345620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222f6000 (100498)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff02db1fb448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222e88c0 (100494)
shared lockmgr zfs (zfs) r = 0 (0xffffff02f6ccf620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222ea460 (100489)
exclusive sleep mutex mbuf (UMA zone) r = 0 (0xffffff063ffdf010) locked @ /usr/src/sys/vm/uma_core.c:2549
Process 865 (nfsd) thread 0xffffff00222ec460 (100483)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff05f6827448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222e28c0 (100477)
exclusive sleep mutex nfs_cache_mutex (nfs_cache_mutex) r = 0 (0xffffffff80d6af00) locked @ /usr/src/sys/fs/nfsserver/nfs_nfsdcache.c:710
Process 865 (nfsd) thread 0xffffff00222e4460 (100472)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff06102dc9d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222e78c0 (100465)
shared lockmgr zfs (zfs) r = 0 (0xffffff00314249d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222d88c0 (100460)
shared lockmgr zfs (zfs) r = 0 (0xffffff05f94be448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222d9460 (100458)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff03901d19d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222dc460 (100449)
shared lockmgr zfs (zfs) r = 0 (0xffffff013b57d9d0) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222ce8c0 (100443)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0392ed5270) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222d3000 (100433)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0034744ba8) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff002203c000 (100425)
shared lockmgr zfs (zfs) r = 0 (0xffffff05c3947620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222c1000 (100416)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff05102cf620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222728c0 (100412)
shared lockmgr zfs (zfs) r = 0 (0xffffff025c88a620) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff000cfb0460 (100407)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff01b121f448) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222b78c0 (100386)
shared lockmgr zfs (zfs) r = 0 (0xffffff0199eaad80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 865 (nfsd) thread 0xffffff00222b3000 (100368)
exclusive lockmgr zfs (zfs) r = 0 (0xffffff0493abad80) locked @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:1700
Process 18 (syncer) thread 0xffffff000c81d000 (100108)
exclusive lockmgr syncer (syncer) r = 0 (0xffffff000e0b1ba8) locked @ /usr/src/sys/kern/vfs_subr.c:1770
---
------------------------------------------------------------------------
ps -axl
UID PID PPID CPU PRI NI VSZ RSS MWCHAN STAT TT TIME COMMAND
0 0 0 0 -8 0 0 0 - DLs ?? 237844023158:14.90 [kernel]
0 1 0 0 52 0 3200 0 wait DLs ?? 2999235:54.00 [init]
0 2 0 0 -8 0 0 0 - DL ?? 2583291:48.00 [g_event]
0 3 0 0 -8 0 0 0 - RL ?? 8333529047:38.00 [g_up]
0 4 0 0 -8 0 0 0 - DL ?? 15508645836:58.00 [g_down]
0 5 0 0 -16 0 0 0 mps_sc DL ?? 6921236:34.00 [mps_scan0]
0 6 0 0 -16 0 0 0 waitin DL ?? 1851:28.00 [sctp_itera
0 7 0 0 -16 0 0 0 ccb_sc DL ?? 0:00.00 [xpt_thrd]
0 8 0 0 -16 0 0 0 psleep DL ?? 1117119713:56.00 [pagedaemon
0 9 0 0 -16 0 0 0 psleep DL ?? 398139:12.00 [vmdaemon]
0 10 0 0 -16 0 0 0 audit_ DL ?? 0:00.00 [audit]
0 11 0 0 171 0 0 0 - RL ?? 184151273702:09.87 [idle]
0 12 0 0 -60 0 0 0 - WL ?? 30539688189:18.00 [intr]
0 13 0 0 -16 0 0 0 - DL ?? 3943794171:44.00 [yarrow]
0 14 0 0 -40 0 0 0 - DL ?? 126924074:38.00 [usb]
0 15 0 0 76 0 0 0 pgzero DL ?? 24451:52.00 [pagezero]
0 16 0 0 -16 0 0 0 psleep DL ?? 8680471:14.00 [bufdaemon]
0 17 0 0 47 0 0 0 vlruwt DL ?? 1621276224:34.00 [vnlru]
0 18 0 0 20 0 0 0 syncer DL ?? 6868829552:00.00 [syncer]
0 19 0 0 -16 0 0 0 sdflus DL ?? 23321024:10.00 [softdepflu
0 20 0 0 -8 0 0 0 m:w1 DL ?? 46710556:18.00 [g_mirror g
0 60 0 0 -8 0 0 0 tx->tx DL ?? 59193927259:42.00 [zfskern]
0 113 0 0 -8 0 0 0 mdwait DL ?? 60546:18.00 [md0]
0 153 1 0 76 0 5832 508 pause DWs ?? 0:00.00 [adjkerntz]
0 732 1 0 44 0 6920 0 swread DLs ?? 4569221:32.00 [syslogd]
0 747 1 0 44 0 7976 0 select Ds ?? 5012299:26.00 [rpcbind]
0 782 1 0 76 0 6920 0 select Ds ?? 82364:00.00 [mountd]
0 800 1 0 76 0 5832 572 pause DWs ?? 0:00.00 [nfsuserd]
0 801 800 0 44 0 5832 0 select D ?? 1295896:48.00 [nfsuserd]
0 802 800 0 44 0 5832 0 select D ?? 1461188:16.00 [nfsuserd]
0 803 800 0 44 0 5832 0 select D ?? 1316882:20.00 [nfsuserd]
0 804 800 0 44 0 5832 0 select D ?? 1298376:06.00 [nfsuserd]
0 806 1 0 44 0 5828 0 select Ds ?? 1779972:34.00 [nfsd]
0 807 806 0 44 0 5828 0 rpcsvc D ?? 283962954521:04.24 [nfsd]
0 810 1 0 44 0 269036 0 select Ds ?? 1865349:46.00 [rpc.statd]
0 813 1 0 44 0 7976 0 rpcsvc Ds ?? 1741008680:34.00 [rpc.lockd]
0 852 1 0 44 0 11804 0 select Ds ?? 110532173:34.00 [ntpd]
1 860 1 0 44 0 5828 612 sbwait Ds ?? 29900093:08.00 [rwhod]
0 871 1 0 44 0 20908 0 select Ds ?? 110118584:36.00 [perl5.10.1
0 975 1 0 46 0 26172 0 select Ds ?? 1189785:06.00 [sshd]
0 1011 1 0 44 0 12024 0 select Ds ?? 33266547:42.00 [sendmail]
25 1029 1 0 44 0 12024 1040 pause DWs ?? 0:00.00 [sendmail]
0 1043 1 0 44 0 7976 732 nanslp Ds ?? 5102323:00.00 [cron]
0 1110 1 0 76 0 6916 0 ttyin Ds+ ?? 85587:56.00 [getty]
0 1111 1 0 76 0 6916 0 ttyin Ds+ ?? 84443:56.00 [getty]
0 1112 1 0 44 0 6916 0 ttyin Ds+ ?? 92258:54.00 [getty]
0 1113 975 0 50 0 29808 1988 sbwait DWs ?? 0:00.00 [sshd]
20001 1115 1113 0 44 0 29808 0 select D ?? 71721983:56.00 [sshd]
20001 1116 1115 0 44 0 10336 812 pause DWs ?? 0:00.00 [tcsh]
20001 3161 1116 0 46 0 8344 892 wait D ?? 76296945:54.00 [sh]
20001 11908 3161 0 46 0 2764 0 nanslp D ?? 42611:20.00 [sleep]
20001 47211 1116 0 44 0 9372 0 - R+ ?? 576339426:06.00 [top]
----
----Security_Multipart(Thu_Feb_23_23_45_58_2012_702)--
Content-Type: application/pgp-signature
Content-Transfer-Encoding: 7bit
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.11 (FreeBSD)
iEYEABECAAYFAk9GUSYACgkQTyzT2CeTzy2efQCggbkW4UgWgQ3LE3RUIYyRz4CD
xyQAn1N7SXKNgbwd14NRFyvwXI7F4PAB
=kjs7
-----END PGP SIGNATURE-----
----Security_Multipart(Thu_Feb_23_23_45_58_2012_702)----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20120223.234558.1101656075598772176.hrs>