From owner-freebsd-bugs@FreeBSD.ORG Thu Aug 21 06:00:13 2008 Return-Path: Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DBB2A106569B for ; Thu, 21 Aug 2008 06:00:13 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 3B3718FC24 for ; Thu, 21 Aug 2008 06:00:12 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.14.2/8.14.2) with ESMTP id m7L60CEa046068 for ; Thu, 21 Aug 2008 06:00:12 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.2/8.14.1/Submit) id m7L60C0v046067; Thu, 21 Aug 2008 06:00:12 GMT (envelope-from gnats) Resent-Date: Thu, 21 Aug 2008 06:00:12 GMT Resent-Message-Id: <200808210600.m7L60C0v046067@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, kevin Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A7BD61065676 for ; Thu, 21 Aug 2008 05:59:35 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (www.freebsd.org [IPv6:2001:4f8:fff6::21]) by mx1.freebsd.org (Postfix) with ESMTP id 9733B8FC19 for ; Thu, 21 Aug 2008 05:59:35 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from www.freebsd.org (localhost [127.0.0.1]) by www.freebsd.org (8.14.2/8.14.2) with ESMTP id m7L5xZYg074842 for ; Thu, 21 Aug 2008 05:59:35 GMT (envelope-from nobody@www.freebsd.org) Received: (from nobody@localhost) by www.freebsd.org (8.14.2/8.14.1/Submit) id m7L5xZWw074841; Thu, 21 Aug 2008 05:59:35 GMT (envelope-from nobody) Message-Id: <200808210559.m7L5xZWw074841@www.freebsd.org> Date: Thu, 21 Aug 2008 05:59:35 GMT From: kevin To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Cc: Subject: kern/126703: panic: _mtx_lock_sleep: recursed on non-recursive mutex vnode interlock X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Aug 2008 06:00:14 -0000 >Number: 126703 >Category: kern >Synopsis: panic: _mtx_lock_sleep: recursed on non-recursive mutex vnode interlock >Confidential: no >Severity: serious >Priority: high >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Thu Aug 21 06:00:11 UTC 2008 >Closed-Date: >Last-Modified: >Originator: kevin >Release: 8.0current >Organization: 163.org >Environment: FreeBSD xxx-laptop.people.163.org 8.0-CURRENT FreeBSD 8.0-CURRENT #36: Fri Aug 15 01:59:20 CST 2008 root@xxx-laptop.people.163.org:/usr/obj/usr/src/sys/G8laptop amd64 >Description: db>show msgbuf msgbufp =0xffffffff81420fe0 magic = 63062, size = 65504, r= 17561, w = 18105, ptr = 0xffffffff81411000, cksum= 1482817 _mtx_lock_flags() at _mtx_lock_flags+0x65 zfs_znode_free() at zfs_znode_free+0x91 zfs_freebsd_inactive() at zfs_freebsd_inactive+0x1a vinactive() at vinactive+0x6b vput() at vput+0x218 kern_statat() at kern_statat+0xf1 lstat() at lstat+0x22 syscall() at syscall+0x1dd Xfast_syscall() at Xfast_syacall+0xab --- syscall (190, FreeBSD ELF64, lstat),rip = 0x8009b788c,rsp = 0x7ffffffe358,rdp = 0x6b6040 --- panic: _mtx_lock_sleep: recursed on non-recursive mutex vnode interlock @ /usr/src/sys/kern/vfs_subr.c:2298 cpuid = 1 KDB: enter:panic Copyright...... ... db> bt Tracing pid 3242 tid 100137 td 0xffffff0004cd0000 kdb_enter() at kdb_enter+0x3d panic() at panic+0x16c _mtx_lock_flags() at _mtx_lock_flags _mtx_lock_flags() at _mtx_lock_flags+0xc0 vinactive() at vinactive+0x81 vput() at vput+0x218 kern_statat() at kern_statat+0xf1 lstat() at lstat+0x22 syscall() at syscall+0x1dd Xfast_syscall() at Xfast_syacall+0xab --- syscall (190, FreeBSD ELF64, lstat),rip = 0x8009b788c,rsp = 0x7ffffffe358,rdp = 0x6b6040 --- --------------------------------------------------------------------- Copyright (c) 1992-2008 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-CURRENT #36: Fri Aug 15 01:59:20 CST 2008 root@xxx-laptop.people.163.org:/usr/obj/usr/src/sys/G8laptop WARNING: WITNESS option enabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Core(TM)2 Duo CPU T7700 @ 2.40GHz (2394.01-MHz K8-class CPU) Origin = "GenuineIntel" Id = 0x6fb Stepping = 11 Features=0xbfebfbff Features2=0xe3bd AMD Features=0x20100800 AMD Features2=0x1 Cores per package: 2 usable memory = 4206596096 (4011 MB) avail memory = 4039573504 (3852 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 This module (opensolaris) contains code covered by the Common Development and Distribution License (CDDL) see http://opensolaris.org/os/licensing/opensolaris_license/ ACPI Warning (tbfadt-0505): Optional field "Gpe1Block" has zero address or length: 0 102C/0 [20070320] ioapic0: Changing APIC ID to 1 ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 acpi0: on motherboard acpi0: [ITHREAD] acpi_ec0: port 0x62,0x66 on acpi0 acpi0: Power Button (fixed) acpi0: reservation of 0, a0000 (3) failed acpi0: reservation of 100000, bff00000 (3) failed Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 acpi_hpet0: iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 900 acpi_lid0: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: irq 16 at device 1.0 on pci0 pci1: on pcib1 vgapci0: port 0x2000-0x207f mem 0xd2000000-0xd2ffffff,0xe0000000-0xefffffff,0xd0000000-0xd1ffffff irq 16 at device 0.0 on pci1 em0: port 0x1840-0x185f mem 0xfe200000-0xfe21ffff,0xfe225000-0xfe225fff irq 20 at device 25.0 on pci0 em0: Using MSI interrupt em0: [FILTER] em0: Ethernet address: 00:1c:25:1c:fb:d0 uhci0: port 0x1860-0x187f irq 20 at device 26.0 on pci0 uhci0: [GIANT-LOCKED] uhci0: [ITHREAD] usb0: on uhci0 usb0: USB revision 1.0 uhub0: on usb0 uhub0: 2 ports with 2 removable, self powered uhci1: port 0x1880-0x189f irq 21 at device 26.1 on pci0 uhci1: [GIANT-LOCKED] uhci1: [ITHREAD] usb1: on uhci1 usb1: USB revision 1.0 uhub1: on usb1 uhub1: 2 ports with 2 removable, self powered ehci0: mem 0xfe226c00-0xfe226fff irq 22 at device 26.7 on pci0 ehci0: [GIANT-LOCKED] ehci0: [ITHREAD] usb2: EHCI version 1.0 usb2: companion controllers, 2 ports each: usb0 usb1 usb2: on ehci0 usb2: USB revision 2.0 uhub2: on usb2 uhub2: 4 ports with 4 removable, self powered pcm0: mem 0xfe220000-0xfe223fff irq 17 at device 27.0 on pci0 pcm0: [ITHREAD] pcib2: irq 20 at device 28.0 on pci0 pci2: on pcib2 pci2: at device 0.0 (no driver attached) pcib3: irq 21 at device 28.1 on pci0 pci3: on pcib3 iwn0: mem 0xd7dfe000-0xd7dfffff irq 17 at device 0.0 on pci3 iwn0: Reg Domain: MoW1, address 00:1d:e0:48:13:2f iwn0: [ITHREAD] iwn0: 11a rates: 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps iwn0: 11b rates: 1Mbps 2Mbps 5.5Mbps 11Mbps iwn0: 11g rates: 1Mbps 2Mbps 5.5Mbps 11Mbps 6Mbps 9Mbps 12Mbps 18Mbps 24Mbps 36Mbps 48Mbps 54Mbps iwn0: 11na MCS: 15Mbps 30Mbps 45Mbps 60Mbps 90Mbps 120Mbps 135Mbps 150Mbps 30Mbps 60Mbps 90Mbps 120Mbps 180Mbps 240Mbps 270Mbps 300Mbps iwn0: 11ng MCS: 15Mbps 30Mbps 45Mbps 60Mbps 90Mbps 120Mbps 135Mbps 150Mbps 30Mbps 60Mbps 90Mbps 120Mbps 180Mbps 240Mbps 270Mbps 300Mbps pcib4: irq 22 at device 28.2 on pci0 pci4: on pcib4 pcib5: irq 23 at device 28.3 on pci0 pci5: on pcib5 pcib6: irq 20 at device 28.4 on pci0 pci13: on pcib6 uhci2: port 0x18a0-0x18bf irq 16 at device 29.0 on pci0 uhci2: [GIANT-LOCKED] uhci2: [ITHREAD] usb3: on uhci2 usb3: USB revision 1.0 uhub3: on usb3 uhub3: 2 ports with 2 removable, self powered uhci3: port 0x18c0-0x18df irq 17 at device 29.1 on pci0 uhci3: [GIANT-LOCKED] uhci3: [ITHREAD] usb4: on uhci3 usb4: USB revision 1.0 uhub4: on usb4 uhub4: 2 ports with 2 removable, self powered uhci4: port 0x18e0-0x18ff irq 18 at device 29.2 on pci0 uhci4: [GIANT-LOCKED] uhci4: [ITHREAD] usb5: on uhci4 usb5: USB revision 1.0 uhub5: on usb5 uhub5: 2 ports with 2 removable, self powered ehci1: mem 0xfe227000-0xfe2273ff irq 19 at device 29.7 on pci0 ehci1: [GIANT-LOCKED] ehci1: [ITHREAD] usb6: EHCI version 1.0 usb6: companion controllers, 2 ports each: usb3 usb4 usb5 usb6: on ehci1 usb6: USB revision 2.0 uhub6: on usb6 uhub6: 6 ports with 6 removable, self powered pcib7: at device 30.0 on pci0 pci21: on pcib7 cbb0: mem 0xf8100000-0xf8100fff irq 16 at device 0.0 on pci21 cardbus0: on cbb0 pccard0: <16-bit PCCard bus> on cbb0 cbb0: [ITHREAD] isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1830-0x183f at device 31.1 on pci0 ata0: on atapci0 ata0: [ITHREAD] ata1: on atapci0 ata1: [ITHREAD] atapci1: port 0x1c48-0x1c4f,0x1c1c-0x1c1f,0x1c40-0x1c47,0x1c18-0x1c1b,0x1c20-0x1c3f mem 0xfe226000-0xfe2267ff irq 16 at device 31.2 on pci0 atapci1: [ITHREAD] atapci1: AHCI Version 01.10 controller with 3 ports PM not supported ata2: on atapci1 ata2: [ITHREAD] ata3: on atapci1 ata3: port not implemented ata3: [ITHREAD] ata4: on atapci1 ata4: [ITHREAD] pci0: at device 31.3 (no driver attached) acpi_tz0: on acpi0 acpi_tz1: on acpi0 atrtc0: port 0x70-0x71 irq 8 on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] atkbd0: [ITHREAD] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: [ITHREAD] psm0: model Synaptics Touchpad, device ID 0 battery0: on acpi0 acpi_acad0: on acpi0 acpi_ibm0: on acpi0 cpu0: on acpi0 coretemp0: on cpu0 est0: on cpu0 p4tcc0: on cpu0 cpu1: on acpi0 coretemp1: on cpu1 est1: on cpu1 p4tcc1: on cpu1 orm0: at iomem 0xc0000-0xcefff,0xcf000-0xcffff,0xd0000-0xd0fff,0xd1000-0xd3fff,0xe0000-0xeffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ubt0: on uhub0 ubt0: Interface 0 endpoints: interrupt=0x81, bulk-in=0x82, bulk-out=0x2 ubt0: Interface 1 (alt.config 4) endpoints: isoc-in=0x83, isoc-out=0x3; wMaxPacketSize=64; nframes=10, buffer size=640 ugen0: on uhub0 WARNING: ZFS is considered to be an experimental feature in FreeBSD. Timecounters tick every 1.000 msec ZFS filesystem version 11 ZFS storage pool version 11 acd0: DVDR at ata0-master UDMA33 ad4: 152627MB at ata2-master SATA150 pcm0: pcm0: SMP: AP CPU #1 Launched! WARNING: WITNESS option enabled, expect reduced performance. GEOM_LABEL: Label for provider ad4s1 is ntfs/System. GEOM_LABEL: Label for provider ad4s5 is ntfs/Program. GEOM_LABEL: Label for provider ad4s6 is ntfs/ Data. lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004c35028 struct mount mtx (struct mount mtx) @ /usr/src/sys/kern/vfs_subr.c:346 2nd 0xffffff0004c35000 vfslock (vfslock) @ /usr/src/sys/kern/vfs_subr.c:373 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc95 vfs_busy() at vfs_busy+0xd0 vfs_mount_alloc() at vfs_mount_alloc+0x80 vfs_mountroot() at vfs_mountroot+0x23b start_init() at start_init+0x62 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe40018d30, rbp = 0 --- lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004c36470 vnode interlock (vnode interlock) @ /usr/src/sys/fs/devfs/devfs_vnops.c:286 2nd 0xffffff0004c36448 devfs (devfs) @ /usr/src/sys/kern/vfs_subr.c:2051 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc52 vop_stdlock() at vop_stdlock+0x39 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x50 vget() at vget+0x7d devfs_allocv() at devfs_allocv+0xf9 devfs_root() at devfs_root+0x49 set_rootvnode() at set_rootvnode+0x2d vfs_mountroot() at vfs_mountroot+0x2f8 start_init() at start_init+0x62 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe40018d30, rbp = 0 --- Trying to mount root from ufs:/dev/ad4s3a WARNING: / was not properly dismounted lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004b77da8 vnode interlock (vnode interlock) @ /usr/src/sys/kern/vfs_hash.c:79 2nd 0xffffff0004b77d80 ufs (ufs) @ /usr/src/sys/kern/vfs_subr.c:2051 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc52 ffs_lock() at ffs_lock+0x8c VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x50 vget() at vget+0x7d vfs_hash_get() at vfs_hash_get+0xd1 ffs_vget() at ffs_vget+0x39 ufs_root() at ufs_root+0x1e set_rootvnode() at set_rootvnode+0x2d vfs_mountroot_try() at vfs_mountroot_try+0x27a vfs_mountroot() at vfs_mountroot+0x3e5 start_init() at start_init+0x62 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe40018d30, rbp = 0 --- lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004b77e00 bufobj interlock (bufobj interlock) @ /usr/src/sys/kern/vfs_bio.c:2429 2nd 0xfffffffe803a2de8 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2443 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc52 getblk() at getblk+0xda breadn() at breadn+0x34 bread() at bread+0x1e ffs_blkatoff() at ffs_blkatoff+0x56 ufs_lookup() at ufs_lookup+0x5ab vfs_cache_lookup() at vfs_cache_lookup+0xe5 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x97 lookup() at lookup+0x4ec namei() at namei+0x531 kern_unlinkat() at kern_unlinkat+0xa8 vfs_mountroot_try() at vfs_mountroot_try+0x423 vfs_mountroot() at vfs_mountroot+0x3e5 start_init() at start_init+0x62 fork_exit() at fork_exit+0x12a fork_trampoline() at fork_trampoline+0xe --- trap 0, rip = 0, rsp = 0xfffffffe40018d30, rbp = 0 --- lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004b77648 vnode interlock (vnode interlock) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:167 2nd 0xffffff0004c32000 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:178 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc95 ufsdirhash_build() at ufsdirhash_build+0xdb ufs_lookup() at ufs_lookup+0x10a vfs_cache_lookup() at vfs_cache_lookup+0xe5 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x97 lookup() at lookup+0x4ec namei() at namei+0x531 kern_statat() at kern_statat+0x85 lstat() at lstat+0x22 syscall() at syscall+0x1dd Xfast_syscall() at Xfast_syscall+0xab --- syscall (190, FreeBSD ELF64, lstat), rip = 0x444a7c, rsp = 0x7fffffffe2c8, rbp = 0x47e863 --- lock order reversal: (sleepable after non-sleepable) 1st 0xffffff0004ce3d80 zfs (zfs) @ /usr/src/sys/modules/zfs/../../cddl/contrib/opensolaris/uts/common/fs/zfs/zfs_vfsops.c:877 2nd 0xffffff0004fa1298 vnode interlock (vnode interlock) @ /usr/src/sys/kern/vfs_cache.c:438 3rd 0xffffff0004fa1270 zfs (zfs) @ /usr/src/sys/kern/vfs_subr.c:2051 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2a _witness_debugger() at _witness_debugger+0x45 witness_checkorder() at witness_checkorder+0x75c __lockmgr_args() at __lockmgr_args+0xc52 vop_stdlock() at vop_stdlock+0x39 VOP_LOCK1_APV() at VOP_LOCK1_APV+0x9b _vn_lock() at _vn_lock+0x50 vget() at vget+0x7d cache_lookup() at cache_lookup+0x1d5 vfs_cache_lookup() at vfs_cache_lookup+0xb0 VOP_LOOKUP_APV() at VOP_LOOKUP_APV+0x97 lookup() at lookup+0x4ec namei() at namei+0x531 vfs_donmount() at vfs_donmount+0x999 nmount() at nmount+0xa8 syscall() at syscall+0x1dd Xfast_syscall() at Xfast_syscall+0xab --- syscall (378, FreeBSD ELF64, nmount), rip = 0x800f34fac, rsp = 0x7fffffffcf48, rbp = 0x7fffffffcf60 --- WARNING: attempt to net_add_domain(bluetooth) after domainfinalize() WARNING: attempt to net_add_domain(netgraph) after domainfinalize() pid 1323 (scim-helper-manager), uid 1001: exited on signal 11 >How-To-Repeat: update source tree to Aug 15,then update to current. panic random. >Fix: >Release-Note: >Audit-Trail: >Unformatted: