From owner-freebsd-current@FreeBSD.ORG Sun Jul 12 16:55:06 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 748D6106564A; Sun, 12 Jul 2009 16:55:06 +0000 (UTC) (envelope-from mexas@bristol.ac.uk) Received: from dirj.bris.ac.uk (dirj.bris.ac.uk [137.222.10.78]) by mx1.freebsd.org (Postfix) with ESMTP id F2B418FC08; Sun, 12 Jul 2009 16:55:05 +0000 (UTC) (envelope-from mexas@bristol.ac.uk) Received: from seis.bris.ac.uk ([137.222.10.93]) by dirj.bris.ac.uk with esmtp (Exim 4.69) (envelope-from ) id 1MQ2KL-0005KL-4l; Sun, 12 Jul 2009 17:55:05 +0100 Received: from mech-cluster238.men.bris.ac.uk ([137.222.187.238]) by seis.bris.ac.uk with esmtp (Exim 4.67) (envelope-from ) id 1MQ2KK-0003BI-5k; Sun, 12 Jul 2009 17:55:00 +0100 Received: from mech-cluster238.men.bris.ac.uk (localhost.men.bris.ac.uk [127.0.0.1]) by mech-cluster238.men.bris.ac.uk (8.14.3/8.14.3) with ESMTP id n6CGsxVt093010; Sun, 12 Jul 2009 17:54:59 +0100 (BST) (envelope-from mexas@bristol.ac.uk) Received: (from mexas@localhost) by mech-cluster238.men.bris.ac.uk (8.14.3/8.14.3/Submit) id n6CGsxk8093009; Sun, 12 Jul 2009 17:54:59 +0100 (BST) (envelope-from mexas@bristol.ac.uk) X-Authentication-Warning: mech-cluster238.men.bris.ac.uk: mexas set sender to mexas@bristol.ac.uk using -f Date: Sun, 12 Jul 2009 17:54:59 +0100 From: Anton Shterenlikht To: freebsd-ia64@freebsd.org, freebsd-current@freebsd.org Message-ID: <20090712165459.GA92924@mech-cluster238.men.bris.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) X-Spam-Score: -1.3 X-Spam-Level: - Cc: Subject: mpt X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 12 Jul 2009 16:55:06 -0000 FreeBSD 8.0-BETA1 ia64 I see lots of these messages (full dmesg below) on boot after a cold reset: mpt0: completing timedout/aborted req 0xa0000000000d0f40:42081 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d12a0:42084 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt is a SCSI driver. Is this something to do with gmirror? I also get this: /usr: mount pending error: blocks 756 files 13 Should I be worried? many thanks anton full dmesg: GDB: debug ports: uart GDB: current port: uart KDB: debugger backends: ddb gdb KDB: current backend: ddb Copyright (c) 1992-2009 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 8.0-BETA1 #0: Sun Jul 12 15:15:30 BST 2009 mexas@tzav.vms.org:/usr/obj/usr/src/sys/TZAV WARNING: WITNESS option enabled, expect reduced performance. module_register: module probe already exists! Module probe failed to register: 17 CPU: Madison (1500.00-Mhz Itanium 2) Origin = "GenuineIntel" Revision = 5 Features = 0x1 real memory = 2126766080 (2028 MB) avail memory = 2017198080 (1923 MB) FPSWA Revision = 0x10012, Entry = 0xe00000407fe60050 FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0: SAPIC Id=0, SAPIC Eid=0 (BSP) cpu1: SAPIC Id=1, SAPIC Eid=0 ACPI Warning: 32/64X length mismatch in Gpe0Block: 32/16 20090521 tbfadt-625 ACPI Warning: 32/64X length mismatch in Gpe1Block: 32/16 20090521 tbfadt-625 acpi0: on motherboard acpi0: [ITHREAD] acpi0: Power Button (fixed) acpi0: Sleep Button (fixed) Timecounter "ACPI-safe" frequency 3579545 Hz quality 850 acpi_timer0: <32-bit timer at 3.579545MHz> iomem 0xff5c1004-0xff5c1007 on acpi0 acpi_tz0: on acpi0 pcib0: on acpi0 pci0: on pcib0 ohci0: mem 0x80023000-0x80023fff irq 16 at device 1.0 on pci0 ohci0: [ITHREAD] usbus0: on ohci0 ohci1: mem 0x80022000-0x80022fff irq 17 at device 1.1 on pci0 ohci1: [ITHREAD] usbus1: on ohci1 ehci0: mem 0x80021000-0x800210ff irq 18 at device 1.2 on pci0 ehci0: [ITHREAD] usbus2: EHCI version 0.95 usbus2: on ehci0 atapci0: port 0xd58-0xd5f,0xd64-0xd67,0xd50-0xd57,0xd60-0xd63,0xd40-0xd4f irq 21 at device 2.0 on pci0 atapci0: [ITHREAD] atapci0: HW has secondary channel disabled ata2: on atapci0 ata2: [ITHREAD] fxp0: port 0xd00-0xd3f mem 0x80020000-0x80020fff,0x80000000-0x8001ffff irq 20 at device 3.0 on pci0 miibus0: on fxp0 inphy0: PHY 1 on miibus0 inphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto fxp0: Ethernet address: 00:11:0a:31:d6:ec fxp0: [ITHREAD] pcib1: on acpi0 pci32: on pcib1 mpt0: port 0x2100-0x21ff mem 0x90840000-0x9084ffff,0x90830000-0x9083ffff irq 27 at device 1.0 on pci32 mpt0: [ITHREAD] mpt0: MPI Version=1.2.12.0 mpt1: port 0x2000-0x20ff mem 0x90820000-0x9082ffff,0x90810000-0x9081ffff irq 28 at device 1.1 on pci32 mpt1: [ITHREAD] mpt1: MPI Version=1.2.12.0 bge0: mem 0x90800000-0x9080ffff irq 29 at device 2.0 on pci32 miibus1: on bge0 brgphy0: PHY 1 on miibus1 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-FDX, auto bge0: Ethernet address: 00:11:0a:31:36:40 bge0: [ITHREAD] pcib2: on acpi0 pci64: on pcib2 pcib3: on acpi0 pci96: on pcib3 pcib4: on acpi0 pci128: on pcib4 pcib5: on acpi0 pci192: on pcib5 pcib6: on acpi0 pci224: on pcib6 uart0: <8250 or 16450 or compatible> mem 0xf4051000-0xf405100f irq 82 at device 1.0 on pci224 uart0: [FILTER] puc0: mem 0xf4050000-0xf4050fff,0xf4020000-0xf403ffff irq 82 at device 1.1 on pci224 puc0: [FILTER] uart1: on puc0 uart1: [FILTER] uart1: console (9600,n,8,1) uart2: on puc0 uart2: [FILTER] uart3: on puc0 uart3: [FILTER] vgapci0: port 0xe000-0xe0ff mem 0xf0000000-0xf3ffffff,0xf4040000-0xf404ffff at device 2.0 on pci224 uart4: <16550 or compatible> iomem 0xff5e0000-0xff5e0007 irq 34 on acpi0 uart4: [FILTER] uart5: <16550 or compatible> iomem 0xff5e2000-0xff5e2007 irq 35 on acpi0 uart5: [FILTER] uart5: debug port (9600,n,8,1) cpu0: on acpi0 cpu1: on acpi0 Timecounters tick every 1.000 msec IP Filter: v4.1.28 initialized. Default = block all, Logging = enabled Waiting 5 seconds for SCSI devices to settle usbus0: 12Mbps Full Speed USB v1.0 usbus1: 12Mbps Full Speed USB v1.0 usbus2: 480Mbps High Speed USB v2.0 ugen0.1: at usbus0 uhub0: on usbus0 ugen1.1: at usbus1 uhub1: on usbus1 ugen2.1: at usbus2 uhub2: on usbus2 acd0: DVDROM at ata2-master PIO4 uhub1: 2 ports with 2 removable, self powered uhub0: 3 ports with 3 removable, self powered uhub2: 5 ports with 5 removable, self powered WARNING: WITNESS option enabled, expect reduced performance. da0 at mpt0 bus 0 target 0 lun 0 da0: Fixed Direct Access SCSI-3 device da0: 320.000MB/s transfers (160.000MHz, offset 63, 16bit) da0: Command Queueing enabled da0: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) da1 at mpt0 bus 0 target 1 lun 0 da1: Fixed Direct Access SCSI-3 device da1: 320.000MB/s transfers (160.000MHz, offset 63, 16bit) da1: Command Queueing enabled da1: 70007MB (143374738 512 byte sectors: 255H 63S/T 8924C) GEOM_MIRROR: Device mirror/efi launched (2/2). GEOM_MIRROR: Device mirror/root launched (2/2). GEOM_MIRROR: Device mirror/swap launched (2/2). GEOM_MIRROR: Device mirror/var launched (2/2). GEOM_MIRROR: Device mirror/tmp launched (2/2). GEOM_MIRROR: Device mirror/usr launched (1/2). GEOM_MIRROR: Device usr: rebuilding provider da0p6. Trying to mount root from ufs:/dev/mirror/root WARNING: / was not properly dismounted WARNING: /tmp was not properly dismounted WARNING: /usr was not properly dismounted /usr: mount pending error: blocks 756 files 13 WARNING: /var was not properly dismounted lock order reversal: 1st 0xe000000010a64448 ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:423 2nd 0xa00000001e5a6340 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2558 3rd 0xe0000000107a4098 ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:544 KDB: stack backtrace: db_trace_self(0xe000000004135d60) at db_trace_self+0x20 db_trace_self_wrapper(0xe00000000443add0) at db_trace_self_wrapper+0x70 kdb_backtrace(0xe0000000049da960, 0xe0000000044639d0) at kdb_backtrace+0xc0 _witness_debugger(0x1, 0xe000000004888610, 0xe000000004465270, 0x999, 0xe0000000048a9da8) at _witness_debugger+0x60 witness_checkorder(0xe0000000107a4098, 0x9, 0x0, 0x220, 0x0) at witness_checkorder+0x12c0 __lockmgr_args(0xe0000000107a4098, 0x80100, 0xe0000000107a40c0, 0xe000000004876a38, 0x50, 0x33, 0xe0000000048a9da8, 0x220) at __lockmgr_args+0xe60 ffs_lock(0xa000000032c1cdd0, 0xe0000000107a4098, 0x80100) at ffs_lock+0x130 VOP_LOCK1_APV(0xe0000000049ac600, 0xa000000032c1cdb0, 0xe0000000043bb800) at VOP_LOCK1_APV+0x1d0 _vn_lock(0xe0000000107a4000, 0x80100, 0xe0000000048a9da8, 0x220, 0xe0000000107a4010, 0xa000000032c1cdd0, 0xa000000032c1cdc8, 0xa000000032c1cdc0) at _vn_lock+0xf0 ffs_snapshot(0xe0000000106e9490, 0xa000000032c1cfc8, 0xe0000000107a4000, 0xe0000000107a40c0, 0x1, 0x0, 0xa000000000416000, 0x0) at ffs_snapshot+0x2280 ffs_mount(0x0, 0xe0000000048abc50, 0xa000000032c1d100, 0xa000000032c1d100) at ffs_mount+0x2160 vfs_donmount(0x0, 0x211000, 0xe0000000107df400) at vfs_donmount+0x1d80 nmount(0xe000000010a34b10, 0xa000000032c1d4e8, 0x0, 0xe0000000048283e0) at nmount+0xf0 syscall(0xa000000032c1d400, 0x17a, 0x201000, 0xe000000010a34b10, 0xe000000010a29120, 0xe000000004986b90, 0x17a, 0xa000000032c1d4e8) at syscall+0x3e0 epc_syscall_return() at epc_syscall_return lock order reversal: 1st 0xa00000001e56b8c8 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2558 2nd 0xe000000010a30830 snaplk (snaplk) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:2223 KDB: stack backtrace: db_trace_self(0xe000000004135d60) at db_trace_self+0x20 db_trace_self_wrapper(0xe00000000443add0) at db_trace_self_wrapper+0x70 kdb_backtrace(0xe0000000049da960, 0xe0000000044639d0) at kdb_backtrace+0xc0 _witness_debugger(0x1, 0xe000000004888610, 0xe000000004465270, 0x999, 0xe0000000048a9da8) at _witness_debugger+0x60 witness_checkorder(0xe000000010a30830, 0x9, 0xffffffffffffffff, 0x8af, 0x0) at witness_checkorder+0x12c0 __lockmgr_args(0xe000000010a30830, 0x80900, 0xe0000000107a5c68, 0xe0000000048a9e10, 0x50, 0x33, 0xe0000000048a9da8, 0x8af) at __lockmgr_args+0xe60 ffs_copyonwrite(0xe0000000107a5ba8, 0xa00000001e56ba08) at ffs_copyonwrite+0x490 ffs_geom_strategy(0xe0000000107a5cc0, 0xa00000001e56ba08, 0x375) at ffs_geom_strategy+0x2b0 bufwrite(0xa00000001e56ba08, 0x4, 0x0, 0xe00000000476da70, 0x38c) at bufwrite+0x300 ffs_bufwrite(0xa00000001e56ba08, 0xe0000000048abc50) at ffs_bufwrite+0x4c0 bawrite(0xa00000001e56ba08, 0xe00000000476f5d0, 0xa9b, 0xe000000004bb9ea0) at bawrite+0xf0 ffs_sbupdate(0xe0000000107ba000, 0x3, 0x0, 0xa00000001e56ba08, 0x800, 0xe000000010638000) at ffs_sbupdate+0x2a0 ffs_sync(0xe0000000106e9490, 0x3, 0xe0000000107a5ba8, 0xe0000000107a5cc0) at ffs_sync+0x850 sync_fsync(0xe000000004891318, 0xe000000004891318, 0xe0000000048330b0) at sync_fsync+0x2f0 VOP_FSYNC_APV(0xe00000000499c9a8, 0xa0000000306b7518, 0xe000000004891318, 0xe000000004504560) at VOP_FSYNC_APV+0x1c0 sync_vnode(0xe0000000104702d0, 0xa0000000306b7540, 0xe000000010500760, 0xa0000000306b7520, 0xa0000000306b7518) at sync_vnode+0x260 sched_sync(0xe0000000104702d8, 0x1a, 0xe0000000104702d0, 0x1b) at sched_sync+0x4d0 fork_exit(0xe0000000048c4130, 0x0, 0xa0000000306b7550) at fork_exit+0x110 enter_userland() at enter_userland mpt0: request 0xa0000000000cec60:42042 timed out for ccb 0xe0000000106e4000 (req->ccb 0xe0000000106e4000) mpt0: request 0xa0000000000ce120:42043 timed out for ccb 0xe000000010b1c000 (req->ccb 0xe000000010b1c000) mpt0: request 0xa0000000000d0760:42044 timed out for ccb 0xe000000010a01000 (req->ccb 0xe000000010a01000) mpt0: request 0xa0000000000d0490:42045 timed out for ccb 0xe000000010626800 (req->ccb 0xe000000010626800) mpt0: request 0xa0000000000cfdd0:42046 timed out for ccb 0xe00000001069c800 (req->ccb 0xe00000001069c800) mpt0: request 0xa0000000000d05b0:42047 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000cf9e0:42048 timed out for ccb 0xe00000001061c000 (req->ccb 0xe00000001061c000) mpt0: completing timedout/aborted req 0xa0000000000cec60:42042 mpt0: completing timedout/aborted req 0xa0000000000ce120:42043 mpt0: completing timedout/aborted req 0xa0000000000d0760:42044 mpt0: completing timedout/aborted req 0xa0000000000d0490:42045 mpt0: completing timedout/aborted req 0xa0000000000cf9e0:42048 mpt0: completing timedout/aborted req 0xa0000000000cfdd0:42046 mpt0: completing timedout/aborted req 0xa0000000000d05b0:42047 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d0d90:42053 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000d1c30:42054 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000cf5f0:42055 timed out for ccb 0xe00000001069c800 (req->ccb 0xe00000001069c800) mpt0: request 0xa0000000000d00a0:42056 timed out for ccb 0xe00000001061c000 (req->ccb 0xe00000001061c000) mpt0: request 0xa0000000000d0370:42057 timed out for ccb 0xe000000010626800 (req->ccb 0xe000000010626800) mpt0: request 0xa0000000000cf7a0:42058 timed out for ccb 0xe000000010a01000 (req->ccb 0xe000000010a01000) mpt0: request 0xa0000000000d1180:42059 timed out for ccb 0xe000000010b1c000 (req->ccb 0xe000000010b1c000) mpt0: completing timedout/aborted req 0xa0000000000cf7a0:42058 mpt0: completing timedout/aborted req 0xa0000000000d0d90:42053 mpt0: completing timedout/aborted req 0xa0000000000d1c30:42054 mpt0: completing timedout/aborted req 0xa0000000000d1180:42059 mpt0: completing timedout/aborted req 0xa0000000000cf5f0:42055 mpt0: completing timedout/aborted req 0xa0000000000d00a0:42056 mpt0: completing timedout/aborted req 0xa0000000000d0370:42057 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d17b0:42060 timed out for ccb 0xe00000001069c800 (req->ccb 0xe00000001069c800) mpt0: request 0xa0000000000cfcb0:42061 timed out for ccb 0xe000000010b1c000 (req->ccb 0xe000000010b1c000) mpt0: request 0xa0000000000d0880:42062 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000d0640:42063 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000cfb00:42064 timed out for ccb 0xe000000010a01000 (req->ccb 0xe000000010a01000) mpt0: request 0xa0000000000d0910:42065 timed out for ccb 0xe000000010683000 (req->ccb 0xe000000010683000) mpt0: request 0xa0000000000cfef0:42066 timed out for ccb 0xe00000001069e800 (req->ccb 0xe00000001069e800) mpt0: completing timedout/aborted req 0xa0000000000cfb00:42064 mpt0: completing timedout/aborted req 0xa0000000000d17b0:42060 mpt0: completing timedout/aborted req 0xa0000000000cfcb0:42061 mpt0: completing timedout/aborted req 0xa0000000000d0880:42062 mpt0: completing timedout/aborted req 0xa0000000000d0640:42063 mpt0: completing timedout/aborted req 0xa0000000000cfef0:42066 mpt0: completing timedout/aborted req 0xa0000000000d0910:42065 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d0250:42067 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000d0be0:42068 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000d2b60:42069 timed out for ccb 0xe000000010b1c000 (req->ccb 0xe000000010b1c000) mpt0: request 0xa0000000000d19f0:42070 timed out for ccb 0xe00000001069c800 (req->ccb 0xe00000001069c800) mpt0: request 0xa0000000000d0d00:42071 timed out for ccb 0xe000000010a01000 (req->ccb 0xe000000010a01000) mpt0: request 0xa0000000000d2800:42072 timed out for ccb 0xe000000010626800 (req->ccb 0xe000000010626800) mpt0: request 0xa0000000000d1060:42073 timed out for ccb 0xe00000001061c000 (req->ccb 0xe00000001061c000) mpt0: request 0xa0000000000d13c0:42074 timed out for ccb 0xe0000000106e4000 (req->ccb 0xe0000000106e4000) mpt0: request 0xa0000000000d1450:42075 timed out for ccb 0xe000000010b19000 (req->ccb 0xe000000010b19000) mpt0: completing timedout/aborted req 0xa0000000000d2800:42072 mpt0: completing timedout/aborted req 0xa0000000000d13c0:42074 mpt0: completing timedout/aborted req 0xa0000000000d0250:42067 mpt0: completing timedout/aborted req 0xa0000000000d0be0:42068 mpt0: completing timedout/aborted req 0xa0000000000d1450:42075 mpt0: completing timedout/aborted req 0xa0000000000d2b60:42069 mpt0: completing timedout/aborted req 0xa0000000000d19f0:42070 mpt0: completing timedout/aborted req 0xa0000000000d0d00:42071 mpt0: completing timedout/aborted req 0xa0000000000d1060:42073 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d1840:42076 timed out for ccb 0xe000000010b19000 (req->ccb 0xe000000010b19000) mpt0: request 0xa0000000000d1210:42077 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000d2fe0:42078 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000d2650:42079 timed out for ccb 0xe0000000106e4000 (req->ccb 0xe0000000106e4000) mpt0: request 0xa0000000000d1720:42080 timed out for ccb 0xe000000010626800 (req->ccb 0xe000000010626800) mpt0: request 0xa0000000000d0f40:42081 timed out for ccb 0xe000000010683000 (req->ccb 0xe000000010683000) mpt0: request 0xa0000000000d2ec0:42082 timed out for ccb 0xe00000001069e800 (req->ccb 0xe00000001069e800) mpt0: completing timedout/aborted req 0xa0000000000d1720:42080 mpt0: completing timedout/aborted req 0xa0000000000d2ec0:42082 mpt0: completing timedout/aborted req 0xa0000000000d1840:42076 mpt0: completing timedout/aborted req 0xa0000000000d1210:42077 mpt0: completing timedout/aborted req 0xa0000000000d2fe0:42078 mpt0: completing timedout/aborted req 0xa0000000000d2650:42079 mpt0: completing timedout/aborted req 0xa0000000000d0f40:42081 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d12a0:42084 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000d1b10:42085 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000d41e0:42086 timed out for ccb 0xe000000010b19000 (req->ccb 0xe000000010b19000) mpt0: request 0xa0000000000d07f0:42087 timed out for ccb 0xe00000001069e800 (req->ccb 0xe00000001069e800) mpt0: request 0xa0000000000d3a00:42088 timed out for ccb 0xe000000010626800 (req->ccb 0xe000000010626800) mpt0: request 0xa0000000000d0c70:42089 timed out for ccb 0xe00000001061c000 (req->ccb 0xe00000001061c000) mpt0: request 0xa0000000000d1330:42090 timed out for ccb 0xe000000010a01000 (req->ccb 0xe000000010a01000) mpt0: request 0xa0000000000d38e0:42091 timed out for ccb 0xe00000001069c800 (req->ccb 0xe00000001069c800) mpt0: completing timedout/aborted req 0xa0000000000d0c70:42089 mpt0: completing timedout/aborted req 0xa0000000000d12a0:42084 mpt0: completing timedout/aborted req 0xa0000000000d1b10:42085 mpt0: completing timedout/aborted req 0xa0000000000d41e0:42086 mpt0: completing timedout/aborted req 0xa0000000000d07f0:42087 mpt0: completing timedout/aborted req 0xa0000000000d38e0:42091 mpt0: completing timedout/aborted req 0xa0000000000d3a00:42088 mpt0: completing timedout/aborted req 0xa0000000000d1330:42090 mpt0: Timedout requests already complete. Interrupts may not be functioning. mpt0: request 0xa0000000000d2770:42092 timed out for ccb 0xe00000001069e800 (req->ccb 0xe00000001069e800) mpt0: request 0xa0000000000d06d0:42093 timed out for ccb 0xe000000010b19000 (req->ccb 0xe000000010b19000) mpt0: request 0xa0000000000d24a0:42094 timed out for ccb 0xe00000001061c800 (req->ccb 0xe00000001061c800) mpt0: request 0xa0000000000d2140:42095 timed out for ccb 0xe000000010b16800 (req->ccb 0xe000000010b16800) mpt0: request 0xa0000000000d44b0:42096 timed out for ccb 0xe00000001061c000 (req->ccb 0xe00000001061c000) mpt0: request 0xa0000000000d40c0:42097 timed out for ccb 0xe000000010a1f800 (req->ccb 0xe000000010a1f800) mpt0: request 0xa0000000000d1f00:42098 timed out for ccb 0xe000000010683000 (req->ccb 0xe000000010683000) mpt0: completing timedout/aborted req 0xa0000000000d2770:42092 mpt0: completing timedout/aborted req 0xa0000000000d2140:42095 mpt0: completing timedout/aborted req 0xa0000000000d44b0:42096 mpt0: completing timedout/aborted req 0xa0000000000d40c0:42097 mpt0: completing timedout/aborted req 0xa0000000000d06d0:42093 mpt0: completing timedout/aborted req 0xa0000000000d1f00:42098 mpt0: completing timedout/aborted req 0xa0000000000d24a0:42094 mpt0: Timedout requests already complete. Interrupts may not be functioning. lock order reversal: 1st 0xe000000010a30830 snaplk (snaplk) @ /usr/src/sys/kern/vfs_vnops.c:296 2nd 0xe000000010a64448 ufs (ufs) @ /usr/src/sys/ufs/ffs/ffs_snapshot.c:1587 KDB: stack backtrace: db_trace_self(0xe000000004135d60) at db_trace_self+0x20 db_trace_self_wrapper(0xe00000000443add0) at db_trace_self_wrapper+0x70 kdb_backtrace(0xe0000000049da960, 0xe0000000044639d0) at kdb_backtrace+0xc0 _witness_debugger(0x1, 0xe000000004888610, 0xe000000004465270, 0x999, 0xe0000000048a9da8) at _witness_debugger+0x60 witness_checkorder(0xe000000010a64448, 0x9, 0xffffffffffffffff, 0x633, 0x0) at witness_checkorder+0x12c0 __lockmgr_args(0xe000000010a64448, 0x80000, 0x0, 0xe000000004876a38, 0x50, 0x33, 0xe0000000048a9da8, 0x633) at __lockmgr_args+0xe60 ffs_snapremove(0xe000000010a643b0, 0xe0000000048a9da8, 0xe000000004892880, 0xe000000010a64448) at ffs_snapremove+0x200 softdep_releasefile(0xe000000010a5ad20, 0xa000000032c1d2d0, 0x29f, 0xe000000004782080, 0x48e) at softdep_releasefile+0x90 ufs_inactive(0xe000000010a34b10, 0xe000000010a5ad20, 0xe000000010a644a0) at ufs_inactive+0x400 VOP_INACTIVE_APV(0xe0000000049acdd0, 0xa000000032c1d2e0, 0xe000000004891318, 0xe0000000044fc820) at VOP_INACTIVE_APV+0x1c0 vinactive(0xe000000010a643b0, 0xe000000010a34b10, 0x800, 0xe000000010a64470) at vinactive+0x110 vput(0xe000000010a643b0, 0xa000000032c1d308, 0xe000000004892880, 0xe000000010a64470) at vput+0x3f0 vn_close(0xe000000010a643b0, 0x1, 0xe000000010363c00, 0xe000000010a34b10) at vn_close+0x310 vn_closefile(0xe000000010720c80, 0xe000000010a34b10, 0xe000000010a643b0) at vn_closefile+0x1e0 _fdrop(0xe000000010720c80, 0xe000000010a34b10, 0xe00000000436eb60, 0xb9b) at _fdrop+0xb0 closef(0xe000000010720c80, 0xe000000010a34b10, 0x0, 0xe00000000436f310) at closef+0x570 kern_close(0xe000000010a34b10, 0xe000000004878dd0) at kern_close+0x270 close(0xe000000010a34b10, 0xa000000032c1d4e8, 0xe0000000048283e0, 0x58f) at close+0x30 syscall(0xa000000032c1d400, 0x6, 0x0, 0xe000000010a34b10, 0xe000000010a29120, 0xe0000000049825d0, 0x6, 0xa000000032c1d4e8) at syscall+0x3e0 epc_syscall_return() at epc_syscall_return lock order reversal: 1st 0xa00000001e5baf20 bufwait (bufwait) @ /usr/src/sys/kern/vfs_bio.c:2558 2nd 0xe00000001069ba00 dirhash (dirhash) @ /usr/src/sys/ufs/ufs/ufs_dirhash.c:285 KDB: stack backtrace: db_trace_self(0xe000000004135d60) at db_trace_self+0x20 db_trace_self_wrapper(0xe00000000443add0) at db_trace_self_wrapper+0x70 kdb_backtrace(0xe0000000049da960, 0xe0000000044639d0) at kdb_backtrace+0xc0 _witness_debugger(0x1, 0xe000000004888610, 0xe000000004465270, 0x999, 0xe0000000048ac640) at _witness_debugger+0x60 witness_checkorder(0xe00000001069ba00, 0x9, 0xffffffffffffffff, 0x11d, 0x0) at witness_checkorder+0x12c0 _sx_xlock(0xe00000001069ba00, 0x0, 0xe0000000048ac640, 0x11d) at _sx_xlock+0xc0 ufsdirhash_acquire(0xe000000013265650, 0xe00000001069ba00, 0xe00000000477eaf0, 0x38b) at ufsdirhash_acquire+0x50 ufsdirhash_remove(0xe000000013265650, 0xa00000001f929788, 0x1788, 0xa000000032c0d308) at ufsdirhash_remove+0x20 ufs_dirremove(0xe000000010ac0b10, 0xe00000001215a5e8, 0x0, 0x0) at ufs_dirremove+0x240 ufs_remove(0xa000000032c0d3d8, 0xe00000001215a5e8, 0xe0000000045096f0) at ufs_remove+0xe0 VOP_REMOVE_APV(0xe0000000049acdd0, 0xa000000032c0d3d8, 0xe00000001216cb10, 0xe000000004509760) at VOP_REMOVE_APV+0x1c0 kern_unlinkat(0xe00000001064d620, 0xffffffffffffff9c, 0x9fffffffffffebae, 0x0) at kern_unlinkat+0x2f0 kern_unlink(0xe00000001064d620, 0x9fffffffffffebae, 0x0) at kern_unlink+0x30 unlink(0xe00000001064d620, 0xa000000032c0d4e8, 0xe0000000048283e0, 0x58f) at unlink+0x30 syscall(0xa000000032c0d400, 0xa, 0x8, 0xe00000001064d620, 0xe000000010a299b0, 0xe000000004982690, 0xa, 0xa000000032c0d4e8) at syscall+0x3e0 epc_syscall_return() at epc_syscall_return -- Anton Shterenlikht Room 2.6, Queen's Building Mech Eng Dept Bristol University University Walk, Bristol BS8 1TR, UK Tel: +44 (0)117 928 8233 Fax: +44 (0)117 929 4423