From owner-freebsd-bugs@FreeBSD.ORG Wed Sep 3 09:46:58 2014 Return-Path: Delivered-To: freebsd-bugs@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id CA9ADCF3 for ; Wed, 3 Sep 2014 09:46:58 +0000 (UTC) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AC77E1B9B for ; Wed, 3 Sep 2014 09:46:58 +0000 (UTC) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.14.9/8.14.9) with ESMTP id s839kwAU029726 for ; Wed, 3 Sep 2014 09:46:58 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-bugs@FreeBSD.org Subject: [Bug 193277] New: Kernel crash after a few minutes/hours when aplications want to write something to disk. Date: Wed, 03 Sep 2014 09:46:58 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: new X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 10.0-STABLE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: maciej.gabryszak@gmail.com X-Bugzilla-Status: Needs Triage X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-bugs@FreeBSD.org X-Bugzilla-Target-Milestone: --- X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_id short_desc product version rep_platform op_sys bug_status bug_severity priority component assigned_to reporter attachments.created Message-ID: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Sep 2014 09:46:58 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=193277 Bug ID: 193277 Summary: Kernel crash after a few minutes/hours when aplications want to write something to disk. Product: Base System Version: 10.0-STABLE Hardware: amd64 OS: Any Status: Needs Triage Severity: Affects Only Me Priority: --- Component: kern Assignee: freebsd-bugs@FreeBSD.org Reporter: maciej.gabryszak@gmail.com Created attachment 146726 --> https://bugs.freebsd.org/bugzilla/attachment.cgi?id=146726&action=edit core.txt.0 # Two servers have disks: 2x ST3000DM001-9YN166 CC4B + PF + CARP + sometimes bhyve to test + vlans + bridge interface + tap interfaces for bhyve + I tested with ZFS and UFS. Now it working at UFS file system + Gmirror # Two another servers have (bigger servers): 4x INTEL SSDSC2BA100G3 5DV10265 (SSD) 7x ATA HGST HUS724040AL AA70 (SATA) + without PF + CARP + bhyve + vlans + bridge interface + tap interfaces for bhyve + ZFS I'm testing bhyve but servers without bhyve crash too. Servers Supermicro. core.txt.0 Fri Aug 29 19:59:54 CEST 2014 FreeBSD rack02.xx 10.0-RELEASE FreeBSD 10.0-RELEASE #0 r260789: Thu Jan 16 22:34:59 UTC 2014 root@snap.freebsd.org:/usr/obj/usr/src/sys/GENERIC amd64 panic: spin lock held too long GNU gdb 6.1.1 [FreeBSD] Copyright 2004 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "amd64-marcel-freebsd"... Unread portion of the kernel message buffer: <118>Stopping powerd. <118>Waiting for PIDS: 2913. <118>Stopping devd. <118>Waiting for PIDS: 2578. <118>Writing entropy file:. <118>. <118>Terminated <118>Aug 29 19:54:04 rack02 syslogd: exiting on signal 15 spin lock 0xffffffff814fa030 (smp rendezvous) held by 0xfffff8035506d000 (tid 100157) too long panic: spin lock held too long cpuid = 2 KDB: stack backtrace: #0 0xffffffff808e7dd0 at kdb_backtrace+0x60 #1 0xffffffff808af8b5 at panic+0x155 #2 0xffffffff8089cb71 at _mtx_lock_spin_cookie+0x241 #3 0xffffffff80c7ef54 at smp_targeted_tlb_shootdown+0xf4 #4 0xffffffff80c80922 at pmap_invalidate_all+0x232 #5 0xffffffff80c8736f at pmap_remove_pages+0x6af #6 0xffffffff80b104c0 at vmspace_exit+0xa0 #7 0xffffffff8087c6af at exit1+0x65f #8 0xffffffff808b2eef at sigexit+0xb7f #9 0xffffffff808b35a9 at postsig+0x349 #10 0xffffffff808f6e97 at ast+0x437 #11 0xffffffff80c765c9 at doreti_ast+0x1f Uptime: 1d2h40m52s (ada0:ahcich0:0:0:0): STANDBY_IMMEDIATE. ACB: e0 00 00 00 00 40 00 00 00 00 00 00 (ada0:ahcich0:0:0:0): CAM status: CCB request is in progress (ada0:ahcich0:0:0:0): Error 5, Retries exhausted (ada0:ahcich0:0:0:0): Spin-down disk failed (ada1:ahcich1:0:0:0): STANDBY_IMMEDIATE. ACB: e0 00 00 00 00 40 00 00 00 00 00 00 (ada1:ahcich1:0:0:0): CAM status: CCB request is in progress (ada1:ahcich1:0:0:0): Error 5, Retries exhausted (ada1:ahcich1:0:0:0): Spin-down disk failed Dumping 1590 out of 32706 MB:..2%..11%..21%..31%..41%..51%..61%..71%..81%..91% Reading symbols from /boot/kernel/zfs.ko.symbols...done. Loaded symbols for /boot/kernel/zfs.ko.symbols Reading symbols from /boot/kernel/opensolaris.ko.symbols...done. Loaded symbols for /boot/kernel/opensolaris.ko.symbols Reading symbols from /boot/kernel/if_tap.ko.symbols...done. Loaded symbols for /boot/kernel/if_tap.ko.symbols Reading symbols from /boot/kernel/pf.ko.symbols...done. Loaded symbols for /boot/kernel/pf.ko.symbols Reading symbols from /boot/kernel/bridgestp.ko.symbols...done. Loaded symbols for /boot/kernel/bridgestp.ko.symbols Reading symbols from /boot/kernel/carp.ko.symbols...done. Loaded symbols for /boot/kernel/carp.ko.symbols Reading symbols from /boot/kernel/if_bridge.ko.symbols...done. Loaded symbols for /boot/kernel/if_bridge.ko.symbols Reading symbols from /boot/kernel/if_em.ko.symbols...done. Loaded symbols for /boot/kernel/if_em.ko.symbols Reading symbols from /boot/kernel/ipmi.ko.symbols...done. Loaded symbols for /boot/kernel/ipmi.ko.symbols Reading symbols from /boot/kernel/smbus.ko.symbols...done. Loaded symbols for /boot/kernel/smbus.ko.symbols Reading symbols from /boot/kernel/vmm.ko.symbols...done. Loaded symbols for /boot/kernel/vmm.ko.symbols Reading symbols from /boot/kernel/nmdm.ko.symbols...done. Loaded symbols for /boot/kernel/nmdm.ko.symbols Reading symbols from /boot/kernel/pfsync.ko.symbols...done. Loaded symbols for /boot/kernel/pfsync.ko.symbols Reading symbols from /boot/kernel/pflog.ko.symbols...done. Loaded symbols for /boot/kernel/pflog.ko.symbols Reading symbols from /boot/kernel/if_lagg.ko.symbols...done. Loaded symbols for /boot/kernel/if_lagg.ko.symbols Reading symbols from /boot/kernel/ums.ko.symbols...done. Loaded symbols for /boot/kernel/ums.ko.symbols #0 doadump (textdump=) at pcpu.h:219 219 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=) at pcpu.h:219 #1 0xffffffff808af530 in kern_reboot (howto=16644) at /usr/src/sys/kern/kern_shutdown.c:447 #2 0xffffffff808af8f4 in panic (fmt=) at /usr/src/sys/kern/kern_shutdown.c:754 #3 0xffffffff8089cb71 in _mtx_lock_spin_cookie (c=, tid=, opts=, file=, line=) at /usr/src/sys/kern/kern_mutex.c:554 #4 0xffffffff80c7ef54 in smp_targeted_tlb_shootdown (mask={__bits = {105}}, vector=244, pmap=0x0, addr1=0, addr2=0) at /usr/src/sys/amd64/amd64/mp_machdep.c:1179 #5 0xffffffff80c80922 in pmap_invalidate_all (pmap=) at /usr/src/sys/amd64/amd64/pmap.c:1532 #6 0xffffffff80c8736f in pmap_remove_pages (pmap=0xfffff80009388138) at /usr/src/sys/amd64/amd64/pmap.c:5302 #7 0xffffffff80b104c0 in vmspace_exit (td=0xfffff80837ede920) at /usr/src/sys/vm/vm_map.c:399 #8 0xffffffff8087c6af in exit1 (td=0xfffff80837ede920, rv=) at /usr/src/sys/kern/kern_exit.c:321 #9 0xffffffff808b2eef in sigexit (td=, sig=) at /usr/src/sys/kern/kern_sig.c:2935 #10 0xffffffff808b35a9 in postsig (sig=) at /usr/src/sys/kern/kern_sig.c:2822 #11 0xffffffff808f6e97 in ast (framep=) at /usr/src/sys/kern/subr_trap.c:271 #12 0xffffffff80c765c9 in doreti_ast () at /usr/src/sys/amd64/amd64/exception.S:677 #13 0x00000000ffffffff in ?? () #14 0x00007fffffffd674 in ?? () #15 0x0000000000000000 in ?? () Current language: auto; currently minimal (kgdb) -- You are receiving this mail because: You are the assignee for the bug.