From owner-freebsd-bugs@FreeBSD.ORG Mon Oct 28 21:20:02 2013 Return-Path: Delivered-To: freebsd-bugs@smarthost.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 1380C318 for ; Mon, 28 Oct 2013 21:20:02 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:1900:2254:206c::16:87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id E82E42EF7 for ; Mon, 28 Oct 2013 21:20:01 +0000 (UTC) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.7/8.14.7) with ESMTP id r9SLK1Zg000629 for ; Mon, 28 Oct 2013 21:20:01 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.7/8.14.7/Submit) id r9SLK14A000628; Mon, 28 Oct 2013 21:20:01 GMT (envelope-from gnats) Resent-Date: Mon, 28 Oct 2013 21:20:01 GMT Resent-Message-Id: <201310282120.r9SLK14A000628@freefall.freebsd.org> Resent-From: FreeBSD-gnats-submit@FreeBSD.org (GNATS Filer) Resent-To: freebsd-bugs@FreeBSD.org Resent-Reply-To: FreeBSD-gnats-submit@FreeBSD.org, Rick Reed Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 7E7FA172 for ; Mon, 28 Oct 2013 21:14:47 +0000 (UTC) (envelope-from nobody@FreeBSD.org) Received: from oldred.freebsd.org (oldred.freebsd.org [8.8.178.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 50D142EAF for ; Mon, 28 Oct 2013 21:14:47 +0000 (UTC) Received: from oldred.freebsd.org ([127.0.1.6]) by oldred.freebsd.org (8.14.5/8.14.7) with ESMTP id r9SLEkrZ016314 for ; Mon, 28 Oct 2013 21:14:46 GMT (envelope-from nobody@oldred.freebsd.org) Received: (from nobody@localhost) by oldred.freebsd.org (8.14.5/8.14.5/Submit) id r9SLEkSj016310; Mon, 28 Oct 2013 21:14:46 GMT (envelope-from nobody) Message-Id: <201310282114.r9SLEkSj016310@oldred.freebsd.org> Date: Mon, 28 Oct 2013 21:14:46 GMT From: Rick Reed To: freebsd-gnats-submit@FreeBSD.org X-Send-Pr-Version: www-3.1 Subject: misc/183417: panic: fault on nofault entry in softdep_setup_freeblocks X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 28 Oct 2013 21:20:02 -0000 >Number: 183417 >Category: misc >Synopsis: panic: fault on nofault entry in softdep_setup_freeblocks >Confidential: no >Severity: non-critical >Priority: low >Responsible: freebsd-bugs >State: open >Quarter: >Keywords: >Date-Required: >Class: sw-bug >Submitter-Id: current-users >Arrival-Date: Mon Oct 28 21:20:01 UTC 2013 >Closed-Date: >Last-Modified: >Originator: Rick Reed >Release: 9.1 >Organization: WhatsApp >Environment: FreeBSD mms983.whatsapp.net 9.1-RELEASE-p7 FreeBSD 9.1-RELEASE-p7 #0 r255864M: Tue Sep 24 18:12:17 PDT 2013 root@mms983.whatsapp.net:/usr/obj/usr/src/sys/bsdnine64 amd64 >Description: We've seen this panic multiple times on hosts which are getting uncorrectable I/O errors from a spinning SATA disk: root@mms983$ cat panic.txt vm_fault: fault on nofault entry, addr: ffffffa010748000 b:0:kdb.enter.panic> show pcpu cpuid = 12 dynamic pcpu = 0xffffff807faf8200 curthread = 0xfffffe09675938e0: pid 57943 "beam.smp" curpcb = 0xffffffa31038ebc0 fpcurthread = none idlethread = 0xfffffe0034935470: tid 100014 "idle: cpu12" curpmap = 0xfffffe01230ccbe8 tssp = 0xffffffff80957340 commontssp = 0xffffffff80957340 rsp0 = 0xffffffa31038ebc0 gs32p = 0xffffffff80955498 ldt = 0xffffffff809554d8 tss = 0xffffffff809554c8 db:0:kdb.enter.panic> bt Tracing pid 57943 tid 43087119 td 0xfffffe09675938e0 kdb_enter() at kdb_enter+0x3b panic() at panic+0x1c7 vm_fault_hold() at vm_fault_hold+0x1eea vm_fault() at vm_fault+0x73 trap_pfault() at trap_pfault+0x41d trap() at trap+0x365 calltrap() at calltrap+0x8 --- trap 0xc, rip = 0xffffffff8054c43c, rsp = 0xffffffa31038e490, rbp = 0xffffffa31038e520 --- softdep_setup_freeblocks() at softdep_setup_freeblocks+0x3ec ffs_truncate() at ffs_truncate+0x530 ufs_inactive() at ufs_inactive+0x1e5 VOP_INACTIVE_APV() at VOP_INACTIVE_APV+0x4a vinactive() at vinactive+0x8d vputx() at vputx+0x2d8 kern_unlinkat() at kern_unlinkat+0x1df amd64_syscall() at amd64_syscall+0x5d6 Xfast_syscall() at Xfast_syscall+0xf7 --- syscall (10, FreeBSD ELF64, sys_unlink), rip = 0x80125e32c, rsp = 0x7ffffd1b3ea8, rbp = 0x825b5af40 --- After reboot, we get a second panic: root@mms983$ cat panic.txt ufs_dirbad: /d6: bad dir ino 9708991 at offset 1536: mangled entry After reboot and fsck, filesystem is working again. >How-To-Repeat: >Fix: >Release-Note: >Audit-Trail: >Unformatted: