From owner-freebsd-fs@FreeBSD.ORG Thu Feb 28 12:48:36 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 80F7832A; Thu, 28 Feb 2013 12:48:36 +0000 (UTC) (envelope-from lev@FreeBSD.org) Received: from onlyone.friendlyhosting.spb.ru (onlyone.friendlyhosting.spb.ru [IPv6:2a01:4f8:131:60a2::2]) by mx1.freebsd.org (Postfix) with ESMTP id 2AD4E214; Thu, 28 Feb 2013 12:48:36 +0000 (UTC) Received: from lion.home.serebryakov.spb.ru (unknown [IPv6:2001:470:923f:1:9421:367:9d7d:512b]) (Authenticated sender: lev@serebryakov.spb.ru) by onlyone.friendlyhosting.spb.ru (Postfix) with ESMTPA id C3CFF4AC57; Thu, 28 Feb 2013 16:48:26 +0400 (MSK) Date: Thu, 28 Feb 2013 16:48:21 +0400 From: Lev Serebryakov Organization: FreeBSD X-Priority: 3 (Normal) Message-ID: <1698593972.20130228164821@serebryakov.spb.ru> To: freebsd-fs@freebsd.org, freebsd-current@freebsd.org Subject: Panic in ffs_valloc (Was: Unexpected SU+J inconsistency AGAIN -- please, don't shift topic to ZFS!) In-Reply-To: <1158712592.20130228141323@serebryakov.spb.ru> References: <1796551389.20130228120630@serebryakov.spb.ru> <1238720635.20130228123325@serebryakov.spb.ru> <1158712592.20130228141323@serebryakov.spb.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: lev@FreeBSD.org List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Feb 2013 12:48:36 -0000 Hello, Lev. You wrote 28 =D1=84=D0=B5=D0=B2=D1=80=D0=B0=D0=BB=D1=8F 2013 =D0=B3., 14:13= :23: LS>>> My server runs 9.1-STABLE and have 8Tb UFS2 SU+J FS. LS>>> It crashed a several minutes ago (I don't know reason yet) and fsck LS>>> says "Unexpected SU+J inconsistency" (Inode mode/directory tyme LS>>> mismatch) and requested full check (which will take more than hour on LS>>> such FS). LS>> Full fsck found "INTERNAL ERROR: DUPS WITH SOFTUPDATES" and keeps run= ning... LS> full fsck reconnected about 1000 files, which was written in time of LS> crash. LS> Really, sever crashed when SVN mirror seed was been unpacking on LS> this FS, so there was massive file creation at this time. Ok, I've checked memory, and now I have booted system with crashlog (!) Here it is (please note, that panic() was called by ffs_valloc): #0 doadump (textdump=3D) at pcpu.h:229 229 pcpu.h: No such file or directory. in pcpu.h (kgdb) #0 doadump (textdump=3D) at pcpu.h:229 #1 0xffffffff80431494 in kern_reboot (howto=3D260) at /usr/src/sys/kern/kern_shutdown.c:448 #2 0xffffffff80431997 in panic (fmt=3D0x1
) at /usr/src/sys/kern/kern_shutdown.c:636 #3 0xffffffff80573d8c in ffs_valloc (pvp=3D0xfffffe0024d68000, mode=3D3320= 4, cred=3D0xfffffe0023d52700, vpp=3D0xffffff81c35586b8) at /usr/src/sys/ufs/ffs/ffs_alloc.c:995 #4 0xffffffff805aa126 in ufs_makeinode (mode=3D33204, dvp=3D0xfffffe0024d6= 8000, vpp=3D0xffffff81c3558a10, cnp=3D0xffffff81c3558a38) at /usr/src/sys/ufs/ufs/ufs_vnops.c:2614 #5 0xffffffff80634391 in VOP_CREATE_APV (vop=3D, a=3D0xffffff81c3558920) at vnode_if.c:252 #6 0xffffffff804d389a in vn_open_cred (ndp=3D0xffffff81c35589d0, flagp=3D0xffffff81c35589cc, cmode=3D, vn_open_flags=3D, cred=3D0xfffffe0023d52700, fp=3D0xfffffe00ae9cf370) at vnode_if.h:109 #7 0xffffffff804cc0d9 in kern_openat (td=3D0xfffffe012d095000, fd=3D-100, path=3D0x801c951e0
, pathseg=3DUIO_USERSPACE, flags=3D2562, mode=3D) at /usr/src/sys/kern/vfs_syscalls.c:1132 #8 0xffffffff805f1400 in amd64_syscall (td=3D0xfffffe012d095000, traced=3D= 0) at subr_syscall.c:135 #9 0xffffffff805dbfc7 in Xfast_syscall () at /usr/src/sys/amd64/amd64/exception.S:387 #10 0x000000080177ce5c in ?? () Previous frame inner to this frame (corrupt stack?) (kgdb) Full textdump: http://lev.serebryakov.spb.ru/crashes/core-ffs-crash.txt.1 Please note, that FS was loaded by torrent client (40Mbit/s outbound traffic) and unpacking of svnmirror-base-r238500.tar.xz from this FS to itself. So, it was really high multistream load. I'll try to reproduce this on SINGLE disk, without geom_radi5 :) --=20 // Black Lion AKA Lev Serebryakov