From owner-freebsd-bugs@FreeBSD.ORG Mon Apr 16 19:10:07 2007 Return-Path: X-Original-To: freebsd-bugs@hub.freebsd.org Delivered-To: freebsd-bugs@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7505316A401 for ; Mon, 16 Apr 2007 19:10:07 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 6184413C43E for ; Mon, 16 Apr 2007 19:10:07 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l3GJA7HM082384 for ; Mon, 16 Apr 2007 19:10:07 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l3GJA7Qb082383; Mon, 16 Apr 2007 19:10:07 GMT (envelope-from gnats) Date: Mon, 16 Apr 2007 19:10:07 GMT Message-Id: <200704161910.l3GJA7Qb082383@freefall.freebsd.org> To: freebsd-bugs@FreeBSD.org From: Dan D Niles Cc: Subject: Re: bin/111146: fsck fails on 6Tfilesystem X-BeenThere: freebsd-bugs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Dan D Niles List-Id: Bug reports List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Apr 2007 19:10:07 -0000 The following reply was made to PR bin/111146; it has been noted by GNATS. From: Dan D Niles To: bug-followup@FreeBSD.org Cc: Harrison Grundy , Jan Srzednicki Subject: Re: bin/111146: fsck fails on 6Tfilesystem Date: Mon, 16 Apr 2007 14:08:57 -0500 I attached the failed raid device to a newer server with 8G of RAM. I booted to an amd64 kernel, and set datasize limit to 7G. Resource limits (current): cputime infinity secs filesize infinity kB datasize 7340032 kB stacksize-cur 8192 kB coredumpsize infinity kB memoryuse-cur 8093236 kB memorylocked-cur 1299644 kB maxprocesses 6164 openfiles 12328 sbsize infinity bytes vmemoryuse infinity kB Now when I run fsck I get: ** /dev/da0 ** Last Mounted on /LSO ** Phase 1 - Check Blocks and Sizes fsck_ffs: bad inode number 53321728 to nextinode My theory is that some bits got flipped in the meta-data and cg_initediblk is getting a bad value. The value of 1,572,191,256 that it returns just before it fails is greater than the total number of inodes, which is around 784,218,256. It is distressing that some bits in the meta-data could get flipped during normal usage resulting in an unusable filesystem. I have 19 hours before I need to reformat the array and put it back into production. Is there anything else I should try before then? Thanks, Dan