From owner-freebsd-questions@FreeBSD.ORG Tue Sep 6 15:46:57 2005 Return-Path: X-Original-To: questions@freebsd.org Delivered-To: freebsd-questions@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 27E7916A420 for ; Tue, 6 Sep 2005 15:46:57 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: from mail28.sea5.speakeasy.net (mail28.sea5.speakeasy.net [69.17.117.30]) by mx1.FreeBSD.org (Postfix) with ESMTP id 04F2043D45 for ; Tue, 6 Sep 2005 15:46:54 +0000 (GMT) (envelope-from mi+mx@aldan.algebra.com) Received: (qmail 21691 invoked from network); 6 Sep 2005 15:46:54 -0000 Received: from aldan.algebra.com (HELO blue.virtual-estates.net) ([216.254.65.224]) (envelope-sender ) by mail28.sea5.speakeasy.net (qmail-ldap-1.03) with AES256-SHA encrypted SMTP for ; 6 Sep 2005 15:46:54 -0000 Received: from corbulon.video-collage.com (static-151-204-231-237.bos.east.verizon.net [151.204.231.237]) by blue.virtual-estates.net (8.13.3/8.13.3) with ESMTP id j86Fknjk078197 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 6 Sep 2005 11:46:50 -0400 (EDT) (envelope-from mi+mx@aldan.algebra.com) Received: from mteterin.us.murex.com (195-11.customer.cloud9.net [168.100.195.11]) by corbulon.video-collage.com (8.13.4/8.13.1) with ESMTP id j86Fkh9b046569 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 6 Sep 2005 11:46:44 -0400 (EDT) (envelope-from mi+mx@aldan.algebra.com) Received: from mteterin.us.murex.com (mteterin@localhost [127.0.0.1]) by mteterin.us.murex.com (8.13.3/8.13.3) with ESMTP id j86FkUJ7042838; Tue, 6 Sep 2005 11:46:30 -0400 (EDT) (envelope-from mi+mx@aldan.algebra.com) Received: from localhost (localhost [[UNIX: localhost]]) by mteterin.us.murex.com (8.13.3/8.13.3/Submit) id j86FkTDQ042837; Tue, 6 Sep 2005 11:46:29 -0400 (EDT) (envelope-from mi+mx@aldan.algebra.com) X-Authentication-Warning: mteterin.us.murex.com: mteterin set sender to mi+mx@aldan.algebra.com using -f From: Mikhail Teterin Organization: Virtual Estates, Inc. To: Robert Watson Date: Tue, 6 Sep 2005 11:46:28 -0400 User-Agent: KMail/1.8.2 References: <200509051953.22337@aldan> <200509060931.33977@aldan> <20050906144512.T75104@fledge.watson.org> In-Reply-To: <20050906144512.T75104@fledge.watson.org> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200509061146.28926.mi+mx@aldan.algebra.com> X-Virus-Scanned: ClamAV devel-20050525/1064/Mon Sep 5 17:05:55 2005 on corbulon.video-collage.com X-Virus-Status: Clean X-Scanned-By: MIMEDefang 2.43 Cc: questions@freebsd.org, fs@freebsd.org Subject: Re: Strange case of filesystem corruption? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Sep 2005 15:46:57 -0000 > Do you have back logs to when bgfsck was running, btw? Yes, indeed. And there is stuff in them... The machine crashed on July 21st at 00:20 (/var is troublesome fs): Jul 21 00:20:37 blue kernel: WARNING: /var was not properly dismounted Jul 21 00:20:37 blue kernel: /var: mount pending error: blocks 28 files 2 Jul 21 00:29:05 blue kernel: root@blue.virtual-estates.net:/var/obj/var/src/sys/SILVER Jul 21 00:29:05 blue kernel: WARNING: /var was not properly dismounted Jul 21 00:29:05 blue kernel: /var: mount pending error: blocks 28 files 2 Jul 21 00:32:21 blue fsck: /dev/da0s1d: UNREF FILE I=11559 OWNER=root MODE=100400 Jul 21 00:32:21 blue fsck: /dev/da0s1d: SIZE=12884902464 MTIME=Jul 21 00:22 2005 (CLEARED) Jul 21 00:32:21 blue fsck: /dev/da0s1d: UNREF FILE I=1413219 OWNER=root MODE=100600 Jul 21 00:32:21 blue fsck: /dev/da0s1d: SIZE=12288 MTIME=Jul 21 00:18 2005 (CLEARED) Jul 21 00:32:21 blue fsck: /dev/da0s1d: UNREF FILE I=1423432 OWNER=root MODE=100600 Jul 21 00:32:21 blue fsck: /dev/da0s1d: SIZE=12288 MTIME=Jul 21 00:22 2005 (CLEARED) Jul 21 00:32:21 blue fsck: /dev/da0s1d: UNREF FILE I=1423433 OWNER=root MODE=100600 Jul 21 00:32:21 blue fsck: /dev/da0s1d: SIZE=451 MTIME=Jul 21 00:22 2005 (CLEARED) Jul 21 00:32:21 blue fsck: /dev/da0s1d: Reclaimed: 0 directories, 4294967269 files, -26 fragments Jul 21 00:32:21 blue fsck: /dev/da0s1d: 495013 files, 4631802 used, 1461319 free (59391 frags, 175241 blocks, 1.0% fragmentation) So that was a successful fsck above (save for the negative number of reclaimed fragments). I am not sure, what caused the next reboot (crash or orderly reboot) at 1:17, but this time fsck failed: Jul 21 01:17:18 blue kernel: root@blue.virtual-estates.net:/var/obj/var/src/sys/SILVER Jul 21 01:17:18 blue kernel: WARNING: /var was not properly dismounted Jul 21 01:17:18 blue kernel: /var: mount pending error: blocks 44 files 12 Jul 21 01:20:30 blue fsck: /dev/da0s1d: INCORRECT BLOCK COUNT I=11599 (4 should be 0) (CORRECTED) Jul 21 01:20:30 blue fsck: /dev/da0s1d: INCORRECT BLOCK COUNT I=34376 (4 should be 0) (CORRECTED) Jul 21 01:20:30 blue fsck: /dev/da0s1d: SETTING DIRTY FLAG IN READ_ONLY MODE Jul 21 01:20:30 blue fsck: Jul 21 01:20:30 blue fsck: /dev/da0s1d: UNEXPECTED SOFT UPDATE INCONSISTENCY; RUN fsck MANUALLY. What is interesting is that my ports tree is also on this same fs and has gone through numerous cvs updates and port builds (including large items like mozilla and openoffice)... Thanks! -mi