From owner-freebsd-stable@FreeBSD.ORG Tue Sep 30 01:41:47 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0D3C71065689 for ; Tue, 30 Sep 2008 01:41:47 +0000 (UTC) (envelope-from andrew@modulus.org) Received: from email.octopus.com.au (host-122-100-2-232.octopus.com.au [122.100.2.232]) by mx1.freebsd.org (Postfix) with ESMTP id BB7298FC13 for ; Tue, 30 Sep 2008 01:41:46 +0000 (UTC) (envelope-from andrew@modulus.org) Received: by email.octopus.com.au (Postfix, from userid 1002) id 2BF0017DA2; Tue, 30 Sep 2008 11:41:42 +1000 (EST) X-Spam-Checker-Version: SpamAssassin 3.2.3 (2007-08-08) on email.octopus.com.au X-Spam-Level: X-Spam-Status: No, score=-1.4 required=10.0 tests=ALL_TRUSTED autolearn=failed version=3.2.3 Received: from [10.1.50.60] (142.19.96.58.exetel.com.au [58.96.19.142]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: admin@email.octopus.com.au) by email.octopus.com.au (Postfix) with ESMTP id 402E9171C8 for ; Tue, 30 Sep 2008 11:41:36 +1000 (EST) Message-ID: <48E1839E.3060006@modulus.org> Date: Tue, 30 Sep 2008 11:40:46 +1000 From: Andrew Snow User-Agent: Thunderbird 2.0.0.14 (X11/20080523) MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <20080921213426.GA13923@0lsen.net> <249873145.20080926213341@takeda.tk> <20080927051413.GA42700@icarus.home.lan> <765067435.20080926223557@takeda.tk> <20080927064417.GA43638@icarus.home.lan> <588787159.20080927003750@takeda.tk> <5f67a8c40809282030l7888d942q548d570cd0b33be9@mail.gmail.com> <20080929040025.GA97332@icarus.home.lan> <48E080C0.9070103@modulus.org> <5f67a8c40809290809j58639df8ka65184151161cab6@mail.gmail.com> <5f67a8c40809290849m413eebe6sd31a493aea506932@mail.gmail.com> <200809291744.m8THiBlR034739@apollo.backplane.com> In-Reply-To: <200809291744.m8THiBlR034739@apollo.backplane.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: UNEXPECTED SOFT UPDATE INCONSISTENCY; RUN fsck MANUALLY X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Sep 2008 01:41:47 -0000 Matthew Dillon wrote: > It can take 6 hours to fsck a full 1TB HD. It can > take over a day to fsck larger setups. Putting in a few sleeps here > and there just makes the run time even longer and perpetuates the pain. We have a box with millions of files spread over 2TB, on a 16 disk RAID. Foreground fsck takes almost 8 hours, so background fsck, which takes almost 24 hours or more, is my only option when I want to bring the box back online quickly. And UFS Snapshots are so slow as to be completely useless. I've now converted the volume to ZFS, and am now enjoying instant boot time and higher speed I/O under heavy load, at the expense of memory consumption. > My recommendation? Default UFS back to a synchronous fsck and stop > treating ZFS (your only real alternative) as being so ultra-alpha that > it shouldn't be used. Completely agree. ZFS is the way of the future for FreeBSD. In my latest testing, the memory problems are now under control, there is just stability problems with random lockups after days of heavy load unless I turn off ZIL. So its nearly there. If only ZFS also supported a network distributed mode. Or can we convince you to port Hammer to FreeBSD? :-) - Andrew