From owner-freebsd-current@FreeBSD.ORG Fri Jan 19 17:22:41 2007 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4845816A401 for ; Fri, 19 Jan 2007 17:22:41 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id CA9E413C441 for ; Fri, 19 Jan 2007 17:22:40 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id l0JHMYVH076881; Fri, 19 Jan 2007 11:22:34 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <45B0FE5E.7090201@centtech.com> Date: Fri, 19 Jan 2007 11:22:38 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.9 (X11/20061223) MIME-Version: 1.0 To: Kris Kennaway References: <20070119025156.GB77180@mero.morphisms.net> <20070119032814.GA83278@xor.obsecurity.org> In-Reply-To: <20070119032814.GA83278@xor.obsecurity.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2466/Thu Jan 18 17:49:11 2007 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: "W. Josephson" , freebsd-current@freebsd.org Subject: Re: building a new fileserver X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 19 Jan 2007 17:22:41 -0000 On 01/18/07 21:28, Kris Kennaway wrote: > On Thu, Jan 18, 2007 at 09:51:56PM -0500, W. Josephson wrote: >> I'd like to solicit people's opinions about configuring >> CURRENT for a new fileserver that we'll be using internally. >> I have only recently had hardware available for running anything >> other than 6-STABLE so: >> >> 1. We'd like to use the 16-port 3Ware 9650SE-16. >> Does anyone here have experience with this card in >> RAID-6 mode under FreeBSD? >> >> 2. Any one have advice for setting up UFS+gjournal? >> I've been using FFS+SU for some time on a number of machines >> with filesystems up to about 1TB, but I'm not looking forward >> to fsck, even background fsck, on multiple 10TB filesystems. >> Does anyone here have experience with UFS+gjournal on large >> filesystems? Are there any gotchas to be aware of when >> configuring? Can someone describe briefly what guarantees >> UFS+gjournal makes? > > One gotcha with gjournal is that there is apparently still at least > one pretty obscure data corruption bug lurking. I see this when doing > concurrent package builds on a 12 cpu system with a single gjournal > data store, although I haven't run this configuration for a few > months. > > Kris As a data point, I've been using gjournal with two 10Tb file systems (same host) for some time now, and it has been doing the job quite well. I don't have nearly the number of CPU's as you, and I dedicate a journal for each fs. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology An undefined problem has an infinite number of solutions. ------------------------------------------------------------------------