From owner-freebsd-stable@FreeBSD.ORG Fri Oct 31 02:29:43 2008 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5358C106567D for ; Fri, 31 Oct 2008 02:29:43 +0000 (UTC) (envelope-from louisk@cryptomonkeys.com) Received: from abeyance.cryptomonkeys.com (abeyance.cryptomonkeys.com [67.42.3.2]) by mx1.freebsd.org (Postfix) with ESMTP id C9B9B8FC08 for ; Fri, 31 Oct 2008 02:29:41 +0000 (UTC) (envelope-from louisk@cryptomonkeys.com) Received: from lk-mbp.local (c-76-21-17-250.hsd1.ca.comcast.net [76.21.17.250]) (authenticated bits=0) by abeyance.cryptomonkeys.com (8.13.8+Sun/8.13.8) with ESMTP id m9V2FDuA015057 (version=TLSv1/SSLv3 cipher=AES128-SHA bits=128 verify=NO); Thu, 30 Oct 2008 18:16:48 -0800 (PST) Received: from [127.0.0.1] by lk-mbp.local (PGP Universal service); Thu, 30 Oct 2008 19:16:48 -0700 X-PGP-Universal: processed; by lk-mbp.local on Thu, 30 Oct 2008 19:16:48 -0700 Message-Id: <1EA86BC6-349F-48DB-A77C-A4D8E00C55B5@cryptomonkeys.com> From: Louis Kowolowski To: Lorenzo Perone In-Reply-To: <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> Mime-Version: 1.0 (Apple Message framework v929.2) Date: Thu, 30 Oct 2008 19:15:13 -0700 References: <200810220838.45900.fjwcash@gmail.com> <43E87CCF-6D36-4F82-BF54-7B705CB1EFB5@yellowspace.net> X-Mailer: Apple Mail (2.929.2) Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Cc: freebsd-stable@freebsd.org Subject: Re: ZFS X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 02:29:43 -0000 On Oct 30, 2008, at 2:55 PM, Lorenzo Perone wrote: > On 22.10.2008, at 17:38, Freddie Cash wrote: >> Personally, we use it in production for a remote backup box using >> ZFS and >> Rsync (64-bit FreeBSD 7-Stable from August, 2x dual-core Opteron >> 2200s, 8 >> GB DDR2 RAM, 24x 500 GB SATA disks attached to two 3Ware 9650/9550 >> controllers as single-disks). Works beautifully, backing up 80 >> FreeBSD >> and Debian Linux servers every night, creating snapshots with each >> run. >> Restoring files from an arbitrary day is as simple as navigating to >> the >> needed .zfs/snapshot/// and scping the file to >> wherever. >> And full system restores are as simple as "boot livecd, partition/ >> format >> disks, run rsync". > > > So your system doesn't suffer panics and/or deadlocks, or you just > cope with them as "collateral damage" (which, admitted, is less of > a problem with a logging fs)? > > If that's the case, would you share the details about what you're > using > on that machine (RELENG_7?, 7_0? HEAD?) and which patches > /knobs You used? I have a similar setup on a host which > backs up way fewer machines and locks up every... 3-9 weeks or so. > That host only has about 2GB ram though. > I have a system which is sort of similar in production at work. I have the following tunables (for ZFS) set: zfs_load="YES" vm.kmem_size_max="1024M" vm.kmem_size="1024M" vfs.zfs.arc_min="16M" vfs.zfs.arc_max="384M" [lkowolowski@release lkowolowski 76 ]$ uname -a FreeBSD release.pgp.com 7.1-PRERELEASE FreeBSD 7.1-PRERELEASE #0: Wed Sep 3 12:18:57 PDT 2008 root@release.pgp.com:/usr/obj/usr/src/sys/ GENERIC amd64 [lkowolowski@release lkowolowski 77 ]$ This box has 2G of RAM, and 8.5T in ZFS spread across 8 RAID1 mirrors in an EonStore Fiber array (direct attach). It's been rock solid and stores all of our build collateral. -- Louis Kowolowski louisk@cryptomonkeys.com Cryptomonkeys: http://www.cryptomonkeys.com/~louisk Making life more interesting for people since 1977