From owner-freebsd-questions@FreeBSD.ORG Tue May 26 13:50:38 2009 Return-Path: Delivered-To: FreeBSD-Questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA64A1065676 for ; Tue, 26 May 2009 13:50:38 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: from mail-gx0-f166.google.com (mail-gx0-f166.google.com [209.85.217.166]) by mx1.freebsd.org (Postfix) with ESMTP id 5CFE78FC1F for ; Tue, 26 May 2009 13:50:38 +0000 (UTC) (envelope-from amvandemore@gmail.com) Received: by gxk10 with SMTP id 10so69810gxk.19 for ; Tue, 26 May 2009 06:50:37 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=gSutoqrJpqkf9cTJsAYclZnG7J1kFkXnkYKABKuqk1w=; b=GObeoSInq0FTR3F87n4WshedMsWNActYPaZjtUiUkziYIx2Hf9rvPFENBfJ4bPDH1f xfhhxx/BrDrMErYzDMeo/Oq/liQHCLKUUduduKeU+PLrvWFchBQ1Xyaxej8sHlG7UFfh 28TNU5LBSlGJLHduRlm7hmy/wi/7aMVtUK9go= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=XFSSiub+SR5Hgn471cDzfy4VOOEs/2DW8j9VbqT76j4Jz9p7jtWaVkzCvinnYtlV/C yVSgrpqLp2WW5J9zgaAfur6FMDy/0Ix3BvIWGPsOftUsaHsr2jlQA97LtFT46gze+mrX QJg2F58NXylm2HLjft4akKv16/HKeSS2iMfiM= MIME-Version: 1.0 Received: by 10.150.182.5 with SMTP id e5mr16659079ybf.328.1243345837781; Tue, 26 May 2009 06:50:37 -0700 (PDT) In-Reply-To: <4A1BEAC8.6030505@ibctech.ca> References: <4A1AA3DC.5020300@network-i.net> <01FB8F39BAD0BD49A6D0DA8F7897392956C7@Mercury.galaxy.lan.lcl> <139b44430905250937u3410ac24g1f0b9f89a0d51f22@mail.gmail.com> <20090525165618.GB8441@Grumpy.DynDNS.org> <20090525174818.GA32121@Grumpy.DynDNS.org> <4A1BB15C.40300@network-i.net> <4A1BEAC8.6030505@ibctech.ca> Date: Tue, 26 May 2009 07:50:37 -0600 Message-ID: <6201873e0905260650s6172cc71ib53d61f9e9affb2d@mail.gmail.com> From: Adam Vande More To: Steve Bertrand , Howard Jones , Wojciech Puchar , FreeBSD-Questions@freebsd.org, Graeme Dargie , Valentin Bud Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Tue, 26 May 2009 15:25:07 +0000 Cc: Subject: Re: FreeBSD & Software RAID X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 May 2009 13:50:38 -0000 Sweet thanks for the info. Building one of those boxes is next in the list. On 5/26/09, Steve Bertrand wrote: > Howard Jones wrote: >> Wojciech Puchar wrote: >>> you are right. you can't be happy of warm house without getting really >>> cold some time :) >>> >>> that's why it's excellent that ZFS (and few other things) is included >>> in FreeBSD but it's COMPLETELY optional. >>> >> Well, I switched from the heater that doesn't work and is poorly >> documented (gvinum) to the one that does and is (zfs, albeit mostly >> documented by Sun), and so far I am warm :-) >> >> Once I'd increased kmem, at least. I did get a panic before that, but >> now I am shuffling data happily and slightly faster than gvinum did, and >> memory has levelled off at about 160MB for zfs. I'll be keeping my >> previous hardware RAID in one piece for a little while though, I think, >> just in case! (old Adaptec card with a 2TB limit on containers). > > I moved my AMANDA tapeless backup system to ZFS well over a year ago. > It's got four 500GB SATA drives. > > At first, it would panic frequently sometime during the backup. The > backups peak at ~400Mbps of network traffic. I adopted the following > script to write out the memory usage during the backup, so I could > better tune the system (sorry, I can't recall where I found this code snip): > > #!/bin/sh > > TEXT=`/sbin/kldstat | /usr/bin/awk 'BEGIN {print "16i 0";} NR>1 \ > {print toupper($4) "+"} END {print "p"}' | dc` > > DATA=`/usr/bin/vmstat -m | sed -Ee \ > '1s/.*/0/;s/.* ([0-9]+)K.*/\1+/;$s/$/1024*p/' | dc` > > TOTAL=$((DATA + TEXT)) > DATE=`/bin/date | awk '{print $4}'` > > /bin/echo $DATE `/bin/echo $TOTAL | \ > /usr/bin/awk '{print $1/1048576}'` >> /home/steve/mem.usage > > Cronned every minute, I'd end up with a file like this: > > 19:16:01 500.205 > 19:17:02 485.699 > 19:18:01 474.305 > 19:19:01 473.265 > 19:20:01 471.874 > 19:21:02 471.94 > > ...the next day, I'd be able to review this file to see what the memory > usage was at the time of the panic/reboot. > > I found that: > > vm.kmem_size="1536M" > vm.kmem_size_max="1536M" > > made the system extremely stable, and since then: > > amanda# uptime > 9:01AM up 81 days, 17:06, > > I'm about to upgrade the system to -STABLE today... > > Steve > -- Adam Vande More Systems Administrator Mobility Sales