Skip site navigation (1)Skip section navigation (2) 
Date:      Tue, 26 May 2009 09:12:40 -0400
From:      Steve Bertrand <steve@ibctech.ca>
To:        Howard Jones <howard.jones@network-i.net>
Cc:        Wojciech Puchar <wojtek@wojtek.tensor.gdynia.pl>, FreeBSD-Questions@freebsd.org, Graeme Dargie <arab@tangerine-army.co.uk>, Valentin Bud <valentin.bud@gmail.com>
Subject:   Re: FreeBSD & Software RAID
Message-ID:  <4A1BEAC8.6030505@ibctech.ca>
In-Reply-To: <4A1BB15C.40300@network-i.net>
References:  <4A1AA3DC.5020300@network-i.net>	<01FB8F39BAD0BD49A6D0DA8F7897392956C7@Mercury.galaxy.lan.lcl>	<139b44430905250937u3410ac24g1f0b9f89a0d51f22@mail.gmail.com>	<20090525165618.GB8441@Grumpy.DynDNS.org>	<alpine.BSF.2.00.0905251907460.39949@wojtek.tensor.gdynia.pl>	<20090525174818.GA32121@Grumpy.DynDNS.org>	<alpine.BSF.2.00.0905251954230.40402@wojtek.tensor.gdynia.pl> <4A1BB15C.40300@network-i.net>
index | next in thread | previous in thread | raw e-mail 

[-- Attachment #1 --]
Howard Jones wrote:
> Wojciech Puchar wrote:
>> you are right. you can't be happy of warm house without getting really
>> cold some time :)
>>
>> that's why it's excellent that ZFS (and few other things) is included
>> in FreeBSD but it's COMPLETELY optional.
>>
> Well, I switched from the heater that doesn't work and is poorly
> documented (gvinum) to the one that does and  is (zfs, albeit mostly
> documented by Sun), and so far I am warm :-)
> 
> Once I'd increased kmem, at least. I did get a panic before that, but
> now I am shuffling data happily and slightly faster than gvinum did, and
> memory has levelled off at about 160MB for zfs. I'll be keeping my
> previous hardware RAID in one piece for a little while though, I think,
> just in case! (old Adaptec card with a 2TB limit on containers).

I moved my AMANDA tapeless backup system to ZFS well over a year ago.
It's got four 500GB SATA drives.

At first, it would panic frequently sometime during the backup. The
backups peak at ~400Mbps of network traffic. I adopted the following
script to write out the memory usage during the backup, so I could
better tune the system (sorry, I can't recall where I found this code snip):

#!/bin/sh

TEXT=`/sbin/kldstat | /usr/bin/awk 'BEGIN {print "16i 0";} NR>1 \
{print toupper($4) "+"} END {print "p"}' | dc`

DATA=`/usr/bin/vmstat -m | sed -Ee \
'1s/.*/0/;s/.* ([0-9]+)K.*/\1+/;$s/$/1024*p/' | dc`

TOTAL=$((DATA + TEXT))
DATE=`/bin/date | awk '{print $4}'`

/bin/echo $DATE `/bin/echo $TOTAL | \
/usr/bin/awk '{print $1/1048576}'` >> /home/steve/mem.usage

Cronned every minute, I'd end up with a file like this:

19:16:01 500.205
19:17:02 485.699
19:18:01 474.305
19:19:01 473.265
19:20:01 471.874
19:21:02 471.94

...the next day, I'd be able to review this file to see what the memory
 usage was at the time of the panic/reboot.

I found that:

vm.kmem_size="1536M"
vm.kmem_size_max="1536M"

made the system extremely stable, and since then:

amanda# uptime
 9:01AM  up 81 days, 17:06,

I'm about to upgrade the system to -STABLE today...

Steve

[-- Attachment #2 --]
0	*H
010	+0	*H
00CK9AbxIUw0
	*H
0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CA0
090507231610Z
100507231610Z0B10UThawte Freemail Member10	*H
	steve@ibctech.ca0"0
	*H
0
DZ杙<2IⵀfrsE6q?0.>
S@Œ!V?A\Q
r-aZ
Ōf/0{OYQhɏߴ
F_\Q0BF=<_.a*3epeY|tݼcvlҷ+@piQA{2E9WN4[Z`h6VM/zPbd(GC^K6XV4j<t-0+0U0steve@ibctech.ca0U00
	*H
æ|85aQz-*3HG		.s*Fw*`HvFw;9ytƘn0taC/:WC+LÙ{Oq 1n00CK9AbxIUw0
	*H
0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CA0
090507231610Z
100507231610Z0B10UThawte Freemail Member10	*H
	steve@ibctech.ca0"0
	*H
0
DZ杙<2IⵀfrsE6q?0.>
S@Œ!V?A\Q
r-aZ
Ōf/0{OYQhɏߴ
F_\Q0BF=<_.a*3epeY|tݼcvlҷ+@piQA{2E9WN4[Z`h6VM/zPbd(GC^K6XV4j<t-0+0U0steve@ibctech.ca0U00
	*H
æ|85aQz-*3HG		.s*Fw*`HvFw;9ytƘn0taC/:WC+LÙ{Oq 1n0?0
0
	*H
010	UZA10UWestern Cape10U	Cape Town10U
Thawte Consulting1(0&UCertification Services Division1$0"UThawte Personal Freemail CA1+0)	*H
	personal-freemail@thawte.com0
030717000000Z
130716235959Z0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CA00
	*H
0Ħ<UsUNʙZhup[v:aQP
0cZ,p+Z?qV˯<6$*+w=+>@dקe*TH<a@dr`00U00CU<0:08642http://crl.thawte.com/ThawtePersonalFreemailCA.crl0U0)U"0 010UPrivateLabel2-1380
	*H
HP.
fgCL!6-6/P p<ab:~t%Pb'qW%ݩ9 Oe_N4[5MwV!x!5$F]_eO1d0`0v0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CAK9AbxIUw0	+0	*H
	1	*H
0	*H
	1
090526131240Z0#	*H
	1=Ѯ"z:Χ0R	*H
	1E0C0
*H
0*H
0
*H
@0+0
*H
(0	+71x0v0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CAK9AbxIUw0*H
	1xv0b10	UZA1%0#U
Thawte Consulting (Pty) Ltd.1,0*U#Thawte Personal Freemail Issuing CAK9AbxIUw0
	*H
%
.Qr;Mdֱti-}'V:vhƺ)Cɝ!ravakuM~x>d>NR>V/؂&n}}/M%]TkWxPۼ&(Ɯ}KW_tA	ӄ.V&E8:՞
XJҹY	rOZd<o_(Iq^i󅖹x~5
help

Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4A1BEAC8.6030505>