From owner-freebsd-fs@FreeBSD.ORG  Thu Dec  3 08:38:18 2009
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 5FB3E1065672
	for <freebsd-fs@freebsd.org>; Thu,  3 Dec 2009 08:38:18 +0000 (UTC)
	(envelope-from gallasch@free.de)
Received: from smtp.free.de (smtp.free.de [91.204.6.103])
	by mx1.freebsd.org (Postfix) with ESMTP id AA4788FC0A
	for <freebsd-fs@freebsd.org>; Thu,  3 Dec 2009 08:38:17 +0000 (UTC)
Received: (qmail 95512 invoked from network); 3 Dec 2009 09:38:15 +0100
Received: from smtp.free.de (HELO orwell.free.de)
	(gallasch@free.de@[91.204.4.103])
	(envelope-sender <gallasch@free.de>)
	by smtp.free.de (qmail-ldap-1.03) with AES128-SHA encrypted SMTP
	for <freebsd-fs@freebsd.org>; 3 Dec 2009 09:38:15 +0100
Date: Thu, 3 Dec 2009 09:38:09 +0100
From: Kai Gallasch <gallasch@free.de>
To: freebsd-fs@freebsd.org
Message-ID: <20091203093809.3d54ea2e@orwell.free.de>
X-Mailer: Claws Mail 3.7.0 (GTK+ 2.18.2; powerpc-apple-darwin9.7.0)
X-Face: <?Kr%McPBj=Isg`; /; DLKgg8=?TK)D4+#KjDI[%2;
	Mm>7"x0zA5=*cXGZw-xjU<<f:m8)Hl
	L>">'+!3(KXTUXZVLD42KVN{'go[UQr"Mc.e(XW92N8plZ(9x.{x;
	I<|95e+b&GH-36\15F~L$YD*Y
	+u}o&KV?6.%"mJIkaY3G>BKNt`1|Y+%K1P4t; 47D65&(Y7h5Ll-[ltkhamx.-;
	,jggK'}oMpUgEHFG YQ"9oXKAl>!d,J}T{)@uxvfu?YFWC*\~h+,^f
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Subject: questions using zfs on raid controllers without jbod option
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 03 Dec 2009 08:38:18 -0000


Hi list.

What's the best way to deploy zfs on a server with builtin raid
controller and missing JBOD functionality?

I am currently testing a hp/compaq proliant server with Battery Backed
SmartArray P400 controller (ciss) and 5 sas disks which I use for a
raidz1 pool.

What I did was to create a raid0 array on the controller for each disk,
with raid0 chunksize set to 32K (Those raid0 drives show up as da2-da6
in FreeBSD) and used them for a raidz1 pool.

Following zpool iostat I can see, that there are almost all of the time
no continous writes, but most of the copied data is written in spikes of
write operations. My guess is, that this behaviour is caching related
and that it might be caused by zfs-arc and raid-controller cache not
playing too well together.

questions:

"raid0 drives":

- What's the best chunksize for a single raid0 drive that is used as a
  device for a pool ? (I use 32K)

- Should the write cache on the physical disks that are used as raid0
  drives for zfs be enabled, if the raid controller has a battery
  backup unit ? ( I enabled the disk write cache for all disks)

raid controller cache:

My current settings for the raid controller cache are: "cache 50% reads
and 50% writes"

- Does it make sense to have caching of read- and write-ops enabled
  with this setup? I wonder: Shouldn't it be the job of the zfs arc to
  do the caching?

- Does zfs prefetch make any sense If your raid controller already
  caches read operations?


Cheers,
Kai.