From owner-freebsd-hardware@FreeBSD.ORG Fri Oct 31 03:14:55 2008 Return-Path: Delivered-To: freebsd-hardware@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 41FE01065672 for ; Fri, 31 Oct 2008 03:14:55 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from mail.dannysplace.net (mail.dannysplace.net [213.133.54.210]) by mx1.freebsd.org (Postfix) with ESMTP id F1E8F8FC12 for ; Fri, 31 Oct 2008 03:14:54 +0000 (UTC) (envelope-from fbsd@dannysplace.net) Received: from 203-206-171-212.perm.iinet.net.au ([203.206.171.212] helo=[192.168.10.10]) by mail.dannysplace.net with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1KvkTM-000J1l-3P for freebsd-hardware@freebsd.org; Fri, 31 Oct 2008 13:14:54 +1000 Message-ID: <490A782F.9060406@dannysplace.net> Date: Fri, 31 Oct 2008 13:14:55 +1000 From: Danny Carroll User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) MIME-Version: 1.0 To: freebsd-hardware@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Authenticated-User: danny X-Authenticator: plain X-Sender-Verify: SUCCEEDED (sender exists & accepts mail) X-Exim-Version: 4.69 (build at 08-Jul-2008 08:59:40) X-Date: 2008-10-31 13:14:52 X-Connected-IP: 203.206.171.212:1550 X-Message-Linecount: 60 X-Body-Linecount: 49 X-Message-Size: 2439 X-Body-Size: 2055 X-Received-Count: 1 X-Recipient-Count: 1 X-Local-Recipient-Count: 1 X-Local-Recipient-Defer-Count: 0 X-Local-Recipient-Fail-Count: 0 X-SA-Exim-Connect-IP: 203.206.171.212 X-SA-Exim-Rcpt-To: freebsd-hardware@freebsd.org X-SA-Exim-Mail-From: fbsd@dannysplace.net X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on ferrari.dannysplace.net X-Spam-Level: X-Spam-Status: No, score=0.2 required=8.0 tests=ALL_TRUSTED,TVD_RCVD_IP autolearn=disabled version=3.2.5 X-SA-Exim-Version: 4.2 X-SA-Exim-Scanned: Yes (on mail.dannysplace.net) Subject: Areca vs. ZFS performance testing. X-BeenThere: freebsd-hardware@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: fbsd@dannysplace.net List-Id: General discussion of FreeBSD hardware List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 31 Oct 2008 03:14:55 -0000 Hello all, I've just become the proud new owner of an Areca 1231-ML which I plan to use to set up an office server. I'm very curious as to how ZFS compares to a hardware solution so I plan to run some tests before I put this thing to work. The purpose of this email is to find out if anyone would like to see specific things tested as well as perhaps get some advice on how to get the most information out of the tests. My setup: Supermicro X7SBE board with 2Gb ram and an E6550 Core 2 Duo. FreeBSD 7.0-Stable compiled with amd64 sources from mid August. 1 x ST9120822AS 120gb disk (for the OS) For the array(s) 9 x ST31000340AS 1tb disks 1 x ST31000333AS 1tb disk (trying to swap this for a ST31000340AS) My thoughts are to do the following tests with bonnie++: 1 5 disk Areca Raid5 2 5 Disk ZFS RaidZ1 (Connected to Areca in JBOD mode) 3 5 Disk ZFS RaidZ1 (Connected to ICH9 On board SATA controller) 4 5 disk Areca Raid6 5 5 Disk ZFS RaidZ2 (Connected to Areca in JBOD mode) 6 5 Disk ZFS RaidZ2 (Connected to ICH9 On board SATA controller) 7 10 disk Areca Raid5 8 10 Disk ZFS RaidZ1 (Connected to Areca in JBOD mode) 9 10 disk Areca Raid6 10 10 Disk ZFS RaidZ2 (Connected to Areca in JBOD mode) My aim is to see what sort of performance gain you get by buying an Areca card for use in JBOD as well as seeing how ZFS compares to the hardware solution which offers write caching etc. I'm really only interested in testing ZFS's volume management performance, so for that reason I will also put ZFS on the Areca Raid drives. Not sure if it's a good idea to create 2 Raid drives and stripe them or simply use 1 large disk and give it to ZFS. Any thoughts on this setup as well as advice on what options to give to bonnie++ (or suggestions on another disk testing package) are very welcome. I do have some concern about the size of the eventual array and ZFS' use of system memory. Are there guidelines available that give advice on how much memory a box should have with large ZFS arrays? Can an AMD64 kernel make use of memory above 2g? -D