From owner-freebsd-fs@FreeBSD.ORG Thu Nov 13 17:15:19 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 441AF10656A9; Thu, 13 Nov 2008 17:15:19 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from pooker.samsco.org (pooker.samsco.org [168.103.85.57]) by mx1.freebsd.org (Postfix) with ESMTP id D862A8FC16; Thu, 13 Nov 2008 17:15:18 +0000 (UTC) (envelope-from scottl@samsco.org) Received: from phobos.local ([192.168.254.200]) (authenticated bits=0) by pooker.samsco.org (8.14.2/8.14.2) with ESMTP id mADGnhcE040068; Thu, 13 Nov 2008 09:49:44 -0700 (MST) (envelope-from scottl@samsco.org) Message-ID: <491C5AA7.1030004@samsco.org> Date: Thu, 13 Nov 2008 09:49:43 -0700 From: Scott Long User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X; en-US; rv:1.8.1.13) Gecko/20080313 SeaMonkey/1.1.9 MIME-Version: 1.0 To: Danny Carroll References: <490A782F.9060406@dannysplace.net> <20081031033208.GA21220@icarus.home.lan> <490A849C.7030009@dannysplace.net> <20081031043412.GA22289@icarus.home.lan> <490A8FAD.8060009@dannysplace.net> <491BBF38.9010908@dannysplace.net> In-Reply-To: <491BBF38.9010908@dannysplace.net> X-Enigmail-Version: 0.95.6 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Spam-Status: No, score=-4.4 required=3.8 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.1.8 X-Spam-Checker-Version: SpamAssassin 3.1.8 (2007-02-13) on pooker.samsco.org Cc: freebsd-fs@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: Areca vs. ZFS performance testing. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Nov 2008 17:15:19 -0000 Danny Carroll wrote: > Danny Carroll wrote: >> Jeremy Chadwick wrote: >>> I'd like to see the performance difference between these scenarios: >>> >>> - Memory cache enabled on Areca, write caching enabled on disks >>> - Memory cache enabled on Areca, write caching disabled on disks >>> - Memory cache disabled on Areca, write caching enabled on disks >>> - Memory cache disabled on Areca, write caching disabled on disks >>> > > > The initial results for a ICH9 vs Areca in JBod mode can be found here: > http://www.dannysplace.net/ZFS-JBODTests.html > > Summary: > 5 Disk ZFS RaidZ array with atime turned off. > ICH9 - block reads avg 400MByte/Sec > ICH9 - block writes avg 150MByte/Sec > ArecaJBOD - block reads avg 300MByte/Sec > ArecaJBOD - block writes avg 160MByte/Sec > > > The Areca seems to be in all except char and block writes. Block reads > are 75% as fast as the ICH9 and rewrites are about 85% as fast. > > There seems to be little difference between enabling and disabling the > disk cache on the Areca. This leads me to two conclusions: > 1. Disabling the write cache does nothing on Seagate drives. > 2. IO to the drives is so slow that a write cache is irrelevant. > > These are just some quick tests that I started with, mainly to compare > the areca bus versus the ich9 bus. If someone has any tuning > suggestions, then now is the time to make them before I migrate the ICH9 > drives to the Areca bus. The Areca controller likely doesn't buffer/cache for disks in JBOD mode, as others in this thread have stated. Without buffering, simple disk controllers will almost always be faster than accelerated raid controllers because the accelerated controllers add more latency between the host and the disk. A simple controller will directly funnel data from the host to the disk as soon as it receives a command. An accelerated controller, however, has a CPU and a mini-OS on it that has to schedule the work coming from the host and handle its own tasks and interrupts. This adds latency that quickly adds up under benchmarks. Your numbers clearly demonstrate this. Scott