From owner-freebsd-fs@FreeBSD.ORG Wed Feb 24 01:39:28 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 94CDE106564A; Wed, 24 Feb 2010 01:39:28 +0000 (UTC) (envelope-from ticso@cicely7.cicely.de) Received: from raven.bwct.de (raven.bwct.de [85.159.14.73]) by mx1.freebsd.org (Postfix) with ESMTP id 005088FC1D; Wed, 24 Feb 2010 01:39:27 +0000 (UTC) Received: from mail.cicely.de ([10.1.1.37]) by raven.bwct.de (8.13.4/8.13.4) with ESMTP id o1NN9E9Q073876 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Wed, 24 Feb 2010 00:09:14 +0100 (CET) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (cicely7.cicely.de [10.1.1.9]) by mail.cicely.de (8.14.3/8.14.3) with ESMTP id o1NN97N2055422 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 24 Feb 2010 00:09:07 +0100 (CET) (envelope-from ticso@cicely7.cicely.de) Received: from cicely7.cicely.de (localhost [127.0.0.1]) by cicely7.cicely.de (8.14.2/8.14.2) with ESMTP id o1NN92pM021666; Wed, 24 Feb 2010 00:09:07 +0100 (CET) (envelope-from ticso@cicely7.cicely.de) Received: (from ticso@localhost) by cicely7.cicely.de (8.14.2/8.14.2/Submit) id o1NN8i14021664; Wed, 24 Feb 2010 00:08:44 +0100 (CET) (envelope-from ticso) Date: Wed, 24 Feb 2010 00:08:44 +0100 From: Bernd Walter To: Ivan Voras Message-ID: <20100223230844.GP13767@cicely7.cicely.de> References: <20100223193458.GO13767@cicely7.cicely.de> <9bbcef731002231321t352ce3e6y5fdafbf75b7fac54@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9bbcef731002231321t352ce3e6y5fdafbf75b7fac54@mail.gmail.com> X-Operating-System: FreeBSD cicely7.cicely.de 7.0-STABLE i386 User-Agent: Mutt/1.5.11 X-Spam-Status: No, score=-4.4 required=5.0 tests=ALL_TRUSTED=-1.8, BAYES_00=-2.599 autolearn=ham version=3.2.5 X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on spamd.cicely.de Cc: freebsd-fs@freebsd.org, ticso@cicely.de Subject: Re: Some ZFS+NFS benchmarks (OpenSolaris) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: ticso@cicely.de List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Feb 2010 01:39:28 -0000 On Tue, Feb 23, 2010 at 10:21:41PM +0100, Ivan Voras wrote: > On 23 February 2010 20:34, Bernd Walter wrote: > > On Tue, Feb 23, 2010 at 08:15:48PM +0100, Ivan Voras wrote: > >> http://staff.science.uva.nl/~delaat/sne-2009-2010/p02/report.pdf > >> > >> It's curious how ZIL on SSD doesn't help them with NFS when they > >> increase the load. > > > > My assumption is because they already write linear on SSD and get a more > > or less fixed write rate, while parallel write rate with disks can > > increase because of reordering. > > > > I'm personally impressed by my own tests on how much our current > > USB stack can speed up random reads even with cheap USB flash sticks > > used as cache devices. > > This is surprising to hear - I've just run some randomio > (http://www.arctic.org/~dean/randomio/) tests on two little used USB > flash sticks and got around 110 IOPS sequential writing (~~ 7 MB/s) > and a bit less than 30 IOPS random writes of 4 KB buffers (amounting > to ~~ 1 MB/s). Yes - your values seem to fit with my assumed values, but I'm talking about L2ARC cache devices here. Those are written linear with small bandwith and read random. If they are too slow ZFS just drops data and cache fill slower. Random read access for USB sticks is great compared to HDD - although USB has a high latency overhead. > (the test command was "randomio file 16 1 1 4096 10"). > > The ZIL should be written practically linearly - the sequential write > rate is relevant here - and it is actually significantly slower than > what mechanical HDDs can achieve. A small test with ZIL on USB sticks was horrible because it couldn't take up with write speed. > Is your result with ZIL perhaps simply because you moved it to another > device and so freed the main device? I assume for ZIL you really need a device with fast write speed, but I have not much experience with ZIL devices. -- B.Walter http://www.bwct.de Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm.