Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 24 Feb 2010 00:08:44 +0100
From:      Bernd Walter <ticso@cicely7.cicely.de>
To:        Ivan Voras <ivoras@freebsd.org>
Cc:        freebsd-fs@freebsd.org, ticso@cicely.de
Subject:   Re: Some ZFS+NFS benchmarks (OpenSolaris)
Message-ID:  <20100223230844.GP13767@cicely7.cicely.de>
In-Reply-To: <9bbcef731002231321t352ce3e6y5fdafbf75b7fac54@mail.gmail.com>
References:  <hm19h4$8ah$1@dough.gmane.org> <20100223193458.GO13767@cicely7.cicely.de> <9bbcef731002231321t352ce3e6y5fdafbf75b7fac54@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Feb 23, 2010 at 10:21:41PM +0100, Ivan Voras wrote:
> On 23 February 2010 20:34, Bernd Walter <ticso@cicely7.cicely.de> wrote:
> > On Tue, Feb 23, 2010 at 08:15:48PM +0100, Ivan Voras wrote:
> >> http://staff.science.uva.nl/~delaat/sne-2009-2010/p02/report.pdf
> >>
> >> It's curious how ZIL on SSD doesn't help them with NFS when they
> >> increase the load.
> >
> > My assumption is because they already write linear on SSD and get a more
> > or less fixed write rate, while parallel write rate with disks can
> > increase because of reordering.
> >
> > I'm personally impressed by my own tests on how much our current
> > USB stack can speed up random reads even with cheap USB flash sticks
> > used as cache devices.
> 
> This is surprising to hear - I've just run some randomio
> (http://www.arctic.org/~dean/randomio/) tests on two little used USB
> flash sticks and got around 110 IOPS sequential writing (~~ 7 MB/s)
> and a bit less than 30 IOPS random writes of 4 KB buffers (amounting
> to ~~ 1 MB/s).

Yes - your values seem to fit with my assumed values, but I'm talking
about L2ARC cache devices here.
Those are written linear with small bandwith and read random.
If they are too slow ZFS just drops data and cache fill slower.
Random read access for USB sticks is great compared to HDD - although
USB has a high latency overhead.

> (the test command was "randomio file 16 1 1 4096 10").
> 
> The ZIL should be written practically linearly - the sequential write
> rate is relevant here - and it is actually significantly slower than
> what mechanical HDDs can achieve.

A small test with ZIL on USB sticks was horrible because it couldn't
take up with write speed.

> Is your result with ZIL perhaps simply because you moved it to another
> device and so freed the main device?

I assume for ZIL you really need a device with fast write speed, but
I have not much experience with ZIL devices.

-- 
B.Walter <bernd@bwct.de> http://www.bwct.de
Modbus/TCP Ethernet I/O Baugruppen, ARM basierte FreeBSD Rechner uvm.



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20100223230844.GP13767>