Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 18 Mar 2000 06:54:48 -0800 (PST)
From:      fbsd-dave <fbsddave@mrcaffeine.com>
To:        Mark Smith <msmith@beta.tricity.wsu.edu>
Cc:        freebsd-questions@freebsd.org
Subject:   Re: vinum stats and question(addendum)
Message-ID:  <Pine.BSF.4.21.0003180634400.53717-100000@boris.netgate.net>
In-Reply-To: <200003180747.XAA29239@beta.tricity.wsu.edu>

next in thread | previous in thread | raw e-mail | index | archive | help
"b"? I would guess all your writes are walking on each other. And with
power-of-two stripe sizes all your superblocks will be on one drive.
That's a slow combination. Try some tests again but starting at 128k, and
try, for instance, 129k to see what it does. Greg is working on a program
to figure ideal sizes so one day that'll be easier. Also, I notice your
processor is mostly maxed. I think it's spending itself on the small
stripe transactions. A faster processor could help but that would be the
wrong fix IMO.

The usual stuff about alternating drives between channels holds here, too.
With a 4 drive stripe, I've seen better than 50% improvements from putting
drives a/c on one channel and b/d on another vs. a/b and c/d. I'd guess
your tiny stripe sizes would especially benefit from multiple channels but
I haven't tested anything that small.

Let us know! Now I'm curious! :)

Dave

On Fri, 17 Mar 2000, Mark Smith wrote:

> Here's the revised vinum benchmarks using both rawio (the first batch)
> and bonnie (the second).  In each case, the first 2 entries are
> the seperate drives.  Then comes the vinum volume, testc.  I ran
> striping at 128b, 256b, 512b and 1024b.
> 
> In all cases, vinum absolutly dies in the sequential write, at least in
> my case.
> 
> Any comments?
> 
> first is the conf file.
> ------------------------------------------------------------
> drive drive1 device /dev/da1s2e
> drive drive2 device /dev/da2s2e
> 
> volume testc
> plex org striped 1024b
> sd length 5169m drive drive1
> sd length 5169m drive drive2
> ------------------------------------------------------------
> 
> root$ rawio -av /dev/da1s2e
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon        709.9    44  44065.0  2690     877.6    54    6575.6   401
> 
> root$ rawio -av /dev/da2s2e
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon        707.9    44  49995.6  3051     931.5    58    6818.3   416
> 
> root$ rawio -av /dev/vinum/testc  #128b
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon       1082.3    67  40147.9  2450    1031.1    64    1944.5   119
> 
> root$ rawio -av /dev/vinum/testc  #256b
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon       1090.6    68   37885.9  2312    1006.4    62    1946.2   119
> 
> root$ rawio -av /dev/vinum/testc  #512b
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon       1112.6    69  38752.4  2365    1009.6    62    1948.3   119
> 
> root$ rawio -av /dev/vinum/testc  #1024b
>            Random read  Sequential read    Random write Sequential write
> ID          K/sec  /sec    K/sec  /sec     K/sec  /sec     K/sec  /sec
> anon       1129.3    69  38876.6  2373    1000.1    62    1942.4   119
> 
> Bonnie -s 200
> 
> /disk1 /dev/sd1s2e
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7510 93.4  8428 21.5  2856 15.8  7485 93.2 11164 27.4 227.0  6.3
> 
> /disk2 /dev/sd2s2e
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7546 92.4  8403 21.6  2871 15.9  7512 93.0 11375 29.6 199.9  5.9
> 
> /testc /dev/vinum/testc  128 blocks
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7862 95.8  2720 26.3  5495 30.6  6129 74.9 22002 65.6 319.7  9.6
> 
> /testc /dev/vinum/testc  256 blocks
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7835 95.2  2774 26.9  5890 31.9  6299 77.0 21613 65.2 311.8  9.4
> 
> /testc /dev/vinum/testc  512 blocks
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7881 96.3  2886 25.9  5765 31.7  6297 77.0 16289 46.5 315.8  9.6
> 
> /testc /dev/vinum/testc  1024 blocks
>     -------Sequential Output-------- ---Sequential Input-- --Random--
>     -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks---
>  MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU  /sec %CPU
> 200  7863 95.7  2873 26.4  4058 23.2  6273 77.5 13422 36.0 312.0  9.5




To Unsubscribe: send mail to majordomo@FreeBSD.org
with "unsubscribe freebsd-questions" in the body of the message




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?Pine.BSF.4.21.0003180634400.53717-100000>