From owner-freebsd-questions Sat Mar 18 6:58:17 2000 Delivered-To: freebsd-questions@freebsd.org Received: from boris.netgate.net (boris.netgate.net [204.145.147.154]) by hub.freebsd.org (Postfix) with ESMTP id 1A5E137B5D3 for ; Sat, 18 Mar 2000 06:58:14 -0800 (PST) (envelope-from fbsddave@mrcaffeine.com) Received: from localhost (wellsian@localhost) by boris.netgate.net (8.9.3/8.9.3) with ESMTP id GAA61124; Sat, 18 Mar 2000 06:54:48 -0800 (PST) (envelope-from fbsddave@mrcaffeine.com) Date: Sat, 18 Mar 2000 06:54:48 -0800 (PST) From: fbsd-dave X-Sender: wellsian@boris.netgate.net To: Mark Smith Cc: freebsd-questions@freebsd.org Subject: Re: vinum stats and question(addendum) In-Reply-To: <200003180747.XAA29239@beta.tricity.wsu.edu> Message-ID: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG "b"? I would guess all your writes are walking on each other. And with power-of-two stripe sizes all your superblocks will be on one drive. That's a slow combination. Try some tests again but starting at 128k, and try, for instance, 129k to see what it does. Greg is working on a program to figure ideal sizes so one day that'll be easier. Also, I notice your processor is mostly maxed. I think it's spending itself on the small stripe transactions. A faster processor could help but that would be the wrong fix IMO. The usual stuff about alternating drives between channels holds here, too. With a 4 drive stripe, I've seen better than 50% improvements from putting drives a/c on one channel and b/d on another vs. a/b and c/d. I'd guess your tiny stripe sizes would especially benefit from multiple channels but I haven't tested anything that small. Let us know! Now I'm curious! :) Dave On Fri, 17 Mar 2000, Mark Smith wrote: > Here's the revised vinum benchmarks using both rawio (the first batch) > and bonnie (the second). In each case, the first 2 entries are > the seperate drives. Then comes the vinum volume, testc. I ran > striping at 128b, 256b, 512b and 1024b. > > In all cases, vinum absolutly dies in the sequential write, at least in > my case. > > Any comments? > > first is the conf file. > ------------------------------------------------------------ > drive drive1 device /dev/da1s2e > drive drive2 device /dev/da2s2e > > volume testc > plex org striped 1024b > sd length 5169m drive drive1 > sd length 5169m drive drive2 > ------------------------------------------------------------ > > root$ rawio -av /dev/da1s2e > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 709.9 44 44065.0 2690 877.6 54 6575.6 401 > > root$ rawio -av /dev/da2s2e > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 707.9 44 49995.6 3051 931.5 58 6818.3 416 > > root$ rawio -av /dev/vinum/testc #128b > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 1082.3 67 40147.9 2450 1031.1 64 1944.5 119 > > root$ rawio -av /dev/vinum/testc #256b > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 1090.6 68 37885.9 2312 1006.4 62 1946.2 119 > > root$ rawio -av /dev/vinum/testc #512b > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 1112.6 69 38752.4 2365 1009.6 62 1948.3 119 > > root$ rawio -av /dev/vinum/testc #1024b > Random read Sequential read Random write Sequential write > ID K/sec /sec K/sec /sec K/sec /sec K/sec /sec > anon 1129.3 69 38876.6 2373 1000.1 62 1942.4 119 > > Bonnie -s 200 > > /disk1 /dev/sd1s2e > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7510 93.4 8428 21.5 2856 15.8 7485 93.2 11164 27.4 227.0 6.3 > > /disk2 /dev/sd2s2e > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7546 92.4 8403 21.6 2871 15.9 7512 93.0 11375 29.6 199.9 5.9 > > /testc /dev/vinum/testc 128 blocks > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7862 95.8 2720 26.3 5495 30.6 6129 74.9 22002 65.6 319.7 9.6 > > /testc /dev/vinum/testc 256 blocks > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7835 95.2 2774 26.9 5890 31.9 6299 77.0 21613 65.2 311.8 9.4 > > /testc /dev/vinum/testc 512 blocks > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7881 96.3 2886 25.9 5765 31.7 6297 77.0 16289 46.5 315.8 9.6 > > /testc /dev/vinum/testc 1024 blocks > -------Sequential Output-------- ---Sequential Input-- --Random-- > -Per Char- --Block--- -Rewrite-- -Per Char- --Block--- --Seeks--- > MB K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU K/sec %CPU /sec %CPU > 200 7863 95.7 2873 26.4 4058 23.2 6273 77.5 13422 36.0 312.0 9.5 To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message