From owner-freebsd-questions@FreeBSD.ORG Thu Mar 2 23:50:36 2006 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 477A716A420 for ; Thu, 2 Mar 2006 23:50:36 +0000 (GMT) (envelope-from nikolas.britton@gmail.com) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id B436843D45 for ; Thu, 2 Mar 2006 23:50:35 +0000 (GMT) (envelope-from nikolas.britton@gmail.com) Received: by xproxy.gmail.com with SMTP id t11so357557wxc for ; Thu, 02 Mar 2006 15:50:35 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=D2kTwJ/gwyROOYrf2n8UDVVPRHhoNSRo+JaRsfYRJqCZa7zrRhjPxmO+dlY21JN+QESF8++TFUCkzZX7o9aClAZ98EMokU13yNjbag4UkMWh5G0U5Adx2+RkEfIFLQJDQSGwpaBG8kqAAGPVdL787+AldCftpCr2bCO3d0itEqs= Received: by 10.70.110.20 with SMTP id i20mr3986970wxc; Thu, 02 Mar 2006 15:50:35 -0800 (PST) Received: by 10.70.65.9 with HTTP; Thu, 2 Mar 2006 15:50:35 -0800 (PST) Message-ID: Date: Thu, 2 Mar 2006 17:50:35 -0600 From: "Nikolas Britton" To: "Alex Zbyslaw" In-Reply-To: <44072515.6080105@dial.pipex.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <61560.207.70.139.52.1139628926.squirrel@www.compedgeracing.com> <50778.207.70.139.52.1140002253.squirrel@www.compedgeracing.com> <43F3EDD6.80707@mra.co.id> <44052663.7000802@mra.co.id> <440565FF.3030002@mra.co.id> <44058D9E.3010801@dial.pipex.com> <440675E0.1020204@mra.co.id> <4406CB4D.5050300@dial.pipex.com> <44072515.6080105@dial.pipex.com> Cc: Liste FreeBSD Subject: Re: SATA Raid (stress test..) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 02 Mar 2006 23:50:36 -0000 On 3/2/06, Alex Zbyslaw wrote: > Nikolas Britton wrote: > > >This and all the other benchmarks you've run are useless. Run a real > >benchmark like iozone. It's in ports under benchmarks/iozone. > >http://www.iozone.org/ > > > > > Please can you be careful when you attribute your comments. You've sent > this email "to" me, and left only my name in the attributions as if I > were someone suggesting either dd or diskinfo as accurate benchmarks, > when in fact my contribution was to suggest unixbench and sandra-lite. > Maybe you hate those too, in which case you can quote what I said > in-context and rubbish that at your pleasure. Yes I see your point, it does look like I'm replying to something you wrote. This was a oversight and I am sorry. > > The OP sent poor-throughput dd stats, and I explained why they were > poor. The OP then complained that diskinfo -t stats weren't up to > snuff, so I contributed mine because they were comparable and I couldn't > see why he(?) didn't like his(?). > > I would contend that the statement "all the other benchmarks you've run > are useless" is grandiose over-generalisation. Both dd (with a > sensible blocksize) and diskinfo -t will give you useful information. > One might be an idiot to trust the data to several decimal places, but > if the result from both was, say, a transfer rate of 5Mb/s when you > expected 50Mb/s, you could conclude that something was up. Of course > neither mimics real-world behaviour; but both likely provide reasonable > maxima. You may find that "useless", but with no explanation for your > reasoning, your statement isn't terribly helpful. > Yes, well you see it's a long story :-) By sheer happenstance over the night had I drive fail on the array I ran the diskinfo test on, if I would have check my email I'd have know this. So when I logged into the system via ssh and ran the test I did not know that the array (RAID5, 8 disks, SATAII, PCI-X) was operating in degraded mode. Having run extensive iozone testing on this array when I first designed it I just assumed diskinfo was lying when it said I was getting 70MB/s transfers, I was getting sustained read transfer rates of 105MB/s on a 650GB test file back when it only had 4 drives. This is the reason I said diskinfo was useless, however, I still feel that diskinfo is sorta useless because it only shows you the tip of the iceberg. A tool such as iozone is much more useful for getting accurate numbers for the entire disk subsystem. Do you know how disk caching effects your system? Do you know what FreeBSD, and it's tunable setting, can do to your file system? Best stripe and block size for your needs? iozone can tell you all of this and more. Remember that 105MB/s number I quoted above?, that's just the sustained read transfer rate for a big ass file, I don't need to work with big ass files. I need to work with 15MB files (+/- 5MB). After buying the right disks, controller, mainboard etc. and lots of tuning with the help of iozone I get: 200 - 350MB/s overall (read, write, etc.) for files less then or equal to 64MB*. So anyways, that's what iozone can do for you. google it and you'll find out more stuff about it. *in a 4 disk setup running FreeBSD 5.4, I have 8 disks today and run FreeBSD 6.1-PRERELEASE. so those numbers went up because I have 4 more disks and the file system speed improvements to the FreeBSD 6.x line, but I have not benchmarked the improvements because the server is in production now. -- BSD Podcasts @ http://bsdtalk.blogspot.com/