Date: Thu, 22 Dec 2011 09:56:55 +0000 From: Igor Mozolevsky <igor@hybrid-lab.co.uk> To: Daniel Kalchev <daniel@digsys.bg> Cc: freebsd-current@freebsd.org Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server Message-ID: <CADWvR2jQMcOrPEzU5Ug4TRp9hxvD6qOVTZYjqqozarA-%2B-DsQw@mail.gmail.com> In-Reply-To: <4EF2C613.3020609@digsys.bg> References: <xf5fxrkpagw2qf65tk9y2njf.1324492907631@email.android.com> <4EF25468.9040204@gmail.com> <CAOjFWZ7%2Bx61QPB-cO5ppWwY-nCRFvs9P76H_SO%2BCSL41APLwsA@mail.gmail.com> <CADWvR2jVPkLrM686Xhk12U0poV7CCqB3LF_ZbTPTHFKjt%2BdP=g@mail.gmail.com> <4EF2C613.3020609@digsys.bg>
next in thread | previous in thread | raw e-mail | index | archive | help
On 22 December 2011 05:54, Daniel Kalchev <daniel@digsys.bg> wrote: > > > On 22.12.11 00:33, Igor Mozolevsky wrote: >> >> Using the same argument one can say that Ferrari F430 vs Toyota Prius is= a >> meaningless comparison because the under-the-hood equipment is different= . > > =C2=A0Of course, it is meaningless, the Ferrari will lose big time in the= fuel > consumption comparison! I believe it will also lose the price comparison = as > well. Not to speak the availability comparison. That's an oxymoron, right? The comparison cannot be meaningless---the reality is F430 will indeed use up more fuel than Prius. If a benchmark demonstrates a true reality, how can that benchmark be possibly meaningless??? Same benchmark might be irrelevant to someone who wants to know how fast they can get from A to B, but irrelevant is not a synonym for meaningless! > You say that comparison is meaningless, yet you intend to compare those t= wo > cars? I didn't say that at all, I was demonstrating fallacy of the argument that the comparisons were meaningless. > Any 'benchmark' has a goal. You first define the goal and then measure ho= w > different contenders achieve it. Reaching the goal may have several > measurable metrics, that you will use to later declare the winner in each= . > Besides, you need to define a baseline and be aware of what theoretical > max/min values are possible. Treating a benchmark as a binary win/lose is rather naive, it's not a competition, and (I hope) no serious person ever does that. A proper benchmark shows true strength and weaknesses so than a well-informed intelligent decision can be taken by an individual according to that individual's needs. The caveat, of course, is making your methodology clear and methods repeatable! Cheers, -- Igor M.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CADWvR2jQMcOrPEzU5Ug4TRp9hxvD6qOVTZYjqqozarA-%2B-DsQw>