Date: Mon, 19 Dec 2011 13:47:20 +0400 From: Lev Serebryakov <lev@FreeBSD.org> To: Matthew Seaman <m.seaman@infracaninophile.co.uk> Cc: freebsd-current@freebsd.org Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server Message-ID: <1704813846.20111219134720@serebryakov.spb.ru> In-Reply-To: <4EEF0025.6040205@infracaninophile.co.uk> References: <4EE1EAFE.3070408@m5p.com> <CAJ-FndDniGH8QoT=kUxOQ%2BzdVhWF0Z0NKLU0PGS-Gt=BK6noWw@mail.gmail.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <CAFHbX1%2B5PttyZuNnYot8emTn_AWkABdJCvnpo5rcRxVXj0ypJA@mail.gmail.com> <4EE933C6.4020209@zedat.fu-berlin.de> <CAPjTQNEJDE17TLH-mDrG_-_Qa9R5N3mSeXSYYWtqz_DFidzYQw@mail.gmail.com> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <CAJ-VmomWnAvsVPcK0mfFECvFw_FKcja1m3NE9ue=TOkF%2Bx14Xg@mail.gmail.com> <CANY-Wm8jbtr3tiwdGQMDx8SVZKEBspGwTV7Q0wziYWsV%2Bf3BSQ@mail.gmail.com> <6140271.20111219122721@serebryakov.spb.ru> <4EEF0025.6040205@infracaninophile.co.uk>
index | next in thread | previous in thread | raw e-mail
Hello, Matthew. You wrote 19 декабря 2011 г., 13:13:09: >> (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD >> >> (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix >> (communication with them, convincing, that they benchamrks are unfare >> / meaningless, ets) > (2a) Ignore Phoronix, other than explaining concisely why their numbers > are complete balderdash. Publish our own benchmarks, done with care and > rigour and using well defined, repeatable, peer reviewed methodology > that anyone can repeat. Aggressively publicise these results. Ok, it is The Way too, I agree. But in modern world, unfortunately (for me, and I'm sure, for many FreeBSD hackers), keywords are "Aggressively publicise" but not "done with care and rigour and using well defined, repeatable, peer reviewed methodology that anyone can repeat" >> (3) Lose [potential] userbase. > Indeed. Unfortunately "performance" is /the/ deciding factor in many OS > choices, never mind that it is an impossibly complex subject to > generalise to a few management-friendly numbers in a one-size-fits-all > abstract way. Having only one source of published numbers suggesting > that "OS Foo is better" *even if those numbers are completely bogus* > will have a disproportionate effect. Yep. -- // Black Lion AKA Lev Serebryakov <lev@FreeBSD.org>help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1704813846.20111219134720>