Date: Mon, 19 Dec 2011 09:13:09 +0000 From: Matthew Seaman <m.seaman@infracaninophile.co.uk> To: freebsd-current@freebsd.org Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server Message-ID: <4EEF0025.6040205@infracaninophile.co.uk> In-Reply-To: <6140271.20111219122721@serebryakov.spb.ru> References: <4EE1EAFE.3070408@m5p.com> <CAJ-FndDniGH8QoT=kUxOQ%2BzdVhWF0Z0NKLU0PGS-Gt=BK6noWw@mail.gmail.com> <4EE2AE64.9060802@m5p.com> <4EE88343.2050302@m5p.com> <CAFHbX1%2B5PttyZuNnYot8emTn_AWkABdJCvnpo5rcRxVXj0ypJA@mail.gmail.com> <4EE933C6.4020209@zedat.fu-berlin.de> <CAPjTQNEJDE17TLH-mDrG_-_Qa9R5N3mSeXSYYWtqz_DFidzYQw@mail.gmail.com> <20111215024249.GA13557@icarus.home.lan> <4EE9A2A0.80607@zedat.fu-berlin.de> <CAJ-VmomWnAvsVPcK0mfFECvFw_FKcja1m3NE9ue=TOkF%2Bx14Xg@mail.gmail.com> <CANY-Wm8jbtr3tiwdGQMDx8SVZKEBspGwTV7Q0wziYWsV%2Bf3BSQ@mail.gmail.com> <6140271.20111219122721@serebryakov.spb.ru>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --]
On 19/12/2011 08:27, Lev Serebryakov wrote:
> Here is one problem: we have choice from three items:
>
> (1) Make FreeBSD looks good on benchmarks by "fixing" FreeBSD
>
> (2) Make FreeBSD looks good on benchmarks by "fixing" Phoronix
> (communication with them, convincing, that they benchamrks are unfare
> / meaningless, ets)
(2a) Ignore Phoronix, other than explaining concisely why their numbers
are complete balderdash. Publish our own benchmarks, done with care and
rigour and using well defined, repeatable, peer reviewed methodology
that anyone can repeat. Aggressively publicise these results.
> (3) Lose [potential] userbase.
Indeed. Unfortunately "performance" is /the/ deciding factor in many OS
choices, never mind that it is an impossibly complex subject to
generalise to a few management-friendly numbers in a one-size-fits-all
abstract way. Having only one source of published numbers suggesting
that "OS Foo is better" *even if those numbers are completely bogus*
will have a disproportionate effect.
Cheers,
Matthew
--
Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard
Flat 3
PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate
JID: matthew@infracaninophile.co.uk Kent, CT11 9PW
[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Version: GnuPG/MacGPG2 v2.0.16 (Darwin)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAk7vACYACgkQ8Mjk52CukIyprwCfdBSflN+g1ON0ZQhfhBNzlyPM
eYUAnjgrAFW1/QlDQHwQ0a3Cff5KwHlh
=lCiv
-----END PGP SIGNATURE-----
help
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4EEF0025.6040205>