Date: Fri, 23 Dec 2011 02:17:00 +0100 From: "O. Hartmann" <ohartman@zedat.fu-berlin.de> To: Igor Mozolevsky <igor@hybrid-lab.co.uk> Cc: freebsd-performance@freebsd.org, freebsd-current@freebsd.org, Daniel Kalchev <daniel@digsys.bg> Subject: Re: Benchmark (Phoronix): FreeBSD 9.0-RC2 vs. Oracle Linux 6.1 Server Message-ID: <4EF3D68C.2060803@zedat.fu-berlin.de> In-Reply-To: <CADWvR2jQMcOrPEzU5Ug4TRp9hxvD6qOVTZYjqqozarA-%2B-DsQw@mail.gmail.com> References: <xf5fxrkpagw2qf65tk9y2njf.1324492907631@email.android.com> <4EF25468.9040204@gmail.com> <CAOjFWZ7%2Bx61QPB-cO5ppWwY-nCRFvs9P76H_SO%2BCSL41APLwsA@mail.gmail.com> <CADWvR2jVPkLrM686Xhk12U0poV7CCqB3LF_ZbTPTHFKjt%2BdP=g@mail.gmail.com> <4EF2C613.3020609@digsys.bg> <CADWvR2jQMcOrPEzU5Ug4TRp9hxvD6qOVTZYjqqozarA-%2B-DsQw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigAF289CA4D0C93747BA1C84E1 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 12/22/11 10:56, Igor Mozolevsky wrote: > On 22 December 2011 05:54, Daniel Kalchev <daniel@digsys.bg> wrote: [...] >> Any 'benchmark' has a goal. You first define the goal and then measure= how >> different contenders achieve it. Reaching the goal may have several >> measurable metrics, that you will use to later declare the winner in e= ach. >> Besides, you need to define a baseline and be aware of what theoretica= l >> max/min values are possible. >=20 > Treating a benchmark as a binary win/lose is rather naive, it's not a > competition, and (I hope) no serious person ever does that. A proper > benchmark shows true strength and weaknesses so than a well-informed > intelligent decision can be taken by an individual according to that > individual's needs. The caveat, of course, is making your methodology > clear and methods repeatable! >=20 >=20 > Cheers, >=20 > -- Benchmarks also could lead developers to look into more details of the weak points of their OS, if they're open for that. Therefore, benchmarks are very useful. But not if any real fault of the OS is excused by a faulty becnhmarking. I remember that the worse threaded I/O performance of FreeBSD has been long discussed as a bad benchmarks schematics. Or even look at the thread regarding to SCHED_ULE. Why has a user, experiencing really worse performance with SCHED_ULE, in a nearly scientific manner some engineer the fault? I'd expect the developer or care-taking engineer taking care in a more user friendly manner. If a benchmark reveals some severe weak points in FreeBSD and I have to read about obscure tweaks of non documented sysctl, then this OS would be a no-go if I was a manager to make decissions. And yes, i know, FreeBSD is an free and open project. But I also know that this free and open project does not rely only on "volonteers". A volunteers do not expect funding or payment. So, even freeBSD is dependend on some finacial basis and such a basis has to be taken care of= =2E --------------enigAF289CA4D0C93747BA1C84E1 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (FreeBSD) iQEcBAEBAgAGBQJO89aMAAoJEOgBcD7A/5N8crUIAMyz/7q/VOujbdrUZrfa9MqN mZv95SkaWn9nBFOxL5FRVbrPgqg8Ys4D82JPsNQwdZbQD+rtGSm1wwQmRsSKu+cZ j4IfOyiLMnNC5e3hWYwjtaVow2QKQjmL9NaQzb3UHe+snD6i8nB/DAwC2jhduhN+ wPXJM61uNV6oaShc7+dOnc+wOz9Q6oDqtXFTZVdalVZkKi8CqEEP428FcH2N1lp2 X2bcPBFi9eOkzyuHk/F4weKMCFFzq13r+7nuz9Dqndc7adbvl08WMoxClP3Foe99 jMA0I8VbRXtdLeoXVlaCqa1+jobCbJFO5Dsu8NM5JdNi2IMa71KTjY1HGyBs4oQ= =UdvK -----END PGP SIGNATURE----- --------------enigAF289CA4D0C93747BA1C84E1--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4EF3D68C.2060803>