Date: Sun, 21 Aug 2016 15:21:01 +1000 From: Kubilay Kocak <koobs@FreeBSD.org> To: Erich Dollansky <erichsfreebsdlist@alogt.com>, freebsd-stable <freebsd-stable@FreeBSD.org> Subject: Re: Benchmarks results for FreeBSD 11 Message-ID: <af0fefab-69d7-f0a9-3d6d-4a9891d5a156@FreeBSD.org> In-Reply-To: <20160819073422.4292997b@X220.alogt.com> References: <20160819073422.4292997b@X220.alogt.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 19/08/2016 9:34 AM, Erich Dollansky wrote: > Hi, > > I am sure that some know of this site: > > http://www.phoronix.com/scan.php?page=article&item=2bsd-7linux-bench&num=4 > > I wonder about the results for FreeBSD. As I do not have 11 on my > machines, a stupid question. Are there still some debugging aids > enabled in 11? They're off in those versions, but did note compiler (and compiler args) differences between within most tests (See attachments) as you mentioned. > I know that some of the results are caused by the use of CLang and > some of the results test applications/compilers and not operating > systems. gcc/clang tests and defaults in upstream build systems are almost certainly contributors. At a minimum it would be nice to see an attempt to standardise (force) compiler args across all OS runs for the same test, even if this doesn't prove to be perfect. Separating or adding tests for the same tests using non-default compilers (in particular latest GCC versions from ports) so they match across OS's would also be valuable. At a minimum it would be worth Michael highlighting the differences, and ideally removing these variables from the tests, even if they aren't default configurations. Though a test of out of the box configurations is still valuable, it can serve to muddy the underlying differences and make them tougher to isolate.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?af0fefab-69d7-f0a9-3d6d-4a9891d5a156>