From owner-freebsd-stable@FreeBSD.ORG Wed Apr 7 18:15:50 2004 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7296816A4CE; Wed, 7 Apr 2004 18:15:50 -0700 (PDT) Received: from geri.cc.fer.hr (geri.cc.fer.hr [161.53.72.107]) by mx1.FreeBSD.org (Postfix) with ESMTP id C03E743D39; Wed, 7 Apr 2004 18:15:49 -0700 (PDT) (envelope-from ivoras@geri.cc.fer.hr) Received: from geri.cc.fer.hr (geri.cc.fer.hr [161.53.72.107]) by geri.cc.fer.hr (8.12.9p2/8.12.8) with ESMTP id i381DScj056513; Thu, 8 Apr 2004 03:13:28 +0200 (CEST) (envelope-from ivoras@geri.cc.fer.hr) Message-ID: <4074A7BB.7030509@geri.cc.fer.hr> Date: Thu, 08 Apr 2004 03:15:39 +0200 From: Ivan Voras User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.6b) Gecko/20031205 Thunderbird/0.4 X-Accept-Language: en-us, en MIME-Version: 1.0 References: <40745C07.6030501@fer.hr> <20040408001205.40c1b163@pheisar> <20040407234633.GA20155@panix.com> In-Reply-To: <20040407234633.GA20155@panix.com> X-Enigmail-Version: 0.83.1.0 X-Enigmail-Supports: pgp-inline, pgp-mime Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit cc: stable@freebsd.org cc: current@freebsd.org cc: netbsd-users@NetBSD.org cc: kernel@crater.dragonflybsd.org Subject: Re: Benchmarking X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 08 Apr 2004 01:15:50 -0000 >> Why didn't you benchmarked netbsd-current? I really did wish to do it, as it seems that the -current branch is much more advanced than the version I benchmarked, but unfortunately, I didn't have the time to do it. I may do it yet - I'm curious, is there a bootable ISO image installation available for NetBSD-current? Is PostgreSQL 7.4.x in the pkgsrc yet? > Presumably because it is not a released version of the operating system; > though, in that context, benchmarking "DragonflyBSD" seems rather odd, > to say the least. I completely agree with you. I got the idea wondering how does DragonFlyBSD compare to FreeBSD 5, expecting the DragonFly to appear equal, or faster than FreeBSD. Unfortunately, it didn't. The rest of the test sort of grew from that. :) > What is of much more concern to me, as someone who relies on high-quality > benchmark numbers to guide his role in OS development, is the poor > methodology of this study, particularly when compared to other recent > studies such as Felix von Leitner's (http://bulk.fefe.de/scalability). To me, honestly, this benchmark is not so good, for a number of reasons. > Here are three of the most obvious ones: Thank you for all your suggestions, I'll remember them if I do anything of such scale you're proposing :). I'm somewhat flattered that you would use my benchmark for anything but a rough estimate of performance as it is not meant to be highly accurate nor comprehensive. I simply didn't have the time or resources. I'm surprised that people who do serious OS development don't do this kind of tests more often, just to get a feel of how their system compares to the others'. I would expect such tests, made from professionals, to be done more comprehensively and accurately :) What I'm trying to say is: I'm not an OS developer, and this benchmark scratched my itch :) (see the updated FAQ for more info). I *do* believe that this benchmark serves its purpose - a rough comparison between the tested systems quite well. -- C isn't that hard: void (*(*f[])())() defines f as an array of unspecified size, of pointers to functions that return pointers to functions that return void.