From owner-freebsd-hackers@FreeBSD.ORG Tue Nov 6 17:46:54 2012 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CCD3E24E for ; Tue, 6 Nov 2012 17:46:54 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-pa0-f54.google.com (mail-pa0-f54.google.com [209.85.220.54]) by mx1.freebsd.org (Postfix) with ESMTP id 94F688FC08 for ; Tue, 6 Nov 2012 17:46:54 +0000 (UTC) Received: by mail-pa0-f54.google.com with SMTP id bi1so547503pad.13 for ; Tue, 06 Nov 2012 09:46:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=references:mime-version:in-reply-to:content-type :content-transfer-encoding:message-id:cc:x-mailer:from:subject:date :to; bh=jWoa5gkzLAaGUURvOMQS9YOUmMw9nj8Qk+0B06rRL3k=; b=mh6w21Nk+K3nXiBWzsz012Knaa7e9orSCLpamGfOmk1ph+g8mqogOMyrCBEtdZ3Gug NR4q8slJWQdmzIg9h9QZ28ro6LHbHSovTVy9uCHWEUOOvXHGb73IykFQ3dbEkWNiOxeg OaJgro4ecsudt2txhmU1zCqzt23bXVAg/GwNITpszqA7QzPYrULUvATWZDxbTVRiD9Sx aQ1I0mBNZ49Ex3wDdltKJ/1oq5nsohStApazDofJxQ9SSIDm4AXTOaF4OtyB/7kRhcae LMYqzbzlzGmpYn5zm2fkC/itW2Ra/Qg5LLIuVJiOV0hmo1eixLLIIdN2zcHu9LalTr6R YhRQ== Received: by 10.68.224.161 with SMTP id rd1mr5600088pbc.49.1352224013186; Tue, 06 Nov 2012 09:46:53 -0800 (PST) Received: from [10.77.14.93] (mobile-166-147-081-002.mycingular.net. [166.147.81.2]) by mx.google.com with ESMTPS id j4sm12773490pax.31.2012.11.06.09.46.40 (version=SSLv3 cipher=OTHER); Tue, 06 Nov 2012 09:46:52 -0800 (PST) References: <50980ADD.4010402@rawbw.com> Mime-Version: 1.0 (1.0) In-Reply-To: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Message-Id: X-Mailer: iPhone Mail (10A403) From: Garrett Cooper Subject: Re: pgbench performance is lagging compared to Linux and DragonflyBSD? Date: Tue, 6 Nov 2012 09:46:22 -0800 To: Wojciech Puchar Cc: Olivier Smedts , Yuri , "freebsd-hackers@freebsd.org" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2012 17:46:54 -0000 On Nov 6, 2012, at 8:55 AM, Wojciech Puchar = wrote: >>> Tuning operating system for single benchmark is an example of that child= ish >>> behaviour. >>=20 >> LOL. That's what "we" did several years ago : >> http://people.freebsd.org/~kris/scaling/dfly.html >=20 > i've seen that page some time ago but i don't really care of it. > i just wasn't interested. >=20 > Still - DOING such benchmark is good, as it can show general problems in u= sed algorithms. >=20 > But working on software to make it better in some kind of synthetic benchm= ark is common in commercial software world. ("We have more performance per b= uck than company X") "Synthetic benchmarks" as you put it shouldn't be the ultimate basis for a d= ecision, but instead allow users to gauge whether or not a certain software o= r hardware configuration is suitable for their given workload. No more, no l= ess. The fact that they're being used in this manner is a bit like a salesma= n selling snake oil as the results aren't necessarily the result of a "best"= configuration for all competing platforms, but instead an unknown configura= tion in this case. A similar statement about the importance of micro benchmarks can be made... Thanks, -Garrett=