From owner-freebsd-current@FreeBSD.ORG Sat Mar 12 23:43:55 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1C31A1065670 for ; Sat, 12 Mar 2011 23:43:55 +0000 (UTC) (envelope-from egypcio@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id B7D078FC12 for ; Sat, 12 Mar 2011 23:43:54 +0000 (UTC) Received: by iwn33 with SMTP id 33so4531462iwn.13 for ; Sat, 12 Mar 2011 15:43:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=COO3JVovbo3+v/DWaaPGyeO+X94OL34nSgRaFDmb9D0=; b=ilyI8b7lsIlM5EVTb9fQY9c3ZC8acwfMrTYYfEemBIWzk0fvovkzyhEPJE4ijXucT9 KadSxK2UlJ6aH3Ze7TdtwnkJP1zHf7LFDIYFojt2zfMPCqVPNw11KQoSvRhcaiitWqAt vsaBK6UhOZX2GcUODq1UZjKeK21EOzMrVFpcQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; b=w2m/Cjla2obbDAtXYQii2AhdavKTYyJahPCO6LFa8CgK0OuzL9BpBkFovwI2+JKSFM KtAO0eogFTNEcbcK60afiuf11AaK/yCMh9nd5V2P0NPj1s348L8y0HiYRBN5FJDwIIX1 4K/4GnlU2jwo2I2WylrqRsU/8P8wM3On1db1s= MIME-Version: 1.0 Received: by 10.43.62.197 with SMTP id xb5mr413266icb.246.1299973434123; Sat, 12 Mar 2011 15:43:54 -0800 (PST) Sender: egypcio@gmail.com Received: by 10.42.157.1 with HTTP; Sat, 12 Mar 2011 15:43:54 -0800 (PST) In-Reply-To: <60071.1299936937@critter.freebsd.dk> References: <4D7B44AF.7040406@FreeBSD.org> <60071.1299936937@critter.freebsd.dk> Date: Sat, 12 Mar 2011 20:43:54 -0300 X-Google-Sender-Auth: GX5LixoND2XpviQhtlY6EzXfqfE Message-ID: From: =?ISO-8859-1?Q?Vin=EDcius_Zavam?= To: Poul-Henning Kamp Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-performance@freebsd.org, freebsd-current@freebsd.org, Martin Matuska Subject: Re: FreeBSD Compiler Benchmark: gcc-base vs. gcc-ports vs. clang X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 12 Mar 2011 23:43:55 -0000 2011/3/12 Poul-Henning Kamp : > In message <4D7B44AF.7040406@FreeBSD.org>, Martin Matuska writes: > > > Thanks a lot for doing this properly. > >>What significance level should I take? > > I think I set ministat(1) to use 95 % confidence level by default > and that is in general a pretty safe bet (1 in 20 chance) > >>I hope this approach is better :) > > Much, much better. > > As I said, this was not to go after you personally, but to point > out that we need to be more rigorous with benchmarks in general. > > -- > Poul-Henning Kamp =A0 =A0 =A0 | UNIX since Zilog Zeus 3.20 > phk@FreeBSD.ORG =A0 =A0 =A0 =A0 | TCP/IP since RFC 956 > FreeBSD committer =A0 =A0 =A0 | BSD since 4.3-tahoe > Never attribute to malice what can adequately be explained by incompetenc= e. i'm still curious about things like CPUTYPE=3D and -march=3D configured as native, gentlemen. is it the "golden egg" to use with our system or not? why "natives" aren't in the benchs? /me feels confused. --=20 Vin=EDcius Zavam profiles.google.com/egypcio