From owner-freebsd-performance@FreeBSD.ORG  Sat Nov 10 20:14:51 2007
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 1282716A468
	for <freebsd-performance@freebsd.org>;
	Sat, 10 Nov 2007 20:14:51 +0000 (UTC)
	(envelope-from kris@FreeBSD.org)
Received: from weak.local (pointyhat.freebsd.org [IPv6:2001:4f8:fff6::2b])
	by mx1.freebsd.org (Postfix) with ESMTP id D602213C4CB;
	Sat, 10 Nov 2007 20:14:44 +0000 (UTC)
	(envelope-from kris@FreeBSD.org)
Message-ID: <47361134.3050301@FreeBSD.org>
Date: Sat, 10 Nov 2007 21:14:44 +0100
From: Kris Kennaway <kris@FreeBSD.org>
User-Agent: Thunderbird 2.0.0.6 (Macintosh/20070728)
MIME-Version: 1.0
To: josh.carroll@gmail.com
References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com>	<8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com>	<20071104122546.S544@10.0.0.1>	<8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com>	<20071104151722.M544@10.0.0.1>	<8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com>	<20071106171059.M544@10.0.0.1>	<8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com>	<20071109145827.W639@10.0.0.1>	<8cb6106e0711091855x1305ee2bt6d57696df7c7564@mail.gmail.com>
	<8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com>
In-Reply-To: <8cb6106e0711101158o16887999rf7f7302ad44d0de8@mail.gmail.com>
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Cc: Jeff Roberson <jroberson@chesapeake.net>, freebsd-performance@freebsd.org
Subject: Re: ULE vs. 4BSD in RELENG_7
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 10 Nov 2007 20:14:51 -0000

Josh Carroll wrote:
>> ffmpeg:  1:38.885
>>
>> sysbench: (4,8,12,16 threads respectively):
>>    2221.93
>>    2327.87
>>    2292.49
>>    2269.29
>>
>> And buildworld: 13m47.052s
> 
> I ran these after changing the slice value to 7 as well with this patch.
> 
> ffmpeg:  1:38.547

BTW, it doesn't make much sense to be measuring to millisecond precision 
a quantity which has variation that is unknown but probably much larger 
:)  When trying to make comparisons to identify performance changes, a 
careful statistical approach is necessary.

Try the /usr/src/tools/tools/ministat utility for a simple and effective 
way to compare these kinds of noisy measurements and extract reliable 
comparisons.

Kris