From owner-freebsd-current@FreeBSD.ORG  Wed Aug 12 13:02:04 2009
Return-Path: <owner-freebsd-current@FreeBSD.ORG>
Delivered-To: current@FreeBSD.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 1B1A01065672
	for <current@FreeBSD.org>; Wed, 12 Aug 2009 13:02:04 +0000 (UTC)
	(envelope-from rdivacky@vlk.vlakno.cz)
Received: from vlakno.cz (77-93-215-190.static.masterinter.net [77.93.215.190])
	by mx1.freebsd.org (Postfix) with ESMTP id C62C18FC5E
	for <current@FreeBSD.org>; Wed, 12 Aug 2009 13:02:02 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
	by vlakno.cz (Postfix) with ESMTP id 963B19CB126;
	Wed, 12 Aug 2009 14:59:39 +0200 (CEST)
X-Virus-Scanned: amavisd-new at vlakno.cz
Received: from vlakno.cz ([127.0.0.1])
	by localhost (lev.vlakno.cz [127.0.0.1]) (amavisd-new, port 10024)
	with ESMTP id 5aBUr3xV20Xb; Wed, 12 Aug 2009 14:59:37 +0200 (CEST)
Received: from vlk.vlakno.cz (localhost [127.0.0.1])
	by vlakno.cz (Postfix) with ESMTP id 726599CB113;
	Wed, 12 Aug 2009 14:59:37 +0200 (CEST)
Received: (from rdivacky@localhost)
	by vlk.vlakno.cz (8.14.3/8.14.3/Submit) id n7CCxbPT095970;
	Wed, 12 Aug 2009 14:59:37 +0200 (CEST) (envelope-from rdivacky)
Date: Wed, 12 Aug 2009 14:59:37 +0200
From: Roman Divacky <rdivacky@FreeBSD.org>
To: Robert Watson <rwatson@FreeBSD.org>
Message-ID: <20090812125937.GA95810@freebsd.org>
References: <alpine.BSF.2.00.0908121329130.66335@fledge.watson.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <alpine.BSF.2.00.0908121329130.66335@fledge.watson.org>
User-Agent: Mutt/1.4.2.3i
Cc: current@FreeBSD.org
Subject: Re: Call for regression and performance testing - 8.0
X-BeenThere: freebsd-current@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Discussions about the use of FreeBSD-current
	<freebsd-current.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>, 
	<mailto:freebsd-current-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-current>
List-Post: <mailto:freebsd-current@freebsd.org>
List-Help: <mailto:freebsd-current-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-current>,
	<mailto:freebsd-current-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 12 Aug 2009 13:02:04 -0000

>   Performance testing
> 
> On the performance front, life is always a bit more tricky -- performance 
> testing is a subtle art.  However, the most clear lessons are that (a) 
> testing with diverse workloads and diverse environments is extremely 
> important, (b) you should do multiple runs and use ministat(1) to analyze 
> results, and (c) that you want to compare apples with apples -- use the 
> same hardware/configuration wherever possible.  Watch out for annoying nits 
> such as partition layout affecting I/O throughput for two different 
> installs on the same disk.
> 
> Pick something you think is important to you: bytes/sec over TCP on 
> loopback, web hits/sec, NFS ops/sec, disk I/O transactions/sec, and do some 
> comparison between 7.2 and 8.0.  If you find improvement -- great!  If you 
> find a regression, please start a thread on current@ to help get it 
> diagnosed.  And if you want help doing performance measurement for a 
> particular workload that isn't well studied, send some e-mail to 
> performance@ to ask for advice on how best to measure it.

what happened to the performance tracking project? that would ease
finding performance regressions...