From owner-freebsd-current@FreeBSD.ORG Wed Aug 13 00:25:43 2003 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 055E437B401 for ; Wed, 13 Aug 2003 00:25:43 -0700 (PDT) Received: from critter.freebsd.dk (critter.freebsd.dk [212.242.86.163]) by mx1.FreeBSD.org (Postfix) with ESMTP id C2D9643F3F for ; Wed, 13 Aug 2003 00:25:41 -0700 (PDT) (envelope-from phk@phk.freebsd.dk) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.12.9/8.12.9) with ESMTP id h7D7PYhZ001984 for ; Wed, 13 Aug 2003 09:25:38 +0200 (CEST) (envelope-from phk@phk.freebsd.dk) From: "Poul-Henning Kamp" Date: Wed, 13 Aug 2003 09:25:34 +0200 Message-ID: <1983.1060759534@critter.freebsd.dk> cc: current@freebsd.org Subject: How to do statistics on benchmarks (101) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Aug 2003 07:25:43 -0000 In message <200308130721.h7D7LsAk003557@repoman.freebsd.org>, Poul-Henning Kamp writes: >phk 2003/08/13 00:21:54 PDT > > FreeBSD src repository > > Added files: > tools/tools/ministat Makefile README chameleon iguana > ministat.c I just added this small tool to give people a simple way to check the validity of a benchmark, please use it. critter# cat chameleon 150 400 720 500 930 critter# cat iguana 50 200 150 400 750 400 150 critter# ./ministat iguana chameleon x iguana + chameleon +--------------------------------------------------------------------------+ |x * x * + + x +| | |__________M___|____A_______________M__|A_______________________| | +--------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 7 50 750 200 300 238.04761 + 5 150 930 500 540 299.08193 No difference proven at 95.0% confidence -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence.