From owner-freebsd-current@FreeBSD.ORG Sun May 7 19:59:44 2006 Return-Path: X-Original-To: current@freebsd.org Delivered-To: freebsd-current@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A4B3716A418; Sun, 7 May 2006 19:59:44 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 88D8A43D66; Sun, 7 May 2006 19:59:42 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 63A9D1A3C1A; Sun, 7 May 2006 12:59:42 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id BA46251DA6; Sun, 7 May 2006 15:59:41 -0400 (EDT) Date: Sun, 7 May 2006 15:59:41 -0400 From: Kris Kennaway To: Robert Watson Message-ID: <20060507195941.GA2978@xor.obsecurity.org> References: <20060506150622.C17611@fledge.watson.org> <200605071949.54978.hadara@bsd.ee> <20060507190844.K46997@fledge.watson.org> <200605072200.42529.hadara@bsd.ee> <20060507191641.GA1851@xor.obsecurity.org> <20060507205627.B46997@fledge.watson.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zYM0uCDKw75PZbzx" Content-Disposition: inline In-Reply-To: <20060507205627.B46997@fledge.watson.org> User-Agent: Mutt/1.4.2.1i Cc: csjp@FreeBSD.org, performance@freebsd.org, current@freebsd.org, Kris Kennaway Subject: Re: Fine-grained locking for POSIX local sockets (UNIX domain sockets) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 07 May 2006 19:59:44 -0000 --zYM0uCDKw75PZbzx Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, May 07, 2006 at 08:57:21PM +0100, Robert Watson wrote: >=20 > >On Sun, May 07, 2006 at 10:00:41PM +0300, Sven Petai wrote: > > > >>The results in my mail were mean values over 2 runs, > >>only once did I see really huge (more than 10%) differences between=20 > >>several > >>subsequent runs with same settings, this case was clearly mentioned in= =20 > >>the results. > > > >FYI, 2 is not really enough, you should do at least 10 repetitions of ea= ch=20 > >test to reduce variance (which can be a lot, despite what you saw!) and = so=20 > >that differences between them can be accurately estimated. Ministat is= =20 > >really helpful for this. >=20 > Typically, I do 12 runs of supersmack in each configuration, and discard= =20 > the first 2 runs in which the cache and scheduler (etc) are still settlin= g,=20 > as I'm interested in the steady state. Yeah, forgot to mention that too. Also keeping in mind that mysql performance is not time-constant, e.g. you should restart it in between test configurations instead of comparing early and late times. Kris --zYM0uCDKw75PZbzx Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (FreeBSD) iD8DBQFEXlGtWry0BWjoQKURAh/BAKCPgPuGgxUzTeBWbstBc85S8zAEQQCgpDtT qP+XbWrbbL5xauyq3dOie18= =gMww -----END PGP SIGNATURE----- --zYM0uCDKw75PZbzx--