Date: Sun, 7 May 2006 15:59:41 -0400 From: Kris Kennaway <kris@obsecurity.org> To: Robert Watson <rwatson@FreeBSD.org> Cc: Sven Petai <hadara@bsd.ee>, csjp@FreeBSD.org, performance@freebsd.org, current@freebsd.org, Kris Kennaway <kris@obsecurity.org> Subject: Re: Fine-grained locking for POSIX local sockets (UNIX domain sockets) Message-ID: <20060507195941.GA2978@xor.obsecurity.org> In-Reply-To: <20060507205627.B46997@fledge.watson.org> References: <20060506150622.C17611@fledge.watson.org> <200605071949.54978.hadara@bsd.ee> <20060507190844.K46997@fledge.watson.org> <200605072200.42529.hadara@bsd.ee> <20060507191641.GA1851@xor.obsecurity.org> <20060507205627.B46997@fledge.watson.org>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] On Sun, May 07, 2006 at 08:57:21PM +0100, Robert Watson wrote: > > >On Sun, May 07, 2006 at 10:00:41PM +0300, Sven Petai wrote: > > > >>The results in my mail were mean values over 2 runs, > >>only once did I see really huge (more than 10%) differences between > >>several > >>subsequent runs with same settings, this case was clearly mentioned in > >>the results. > > > >FYI, 2 is not really enough, you should do at least 10 repetitions of each > >test to reduce variance (which can be a lot, despite what you saw!) and so > >that differences between them can be accurately estimated. Ministat is > >really helpful for this. > > Typically, I do 12 runs of supersmack in each configuration, and discard > the first 2 runs in which the cache and scheduler (etc) are still settling, > as I'm interested in the steady state. Yeah, forgot to mention that too. Also keeping in mind that mysql performance is not time-constant, e.g. you should restart it in between test configurations instead of comparing early and late times. Kris [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (FreeBSD) iD8DBQFEXlGtWry0BWjoQKURAh/BAKCPgPuGgxUzTeBWbstBc85S8zAEQQCgpDtT qP+XbWrbbL5xauyq3dOie18= =gMww -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20060507195941.GA2978>