From owner-freebsd-stable@FreeBSD.ORG Tue Mar 13 21:46:00 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AEA3E16A400 for ; Tue, 13 Mar 2007 21:46:00 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 90DCB13C48A for ; Tue, 13 Mar 2007 21:46:00 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 64C801A4D88; Tue, 13 Mar 2007 14:46:00 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id A22ED5132C; Tue, 13 Mar 2007 17:45:59 -0400 (EDT) Date: Tue, 13 Mar 2007 17:45:59 -0400 From: Kris Kennaway To: Martin Message-ID: <20070313214559.GB13079@xor.obsecurity.org> References: <20070313154729.1ec6abb7@DELOREAN.manuelmartini.it> <20070313194206.GA5957@crodrigues.org> <20070313195756.GA11679@xor.obsecurity.org> <20070313211908.59de6504@DELOREAN.manuelmartini.it> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="98e8jtXdkpgskNou" Content-Disposition: inline In-Reply-To: <20070313211908.59de6504@DELOREAN.manuelmartini.it> User-Agent: Mutt/1.4.2.2i Cc: freebsd-stable@freebsd.org Subject: Re: FreeBSD mysql Benchmark on 4BSD/ULE scheduler and i386/amd64 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 13 Mar 2007 21:46:00 -0000 --98e8jtXdkpgskNou Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Mar 13, 2007 at 09:19:08PM +0100, Martin wrote: > > Also some more discussion would be useful, e.g. you appear to be > > testing on different machines so the most important thing to > > understand is how, or whether, the hardware differs. You do link to > > the dmesgs, but it's hard to process this into a summary form whereas > > you presumably know the details. > >=20 > I use the same hw (3 dell 1435 server) >=20 >=20 > > I am also unfamiliar with the benchmark itself, can you give me a > > pointer to the software? =20 >=20 > I used sql-bench=20 > /usr/ports/databases/mysql50-server/work/mysql-5.0.33/sql-bench/ > (at this time) > the default Makefile of port have "--without-bench" options so u need > to make manually Hmm. This seems to be a single-user test, so while it's presumably testing some relevant basic ingredients of database performance it's probably not a realistic measure of server performance. i.e. if you really only have a maximum of one client accessing your database then your 4-core system is being more than 75% wasted :) > > If it is doing disk I/O then you may be > > mostly measuring the speed of your disks, which is why the previous > > paragraph is so important to understand. >=20 > the disk was the same of 3 test OK, cool. The difference between i386 and amd64 is actually kind of surprising. I would have expected amd64 to be slower. One thing that is missing is an estimate of standard deviation of the data points: some benchmarks have very high variance, meaning the numbers vary a lot between runs; this makes direct comparison more difficult without statistical work. In FreeBSD the /usr/src/tools/tools/ministat utility is excellent for this purpose. Kris --98e8jtXdkpgskNou Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFF9xuXWry0BWjoQKURAl6GAKCpWu4YNUVtIVr9FGSXKEjBFqNe2wCgsNi6 Oid/iV2wdMAjOWskOrZfpaA= =0ggK -----END PGP SIGNATURE----- --98e8jtXdkpgskNou--