From owner-freebsd-performance@FreeBSD.ORG Tue Apr 17 19:21:21 2007 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9171816A555; Tue, 17 Apr 2007 19:21:21 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 7CB9913C459; Tue, 17 Apr 2007 19:21:21 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 1CC3F1A4D83; Tue, 17 Apr 2007 12:21:36 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id BFA7C51428; Tue, 17 Apr 2007 15:21:20 -0400 (EDT) Date: Tue, 17 Apr 2007 15:21:20 -0400 From: Kris Kennaway To: Kevin Way Message-ID: <20070417192120.GA5191@xor.obsecurity.org> References: <461B0CD0.8090404@insidesystems.net> <20070417174825.X42234@fledge.watson.org> <4625174B.5090208@insidesystems.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="G4iJoqBmSsgzjUCe" Content-Disposition: inline In-Reply-To: <4625174B.5090208@insidesystems.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-performance@freebsd.org, Robert Watson Subject: Re: Anyone interested in improving postgresql scaling? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Apr 2007 19:21:21 -0000 --G4iJoqBmSsgzjUCe Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Apr 17, 2007 at 02:51:55PM -0400, Kevin Way wrote: > I built 7.0 as of 6 days ago, and ran the same test using 8-cores, ULE=20 > and 4BSD. The results are available at: >=20 > http://blog.insidesystems.net/articles/2007/04/11/postgresql-scaling-on-6= -2-and-7-0 >=20 > Unfortunately, I can't run the additional tests, as the machines in=20 > question have now been deployed to production. I should have similar=20 > equipment available in a few weeks, and will try the other tests at that= =20 > point. That's better but still not comparable to my results. One important change you may have missed was to enable MALLOC_PRODUCTION in /usr/src/lib/libc/stdlib/malloc.c. This disables malloc debugging which may have significant overhead. My results from about a month ago: http://people.freebsd.org/~kris/scaling/nickel.png The big dip between 5-7 clients is believed to be due to a ULE bug that has known cause but is not yet fixed (on dual core CPUs processes are bouncing around between the two cores too much). The main point is that apart from this anomaly in the middle there is approximately linear scaling from 1 to 8 CPUs. On your system it is not scaling linearly beyond 4. I do have some other changes in my kernel but I don't think any of them are enough to explain this difference. Anyway, get back to us when you can retest with the above change. Kris --G4iJoqBmSsgzjUCe Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD4DBQFGJR4wWry0BWjoQKURAq7JAJiPX4ogSZlSl+hTCqAUCLW5zt5TAJ9m28/C ZXwUu7WIgVoXmNrPt8iilA== =c4Xu -----END PGP SIGNATURE----- --G4iJoqBmSsgzjUCe--