Date: Tue, 17 Apr 2007 19:17:21 -0400 From: Kevin Way <kevin@insidesystems.net> To: Kris Kennaway <kris@obsecurity.org> Cc: freebsd-performance@freebsd.org, Robert Watson <rwatson@FreeBSD.org> Subject: Re: Anyone interested in improving postgresql scaling? Message-ID: <46255581.8000902@insidesystems.net> In-Reply-To: <20070417192120.GA5191@xor.obsecurity.org> References: <461B0CD0.8090404@insidesystems.net> <20070417174825.X42234@fledge.watson.org> <4625174B.5090208@insidesystems.net> <20070417192120.GA5191@xor.obsecurity.org>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Kris Kennaway wrote: > On Tue, Apr 17, 2007 at 02:51:55PM -0400, Kevin Way wrote: > > >> I built 7.0 as of 6 days ago, and ran the same test using 8-cores, ULE >> and 4BSD. The results are available at: >> >> http://blog.insidesystems.net/articles/2007/04/11/postgresql-scaling-on-6-2-and-7-0 >> >> Unfortunately, I can't run the additional tests, as the machines in >> question have now been deployed to production. I should have similar >> equipment available in a few weeks, and will try the other tests at that >> point. >> > > That's better but still not comparable to my results. One important > change you may have missed was to enable MALLOC_PRODUCTION in > /usr/src/lib/libc/stdlib/malloc.c. This disables malloc debugging > which may have significant overhead. > > My results from about a month ago: > > http://people.freebsd.org/~kris/scaling/nickel.png > > The big dip between 5-7 clients is believed to be due to a ULE bug > that has known cause but is not yet fixed (on dual core CPUs processes > are bouncing around between the two cores too much). The main point > is that apart from this anomaly in the middle there is approximately > linear scaling from 1 to 8 CPUs. On your system it is not scaling > linearly beyond 4. > > I do have some other changes in my kernel but I don't think any of > them are enough to explain this difference. > > Anyway, get back to us when you can retest with the above change. > > Confirmed, I did miss MALLOC_PRODUCTION. I incorrectly believed that I just needed an empty malloc.conf. This is somewhat exciting news from my vantage point. I'll post a corrected re-test as soon as I have another available 8-core machine. [-- Attachment #2 --] 0 *H 01 0 + 0 *H 0b0ˠ ? tz.30 *H 0_1 0 UUS10U VeriSign, Inc.1705U .Class 1 Public Primary Certification Authority0 980512000000Z 080512235959Z010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated00 *H 0 ZDUz-Ox6 JoTw*h1ApzKHV-BD\B/;' ]6B3nTOJ ƚj$e~7jJ 00U 0 0GU @0>0< `HE0-0++ www.verisign.com/repository/RPA01U *0(0&$" http://crl.verisign.com/pca1.crl0 U 0 `HB0 *H }oEK8Sd!L+ @ 9j2!,Yb}U87sfcbSpRR[-Ϭ1Tԋ#+2}, |.wDe Mtst.;5r@1ӲīV00^ RVX#0 *H 010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated0 070308000000Z 070507235959Z010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. by Ref.,LIAB.LTD(c)981 0 U Persona Not Validated1&0$U Digital ID Class 1 - Netscape10U Kevin Way1&0$ *H kevin@insidesystems.net0"0 *H 0 0'۵6Wr<0yPw;!d5 b"z% g?C@t5ㄻ##lRu8011!WC9Ǿl p PGZBLۨNMw_#O4 N=@y: 3pL瓝%B!p dmeshd~CB Z~+jp)d{K8(}IYxy2ȧKr}?2zgCkxbɡ( j;KY 00 U 0 0DU =0;09 `HE0*0(+ https://www.verisign.com/rpa0 U 0 U %0++03U ,0*0(&$"http://crl.verisign.com/class1.crl0 *H $uMspZhkl-t!6ޠ=2#D佻 ⎖sWl \,s]t'E(;v L: QKKo"Ka3bcrR00^ RVX#0 *H 010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated0 070308000000Z 070507235959Z010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. by Ref.,LIAB.LTD(c)981 0 U Persona Not Validated1&0$U Digital ID Class 1 - Netscape10U Kevin Way1&0$ *H kevin@insidesystems.net0"0 *H 0 0'۵6Wr<0yPw;!d5 b"z% g?C@t5ㄻ##lRu8011!WC9Ǿl p PGZBLۨNMw_#O4 N=@y: 3pL瓝%B!p dmeshd~CB Z~+jp)d{K8(}IYxy2ȧKr}?2zgCkxbɡ( j;KY 00 U 0 0DU =0;09 `HE0*0(+ https://www.verisign.com/rpa0 U 0 U %0++03U ,0*0(&$"http://crl.verisign.com/class1.crl0 *H $uMspZhkl-t!6ޠ=2#D佻 ⎖sWl \,s]t'E(;v L: QKKo"Ka3bcrR100010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated^ RVX#0 + 0 *H 1 *H 0 *H 1 070417231721Z0# *H 1o]p| H90R *H 1E0C0 *H 0*H 0 *H @0+0 *H (0 +710010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated^ RVX#0 *H 1䠁010U VeriSign, Inc.1 0 U VeriSign Trust Network1F0DU =www.verisign.com/repository/RPA Incorp. By Ref.,LIAB.LTD(c)981H0FU?VeriSign Class 1 CA Individual Subscriber-Persona Not Validated^ RVX#0 *H (G%IecCx#<uJr@Z^qod>r8D[%* b=Xţgo9:u /@zQX (аLՕNgZ,LtImL:D$Fb_8bJGgۧ,o }";Wx) V].FlyuHWb =Fyen=}ȴcHo"<.$
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?46255581.8000902>