From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 18:09:05 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3414616A420; Sat, 14 Jan 2006 18:09:05 +0000 (GMT) (envelope-from dmiller@sparks.net) Received: from search.sparks.net (search.sparks.net [207.5.180.136]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7F49D43D49; Sat, 14 Jan 2006 18:09:04 +0000 (GMT) (envelope-from dmiller@sparks.net) Received: from [10.0.0.10] (dsl-66-243-211-31.pivot.net [66.243.211.31]) by search.sparks.net (Postfix) with ESMTP id 11E12A90A; Sat, 14 Jan 2006 13:09:03 -0500 (EST) Message-ID: <43C93E3E.30009@sparks.net> Date: Sat, 14 Jan 2006 13:09:02 -0500 From: David Miller User-Agent: Mozilla/5.0 (Macintosh; U; PPC Mac OS X Mach-O; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Arne Woerner References: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> In-Reply-To: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Sun, 15 Jan 2006 06:11:52 +0000 Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 18:09:05 -0000 Arne Woerner wrote: >--- Slawek Zak wrote: > > >>On 1/13/06, Arne Woerner wrote: >>40MB/s. CPU load negligible. I don't have >>an exact number, as this machine has other >>processes running. But overall, the system >>load didn't exceed 5%. >> >> >> >Looks good... > > > >>I saturated fast ethernet on the host >>with this test. Filer is connected with >>Gb and can spew around 70MB/s easily. >>CPU load on the host didn't exceed 4%. >> >> >> >Looks even better... :-) > > > >>>3. test the NIC performance with >>> >>> >>Filer doesn't respond to large icmp packets. >> >> >> >Ok... This isn't so important, since NFS speed is higher than >local disc speed. > > > >>>My theory would be, that your NICs need a >>>lot of CPU time, while your local discs >>>dont need so much CPU time. :-) >>> >>> >>I don't think so. Drivers account for system >>time. It doesn't exceed 20% of overall load. >>The postgres processes are very busy doing >>almost nothing. Semops is most of the work >>they seem to do. >> >> >> >Hmm... > >But why does switching from local disc to NFS makes the PostgreSQL >performance so bad? > > It certainly sounds like something is no longer caching things - either reads or writes or both - when using NFS. Does FreeBSD 6.x have a version of lockd that works with the netApp? --- David From owner-freebsd-performance@FreeBSD.ORG Sun Jan 15 14:49:10 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3D2A716A423 for ; Sun, 15 Jan 2006 14:49:10 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9470043D62 for ; Sun, 15 Jan 2006 14:49:06 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so401549uge for ; Sun, 15 Jan 2006 06:49:03 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=tBarEmVzpoHbebR+KwUUj7tMnu7RonOGtu5NrEf/tZWCpCnWGrb0WnAzra1Kuvy2G+tVeEEtquO0ysHT47lHmP5IUZLeHp1kNh6pY7JqaPbPwNn6Ewq9ygcxBAwdpNjhWFPuEuyt3e2Y2o/TwDOmAFE/ssqCb928gOUxqCeLbQ4= Received: by 10.49.9.14 with SMTP id m14mr169278nfi; Sun, 15 Jan 2006 06:49:03 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sun, 15 Jan 2006 06:49:02 -0800 (PST) Message-ID: <787bbe1c0601150649y5c14e31dl2a47c88a66073707@mail.gmail.com> Date: Sun, 15 Jan 2006 15:49:02 +0100 From: Slawek Zak To: Andreas Feid In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 14:49:10 -0000 T24gMS8xNC8wNiwgQW5kcmVhcyBGZWlkIDxhc2ltZXhAZ214LmRlPiB3cm90ZToKPiBBcmUgeW91 IHN1cmUgdGhlIGZpbGVyIGlzIGZpbmU/Cj4gSSB3b3VsZCBndWVzcyBzbyBmcm9tIHlvdXIgZGVz Y3JpcHRpb24sIG1pZ2h0IGJlIHdvcnRoIGdldHRpbmcgdGhlIGxhdGVzdAo+IHZlcnNpb24gb2Yg cGVyZnN0YXQgZnJvbSBOT1cgYW5kIHJ1biBpdC4KCkknbSBzdXJlLiBJdCBkb2Vzbid0IGRvIGFu eXRoaW5nIHNwZWNpYWwuIFRoZSB0aHJvdWdocHV0IGl0IHNlZXMgZnJvbQp0aGUgZGJzZXJ2ZXIg aXMgaW4gdGhlIG1lYXN1cmVtZW50IGVycm9yIHJhbmdlLiBXaGF0IG1pZ2h0IGJlIHdyb25nPwoK PiBBbHRlcm5hdGl2ZSBpZGVhLCBpZiBjYW4gYWZmb3JkIHRvIHRlc3QgaXQsIHdvdWxkIGJlIHRv IHRyeSB0aGUgSVNDU0kKPiBkcml2ZXIgZnJvbSBEYW5ueSBCcmFubmlzIGFuZCBwdXQgdGhlIGRh dGEgb24gYSBsdW4gb24gdGhlIGZpbGVyLiBUaGF0Cj4gc2hvdWxkIGdpdmUgeW91IGFib3V0IHRo ZSBzYW1lIHBlcmZvcm1hbmNlIGFzIGEgbG9jYWwgZGlzay4KCkl0IGlzIHNvbWUgaWRlYS4gSSB3 aWxsIHRyeSB0byBydW4gdGhlIGRhdGFiYXNlIG9uIFNvbGFyaXMgMTAgZm9yIGEKdGVzdCBmaXJz dCB0aG91Z2guCgovUwotLQpTs2F3ZWsgr2FrIC8gVU5JWCBTeXN0ZW1zIEFkbWluaXN0cmF0b3IK From owner-freebsd-performance@FreeBSD.ORG Sun Jan 15 14:50:51 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BBBC616A41F for ; Sun, 15 Jan 2006 14:50:51 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.200]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7076643D4C for ; Sun, 15 Jan 2006 14:50:50 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so401878uge for ; Sun, 15 Jan 2006 06:50:49 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dlzJcs/KP3gzMsjaM5hO/YkhAKyBSXCgZVlTPJuRfS7IujHMXnIE1KbXABd4HTENTdNVsFKJAxU18J7e1aeK+k+ca+GYsvedvdS10qi5WxzscsWeyrKDf4hyjjd4K4/xO3opMrop998dLe6/iYSlXeC2S4HyZ53ulQbs+wjnIPg= Received: by 10.49.17.20 with SMTP id u20mr168212nfi; Sun, 15 Jan 2006 06:50:49 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sun, 15 Jan 2006 06:50:49 -0800 (PST) Message-ID: <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> Date: Sun, 15 Jan 2006 15:50:49 +0100 From: Slawek Zak To: Arne Woerner , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <43C9110B.8070807@fer.hr> <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 14:50:51 -0000 T24gMS8xNC8wNiwgQXJuZSBXb2VybmVyIDxhcm5lX3dvZXJuZXJAeWFob28uY29tPiB3cm90ZToK PiAtLS0gSXZhbiBWb3JhcyA8aXZvcmFzQGZlci5ocj4gd3JvdGU6Cj4gPiBBcm5lIFdvZXJuZXIg d3JvdGU6Cj4gPiA+IEJ1dCB3aHkgZG9lcyBzd2l0Y2hpbmcgZnJvbSBsb2NhbCBkaXNjCj4gPiA+ IHRvIE5GUyBtYWtlcyB0aGUgUG9zdGdyZVNRTCBwZXJmb3JtYW5jZQo+ID4gPiBzbyBiYWQ/Cj4g Pgo+ID4gQSB3aWxkIGd1ZXNzL3RyeTogZG9lcyBmaWxlIGxvY2tpbmcgd29yawo+ID4gcHJvcGVy bHkgd2l0aCBORlMgYW5kIHRoZSBmaWxlcj8KPiA+Cj4gSSB3b3VsZCByZWNvbW1lbmQgdGhlIGZv bGxvd2luZyB0ZXN0IGluIG9yZGVyIHRvIGFuc3dlciB0aGF0Cj4gcXVlc3Rpb246Cj4KPiBFeGVj dXRpbmcgdGhlIHNoZWxsIHNjcmlwdCBpbiBhcHBlbmRpeCBBIG9mIHRoaXMgZW1haWwgd2lsbCB0 ZXN0LAo+IGlmIGxvY2tpbmcgd29ya3MsIGFuZCBob3cgZmFzdCBpdCBpczoKPiAlIHRpbWUgLi9s Y2stdHN0LnNoIDwvcGF0aC90by9sb2NhbC1mcy9maWxlPgo+ICUgdGltZSAuL2xjay10c3Quc2gg PC9wYXRoL3RvL05GUy9maWxlPgo+Cj4gLUFybmUKW3NuaXBdCgpJIGtlZXAgdGhlIGxvY2tzIGxv Y2FsIHdpdGggbW91bnRfbmZzIC1MLCBzbyBpdCdzIG5vdCBhIHByb2JsZW0uIEkKZG9uJ3Qga25v dyBpZiBwb3N0Z3Jlc3FsIHVzZXMgZmlsZSBsb2NraW5nIGFueXdheS4KCi9TCi0tClOzYXdlayCv YWsgLyBVTklYIFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-performance@FreeBSD.ORG Tue Jan 17 09:57:12 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7442416A41F for ; Tue, 17 Jan 2006 09:57:12 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id C245B43D45 for ; Tue, 17 Jan 2006 09:57:11 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id j3so357729ugf for ; Tue, 17 Jan 2006 01:57:10 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=CAXgYPOr2nJaYKXiOsLSD2eKcFcDNrRO3tOeX/IGZqG1F+PzBUfUfEN/rQebCxO19R+/AumBiE5FenDBJMS6Hgy6gZqVimz9Erc3MUm2S9zWXS2VTLzuiKL92Ll8Xo9dNVi05gBwPXGoGdfPByhCPgbdTeOPKS00HQAvelxNAYw= Received: by 10.49.37.9 with SMTP id p9mr300487nfj; Tue, 17 Jan 2006 01:57:10 -0800 (PST) Received: by 10.49.60.13 with HTTP; Tue, 17 Jan 2006 01:57:09 -0800 (PST) Message-ID: <787bbe1c0601170157x7779063m16aa8a91de15361e@mail.gmail.com> Date: Tue, 17 Jan 2006 10:57:09 +0100 From: Slawek Zak To: freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <43C9110B.8070807@fer.hr> <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 09:57:12 -0000 SGksCgpJIHdlbnQgYmFjayBvbmUgc3RlcCBhbmQgbW92ZWQgdGhlIGRiIGJhY2sgdG8gdGhlIGRp c2tzLiBJdCBzZWVtcyB0aGF0CmFuIHVucmVsYXRlZCB1cGRhdGUgdG8gdGhlIGRhdGFiYXNlIGF0 IGFyb3VuZCB0aGUgc2FtZSB0aW1lIEkgbWlncmF0ZWQKdG8gZmlsZXIsIG1hZGUgaXQgc2xvdyBk b3duIHRvIGEgY3Jhd2wuIEFmdGVyIHNvbWUgdHdlYWtpbmcgYnkgdGhlCmRldmVsb3BlcnMgYW5k IG1vdmluZyBiYWNrIHRvIGZpbGVyLCBwZXJmb3JtYW5jZSBpcyBmaW5lIGFnYWluLgoKTGVzc29u IGxlYXJuZWQ6IEFsd2F5cyBvbmUgc3RlcCBhdCBhIHRpbWUuCgpTb3JyeSBmb3IgdGhlIGhhdm9j LgoKL1MKLS0KU7Nhd2VrIK9hayAvIFVOSVggU3lzdGVtcyBBZG1pbmlzdHJhdG9yCg== From owner-freebsd-performance@FreeBSD.ORG Tue Jan 17 10:32:48 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9A02E16A41F for ; Tue, 17 Jan 2006 10:32:48 +0000 (GMT) (envelope-from trashy_bumper@yahoo.com) Received: from web36307.mail.mud.yahoo.com (web36307.mail.mud.yahoo.com [209.191.84.237]) by mx1.FreeBSD.org (Postfix) with SMTP id BB94543D46 for ; Tue, 17 Jan 2006 10:32:47 +0000 (GMT) (envelope-from trashy_bumper@yahoo.com) Received: (qmail 86693 invoked by uid 60001); 17 Jan 2006 10:32:47 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=xgfo2v49QUl9uthNhk+Hd7DR/2rn1IdxmM+R+CreKfPgctxFLItpd0HR5DabsAePxyDJE4J9/ci9upYtxVHo05h6eFpZJADQHHvP7sub0tvjhnKJl5zvPcQgpF23J8i55X1aeIz+CKVmRnemuvPMGDz8gs+OLmiJq3haXSlvXHY= ; Message-ID: <20060117103247.86691.qmail@web36307.mail.mud.yahoo.com> Received: from [213.227.200.244] by web36307.mail.mud.yahoo.com via HTTP; Tue, 17 Jan 2006 02:32:47 PST Date: Tue, 17 Jan 2006 02:32:47 -0800 (PST) From: Nash Nipples To: freebsd-performance@freebsd.org In-Reply-To: <787bbe1c0601170157x7779063m16aa8a91de15361e@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 10:32:48 -0000 Or sit on ur fingers before u send CR Slawek Zak wrote: Hi, I went back one step and moved the db back to the disks. It seems that an unrelated update to the database at around the same time I migrated to filer, made it slow down to a crawl. After some tweaking by the developers and moving back to filer, performance is fine again. Lesson learned: Always one step at a time. Sorry for the havoc. /S -- Sławek Żak / UNIX Systems Administrator _______________________________________________ freebsd-performance@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-performance To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" --------------------------------- Yahoo! Photos – Showcase holiday pictures in hardcover Photo Books. You design it and we’ll bind it! From owner-freebsd-performance@FreeBSD.ORG Thu Jan 19 00:59:00 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 51BA216A420; Thu, 19 Jan 2006 00:59:00 +0000 (GMT) (envelope-from decibel@decibel.org) Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id E5A7143D45; Thu, 19 Jan 2006 00:58:59 +0000 (GMT) (envelope-from decibel@decibel.org) Received: by noel.decibel.org (Postfix, from userid 1001) id 3EDBC3983D; Wed, 18 Jan 2006 18:58:47 -0600 (CST) Date: Wed, 18 Jan 2006 18:58:47 -0600 From: "Jim C. Nasby" To: Arne Woerner Message-ID: <20060119005847.GK17896@decibel.org> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> X-Operating-System: FreeBSD 6.0-RELEASE amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 00:59:00 -0000 On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > Did you do those "dd" tests with small block sizes (like 1byte: > bs=1), like somebody on one of those lists suggests, too? Then we > could see, if there is a high latency that ruins everything... FYI, PostgreSQL does 8kB I/O by default. This can only be changed by modifying a header file. -- Jim C. Nasby, Database Architect decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?" From owner-freebsd-performance@FreeBSD.ORG Thu Jan 19 01:11:17 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DE60C16A41F; Thu, 19 Jan 2006 01:11:17 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6BEB743D46; Thu, 19 Jan 2006 01:11:17 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id k0J1BFfC020668; Wed, 18 Jan 2006 17:11:15 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id k0J1BF6L020666; Wed, 18 Jan 2006 17:11:15 -0800 Date: Wed, 18 Jan 2006 17:11:15 -0800 From: Brooks Davis To: "Jim C. Nasby" Message-ID: <20060119011115.GA18415@odin.ac.hmc.edu> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="sm4nu43k4a2Rpi4c" Content-Disposition: inline In-Reply-To: <20060119005847.GK17896@decibel.org> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org, Arne Woerner Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 01:11:18 -0000 --sm4nu43k4a2Rpi4c Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 18, 2006 at 06:58:47PM -0600, Jim C. Nasby wrote: > On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > > Did you do those "dd" tests with small block sizes (like 1byte: > > bs=3D1), like somebody on one of those lists suggests, too? Then we > > could see, if there is a high latency that ruins everything... >=20 > FYI, PostgreSQL does 8kB I/O by default. This can only be changed by > modifying a header file. That's definitely small in my book (certainly compared to the 1MB block size the first responder suggested), knowing that, you should definitely do dd tests with 8k blocks since that's the best performance you are likely to get. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --sm4nu43k4a2Rpi4c Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFDzuczXY6L6fI4GtQRAoNCAJ0dJcbZZyxaFn3+JPvgQjYNon3+DQCfXquj il7c4HKlug5OMn5bna5E0rE= =6iId -----END PGP SIGNATURE----- --sm4nu43k4a2Rpi4c-- From owner-freebsd-performance@FreeBSD.ORG Thu Jan 19 01:15:51 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DCDB116A420; Thu, 19 Jan 2006 01:15:51 +0000 (GMT) (envelope-from decibel@decibel.org) Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 31A4F43D46; Thu, 19 Jan 2006 01:15:51 +0000 (GMT) (envelope-from decibel@decibel.org) Received: by noel.decibel.org (Postfix, from userid 1001) id 8DB1C39834; Wed, 18 Jan 2006 19:15:50 -0600 (CST) Date: Wed, 18 Jan 2006 19:15:50 -0600 From: "Jim C. Nasby" To: Brooks Davis Message-ID: <20060119011550.GN17896@decibel.org> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> <20060119011115.GA18415@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060119011115.GA18415@odin.ac.hmc.edu> X-Operating-System: FreeBSD 6.0-RELEASE amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org, Arne Woerner Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 01:15:52 -0000 On Wed, Jan 18, 2006 at 05:11:15PM -0800, Brooks Davis wrote: > On Wed, Jan 18, 2006 at 06:58:47PM -0600, Jim C. Nasby wrote: > > On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > > > Did you do those "dd" tests with small block sizes (like 1byte: > > > bs=1), like somebody on one of those lists suggests, too? Then we > > > could see, if there is a high latency that ruins everything... > > > > FYI, PostgreSQL does 8kB I/O by default. This can only be changed by > > modifying a header file. > > That's definitely small in my book (certainly compared to the 1MB block > size the first responder suggested), knowing that, you should > definitely do dd tests with 8k blocks since that's the best performance you > are likely to get. Agreed, it is small from a OS/filesystem viewpoint, but it's also nowhere near 1 byte which is the test that had been suggested. :) -- Jim C. Nasby, Database Architect decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?" From owner-freebsd-performance@FreeBSD.ORG Thu Jan 19 18:05:37 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 12FF716A41F; Thu, 19 Jan 2006 18:05:37 +0000 (GMT) (envelope-from sean@gigave.com) Received: from mailhost.gigave.com (mailhost.gigave.com [38.113.228.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B83743D49; Thu, 19 Jan 2006 18:05:33 +0000 (GMT) (envelope-from sean@gigave.com) Date: Thu, 19 Jan 2006 10:05:32 -0800 From: Sean Chittenden To: Brooks Davis Message-ID: <20060119180532.GD9040@mailhost.gigave.com> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> <20060119011115.GA18415@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qVHblb/y9DPlgkHs" Content-Disposition: inline In-Reply-To: <20060119011115.GA18415@odin.ac.hmc.edu> Message-Id: <20060119180533.4B8FC21701B@mailhost.gigave.com> Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org, Arne Woerner , "Jim C. Nasby" Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 18:05:37 -0000 --qVHblb/y9DPlgkHs Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > > > Did you do those "dd" tests with small block sizes (like 1byte: > > > bs=3D1), like somebody on one of those lists suggests, too? Then > > > we could see, if there is a high latency that ruins > > > everything... > >=20 > > FYI, PostgreSQL does 8kB I/O by default. This can only be changed > > by modifying a header file. >=20 > That's definitely small in my book (certainly compared to the 1MB > block size the first responder suggested), knowing that, you should > definitely do dd tests with 8k blocks since that's the best > performance you are likely to get. PostgreSQL can be configured to use more than 32K blocks, but I recall 65K having problems and shouldn't be used in production. Tom Lane was less than amused when he found out I'd added those options to the ports and issued some strong words suggesting against using anything but 8K blocks simply because that was the only config that'd seen years of production use. YMMV. -sc --=20 Sean Chittenden --qVHblb/y9DPlgkHs Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- iD8DBQFDz9Tsapga0yeGcOQRAnwjAJ9Q6DVDVGIMKpvauh5RwfdaoIMWtwCgxPJ3 /YO8k5TFeePgp7rPIawg16Q= =eFD6 -----END PGP SIGNATURE----- --qVHblb/y9DPlgkHs-- From owner-freebsd-performance@FreeBSD.ORG Fri Jan 20 15:42:38 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0D48F16A41F for ; Fri, 20 Jan 2006 15:42:38 +0000 (GMT) (envelope-from alanbaka@writeme.com) Received: from iasvr8-smtp.cyberchn.com.hk (iasvr8.cyberchn.com.hk [203.132.207.223]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7C63043D46 for ; Fri, 20 Jan 2006 15:42:37 +0000 (GMT) (envelope-from alanbaka@writeme.com) Received: from [192.168.0.211] ([219.131.228.71]) (authenticated bits=0) by iasvr8-smtp.cyberchn.com.hk (8.12.8/8.12.8) with ESMTP id k0KFgZlB018987 for ; Fri, 20 Jan 2006 23:42:35 +0800 Message-ID: <43D104EA.8040400@writeme.com> Date: Fri, 20 Jan 2006 23:42:34 +0800 From: AlanBAKA User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20051206 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Speed up ports compiling under SMP (muti cpu) ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jan 2006 15:42:38 -0000 Hi all I know how to use make -j x to compiling src but I have try to use for compiling ports but doesn't work. any way I can use all my cpu to compiling ports? thanks From owner-freebsd-performance@FreeBSD.ORG Fri Jan 20 17:05:30 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7DCE016A41F for ; Fri, 20 Jan 2006 17:05:30 +0000 (GMT) (envelope-from cswiger@mac.com) Received: from pi.codefab.com (pi.codefab.com [199.103.21.227]) by mx1.FreeBSD.org (Postfix) with ESMTP id 21F6143D45 for ; Fri, 20 Jan 2006 17:05:29 +0000 (GMT) (envelope-from cswiger@mac.com) Received: from localhost (localhost [127.0.0.1]) by pi.codefab.com (Postfix) with ESMTP id 5C9815EEF; Fri, 20 Jan 2006 12:05:29 -0500 (EST) Received: from pi.codefab.com ([127.0.0.1]) by localhost (pi.codefab.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 48354-07; Fri, 20 Jan 2006 12:05:28 -0500 (EST) Received: from [199.103.21.238] (pan.codefab.com [199.103.21.238]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) by pi.codefab.com (Postfix) with ESMTP id A3CBC5D67; Fri, 20 Jan 2006 12:05:28 -0500 (EST) In-Reply-To: <43D104EA.8040400@writeme.com> References: <43D104EA.8040400@writeme.com> Mime-Version: 1.0 (Apple Message framework v746.2) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <6F9BE890-80EE-4EB1-9033-4D269C61A0AD@mac.com> Content-Transfer-Encoding: 7bit From: Charles Swiger Date: Fri, 20 Jan 2006 12:05:27 -0500 To: AlanBAKA X-Mailer: Apple Mail (2.746.2) X-Virus-Scanned: amavisd-new at codefab.com Cc: freebsd-performance@freebsd.org Subject: Re: Speed up ports compiling under SMP (muti cpu) ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jan 2006 17:05:30 -0000 On Jan 20, 2006, at 10:42 AM, AlanBAKA wrote: > I know how to use make -j x to compiling src > but I have try to use for compiling ports but doesn't work. > any way I can use all my cpu to compiling ports? There are 13,000 ports which would require testing and fixing of their Makefiles to be safely parallizeable. While you can help by fixing the ports you actually use, I would not rely on parallel builds to always work... -- -Chuck