From owner-freebsd-performance@FreeBSD.ORG Sun Jan 8 06:57:36 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4A40B16A41F for ; Sun, 8 Jan 2006 06:57:36 +0000 (GMT) (envelope-from chrcoluk@gmail.com) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id ACD0E43D45 for ; Sun, 8 Jan 2006 06:57:35 +0000 (GMT) (envelope-from chrcoluk@gmail.com) Received: by wproxy.gmail.com with SMTP id i20so3373970wra for ; Sat, 07 Jan 2006 22:57:34 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:references; b=WM/TWZ/AkvQDGy6O8bdmXjp1bJFzepMVWh+1kIg8DS4g7Uw0XVuRm52bP6safjdcCdC2eVm0QE41YI652My9zw8IRw05b9P3D+JoLwqK6aP4U01NPX9SI5/62I6AZx+MIWJxm4xRWkb4Lak3Xd4ADcgfokXiwFcqs7w7YISnlI4= Received: by 10.54.72.15 with SMTP id u15mr6970100wra; Sat, 07 Jan 2006 22:57:34 -0800 (PST) Received: by 10.54.122.17 with HTTP; Sat, 7 Jan 2006 22:57:34 -0800 (PST) Message-ID: <3aaaa3a0601072257o4d5ec1b3m@mail.gmail.com> Date: Sun, 8 Jan 2006 06:57:34 +0000 From: Chris To: Alexander Leidinger In-Reply-To: <20060104125121.701cc504@Magellan.Leidinger.net> MIME-Version: 1.0 References: <43B7BBEE.5020701@roq.com> <3aaaa3a0601011728j31f1cd5as@mail.gmail.com> <20060104125121.701cc504@Magellan.Leidinger.net> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Michael Vince , freebsd-performance@freebsd.org, huang leo Subject: Re: Benchmark MySQL Performance On FreeBSD And Linux X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 08 Jan 2006 06:57:36 -0000 On 04/01/06, Alexander Leidinger wrote: > On Mon, 2 Jan 2006 01:28:07 +0000 > Chris wrote: > > > have had mysql lockups until I tinkered with the threading settings. > Libthr > > is the good old threading routine from the 4.x days if I am correct, so > if > > libpthread is indeed unstable under continous heavy load how has it > become > > unoticed by the developer's or has it just been tested in desktop > > environments? > > libc_r is the threading library used in 4.x. > libpthread and libthr are SMP aware threading libraries with a > different internal structure (M:N vs. 1:1). > > Bye, > Alexander. > > -- > 0 and 1. Now what could be so hard about that? > http://www.Leidinger.net Alexander @ Leidinger.net > GPG fingerprint =3D C518 BC70 E67F 143F BE91 3365 79E2 9C60 B006 3FE7 > WL http://www.amazon.de/exec/obidos/registry/1FZ4DTHQE9PQ8/ref=3Dwl_em_to= / > ah thanks for correcting me, so libthr and libpthread are both new then in 5.x? Chris From owner-freebsd-performance@FreeBSD.ORG Sun Jan 8 13:26:39 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 022A016A41F for ; Sun, 8 Jan 2006 13:26:39 +0000 (GMT) (envelope-from Alexander@Leidinger.net) Received: from www.ebusiness-leidinger.de (jojo.ms-net.de [84.16.236.246]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2D90843D46 for ; Sun, 8 Jan 2006 13:26:37 +0000 (GMT) (envelope-from Alexander@Leidinger.net) Received: from Andro-Beta.Leidinger.net (p54A5E979.dip.t-dialin.net [84.165.233.121]) (authenticated bits=0) by www.ebusiness-leidinger.de (8.13.1/8.13.1) with ESMTP id k08DLoEZ035546; Sun, 8 Jan 2006 14:21:51 +0100 (CET) (envelope-from Alexander@Leidinger.net) Received: from Magellan.Leidinger.net (Magellan.Leidinger.net [192.168.1.1]) by Andro-Beta.Leidinger.net (8.13.3/8.13.3) with ESMTP id k08DQXsh014537; Sun, 8 Jan 2006 14:26:33 +0100 (CET) (envelope-from Alexander@Leidinger.net) Date: Sun, 8 Jan 2006 14:26:33 +0100 From: Alexander Leidinger To: Chris Message-ID: <20060108142633.73abffa3@Magellan.Leidinger.net> In-Reply-To: <3aaaa3a0601072257o4d5ec1b3m@mail.gmail.com> References: <43B7BBEE.5020701@roq.com> <3aaaa3a0601011728j31f1cd5as@mail.gmail.com> <20060104125121.701cc504@Magellan.Leidinger.net> <3aaaa3a0601072257o4d5ec1b3m@mail.gmail.com> X-Mailer: Sylpheed-Claws 1.9.100 (GTK+ 2.8.9; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new Cc: Michael Vince , Alexander Leidinger , freebsd-performance@freebsd.org, huang leo Subject: Re: Benchmark MySQL Performance On FreeBSD And Linux X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 08 Jan 2006 13:26:39 -0000 On Sun, 8 Jan 2006 06:57:34 +0000 Chris wrote: > ah thanks for correcting me, so libthr and libpthread are both new then in > 5.x? Yes. Bye, Alexander. -- The best things in life are free, but the expensive ones are still worth a look. http://www.Leidinger.net Alexander @ Leidinger.net GPG fingerprint = C518 BC70 E67F 143F BE91 3365 79E2 9C60 B006 3FE7 WL http://www.amazon.de/exec/obidos/registry/1FZ4DTHQE9PQ8/ref=wl_em_to/ From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 00:06:31 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 06C4816A41F for ; Fri, 13 Jan 2006 00:06:31 +0000 (GMT) (envelope-from grog@lemis.com) Received: from ext-gw.lemis.com (ext-gw.lemis.com [150.101.14.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6B83243D58 for ; Fri, 13 Jan 2006 00:06:28 +0000 (GMT) (envelope-from grog@lemis.com) Received: from wantadilla.lemis.com (wantadilla.lemis.com [192.109.197.135]) by ext-gw.lemis.com (Postfix) with ESMTP id 381A7131D7C; Fri, 13 Jan 2006 10:36:27 +1030 (CST) Received: by wantadilla.lemis.com (Postfix, from userid 1004) id 1208C85C2A; Fri, 13 Jan 2006 10:36:27 +1030 (CST) Date: Fri, 13 Jan 2006 10:36:27 +1030 From: Greg 'groggy' Lehey To: Eric Hodel Message-ID: <20060113000627.GY73071@wantadilla.lemis.com> References: <20051216040722.GA503@wantadilla.lemis.com> <3C3376C1-0FED-4DA1-BB93-86A9198EAC3A@segment7.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="vYzPTKoKRdF40tnF" Content-Disposition: inline In-Reply-To: <3C3376C1-0FED-4DA1-BB93-86A9198EAC3A@segment7.net> User-Agent: Mutt/1.4.2.1i Organization: The FreeBSD Project Phone: +61-8-8388-8286 Fax: +61-8-8388-8725 Mobile: +61-418-838-708 VoIP: sip:0871270137@sip.internode.on.net WWW-Home-Page: http://www.FreeBSD.org/ X-PGP-Fingerprint: 9A1B 8202 BCCE B846 F92F 09AC 22E6 F290 507A 4223 Cc: freebsd-performance@freebsd.org Subject: Re: MySQL Deadlocks (Was: Re: Benchmark MySQL Performance On FreeBSD And Linux) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 00:06:31 -0000 --vYzPTKoKRdF40tnF Content-Type: text/plain; charset=us-ascii Content-Disposition: inline On Thursday, 15 December 2005 at 22:18:58 -0800, Eric Hodel wrote: > On Dec 15, 2005, at 8:07 PM, Greg 'groggy' Lehey wrote: > >> On Friday, 16 December 2005 at 11:20:12 +0800, huang leo wrote: >>> >>> We had evaluated MySQL performance on FreeBSD and Linux. The >>> result is attached. >> >> This is some of the most plausible information I've seen in a while. >> I'm forwarding it to a MySQL internal list, and I expect we'll discuss >> it in much detail. >> >> A few comments: >> >> - I'd be very interested in the deadlocks you've been experiencing. >> If you have any additional information, please let me know. > > Some time back I experienced deadlocks with FreeBSD 5.4 and either > libthr or libpthread. linuxthreads had no issue. Other machines > with different hardware did not have the problem. Interesting. > It looks like I'll be able to perform some testing on that machine > sometime early in the new year. What is the correct forum for > discussing this when I get the opportunity to look into it again? I think this forum would be fine. Greg -- See complete headers for address and phone numbers. --vYzPTKoKRdF40tnF Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.1 (FreeBSD) iD8DBQFDxu8DIubykFB6QiMRArjLAJ9EsRA9zcmriU4pQoeelHwqNA/KmwCaA1ik Yw0MOff2tSWGSv3vEjFFN3E= =Ahtr -----END PGP SIGNATURE----- --vYzPTKoKRdF40tnF-- From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 20:45:31 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7A4FE16A41F for ; Fri, 13 Jan 2006 20:45:31 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.202]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6B5DE43D5C for ; Fri, 13 Jan 2006 20:45:21 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so10589uge for ; Fri, 13 Jan 2006 12:45:19 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=HWSbDES9MlMX0UvALxPFvD5UWHwF7rvD/3JYrhsD/mNemrxM/7YYevo9Y1t/B5kmxUOSvlQglNUswWSeo3AOdG6SxWMKKLnIEFGZ1kRuwJccvGHvyMnQmM62fIc6FsicmDFsBewuGTsdNV8zCBl9D4tWfSvww1xaezhxSMwsE84= Received: by 10.48.12.9 with SMTP id 9mr90226nfl; Fri, 13 Jan 2006 12:20:13 -0800 (PST) Received: by 10.49.60.13 with HTTP; Fri, 13 Jan 2006 12:20:13 -0800 (PST) Message-ID: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Date: Fri, 13 Jan 2006 21:20:13 +0100 From: Slawek Zak To: freebsd-database@freebsd.org, freebsd-performance@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline Cc: Subject: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 20:45:31 -0000 SGVsbG8gZXZlcnlvbmUsCgpBIGNvdXBsZSBvZiBkYXlzIGFnbyBJJ3ZlIG1vdmVkIG91ciBwcm9k dWN0aW9uIGRhdGFiYXNlIGZyb20gbG9jYWwKZGlza3MgdG8gTmV0QVBQIGZpbGVyIHNlcnZpbmcg TkZTLiBQZXJmb3JtYW5jZSBmb3IgdGhpcyBzZXJ2ZXIgZHJvcHBlZApieSBmYWN0b3Igb2YgMTAg aWYgbm90IG1vcmUuIEZyb20gYSBoYXBweSAxMCUgbG9hZCwgdGhlIHNlcnZlciBoaXQgdGhlCmNl aWxpbmcgYW5kIHNlZXMgbG9hZCBvZiAxMDAlIGFsbCB0aGUgdGltZSB3aXRoIHJ1bnF1ZXVlIGFi b3ZlIDMwLiBUaGUKc2VydmVyIGlzIGEgU3VuIFY0MHogbWFjaGluZSwgNHggT3B0ZXJvbiA4NTIs IDE2R0IgUkFNLCB0dW5lZCBmb3IgMTYwMApjb25jdXJyZW50IGNvbm5lY3Rpb25zLiBJJ20gcnVu bmluZyBGcmVlQlNEIDYuMCBCRVRBNS4gSSBkb24ndCBzZWUgYW55CnByb2JsZW0gd2l0aCB0aGUg bmV0d29yayBiYW5kd2lkdGggb3IgSS9PIG9wY291bnQuIFRvdGFsIGJhbmR3aWR0aApnZW5lcmF0 ZWQgYnkgdGhlIG1hY2hpbmUgdG9wcyBhdCAxME1icHMuIE5JQ3MgYXJlIGJnZSBjb25maWd1cmVk IGZvcgoxMDBNYnBzIGZ1bGwtZHVwbGV4LiBGaWxlciBoYXJkbHkgbm90aWNlcyB0aGUgdHJhZmZp Yy4gSXQgc3RheXMgYXJvdW5kCjElIENQVSBsb2FkIGFuZCA1MDAgTkZTIG9wcy9zIGluY2x1ZGlu ZyBzdGF0aWMgZmlsZSB0cmFuc2ZlcnMuIFRoaXMKcGFydGljdWxhciBtb2RlbCBjYW4gaGFuZGxl IGFyb3VuZCA2MDAwIEkvT3MgcGVyIHNlY29uZC4gVHJ1c3NpbmcKZGF0YWJhc2UgcHJvY2Vzc2Vz IHNob3dzIHRoYXQgbW9zdCBvZiB0aGUgc3lzY2FsbHMgYXJlIHNlbW9wcy4gSSB0cmllZAp0byBz ZWFyY2ggdGhlIGFyY2hpdmVzIGJ1dCBjb3VsZG4ndCBmaW5kIGFueXRoaW5nIHVzZWZ1bCBmb3Ig c3VjaApzZXR1cC4KCkkgY2FuIHByb3ZpZGUgcG9zdGdyZXNxbCBjb25maWcuIFN5c2N0bCBrbm9i cyByZW1haW4gdW50b3VjaGVkIG5vdApjb3VudGluZyBiYXNpYyBORlMgdHdlYWtpbmcuIEZvciBt b3VudF9uZnMgSSB0cmllZCB0byBjaGFuZ2UgTkZTCmJ1ZmZlciBzaXplcyAtciAtdy4gSSBhbHNv IHRyaWVkIHRoZSAtTCBvcHRpb24gdG8ga2VlcCB0aGUgbG9jawp0cmFmZmljIGxvY2FsLiBPbiB0 aGUgcG9zdGdyZXMgc2lkZSwgc2V0dGluZyBmc3luYyA9IG9mZiBpbgpwb3N0Z3Jlc3FsLmNvbmYu IEl0IGRpZG4ndCBjaGFuZ2UgYSB0aGluZy4KCkFueSBhZHZpY2UgYmVzaWRlcyAiZ2l2ZSB1cCBv biBORlMiIGlzIG1vc3Qgd2VsY29tZS4gSSBuZWVkIE5ldEFQUApvdmVyIE5GUyBmb3Igc25hcHNo b3RzIGFuZCBlYXN5IEZTIG1hbmFnZW1lbnQuCgpUSUEsIC9TCi0tClOzYXdlayCvYWsgLyBVTklY IFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 21:10:50 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5BA9D16A41F for ; Fri, 13 Jan 2006 21:10:50 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: from web30313.mail.mud.yahoo.com (web30313.mail.mud.yahoo.com [68.142.201.231]) by mx1.FreeBSD.org (Postfix) with SMTP id 5CD3F43D46 for ; Fri, 13 Jan 2006 21:10:49 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 31787 invoked by uid 60001); 13 Jan 2006 21:10:48 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=iEszZWXAynBg8QhAwKJkQLr828pfnzM2QRLsad658xg8jAdi4NvrSZhO9lL9ywDrAzWbuKjdVL9BaESRHnxTB4PyqKOCTZqrDY0F83J2F/woh4kxsQFnZZRqn/Hh+Xc5um4eqEeD9bsLvqiCWZu5kVLzi8NwMtsfksN8TcbtTyA= ; Message-ID: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Received: from [213.54.85.246] by web30313.mail.mud.yahoo.com via HTTP; Fri, 13 Jan 2006 13:10:48 PST Date: Fri, 13 Jan 2006 13:10:48 -0800 (PST) From: Arne Woerner To: Slawek Zak , freebsd-database@freebsd.org, freebsd-performance@freebsd.org In-Reply-To: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:10:50 -0000 Hiho! --- Slawek Zak wrote: > A couple of days ago I've moved our > production database from local disks > to NetAPP filer serving NFS. Performance > for this server dropped by factor of 10 > if not more. > I would like to suggest some tests (I do not have a clear idea, why your system becomes slower; a hypothesis will follow below): 1. benchmark the local disc (watch cpu usage via e. g. vmstat 1) % dd if=/dev/zero of=/some/local/filesystem/a bs=1m count=1000 2. benchmark the NFS filesystem (watch cpu usage via e. g. vmstat 1) % dd if=/dev/zero of=/some/NFS/filesystem/a bs=1m count=1000 3. test the NIC performance with (again watching the CPU usage might help) % ping -s 50000 I get 17Mbit/sec which is the actual rate... neo# ping -s 50000 vaako PING vaako.riddick.homeunix.org (10.1.1.3): 50000 data bytes 50008 bytes from 10.1.1.3: icmp_seq=0 ttl=64 time=46.584 ms My theory would be, that your NICs need a lot of CPU time, while your local discs dont need so much CPU time. :-) Bye Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 21:28:29 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9451816A41F; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2954E43D45; Fri, 13 Jan 2006 21:28:29 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id k0DLSS6i015955; Fri, 13 Jan 2006 13:28:28 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id k0DLSSKA015954; Fri, 13 Jan 2006 13:28:28 -0800 Date: Fri, 13 Jan 2006 13:28:28 -0800 From: Brooks Davis To: Arne Woerner Message-ID: <20060113212828.GB1819@odin.ac.hmc.edu> References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mYCpIKhGyMATD0i+" Content-Disposition: inline In-Reply-To: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu Cc: freebsd-database@freebsd.org, Slawek Zak , freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 21:28:29 -0000 --mYCpIKhGyMATD0i+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jan 13, 2006 at 01:10:48PM -0800, Arne Woerner wrote: > Hiho! >=20 > --- Slawek Zak wrote: > > A couple of days ago I've moved our > > production database from local disks > > to NetAPP filer serving NFS. Performance > > for this server dropped by factor of 10 > > if not more. > > > I would like to suggest some tests (I do not have a clear idea, > why your system becomes slower; a hypothesis will follow below): >=20 > 1. benchmark the local disc (watch cpu usage via e. g. vmstat 1) > % dd if=3D/dev/zero of=3D/some/local/filesystem/a bs=3D1m count=3D1000 >=20 > 2. benchmark the NFS filesystem (watch cpu usage via e. g. vmstat > 1) > % dd if=3D/dev/zero of=3D/some/NFS/filesystem/a bs=3D1m count=3D1000 I'd suggest also testing with small blocks as well. I suspect that a large portion of many database accesses quite small and thus transaction overhead, not streaming performance is likely to be the issue. If streaming performance is an issue, increasing your network's MTU should help somewhat. > 3. test the NIC performance with (again watching the CPU usage > might help) > % ping -s 50000 > I get 17Mbit/sec which is the actual rate... > neo# ping -s 50000 vaako > PING vaako.riddick.homeunix.org (10.1.1.3): 50000 data bytes > 50008 bytes from 10.1.1.3: icmp_seq=3D0 ttl=3D64 time=3D46.584 ms I don't think this tells you much if anything. You need to know what your protocol overhead is, not how many ICMP packets you can spew. > My theory would be, that your NICs need a lot of CPU time, while > your local discs dont need so much CPU time. :-) That's certainly part of it, but I doubt it's the whole story. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --mYCpIKhGyMATD0i+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFDyBt2XY6L6fI4GtQRAgrwAJsF1m5v/11V7w4LAFLXikEOgchpUQCfWoTe uzFjzaJ2sYtFyoQOcq4Hkg0= =xJXN -----END PGP SIGNATURE----- --mYCpIKhGyMATD0i+-- From owner-freebsd-performance@FreeBSD.ORG Fri Jan 13 22:15:34 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E2C2116A41F for ; Fri, 13 Jan 2006 22:15:34 +0000 (GMT) (envelope-from kometen@gmail.com) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.199]) by mx1.FreeBSD.org (Postfix) with ESMTP id 10DE443D46 for ; Fri, 13 Jan 2006 22:15:33 +0000 (GMT) (envelope-from kometen@gmail.com) Received: by wproxy.gmail.com with SMTP id 71so740098wra for ; Fri, 13 Jan 2006 14:15:33 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=icCdC6jyAW7R2ZlIioUOyB3YWtfw7KhN51PT0e8vuQgWX7z03hAwWouKimxhlYlcSeoHPy/Hbge8RIWzmnEUFNelc6ez4NNLph0jAODBXHz62/Rl81LpE5iOxwR3p+ovicrGjuiM/lgFVxweoBEoazZavtXH4Kt3YL0bFXwAXAE= Received: by 10.65.218.4 with SMTP id v4mr2120984qbq; Fri, 13 Jan 2006 14:15:33 -0800 (PST) Received: by 10.65.192.14 with HTTP; Fri, 13 Jan 2006 14:15:33 -0800 (PST) Message-ID: Date: Fri, 13 Jan 2006 23:15:33 +0100 From: Claus Guttesen To: Slawek Zak In-Reply-To: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 13 Jan 2006 22:15:35 -0000 > A couple of days ago I've moved our production database from local > disks to NetAPP filer serving NFS. Performance for this server dropped > by factor of 10 if not more. From a happy 10% load, the server hit the > ceiling and sees load of 100% all the time with runqueue above 30. The > > I can provide postgresql config. Sysctl knobs remain untouched not > counting basic NFS tweaking. For mount_nfs I tried to change NFS > buffer sizes -r -w. I also tried the -L option to keep the lock > traffic local. On the postgres side, setting fsync =3D off in > postgresql.conf. It didn't change a thing. Did you try tcp? regards Claus From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 12:52:09 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A0BAD16A420 for ; Sat, 14 Jan 2006 12:52:09 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id AA28E43D45 for ; Sat, 14 Jan 2006 12:52:08 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so165604uge for ; Sat, 14 Jan 2006 04:52:07 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fmkQl39sBJWjBuhItWdvt3ZRdTm01O65PWY4omDxgkALmz4Ci7PuYZumeUSKh9QgJoIoc831/rTUaY2YsF/UQXMoek7nKtNmbd2Em0T1pUKQRJ8eCeQjPwX7QgOVJdcH4CNPJeTu8x62hQue3oAij4ftK/XO83NHIxegJWGB8bo= Received: by 10.49.9.14 with SMTP id m14mr124841nfi; Sat, 14 Jan 2006 04:52:07 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sat, 14 Jan 2006 04:52:07 -0800 (PST) Message-ID: <787bbe1c0601140452p43291399xe79e99fd1e956e4a@mail.gmail.com> Date: Sat, 14 Jan 2006 13:52:07 +0100 From: Slawek Zak To: Claus Guttesen In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 12:52:09 -0000 T24gMS8xMy8wNiwgQ2xhdXMgR3V0dGVzZW4gPGtvbWV0ZW5AZ21haWwuY29tPiB3cm90ZToKPiA+ IEEgY291cGxlIG9mIGRheXMgYWdvIEkndmUgbW92ZWQgb3VyIHByb2R1Y3Rpb24gZGF0YWJhc2Ug ZnJvbSBsb2NhbAo+ID4gZGlza3MgdG8gTmV0QVBQIGZpbGVyIHNlcnZpbmcgTkZTLiBQZXJmb3Jt YW5jZSBmb3IgdGhpcyBzZXJ2ZXIgZHJvcHBlZAo+ID4gYnkgZmFjdG9yIG9mIDEwIGlmIG5vdCBt b3JlLiBGcm9tIGEgaGFwcHkgMTAlIGxvYWQsIHRoZSBzZXJ2ZXIgaGl0IHRoZQo+ID4gY2VpbGlu ZyBhbmQgc2VlcyBsb2FkIG9mIDEwMCUgYWxsIHRoZSB0aW1lIHdpdGggcnVucXVldWUgYWJvdmUg MzAuIFRoZQo+ID4KPiA+IEkgY2FuIHByb3ZpZGUgcG9zdGdyZXNxbCBjb25maWcuIFN5c2N0bCBr bm9icyByZW1haW4gdW50b3VjaGVkIG5vdAo+ID4gY291bnRpbmcgYmFzaWMgTkZTIHR3ZWFraW5n LiBGb3IgbW91bnRfbmZzIEkgdHJpZWQgdG8gY2hhbmdlIE5GUwo+ID4gYnVmZmVyIHNpemVzIC1y IC13LiBJIGFsc28gdHJpZWQgdGhlIC1MIG9wdGlvbiB0byBrZWVwIHRoZSBsb2NrCj4gPiB0cmFm ZmljIGxvY2FsLiBPbiB0aGUgcG9zdGdyZXMgc2lkZSwgc2V0dGluZyBmc3luYyA9IG9mZiBpbgo+ ID4gcG9zdGdyZXNxbC5jb25mLiBJdCBkaWRuJ3QgY2hhbmdlIGEgdGhpbmcuCj4KPiBEaWQgeW91 IHRyeSB0Y3A/CgpZZXAuIFNhbWUgdGhpbmcuCgovUwotLQpTs2F3ZWsgr2FrIC8gVU5JWCBTeXN0 ZW1zIEFkbWluaXN0cmF0b3IK From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 12:57:32 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 108C716A420 for ; Sat, 14 Jan 2006 12:57:32 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.197]) by mx1.FreeBSD.org (Postfix) with ESMTP id F41CD43D46 for ; Sat, 14 Jan 2006 12:57:30 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so166647uge for ; Sat, 14 Jan 2006 04:57:29 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dfcVRr2ht/FHc228SKjbJeVn0x/2lmR7k0t0iCweDOSvVgIx55oykOzn5SDK5dYbp6Oz6CClFmkktygB+w/eaVUPsnEYN6BXguED+b/w2Ua2X8AEGMNDi4ujTd9FiKR3O6O2kXo9K5xG+/JDrtDVLnr/AszbX48VFSbWJ8XpOzI= Received: by 10.48.43.4 with SMTP id q4mr125043nfq; Sat, 14 Jan 2006 04:57:29 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sat, 14 Jan 2006 04:57:29 -0800 (PST) Message-ID: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> Date: Sat, 14 Jan 2006 13:57:29 +0100 From: Slawek Zak To: Arne Woerner , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> <20060113211048.31785.qmail@web30313.mail.mud.yahoo.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 12:57:32 -0000 T24gMS8xMy8wNiwgQXJuZSBXb2VybmVyIDxhcm5lX3dvZXJuZXJAeWFob28uY29tPiB3cm90ZToK PiBIaWhvIQo+Cj4gLS0tIFNsYXdlayBaYWsgPHNsYXdlay56YWtAZ21haWwuY29tPiB3cm90ZToK PiA+IEEgY291cGxlIG9mIGRheXMgYWdvIEkndmUgbW92ZWQgb3VyCj4gPiBwcm9kdWN0aW9uIGRh dGFiYXNlIGZyb20gbG9jYWwgZGlza3MKPiA+IHRvIE5ldEFQUCBmaWxlciBzZXJ2aW5nIE5GUy4g UGVyZm9ybWFuY2UKPiA+IGZvciB0aGlzIHNlcnZlciBkcm9wcGVkIGJ5IGZhY3RvciBvZiAxMAo+ ID4gaWYgbm90IG1vcmUuCj4gPgo+IEkgd291bGQgbGlrZSB0byBzdWdnZXN0IHNvbWUgdGVzdHMg KEkgZG8gbm90IGhhdmUgYSBjbGVhciBpZGVhLAo+IHdoeSB5b3VyIHN5c3RlbSBiZWNvbWVzIHNs b3dlcjsgYSBoeXBvdGhlc2lzIHdpbGwgZm9sbG93IGJlbG93KToKPgo+IDEuIGJlbmNobWFyayB0 aGUgbG9jYWwgZGlzYyAod2F0Y2ggY3B1IHVzYWdlIHZpYSBlLiBnLiB2bXN0YXQgMSkKPiAlIGRk IGlmPS9kZXYvemVybyBvZj0vc29tZS9sb2NhbC9maWxlc3lzdGVtL2EgYnM9MW0gY291bnQ9MTAw MAoKNDBNQi9zLiBDUFUgbG9hZCBuZWdsaWdpYmxlLiBJIGRvbid0IGhhdmUgYW4gZXhhY3QgbnVt YmVyLCBhcyB0aGlzCm1hY2hpbmUgaGFzIG90aGVyIHByb2Nlc3NlcyBydW5uaW5nLiBCdXQgb3Zl cmFsbCwgdGhlIHN5c3RlbSBsb2FkCmRpZG4ndCBleGNlZWQgNSUuCgo+IDIuIGJlbmNobWFyayB0 aGUgTkZTIGZpbGVzeXN0ZW0gKHdhdGNoIGNwdSB1c2FnZSB2aWEgZS4gZy4gdm1zdGF0Cj4gMSkK PiAlIGRkIGlmPS9kZXYvemVybyBvZj0vc29tZS9ORlMvZmlsZXN5c3RlbS9hIGJzPTFtIGNvdW50 PTEwMDAKCkkgc2F0dXJhdGVkIGZhc3QgZXRoZXJuZXQgb24gdGhlIGhvc3Qgd2l0aCB0aGlzIHRl c3QuIEZpbGVyIGlzCmNvbm5lY3RlZCB3aXRoIEdiIGFuZCBjYW4gc3BldyBhcm91bmQgNzBNQi9z IGVhc2lseS4gQ1BVIGxvYWQgb24gdGhlCmhvc3QgZGlkbid0IGV4Y2VlZCA0JS4KCj4gMy4gdGVz dCB0aGUgTklDIHBlcmZvcm1hbmNlIHdpdGggKGFnYWluIHdhdGNoaW5nIHRoZSBDUFUgdXNhZ2UK PiBtaWdodCBoZWxwKQo+ICUgcGluZyAtcyA1MDAwMCA8bmZzLXNlcnZlcj4KPiBJIGdldCAxN01i aXQvc2VjIHdoaWNoIGlzIHRoZSBhY3R1YWwgcmF0ZS4uLgo+IG5lbyMgcGluZyAtcyA1MDAwMCB2 YWFrbwo+IFBJTkcgdmFha28ucmlkZGljay5ob21ldW5peC5vcmcgKDEwLjEuMS4zKTogNTAwMDAg ZGF0YSBieXRlcwo+IDUwMDA4IGJ5dGVzIGZyb20gMTAuMS4xLjM6IGljbXBfc2VxPTAgdHRsPTY0 IHRpbWU9NDYuNTg0IG1zCgpGaWxlciBkb2Vzbid0IHJlc3BvbmQgdG8gbGFyZ2UgaWNtcCBwYWNr ZXRzLiAyMDAwMCB3YXMgdGhlIGJpZ2dlc3QKdGhhdCB3b3JrZWQuIENQVSBsb2FkIG5lZ2xpZ2li bGUuCgo+IE15IHRoZW9yeSB3b3VsZCBiZSwgdGhhdCB5b3VyIE5JQ3MgbmVlZCBhIGxvdCBvZiBD UFUgdGltZSwgd2hpbGUKPiB5b3VyIGxvY2FsIGRpc2NzIGRvbnQgbmVlZCBzbyBtdWNoIENQVSB0 aW1lLiA6LSkKCkkgZG9uJ3QgdGhpbmsgc28uIERyaXZlcnMgYWNjb3V0IGZvciBzeXN0ZW0gdGlt ZS4gSXQgZG9lc24ndCBleGNlZWQKMjAlIG9mIG92ZXJhbGwgbG9hZC4gVGhlIHBvc3RncmVzIHBy b2Nlc3NlcyBhcmUgdmVyeSBidXN5IGRvaW5nIGFsbW9zdApub3RoaW5nLiBTZW1vcHMgaXMgbW9z dCBvZiB0aGUgd29yayB0aGV5IHNlZW0gdG8gZG8uCgpUaGFua3MsIC9TCi0tClOzYXdlayCvYWsg LyBVTklYIFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 14:42:03 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 887D316A41F for ; Sat, 14 Jan 2006 14:42:03 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: from web30315.mail.mud.yahoo.com (web30315.mail.mud.yahoo.com [68.142.201.233]) by mx1.FreeBSD.org (Postfix) with SMTP id CE02243D48 for ; Sat, 14 Jan 2006 14:42:02 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 6201 invoked by uid 60001); 14 Jan 2006 14:42:02 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=Sk4zUBB5SVYo5NWxEIU788OQQyI+d+jCtnRxF6//QNNQpRWQ5ugzsm/MCPvnR00bJ+zVbBV72yVYctZYTYUG39NmVwjPF06H9rzPhkHlEpKDqiWkw2S3ZX0PMOoRPuObx4T4gFf17zVF60DcJrDrxrFQu+iWK2EodJ8p+st+G4A= ; Message-ID: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Received: from [213.54.74.99] by web30315.mail.mud.yahoo.com via HTTP; Sat, 14 Jan 2006 06:42:02 PST Date: Sat, 14 Jan 2006 06:42:02 -0800 (PST) From: Arne Woerner To: Slawek Zak , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 14:42:03 -0000 --- Slawek Zak wrote: > On 1/13/06, Arne Woerner wrote: > 40MB/s. CPU load negligible. I don't have > an exact number, as this machine has other > processes running. But overall, the system > load didn't exceed 5%. > Looks good... > I saturated fast ethernet on the host > with this test. Filer is connected with > Gb and can spew around 70MB/s easily. > CPU load on the host didn't exceed 4%. > Looks even better... :-) > > 3. test the NIC performance with > Filer doesn't respond to large icmp packets. > Ok... This isn't so important, since NFS speed is higher than local disc speed. > > My theory would be, that your NICs need a > > lot of CPU time, while your local discs > > dont need so much CPU time. :-) > > I don't think so. Drivers account for system > time. It doesn't exceed 20% of overall load. > The postgres processes are very busy doing > almost nothing. Semops is most of the work > they seem to do. > Hmm... But why does switching from local disc to NFS makes the PostgreSQL performance so bad? The semops of postgres are most likely the same, since postgres would not check if it runs on NFS or local filesystems, would it? Were there any other changes? Did you do those "dd" tests with small block sizes (like 1byte: bs=1), like somebody on one of those lists suggests, too? Then we could see, if there is a high latency that ruins everything... -Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 14:58:40 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DCF3A16A41F for ; Sat, 14 Jan 2006 14:58:40 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from pinus.cc.fer.hr (pinus.cc.fer.hr [161.53.73.18]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0E56543D48 for ; Sat, 14 Jan 2006 14:58:38 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from [161.53.72.113] (lara.cc.fer.hr [161.53.72.113]) by pinus.cc.fer.hr (8.12.2/8.12.2) with ESMTP id k0EEwUFx008381; Sat, 14 Jan 2006 15:58:30 +0100 (MET) Message-ID: <43C9110B.8070807@fer.hr> Date: Sat, 14 Jan 2006 15:56:11 +0100 From: Ivan Voras User-Agent: Mozilla Thunderbird 1.0.6 (X11/20050921) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Arne Woerner , freebsd-performance@freebsd.org References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> In-Reply-To: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 14:58:41 -0000 Arne Woerner wrote: > But why does switching from local disc to NFS makes the PostgreSQL > performance so bad? A wild guess/try: does file locking work properly with NFS and the filer? From owner-freebsd-performance@FreeBSD.ORG Sat Jan 14 16:14:03 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6BFDA16A41F for ; Sat, 14 Jan 2006 16:14:03 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: from web30305.mail.mud.yahoo.com (web30305.mail.mud.yahoo.com [68.142.200.98]) by mx1.FreeBSD.org (Postfix) with SMTP id E09F543D45 for ; Sat, 14 Jan 2006 16:14:02 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 43005 invoked by uid 60001); 14 Jan 2006 16:14:02 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=dlFuxB+9l5Y4k6XfhXzp3tyPLmT6IxQ8vhU41gMLFSwoyYFj/JpMzh+zUmnJ7rsNXWiDNx/bSwmVXlB3qA4tDQ3rznxQn8iBgBXO8bp5rjQ27WcrvWQAT84HhDYK+jecuFpvW9rf0TW7f1EQmzJW5jfraIZyI/vIZ5/vScIakKA= ; Message-ID: <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> Received: from [213.54.74.99] by web30305.mail.mud.yahoo.com via HTTP; Sat, 14 Jan 2006 08:14:02 PST Date: Sat, 14 Jan 2006 08:14:02 -0800 (PST) From: Arne Woerner To: Ivan Voras , freebsd-performance@freebsd.org, slawek.zak@gmail.com In-Reply-To: <43C9110B.8070807@fer.hr> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jan 2006 16:14:03 -0000 --- Ivan Voras wrote: > Arne Woerner wrote: > > But why does switching from local disc > > to NFS makes the PostgreSQL performance > > so bad? > > A wild guess/try: does file locking work > properly with NFS and the filer? > I would recommend the following test in order to answer that question: Executing the shell script in appendix A of this email will test, if locking works, and how fast it is: % time ./lck-tst.sh % time ./lck-tst.sh -Arne appendix A: the script lck-tst.sh #!/bin/sh lockf -k $1 sleep 10 & sleep 3 lockf -k -s -t 0 $1 echo BAD || echo GOOD wait sts=`date +%s` i=0 while [ $i -lt 2000 ]; do i=`expr $i + 1` lockf -k $1 sleep 0 & done expr `date +%s` - $sts __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com