From owner-freebsd-database@FreeBSD.ORG Sun Jan 15 00:08:31 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 91D7216A41F for ; Sun, 15 Jan 2006 00:08:31 +0000 (GMT) (envelope-from justin.bastedo@gmail.com) Received: from xproxy.gmail.com (xproxy.gmail.com [66.249.82.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id E3A6743D45 for ; Sun, 15 Jan 2006 00:08:30 +0000 (GMT) (envelope-from justin.bastedo@gmail.com) Received: by xproxy.gmail.com with SMTP id t12so691283wxc for ; Sat, 14 Jan 2006 16:08:30 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=fV5ldYXCuVqoJOLbgDYU2woPKgY8qRbgb7AXBG8nTFcrRyEFjQ9pjY17Ovx7m2Y8PqNsB1SDm5dvugccE9ePqZOSKlNzHrGxz6jCBP9/JIFwYdbbYUAydi8zLODGUUzKJ2W6np9R0usBzcALKC1mvPY3lMP2tLGsctrHSmtg8XU= Received: by 10.70.86.8 with SMTP id j8mr5881281wxb; Sat, 14 Jan 2006 16:08:29 -0800 (PST) Received: by 10.70.9.11 with HTTP; Sat, 14 Jan 2006 16:08:29 -0800 (PST) Message-ID: <8a5255240601141608t78ed7ffdheacad67307abe8d@mail.gmail.com> Date: Sat, 14 Jan 2006 16:08:29 -0800 From: Justin Bastedo To: Michael Bowerman In-Reply-To: <8038a35b0601140918t459b534cnea1c2a22ea578cc@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline References: <8038a35b0601140918t459b534cnea1c2a22ea578cc@mail.gmail.com> Cc: freebsd-database@freebsd.org Subject: Re: MySQL and FreeBSD native threads X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 00:08:31 -0000 I've been using MySQL 5 now for about 6 months in a productin environment and haven't had any problems. Our co-located master server replicates to an inhouse slave. and neither has given us any problems. Uptime: 6355651 Threads: 2 Questions: 143125480 Slow queries: 0 Opens: 0 Flush tables: 2 Open tables: 55 Queries per second avg: 22.519 >uptime 5:42PM up 129 days, 4:17, 1 user, load averages: 0.03, 0.03, 0.00 seeing a mild load, nothing too heavy, and mainly inserts and selects and has been really stable. Justin On 1/14/06, Michael Bowerman wrote: > A while ago, I was planning to move my MySQL server over from Linux to > FreeBSD. But, I was scared off by some blogs and the MySQL website > that said that FreeBSD threading had some problems dealing with high > loads, since some calls were not threadsafe. > > So, my question is this: has FreeBSD threading improved since the 4.x > line? It seems to me like a lot of work has gone into this area since > then. But, I haven't been able to find any updated information on 5.x > and 6.x. > > I'm trying to move completely to FreeBSD on my home network. So, I'd > prefer to make the switch. > > My server has a very small load and the data isn't exactly mission > critical (simple web stuff). So, even with the threading problem, it > would probably still meet my needs. But, it's mostly a matter of > worry free life cycle. I don't like to spend a lot of time on > maintenance (or wondering if it's my code, or the server), except for > upgrades. > > Thanks for your thoughts, > Mike > _______________________________________________ > freebsd-database@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-database > To unsubscribe, send any mail to "freebsd-database-unsubscribe@freebsd.or= g" > -- Justin Bastedo At Gmail Dot Com -------------------------------------------------- http://www.thebastedo.com From owner-freebsd-database@FreeBSD.ORG Sun Jan 15 04:37:57 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8362216A420 for ; Sun, 15 Jan 2006 04:37:57 +0000 (GMT) (envelope-from bryanh@meridian-enviro.com) Received: from newman.meridian-enviro.com (newman.meridian-enviro.com [207.109.235.166]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0A07543D46 for ; Sun, 15 Jan 2006 04:37:56 +0000 (GMT) (envelope-from bryanh@meridian-enviro.com) Received: from [192.168.2.12] (tamarack.meridian-enviro.com [192.168.2.12]) by newman.meridian-enviro.com (8.13.1/8.13.1) with ESMTP id k0F4bXoa061907; Sat, 14 Jan 2006 22:37:33 -0600 (CST) (envelope-from bryanh@meridian-enviro.com) Date: Sat, 14 Jan 2006 22:37:33 -0600 (CST) From: "Bryan C. Hahn" To: Justin Bastedo In-Reply-To: <8a5255240601141608t78ed7ffdheacad67307abe8d@mail.gmail.com> Message-ID: <20060114222654.Y43774@tamarack.meridian-enviro.com> References: <8038a35b0601140918t459b534cnea1c2a22ea578cc@mail.gmail.com> <8a5255240601141608t78ed7ffdheacad67307abe8d@mail.gmail.com> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Virus-Scanned: ClamAV 0.84/1242/Sat Jan 14 18:00:41 2006 on newman.meridian-enviro.com X-Virus-Status: Clean Cc: freebsd-database@freebsd.org Subject: Re: MySQL and FreeBSD native threads X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 04:37:57 -0000 On Sat, 14 Jan 2006, Justin Bastedo wrote: > > I've been using MySQL 5 now for about 6 months in a productin > environment and haven't had any problems. Our co-located master server > replicates to an inhouse slave. and neither has given us any problems. > > Uptime: 6355651 Threads: 2 Questions: 143125480 Slow queries: 0 Opens: > 0 Flush tables: 2 Open tables: 55 Queries per second avg: 22.519 > > >uptime > 5:42PM up 129 days, 4:17, 1 user, load averages: 0.03, 0.03, 0.00 > > seeing a mild load, nothing too heavy, and mainly inserts and selects > and has been really stable. > > Justin > Justin, I'm glad to hear you're having success with this MySQL 5 and FreeBSD combination. We'd really love to hear what your configuration is: * Is mysql installed from ports? If so, what knobs did you twist? * What threading configuration are you using? (Linux, native, etc.) * Anything special in the my.cnf file? * Are you using Innodb? BDB? * Exactly what version of FreeBSD? * SMP or UP? AMD or Intel? Motherboard? Amount of memory? * RAID? If so, ATA or SATA or SCSI? What controller and RAID configuration? * Is the slave configuration roughly the same? We have almost no experience with MySQL 4 or 5 on any version of FreeBSD. We have been successfully using MySQL 3.23 on both FreeBSD 4 and 5 *without* threading. Obviously for us, upgrading MySQL would be a good thing, and finding a suitable, reliable configuration would be even better. - Bryan From owner-freebsd-database@FreeBSD.ORG Sun Jan 15 14:49:11 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5F6B516A41F for ; Sun, 15 Jan 2006 14:49:11 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.204]) by mx1.FreeBSD.org (Postfix) with ESMTP id 96B8E43D64 for ; Sun, 15 Jan 2006 14:49:06 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so401548uge for ; Sun, 15 Jan 2006 06:49:03 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=tBarEmVzpoHbebR+KwUUj7tMnu7RonOGtu5NrEf/tZWCpCnWGrb0WnAzra1Kuvy2G+tVeEEtquO0ysHT47lHmP5IUZLeHp1kNh6pY7JqaPbPwNn6Ewq9ygcxBAwdpNjhWFPuEuyt3e2Y2o/TwDOmAFE/ssqCb928gOUxqCeLbQ4= Received: by 10.49.9.14 with SMTP id m14mr169278nfi; Sun, 15 Jan 2006 06:49:03 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sun, 15 Jan 2006 06:49:02 -0800 (PST) Message-ID: <787bbe1c0601150649y5c14e31dl2a47c88a66073707@mail.gmail.com> Date: Sun, 15 Jan 2006 15:49:02 +0100 From: Slawek Zak To: Andreas Feid In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <787bbe1c0601131220j7b3a052ege5fe4683156312a7@mail.gmail.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 14:49:11 -0000 T24gMS8xNC8wNiwgQW5kcmVhcyBGZWlkIDxhc2ltZXhAZ214LmRlPiB3cm90ZToKPiBBcmUgeW91 IHN1cmUgdGhlIGZpbGVyIGlzIGZpbmU/Cj4gSSB3b3VsZCBndWVzcyBzbyBmcm9tIHlvdXIgZGVz Y3JpcHRpb24sIG1pZ2h0IGJlIHdvcnRoIGdldHRpbmcgdGhlIGxhdGVzdAo+IHZlcnNpb24gb2Yg cGVyZnN0YXQgZnJvbSBOT1cgYW5kIHJ1biBpdC4KCkknbSBzdXJlLiBJdCBkb2Vzbid0IGRvIGFu eXRoaW5nIHNwZWNpYWwuIFRoZSB0aHJvdWdocHV0IGl0IHNlZXMgZnJvbQp0aGUgZGJzZXJ2ZXIg aXMgaW4gdGhlIG1lYXN1cmVtZW50IGVycm9yIHJhbmdlLiBXaGF0IG1pZ2h0IGJlIHdyb25nPwoK PiBBbHRlcm5hdGl2ZSBpZGVhLCBpZiBjYW4gYWZmb3JkIHRvIHRlc3QgaXQsIHdvdWxkIGJlIHRv IHRyeSB0aGUgSVNDU0kKPiBkcml2ZXIgZnJvbSBEYW5ueSBCcmFubmlzIGFuZCBwdXQgdGhlIGRh dGEgb24gYSBsdW4gb24gdGhlIGZpbGVyLiBUaGF0Cj4gc2hvdWxkIGdpdmUgeW91IGFib3V0IHRo ZSBzYW1lIHBlcmZvcm1hbmNlIGFzIGEgbG9jYWwgZGlzay4KCkl0IGlzIHNvbWUgaWRlYS4gSSB3 aWxsIHRyeSB0byBydW4gdGhlIGRhdGFiYXNlIG9uIFNvbGFyaXMgMTAgZm9yIGEKdGVzdCBmaXJz dCB0aG91Z2guCgovUwotLQpTs2F3ZWsgr2FrIC8gVU5JWCBTeXN0ZW1zIEFkbWluaXN0cmF0b3IK From owner-freebsd-database@FreeBSD.ORG Sun Jan 15 14:56:52 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7E11916A41F for ; Sun, 15 Jan 2006 14:56:52 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.207]) by mx1.FreeBSD.org (Postfix) with ESMTP id D15B943D45 for ; Sun, 15 Jan 2006 14:56:51 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id j3so345287ugf for ; Sun, 15 Jan 2006 06:56:50 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=dlzJcs/KP3gzMsjaM5hO/YkhAKyBSXCgZVlTPJuRfS7IujHMXnIE1KbXABd4HTENTdNVsFKJAxU18J7e1aeK+k+ca+GYsvedvdS10qi5WxzscsWeyrKDf4hyjjd4K4/xO3opMrop998dLe6/iYSlXeC2S4HyZ53ulQbs+wjnIPg= Received: by 10.49.17.20 with SMTP id u20mr168212nfi; Sun, 15 Jan 2006 06:50:49 -0800 (PST) Received: by 10.49.60.13 with HTTP; Sun, 15 Jan 2006 06:50:49 -0800 (PST) Message-ID: <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> Date: Sun, 15 Jan 2006 15:50:49 +0100 From: Slawek Zak To: Arne Woerner , freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <43C9110B.8070807@fer.hr> <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 14:56:52 -0000 T24gMS8xNC8wNiwgQXJuZSBXb2VybmVyIDxhcm5lX3dvZXJuZXJAeWFob28uY29tPiB3cm90ZToK PiAtLS0gSXZhbiBWb3JhcyA8aXZvcmFzQGZlci5ocj4gd3JvdGU6Cj4gPiBBcm5lIFdvZXJuZXIg d3JvdGU6Cj4gPiA+IEJ1dCB3aHkgZG9lcyBzd2l0Y2hpbmcgZnJvbSBsb2NhbCBkaXNjCj4gPiA+ IHRvIE5GUyBtYWtlcyB0aGUgUG9zdGdyZVNRTCBwZXJmb3JtYW5jZQo+ID4gPiBzbyBiYWQ/Cj4g Pgo+ID4gQSB3aWxkIGd1ZXNzL3RyeTogZG9lcyBmaWxlIGxvY2tpbmcgd29yawo+ID4gcHJvcGVy bHkgd2l0aCBORlMgYW5kIHRoZSBmaWxlcj8KPiA+Cj4gSSB3b3VsZCByZWNvbW1lbmQgdGhlIGZv bGxvd2luZyB0ZXN0IGluIG9yZGVyIHRvIGFuc3dlciB0aGF0Cj4gcXVlc3Rpb246Cj4KPiBFeGVj dXRpbmcgdGhlIHNoZWxsIHNjcmlwdCBpbiBhcHBlbmRpeCBBIG9mIHRoaXMgZW1haWwgd2lsbCB0 ZXN0LAo+IGlmIGxvY2tpbmcgd29ya3MsIGFuZCBob3cgZmFzdCBpdCBpczoKPiAlIHRpbWUgLi9s Y2stdHN0LnNoIDwvcGF0aC90by9sb2NhbC1mcy9maWxlPgo+ICUgdGltZSAuL2xjay10c3Quc2gg PC9wYXRoL3RvL05GUy9maWxlPgo+Cj4gLUFybmUKW3NuaXBdCgpJIGtlZXAgdGhlIGxvY2tzIGxv Y2FsIHdpdGggbW91bnRfbmZzIC1MLCBzbyBpdCdzIG5vdCBhIHByb2JsZW0uIEkKZG9uJ3Qga25v dyBpZiBwb3N0Z3Jlc3FsIHVzZXMgZmlsZSBsb2NraW5nIGFueXdheS4KCi9TCi0tClOzYXdlayCv YWsgLyBVTklYIFN5c3RlbXMgQWRtaW5pc3RyYXRvcgo= From owner-freebsd-database@FreeBSD.ORG Sun Jan 15 20:01:02 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2645F16A41F for ; Sun, 15 Jan 2006 20:01:02 +0000 (GMT) (envelope-from 000.fbsd@quip.cz) Received: from home.quip.cz (grimm.quip.cz [213.220.192.218]) by mx1.FreeBSD.org (Postfix) with ESMTP id 97E1243D45 for ; Sun, 15 Jan 2006 20:00:59 +0000 (GMT) (envelope-from 000.fbsd@quip.cz) Received: from [192.168.1.2] (qwork.quip.test [192.168.1.2]) by home.quip.cz (Postfix) with ESMTP id 5F4E1168B; Sun, 15 Jan 2006 21:00:55 +0100 (CET) Message-ID: <43CAA9F7.3090300@quip.cz> Date: Sun, 15 Jan 2006 21:00:55 +0100 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cs, cz, en, en-us MIME-Version: 1.0 To: freebsd-database@freebsd.org References: <8038a35b0601140918t459b534cnea1c2a22ea578cc@mail.gmail.com> <8a5255240601141608t78ed7ffdheacad67307abe8d@mail.gmail.com> <20060114222654.Y43774@tamarack.meridian-enviro.com> In-Reply-To: <20060114222654.Y43774@tamarack.meridian-enviro.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: Re: MySQL and FreeBSD native threads X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jan 2006 20:01:02 -0000 Bryan C. Hahn wrote: > On Sat, 14 Jan 2006, Justin Bastedo wrote: > >>I've been using MySQL 5 now for about 6 months in a productin >>environment and haven't had any problems. Our co-located master server >>replicates to an inhouse slave. and neither has given us any problems. >> >>Uptime: 6355651 Threads: 2 Questions: 143125480 Slow queries: 0 Opens: >>0 Flush tables: 2 Open tables: 55 Queries per second avg: 22.519 >> >> >>>uptime >> >> 5:42PM up 129 days, 4:17, 1 user, load averages: 0.03, 0.03, 0.00 >> >>seeing a mild load, nothing too heavy, and mainly inserts and selects >>and has been really stable. >> >>Justin >> > > > Justin, > > I'm glad to hear you're having success with this MySQL 5 and FreeBSD > combination. We'd really love to hear what your configuration is: > > * Is mysql installed from ports? If so, what knobs did you twist? > > * What threading configuration are you using? (Linux, native, etc.) > > * Anything special in the my.cnf file? > > * Are you using Innodb? BDB? > > * Exactly what version of FreeBSD? > > * SMP or UP? AMD or Intel? Motherboard? Amount of memory? > > * RAID? If so, ATA or SATA or SCSI? What controller and > RAID configuration? > > * Is the slave configuration roughly the same? > > We have almost no experience with MySQL 4 or 5 on any version of FreeBSD. > We have been successfully using MySQL 3.23 on both FreeBSD 4 and 5 > *without* threading. > > Obviously for us, upgrading MySQL would be a good thing, and finding a > suitable, reliable configuration would be even better. > > - Bryan Hi, I've been using MySQL 4.1 on FreeBSD 6.0 (UP and SMP) always with native threads. On one project, I am using 4.1.16 on SMP FreeBSD 6.0 (IBM eServer x336 - dual Xeon 3GHz + 2GB RAM + 72GB SCSI). There are Apache 2.0 + PHP 5.1.1 for serving pages and Lighttpd on another port for serving images,css,js... MySQL tables are InnoDB and few MyISAM tables for stats and URL cache. Database Master is replicated to the same machine with the same configuration. Both machines are serving same content at the same time with round robin DNS. Webapplication is connected to Master DB. Avarage system load is 1.5 - 2 mainly produced by Apache processes. This is output od 'mytop' tool: ------------------------------------------------------------------- MySQL on localhost (4.1.16-log) up 4+05:19:51 [20:30:54] Queries: 119.8M qps: 344 Slow: 2.4k Se/In/Up/De(%): 39/02/01/00 qps now: 984 Slow qps: 0.0 Threads: 5 ( 2/ 3) 44/01/01/00 Cache Hits: 30.2M Hits/s: 86.7 Hits now: 271.3 Ratio: 63.9% Ratio now: 62.7% Key Efficiency: 99.9% Bps in/out: 9.2k/ 3.0k Now in/out: 61.6k/505.2k ------------------------------------------------------------------- As you can see - MySQL has about 30 000 000 queries per day, in peaks it has more than 1400 queries per second without any problems. MySQL is installed from ports with following options: 'WITH_CHARSET=utf8', 'WITH_XCHARSET=all', 'WITH_COLLATION=utf8_czech_ci', 'WITH_PROC_SCOPE_PTH=yes', 'BUILD_OPTIMIZED=yes', 'BUILD_STATIC=yes', MySQL daemon is not running from rc script, but controlled by daemontools. my.cnf is tunned for using 1.5GB of RAM, max 150 connections. For this amount of memory, you must also tweak some options in /boot/loader.conf like this: kern.maxdsiz="1610612736" kern.dfldsiz="1610612736" kern.maxssiz="1610612736" On one UP machine I have MySQL 5.0 withou problems, but this machine has not as high load. -- Miroslav Lachman From owner-freebsd-database@FreeBSD.ORG Mon Jan 16 21:39:22 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A225916A41F for ; Mon, 16 Jan 2006 21:39:22 +0000 (GMT) (envelope-from knezour@weboutsourcing.cz) Received: from out.smtp.cz (ender.smtp.cz [81.95.97.119]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3033943D46 for ; Mon, 16 Jan 2006 21:39:20 +0000 (GMT) (envelope-from knezour@weboutsourcing.cz) Received: from vbmailshield.smtp.cz (jane.smtp.cz [81.95.97.121]) by out.smtp.cz (Postfix) with SMTP id ED8634CDA9 for ; Mon, 16 Jan 2006 22:39:18 +0100 (CET) Received: from [192.168.35.8] (gw.weboutsourcing.cz [82.208.3.19]) by out.smtp.cz (Postfix) with ESMTP id 5FE814CDA9 for ; Mon, 16 Jan 2006 22:39:18 +0100 (CET) Message-ID: <43CC120C.2090506@weboutsourcing.cz> Date: Mon, 16 Jan 2006 22:37:16 +0100 From: Ondra Knezour User-Agent: Mozilla Thunderbird 1.0.2 (Windows/20050317) X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-database@freebsd.org Content-Type: text/plain; charset=ISO-8859-2; format=flowed Content-Transfer-Encoding: 7bit Subject: Debugging Firebird DB X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jan 2006 21:39:22 -0000 Dear all, I'm trying to use some comercial application (Linux binary, no sources available) on FreeBSD. This program runs as daemon, receive requests from win based clients, process them, connect to Firebird and send response back to client. However, there are some troubles with daemon <-> database communication, probably with processing daemons requests in database. I tried to watch communication with tcpdump and look on running db server with truss, but didn't get any usefull info. So my question is - can anybody direct me to some method how to watch actions taken in Firebird DB upon db client request? Some sql debugger/profiler? Or some reading about this? I have no success with searching. And second question - there are some UDFs (user defined functions libraries) for Firebird, Linux only again, compiled from Delphi, no sources available. Has anybody experince with using such .so files with Firebird? Using linuxpluginwrapper, decompilation and compilation on FreeBSD, any other way? Thanks for your time. -- Best Regards Ondra Knezour From owner-freebsd-database@FreeBSD.ORG Tue Jan 17 10:03:19 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 186C416A41F for ; Tue, 17 Jan 2006 10:03:19 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: from uproxy.gmail.com (uproxy.gmail.com [66.249.92.205]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3C91C43D48 for ; Tue, 17 Jan 2006 10:03:17 +0000 (GMT) (envelope-from slawek.zak@gmail.com) Received: by uproxy.gmail.com with SMTP id o2so195556uge for ; Tue, 17 Jan 2006 02:03:16 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=CAXgYPOr2nJaYKXiOsLSD2eKcFcDNrRO3tOeX/IGZqG1F+PzBUfUfEN/rQebCxO19R+/AumBiE5FenDBJMS6Hgy6gZqVimz9Erc3MUm2S9zWXS2VTLzuiKL92Ll8Xo9dNVi05gBwPXGoGdfPByhCPgbdTeOPKS00HQAvelxNAYw= Received: by 10.49.37.9 with SMTP id p9mr300487nfj; Tue, 17 Jan 2006 01:57:10 -0800 (PST) Received: by 10.49.60.13 with HTTP; Tue, 17 Jan 2006 01:57:09 -0800 (PST) Message-ID: <787bbe1c0601170157x7779063m16aa8a91de15361e@mail.gmail.com> Date: Tue, 17 Jan 2006 10:57:09 +0100 From: Slawek Zak To: freebsd-performance@freebsd.org, freebsd-database@freebsd.org In-Reply-To: <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-2 Content-Transfer-Encoding: base64 Content-Disposition: inline References: <43C9110B.8070807@fer.hr> <20060114161402.43003.qmail@web30305.mail.mud.yahoo.com> <787bbe1c0601150650n664f8114o89ea37bf50e7dac7@mail.gmail.com> Cc: Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jan 2006 10:03:19 -0000 SGksCgpJIHdlbnQgYmFjayBvbmUgc3RlcCBhbmQgbW92ZWQgdGhlIGRiIGJhY2sgdG8gdGhlIGRp c2tzLiBJdCBzZWVtcyB0aGF0CmFuIHVucmVsYXRlZCB1cGRhdGUgdG8gdGhlIGRhdGFiYXNlIGF0 IGFyb3VuZCB0aGUgc2FtZSB0aW1lIEkgbWlncmF0ZWQKdG8gZmlsZXIsIG1hZGUgaXQgc2xvdyBk b3duIHRvIGEgY3Jhd2wuIEFmdGVyIHNvbWUgdHdlYWtpbmcgYnkgdGhlCmRldmVsb3BlcnMgYW5k IG1vdmluZyBiYWNrIHRvIGZpbGVyLCBwZXJmb3JtYW5jZSBpcyBmaW5lIGFnYWluLgoKTGVzc29u IGxlYXJuZWQ6IEFsd2F5cyBvbmUgc3RlcCBhdCBhIHRpbWUuCgpTb3JyeSBmb3IgdGhlIGhhdm9j LgoKL1MKLS0KU7Nhd2VrIK9hayAvIFVOSVggU3lzdGVtcyBBZG1pbmlzdHJhdG9yCg== From owner-freebsd-database@FreeBSD.ORG Thu Jan 19 00:59:00 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 51BA216A420; Thu, 19 Jan 2006 00:59:00 +0000 (GMT) (envelope-from decibel@decibel.org) Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id E5A7143D45; Thu, 19 Jan 2006 00:58:59 +0000 (GMT) (envelope-from decibel@decibel.org) Received: by noel.decibel.org (Postfix, from userid 1001) id 3EDBC3983D; Wed, 18 Jan 2006 18:58:47 -0600 (CST) Date: Wed, 18 Jan 2006 18:58:47 -0600 From: "Jim C. Nasby" To: Arne Woerner Message-ID: <20060119005847.GK17896@decibel.org> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> X-Operating-System: FreeBSD 6.0-RELEASE amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 00:59:00 -0000 On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > Did you do those "dd" tests with small block sizes (like 1byte: > bs=1), like somebody on one of those lists suggests, too? Then we > could see, if there is a high latency that ruins everything... FYI, PostgreSQL does 8kB I/O by default. This can only be changed by modifying a header file. -- Jim C. Nasby, Database Architect decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?" From owner-freebsd-database@FreeBSD.ORG Thu Jan 19 01:11:17 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DE60C16A41F; Thu, 19 Jan 2006 01:11:17 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (Odin.AC.HMC.Edu [134.173.32.75]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6BEB743D46; Thu, 19 Jan 2006 01:11:17 +0000 (GMT) (envelope-from brdavis@odin.ac.hmc.edu) Received: from odin.ac.hmc.edu (localhost.localdomain [127.0.0.1]) by odin.ac.hmc.edu (8.13.0/8.13.0) with ESMTP id k0J1BFfC020668; Wed, 18 Jan 2006 17:11:15 -0800 Received: (from brdavis@localhost) by odin.ac.hmc.edu (8.13.0/8.13.0/Submit) id k0J1BF6L020666; Wed, 18 Jan 2006 17:11:15 -0800 Date: Wed, 18 Jan 2006 17:11:15 -0800 From: Brooks Davis To: "Jim C. Nasby" Message-ID: <20060119011115.GA18415@odin.ac.hmc.edu> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="sm4nu43k4a2Rpi4c" Content-Disposition: inline In-Reply-To: <20060119005847.GK17896@decibel.org> User-Agent: Mutt/1.4.1i X-Virus-Scanned: by amavisd-new X-Spam-Status: No, hits=0.0 required=8.0 tests=none autolearn=no version=2.63 X-Spam-Checker-Version: SpamAssassin 2.63 (2004-01-11) on odin.ac.hmc.edu Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org, Arne Woerner Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 01:11:18 -0000 --sm4nu43k4a2Rpi4c Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 18, 2006 at 06:58:47PM -0600, Jim C. Nasby wrote: > On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > > Did you do those "dd" tests with small block sizes (like 1byte: > > bs=3D1), like somebody on one of those lists suggests, too? Then we > > could see, if there is a high latency that ruins everything... >=20 > FYI, PostgreSQL does 8kB I/O by default. This can only be changed by > modifying a header file. That's definitely small in my book (certainly compared to the 1MB block size the first responder suggested), knowing that, you should definitely do dd tests with 8k blocks since that's the best performance you are likely to get. -- Brooks --=20 Any statement of the form "X is the one, true Y" is FALSE. PGP fingerprint 655D 519C 26A7 82E7 2529 9BF0 5D8E 8BE9 F238 1AD4 --sm4nu43k4a2Rpi4c Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.2.1 (GNU/Linux) iD8DBQFDzuczXY6L6fI4GtQRAoNCAJ0dJcbZZyxaFn3+JPvgQjYNon3+DQCfXquj il7c4HKlug5OMn5bna5E0rE= =6iId -----END PGP SIGNATURE----- --sm4nu43k4a2Rpi4c-- From owner-freebsd-database@FreeBSD.ORG Thu Jan 19 01:15:51 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DCDB116A420; Thu, 19 Jan 2006 01:15:51 +0000 (GMT) (envelope-from decibel@decibel.org) Received: from noel.decibel.org (noel.decibel.org [67.100.216.10]) by mx1.FreeBSD.org (Postfix) with ESMTP id 31A4F43D46; Thu, 19 Jan 2006 01:15:51 +0000 (GMT) (envelope-from decibel@decibel.org) Received: by noel.decibel.org (Postfix, from userid 1001) id 8DB1C39834; Wed, 18 Jan 2006 19:15:50 -0600 (CST) Date: Wed, 18 Jan 2006 19:15:50 -0600 From: "Jim C. Nasby" To: Brooks Davis Message-ID: <20060119011550.GN17896@decibel.org> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> <20060119011115.GA18415@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20060119011115.GA18415@odin.ac.hmc.edu> X-Operating-System: FreeBSD 6.0-RELEASE amd64 X-Distributed: Join the Effort! http://www.distributed.net User-Agent: Mutt/1.5.11 Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org, Arne Woerner Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 01:15:52 -0000 On Wed, Jan 18, 2006 at 05:11:15PM -0800, Brooks Davis wrote: > On Wed, Jan 18, 2006 at 06:58:47PM -0600, Jim C. Nasby wrote: > > On Sat, Jan 14, 2006 at 06:42:02AM -0800, Arne Woerner wrote: > > > Did you do those "dd" tests with small block sizes (like 1byte: > > > bs=1), like somebody on one of those lists suggests, too? Then we > > > could see, if there is a high latency that ruins everything... > > > > FYI, PostgreSQL does 8kB I/O by default. This can only be changed by > > modifying a header file. > > That's definitely small in my book (certainly compared to the 1MB block > size the first responder suggested), knowing that, you should > definitely do dd tests with 8k blocks since that's the best performance you > are likely to get. Agreed, it is small from a OS/filesystem viewpoint, but it's also nowhere near 1 byte which is the test that had been suggested. :) -- Jim C. Nasby, Database Architect decibel@decibel.org Give your computer some brain candy! www.distributed.net Team #1828 Windows: "Where do you want to go today?" Linux: "Where do you want to go tomorrow?" FreeBSD: "Are you guys coming, or what?" From owner-freebsd-database@FreeBSD.ORG Thu Jan 19 18:05:37 2006 Return-Path: X-Original-To: freebsd-database@freebsd.org Delivered-To: freebsd-database@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 12FF716A41F; Thu, 19 Jan 2006 18:05:37 +0000 (GMT) (envelope-from sean@gigave.com) Received: from mailhost.gigave.com (mailhost.gigave.com [38.113.228.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9B83743D49; Thu, 19 Jan 2006 18:05:33 +0000 (GMT) (envelope-from sean@gigave.com) Date: Thu, 19 Jan 2006 10:05:32 -0800 From: Sean Chittenden To: Brooks Davis Message-ID: <20060119180532.GD9040@mailhost.gigave.com> References: <787bbe1c0601140457y6de99891n86b49a728eedac94@mail.gmail.com> <20060114144202.6199.qmail@web30315.mail.mud.yahoo.com> <20060119005847.GK17896@decibel.org> <20060119011115.GA18415@odin.ac.hmc.edu> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qVHblb/y9DPlgkHs" Content-Disposition: inline In-Reply-To: <20060119011115.GA18415@odin.ac.hmc.edu> Message-Id: <20060119180533.4B8FC21701B@mailhost.gigave.com> Cc: freebsd-database@freebsd.org, freebsd-performance@freebsd.org, Arne Woerner , "Jim C. Nasby" Subject: Re: Horrible PostgreSQL performance with NFS X-BeenThere: freebsd-database@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Database use and development under FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jan 2006 18:05:37 -0000 --qVHblb/y9DPlgkHs Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable > > > Did you do those "dd" tests with small block sizes (like 1byte: > > > bs=3D1), like somebody on one of those lists suggests, too? Then > > > we could see, if there is a high latency that ruins > > > everything... > >=20 > > FYI, PostgreSQL does 8kB I/O by default. This can only be changed > > by modifying a header file. >=20 > That's definitely small in my book (certainly compared to the 1MB > block size the first responder suggested), knowing that, you should > definitely do dd tests with 8k blocks since that's the best > performance you are likely to get. PostgreSQL can be configured to use more than 32K blocks, but I recall 65K having problems and shouldn't be used in production. Tom Lane was less than amused when he found out I'd added those options to the ports and issued some strong words suggesting against using anything but 8K blocks simply because that was the only config that'd seen years of production use. YMMV. -sc --=20 Sean Chittenden --qVHblb/y9DPlgkHs Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- iD8DBQFDz9Tsapga0yeGcOQRAnwjAJ9Q6DVDVGIMKpvauh5RwfdaoIMWtwCgxPJ3 /YO8k5TFeePgp7rPIawg16Q= =eFD6 -----END PGP SIGNATURE----- --qVHblb/y9DPlgkHs--