From owner-freebsd-performance@FreeBSD.ORG Thu Apr 20 09:46:56 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 61E7316A400 for ; Thu, 20 Apr 2006 09:46:56 +0000 (UTC) (envelope-from mv@thebeastie.org) Received: from p4.roq.com (ns1.ecoms.com [207.44.130.137]) by mx1.FreeBSD.org (Postfix) with ESMTP id EF49E43D45 for ; Thu, 20 Apr 2006 09:46:51 +0000 (GMT) (envelope-from mv@thebeastie.org) Received: from p4.roq.com (localhost.roq.com [127.0.0.1]) by p4.roq.com (Postfix) with ESMTP id 0A00E4D1C6 for ; Thu, 20 Apr 2006 09:47:55 +0000 (GMT) Received: from [192.168.0.6] (ppp157-158.static.internode.on.net [150.101.157.158]) by p4.roq.com (Postfix) with ESMTP id 547514D1C2 for ; Thu, 20 Apr 2006 09:47:53 +0000 (GMT) Message-ID: <4447588E.9020105@thebeastie.org> Date: Thu, 20 Apr 2006 19:46:54 +1000 From: Michael Vince User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.12) Gecko/20060213 X-Accept-Language: en-us, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org References: <200604041942.18767.hadara@bsd.ee> <021b01c658d2$de254a00$b3db87d4@multiplay.co.uk> <4434DB85.10104@roq.com> In-Reply-To: <4434DB85.10104@roq.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Subject: Re: mysql performance on 4 * dualcore opteron X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Apr 2006 09:46:56 -0000 Michael Vince wrote: > I just ran a test on 6_stable (April 5th) on a Dell 2850 dual CPU > (single core 3.60GHz) using the AMD64 build of FreeBSD and got similar > speeds as you. > Its interesting how Sven could have 8 cores with what appears to be > less MySQL speed then just having a few cores. > After enabling libthr it does jump by about 3,600 on a generic SMP > kernel compile, I didn't try any more serious tweaks. > > For those who are interested in exactly how I tested wheres what I did. > > portupgrade -RN -m 'BUILD_OPTIMIZED=yes WITH_PROC_SCOPE_PTH=yes' > /usr/ports/databases/mysql41-server > portupgrade -RN /usr/ports/benchmarks/super-smack > > super-smack -d mysql /usr/local/share/super-smack/select-key.smack 10 > 10000 > Query Barrel Report for client smacker1 > connect: max=4ms min=1ms avg= 2ms from 10 clients > Query_type num_queries max_time min_time q_per_s > select_index 200000 0 0 22061.88 > > With this below in my /etc/libmap.conf for libthr and a MySQL restart > /usr/local/etc/rc.d/mysql-server restart the numbers do jump. > [/usr/local/libexec/mysqld] > libpthread.so.2 libthr.so.2 > libpthread.so libthr.so > > > super-smack -d mysql /usr/local/share/super-smack/select-key.smack 10 > 10000 > Query Barrel Report for client smacker1 > connect: max=238ms min=0ms avg= 117ms from 10 clients > Query_type num_queries max_time min_time q_per_s > select_index 200000 0 0 25601.49 > Interestingly I just did a install of i386 FreeBSD 6.1RC1 and installed a PAE kernel (for 6gigs of ram) on this very same server (which had AMD64 FreeBSD on before hand) and run the exact same tests and its now a good deal slower! # super-smack -d mysql /usr/local/share/super-smack/select-key.smack 10 10000 Query Barrel Report for client smacker1 connect: max=3ms min=2ms avg= 2ms from 10 clients Query_type num_queries max_time min_time q_per_s select_index 200000 0 0 19234.02 And without libthr its even slower # super-smack -d mysql /usr/local/share/super-smack/select-key.smack 10 10000 Query Barrel Report for client smacker1 connect: max=100ms min=22ms avg= 60ms from 10 clients Query_type num_queries max_time min_time q_per_s select_index 200000 0 0 16583.43 Does any one have any explanation of this? Mike > I have also done benchmarking with libthr against Apache using 'ab' > and found it can deliver an extra amount of megabytes/sec of data (I > think it was about an extra 2000/requests sec) at the cost of giving > the server from what I remember almost double the 'average load' > according to 'top' > Given that if your machine has nothing else to do but deliver data > purely from Apache then even libthr is more worth while for Apache as > well. > > Mike > > Steven Hartland wrote: > >> Looking at this on a dual box here ( waiting for the new MB for dual >> dual core ) >> All the time is spent processing super-smack and only 25% on mysqld. >> Even dropping to 10 clients a large portion is take by the clients. >> That said there is a lot that can be gained by using the tweaks out >> there >> i.e. ULE + libthr + TSC + context_time.patch + cpu_acct_1.patch + >> cpu_acct_2.patch >> Adding these jumps from a baseline: >> select_index 2000000 8 0 18624.60 >> to: >> select_index 2000000 5 0 29942.10 >> >> The biggest increases coming from libthr ( thanks DavidXu ) and the ULE >> scheduler. >> >> [log] >> == 4BSD + libpthread + ACPI-Fast == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=46ms min=6ms avg= 25ms from 100 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 8 0 18624.60 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=5ms min=0ms avg= 1ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 23983.87 >> >> == 4BSD + libthr + ACPI-Fast == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=107ms min=2ms avg= 45ms from 100 clients >> Query_type num_queries max_time min_time q_per_s >> select_index 2000000 13 0 22413.39 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=2ms min=1ms avg= 1ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 26841.07 >> >> == 4BSD + libthr + TSC == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=46ms min=1ms avg= 21ms from 100 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 11 0 23428.03 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=2ms min=0ms avg= 1ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 26403.95 >> >> == ULE + libthr + TSC == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=41ms min=0ms avg= 23ms from 100 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 5 0 28581.18 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=4ms min=0ms avg= 1ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 30128.44 >> >> == ULE + libthr + TSC + context_time.patch + cpu_acct_1.patch + >> cpu_acct_2.patch == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=27ms min=0ms avg= 14ms from 100 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 5 0 29942.10 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=12ms min=0ms avg= 4ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 31057.52 >> >> == 4BSD + libthr + TSC + context_time.patch + cpu_acct_1.patch + >> cpu_acct_2.patch == >> super-smack -d mysql select-key.smack 100 10000 >> Query Barrel Report for client smacker1 >> connect: max=54ms min=20ms avg= 38ms from 100 clients >> Query_type num_queries max_time min_time q_per_s >> select_index 2000000 9 0 24144.22 >> >> super-smack -d mysql select-key.smack 10 100000 >> Query Barrel Report for client smacker1 >> connect: max=2ms min=0ms avg= 1ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 2000000 0 0 27073.46 >> >> ** update test ** >> super-smack -d mysql update-select.smack 10 100000 >> Query Barrel Report for client smacker >> connect: max=3ms min=0ms avg= 0ms from 10 clients Query_type >> num_queries max_time min_time q_per_s >> select_index 1000000 1 0 6468.70 >> update_index 1000000 0 0 6468.70 >> [/log] >> >> Machine: >> Dual 244, 2Gb running FreeBSD 6.1-PRERELEASE (i386) >> Package install of mysql 4.0 >> Port install of super-smack >> >> Notes: >> No detectable disk activity thoughout the tests >> ULE scheduler breaks the output from top with everything showing as >> WCPU 0% in the 100 concurrency test and the numbers not adding up >> at all in 10 concurrency test or showing 0%. >> To get context_time.patch to work I needed the attached patch which >> is basically two failed chunks of: kern/kern_exit.c moved to >> kern/kern_thread.c >> >> Steve >> ----- Original Message ----- From: "Sven Petai" >> To: >> Sent: Tuesday, April 04, 2006 5:42 PM >> Subject: mysql performance on 4 * dualcore opteron >> >> >>> hi >>> >>> Before I begin, let me just say that I'm probably aware most of the >>> threads about mysql performance in various fbsd lists over last >>> couple of years, so please let's not consentrate on the usual points >>> made over and over again like how filesystems are mounted under >>> linux, how fast time() is or how various combinations of >>> scheduler/threding library/compiler flags give you ~5-10% better >>> performance. It's very unlikely that any of these reasons, or even >>> all of them together can explain performance differences of 2-3 * >>> so now a little bit of the backround... >>> I usually use MySQL benchmark called super-smack as one of the >>> benchmarks on all the new machines to get a general feeling of the >>> servers performance. >>> I certainly agree that the default smack workloads are far too >>> simple to say much about actual production performance, but still... >>> better than nothing... >>> >>> In general 2.4Ghz amd64 UP box (6.1 betaX) can do about >>> 17400 q/s with select-smack+4bsd+thr combination and >>> 4300 q/s with update-smack+4bsd+thr >>> >>> on dualcore 2Ghz opteron (6.1 prerelease) the results are: >>> 20000 q/s with select-smack+4bsd+thr and >>> 4500 q/s with update-smack+4bsd+thr >>> >>> performance for update-smack seems to be always 4XXX q/s, no matter >>> how many CPUs the box has or what kind or raid controller/disks are >>> used (i have tested on about 8 rather different machines). I have >>> no idea if IO on all the servers I have tried really maxes out at >>> this point or is there some bottleneck in UFS. >>> select-smack performance gains on dualcore are not quite as good as >>> one might expect, but then again that dualcore box uses ECC memory >>> which is probably somewhat slower because of the checksum >>> calculations, and synchronisation has some overhead too... Anyway >>> all in all I'm more or less happy with these results, even though >>> linux will do about twise as much selects on the same hardware. >>> >>> Today I had a chance to test 4 * 2Ghz dualcore opteron machine, so >>> this machine has 8 cores in total and 8G of RAM. >>> >>> Now, on that server I get: >>> 11000 q/s for select-smack+4bsd+thr combination (with KSE it's >>> around 6000 q/s, ule+thr gives somewhere around 12000 q/s) >>> 4100 q/s for update-smack+4bsd+thr >>> >>> So the 8 core machine got almost 2* worse result for select than UP >>> server. >>> >>> After some tinkering I found out that renicing mysqld to -5 will >>> make it push out 21000 q/s (4bsd, thr), so I suspect part of the >>> problem is in the scheduling - probably super-smack with it's 100 >>> processes gets just a lot more CPU time otherwise than mysql with >>> it's 100 threads servicing them. But anyway even this result is >>> still only about equal in performance to what I get from dualcore >>> machine. >>> >>> As I ran out of good (macro)tuning ideas at this point, and wanted >>> to make sure higher scores are indeed achievable, I tried Linux on >>> the same hardware. >>> Here are the results for same tests on Suse enterprise linux 9 >>> (2.6.5-7.97-smp): >>> 76857 q/s for select-smack >>> 10050 q/s for update-smack >>> >>> the mysql configuration was identical to the one I used under >>> freebsd (my-huge). This Suse uses ReiserFS, but I have no idea about >>> what kind of FS guarantees it provides, didn't see any sync/async >>> stuff in the mount output. >>> I also repeated the tests on identical box that had Fedora installed >>> (2.6.9-22-ELsmp) and used ext3'fs. >>> select-smack results were obviously almost the same as it doesn't >>> touch the FS, update was about 8000 q/s. >>> >>> I'm relativelly sure that this kind of huge performance differences >>> can't be explained by mere speed difference of time(), I haven't yet >>> tested phk'd and roberts timer hacks, but at some point in time I >>> rewrote mysql's timing code to completelly avoid any calls to time() >>> by keeping internal timestamp that was updated from TSC reg. value. >>> It was certainly very ugly and imprecise, but worked well enough >>> since mysql uses these code paths mainly for statistics and for >>> setting various safeguard timeouts. Even with ~90% time() calls >>> removed the performance still didn't get measurably better. >>> Of course it's possible that I fucked up somehow, so if someone has >>> tested roberts and phk's changes then it would be certainly nice to >>> hear about your results. >>> >>> To make the long story short - does anyone have any good ideas about >>> where might the bottleneck and how to debug it ? >>> >>> PS >>> Here's some system/test information: >>> super-smack was used with concurrency of 100 and reqs. set to 10000 >>> it was running on the same machine as the mysqld and connections >>> were done over local socket. >>> >>> timer: acpi-fast in all the cases >>> mysql: 4.1.18_2 from ports, table type is myisam >>> mysql configuration file: >>> http://bsd.ee/~hadara/debug/mysql3/2way/my.cnf >>> in general it's just my-huge.cnf from mysql distribution, with >>> increased max_connections >>> >>> kernel config is GENERIC-SMP (no it doesn't have WITNESS enabled) >>> == 4 * dualcore opteron ==: >>> vmstat 1, during select-smack test: >>> http://bsd.ee/~hadara/debug/mysql3/8way/vmstat.txt >>> dmesg: >>> http://bsd.ee/~hadara/debug/mysql3/8way/dmesg.boot >>> sysctl -a: >>> http://bsd.ee/~hadara/debug/mysql3/8way/sysctl.txt >>> >>> == 1 * dualcore opteron ==: >>> vmstat 1, during select-smack test: >>> http://bsd.ee/~hadara/debug/mysql3/2way/vmstat.txt >>> dmesg: >>> http://bsd.ee/~hadara/debug/mysql3/2way/dmesg.boot >>> sysctl -a: >>> http://bsd.ee/~hadara/debug/mysql3/2way/sysctl.txt >>> _______________________________________________ >>> freebsd-performance@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >>> To unsubscribe, send any mail to >>> "freebsd-performance-unsubscribe@freebsd.org" >>> >>> >> >> ================================================ >> This e.mail is private and confidential between Multiplay (UK) Ltd. >> and the person or entity to whom it is addressed. In the event of >> misdirection, the recipient is prohibited from using, copying, >> printing or otherwise disseminating it or any information contained >> in it. >> In the event of misdirection, illegible or incomplete transmission >> please telephone (023) 8024 3137 >> or return the E.mail to postmaster@multiplay.co.uk. >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> freebsd-performance@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-performance >> To unsubscribe, send any mail to >> "freebsd-performance-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" From owner-freebsd-performance@FreeBSD.ORG Thu Apr 20 10:24:58 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 14AD716A402 for ; Thu, 20 Apr 2006 10:24:58 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.FreeBSD.org (Postfix) with ESMTP id 1E5E243D6A for ; Thu, 20 Apr 2006 10:24:51 +0000 (GMT) (envelope-from killing@multiplay.co.uk) Received: from vader ([212.135.219.179]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon.PRO.v8.1.3.R) with ESMTP id md50002486279.msg for ; Thu, 20 Apr 2006 11:24:56 +0100 Message-ID: <00cf01c66464$a3a5ff30$b3db87d4@multiplay.co.uk> From: "Steven Hartland" To: "Steven Hartland" , "Sven Petai" , Date: Thu, 20 Apr 2006 11:24:37 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2869 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2869 X-Spam-Processed: multiplay.co.uk, Thu, 20 Apr 2006 11:24:56 +0100 (not processed: message from valid local sender) X-MDRemoteIP: 212.135.219.179 X-Return-Path: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-performance@freebsd.org X-MDAV-Processed: multiplay.co.uk, Thu, 20 Apr 2006 11:24:56 +0100 Cc: Subject: Re: mysql performance on 4 * dualcore opteron X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Apr 2006 10:24:58 -0000 Just retested on a dual dual core so 2 * as quick as before Dual 265 ( 4 * 1.8 Ghz Cores ) == 4BSD + libthr + ACPI-Fast == super-smack -d mysql select-key.smack 100 10000 Query Barrel Report for client smacker1 connect: max=36ms min=0ms avg= 18ms from 100 clients Query_type num_queries max_time min_time q_per_s select_index 2000000 13 0 38965.71 super-smack -d mysql select-key.smack 10 100000 Query Barrel Report for client smacker1 connect: max=2ms min=0ms avg= 1ms from 10 clients Query_type num_queries max_time min_time q_per_s select_index 2000000 0 0 42344.21 Dual 244 ( 2 * 1.8 Ghz Cores ) == 4BSD + libthr + ACPI-Fast == super-smack -d mysql select-key.smack 100 10000 Query Barrel Report for client smacker1 connect: max=107ms min=2ms avg= 45ms from 100 clients Query_type num_queries max_time min_time q_per_s select_index 2000000 13 0 22413.39 super-smack -d mysql select-key.smack 10 100000 Query Barrel Report for client smacker1 connect: max=2ms min=1ms avg= 1ms from 10 clients Query_type num_queries max_time min_time q_per_s select_index 2000000 0 0 26841.07 So pretty good scaling there. Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone (023) 8024 3137 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 06:11:29 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 9CE6716A400 for ; Fri, 21 Apr 2006 06:11:29 +0000 (UTC) (envelope-from patpro@patpro.net) Received: from smtp2-g19.free.fr (smtp2-g19.free.fr [212.27.42.28]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4B44243D45 for ; Fri, 21 Apr 2006 06:11:29 +0000 (GMT) (envelope-from patpro@patpro.net) Received: from [82.235.12.223] (boleskine.patpro.net [82.235.12.223]) by smtp2-g19.free.fr (Postfix) with ESMTP id 4B69872EEB for ; Fri, 21 Apr 2006 08:11:28 +0200 (CEST) Mime-Version: 1.0 (Apple Message framework v749.3) Content-Transfer-Encoding: 7bit Message-Id: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed To: freebsd-performance@freebsd.org From: Patrick Proniewski Date: Fri, 21 Apr 2006 08:11:27 +0200 X-Mailer: Apple Mail (2.749.3) Subject: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 06:11:29 -0000 Hello, there is an extensive discussion here about MySQL performance on FreeBSD compared to linux and also comparing various options on FreeBSD side (threading lib, ...). What about Java application perfs (tomcat and other) ? Are there any benches around comparing multi- user java application performances on FreeBSD and Linux ? It's of great interest to me, because in the following months I'm likely to become the main sysadmin in my department, and I'll have technical decision to make. As I'm mastering FreeBSD and not Linux, and as our current java plateform is Linux, I have quite a dilema here. regards, Patrick From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 06:26:39 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 253CB16A405 for ; Fri, 21 Apr 2006 06:26:39 +0000 (UTC) (envelope-from mikej@rogers.com) Received: from smtp108.rog.mail.re2.yahoo.com (smtp108.rog.mail.re2.yahoo.com [68.142.225.206]) by mx1.FreeBSD.org (Postfix) with SMTP id 6412F43D48 for ; Fri, 21 Apr 2006 06:26:38 +0000 (GMT) (envelope-from mikej@rogers.com) Received: (qmail 13133 invoked from network); 21 Apr 2006 06:26:37 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=rogers.com; h=Received:Message-ID:Date:From:User-Agent:MIME-Version:To:CC:Subject:References:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=b5V9u6ooodstriD8afRo4szT6rrhBNjBSB2zLPFInbb7938n5IhifFVrRRM0+7ug3YDyXV5D2+ZQT+phjXEOAi3znBroJO2ddWkhJbc1TiNwcGdHAB1/KfcI02mqy5C3MfqCKgJcZJgaCKuaZJSVq4k5Kocky+0A0cc9a2DG/aM= ; Received: from unknown (HELO ?70.31.50.218?) (mikej@rogers.com@70.31.50.218 with plain) by smtp108.rog.mail.re2.yahoo.com with SMTP; 21 Apr 2006 06:26:37 -0000 Message-ID: <44487B21.7000203@rogers.com> Date: Fri, 21 Apr 2006 02:26:41 -0400 From: Mike Jakubik User-Agent: Thunderbird 1.5 (Windows/20051201) MIME-Version: 1.0 To: Patrick Proniewski References: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> In-Reply-To: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 06:26:39 -0000 Patrick Proniewski wrote: > Hello, > > there is an extensive discussion here about MySQL performance on > FreeBSD compared to linux and also comparing various options on > FreeBSD side (threading lib, ...). What about Java application perfs > (tomcat and other) ? Are there any benches around comparing multi-user > java application performances on FreeBSD and Linux ? These are very specific benchmarks, perhaps you could start some of your own. Also, do not dismiss the advantage of an OS that is very easy to manage and keep up to date. From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 19:19:55 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3540216A403 for ; Fri, 21 Apr 2006 19:19:55 +0000 (UTC) (envelope-from patpro@patpro.net) Received: from smtp1-g19.free.fr (smtp1-g19.free.fr [212.27.42.27]) by mx1.FreeBSD.org (Postfix) with ESMTP id CCF9A43D58 for ; Fri, 21 Apr 2006 19:19:54 +0000 (GMT) (envelope-from patpro@patpro.net) Received: from [82.235.12.223] (boleskine.patpro.net [82.235.12.223]) by smtp1-g19.free.fr (Postfix) with ESMTP id C98438F980; Fri, 21 Apr 2006 21:19:53 +0200 (CEST) In-Reply-To: <44487B21.7000203@rogers.com> References: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> <44487B21.7000203@rogers.com> Mime-Version: 1.0 (Apple Message framework v749.3) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <76653CEC-76E4-4E9B-904C-C637BFD3F210@patpro.net> Content-Transfer-Encoding: 7bit From: Patrick Proniewski Date: Fri, 21 Apr 2006 21:19:52 +0200 To: Mike Jakubik X-Mailer: Apple Mail (2.749.3) Cc: freebsd-performance@freebsd.org Subject: Re: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 19:19:55 -0000 On 21 avr. 2006, at 08:26, Mike Jakubik wrote: > Patrick Proniewski wrote: >> there is an extensive discussion here about MySQL performance on >> FreeBSD compared to linux and also comparing various options on >> FreeBSD side (threading lib, ...). What about Java application >> perfs (tomcat and other) ? Are there any benches around comparing >> multi-user java application performances on FreeBSD and Linux ? > > These are very specific benchmarks, perhaps you could start some of > your own. Also, do not dismiss the advantage of an OS that is very > easy to manage and keep up to date. well, in fact I'm barely able to install a Linux on our existing hardware. My first attempt to put a debian on the fujitsu RX300 (first gen) with a good kernel (more than 4Go RAM and SMP) is an absolute failure. I'm very far from being able to deliver benchmarks. But well, it's my very first debian install. By the way, I understand that installing a native java on FreeBSD is not straighforward, isn't it ? one have to go with a java in compat_linux and then build a java for the freebsd host, is it right ? Patrick From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 19:24:06 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CF9CB16A403 for ; Fri, 21 Apr 2006 19:24:06 +0000 (UTC) (envelope-from mikej@rogers.com) Received: from smtp100.rog.mail.re2.yahoo.com (smtp100.rog.mail.re2.yahoo.com [206.190.36.78]) by mx1.FreeBSD.org (Postfix) with SMTP id 317C143D45 for ; Fri, 21 Apr 2006 19:24:06 +0000 (GMT) (envelope-from mikej@rogers.com) Received: (qmail 67420 invoked from network); 21 Apr 2006 19:24:05 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=rogers.com; h=Received:Message-ID:Date:From:User-Agent:MIME-Version:To:CC:Subject:References:In-Reply-To:Content-Type:Content-Transfer-Encoding; b=LqjweuNrWKRXSsu4teYlNKkdFush8OmF4TBZlV9bPYG4j/wT6lUXdFVNmE9rP9YpmfawJGniS7SrNkcuVVUWRNh6Oyb7Y3mIKdAhqgMEZCiUKWeuAPZrxenJDvAUNWnJtMSzHz7Hkb/L8mPMSfX2Zk+QByWZpic5EZaCOIPKz+E= ; Received: from unknown (HELO ?70.31.50.218?) (mikej@rogers.com@70.31.50.218 with plain) by smtp100.rog.mail.re2.yahoo.com with SMTP; 21 Apr 2006 19:24:05 -0000 Message-ID: <4449315E.8010003@rogers.com> Date: Fri, 21 Apr 2006 15:24:14 -0400 From: Mike Jakubik User-Agent: Thunderbird 1.5 (Windows/20051201) MIME-Version: 1.0 To: Patrick Proniewski References: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> <44487B21.7000203@rogers.com> <76653CEC-76E4-4E9B-904C-C637BFD3F210@patpro.net> In-Reply-To: <76653CEC-76E4-4E9B-904C-C637BFD3F210@patpro.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org Subject: Re: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 19:24:06 -0000 Patrick Proniewski wrote: > By the way, I understand that installing a native java on FreeBSD is > not straighforward, isn't it ? one have to go with a java in > compat_linux and then build a java for the freebsd host, is it right ? Its very straight forward, cd /usr/ports/java/diablo-jre15 && make install. FreeBSD has obtained a binary license from SUN, the diablo* distributions are all native and do not require any linux components. From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 19:25:04 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 70E0B16A403 for ; Fri, 21 Apr 2006 19:25:04 +0000 (UTC) (envelope-from patpro@patpro.net) Received: from smtp3-g19.free.fr (smtp3-g19.free.fr [212.27.42.29]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2300A43D60 for ; Fri, 21 Apr 2006 19:25:03 +0000 (GMT) (envelope-from patpro@patpro.net) Received: from [82.235.12.223] (boleskine.patpro.net [82.235.12.223]) by smtp3-g19.free.fr (Postfix) with ESMTP id 0083547EE9; Fri, 21 Apr 2006 21:25:01 +0200 (CEST) In-Reply-To: <444885FA.3050109@thebeastie.org> References: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> <444885FA.3050109@thebeastie.org> Mime-Version: 1.0 (Apple Message framework v749.3) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <846526F6-6668-45BD-9005-29E6F1977828@patpro.net> Content-Transfer-Encoding: 7bit From: Patrick Proniewski Date: Fri, 21 Apr 2006 21:25:00 +0200 To: Michael Vince X-Mailer: Apple Mail (2.749.3) Cc: freebsd-performance@freebsd.org Subject: Re: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 19:25:04 -0000 On 21 avr. 2006, at 09:12, Michael Vince wrote: > I choose a while ago that for me performance comes second to > flexibility and ability to keep control which I believe FreeBSD > provides best. sure, but I don't have your flexibility for buying hardware, and if switching to freebsd yields to a performance drop of 30-40% I'll have to switch back to linux :/ Patrick From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 19:52:33 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7263916A400 for ; Fri, 21 Apr 2006 19:52:33 +0000 (UTC) (envelope-from patpro@patpro.net) Received: from smtp2-g19.free.fr (smtp2-g19.free.fr [212.27.42.28]) by mx1.FreeBSD.org (Postfix) with ESMTP id 179E843D45 for ; Fri, 21 Apr 2006 19:52:33 +0000 (GMT) (envelope-from patpro@patpro.net) Received: from [82.235.12.223] (boleskine.patpro.net [82.235.12.223]) by smtp2-g19.free.fr (Postfix) with ESMTP id 5532D73129; Fri, 21 Apr 2006 21:52:32 +0200 (CEST) In-Reply-To: <4449315E.8010003@rogers.com> References: <7471F687-D1AC-4656-A037-CFED130A406D@patpro.net> <44487B21.7000203@rogers.com> <76653CEC-76E4-4E9B-904C-C637BFD3F210@patpro.net> <4449315E.8010003@rogers.com> Mime-Version: 1.0 (Apple Message framework v749.3) Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed Message-Id: <2B1500E3-EFCD-4D48-B44C-ECEA18C78645@patpro.net> Content-Transfer-Encoding: 7bit From: Patrick Proniewski Date: Fri, 21 Apr 2006 21:52:31 +0200 To: Mike Jakubik X-Mailer: Apple Mail (2.749.3) Cc: freebsd-performance@freebsd.org Subject: Re: what about java application performances ? X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 19:52:33 -0000 On 21 avr. 2006, at 21:24, Mike Jakubik wrote: > Patrick Proniewski wrote: >> By the way, I understand that installing a native java on FreeBSD >> is not straighforward, isn't it ? one have to go with a java in >> compat_linux and then build a java for the freebsd host, is it >> right ? > > Its very straight forward, cd /usr/ports/java/diablo-jre15 && make > install. FreeBSD has obtained a binary license from SUN, the > diablo* distributions are all native and do not require any linux > components. great news, thanks. Patrick From owner-freebsd-performance@FreeBSD.ORG Fri Apr 21 19:55:04 2006 Return-Path: X-Original-To: freebsd-performance@freebsd.org Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id A38F016A401 for ; Fri, 21 Apr 2006 19:55:04 +0000 (UTC) (envelope-from amarat@ksu.ru) Received: from ksu.ru (mail.ksu.ru [193.232.252.56]) by mx1.FreeBSD.org (Postfix) with ESMTP id D33C843D45 for ; Fri, 21 Apr 2006 19:55:03 +0000 (GMT) (envelope-from amarat@ksu.ru) X-Pass-Through: Kazan State University Network Received: from [194.85.245.161] (zealot.ksu.ru [194.85.245.161]) by ksu.ru (8.13.4/8.13.4) with ESMTP id k3LJbvCL022993 for ; Fri, 21 Apr 2006 23:37:58 +0400 Message-ID: <44493491.8060107@ksu.ru> Date: Fri, 21 Apr 2006 23:37:53 +0400 From: "Marat N.Afanasyev" User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.7.12) Gecko/20060214 X-Accept-Language: ru, en MIME-Version: 1.0 To: freebsd-performance@freebsd.org X-Enigmail-Version: 0.93.0.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Mailman-Approved-At: Fri, 21 Apr 2006 20:48:54 +0000 Subject: freebsd 6.1-RC amd64 spends a lot of time in 'system' load X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 Apr 2006 19:55:04 -0000 Hello! I encounered a problem and don't know how to handle it yet. I have a SMP machine with 2 opterons and 4G of memory running freebsd 6.1-RC. It serves as web and mail server and runs mysql 4.1 as well. Problem is using a large amount of CPU to handle 'system' tasks. vmstat 1 shows that average numbers of context switching is about 100k. I've tried to use all recomendation I've found, but problem still persists. Can anybody give me a glue, what I should tune first of all. Any information you'll need will be provided. -- SY, Marat