From owner-freebsd-stable@FreeBSD.ORG Mon Dec 3 09:19:08 2007 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 14A9B16A417 for ; Mon, 3 Dec 2007 09:19:08 +0000 (UTC) (envelope-from lol@chistydom.ru) Received: from hermes.hw.ru (hermes.hw.ru [80.68.240.91]) by mx1.freebsd.org (Postfix) with ESMTP id 5C50513C44B for ; Mon, 3 Dec 2007 09:19:06 +0000 (UTC) (envelope-from lol@chistydom.ru) Received: from [80.68.244.40] (account a_popov@rbc.ru [80.68.244.40] verified) by hermes.hw.ru (CommuniGate Pro SMTP 5.0.14) with ESMTPA id 204843154; Mon, 03 Dec 2007 12:18:41 +0300 Message-ID: <4753C9E4.1060200@chistydom.ru> Date: Mon, 03 Dec 2007 12:18:28 +0300 From: Alexey Popov User-Agent: Thunderbird 2.0.0.6 (X11/20070924) MIME-Version: 1.0 To: Mark Linimon References: <20071201213732.GA16638@cannabis.dataforce.net> <1497741406.20071201230441@rulez.sk> <20071202174540.GA29572@cannabis.dataforce.net> <200712020844.49718.linimon@FreeBSD.org> In-Reply-To: <200712020844.49718.linimon@FreeBSD.org> Content-Type: multipart/mixed; boundary="------------040700030907080801060805" Cc: freebsd-stable@freebsd.org, Alexey Vlasov Subject: Re: 2 x quad-core system is slower that 2 x dual core on FreeBSD X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Dec 2007 09:19:08 -0000 This is a multi-part message in MIME format. --------------040700030907080801060805 Content-Type: text/plain; charset=KOI8-R; format=flowed Content-Transfer-Encoding: 7bit Hi Mark Linimon wrote: >> I used 7.0-BETA3 and it is much worse. > Ouch. A lot of systems see improvement. Thanks for trying it > out. I hope that one of the people that has been doing the actual > work can now comment (I am just an onlooker), and that you can be > patient in the meantime. > Unfortunately, Kris, who often looks at these kind of issues, is > traveling for all of December and thus off the net. Is there any other FreeBSD developer who can take care of performance problems on many-cores systems? Seems like upcoming 7-RELEASE and 6.3-RELEASE would be completely unusable for us on that kind of systems i.e. mostly on all modern hardware. Now we also have terribly performing PostgreSQL on 8-core server. We noticed the slowdown after moving PostgreSQL from 2xXeon 3.0 Apache+PostgreSQL server to dedicated PostgreSQL server. I collected some stats (see attach) before moving to Linux. With best regards, Alexey Popov --------------040700030907080801060805 Content-Type: text/plain; name="stats-psql-8core.txt" Content-Transfer-Encoding: 7bit Content-Disposition: inline; filename="stats-psql-8core.txt" last pid: 58755; load averages: 26.42, 20.88, 14.00 up 25+22:12:42 11:51:11 84 processes: 29 running, 55 sleeping CPU states: % user, % nice, % system, % interrupt, % idle Mem: 1149M Active, 1971M Inact, 464M Wired, 120M Cache, 214M Buf, 161M Free Swap: 2048M Total, 72K Used, 2048M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 58541 pgsql 1 -4 0 1068M 655M semwai 5 0:17 27.08% postgres 58664 pgsql 1 4 0 1068M 458M sblock 0 0:05 25.49% postgres 58677 pgsql 1 129 0 1067M 291M RUN 2 0:04 24.55% postgres 58713 pgsql 1 130 0 1067M 210M RUN 5 0:03 23.99% postgres 58705 pgsql 1 130 0 1069M 214M CPU7 4 0:03 23.03% postgres 58679 pgsql 1 129 0 1068M 306M RUN 1 0:04 22.45% postgres 58724 pgsql 1 130 0 1068M 179M RUN 4 0:02 22.19% postgres 58698 pgsql 1 129 0 1068M 238M RUN 0 0:03 22.19% postgres 58715 pgsql 1 130 0 1068M 188M RUN 0 0:02 21.68% postgres 58727 pgsql 1 131 0 1069M 119M RUN 1 0:01 20.15% postgres 58658 pgsql 1 125 0 1069M 304M CPU0 0 0:03 19.99% postgres 58728 pgsql 1 131 0 1068M 104M RUN 3 0:01 19.57% postgres 58726 pgsql 1 -4 0 1067M 140M semwai 6 0:01 18.83% postgres 58730 pgsql 1 131 0 1067M 96504K RUN 2 0:01 17.42% postgres 58695 pgsql 1 128 0 1069M 194M RUN 0 0:02 16.37% postgres 58731 pgsql 1 131 0 1068M 57016K CPU2 4 0:01 14.77% postgres 58737 pgsql 1 131 0 1067M 53680K RUN 3 0:01 13.45% postgres 58738 pgsql 1 131 0 1067M 50508K RUN 4 0:00 13.45% postgres 58743 pgsql 1 131 0 1067M 29588K CPU4 2 0:00 9.74% postgres 58712 pgsql 1 -4 0 1069M 60488K semwai 6 0:01 9.57% postgres 58733 pgsql 1 131 0 1068M 42968K RUN 6 0:00 8.61% postgres 58742 pgsql 1 131 0 1067M 27284K RUN 1 0:00 6.65% postgres 58740 pgsql 1 131 0 1067M 20096K RUN 7 0:00 5.60% postgres 58736 pgsql 1 -4 0 1067M 26164K semwai 6 0:00 5.38% postgres 58734 pgsql 1 130 0 1068M 33496K RUN 7 0:00 4.04% postgres 58741 pgsql 1 4 0 1067M 23308K sbwait 7 0:00 3.85% postgres 58735 pgsql 1 -4 0 1067M 26152K semwai 5 0:00 3.50% postgres 47990 pgsql 1 132 0 1066M 4300K select 6 163:53 1.51% postgres 58750 pgsql 1 131 0 1067M 6816K RUN 5 0:00 1.00% postgres 58751 pgsql 1 131 0 1067M 6368K RUN 6 0:00 1.00% postgres 58748 pgsql 1 131 0 1067M 6456K CPU6 6 0:00 1.00% postgres 58732 pgsql 1 4 0 1067M 6772K sbwait 4 0:00 0.88% postgres 58744 pgsql 1 -4 0 1067M 10956K semwai 6 0:00 0.51% postgres 58745 pgsql 1 4 0 1067M 6804K sbwait 1 0:00 0.51% postgres 2 users Load 27.56 21.69 14.53 Dec 3 11:51 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 1272944 6956 1373904 10528 156944 count All 1516224 8576 5907668 18076 pages Proc: Interrupts r p d s w Csw Trp Sys Int Sof Flt 222 cow 16147 total 38 46 50 9210 29k 2349 1313 223 28k 3475 zfod atkbd0 1 3449 ozfod ata0 irq14 75.9%Sys 0.4%Intr 21.3%User 0.0%Nice 2.4%Idle 99%ozfod 161 em0 mfi0 1 | | | | | | | | | | | daefr 1999 cpu0: time ======================================>>>>>>>>>>> 1893 prcfr 1999 cpu1: time 282 dtbuf 4131 totfr 1998 cpu2: time Namei Name-cache Dir-cache 100000 desvn react 1998 cpu3: time Calls hits % hits % 6850 numvn pdwak 1995 cpu4: time 447 439 98 5474 frevn pdpgs 2000 cpu7: time 20 intrn 1996 cpu5: time Disks mfid0 502808 wire 2001 cpu6: time KB/t 113 1274232 act tps 26 2017344 inact MB/s 2.85 122864 cache %busy 2 39272 free 219632 buf %vmstat 1 procs memory page disk faults cpu r b w avm fre flt re pi po fr sr mf0 in sy cs us sy id 1 2 0 1141400 370652 1762 0 0 0 670 0 0 1184 602 1007 6 11 84 3 5 0 1147876 365412 30021 0 0 0 3867 0 8 1407 2393 5490 4 6 91 1 0 0 1141628 370788 28359 0 0 0 10891 0 4 1303 1771 5241 14 6 81 2 0 0 1152000 361456 37957 0 0 0 2057 0 2 1204 1325 4791 11 12 78 1 0 0 1149292 363388 25155 0 0 0 4254 0 1 1182 1259 4712 10 5 85 0 0 0 1138188 373212 17983 0 0 0 6909 0 5 1341 2058 5265 4 4 93 3 4 0 1147944 365664 28170 0 0 0 2215 0 5 1235 1636 4875 8 6 86 1 0 0 1144412 367376 38756 0 0 0 4171 0 12 1372 2020 5604 10 16 74 2 0 0 1147844 364192 45418 0 0 0 6197 0 4 1336 2084 5256 9 10 80 2 1 0 1149456 362972 35356 0 0 0 2852 0 4 1234 1432 4942 16 9 75 0 0 0 1141436 369512 30652 0 0 0 7443 0 8 1289 1720 5047 6 8 86 1 1 0 1141628 370820 22387 0 0 0 2351 0 0 1161 1076 4660 10 4 86 ^C --------------040700030907080801060805--