From owner-freebsd-smp@FreeBSD.ORG Mon Feb 13 17:23:31 2006 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D71EC16A422 for ; Mon, 13 Feb 2006 17:23:31 +0000 (GMT) (envelope-from astatech@mail.ru) Received: from f25.mail.ru (f25.mail.ru [194.67.57.151]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2DF5B43D83 for ; Mon, 13 Feb 2006 17:23:20 +0000 (GMT) (envelope-from astatech@mail.ru) Received: from mail by f25.mail.ru with local id 1F8hPz-0005JN-00; Mon, 13 Feb 2006 20:23:19 +0300 Received: from [82.204.131.122] by win.mail.ru with HTTP; Mon, 13 Feb 2006 20:23:19 +0300 From: astatech@mail.ru To: Joseph Koshy Mime-Version: 1.0 X-Mailer: mPOP Web-Mail 2.19 X-Originating-IP: [82.204.131.122] Date: Mon, 13 Feb 2006 20:23:19 +0300 In-Reply-To: <84dead720602081124o651693ccy7920658a54d97e61@mail.gmail.com> Content-Type: text/plain; charset=koi8-r Content-Transfer-Encoding: 8bit Message-Id: Cc: freebsd-smp@freebsd.org Subject: Next iteration X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: astatech@mail.ru List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 13 Feb 2006 17:23:32 -0000 Hi! Sorry for my timeout... I can't start kldstat: root@bsd# kldload hwpmc root@bsd# pmcstat -S k8-bu-cpu-clk-unhalted -O /tmp/logfile pmcstat: ERROR: Initialization of the pmc(3) library failed: No such file or directory What is wrong? What I did: - changed mount uptions to async,noatime. - added to /etc/sysctl.conf vfs.vmiodirenable=1 kern.maxfiles=65536 net.inet.icmp.icmplim=300 kern.ipc.maxsockbuf=2097152 kern.ipc.somaxconn=8192 kern.ipc.maxsockets=16424 net.inet.tcp.rfc1323=1 net.inet.tcp.delayed_ack=0 net.inet.tcp.sendspace=65535 net.inet.tcp.recvspace=65535 net.inet.udp.recvspace=65535 net.inet.udp.maxdgram=57344 net.local.stream.recvspace=65535 net.local.stream.sendspace=65535 vm.exec_map_entries=128 - recompiling mysql with ./configure --prefix=/usr/local/ --without-libedit --without-readline --without-debug --without-bench --enable-thread-safe-client --enable-assembler --with-mysqld-ldflags=-all-static --with-client-ldflags=-all-static --with-extra-charsets=complex --with-named-thread-libs='-lpthread -D_THREAD_SAFE' Throughput improved by 5 times from 30 to 160, but server still have idle cycles. And throughput about 65-70% of Solaris. root@bsd# vmstat 5 99999 procs memory page disks faults cpu r b w avm fre flt re pi po fr sr da0 pa0 in sy cs us sy id 57 7 0 1437664 14685816 15880 0 1 0 15602 0 0 0 751 32946 4527 21 6 73 34 0 0 1414596 14709272 42496 0 0 0 44131 0 17 0 2234 107315 10897 60 15 25 25 18 3 1448772 14681704 45861 0 0 0 44197 0 51 0 2430 128607 14323 59 17 24 115 0 0 1475388 14667744 41516 0 0 0 41086 0 26 0 1893 99250 12311 55 18 27 48 10 2 1468312 14668900 44786 0 0 0 45002 0 21 0 2281 114561 14933 61 15 24 52 0 1 1465544 14663376 36861 0 0 0 36952 0 28 0 2139 106886 13897 51 16 33 40 1 4 1493980 14645444 46600 0 0 0 46322 0 16 0 1986 118531 12362 62 17 22 9 62 0 1433988 14680880 42577 0 0 0 44164 0 26 0 2516 112201 14278 58 15 27 29 22 3 1427156 14686252 41844 0 0 0 42137 0 114 0 2650 100774 12208 53 20 27 61 5 0 1454092 14660264 33276 0 0 0 32187 0 171 0 2345 95594 12969 44 13 43 72 0 0 1464848 14652860 43017 0 0 0 42969 0 13 0 1958 92878 10794 55 20 25 26 14 0 1439668 14668572 47654 0 0 0 48545 0 22 0 2164 122032 12913 60 17 23 60 1 1 1447260 14661812 48921 0 0 0 48618 0 6 0 2308 131291 15413 61 16 23 44 0 0 1464040 14647920 43565 0 0 0 43346 0 25 0 1974 102238 14174 52 17 30 29 1 0 1478040 14641844 48709 0 0 0 48523 0 17 0 2200 108484 10805 61 15 23 51 20 0 1444064 14656948 39772 0 0 0 40836 0 21 0 2223 105965 11112 57 19 23 46 0 0 1448308 14654368 45678 0 0 0 45765 0 13 0 2142 102726 12209 58 15 27 39 9 0 1450852 14646816 45919 0 0 0 46260 0 15 0 2018 113011 12957 59 14 26 89 1 1 1452640 14634792 36423 0 0 0 35692 0 17 0 1987 110922 12942 55 20 24 63 4 0 1442528 14649108 41640 0 0 0 41725 0 17 0 2358 116923 13326 61 14 25 43 0 0 1445940 14647980 47792 0 0 0 48728 0 17 0 2294 113538 13155 59 16 25 50 3 4 1492220 14606172 33088 0 0 0 31201 0 15 0 1771 108095 18050 59 18 23 59 0 1 1437268 14649388 46433 0 0 0 48720 0 16 0 2652 133756 15102 61 16 24 19 2 8 1421944 14656080 40356 0 0 0 40212 0 10 0 1982 113308 15619 61 18 22 root@bsd# top -b -i -s 5 -b -n 50 last pid: 860; load averages: 60.55, 38.98, 20.33 up 0+00:15:38 20:07:14 295 processes: 62 running, 233 sleeping Mem: 823M Active, 56M Inact, 288M Wired, 812K Cache, 214M Buf, 14G Free Swap: 3991M Total, 3991M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 827 mysql 112 20 0 351M 131M kserel 0 8:00 30.13% mysqld 668 nobody 1 4 0 32540K 7928K sbwait 6 0:13 0.73% httpd 625 nobody 1 79 0 33748K 9148K CPU6 7 0:12 0.73% httpd 666 nobody 1 77 0 32640K 8028K RUN 5 0:12 0.73% httpd 655 nobody 1 4 0 33372K 8760K sbwait 4 0:12 0.73% httpd 619 nobody 1 4 0 36348K 10468K sbwait 7 0:12 0.73% httpd 719 nobody 1 4 0 36152K 10272K sbwait 1 0:11 0.73% httpd 687 nobody 1 4 0 35736K 9856K sbwait 2 0:11 0.73% httpd 728 nobody 1 4 0 35580K 9692K sbwait 2 0:11 0.73% httpd 582 nobody 1 -4 0 36368K 10488K RUN 5 0:11 0.73% httpd 710 nobody 1 -4 0 35532K 9644K RUN 5 0:15 0.00% httpd 718 nobody 1 4 0 35484K 9608K sbwait 0 0:14 0.00% httpd 607 nobody 1 -4 0 35788K 9904K RUN 5 0:14 0.00% httpd 610 nobody 1 -4 0 35768K 9888K RUN 5 0:14 0.00% httpd 620 nobody 1 4 0 35488K 9600K sbwait 5 0:14 0.00% httpd 673 nobody 1 -4 0 32800K 8188K RUN 5 0:13 0.00% httpd 709 nobody 1 4 0 35576K 9688K sbwait 6 0:13 0.00% httpd 652 nobody 1 4 0 33432K 8820K sbwait 3 0:13 0.00% httpd 638 nobody 1 4 0 32976K 8372K sbwait 2 0:13 0.00% httpd 616 nobody 1 -4 0 32536K 7932K RUN 5 0:13 0.00% httpd 591 nobody 1 -4 0 33304K 8512K RUN 5 0:13 0.00% httpd 658 nobody 1 4 0 35504K 9628K sbwait 7 0:13 0.00% httpd 589 nobody 1 77 0 35516K 9640K RUN 2 0:13 0.00% httpd 686 nobody 1 4 0 33288K 8684K sbwait 2 0:13 0.00% httpd 617 nobody 1 4 0 33480K 8696K sbwait 6 0:13 0.00% httpd 612 nobody 1 4 0 36212K 10344K sbwait 4 0:13 0.00% httpd 596 nobody 1 4 0 33432K 8816K sbwait 2 0:13 0.00% httpd 593 nobody 1 4 0 36460K 10580K sbwait 0 0:13 0.00% httpd 720 nobody 1 -4 0 36448K 10564K RUN 5 0:13 0.00% httpd 724 nobody 1 4 0 35768K 9892K sbwait 2 0:13 0.00% httpd 676 nobody 1 77 0 35748K 9868K RUN 0 0:13 0.00% httpd 688 nobody 1 4 0 35604K 9720K sbwait 2 0:13 0.00% httpd 665 nobody 1 4 0 33320K 8528K sbwait 5 0:13 0.00% httpd 670 nobody 1 -4 0 35576K 9700K RUN 5 0:13 0.00% httpd 650 nobody 1 -4 0 33480K 8688K RUN 5 0:13 0.00% httpd 600 nobody 1 4 0 35836K 9956K sbwait 6 0:13 0.00% httpd 662 nobody 1 -4 0 33140K 8532K RUN 2 0:13 0.00% httpd 583 nobody 1 -4 0 35760K 9880K RUN 5 0:13 0.00% httpd 590 nobody 1 4 0 35600K 9724K sbwait 2 0:13 0.00% httpd 706 nobody 1 4 0 32440K 7832K sbwait 6 0:13 0.00% httpd 643 nobody 1 -4 0 33252K 8640K RUN 5 0:12 0.00% httpd 622 nobody 1 4 0 35548K 9660K sbwait 0 0:12 0.00% httpd 641 nobody 1 78 0 32704K 8068K CPU3 5 0:12 0.00% httpd 621 nobody 1 4 0 32432K 7820K sbwait 6 0:12 0.00% httpd 671 nobody 1 4 0 32604K 7992K sbwait 7 0:12 0.00% httpd 672 nobody 1 4 0 36064K 10180K sbwait 6 0:12 0.00% httpd 704 nobody 1 4 0 36400K 10524K sbwait 2 0:12 0.00% httpd 680 nobody 1 -4 0 33344K 8560K RUN 5 0:12 0.00% httpd 627 nobody 1 4 0 32604K 8000K sbwait 6 0:12 0.00% httpd 729 nobody 1 4 0 33172K 8556K sbwait 7 0:12 0.00% httpd From owner-freebsd-smp@FreeBSD.ORG Fri Feb 17 15:32:51 2006 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0BE7616A420 for ; Fri, 17 Feb 2006 15:32:51 +0000 (GMT) (envelope-from hsoftdev17@gmail.com) Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.195]) by mx1.FreeBSD.org (Postfix) with ESMTP id 757AA43D72 for ; Fri, 17 Feb 2006 15:32:47 +0000 (GMT) (envelope-from hsoftdev17@gmail.com) Received: by wproxy.gmail.com with SMTP id i14so160359wra for ; Fri, 17 Feb 2006 07:32:46 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=qfaFkCfyTdTAe3UVNNZAMXwGzBDID5GLWtDOxRx6PIscxhFzz2GnAiHEHYs+y737HRc1Mp8kSlCwazEILgERQ/w1IUG513OmEjVt1y5ruir9Wv8VniRiAH1VmDbdXT8LE7TwS6MYwOr7B7BfxZFkzFuem+XFFA2k9Hn8DinJTgs= Received: by 10.54.149.8 with SMTP id w8mr1180556wrd; Fri, 17 Feb 2006 07:32:42 -0800 (PST) Received: by 10.54.132.9 with HTTP; Fri, 17 Feb 2006 07:32:42 -0800 (PST) Message-ID: <6845d25a0602170732p4b982120r9b0bec7431fa6029@mail.gmail.com> Date: Fri, 17 Feb 2006 10:32:42 -0500 From: Dave Stephens To: freebsd-smp@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Subject: HT/SMP Question (FreeBSD 6.0) X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Feb 2006 15:32:51 -0000 I've upgraded my web server's CPU to one with HT and I was curious about the current state of affairs with HT compatibility and speed under FreeBSD 6.0. I've followed the SMP lists for some time and honestly I've lost track on whether it's a good thing to enable SMP in my kernel or not and whether there are special options for HT in the kernel config. Sorry this is so vague, I'm not having a problem as I'm running my custom kernel with HT/SMP disabled for now. In my searches the consensus seems to be that if you don't have 2 real cores don't bother with SMP and I want to confirm that is still the case. Any info anyone can offer would be greatly appreciated! Thanks! From owner-freebsd-smp@FreeBSD.ORG Fri Feb 17 15:51:06 2006 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0947716A420 for ; Fri, 17 Feb 2006 15:51:06 +0000 (GMT) (envelope-from elessar@bsdforen.de) Received: from postfix.bsdforen.de (bsdforen.de [212.204.60.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 71D8F43D45 for ; Fri, 17 Feb 2006 15:51:05 +0000 (GMT) (envelope-from elessar@bsdforen.de) Received: by postfix.bsdforen.de (Postfix, from userid 20000) id 9187F6844BA; Fri, 17 Feb 2006 16:51:04 +0100 (CET) Received: from localhost (postfix [127.0.0.3]) by postfix.bsdforen.de (Postfix) with ESMTP id A28C46844B7 for ; Fri, 17 Feb 2006 16:51:03 +0100 (CET) Received: from postfix.bsdforen.de ([127.0.0.3]) by localhost (postfix.bsdforen.de [127.0.0.3]) (amavisd-new, port 10024) with LMTP id 33106-04 for ; Fri, 17 Feb 2006 16:51:03 +0100 (CET) Received: from loki (p549CFDF8.dip.t-dialin.net [84.156.253.248]) by postfix.bsdforen.de (Postfix) with ESMTP id 557146844B6 for ; Fri, 17 Feb 2006 16:51:00 +0100 (CET) Date: Fri, 17 Feb 2006 16:50:39 +0100 From: Joerg Pernfuss To: freebsd-smp@freebsd.org Message-ID: <20060217165039.79879ad6@loki> In-Reply-To: <6845d25a0602170732p4b982120r9b0bec7431fa6029@mail.gmail.com> References: <6845d25a0602170732p4b982120r9b0bec7431fa6029@mail.gmail.com> X-Mailer: Sylpheed-Claws 1.9.100 (GTK+ 2.8.9; i386-portbld-freebsd6.0) Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_vh_3HvhcZY1=sTjCj.SuuaF"; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Virus-Scanned: amavisd-new at bsdforen.de X-DSPAM-Result: Innocent X-DSPAM-Confidence: 0.9997 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 43f5f0e8358406023667501 X-DSPAM-User: global Subject: Re: HT/SMP Question (FreeBSD 6.0) X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 17 Feb 2006 15:51:06 -0000 --Sig_vh_3HvhcZY1=sTjCj.SuuaF Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Fri, 17 Feb 2006 10:32:42 -0500 Dave Stephens wrote: > I've upgraded my web server's CPU to one with HT and I was curious > about the current state of affairs with HT compatibility and speed > under FreeBSD 6.0. I've followed the SMP lists for some time and > honestly I've lost track on whether it's a good thing to enable SMP in > my kernel or not and whether there are special options for HT in the > kernel config. >=20 > Sorry this is so vague, I'm not having a problem as I'm running my > custom kernel with HT/SMP disabled for now. In my searches the > consensus seems to be that if you don't have 2 real cores don't bother > with SMP and I want to confirm that is still the case. Any info > anyone can offer would be greatly appreciated! Thanks! The best advice I can give you is that I can't give you advice. Varous combinations of HT enabled/disabled and SCHED_4BSD/ULE give (in some cases very) different results on different hardware and different workloads. If you have the time, motivation and a suitable testcase you can check what works best for you. In the majority of cases this seems to be HT disabled/SCHED_4BSD though. Regards, Joerg --=20 | /"\ ASCII ribbon | GnuPG Key ID | e86d b753 3deb e749 6c3a | | \ / campaign against | 0xbbcaad24 | 5706 1f7d 6cfd bbca ad24 | | X HTML in email | Now featuring a brand new GPG-Key! | | / \ and news | Please update your keyring. | --Sig_vh_3HvhcZY1=sTjCj.SuuaF Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFD9fDYH31s/bvKrSQRAl0BAJwL+EGCx7f18Ef1fZy1LvszD/cFjwCeIJuc 6b4ssS9FSvq1d9kFkiFWgu4= =eMpc -----END PGP SIGNATURE----- --Sig_vh_3HvhcZY1=sTjCj.SuuaF--