From owner-freebsd-smp@FreeBSD.ORG Sun Apr 22 22:33:50 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5B87F16A401 for ; Sun, 22 Apr 2007 22:33:50 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep9.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id 36AD813C484 for ; Sun, 22 Apr 2007 22:33:50 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep9.cogeco.net (Postfix) with ESMTP id 74CF83D7 for ; Sun, 22 Apr 2007 18:14:26 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 22 Apr 2007 18:14:38 -0400 To: freebsd-smp@freebsd.org From: Paul Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070422221426.74CF83D7@fep9.cogeco.net> Subject: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 22:33:50 -0000 Hello, My system is being killed by a system cpu always between 50-70% on Freebsd 6.2 with SMP enabled. Does anyone know of a quick tool to be able to tell me what is making up that 50-70% for the System Cup Usage. They system is a dual core dual intel xeon with a s5000pal setup and on the amd64 6.2 stable smp enabled. They system sees all "4" cpus. I have a hunch that the memory drive is causing this. I set up a memory drive to hold the amavisd-new temp files and set it to be 4gig (the system has 16 gigs of ram) mdmfs -s 4096m -p 0750 -w vscan:vscan md /var/amavis /dev/md0 3.9G 12M 3.5G 0% /var/amavis I wanted to see if I can confirm what part of the system is taking so much cpu power but have struck out so far in trying to figure this out. I need to use the memory drive to save the I/O on the scanning of the email files. This was a suggested solution to remove bottlenecks. last pid: 5541; load averages: 25.22, 21.62, 19.24 up 0+13:54:07 18:13:40 348 processes: 19 running, 317 sleeping, 12 zombie CPU states: 23.7% user, 1.4% nice, 69.9% system, 5.0% interrupt, 0.0% idle Mem: 1010M Active, 4940M Inact, 347M Wired, 4K Cache, 214M Buf, 9367M Free Swap: 8192M Total, 8192M Free Any tips and tools would be greatly appreciated on how to get a handle on what is causing this problem. Thanks Paul From owner-freebsd-smp@FreeBSD.ORG Sun Apr 22 22:41:58 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CB54616A404 for ; Sun, 22 Apr 2007 22:41:58 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id BA2C213C46E for ; Sun, 22 Apr 2007 22:41:58 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 030121A4DB0; Sun, 22 Apr 2007 15:42:20 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id CEFF751406; Sun, 22 Apr 2007 18:41:57 -0400 (EDT) Date: Sun, 22 Apr 2007 18:41:57 -0400 From: Kris Kennaway To: Paul Message-ID: <20070422224157.GA63390@xor.obsecurity.org> References: <20070422221426.74CF83D7@fep9.cogeco.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070422221426.74CF83D7@fep9.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 22:41:58 -0000 On Sun, Apr 22, 2007 at 06:14:38PM -0400, Paul wrote: > Hello, > > My system is being killed by a system cpu always between 50-70% on > Freebsd 6.2 with SMP enabled. Does anyone know of a quick tool to be > able to tell me what is making up that 50-70% for the System Cup Usage. > > They system is a dual core dual intel xeon with a s5000pal setup and > on the amd64 6.2 stable smp enabled. They system sees all "4" cpus. > > I have a hunch that the memory drive is causing this. I set up a > memory drive to hold the amavisd-new temp files and set it to be 4gig > (the system has 16 gigs of ram) > > mdmfs -s 4096m -p 0750 -w vscan:vscan md /var/amavis > > /dev/md0 3.9G 12M 3.5G 0% /var/amavis > > I wanted to see if I can confirm what part of the system is taking so > much cpu power but have struck out so far in trying to figure this > out. I need to use the memory drive to save the I/O on the scanning > of the email files. This was a suggested solution to remove bottlenecks. > > last pid: 5541; load averages: 25.22, 21.62, > 19.24 up > 0+13:54:07 18:13:40 > 348 processes: 19 running, 317 sleeping, 12 zombie > CPU states: 23.7% user, 1.4% nice, 69.9% system, 5.0% interrupt, 0.0% > idle > Mem: 1010M Active, 4940M Inact, 347M Wired, 4K Cache, 214M Buf, 9367M Free > Swap: 8192M Total, 8192M Free > > Any tips and tools would be greatly appreciated on how to get a > handle on what is causing this problem. Uh you had the right idea but forgot to paste the relevant bits ;-) top *is* the tool for working out what processes are using your CPU. Although your high load average suggests that your system is just heavily loaded and it is expected that it will be using 100% CPU. Kris From owner-freebsd-smp@FreeBSD.ORG Sun Apr 22 23:08:31 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 046DF16A402 for ; Sun, 22 Apr 2007 23:08:31 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id E359913C45B for ; Sun, 22 Apr 2007 23:08:30 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id E5DAE1A4DB0; Sun, 22 Apr 2007 16:08:51 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id C129B51451; Sun, 22 Apr 2007 19:08:28 -0400 (EDT) Date: Sun, 22 Apr 2007 19:08:28 -0400 From: Kris Kennaway To: Christopher Arnold Message-ID: <20070422230828.GA63807@xor.obsecurity.org> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="82I3+IH0IqGh5yIs" Content-Disposition: inline In-Reply-To: <20070423010224.C16984@chrishome.localnet> User-Agent: Mutt/1.4.2.2i Cc: Paul , freebsd-smp@freebsd.org, Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 23:08:31 -0000 --82I3+IH0IqGh5yIs Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 01:04:00AM +0200, Christopher Arnold wrote: >=20 >=20 > On Sun, 22 Apr 2007, Kris Kennaway wrote: >=20 > >On Sun, Apr 22, 2007 at 06:14:38PM -0400, Paul wrote: > >>My system is being killed by a system cpu always between 50-70% on > >>Freebsd 6.2 with SMP enabled. Does anyone know of a quick tool to be > >>able to tell me what is making up that 50-70% for the System Cup Usage. > >> > >Uh you had the right idea but forgot to paste the relevant bits ;-) > > > >top *is* the tool for working out what processes are using your CPU. > >Although your high load average suggests that your system is just > >heavily loaded and it is expected that it will be using 100% CPU. > > > Maybe Paul havn't found "S" in top? >=20 > Enter "S" when runing top (to show system processes) and you might find= =20 > out more about whats going on. I wonder if his md filesystem is also using a silly option like soft updates, which was the default at some point (should be using async). Kris --82I3+IH0IqGh5yIs Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGK+rsWry0BWjoQKURAr6aAKCRp6n92WyLP2aXELfibtdZnWKZEQCgqWpi IRMp+e60aFjAUCnDfsnEPxo= =pWn4 -----END PGP SIGNATURE----- --82I3+IH0IqGh5yIs-- From owner-freebsd-smp@FreeBSD.ORG Sun Apr 22 23:26:42 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8EF1C16A401 for ; Sun, 22 Apr 2007 23:26:42 +0000 (UTC) (envelope-from chris@arnold.se) Received: from av8-2-sn3.vrr.skanova.net (av8-2-sn3.vrr.skanova.net [81.228.9.184]) by mx1.freebsd.org (Postfix) with ESMTP id 46D2513C458 for ; Sun, 22 Apr 2007 23:26:42 +0000 (UTC) (envelope-from chris@arnold.se) Received: by av8-2-sn3.vrr.skanova.net (Postfix, from userid 502) id 36CE738454; Mon, 23 Apr 2007 01:04:04 +0200 (CEST) Received: from smtp3-1-sn3.vrr.skanova.net (smtp3-1-sn3.vrr.skanova.net [81.228.9.101]) by av8-2-sn3.vrr.skanova.net (Postfix) with ESMTP id E28C038431; Mon, 23 Apr 2007 01:04:03 +0200 (CEST) Received: from chrishome.localnet (81-224-156-16-o1033.telia.com [81.224.156.16]) by smtp3-1-sn3.vrr.skanova.net (Postfix) with ESMTP id BCB8D37E44; Mon, 23 Apr 2007 01:04:03 +0200 (CEST) Received: from localhost (localhost [127.0.0.1]) by chrishome.localnet (8.13.8/8.13.8) with ESMTP id l3MN40rM017028; Mon, 23 Apr 2007 01:04:01 +0200 (CEST) (envelope-from chris@arnold.se) Date: Mon, 23 Apr 2007 01:04:00 +0200 (CEST) From: Christopher Arnold X-X-Sender: chris@chrishome.localnet To: Kris Kennaway In-Reply-To: <20070422224157.GA63390@xor.obsecurity.org> Message-ID: <20070423010224.C16984@chrishome.localnet> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> X-message-flag: =?ISO-8859-1?Q?Outlook_isn=B4t_compliant_with_current_standards?= =?ISO-8859-1?Q?_please_install_another_mail_client!?= MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Paul , freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 23:26:42 -0000 On Sun, 22 Apr 2007, Kris Kennaway wrote: > On Sun, Apr 22, 2007 at 06:14:38PM -0400, Paul wrote: >> My system is being killed by a system cpu always between 50-70% on >> Freebsd 6.2 with SMP enabled. Does anyone know of a quick tool to be >> able to tell me what is making up that 50-70% for the System Cup Usage. >> > Uh you had the right idea but forgot to paste the relevant bits ;-) > > top *is* the tool for working out what processes are using your CPU. > Although your high load average suggests that your system is just > heavily loaded and it is expected that it will be using 100% CPU. > Maybe Paul havn't found "S" in top? Enter "S" when runing top (to show system processes) and you might find out more about whats going on. /Chris From owner-freebsd-smp@FreeBSD.ORG Sun Apr 22 23:40:30 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A328816A40B for ; Sun, 22 Apr 2007 23:40:30 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep7.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 7EBE013C459 for ; Sun, 22 Apr 2007 23:40:30 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep7.cogeco.net (Postfix) with ESMTP id 575EA5D7 for ; Sun, 22 Apr 2007 18:52:46 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 22 Apr 2007 18:52:59 -0400 To: freebsd-smp@freebsd.org From: Paul Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070422225246.575EA5D7@fep7.cogeco.net> Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Apr 2007 23:40:30 -0000 > >Uh you had the right idea but forgot to paste the relevant bits ;-) > >top *is* the tool for working out what processes are using your CPU. >Although your high load average suggests that your system is just >heavily loaded and it is expected that it will be using 100% CPU. > >Kris Dear Kris, Thanks for your e-mail. The odd thing is that I just switched from an old 4.12 box with dual xeon (only 2 processors) with 4 gb of ram to the 6.2 with the extra ram and dual core dual zeons (technically twice the cpus:) and 4* the ram.... This one is dying and the other older "so called slower" system works much better with as close to the same configuration as I can make it. I have to assume something is wrong here but I will keep digging as this is not even workable. The system cpu is still high if I get rid of the memory drive and have it save on the disks. It takes a lifetime to build a kernel now... Any way I can view what is made up of the 50-70% system cpu to be able to pinpoint the bottleneck? I have tried to trim down the ipfw rules to see if this was the culprit but this does not seem to be making a difference so far. Thanks Paul From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 00:07:22 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 78C8416A401 for ; Mon, 23 Apr 2007 00:07:22 +0000 (UTC) (envelope-from max@love2party.net) Received: from moutng.kundenserver.de (moutng.kundenserver.de [212.227.126.187]) by mx1.freebsd.org (Postfix) with ESMTP id 0D2A213C448 for ; Mon, 23 Apr 2007 00:07:22 +0000 (UTC) (envelope-from max@love2party.net) Received: from [88.64.176.200] (helo=amd64.laiers.local) by mrelayeu.kundenserver.de (node=mrelayeu7) with ESMTP (Nemesis), id 0ML2xA-1Hflsm3Mld-0007hr; Mon, 23 Apr 2007 01:54:16 +0200 From: Max Laier Organization: FreeBSD To: freebsd-smp@freebsd.org Date: Mon, 23 Apr 2007 01:54:10 +0200 User-Agent: KMail/1.9.5 References: <20070422225246.575EA5D7@fep7.cogeco.net> In-Reply-To: <20070422225246.575EA5D7@fep7.cogeco.net> X-Face: ,,8R(x[kmU]tKN@>gtH1yQE4aslGdu+2]; R]*pL,U>^H?)gW@49@wdJ`H<=?utf-8?q?=25=7D*=5FBD=0A=09U=5For=3D=5CmOZf764=26nYj=3DJYbR1PW0ud?=>|!~,,CPC.1-D$FG@0h3#'5"k{V]a~.<=?utf-8?q?mZ=7D44=23Se=7Em=0A=09Fe=7E=5C=5DX5B=5D=5Fxj?=(ykz9QKMw_l0C2AQ]}Ym8)fU MIME-Version: 1.0 Content-Type: multipart/signed; boundary="nextPart7548206.CTLQcQmGoc"; protocol="application/pgp-signature"; micalg=pgp-sha1 Content-Transfer-Encoding: 7bit Message-Id: <200704230154.15703.max@love2party.net> X-Provags-ID: V01U2FsdGVkX19UqXfFv/iuDueLWxxd+P7UuNwSztuAdsHZwfE E4TgMXyRmh40Q+a4C2vtIssziSn/ZtrdNgjU7dWbrvdpJVeFSM qR+LU+ycFRmR13bklnoug== Cc: Paul Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 00:07:22 -0000 --nextPart7548206.CTLQcQmGoc Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline On Monday 23 April 2007 00:52, Paul wrote: > >Uh you had the right idea but forgot to paste the relevant bits ;-) > > > >top *is* the tool for working out what processes are using your CPU. > >Although your high load average suggests that your system is just > >heavily loaded and it is expected that it will be using 100% CPU. > > > >Kris > > Dear Kris, > > Thanks for your e-mail. > > The odd thing is that I just switched from an old 4.12 box with dual > xeon (only 2 processors) with 4 gb of ram to the 6.2 with the extra > ram and dual core dual zeons (technically twice the cpus:) and 4* the > ram.... > > This one is dying and the other older "so called slower" system works > much better with as close to the same configuration as I can make it. > > I have to assume something is wrong here but I will keep digging as > this is not even workable. > > The system cpu is still high if I get rid of the memory drive and > have it save on the disks. It takes a lifetime to build a kernel now... > > Any way I can view what is made up of the 50-70% system cpu to be > able to pinpoint the bottleneck? > > I have tried to trim down the ipfw rules to see if this was the > culprit but this does not seem to be making a difference so far. "vmstat -i" could help to rule out interrupt storms. "top -S" will show=20 in-kernel threads as will "systat". Maybe these help. =2D-=20 /"\ Best regards, | mlaier@freebsd.org \ / Max Laier | ICQ #67774661 X http://pf4freebsd.love2party.net/ | mlaier@EFnet / \ ASCII Ribbon Campaign | Against HTML Mail and News --nextPart7548206.CTLQcQmGoc Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQBGK/WnXyyEoT62BG0RAtsmAJ0WeSuj/NYXspxzNAzd9mSXwMJAMgCfVWDm qax9sOpXL0RX8ATGfXGkDrs= =uAdU -----END PGP SIGNATURE----- --nextPart7548206.CTLQcQmGoc-- From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 00:41:06 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7858F16A402 for ; Mon, 23 Apr 2007 00:41:06 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep7.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 4AB4413C458 for ; Mon, 23 Apr 2007 00:41:06 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep7.cogeco.net (Postfix) with ESMTP id 7984082E for ; Sun, 22 Apr 2007 20:41:05 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 22 Apr 2007 20:41:18 -0400 To: freebsd-smp@freebsd.org From: Paul In-Reply-To: <20070423010224.C16984@chrishome.localnet> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423004105.7984082E@fep7.cogeco.net> Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 00:41:06 -0000 Dear Gentlemen, Thank you very much for your help so far. I was certainly looking for the "S" option. When you are tired these things are easy to miss. Here is an output of the system with the md driver removed and everything is on the hard drive for now. The system usage is still really high. Does anyone have any suggestions based on the output below? Thanks Paul last pid: 36756; load averages: 8.74, 9.74, 10.40 up 0+16:08:41 20:28:14 279 processes: 15 running, 241 sleeping, 21 waiting, 2 lock CPU states: 11.9% user, 0.4% nice, 80.6% system, 6.9% interrupt, 0.2% idle Mem: 1732M Active, 5146M Inact, 354M Wired, 48K Cache, 214M Buf, 8432M Free Swap: 8192M Total, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME CPU COMMAND 44 root 1 171 52 0K 16K CPU2 3 67:25 60.40% pagezero 13 root 1 171 52 0K 16K RUN 0 94:38 17.09% idle: cpu0 10 root 1 171 52 0K 16K RUN 3 92:38 15.19% idle: cpu3 36391 vscan 1 20 0 121M 80732K lockf 0 0:04 12.35% perl5.8.8 36705 user1 1 131 0 15792K 3352K RUN 3 0:03 11.67% imapd 36301 vscan 1 20 0 122M 81896K lockf 1 0:09 10.79% perl5.8.8 36180 vscan 1 20 0 125M 84988K lockf 1 0:17 10.01% perl5.8.8 36266 vscan 1 20 0 126M 84964K lockf 0 0:10 8.89% perl5.8.8 14 root 1 -44 -163 0K 16K WAIT 3 99:21 7.57% swi1: net 15 root 1 -32 -151 0K 16K WAIT 0 93:54 7.47% swi4: clock sio 1211 bind 1 101 0 74372K 71180K select 0 108:51 7.37% named 12 root 1 171 52 0K 16K RUN 1 71:18 6.93% idle: cpu1 36731 user2 1 130 0 15648K 3228K CPU3 0 0:02 6.54% imapd 94452 nobody 1 20 0 144M 38836K lockf 1 0:17 5.76% httpd 35798 vscan 1 20 0 127M 86464K lockf 0 0:25 5.08% perl5.8.8 11 root 1 171 52 0K 16K RUN 2 61:38 4.64% idle: cpu2 36405 root 1 100 0 7416K 2680K CPU0 0 0:02 3.61% top 94286 nobody 1 98 0 142M 36928K select 0 0:11 3.32% httpd 36337 user3 1 4 0 10768K 2968K sbwait 3 0:03 3.08% qpopper 47 root 1 20 0 0K 16K syncer 0 50:27 2.83% syncer 94448 nobody 1 20 0 148M 43092K lockf 1 0:45 2.69% httpd 24 root 1 -68 -187 0K 16K WAIT 3 31:51 2.64% irq17: em0 25 root 1 -68 -187 0K 16K WAIT 0 47:22 2.59% irq18: em1 em2 3554 vscan 2 99 0 104M 93616K ucond 3 11:59 2.39% clamd 5028 nobody 1 98 0 144M 38840K select 0 0:11 2.34% httpd 7187 root 1 131 0 9656K 4016K RUN 3 3:59 2.25% sendmail 36179 vscan 1 103 0 126M 85340K select 0 0:12 2.20% perl5.8.8 1582 root 1 130 0 5868K 1536K allpro 3 9:36 1.32% inetd 45382 root 1 97 0 3688K 1308K select 0 8:30 1.32% syslogd >>>My system is being killed by a system cpu always between 50-70% on >>>Freebsd 6.2 with SMP enabled. Does anyone know of a quick tool to be >>>able to tell me what is making up that 50-70% for the System Cup Usage. >>Uh you had the right idea but forgot to paste the relevant bits ;-) >> >>top *is* the tool for working out what processes are using your CPU. >>Although your high load average suggests that your system is just >>heavily loaded and it is expected that it will be using 100% CPU. >Maybe Paul havn't found "S" in top? > >Enter "S" when runing top (to show system processes) and you might >find out more about whats going on. > > > /Chris From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 00:58:14 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9144C16A402 for ; Mon, 23 Apr 2007 00:58:14 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep7.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 6CC7513C458 for ; Mon, 23 Apr 2007 00:58:14 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep7.cogeco.net (Postfix) with ESMTP id 890A481D for ; Sun, 22 Apr 2007 20:58:13 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 22 Apr 2007 20:58:26 -0400 To: freebsd-smp@freebsd.org From: Paul In-Reply-To: <200704230154.15703.max@love2party.net> References: <20070422225246.575EA5D7@fep7.cogeco.net> <200704230154.15703.max@love2party.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423005813.890A481D@fep7.cogeco.net> Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 00:58:14 -0000 Dear Max Thanks for the suggestion. Here are the two outputs of vmstat -i exactly 1 minute apart. Can you give me some advice on this please? Thanks again for your assistance, Paul #vmstat -i interrupt total rate irq1: atkbd0 5 0 irq4: sio0 131475 2 irq14: ata0 47 0 irq17: em0 34511122 578 irq18: em1 em2 50301687 842 irq23: uhci0 uhci+ 1 0 irq26: arcmsr0 3542212 59 cpu0: timer 119056370 1994 cpu1: timer 119045265 1993 cpu2: timer 119174164 1996 cpu3: timer 119172877 1996 Total 564935225 9462 # vmstat -i interrupt total rate irq1: atkbd0 5 0 irq4: sio0 131610 2 irq14: ata0 47 0 irq17: em0 34540241 577 irq18: em1 em2 50323254 842 irq23: uhci0 uhci+ 1 0 irq26: arcmsr0 3546230 59 cpu0: timer 119176497 1994 cpu1: timer 119165391 1993 cpu2: timer 119294325 1996 cpu3: timer 119293038 1996 Total 565470639 9461 At 07:54 PM 22/04/2007, Max Laier wrote: >"vmstat -i" could help to rule out interrupt storms. "top -S" will show >in-kernel threads as will "systat". Maybe these help. From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 01:58:50 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 85B0116A40E for ; Mon, 23 Apr 2007 01:58:50 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 1F08413C4C5 for ; Mon, 23 Apr 2007 01:58:49 +0000 (UTC) (envelope-from killing@multiplay.co.uk) X-Spam-Checker-Version: SpamAssassin 3.1.5 (2006-08-29) on core6.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-24.7 required=6.0 tests=BAYES_00, USER_IN_WHITELIST, USER_IN_WHITELIST_TO autolearn=ham version=3.1.5 Received: from r2d2 ([212.135.219.182]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon PRO v9.5.4) with ESMTP id md50003758098.msg for ; Mon, 23 Apr 2007 02:48:25 +0100 Message-ID: <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> From: "Steven Hartland" To: , "Paul" References: <20070422221426.74CF83D7@fep9.cogeco.net><20070422224157.GA63390@xor.obsecurity.org><20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> Date: Mon, 23 Apr 2007 02:47:47 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3028 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 X-MDRemoteIP: 212.135.219.182 X-Return-Path: killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-smp@freebsd.org X-Spam-Processed: multiplay.co.uk, Mon, 23 Apr 2007 02:48:25 +0100 X-MDAV-Processed: multiplay.co.uk, Mon, 23 Apr 2007 02:48:26 +0100 Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 01:58:50 -0000 You might want to try: sysctl vm.idlezero_enable=0 and see if that helps. Steve ----- Original Message ----- From: "Paul" To: Sent: Monday, April 23, 2007 1:41 AM Subject: Re: System Cpu Between 50-70% and need to find out why > Dear Gentlemen, > > Thank you very much for your help so far. I was certainly looking for > the "S" option. When you are tired these things are easy to miss. > > Here is an output of the system with the md driver removed and > everything is on the hard drive for now. The system usage is still really high. > > Does anyone have any suggestions based on the output below? > > last pid: 36756; load averages: 8.74, 9.74, > 10.40 up > 0+16:08:41 20:28:14 > 279 processes: 15 running, 241 sleeping, 21 waiting, 2 lock > CPU states: 11.9% user, 0.4% nice, 80.6% system, 6.9% interrupt, 0.2% idle > Mem: 1732M Active, 5146M Inact, 354M Wired, 48K Cache, 214M Buf, 8432M Free > Swap: 8192M Total, 8192M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME CPU COMMAND > 44 root 1 171 52 0K 16K CPU2 3 67:25 60.40% pagezero ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 02:50:51 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D20FB16A401 for ; Mon, 23 Apr 2007 02:50:51 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep3.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id ADC1B13C468 for ; Mon, 23 Apr 2007 02:50:51 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep3.cogeco.net (Postfix) with ESMTP id 8AC4324A; Sun, 22 Apr 2007 22:50:50 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Sun, 22 Apr 2007 22:51:03 -0400 To: Max Laier ,freebsd-smp@freebsd.org From: Paul In-Reply-To: <200704230154.15703.max@love2party.net> References: <20070422225246.575EA5D7@fep7.cogeco.net> <200704230154.15703.max@love2party.net> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423025050.8AC4324A@fep3.cogeco.net> Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 02:50:51 -0000 Dear Max, Thanks for your reply. It was really appreciated. Here is an output from running: "systat -vmstat 1" based on your suggestion. Below is the result. Does the cpu Interrupts (2000 each for the 1 second period) seem an issue? Thanks Paul Interrupts 8853 total atkbd0 1 10 sio0 irq4 ata0 irq14 468 em0 irq17 329 em1 em2 18 uhci0 uhci 20 arcmsr0 26 2006 cpu0: time 2006 cpu1: time 2007 cpu2: time 2007 cpu3: time 4 users Load 19.21 17.14 13.04 Apr 22 22:41 Mem:KB REAL VIRTUAL VN PAGER SWAP PAGER Tot Share Tot Share Free in out in out Act 1559704 36276 2875420 40580 8088352 count All 2193788 117604 28661808 253912 pages Proc: r p d s w Csw Trp Sys Int Sof Flt 15 201 2 2781 1344 8179 1523 43 1243 65.0%Sys 7.8%Intr 22.5%User 0.7%Nice 4.1%Idle | | | | | | | | | | | =================================+++>>>>>>>>>>>> Disks da0 pass0 pass1 365252 wire KB/t 74.98 0.00 0.00 2010724 act tps 40 0 0 5575792 inact MB/s 2.93 0.00 0.00 1292 cache %busy 60 0 0 8087036 free 219632 buf At 07:54 PM 22/04/2007, Max Laier wrote: >On Monday 23 April 2007 00:52, Paul wrote: > > >Uh you had the right idea but forgot to paste the relevant bits ;-) > > > > > >top *is* the tool for working out what processes are using your CPU. > > >Although your high load average suggests that your system is just > > >heavily loaded and it is expected that it will be using 100% CPU. From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 04:03:19 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 13BEE16A401 for ; Mon, 23 Apr 2007 04:03:19 +0000 (UTC) (envelope-from joseph.koshy@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.180]) by mx1.freebsd.org (Postfix) with ESMTP id ABA8E13C465 for ; Mon, 23 Apr 2007 04:03:18 +0000 (UTC) (envelope-from joseph.koshy@gmail.com) Received: by py-out-1112.google.com with SMTP id f31so1176216pyh for ; Sun, 22 Apr 2007 21:03:17 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=SARcbxR+TPRzrdtfDYgUUxtb8K0Xthd189vyStiFqZeF2D93zesNj+H+MbB345ZXoKpTqJqDU43lL/p0385Aqs/te1WmRvWLNlmijrwRa5AAFyRfwdKyEEmK2UrK7+tqSt8VgkVJ0RzN04CwQ41fD6FC9Xmw3ekogMpF+R3oREs= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=S9wNb74tteeErpdqO+tHqXwraatTwznXWckw33qSRLT4RMRNf7UYGGEjbbd5xMGhGmF92Fc80POh0zE2lk+JRKFMV3Q82nXxL8lXAC6iIVhJCkthycCbEqlsCWXKMWMRTDENB+PSoIF0m+dl4ieRKJTt/0i1/rjq4MEZ2+UDHz0= Received: by 10.65.253.6 with SMTP id f6mr10808512qbs.1177299397543; Sun, 22 Apr 2007 20:36:37 -0700 (PDT) Received: by 10.65.83.17 with HTTP; Sun, 22 Apr 2007 20:36:37 -0700 (PDT) Message-ID: <84dead720704222036i62ad582du46dd4f56f96f6bd1@mail.gmail.com> Date: Mon, 23 Apr 2007 09:06:37 +0530 From: "Joseph Koshy" To: Paul In-Reply-To: <20070423004105.7984082E@fep7.cogeco.net> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 04:03:19 -0000 > The system usage is still really high. Check for short-lived processes that are being spawned at a rapid rate? "top" isn't very good at catching short-lived processes. -- FreeBSD Volunteer, http://people.freebsd.org/~jkoshy From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 13:56:21 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0991A16A403 for ; Mon, 23 Apr 2007 13:56:21 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep9.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id D836C13C459 for ; Mon, 23 Apr 2007 13:56:20 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep9.cogeco.net (Postfix) with ESMTP id D6FB4495; Mon, 23 Apr 2007 09:56:19 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 09:56:33 -0400 To: "Steven Hartland" , From: Paul In-Reply-To: <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423135619.D6FB4495@fep9.cogeco.net> Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 13:56:21 -0000 Dear Steve, Thanks for your suggestion. This did not help unfortunately. Does anyone have any other ideas as I am out of solutions? Thanks Paul At 09:47 PM 22/04/2007, Steven Hartland wrote: >You might want to try: >sysctl vm.idlezero_enable=0 >and see if that helps. > > Steve From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 14:54:10 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 845AE16A402 for ; Mon, 23 Apr 2007 14:54:10 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 20F2A13C483 for ; Mon, 23 Apr 2007 14:54:09 +0000 (UTC) (envelope-from killing@multiplay.co.uk) X-Spam-Checker-Version: SpamAssassin 3.1.5 (2006-08-29) on core6.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-24.7 required=6.0 tests=BAYES_00, USER_IN_WHITELIST, USER_IN_WHITELIST_TO autolearn=ham version=3.1.5 Received: from r2d2 ([212.135.219.182]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon PRO v9.5.4) with ESMTP id md50003760069.msg for ; Mon, 23 Apr 2007 15:51:18 +0100 Message-ID: <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> From: "Steven Hartland" To: , "Paul" References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> Date: Mon, 23 Apr 2007 15:50:49 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3028 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 X-MDRemoteIP: 212.135.219.182 X-Return-Path: killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-smp@freebsd.org X-Spam-Processed: multiplay.co.uk, Mon, 23 Apr 2007 15:51:19 +0100 X-MDAV-Processed: multiplay.co.uk, Mon, 23 Apr 2007 15:51:20 +0100 Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:54:10 -0000 When using that are you still seeing 60% usage for pagezero? It's was my understanding that this sysctl should disable this feature and hence you may be seeing a different picture. Steve ----- Original Message ----- From: "Paul" > > Thanks for your suggestion. This did not help unfortunately. > > Does anyone have any other ideas as I am out of solutions? ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 14:59:57 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B5D6016A402 for ; Mon, 23 Apr 2007 14:59:57 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep1.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id 89D1A13C458 for ; Mon, 23 Apr 2007 14:59:55 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep1.cogeco.net (Postfix) with ESMTP id 8244094A; Mon, 23 Apr 2007 10:59:54 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 11:00:08 -0400 To: "Steven Hartland" , From: Paul In-Reply-To: <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423145954.8244094A@fep1.cogeco.net> Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 14:59:57 -0000 Dear Steve, Unfortunately the problem is the same with it on and off. When I have it off I do not see the pagezero but the problem is still there with the high cpu usage ont he system side. I am grasping at straws now so any advice would be appreciated. I am starting to focus on the areca card (1130d) but this seems to be in range with what is expected. I am a bit puzzled to see this: last pid: 15615; load averages: 46.49, 48.45, 42.60 up 0+09:58:37 10:58:55 680 processes: 76 running, 573 sleeping, 9 zombie, 21 waiting, 1 lock CPU states: 26.8% user, 0.0% nice, 66.2% system, 7.0% interrupt, 0.0% idle Mem: 2328M Active, 5794M Inact, 424M Wired, 20K Cache, 214M Buf, 7116M Free Swap: 8192M Total, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 1 171 52 0K 16K RUN 2 92:45 22.46% idle: cpu2 13 root 1 171 52 0K 16K RUN 0 122:15 22.07% idle: cpu0 12 root 1 171 52 0K 16K RUN 1 100:22 22.02% idle: cpu1 10 root 1 171 52 0K 16K RUN 3 115:02 21.97% idle: cpu3 The idle and system is slow, the system is at 66% system cpu but the itle numbers below show up as 20+% percent. Thanks Paul At 10:50 AM 23/04/2007, Steven Hartland wrote: >When using that are you still seeing 60% usage for pagezero? It's was >my understanding that this sysctl should disable this feature and hence >you may be seeing a different picture. > > Steve From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:09:10 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9F5CD16A403 for ; Mon, 23 Apr 2007 15:09:10 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id 3B12F13C44C for ; Mon, 23 Apr 2007 15:09:09 +0000 (UTC) (envelope-from killing@multiplay.co.uk) X-Spam-Checker-Version: SpamAssassin 3.1.5 (2006-08-29) on core6.multiplay.co.uk X-Spam-Level: X-Spam-Status: No, score=-24.7 required=6.0 tests=BAYES_00, USER_IN_WHITELIST, USER_IN_WHITELIST_TO autolearn=ham version=3.1.5 Received: from r2d2 ([212.135.219.182]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon PRO v9.5.4) with ESMTP id md50003760121.msg for ; Mon, 23 Apr 2007 16:07:26 +0100 Message-ID: <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> From: "Steven Hartland" To: , "Paul" References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> Date: Mon, 23 Apr 2007 16:07:01 +0100 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3028 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 X-MDRemoteIP: 212.135.219.182 X-Return-Path: killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-smp@freebsd.org X-Spam-Processed: multiplay.co.uk, Mon, 23 Apr 2007 16:07:27 +0100 X-MDAV-Processed: multiplay.co.uk, Mon, 23 Apr 2007 16:07:27 +0100 Cc: Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:09:10 -0000 But when disabled does the stats in top show a different picture which might identify the app / component which is causing so much vm work? Steve ----- Original Message ----- From: "Paul" > Unfortunately the problem is the same with it on and off. When I have > it off I do not see the pagezero but the problem is still there with > the high cpu usage ont he system side. ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:27:04 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CADF416A400 for ; Mon, 23 Apr 2007 15:27:04 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep2.cogeco.net (smtp1.cogeco.ca [216.221.81.28]) by mx1.freebsd.org (Postfix) with ESMTP id 9C4D713C45E for ; Mon, 23 Apr 2007 15:27:04 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep2.cogeco.net (Postfix) with ESMTP id 715922D1; Mon, 23 Apr 2007 11:27:03 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 11:27:17 -0400 To: "Steven Hartland" From: Paul In-Reply-To: <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423152703.715922D1@fep2.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:27:05 -0000 Hi Steve, When I shut off everything except apache with very low load and qpopper it is still maxed out. Here is another look with the vm setting off. I don't always see the idle: cpu in the list as it changes constantly. I have a hunch this is disk related but I am not sure. I include two snapshots below Thanks, Paul last pid: 18967; load averages: 29.00, 44.28, 46.39 up 0+10:16:42 11:17:00 308 processes: 41 running, 239 sleeping, 7 zombie, 21 waiting CPU states: 13.3% user, 0.0% nice, 74.5% system, 12.2% interrupt, 0.0% idle Mem: 1204M Active, 5678M Inact, 381M Wired, 20K Cache, 214M Buf, 8398M Free Swap: 8192M Total, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 11 root 1 171 52 0K 16K RUN 2 93:59 22.80% idle: cpu2 10 root 1 171 52 0K 16K RUN 3 116:20 22.46% idle: cpu3 12 root 1 171 52 0K 16K RUN 1 101:36 22.36% idle: cpu1 13 root 1 171 52 0K 16K RUN 0 123:32 22.22% idle: cpu0 18944 root 1 132 0 15944K 5332K RUN 1 0:01 14.99% perl5.8.8 18922 root 1 131 0 15648K 3196K RUN 2 0:01 12.45% imapd 18640 root 1 127 0 7484K 2792K CPU1 0 0:10 11.86% top 18952 root 1 131 0 10536K 1412K RUN 1 0:00 11.30% qpopper 18894 user1 1 127 0 10740K 2948K CPU3 3 0:02 10.21% qpopper 18845 user2 1 -4 0 10740K 2944K getblk 0 0:04 10.14% qpopper 18871 user3 1 126 0 10740K 3008K CPU0 0 0:03 9.48% qpopper 18920 root 1 129 0 15648K 3196K RUN 3 0:01 8.68% imapd 17491 user4 1 123 0 7864K 3168K select 2 0:44 8.54% top 14 root 1 -32 -151 0K 16K WAIT 0 59:32 7.52% swi4: clock sio 18939 root 1 130 0 10740K 2940K RUN 2 0:01 7.10% qpopper 18923 user5 1 128 0 10740K 2948K RUN 2 0:01 7.03% qpopper 48 root 1 -4 0 0K 16K ufs 2 28:03 6.74% syncer 18953 root 1 130 0 10544K 2140K RUN 0 0:00 6.46% qpopper 18935 root 1 130 0 10740K 2944K RUN 2 0:01 6.21% qpopper 18941 user6 1 130 0 10740K 3008K RUN 2 0:01 6.07% qpopper 18956 root 1 131 0 6084K 860K RUN 3 0:00 5.95% qpopper 16 root 1 -44 -163 0K 16K WAIT 0 52:09 5.71% swi1: net 18940 user7 1 129 0 10740K 2944K RUN 0 0:00 5.62% qpopper 18934 root 1 130 0 10740K 2940K RUN 1 0:00 5.47% qpopper 18954 root 1 130 0 10532K 2104K RUN 0 0:00 5.38% qpopper 18949 root 1 130 0 10576K 1424K RUN 0 0:00 5.07% qpopper 18965 root 1 132 0 5844K 1536K RUN 1 0:00 5.00% inetd last pid: 20588; load averages: 47.61, 36.13, 39.78 up 0+10:24:00 11:24:18 531 processes: 93 running, 413 sleeping, 19 zombie, 6 lock CPU states: 19.1% user, 0.0% nice, 74.8% system, 6.1% interrupt, 0.0% idle Mem: 1590M Active, 5795M Inact, 404M Wired, 20K Cache, 214M Buf, 7872M Free Swap: 8192M Total, 8192M Free PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMAND 1375 vscan 3 98 0 65632K 52772K ucond 0 52:18 17.63% clamd 1184 bind 1 125 0 63620K 60408K select 2 60:11 9.42% named 19776 root 1 126 0 8096K 3408K CPU2 0 0:23 7.57% top 20429 user1 1 127 0 10740K 3008K RUN 0 0:03 6.98% qpopper 20424 user2 1 127 0 10740K 3008K RUN 1 0:03 6.81% qpopper 20395 user3 1 127 0 10740K 2944K RUN 2 0:03 6.81% qpopper 20442 user4 1 127 0 10740K 2944K RUN 0 0:03 6.75% qpopper 17491 user5 1 118 0 8184K 3488K RUN 0 1:08 6.74% top 20391 user6 1 127 0 10768K 2972K RUN 2 0:03 6.59% qpopper 19135 vscan 1 128 0 126M 85504K select 2 0:20 5.22% perl5.8.8 19136 vscan 1 127 0 124M 83900K RUN 2 0:20 4.69% perl5.8.8 20476 root 1 127 0 15644K 3188K RUN 3 0:01 4.40% imapd 20478 user7 1 127 0 15648K 3232K RUN 3 0:01 4.40% imapd 20475 root 1 127 0 10024K 4284K RUN 2 0:01 4.33% sendmail 20139 user8 1 127 0 15724K 3288K RUN 2 0:05 4.07% imapd 20499 user9 1 127 0 10740K 2944K RUN 0 0:01 4.00% qpopper 19134 vscan 1 125 0 127M 86256K select 3 0:21 3.91% perl5.8.8 20304 user10 1 4 0 10740K 2948K sbwait 2 0:04 3.86% qpopper 19133 vscan 1 -4 0 123M 83372K RUN 2 0:20 3.86% perl5.8.8 At 11:07 AM 23/04/2007, you wrote: >But when disabled does the stats in top show a different picture which >might identify the app / component which is causing so much vm work? > > Steve From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:33:35 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D78D116A402 for ; Mon, 23 Apr 2007 15:33:35 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id C2CE213C468 for ; Mon, 23 Apr 2007 15:33:35 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id A43931A4DC1; Mon, 23 Apr 2007 08:33:57 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 524545138E; Mon, 23 Apr 2007 11:33:34 -0400 (EDT) Date: Mon, 23 Apr 2007 11:33:34 -0400 From: Kris Kennaway To: Paul Message-ID: <20070423153334.GA530@xor.obsecurity.org> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070423152703.715922D1@fep2.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org, Steven Hartland Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:33:35 -0000 On Mon, Apr 23, 2007 at 11:27:17AM -0400, Paul wrote: > Hi Steve, > > When I shut off everything except apache with very low load and > qpopper it is still maxed out. That does not look like very low load to me. On the contrary, your stats show that 30-40 running processes are being scheduled for running on the 4 CPUs at any one time. Under those circumstances you should expect to see 100% CPU usage (anything less means your system is not being completely used). Can you please confirm what you are using for your diagnosis that there is something wrong with the system performance? Kris > Here is another look with the vm setting off. > > I don't always see the idle: cpu in the list as it changes > constantly. I have a hunch this is disk related but I am not sure. I > include two snapshots below > > Thanks, > > Paul > > last pid: 18967; load averages: 29.00, 44.28, > 46.39 up > 0+10:16:42 11:17:00 > 308 processes: 41 running, 239 sleeping, 7 zombie, 21 waiting > CPU states: 13.3% user, 0.0% nice, 74.5% system, 12.2% interrupt, 0.0% > idle > Mem: 1204M Active, 5678M Inact, 381M Wired, 20K Cache, 214M Buf, 8398M Free > Swap: 8192M Total, 8192M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU > COMMAND > 11 root 1 171 52 0K 16K RUN 2 93:59 > 22.80% idle: cpu2 > 10 root 1 171 52 0K 16K RUN 3 116:20 > 22.46% idle: cpu3 > 12 root 1 171 52 0K 16K RUN 1 101:36 > 22.36% idle: cpu1 > 13 root 1 171 52 0K 16K RUN 0 123:32 > 22.22% idle: cpu0 > 18944 root 1 132 0 15944K 5332K RUN 1 0:01 > 14.99% perl5.8.8 > 18922 root 1 131 0 15648K 3196K RUN 2 0:01 12.45% imapd > 18640 root 1 127 0 7484K 2792K CPU1 0 0:10 11.86% top > 18952 root 1 131 0 10536K 1412K RUN 1 0:00 11.30% > qpopper > 18894 user1 1 127 0 10740K 2948K CPU3 3 0:02 10.21% > qpopper > 18845 user2 1 -4 0 10740K 2944K getblk 0 0:04 10.14% > qpopper > 18871 user3 1 126 0 10740K 3008K CPU0 0 0:03 9.48% > qpopper > 18920 root 1 129 0 15648K 3196K RUN 3 0:01 8.68% imapd > 17491 user4 1 123 0 7864K 3168K select 2 0:44 8.54% top > 14 root 1 -32 -151 0K 16K > WAIT 0 59:32 7.52% swi4: clock sio > 18939 root 1 130 0 10740K 2940K RUN 2 0:01 7.10% > qpopper > 18923 user5 1 128 0 10740K 2948K RUN 2 0:01 7.03% > qpopper > 48 root 1 -4 0 0K 16K ufs 2 28:03 6.74% > syncer > 18953 root 1 130 0 10544K 2140K RUN 0 0:00 6.46% > qpopper > 18935 root 1 130 0 10740K 2944K RUN 2 0:01 6.21% > qpopper > 18941 user6 1 130 0 10740K 3008K RUN 2 0:01 6.07% > qpopper > 18956 root 1 131 0 6084K 860K RUN 3 0:00 5.95% > qpopper > 16 root 1 -44 -163 0K 16K > WAIT 0 52:09 5.71% swi1: net > 18940 user7 1 129 0 10740K 2944K RUN 0 0:00 5.62% > qpopper > 18934 root 1 130 0 10740K 2940K RUN 1 0:00 5.47% > qpopper > 18954 root 1 130 0 10532K 2104K RUN 0 0:00 5.38% > qpopper > 18949 root 1 130 0 10576K 1424K RUN 0 0:00 5.07% > qpopper > 18965 root 1 132 0 5844K 1536K RUN 1 0:00 5.00% inetd > > > last pid: 20588; load averages: 47.61, 36.13, > 39.78 up > 0+10:24:00 11:24:18 > 531 processes: 93 running, 413 sleeping, 19 zombie, 6 lock > CPU states: 19.1% user, 0.0% nice, 74.8% system, 6.1% interrupt, 0.0% > idle > Mem: 1590M Active, 5795M Inact, 404M Wired, 20K Cache, 214M Buf, 7872M Free > Swap: 8192M Total, 8192M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU > COMMAND > 1375 vscan 3 98 0 65632K 52772K ucond 0 52:18 17.63% clamd > 1184 bind 1 125 0 63620K 60408K select 2 60:11 9.42% named > 19776 root 1 126 0 8096K 3408K CPU2 0 0:23 7.57% top > 20429 user1 1 127 0 10740K 3008K RUN 0 0:03 6.98% > qpopper > 20424 user2 1 127 0 10740K 3008K RUN 1 0:03 6.81% > qpopper > 20395 user3 1 127 0 10740K 2944K RUN 2 0:03 6.81% > qpopper > 20442 user4 1 127 0 10740K 2944K RUN 0 0:03 6.75% > qpopper > 17491 user5 1 118 0 8184K 3488K RUN 0 1:08 6.74% top > 20391 user6 1 127 0 10768K 2972K RUN 2 0:03 6.59% > qpopper > 19135 vscan 1 128 0 126M 85504K select > 2 0:20 5.22% perl5.8.8 > 19136 vscan 1 127 0 124M 83900K > RUN 2 0:20 4.69% perl5.8.8 > 20476 root 1 127 0 15644K 3188K RUN 3 0:01 4.40% imapd > 20478 user7 1 127 0 15648K 3232K RUN 3 0:01 4.40% imapd > 20475 root 1 127 0 10024K 4284K RUN 2 0:01 4.33% > sendmail > 20139 user8 1 127 0 15724K 3288K RUN 2 0:05 4.07% imapd > 20499 user9 1 127 0 10740K 2944K RUN 0 0:01 4.00% > qpopper > 19134 vscan 1 125 0 127M 86256K select > 3 0:21 3.91% perl5.8.8 > 20304 user10 1 4 0 10740K 2948K sbwait 2 0:04 3.86% > qpopper > 19133 vscan 1 -4 0 123M 83372K > RUN 2 0:20 3.86% perl5.8.8 > > > > > At 11:07 AM 23/04/2007, you wrote: > >But when disabled does the stats in top show a different picture which > >might identify the app / component which is causing so much vm work? > > > > Steve > > _______________________________________________ > freebsd-smp@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-smp > To unsubscribe, send any mail to "freebsd-smp-unsubscribe@freebsd.org" > From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:38:09 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9EDB516A402 for ; Mon, 23 Apr 2007 15:38:09 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep3.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 774C813C48A for ; Mon, 23 Apr 2007 15:38:09 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep3.cogeco.net (Postfix) with ESMTP id 831BF56B; Mon, 23 Apr 2007 11:38:08 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 11:38:22 -0400 To: Kris Kennaway From: Paul In-Reply-To: <20070423153334.GA530@xor.obsecurity.org> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423153808.831BF56B@fep3.cogeco.net> Cc: Steven Hartland , freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:38:09 -0000 Hi Kris, Nothing is essentially working to answer your question on my diagnosis. Everything is extremely slow and I can net get simple sendmail services working at a reasonable rate of a few messages per second. Any ideas? Thanks for your help Paul At 11:33 AM 23/04/2007, Kris Kennaway wrote: >On Mon, Apr 23, 2007 at 11:27:17AM -0400, Paul wrote: > > Hi Steve, > > > > When I shut off everything except apache with very low load and > > qpopper it is still maxed out. > >That does not look like very low load to me. On the contrary, your >stats show that 30-40 running processes are being scheduled for >running on the 4 CPUs at any one time. Under those circumstances you >should expect to see 100% CPU usage (anything less means your system >is not being completely used). Can you please confirm what you are >using for your diagnosis that there is something wrong with the system >performance? From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:47:46 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9178216A401 for ; Mon, 23 Apr 2007 15:47:46 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 7CD0F13C484 for ; Mon, 23 Apr 2007 15:47:46 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id A731D1A4DC1; Mon, 23 Apr 2007 08:48:08 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id B3F2C5126B; Mon, 23 Apr 2007 11:47:45 -0400 (EDT) Date: Mon, 23 Apr 2007 11:47:45 -0400 From: Kris Kennaway To: Paul Message-ID: <20070423154745.GA872@xor.obsecurity.org> References: <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070423153808.831BF56B@fep3.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org, Steven Hartland , Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:47:46 -0000 On Mon, Apr 23, 2007 at 11:38:22AM -0400, Paul wrote: > Hi Kris, > > Nothing is essentially working to answer your question on my diagnosis. > > Everything is extremely slow and I can net get simple sendmail > services working at a reasonable rate of a few messages per second. > > Any ideas? Please post your kernel config. Kris P.S. Also please don't top-post, it destroys context > > Thanks for your help > > Paul > > At 11:33 AM 23/04/2007, Kris Kennaway wrote: > >On Mon, Apr 23, 2007 at 11:27:17AM -0400, Paul wrote: > >> Hi Steve, > >> > >> When I shut off everything except apache with very low load and > >> qpopper it is still maxed out. > > > >That does not look like very low load to me. On the contrary, your > >stats show that 30-40 running processes are being scheduled for > >running on the 4 CPUs at any one time. Under those circumstances you > >should expect to see 100% CPU usage (anything less means your system > >is not being completely used). Can you please confirm what you are > >using for your diagnosis that there is something wrong with the system > >performance? > > _______________________________________________ > freebsd-smp@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-smp > To unsubscribe, send any mail to "freebsd-smp-unsubscribe@freebsd.org" > From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:55:03 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 813CD16A403 for ; Mon, 23 Apr 2007 15:55:03 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep9.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id 50F8313C4AE for ; Mon, 23 Apr 2007 15:55:01 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep9.cogeco.net (Postfix) with ESMTP id 413CB3A5; Mon, 23 Apr 2007 11:54:59 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 11:55:14 -0400 To: Kris Kennaway From: Paul In-Reply-To: <20070423154745.GA872@xor.obsecurity.org> References: <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423155500.413CB3A5@fep9.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:55:03 -0000 > > > > Nothing is essentially working to answer your question on my diagnosis. > > > > Everything is extremely slow and I can net get simple sendmail > > services working at a reasonable rate of a few messages per second. > > > > Any ideas? > >Please post your kernel config. > >Kris Hi Kris, Sorry about that, Here is the kernel config. machine amd64 cpu HAMMER ident MYSERVER makeoptions DEBUG=-g # Build kernel with gdb(1) debug symbols options SCHED_4BSD # 4BSD scheduler options PREEMPTION # Enable kernel thread preemption options INET # InterNETworking #options INET6 # IPv6 communications protocols options FFS # Berkeley Fast Filesystem options SOFTUPDATES # Enable FFS soft updates support options UFS_ACL # Support for access control lists options UFS_DIRHASH # Improve performance on big directories options MD_ROOT # MD is a potential root device options NFSCLIENT # Network Filesystem Client options NFSSERVER # Network Filesystem Server options NFS_ROOT # NFS usable as /, requires NFSCLIENT options NTFS # NT File System options MSDOSFS # MSDOS Filesystem options CD9660 # ISO 9660 Filesystem options PROCFS # Process filesystem (requires PSEUDOFS) options PSEUDOFS # Pseudo-filesystem framework options GEOM_GPT # GUID Partition Tables. options COMPAT_43 # Needed by COMPAT_LINUX32 options COMPAT_IA32 # Compatible with i386 binaries options COMPAT_FREEBSD4 # Compatible with FreeBSD4 options COMPAT_FREEBSD5 # Compatible with FreeBSD5 options COMPAT_LINUX32 # Compatible with i386 linux binaries options SCSI_DELAY=8000 # Delay (in ms) before probing SCSI options KTRACE # ktrace(1) support options SYSVSHM # SYSV-style shared memory options SYSVMSG # SYSV-style message queues options SYSVSEM # SYSV-style semaphores options _KPOSIX_PRIORITY_SCHEDULING # POSIX P1003_1B real-time extensions options KBD_INSTALL_CDEV # install a CDEV entry in /dev options ADAPTIVE_GIANT # Giant mutex is adaptive. options SMP options IPFIREWALL options IPFIREWALL_VERBOSE #enable logging to syslogd(8) options IPDIVERT options QUOTA options DUMMYNET # Workarounds for some known-to-be-broken chipsets (nVidia nForce3-Pro150) device atpic # 8259A compatability # Linux 32-bit ABI support options LINPROCFS # Cannot be a module yet. # Bus support. device acpi device pci # Floppy drives device fdc # ATA and ATAPI devices device ata device atadisk # ATA disk drives device ataraid # ATA RAID drives device atapicd # ATAPI CDROM drives device atapifd # ATAPI floppy drives device atapist # ATAPI tape drives options ATA_STATIC_ID # Static device numbering # SCSI peripherals device scbus # SCSI bus (required for SCSI) device ch # SCSI media changers device da # Direct Access (disks) device sa # Sequential Access (tape etc) device cd # CD device pass # Passthrough device (direct SCSI access) device ses # SCSI Environmental Services (and SAF-TE) # RAID controllers interfaced to the SCSI subsystem # device amr # AMI MegaRAID device arcmsr # Areca SATA II RAID # atkbdc0 controls both the keyboard and the PS/2 mouse device atkbdc # AT keyboard controller device atkbd # AT keyboard device psm # PS/2 mouse device kbdmux # keyboard multiplexer device vga # VGA video card driver device splash # Splash screen and screen saver support # syscons is the default console driver, resembling an SCO console device sc device agp # support several AGP chipsets # Serial (COM) ports device sio # 8250, 16[45]50 based serial ports # Parallel port device ppc device ppbus # Parallel port bus (required) device lpt # Printer device plip # TCP/IP over parallel device ppi # Parallel port interface device #device vpo # Requires scbus and da # If you've got a "dumb" serial or parallel PCI card that is # supported by the puc(4) glue driver, uncomment the following # line to enable it (connects to the sio and/or ppc drivers): #device puc # PCI Ethernet NICs. device de # DEC/Intel DC21x4x (``Tulip'') device em # Intel PRO/1000 adapter Gigabit Ethernet Card device ixgb # Intel PRO/10GbE Ethernet Card device le # AMD Am7900 LANCE and Am79C9xx PCnet device txp # 3Com 3cR990 (``Typhoon'') device vx # 3Com 3c590, 3c595 (``Vortex'') PCI Ethernet NICs that use the common MII bus controller code. # NOTE: Be sure to keep the 'device miibus' line in order to use these NICs! device miibus # MII bus support device fxp # Intel EtherExpress PRO/100B (82557, 82558) device sk # SysKonnect SK-984x & SK-982x gigabit Ethernet # Pseudo devices. device loop # Network loopback device random # Entropy device device ether # Ethernet support device sl # Kernel SLIP device ppp # Kernel PPP device tun # Packet tunnel. device pty # Pseudo-ttys (telnet etc) device md # Memory "disks" device gif # IPv6 and IPv4 tunneling #device faith # IPv6-to-IPv4 relaying (translation) # The `bpf' device enables the Berkeley Packet Filter. # Be aware of the administrative consequences of enabling this! # Note that 'bpf' is required for DHCP. device bpf # Berkeley packet filter # USB support device uhci # UHCI PCI->USB interface device ohci # OHCI PCI->USB interface device ehci # EHCI PCI->USB interface (USB 2.0) device usb # USB Bus (required) #device udbp # USB Double Bulk Pipe devices device ugen # Generic device uhid # "Human Interface Devices" device ukbd # Keyboard device ulpt # Printer device umass # Disks/Mass storage - Requires scbus and da device ums # Mouse From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 15:59:23 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 876A016A401; Mon, 23 Apr 2007 15:59:23 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 7010A13C44B; Mon, 23 Apr 2007 15:59:23 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id A02FB1A4DBD; Mon, 23 Apr 2007 08:59:45 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id B3F115132C; Mon, 23 Apr 2007 11:59:22 -0400 (EDT) Date: Mon, 23 Apr 2007 11:59:22 -0400 From: Kris Kennaway To: Paul Message-ID: <20070423155922.GA1156@xor.obsecurity.org> References: <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="nFreZHaLTZJo0R7j" Content-Disposition: inline In-Reply-To: <20070423155500.413CB3A5@fep9.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: kib@FreeBSD.org, freebsd-smp@freebsd.org, Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 15:59:23 -0000 --nFreZHaLTZJo0R7j Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 11:55:14AM -0400, Paul wrote: >=20 > >> > >> Nothing is essentially working to answer your question on my diagnosis. > >> > >> Everything is extremely slow and I can net get simple sendmail > >> services working at a reasonable rate of a few messages per second. > >> > >> Any ideas? > > > >Please post your kernel config. > > > >Kris >=20 > Hi Kris, >=20 > Sorry about that, >=20 > Here is the kernel config. > options QUOTA This is going to make filesystem operations very slow. It is fixed in 7.0 and might be backported at some point. kib@ may be able to provide a patch again 6.x that you could test. Kris --nFreZHaLTZJo0R7j Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGLNfaWry0BWjoQKURAkb0AKDP6MTPHGVrWILBHoanRn9wlRd5QwCglgRj C6MgxFvtbZWObSlCnAkR0p0= =guAA -----END PGP SIGNATURE----- --nFreZHaLTZJo0R7j-- From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 16:04:36 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8137C16A408 for ; Mon, 23 Apr 2007 16:04:36 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep3.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 59DDB13C484 for ; Mon, 23 Apr 2007 16:04:34 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep3.cogeco.net (Postfix) with ESMTP id 9D0BC484; Mon, 23 Apr 2007 12:04:33 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 12:04:48 -0400 To: Kris Kennaway From: Paul In-Reply-To: <20070423155922.GA1156@xor.obsecurity.org> References: <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423160433.9D0BC484@fep3.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 16:04:36 -0000 > > Here is the kernel config. > > > options QUOTA > >This is going to make filesystem operations very slow. It is fixed in >7.0 and might be backported at some point. kib@ may be able to >provide a patch again 6.x that you could test. > >Kris > Hi Kris, I removed the use quota form the fstab. Should this fix it or do I need to recompile to see the results? Thanks Paul From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 16:07:11 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1035916A403 for ; Mon, 23 Apr 2007 16:07:11 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id F024113C45E for ; Mon, 23 Apr 2007 16:07:10 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 0952B1A4DC3; Mon, 23 Apr 2007 09:07:33 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 0D17F51201; Mon, 23 Apr 2007 12:07:10 -0400 (EDT) Date: Mon, 23 Apr 2007 12:07:09 -0400 From: Kris Kennaway To: Paul Message-ID: <20070423160709.GA6215@xor.obsecurity.org> References: <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> <20070423160433.9D0BC484@fep3.cogeco.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070423160433.9D0BC484@fep3.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org, Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 16:07:11 -0000 On Mon, Apr 23, 2007 at 12:04:48PM -0400, Paul wrote: > > >> Here is the kernel config. > > > >> options QUOTA > > > >This is going to make filesystem operations very slow. It is fixed in > >7.0 and might be backported at some point. kib@ may be able to > >provide a patch again 6.x that you could test. > > > >Kris > > > > Hi Kris, > > I removed the use quota form the fstab. Should this fix it or do I > need to recompile to see the results? You will need to remove it from your kernel. Kris From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 17:10:05 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D649F16A402 for ; Mon, 23 Apr 2007 17:10:05 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outM.internet-mail-service.net (outM.internet-mail-service.net [216.240.47.236]) by mx1.freebsd.org (Postfix) with ESMTP id C1B7B13C458 for ; Mon, 23 Apr 2007 17:10:05 +0000 (UTC) (envelope-from julian@elischer.org) Received: from mx0.idiom.com (HELO idiom.com) (216.240.32.160) by out.internet-mail-service.net (qpsmtpd/0.32) with ESMTP; Mon, 23 Apr 2007 09:23:26 -0700 Received: from julian-mac.elischer.org (home.elischer.org [216.240.48.38]) by idiom.com (Postfix) with ESMTP id 52BBB125B4B; Mon, 23 Apr 2007 09:55:50 -0700 (PDT) Message-ID: <462CE521.6090702@elischer.org> Date: Mon, 23 Apr 2007 09:56:01 -0700 From: Julian Elischer User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) MIME-Version: 1.0 To: Paul References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> In-Reply-To: <20070423135619.D6FB4495@fep9.cogeco.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-smp@freebsd.org, Steven Hartland Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 17:10:05 -0000 Paul wrote: > Dear Steve, > > Thanks for your suggestion. This did not help unfortunately. > > Does anyone have any other ideas as I am out of solutions? the page cleaning (zeroing) code is doing lot.. you need to find out what is asking for all those clean pages of memory. > > Thanks > > Paul > > At 09:47 PM 22/04/2007, Steven Hartland wrote: >> You might want to try: >> sysctl vm.idlezero_enable=0 >> and see if that helps. >> >> Steve > > _______________________________________________ > freebsd-smp@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-smp > To unsubscribe, send any mail to "freebsd-smp-unsubscribe@freebsd.org" From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 17:13:15 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CF28A16A403 for ; Mon, 23 Apr 2007 17:13:15 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep1.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id 5E2C013C457 for ; Mon, 23 Apr 2007 17:13:15 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep1.cogeco.net (Postfix) with ESMTP id 7072470C; Mon, 23 Apr 2007 13:13:14 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 13:13:28 -0400 To: Julian Elischer From: Paul In-Reply-To: <462CE521.6090702@elischer.org> References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <462CE521.6090702@elischer.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070423171314.7072470C@fep1.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 17:13:15 -0000 > >the page cleaning (zeroing) code is doing lot.. >you need to find out what is asking for all those clean pages of memory. Here is my latest version of the memory drive based on some suggestions. mdmfs -s 4096m -S -o async -p 0750 -w vscan:vscan md /var/amavis Is this the reason for the page cleaning? Thanks for your help Paul From owner-freebsd-smp@FreeBSD.ORG Mon Apr 23 17:15:05 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E249716A400 for ; Mon, 23 Apr 2007 17:15:05 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outW.internet-mail-service.net (outW.internet-mail-service.net [216.240.47.246]) by mx1.freebsd.org (Postfix) with ESMTP id CBCBB13C468 for ; Mon, 23 Apr 2007 17:15:05 +0000 (UTC) (envelope-from julian@elischer.org) Received: from mx0.idiom.com (HELO idiom.com) (216.240.32.160) by out.internet-mail-service.net (qpsmtpd/0.32) with ESMTP; Mon, 23 Apr 2007 09:30:02 -0700 Received: from julian-mac.elischer.org (home.elischer.org [216.240.48.38]) by idiom.com (Postfix) with ESMTP id A5C94125B11; Mon, 23 Apr 2007 10:02:26 -0700 (PDT) Message-ID: <462CE6AE.4000806@elischer.org> Date: Mon, 23 Apr 2007 10:02:38 -0700 From: Julian Elischer User-Agent: Thunderbird 2.0.0.0 (Macintosh/20070326) MIME-Version: 1.0 To: Paul References: <20070422221426.74CF83D7@fep9.cogeco.net> <20070422224157.GA63390@xor.obsecurity.org> <20070423010224.C16984@chrishome.localnet> <20070423004105.7984082E@fep7.cogeco.net> <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> In-Reply-To: <20070423152703.715922D1@fep2.cogeco.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-smp@freebsd.org, Steven Hartland Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Apr 2007 17:15:06 -0000 Paul wrote: > > last pid: 18967; load averages: 29.00, 44.28, > 46.39 up 0+10:16:42 > 11:17:00 > 308 processes: 41 running, 239 sleeping, 7 zombie, 21 waiting > CPU states: 13.3% user, 0.0% nice, 74.5% system, 12.2% interrupt, 0.0% > idle that's odd... there are 4 idle threads each with 22% of a CPU.. there should be 22% idle. (I think) > Mem: 1204M Active, 5678M Inact, 381M Wired, 20K Cache, 214M Buf, 8398M Free > Swap: 8192M Total, 8192M Free > > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU > COMMAND > 11 root 1 171 52 0K 16K RUN 2 93:59 22.80% > idle: cpu2 > 10 root 1 171 52 0K 16K RUN 3 116:20 22.46% > idle: cpu3 > 12 root 1 171 52 0K 16K RUN 1 101:36 22.36% > idle: cpu1 > 13 root 1 171 52 0K 16K RUN 0 123:32 22.22% > idle: cpu0 > From owner-freebsd-smp@FreeBSD.ORG Tue Apr 24 01:04:24 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7CE7016A400 for ; Tue, 24 Apr 2007 01:04:24 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep3.cogeco.net (smtp2.cogeco.ca [216.221.81.29]) by mx1.freebsd.org (Postfix) with ESMTP id 2C6CC13C469 for ; Tue, 24 Apr 2007 01:04:24 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep3.cogeco.net (Postfix) with ESMTP id 9E9376A4; Mon, 23 Apr 2007 21:04:21 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 21:04:37 -0400 To: Kris Kennaway From: Paul In-Reply-To: <20070423155922.GA1156@xor.obsecurity.org> References: <00a601c78549$6b480fa0$b6db87d4@multiplay.co.uk> <20070423135619.D6FB4495@fep9.cogeco.net> <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070424010422.9E9376A4@fep3.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 01:04:24 -0000 > > options QUOTA > >This is going to make filesystem operations very slow. It is fixed in >7.0 and might be backported at some point. kib@ may be able to >provide a patch again 6.x that you could test. > >Kris Dear Gentlemen, I appreciate your suggestions today. Unfortunately I had to dump the 6.2 and scale back to the 4.12 for now and possibly for good as I could not find a solution. Just for point of reference here is a snapshot of the 4.12 box (see below). Notice the 98% idle. This is what I experienced in the old box. Most of the time it was idle in a range of 20-70% during busy times and 70-90% idle during non busy times. On the new box it was hardly ever idle. I still am not sure what was wrong but we had a difficult time simulating this as it was quite well tested. Today, when all I had was qpopper actively running on the new 6.2 "super" machine it was choking on the system being 50-70% used. The only reason I point this out is to comment and be complete on this thread on the belief that I would expect 100% usage on the new freebsd 6.2 amd64 with the double dual core xeon processors (technically 2* the cpus) and 4* the ram. This is in no way a complaint on the suggestions that were given. I have a hunch it was an issue with the speed it was able to write to the disk as qpopper moves the mail files from the /usr partition to the /var partition during transfer. This works just fine on the old machine but it was not working fine on the new machine. I am still unclear as to why this was not visible in the drive statistics (which seemed normal) and was visible in the CPU usage. Everything on the new 6.2 server seemed to take a lot more cpu percentages as a matter of visual inspection for the same versions of the 32bit i386 programs. In the old freebsd 4.12 server rarely would a process take >20% cpu. On the new 6.2 I commonly saw 20-50% for simple qpopper processes. I am going to try and reproduce the errors in a non-live environment to see if there is a fix for these problems. For people looking to roll out a 6.2 stable system on the Intel S5000PAL dual core Intel platform using SATA II on the amd64 branch be forewarned it may not be simple given my experience. Before the areca card arc-1130d, I tried an Intel raid card SRCS16 which in my opinion on Freebsd gave poor performance on disk transfers during tests for Raid 5. The areca card on the benchmarks and install seemed to be quite superior for every test. I even had a 1gig chip installed in the raid card to take advantage of the extra ram for caching. I made an effort on this system to get everything up-to-date for all firmware and to the best of my ability configured "right" over the last 3 months. It is unfortunate that it seems to be a shadow in comparison of the old slower 4.12 box. Clearly I must have had something wrong. If anyone has some tips on how to try and reproduce the errors I would greatly appreciate it. Regards and in appreciation for your efforts and suggestions thus far, Paul last pid: 40347; load averages: 0.44, 0.66, 0.59 up 0+05:30:50 20:37:27 127 processes: 2 running, 125 sleeping CPU states: 0.0% user, 0.0% nice, 0.9% system, 0.4% interrupt, 98.7% idle Mem: 1355M Active, 1937M Inact, 191M Wired, 180M Cache, 199M Buf, 235M Free Swap: 400M Total, 400M Free PID USERNAME PRI NICE SIZE RES STATE C TIME WCPU CPU COMMAND 40276 spamfilter 2 0 144M 143M sbwait 0 0:02 2.64% 1.95% perl 39569 vscan 2 0 51940K 45896K accept 0 0:03 1.42% 1.42% perl5.8 1095 nobody 18 0 52340K 39128K lockf 0 0:21 0.98% 0.98% httpd 39643 vscan 2 0 50864K 44920K select 0 0:02 0.63% 0.63% perl5.8 19715 root 2 0 47852K 43548K select 0 1:19 0.59% 0.59% perl 39880 vscan 2 0 53516K 47412K accept 0 0:03 0.54% 0.54% perl5.8 39977 vscan 2 0 53600K 47512K accept 0 0:02 0.54% 0.54% perl5.8 489 root 2 0 14248K 12892K poll 0 28:52 0.39% 0.39% bbackup 40097 user1 2 0 2704K 2268K sbwait 0 0:01 0.05% 0.05% qpopper From owner-freebsd-smp@FreeBSD.ORG Tue Apr 24 02:15:54 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C03B516A401 for ; Tue, 24 Apr 2007 02:15:54 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id A8E5513C458 for ; Tue, 24 Apr 2007 02:15:54 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 6D8D01A4DBE; Mon, 23 Apr 2007 19:16:17 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id AC30351344; Mon, 23 Apr 2007 22:15:53 -0400 (EDT) Date: Mon, 23 Apr 2007 22:15:53 -0400 From: Kris Kennaway To: Paul Message-ID: <20070424021553.GA4224@xor.obsecurity.org> References: <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> <20070424010422.9E9376A4@fep3.cogeco.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="PNTmBPCT7hxwcZjr" Content-Disposition: inline In-Reply-To: <20070424010422.9E9376A4@fep3.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org, Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 02:15:54 -0000 --PNTmBPCT7hxwcZjr Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 09:04:37PM -0400, Paul wrote: >=20 > >> options QUOTA > > > >This is going to make filesystem operations very slow. It is fixed in > >7.0 and might be backported at some point. kib@ may be able to > >provide a patch again 6.x that you could test. > > > >Kris >=20 > Dear Gentlemen, >=20 > I appreciate your suggestions today. Unfortunately I had to dump the=20 > 6.2 and scale back to the 4.12 for now and possibly for good as I=20 > could not find a solution. >=20 > Just for point of reference here is a snapshot of the 4.12 box (see=20 > below). Notice the 98% idle. This is what I experienced in the old=20 > box. Most of the time it was idle in a range of 20-70% during busy=20 > times and 70-90% idle during non busy times. On the new box it was=20 > hardly ever idle. I still am not sure what was wrong but we had a=20 > difficult time simulating this as it was quite well tested. It was almost certainly what I said above. Too bad you weren't able to follow through with it. Kris --PNTmBPCT7hxwcZjr Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGLWhZWry0BWjoQKURAq+OAKD7y0c5hXeCY89ldji7YTmUV1xl4gCgs2Gx 54TvA5lDK/No8W7PXY9NQIk= =cDwB -----END PGP SIGNATURE----- --PNTmBPCT7hxwcZjr-- From owner-freebsd-smp@FreeBSD.ORG Tue Apr 24 02:50:33 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 24ECE16A403 for ; Tue, 24 Apr 2007 02:50:33 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from fep1.cogeco.net (smtp.cogeco.net [216.221.81.25]) by mx1.freebsd.org (Postfix) with ESMTP id F112F13C480 for ; Tue, 24 Apr 2007 02:50:32 +0000 (UTC) (envelope-from bsdlist@cogeco.ca) Received: from elehost-can.cogeco.ca (d141-2-106.home.cgocable.net [24.141.2.106]) by fep1.cogeco.net (Postfix) with ESMTP id F0841AE5; Mon, 23 Apr 2007 22:50:31 -0400 (EDT) X-Mailer: QUALCOMM Windows Eudora Version 7.1.0.9 Date: Mon, 23 Apr 2007 22:50:47 -0400 To: Kris Kennaway From: Paul In-Reply-To: <20070424021553.GA4224@xor.obsecurity.org> References: <009c01c785b6$c8ac36e0$b6db87d4@multiplay.co.uk> <20070423145954.8244094A@fep1.cogeco.net> <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> <20070424010422.9E9376A4@fep3.cogeco.net> <20070424021553.GA4224@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii"; format=flowed Message-Id: <20070424025031.F0841AE5@fep1.cogeco.net> Cc: freebsd-smp@freebsd.org Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 02:50:33 -0000 >It was almost certainly what I said above. Too bad you weren't able >to follow through with it. > >Kris Hi Kris, I was running the make depend for over 1 hour and it showed no end in sight. I figured to run that to the finish and the full make it might have taken all day so I really had no choice :) I will test this and see if it fixes the problem and confirm if this is the culprit (or not). I am surprised to hear this is all a function of the Quota problem you mention. I suppose nobody is using this anymore or is there a better system being used? Thanks, Paul From owner-freebsd-smp@FreeBSD.ORG Tue Apr 24 03:52:50 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 412AE16A404 for ; Tue, 24 Apr 2007 03:52:50 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 2912D13C45A for ; Tue, 24 Apr 2007 03:52:50 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 03FD01A4DBE; Mon, 23 Apr 2007 20:53:13 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 614F851406; Mon, 23 Apr 2007 23:52:49 -0400 (EDT) Date: Mon, 23 Apr 2007 23:52:49 -0400 From: Kris Kennaway To: Paul Message-ID: <20070424035249.GA5598@xor.obsecurity.org> References: <00b301c785b9$0bc9b180$b6db87d4@multiplay.co.uk> <20070423152703.715922D1@fep2.cogeco.net> <20070423153334.GA530@xor.obsecurity.org> <20070423153808.831BF56B@fep3.cogeco.net> <20070423154745.GA872@xor.obsecurity.org> <20070423155500.413CB3A5@fep9.cogeco.net> <20070423155922.GA1156@xor.obsecurity.org> <20070424010422.9E9376A4@fep3.cogeco.net> <20070424021553.GA4224@xor.obsecurity.org> <20070424025031.F0841AE5@fep1.cogeco.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qDbXVdCdHGoSgWSk" Content-Disposition: inline In-Reply-To: <20070424025031.F0841AE5@fep1.cogeco.net> User-Agent: Mutt/1.4.2.2i Cc: freebsd-smp@freebsd.org, Kris Kennaway Subject: Re: System Cpu Between 50-70% and need to find out why X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Apr 2007 03:52:50 -0000 --qDbXVdCdHGoSgWSk Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Apr 23, 2007 at 10:50:47PM -0400, Paul wrote: >=20 > >It was almost certainly what I said above. Too bad you weren't able > >to follow through with it. > > > >Kris >=20 > Hi Kris, >=20 > I was running the make depend for over 1 hour and it showed no end in=20 > sight. I figured to run that to the finish and the full make it might=20 > have taken all day so I really had no choice :) Odd, I suspect you were doing more than just building a kernel, which only takes a few minutes to build completely (even on a quota-enabled machine ;) > I will test this and see if it fixes the problem and confirm if this=20 > is the culprit (or not). >=20 > I am surprised to hear this is all a function of the Quota problem=20 > you mention. I suppose nobody is using this anymore or is there a=20 > better system being used? It's just a left-over from the post-4.x SMP rewrite that didn't get addressed until recently. In the grand scheme of things quotas are relatively infrequently used, so it was a higher priority for the developers to work on other things first. As I mentioned, fixing this performance problem with quotas has now been completed in 7.0 and it will probably make it back into 6.x before 6.3. Kris --qDbXVdCdHGoSgWSk Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) iD8DBQFGLX8RWry0BWjoQKURAnDdAKCLwntzEDHODuC61+HYU/WgOGvEEQCfe70i MmKE1iXwuz5OnhlRo18LJfw= =naKw -----END PGP SIGNATURE----- --qDbXVdCdHGoSgWSk-- From owner-freebsd-smp@FreeBSD.ORG Wed Apr 25 09:14:36 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8A5DE16A406 for ; Wed, 25 Apr 2007 09:14:36 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: from mail.sub.ru (mail.sub.ru [88.212.205.2]) by mx1.freebsd.org (Postfix) with SMTP id DCEBB13C489 for ; Wed, 25 Apr 2007 09:14:35 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: (qmail 96195 invoked from network); 25 Apr 2007 12:53:28 +0400 Received: from unknown (HELO localhost) (88.212.205.2) by mail.sub.ru with SMTP; 25 Apr 2007 12:53:28 +0400 X-Virus-Scanned: by amavisd-new at mail.sub.ru Received: from unknown ([88.212.205.2]) by localhost (mail-new.sub.ru [88.212.205.2]) (amavisd-new, port 10024) with SMTP id Ma+AwGTooFUH; Wed, 25 Apr 2007 12:53:24 +0400 (MSD) Received: from unknown (HELO ?89.222.147.9?) (tarkhil%sub.ru@89.222.147.9) by techno.sub.ru with SMTP; 25 Apr 2007 08:53:24 -0000 Message-ID: <462F15B4.4010201@webmail.sub.ru> Date: Wed, 25 Apr 2007 12:47:48 +0400 From: Alex Povolotsky User-Agent: Thunderbird 1.5.0.9 (X11/20070104) MIME-Version: 1.0 To: freebsd-smp@freebsd.org, FreeBSD Stable , freebsd-hardware@freebsd.org Content-Type: text/plain; charset=KOI8-R; format=flowed Content-Transfer-Encoding: 7bit Cc: Subject: 6.2-RELEASE does not use second CPU on pentium D X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 09:14:36 -0000 Hello! I have a Pentium D box, running 6.2-RELEASE. In dmesg, I see CPU#1 launched, but I never see any process running on it, and mptable shows cluster-one# mptable -verbose =============================================================================== MPTable looking for EBDA pointer @ 0x040e, found, searching EBDA @ 0x0009e800 searching CMOS 'top of mem' @ 0x0009e400 (633K) searching default 'top of mem' @ 0x0009fc00 (639K) searching BIOS @ 0x000f0000 MP FPS found in BIOS @ physical addr: 0x000fe200 ------------------------------------------------------------------------------- MP Floating Pointer Structure: location: BIOS physical address: 0x000fe200 signature: '_MP_' length: 16 bytes version: 1.4 checksum: 0x9f mode: Virtual Wire ------------------------------------------------------------------------------- MP Config Table Header: physical address: 0x000fe210 signature: 'PCMP' base table length: 64 version: 1.4 checksum: 0x7f OEM ID: '' Product ID: '' OEM table pointer: 0x00000000 OEM table size: 0 entry count: 1 local APIC address: 0xfee00000 extended table length: 0 extended table checksum: 0 ------------------------------------------------------------------------------- MP Config Base Table Entries: -- Processors: APIC ID Version State Family Model Step Flags 0 0x14 BSP, usable 15 6 4 0xbfebfbff =============================================================================== while in dmesg Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant WARNING: MPSAFE network stack disabled, expect reduced performance. Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 Features=0xbfebfbff Features2=0xe49d,> AMD Features=0x20100000 AMD Features2=0x1 real memory = 1046757376 (998 MB) avail memory = 1015095296 (968 MB) ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs cpu0 (BSP): APIC ID: 0 cpu1 (AP): APIC ID: 1 ioapic0: Changing APIC ID to 2 ioapic0 irqs 0-23 on motherboard [...] SMP: AP CPU #1 Launched! The kernel is, of course, SMP. What can I do, where can I search for solution? Second core IS enabled in BIOS cluster-one# sysctl hw | grep cpu hw.ncpu: 2 hw.acpi.cpu.cx_supported: C1/0 hw.acpi.cpu.cx_lowest: C1 hw.acpi.cpu.cx_usage: 100.00% cluster-one# sysctl machdep | grep cpu machdep.cpu_idle_hlt: 1 machdep.hlt_cpus: 2 machdep.hlt_logical_cpus: 0 machdep.logical_cpus_mask: 2 so second CPU is halted, attempt to start it with sysctl does not help Alex. From owner-freebsd-smp@FreeBSD.ORG Wed Apr 25 18:14:20 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 64C9A16A402; Wed, 25 Apr 2007 18:14:20 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (66-23-211-162.clients.speedfactory.net [66.23.211.162]) by mx1.freebsd.org (Postfix) with ESMTP id E62DB13C45B; Wed, 25 Apr 2007 18:14:19 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [127.0.0.1]) (authenticated bits=0) by server.baldwin.cx (8.13.8/8.13.8) with ESMTP id l3PI1lQX068100; Wed, 25 Apr 2007 14:01:48 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: freebsd-hardware@freebsd.org Date: Wed, 25 Apr 2007 12:08:33 -0400 User-Agent: KMail/1.9.6 References: <462F15B4.4010201@webmail.sub.ru> In-Reply-To: <462F15B4.4010201@webmail.sub.ru> MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200704251208.34248.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [127.0.0.1]); Wed, 25 Apr 2007 14:01:48 -0400 (EDT) X-Virus-Scanned: ClamAV 0.88.3/3161/Wed Apr 25 11:52:16 2007 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=4.2 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: FreeBSD Stable , freebsd-smp@freebsd.org, Alex Povolotsky Subject: Re: 6.2-RELEASE does not use second CPU on pentium D X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 18:14:20 -0000 On Wednesday 25 April 2007 04:47:48 am Alex Povolotsky wrote: > Hello! > > I have a Pentium D box, running 6.2-RELEASE. In dmesg, I see CPU#1 > launched, but I never see any process running on it, and mptable shows > > cluster-one# mptable -verbose > > =============================================================================== > > MPTable > > looking for EBDA pointer @ 0x040e, found, searching EBDA @ 0x0009e800 > searching CMOS 'top of mem' @ 0x0009e400 (633K) > searching default 'top of mem' @ 0x0009fc00 (639K) > searching BIOS @ 0x000f0000 > > MP FPS found in BIOS @ physical addr: 0x000fe200 > > ------------------------------------------------------------------------------- > > MP Floating Pointer Structure: > > location: BIOS > physical address: 0x000fe200 > signature: '_MP_' > length: 16 bytes > version: 1.4 > checksum: 0x9f > mode: Virtual Wire > > ------------------------------------------------------------------------------- > > MP Config Table Header: > > physical address: 0x000fe210 > signature: 'PCMP' > base table length: 64 > version: 1.4 > checksum: 0x7f > OEM ID: '' > Product ID: '' > OEM table pointer: 0x00000000 > OEM table size: 0 > entry count: 1 > local APIC address: 0xfee00000 > extended table length: 0 > extended table checksum: 0 > > ------------------------------------------------------------------------------- > > MP Config Base Table Entries: > > -- > Processors: APIC ID Version State Family Model Step > Flags > 0 0x14 BSP, usable 15 6 4 > 0xbfebfbff > > =============================================================================== > > while in dmesg > > Copyright (c) 1992-2007 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD is a registered trademark of The FreeBSD Foundation. > FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > > Features=0xbfebfbff ,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > Features2=0xe49d,> > AMD Features=0x20100000 > AMD Features2=0x1 > real memory = 1046757376 (998 MB) > avail memory = 1015095296 (968 MB) > ACPI APIC Table: > FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > cpu0 (BSP): APIC ID: 0 > cpu1 (AP): APIC ID: 1 > ioapic0: Changing APIC ID to 2 > ioapic0 irqs 0-23 on motherboard > > [...] > SMP: AP CPU #1 Launched! > > The kernel is, of course, SMP. > > What can I do, where can I search for solution? > > Second core IS enabled in BIOS > cluster-one# sysctl hw | grep cpu > hw.ncpu: 2 > hw.acpi.cpu.cx_supported: C1/0 > hw.acpi.cpu.cx_lowest: C1 > hw.acpi.cpu.cx_usage: 100.00% > cluster-one# sysctl machdep | grep cpu > machdep.cpu_idle_hlt: 1 > machdep.hlt_cpus: 2 > machdep.hlt_logical_cpus: 0 > machdep.logical_cpus_mask: 2 > > so second CPU is halted, attempt to start it with sysctl does not help > Alex. It's seeing it as an HTT thread. Try changing 'machdep.hyperthreading_allowed'. -- John Baldwin From owner-freebsd-smp@FreeBSD.ORG Wed Apr 25 19:20:14 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D091516A400 for ; Wed, 25 Apr 2007 19:20:14 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: from mail.sub.ru (mail.sub.ru [88.212.205.2]) by mx1.freebsd.org (Postfix) with SMTP id 3753613C448 for ; Wed, 25 Apr 2007 19:20:13 +0000 (UTC) (envelope-from tarkhil@webmail.sub.ru) Received: (qmail 3811 invoked from network); 25 Apr 2007 23:25:48 +0400 Received: from unknown (HELO localhost) (88.212.205.2) by mail.sub.ru with SMTP; 25 Apr 2007 23:25:48 +0400 X-Virus-Scanned: by amavisd-new at mail.sub.ru Received: from unknown ([88.212.205.2]) by localhost (mail-new.sub.ru [88.212.205.2]) (amavisd-new, port 10024) with SMTP id fk9kSCN2gMD6; Wed, 25 Apr 2007 23:25:42 +0400 (MSD) Received: from unknown (HELO ?89.222.147.9?) (tarkhil%sub.ru@89.222.147.9) by techno.sub.ru with SMTP; 25 Apr 2007 19:25:42 -0000 Message-ID: <462FA9E5.5010300@webmail.sub.ru> Date: Wed, 25 Apr 2007 23:20:05 +0400 From: Alex Povolotsky User-Agent: Thunderbird 1.5.0.9 (X11/20070104) MIME-Version: 1.0 To: John Baldwin References: <462F15B4.4010201@webmail.sub.ru> <200704251208.34248.jhb@freebsd.org> In-Reply-To: <200704251208.34248.jhb@freebsd.org> Content-Type: text/plain; charset=KOI8-R; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD Stable , freebsd-smp@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: 6.2-RELEASE does not use second CPU on pentium D X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 19:20:15 -0000 John Baldwin wrote: > On Wednesday 25 April 2007 04:47:48 am Alex Povolotsky wrote: > >> Hello! >> >> I have a Pentium D box, running 6.2-RELEASE. In dmesg, I see CPU#1 >> launched, but I never see any process running on it, and mptable shows >> >> cluster-one# mptable -verbose >> >> >> > =============================================================================== > >> MPTable >> >> looking for EBDA pointer @ 0x040e, found, searching EBDA @ 0x0009e800 >> searching CMOS 'top of mem' @ 0x0009e400 (633K) >> searching default 'top of mem' @ 0x0009fc00 (639K) >> searching BIOS @ 0x000f0000 >> >> MP FPS found in BIOS @ physical addr: 0x000fe200 >> >> ------------------------------------------------------------------------------- >> >> MP Floating Pointer Structure: >> >> location: BIOS >> physical address: 0x000fe200 >> signature: '_MP_' >> length: 16 bytes >> version: 1.4 >> checksum: 0x9f >> mode: Virtual Wire >> >> ------------------------------------------------------------------------------- >> >> MP Config Table Header: >> >> physical address: 0x000fe210 >> signature: 'PCMP' >> base table length: 64 >> version: 1.4 >> checksum: 0x7f >> OEM ID: '' >> Product ID: '' >> OEM table pointer: 0x00000000 >> OEM table size: 0 >> entry count: 1 >> local APIC address: 0xfee00000 >> extended table length: 0 >> extended table checksum: 0 >> >> ------------------------------------------------------------------------------- >> >> MP Config Base Table Entries: >> >> -- >> Processors: APIC ID Version State Family Model Step >> Flags >> 0 0x14 BSP, usable 15 6 4 >> 0xbfebfbff >> >> >> > =============================================================================== > >> while in dmesg >> >> Copyright (c) 1992-2007 The FreeBSD Project. >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 >> The Regents of the University of California. All rights reserved. >> FreeBSD is a registered trademark of The FreeBSD Foundation. >> FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 >> tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D >> WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant >> WARNING: MPSAFE network stack disabled, expect reduced performance. >> Timecounter "i8254" frequency 1193182 Hz quality 0 >> CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) >> Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 >> >> >> > Features=0xbfebfbff >> ,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> >> Features2=0xe49d,> >> AMD Features=0x20100000 >> AMD Features2=0x1 >> real memory = 1046757376 (998 MB) >> avail memory = 1015095296 (968 MB) >> ACPI APIC Table: >> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs >> cpu0 (BSP): APIC ID: 0 >> cpu1 (AP): APIC ID: 1 >> ioapic0: Changing APIC ID to 2 >> ioapic0 irqs 0-23 on motherboard >> >> [...] >> SMP: AP CPU #1 Launched! >> >> The kernel is, of course, SMP. >> >> What can I do, where can I search for solution? >> >> Second core IS enabled in BIOS >> cluster-one# sysctl hw | grep cpu >> hw.ncpu: 2 >> hw.acpi.cpu.cx_supported: C1/0 >> hw.acpi.cpu.cx_lowest: C1 >> hw.acpi.cpu.cx_usage: 100.00% >> cluster-one# sysctl machdep | grep cpu >> machdep.cpu_idle_hlt: 1 >> machdep.hlt_cpus: 2 >> machdep.hlt_logical_cpus: 0 >> machdep.logical_cpus_mask: 2 >> >> so second CPU is halted, attempt to start it with sysctl does not help >> Alex. >> > > It's seeing it as an HTT thread. Try > changing 'machdep.hyperthreading_allowed'. > > Well, it is a Pentium D. It is supposed to have two cores, not just hyperthreading! How can it be at all? Alex. From owner-freebsd-smp@FreeBSD.ORG Wed Apr 25 19:28:32 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D323216A408 for ; Wed, 25 Apr 2007 19:28:32 +0000 (UTC) (envelope-from matrix@itlegion.ru) Received: from corpmail.itlegion.ru (corpmail.itlegion.ru [84.21.226.211]) by mx1.freebsd.org (Postfix) with SMTP id E248B13C45E for ; Wed, 25 Apr 2007 19:28:31 +0000 (UTC) (envelope-from matrix@itlegion.ru) Received: (qmail 94463 invoked from network); 25 Apr 2007 23:01:49 +0400 Received: from unknown (HELO Artem) (192.168.0.12) by 84.21.226.211 with SMTP; 25 Apr 2007 23:01:49 +0400 X-AntiVirus: Checked by Dr.Web [version: 4.33, engine: 4.33.5.10110, virus records: 196306, updated: 25.04.2007] Message-ID: <004e01c7876c$2ce8a3d0$0c00a8c0@Artem> From: "Artem Kuchin" To: "John Baldwin" , References: <462F15B4.4010201@webmail.sub.ru> <200704251208.34248.jhb@freebsd.org> Date: Wed, 25 Apr 2007 23:01:44 +0400 Organization: IT Legion MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="koi8-r"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3028 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 Cc: freebsd-smp@freebsd.org, FreeBSD Stable Subject: Re: 6.2-RELEASE does not use second CPU on pentium D X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 19:28:32 -0000 John Baldwin wrote: > On Wednesday 25 April 2007 04:47:48 am Alex Povolotsky wrote: >> Hello! >> >> I have a Pentium D box, running 6.2-RELEASE. In dmesg, I see CPU#1 >> launched, but I never see any process running on it, and mptable >> shows Hmm. I am running PentiumD 3.0 Ghz on Asus p5p800-vm motherboard. Needed to update BIOS to make CPU work correctly. Also, i am not running RELEASE. I run 6.2-STABLE cvsupped regulary. I have no problem like that, top shows 0 and 1 in C column for different processes. So,I'd simply recomment to cvs and rebuild the kernel and update your MB BIOS to the latest. -- Regards, Artem From owner-freebsd-smp@FreeBSD.ORG Wed Apr 25 19:57:16 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E322F16A401; Wed, 25 Apr 2007 19:57:15 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from server.baldwin.cx (66-23-211-162.clients.speedfactory.net [66.23.211.162]) by mx1.freebsd.org (Postfix) with ESMTP id 61E9813C468; Wed, 25 Apr 2007 19:57:15 +0000 (UTC) (envelope-from jhb@freebsd.org) Received: from localhost.corp.yahoo.com (john@localhost [127.0.0.1]) (authenticated bits=0) by server.baldwin.cx (8.13.8/8.13.8) with ESMTP id l3PJv7lu068823; Wed, 25 Apr 2007 15:57:08 -0400 (EDT) (envelope-from jhb@freebsd.org) From: John Baldwin To: Alex Povolotsky Date: Wed, 25 Apr 2007 15:57:02 -0400 User-Agent: KMail/1.9.6 References: <462F15B4.4010201@webmail.sub.ru> <200704251208.34248.jhb@freebsd.org> <462FA9E5.5010300@webmail.sub.ru> In-Reply-To: <462FA9E5.5010300@webmail.sub.ru> MIME-Version: 1.0 Content-Type: text/plain; charset="koi8-r" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200704251557.02688.jhb@freebsd.org> X-Greylist: Sender succeeded SMTP AUTH authentication, not delayed by milter-greylist-2.0.2 (server.baldwin.cx [127.0.0.1]); Wed, 25 Apr 2007 15:57:08 -0400 (EDT) X-Virus-Scanned: ClamAV 0.88.3/3162/Wed Apr 25 14:43:55 2007 on server.baldwin.cx X-Virus-Status: Clean X-Spam-Status: No, score=-4.4 required=4.2 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on server.baldwin.cx Cc: FreeBSD Stable , freebsd-smp@freebsd.org, freebsd-hardware@freebsd.org Subject: Re: 6.2-RELEASE does not use second CPU on pentium D X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Apr 2007 19:57:16 -0000 On Wednesday 25 April 2007 03:20:05 pm Alex Povolotsky wrote: > John Baldwin wrote: > > On Wednesday 25 April 2007 04:47:48 am Alex Povolotsky wrote: > > > >> Hello! > >> > >> I have a Pentium D box, running 6.2-RELEASE. In dmesg, I see CPU#1 > >> launched, but I never see any process running on it, and mptable shows > >> > >> cluster-one# mptable -verbose > >> > >> > >> > > =============================================================================== > > > >> MPTable > >> > >> looking for EBDA pointer @ 0x040e, found, searching EBDA @ 0x0009e800 > >> searching CMOS 'top of mem' @ 0x0009e400 (633K) > >> searching default 'top of mem' @ 0x0009fc00 (639K) > >> searching BIOS @ 0x000f0000 > >> > >> MP FPS found in BIOS @ physical addr: 0x000fe200 > >> > >> ------------------------------------------------------------------------------- > >> > >> MP Floating Pointer Structure: > >> > >> location: BIOS > >> physical address: 0x000fe200 > >> signature: '_MP_' > >> length: 16 bytes > >> version: 1.4 > >> checksum: 0x9f > >> mode: Virtual Wire > >> > >> ------------------------------------------------------------------------------- > >> > >> MP Config Table Header: > >> > >> physical address: 0x000fe210 > >> signature: 'PCMP' > >> base table length: 64 > >> version: 1.4 > >> checksum: 0x7f > >> OEM ID: '' > >> Product ID: '' > >> OEM table pointer: 0x00000000 > >> OEM table size: 0 > >> entry count: 1 > >> local APIC address: 0xfee00000 > >> extended table length: 0 > >> extended table checksum: 0 > >> > >> ------------------------------------------------------------------------------- > >> > >> MP Config Base Table Entries: > >> > >> -- > >> Processors: APIC ID Version State Family Model Step > >> Flags > >> 0 0x14 BSP, usable 15 6 4 > >> 0xbfebfbff > >> > >> > >> > > =============================================================================== > > > >> while in dmesg > >> > >> Copyright (c) 1992-2007 The FreeBSD Project. > >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > >> The Regents of the University of California. All rights reserved. > >> FreeBSD is a registered trademark of The FreeBSD Foundation. > >> FreeBSD 6.2-RELEASE-p3 #2: Thu Apr 19 00:19:54 MSD 2007 > >> tarkhil@cluster-one.zinester.com:/usr/obj/usr/src/sys/P4D > >> WARNING: debug.mpsafenet forced to 0 as ipsec requires Giant > >> WARNING: MPSAFE network stack disabled, expect reduced performance. > >> Timecounter "i8254" frequency 1193182 Hz quality 0 > >> CPU: Intel(R) Pentium(R) D CPU 2.80GHz (2808.41-MHz 686-class CPU) > >> Origin = "GenuineIntel" Id = 0xf64 Stepping = 4 > >> > >> > >> > > Features=0xbfebfbff > > >> ,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE> > >> Features2=0xe49d,> > >> AMD Features=0x20100000 > >> AMD Features2=0x1 > >> real memory = 1046757376 (998 MB) > >> avail memory = 1015095296 (968 MB) > >> ACPI APIC Table: > >> FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs > >> cpu0 (BSP): APIC ID: 0 > >> cpu1 (AP): APIC ID: 1 > >> ioapic0: Changing APIC ID to 2 > >> ioapic0 irqs 0-23 on motherboard > >> > >> [...] > >> SMP: AP CPU #1 Launched! > >> > >> The kernel is, of course, SMP. > >> > >> What can I do, where can I search for solution? > >> > >> Second core IS enabled in BIOS > >> cluster-one# sysctl hw | grep cpu > >> hw.ncpu: 2 > >> hw.acpi.cpu.cx_supported: C1/0 > >> hw.acpi.cpu.cx_lowest: C1 > >> hw.acpi.cpu.cx_usage: 100.00% > >> cluster-one# sysctl machdep | grep cpu > >> machdep.cpu_idle_hlt: 1 > >> machdep.hlt_cpus: 2 > >> machdep.hlt_logical_cpus: 0 > >> machdep.logical_cpus_mask: 2 > >> > >> so second CPU is halted, attempt to start it with sysctl does not help > >> Alex. > >> > > > > It's seeing it as an HTT thread. Try > > changing 'machdep.hyperthreading_allowed'. > > > > > > Well, it is a Pentium D. It is supposed to have two cores, not just > hyperthreading! How can it be at all? Because multicores actually show up as HTT and you have to do extra work to figure out if they are really cores or threads, and apparently 6.2 gets it wrong on your machine. -- John Baldwin From owner-freebsd-smp@FreeBSD.ORG Thu Apr 26 00:23:28 2007 Return-Path: X-Original-To: freebsd-smp@freebsd.org Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 3FD5A16A402; Thu, 26 Apr 2007 00:23:28 +0000 (UTC) (envelope-from kayve@sfsu.edu) Received: from iron2.sfsu.edu (iron2.sfsu.edu [130.212.10.36]) by mx1.freebsd.org (Postfix) with ESMTP id 1FFA613C45A; Thu, 26 Apr 2007 00:23:28 +0000 (UTC) (envelope-from kayve@sfsu.edu) Received: from smtp01.sfsu.edu ([130.212.10.100]) by iron2.sfsu.edu with ESMTP; 25 Apr 2007 17:02:57 -0700 X-onepass: IPPSC X-IronPort-Anti-Spam-Filtered: true X-IronPort-Anti-Spam-Result: Ao8CAJiIL0aC1Apk/2dsb2JhbAA Received: from libra.sfsu.edu ([130.212.10.238]) by mail05a.sfsu.edu (Lotus Domino Release 7.0) with ESMTP id 2007042516445160-567 ; Wed, 25 Apr 2007 16:44:51 -0700 Date: Wed, 25 Apr 2007 16:44:51 -0700 (PDT) From: KAYVEN RIESE In-Reply-To: <004e01c7876c$2ce8a3d0$0c00a8c0@Artem> Message-ID: References: <462F15B4.4010201@webmail.sub.ru> <200704251208.34248.jhb@freebsd.org> <004e01c7876c$2ce8a3d0$0c00a8c0@Artem> MIME-Version: 1.0 X-MIMETrack: Itemize by SMTP Server on MAIL05a/SERVERS/SFSU(Release 7.0|August 18, 2005) at 04/25/2007 16:44:51, Serialize by Router on SMTP01/SERVERS/SFSU(Release 7.0.2FP1|January 10, 2007) at 04/25/2007 17:02:56, Serialize complete at 04/25/2007 17:02:56 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: FreeBSD Stable , freebsd-smp@freebsd.org, freebsd-hardware@freebsd.org Subject: mesg = dmesg X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Apr 2007 00:23:28 -0000 i sent a post from a puter with a bad "d" key. that's why my subject didn't say "dmesg" like it should have. sorry. here is a dmesg output: Copyright (c) 1992-2006 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.1-RELEASE #0: Sun May 7 04:32:43 UTC 2006 root@opus.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: Intel(R) Pentium(R) M processor 1.73GHz (600.02-MHz 686-class CPU) Origin = "GenuineIntel" Id = 0x6d8 Stepping = 8 Features=0xafe9fbff Features2=0x180 AMD Features=0x100000 real memory = 536084480 (511 MB) avail memory = 515223552 (491 MB) kbd1 at kbdmux0 acpi0: on motherboard ACPI-0356: *** Error: Region EmbeddedControl(3) has no handler ACPI-1304: *** Error: Method execution failed [\\_SB_.PCI0.SBRG.EC0_.ACS_] (Node 0xc33998c0), AE_NOT_EXIST ACPI-1304: *** Error: Method execution failed [\\_SB_.AC__._INI] (Node 0xc33993e0), AE_NOT_EXIST ACPI-0356: *** Error: Region EmbeddedControl(3) has no handler ACPI-1304: *** Error: Method execution failed [\\_SB_.PCI0.SBRG.EC0_.BATS] (Node 0xc33998a0), AE_NOT_EXIST ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._STA] (Node 0xc339d720), AE_NOT_EXIST ACPI-0239: *** Error: Method execution failed [\\_SB_.BAT0._STA] (Node 0xc339d720), AE_NOT_EXIST acpi0: Power Button (fixed) acpi_ec0: port 0x62,0x66 on acpi0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0 cpu0: on acpi0 acpi_throttle0: on cpu0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 agp0: mem 0xe0000000-0xefffffff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pci1: at device 0.0 (no driver attached) uhci0: port 0xe800-0xe81f irq 11 at device 29.0 on pci0 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xe880-0xe89f irq 5 at device 29.1 on pci0 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xec00-0xec1f irq 10 at device 29.2 on pci0 uhci2: [GIANT-LOCKED] usb2: on uhci2 usb2: USB revision 1.0 uhub2: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered ehci0: mem 0xffaffc00-0xffafffff irq 10 at device 29.7 on pci0 ehci0: [GIANT-LOCKED] usb3: EHCI version 1.0 usb3: companion controllers, 2 ports each: usb0 usb1 usb2 usb3: on ehci0 usb3: USB revision 2.0 uhub3: Intel EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 uhub3: 6 ports with 6 removable, self powered pcib2: at device 30.0 on pci0 pci2: on pcib2 bge0: mem 0xff9f0000-0xff9fffff irq 4 at device 0.0 on pci2 miibus0: on bge0 brgphy0: on miibus0 brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX, 1000baseTX-FDX, auto bge0: Ethernet address: 00:11:d8:22:c9:91 cbb0: at device 1.0 on pci2 cardbus0: on cbb0 pccard0: <16-bit PCCard bus> on cbb0 cbb1: at device 1.1 on pci2 cardbus1: on cbb1 pccard1: <16-bit PCCard bus> on cbb1 fwohci0: mem 0xff9ef800-0xff9effff irq 10 at device 1.2 on pci2 fwohci0: OHCI version 1.0 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:e0:18:00:03:26:4c:e9 fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:e0:18:26:4c:e9 fwe0: Ethernet address: 02:e0:18:26:4c:e9 fwe0: if_start running deferred for Giant sbp0: on firewire0 fwohci0: Initiate bus reset fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me) firewire0: bus manager 0 (me) pci2: at device 2.0 (no driver attached) isab0: at device 31.0 on pci0 isa0: on isab0 atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf at device 31.1 on pci0 ata0: on atapci0 ata1: on atapci0 pci0: at device 31.5 (no driver attached) pci0: at device 31.6 (no driver attached) acpi_lid0: on acpi0 acpi_button0: on acpi0 acpi_acad0: on acpi0 battery0: on acpi0 battery1: on acpi0 acpi_button1: on acpi0 acpi_tz0: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model Generic PS/2 mouse, device ID 0 sio0: configured irq 3 not in bitmap of probed irqs 0 sio0: port may not be enabled sio0 port 0x2f8-0x2ff irq 3 drq 1 flags 0x10 on acpi0 sio0: type 16550A ppc0: port 0x378-0x37f,0x778-0x77f irq 7 drq 3 on acpi0 ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode ppc0: FIFO with 16/16/8 bytes threshold ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xcffff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ums0: vendor 0x2222 Macally Optigo USB Mouse, rev 1.10/6.30, addr 2, iclass 3/1 ums0: 3 buttons and Z dir. Timecounter "TSC" frequency 600023816 Hz quality 800 Timecounters tick every 1.000 msec ad0: 57231MB at ata0-master UDMA100 ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE acd0: DVDR at ata1-master UDMA33 Trying to mount root from ufs:/dev/ad0s1a ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE ACPI-1304: *** Error: Method execution failed [\\_SB_.BAT0._BST] (Node 0xc339d740), AE_AML_NO_RETURN_VALUE bge0: link state changed to UP