From owner-freebsd-stable@FreeBSD.ORG Sat Jun 24 19:09:19 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BF11016A4C4 for ; Sat, 24 Jun 2006 19:09:19 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from fw.zoral.com.ua (ll-227.216.82.212.sovam.net.ua [212.82.216.227]) by mx1.FreeBSD.org (Postfix) with ESMTP id 87B5743D58 for ; Sat, 24 Jun 2006 19:09:18 +0000 (GMT) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by fw.zoral.com.ua (8.13.4/8.13.4) with ESMTP id k5OJ9DQR097058 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Sat, 24 Jun 2006 22:09:13 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.13.6/8.13.6) with ESMTP id k5OJ9Dc4094184; Sat, 24 Jun 2006 22:09:13 +0300 (EEST) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.13.6/8.13.6/Submit) id k5OJ9Cqr094183; Sat, 24 Jun 2006 22:09:12 +0300 (EEST) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Sat, 24 Jun 2006 22:09:12 +0300 From: Kostik Belousov To: "Marc G. Fournier" Message-ID: <20060624190912.GD79678@deviant.kiev.zoral.com.ua> References: <20060623172557.H1114@ganymede.hub.org> <261AD16B-C3FE-4671-996E-563053508CE8@mac.com> <20060624022227.X1114@ganymede.hub.org> <20060624115505.E14669@woozle.rinet.ru> <20060624090656.GB79678@deviant.kiev.zoral.com.ua> <20060624145432.A1114@ganymede.hub.org> <20060624185203.GC79678@deviant.kiev.zoral.com.ua> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="jousvV0MzM2p6OtC" Content-Disposition: inline In-Reply-To: <20060624185203.GC79678@deviant.kiev.zoral.com.ua> User-Agent: Mutt/1.4.2.1i X-Virus-Scanned: ClamAV version 0.88.2, clamav-milter version 0.88.2 on fw.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=0.4 required=5.0 tests=ALL_TRUSTED, DNS_FROM_RFC_ABUSE,SPF_NEUTRAL autolearn=no version=3.1.3 X-Spam-Checker-Version: SpamAssassin 3.1.3 (2006-06-01) on fw.zoral.com.ua Cc: freebsd-stable@freebsd.org, Dmitry Morozovsky Subject: Re: vmstat 'b' (disk busy?) field keeps climbing ... X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Jun 2006 19:09:19 -0000 --jousvV0MzM2p6OtC Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Jun 24, 2006 at 09:52:03PM +0300, Kostik Belousov wrote: > On Sat, Jun 24, 2006 at 02:57:27PM -0300, Marc G. Fournier wrote: > > On Sat, 24 Jun 2006, Kostik Belousov wrote: > >=20 > > >On Sat, Jun 24, 2006 at 11:55:26AM +0400, Dmitry Morozovsky wrote: > > >>On Sat, 24 Jun 2006, Marc G. Fournier wrote: > > >> > > >>MGF> > 'b' stands for "blocked", not "busy". Judging by your page fa= ult=20 > > >>rate > > >>MGF> > and the high number of frees and pages being scanned, you're= =20 > > >>probably > > >>MGF> > swapping tasks in and out and are waiting on disk. Take a loo= k at > > >>MGF> > "vmstat -s", and consider adding more RAM if this is correct... > > >>MGF> > > >>MGF> is there a way of finding out what processes are blocked? > > >> > > >>Aren't they in 'D' status by ps? > > >Use ps axlww. In this way, at least actual blocking points are shown. > >=20 > > 'k, stupid question then ... what am I searching for? > >=20 > > # ps axlww | awk '{print $9}' | sort | uniq -c | sort -nr > > 654 select > > 230 lockf > > 166 wait > > 85 - > > 80 piperd > > 71 nanslp > > 33 kserel > > 22 user > > 10 pause > > 9 ttyin > > 5 sbwait > > 3 psleep > > 3 accept > > 2 kqread > > 2 Giant > > 1 vlruwt > > 1 syncer > > 1 sdflus > > 1 ppwait > > 1 ktrace > > 1 MWCHAN > >=20 > > According to vmstat, I'm holding at '4 blocked' for the most part ...= =20 > > sbwwait is socket related, not disk ... and none of the others look rig= ht=20 > > ... > I would say, using big magic cristall ball, that you problems are > not kernel-related. I see only too suspicious points: >=20 > 1. high number of pipe readers and waiters for file locks. It may be=20 > normal for your load. >=20 > 2. 2 Giant holders/lockers. Is it constant ? Are the processes holding/wa= iting > for Giant are the same ? >=20 > Anyway, being in your shoes, I would start looking at applications. >=20 > Ah, and does dmesg show anything ? And another question: what are the processes in the state "user" ? I never see that state. More, search thru the sources does not show what this could be. --jousvV0MzM2p6OtC Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.3 (FreeBSD) iD8DBQFEnY3XC3+MBN1Mb4gRAiA9AKDLjmE0r1YtEHQUcwX/gkX6Mse4VwCfbzPC yod9lPAKIpqBucGp3P18rjQ= =4QRz -----END PGP SIGNATURE----- --jousvV0MzM2p6OtC--