From owner-freebsd-performance@FreeBSD.ORG Tue Nov 6 19:32:40 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 294A916A419 for ; Tue, 6 Nov 2007 19:32:40 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id B50A813C4A3 for ; Tue, 6 Nov 2007 19:32:39 +0000 (UTC) (envelope-from nico-freebsd-performance@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 80DC72072D3; Tue, 6 Nov 2007 20:33:05 +0100 (CET) Date: Tue, 6 Nov 2007 20:33:05 +0100 From: Nico -telmich- Schottelius To: Manjunath R Gowda Message-ID: <20071106193305.GJ15790@schottelius.org> References: <20071106122820.GA28254@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="AXxEqdD4tcVTjWte" Content-Disposition: inline In-Reply-To: User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.23.1-denkbrett on i686 Cc: freebsd-performance@freebsd.org Subject: Re: Performance of disk i/o with 3ware X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Nov 2007 19:32:40 -0000 --AXxEqdD4tcVTjWte Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Manjunath R Gowda [Tue, Nov 06, 2007 at 09:54:09AM -0800]: > On 11/6/07, Nico -telmich- Schottelius < > nico-freebsd-performance@schottelius.org> wrote: > > > > Hello! > > > > I've the problem that sometimes there are many disk waiting processes > > (sysctl -n vm.vmtotal), but systat -vmstat shows da0 and da1 busy with > > 0-10%. >=20 > I woudn't worry about how many are sleeping. But, How long they sleep wou= ld > be interesting data. And also why they sleep. Having about 700 processes in sleep state plus 400 processes in diskwait state makes me wonder somehow. There are also some processes from cron, which are older and also in state "I" (as shown by ps). > > I guess that the disk i/o is at about 100%, but wondering why I see > > those strange values. >=20 > Why do you think it should be 100%? Are you running any disk I/O intense > application? Because it's the well known bottleneck in that server: - it has 4 cpus, which are about 30-50% idle - it has 4 GiB ram, of which 2GiB is mostly inactive - it has 4 10k rpm hds in 2 raid1 disk arrays, one for the mailboxes + root and one for the qmail-queue Normally systat -vmstat shows 80-100% busy state on the disk arrays, but currently it's at about 10%, which cannot be right. I think I'll have a look closer look at the patch we used from CVS to patch= the 3ware twa driver. > > Anyone an idea, > > a) why systat -vmstat shows so small busy values? > > b) how to debug it further? >=20 > You can try experimenting with diffrent I/O loads to make sure that there > is a problem before start debugging it. There is a big problem, that even results in taking about 30 seconds until the '220' messages comes from qmail when connecting via telnet =66rom outside to it. To summarise, what runs on the server: - qmail + patches =3D> has /var/qmail/queue on it's own disk-array - courier imapd - vpopmail (pop3 auth) - mysql (needed by vpopmail) - clamd - spamassassin - Webmail (horde on apache) So it's mainly a customer mailserver, with nothing special installed, which may have some load, but not in the way it's not explainable. So I'm still hoping somebody with similar problems reads this mail ;-) Sincerly Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --AXxEqdD4tcVTjWte Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFHMMFxuL75KpiFGIwRAoKxAKDjh7aN8n/b7B3YPqcdKuqMPv9CGACgsGuf lI6wV4jUuP8GnUhd37oW/mQ= =4Yn4 -----END PGP SIGNATURE----- --AXxEqdD4tcVTjWte--