Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 13 Dec 2006 20:20:35 -0500
From:      Kris Kennaway <kris@obsecurity.org>
To:        Dieter <freebsd@sopwith.solgatos.com>
Cc:        freebsd-questions@freebsd.org
Subject:   Re: processes not getting fair share of available disk I/O
Message-ID:  <20061214012035.GA62554@xor.obsecurity.org>
In-Reply-To: <200612140037.AAA14550@sopwith.solgatos.com>
References:  <20061213232726.GA61149@xor.obsecurity.org> <200612140037.AAA14550@sopwith.solgatos.com>

next in thread | previous in thread | raw e-mail | index | archive | help

--uAKRQypu60I7Lcqm
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Wed, Dec 13, 2006 at 04:37:42PM +0000, Dieter wrote:
> > > Is Giant the only mutex/lock that could be a bottleneck across disks?
> >=20
> > The only one I can think of that is generic.  One would have to do
> > more extensive profiling and diagnosis to try and figure out what is
> > wrong with your system.
>=20
> Suggestions of what to look at would be welcome.

Mutex profiling would show if there is a mutex somehow getting in the
way of your I/O (e.g. if Giant is somehow being forced).  I dont think
it would show anything though.  You can try to study interrupt issues
(e.g. look for an interrupt storm during I/O) with vmstat -i.  Other
than that you'd probably have to get your hands dirtier in the code.

> > The only explanation that seems to fit is that it's something to do
> > with your particular hardware (i.e. driver issue), since it's
> > certainly not a problem on general configurations.
> >=20
> > I know that many people have bad things to say about nforce chipsets,
> > although I dont know if your particular problem has been reported
> > before.
>=20
> Could APIC have anything to do with this?  It is currently turned off in
> firmware.

Problems with interrupt delivery could certainly be relevant.

> Today I experimented with vfs.hirunningspace.  If I crank it up, I get
> better total write speed with multiple drives doing dd from /dev/zero
> to files on disks.  But it doesn't help my real applications, and
> in fact appears to hurt them.

Yes, I don't expect there are any viable high-level workarounds for
this issue at a lower layer.

Kris
--uAKRQypu60I7Lcqm
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (FreeBSD)

iD8DBQFFgKbiWry0BWjoQKURAjUxAKCEkTc17uF19pOkUbQOghWASCkkygCfYLHT
NqMrzYDBtv/q8Ujqt64xn/o=
=WTDV
-----END PGP SIGNATURE-----

--uAKRQypu60I7Lcqm--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20061214012035.GA62554>