From owner-freebsd-fs@FreeBSD.ORG Tue Jan 23 13:39:36 2007 Return-Path: X-Original-To: fs@freebsd.org Delivered-To: freebsd-fs@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 281EA16A403 for ; Tue, 23 Jan 2007 13:39:36 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from relay02.kiev.sovam.com (relay02.kiev.sovam.com [62.64.120.197]) by mx1.freebsd.org (Postfix) with ESMTP id B588513C469 for ; Tue, 23 Jan 2007 13:39:35 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from [212.82.216.227] (helo=fw.zoral.com.ua) by relay02.kiev.sovam.com with esmtps (TLSv1:AES256-SHA:256) (Exim 4.60) (envelope-from ) id 1H9Lry-000F5d-CA for fs@freebsd.org; Tue, 23 Jan 2007 15:39:35 +0200 Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by fw.zoral.com.ua (8.13.4/8.13.4) with ESMTP id l0NDdLpj001494 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 23 Jan 2007 15:39:22 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8) with ESMTP id l0NDdLHo091733; Tue, 23 Jan 2007 15:39:21 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8/Submit) id l0NDdL4L091732; Tue, 23 Jan 2007 15:39:21 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Tue, 23 Jan 2007 15:39:21 +0200 From: Kostik Belousov To: Bruce Evans Message-ID: <20070123133921.GL71333@deviant.kiev.zoral.com.ua> References: <20070123233124.R33734@delplex.bde.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="00hq2S6J2Jlg6EbK" Content-Disposition: inline In-Reply-To: <20070123233124.R33734@delplex.bde.org> User-Agent: Mutt/1.4.2.2i X-Virus-Scanned: ClamAV version 0.88.7, clamav-milter version 0.88.7 on fw.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=-0.1 required=5.0 tests=ALL_TRUSTED,SPF_NEUTRAL autolearn=failed version=3.1.7 X-Spam-Checker-Version: SpamAssassin 3.1.7 (2006-10-05) on fw.zoral.com.ua X-Scanner-Signature: b11a0dd960b728cbee92fea3b4ac1d10 X-DrWeb-checked: yes X-SpamTest-Envelope-From: kostikbel@gmail.com X-SpamTest-Group-ID: 00000000 X-SpamTest-Info: Profiles 702 [Jan 23 2007] X-SpamTest-Info: helo_type=3 X-SpamTest-Info: {received from trusted relay: not dialup} X-SpamTest-Method: none X-SpamTest-Method: Local Lists X-SpamTest-Rate: 0 X-SpamTest-Status: Not detected X-SpamTest-Status-Extended: not_detected X-SpamTest-Version: SMTP-Filter Version 3.0.0 [0255], KAS30/Release Cc: fs@freebsd.org Subject: Re: more lost dotdot caching pessimizes nfs especially X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 23 Jan 2007 13:39:36 -0000 --00hq2S6J2Jlg6EbK Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 24, 2007 at 12:18:38AM +1100, Bruce Evans wrote: > I suspect that recent locking fixes near dotdot are responsible for > slowing down builds over nfs even further by increasing the number > of RPCs. Times and RPC counts for building a RELENG_4 kernel under > -current on a Turion X2 2GHz: >=20 > With i386 SMP kernel built a few days ago: > %%% > make depend: > 9.31 real 5.04 user 1.25 sys > Lookup Read Write Access Getattr Other Total > 1269 541 591 20633 447 112 23593 >=20 > make: > 67.28 real 55.55 user 3.86 sys > Lookup Read Write Create Access Fsstat Other Total > 4633 2370 5291 436 22269 1726 14 36739 > %%% >=20 > With i386 SMP kernel built an hour ago: > %%% > make depend: > 13.70 real 5.38 user 1.56 sys > Lookup Read Write Access Getattr Other Total > 14008 541 591 38615 447 96 54298 >=20 > make: > 71.49 real 55.21 user 4.45 sys > Lookup Read Write Create Access Fsstat Other Total > 19237 2370 5292 436 41860 1714 14 70923 > %%% >=20 > Note that only the number of Lookups and Access's changed significantly > (Access goes with Lookup). >=20 > This is without -j4 so that the slowdown is more obvious. "make depend" > is not parallelized, so -j4 has little effect for it, but -j4 now > speeds "make" up by even more than a factor of 2 by running more RPCs > in parallel. The speedup used to be only from 67.3 to 34.3 seconds, > but now it is from 71.5 to 34.8 seconds. >=20 > This is with my old fixes and hacks to reduce RPCs, and the network > tuned for latency (80 usec ping -f latency). Plain -current would use > about 120000 RPCs for "make" and thus take 10-20 seconds longer. It > would use a bit less than that for "make depend" and thus take 5-10 > seconds longer. "make depend" would take about twice as long as it > should. It can easily take much longer than that on machines with > larger network latency. >=20 Bruce, could you confirm that reversal of rev. 1.97 of vfs_lookup.c would restore the old Lookup/Access RPC statistic ? --00hq2S6J2Jlg6EbK Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFFthAIC3+MBN1Mb4gRAoWUAJ4xsM5HPX5bb1X851EzriXU5x0esQCfRq/j PkM7zaWmF1JToNwfcvT02R0= =kyxA -----END PGP SIGNATURE----- --00hq2S6J2Jlg6EbK--