From owner-freebsd-stable@FreeBSD.ORG Tue Jan 1 01:05:14 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A8CC96B3 for ; Tue, 1 Jan 2013 01:05:14 +0000 (UTC) (envelope-from kamikaze@bsdforen.de) Received: from mail.server1.bsdforen.de (bsdforen.de [82.193.243.81]) by mx1.freebsd.org (Postfix) with ESMTP id 32DAB8FC08 for ; Tue, 1 Jan 2013 01:05:13 +0000 (UTC) Received: from mobileKamikaze.norad (HSI-KBW-134-3-231-194.hsi14.kabel-badenwuerttemberg.de [134.3.231.194]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.server1.bsdforen.de (Postfix) with ESMTPSA id 8020A7E884; Tue, 1 Jan 2013 02:05:11 +0100 (CET) Message-ID: <50E23647.6000309@bsdforen.de> Date: Tue, 01 Jan 2013 02:05:11 +0100 From: Dominic Fandrey User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Chris Rees Subject: Re: Post 9.1 stable file system problems References: <50E225DF.3090004@bsdforen.de> <50E23283.8010407@bsdforen.de> In-Reply-To: <50E23283.8010407@bsdforen.de> X-Enigmail-Version: 1.4.6 Content-Type: text/plain; charset=ascii Content-Transfer-Encoding: 7bit Cc: FreeBSD X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2013 01:05:14 -0000 On 01/01/2013 01:49, Dominic Fandrey wrote: > On 01/01/2013 01:29, Chris Rees wrote: >> On 1 Jan 2013 00:01, "Dominic Fandrey" wrote: >>> >>> I have a Tinderbox that I just updated to the current RELENG_9. >>> Following the update build times for packages have increased by a >>> factor between 5 and 20. I.e. I have packages that used to build in >>> 5 minutes and now take an hour. >>> >>> I'm suspecting the file system ever since I saw that the majority of CPU >>> load was caused by ls when I looked at top (more than 2 minutes of CPU >>> time were counted that moment). The majority of the time most of the CPU >>> load is caused by bsdtar, pkg_add, qmake-qt4, etc. Without exception >>> tools that access a lot of files. >>> >>> The file system on which packages are built is nullfs mounted from >>> an async mounted UFS. I turned async off, to no avail. >>> >>> /usr/src/UPDATING says that there were nullfs optimisations. So I >>> think this is where the problem originates. I might hack the tinderbox to >>> use 'ln -s' or set it up for NFS to verify this. >> >> Is your kernel newer than the Jail? The converse causes problems. > > I ran makeJail for all jails after updating. > > I also seem to have similar problems when building in the host-system. > The unzip for openjdk-7 has just passed the 11 minutes CPU time mark. > On my notebook it takes less than 10 seconds. Just set WRKOBJDIRPREFIX to a tmpfs on the Tinderbox host system and the extract takes less than a second. Originally WRKOBJDIRPREFIX also pointed to a nullfs mount. Afterwards I pointed WRKOBJDIRPREFIX to a UFS file system (without nullfs involvement). The entire make extract took 20s. So still faster by at least factor 30 than running it on a nullfs mount (I eventually SIGINTed so I don't know how long it would've run). -- A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing on usenet and in e-mail?