From owner-freebsd-stable@FreeBSD.ORG Tue Jan 1 13:39:47 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C5E93851 for ; Tue, 1 Jan 2013 13:39:47 +0000 (UTC) (envelope-from kamikaze@bsdforen.de) Received: from mail.server1.bsdforen.de (bsdforen.de [82.193.243.81]) by mx1.freebsd.org (Postfix) with ESMTP id 61BFB8FC08 for ; Tue, 1 Jan 2013 13:39:46 +0000 (UTC) Received: from mobileKamikaze.norad (HSI-KBW-134-3-231-194.hsi14.kabel-badenwuerttemberg.de [134.3.231.194]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.server1.bsdforen.de (Postfix) with ESMTPSA id 7DAAF85FCF; Tue, 1 Jan 2013 14:39:44 +0100 (CET) Message-ID: <50E2E720.3040803@bsdforen.de> Date: Tue, 01 Jan 2013 14:39:44 +0100 From: Dominic Fandrey User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/17.0 Thunderbird/17.0 MIME-Version: 1.0 To: Konstantin Belousov Subject: Re: Post 9.1 stable file system problems References: <50E225DF.3090004@bsdforen.de> <50E23283.8010407@bsdforen.de> <50E23647.6000309@bsdforen.de> <20130101065145.GT82219@kib.kiev.ua> In-Reply-To: <20130101065145.GT82219@kib.kiev.ua> X-Enigmail-Version: 1.4.6 Content-Type: text/plain; charset=ascii Content-Transfer-Encoding: 7bit Cc: FreeBSD , Chris Rees X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 01 Jan 2013 13:39:47 -0000 On 01/01/2013 07:51, Konstantin Belousov wrote: > On Tue, Jan 01, 2013 at 02:05:11AM +0100, Dominic Fandrey wrote: >> On 01/01/2013 01:49, Dominic Fandrey wrote: >>> On 01/01/2013 01:29, Chris Rees wrote: >>>> On 1 Jan 2013 00:01, "Dominic Fandrey" wrote: >>>>> >>>>> I have a Tinderbox that I just updated to the current RELENG_9. >>>>> Following the update build times for packages have increased by a >>>>> factor between 5 and 20. I.e. I have packages that used to build in >>>>> 5 minutes and now take an hour. >>>>> >>>>> I'm suspecting the file system ever since I saw that the majority of CPU >>>>> load was caused by ls when I looked at top (more than 2 minutes of CPU >>>>> time were counted that moment). The majority of the time most of the CPU >>>>> load is caused by bsdtar, pkg_add, qmake-qt4, etc. Without exception >>>>> tools that access a lot of files. >>>>> >>>>> The file system on which packages are built is nullfs mounted from >>>>> an async mounted UFS. I turned async off, to no avail. >>>>> >>>>> /usr/src/UPDATING says that there were nullfs optimisations. So I >>>>> think this is where the problem originates. I might hack the tinderbox to >>>>> use 'ln -s' or set it up for NFS to verify this. >>>> >>>> Is your kernel newer than the Jail? The converse causes problems. >>> >>> I ran makeJail for all jails after updating. >>> >>> I also seem to have similar problems when building in the host-system. >>> The unzip for openjdk-7 has just passed the 11 minutes CPU time mark. >>> On my notebook it takes less than 10 seconds. >> >> Just set WRKOBJDIRPREFIX to a tmpfs on the Tinderbox host system >> and the extract takes less than a second. Originally WRKOBJDIRPREFIX >> also pointed to a nullfs mount. >> >> Afterwards I pointed WRKOBJDIRPREFIX to a UFS file system (without >> nullfs involvement). The entire make extract took 20s. >> >> So still faster by at least factor 30 than running it on a nullfs mount >> (I eventually SIGINTed so I don't know how long it would've run). > > Start providing some useful debugging information ? That one might be interesting. It's all system time: # time -lh make extract ===> License GPLv2 accepted by the user ===> Found saved configuration for openjdk-7.9.05_1 ===> Extracting for openjdk-7.9.05_2 => SHA256 Checksum OK for openjdk-7u6-fcs-src-b24-09_aug_2012.zip. => SHA256 Checksum OK for apache-ant-1.8.4-bin.zip. ===> openjdk-7.9.05_2 depends on file: /usr/local/bin/unzip - found ^Ctime: command terminated abnormally 4m29.30s real 3.03s user 4m22.55s sys 5008 maximum resident set size 135 average shared memory size 2932 average unshared data size 127 average unshared stack size 7772 page reclaims 0 page faults 0 swaps 19 block input operations 101 block output operations 0 messages sent 0 messages received 41 signals received 1597 voluntary context switches 16590 involuntary context switches -- A: Because it fouls the order in which people normally read text. Q: Why is top-posting such a bad thing? A: Top-posting. Q: What is the most annoying thing on usenet and in e-mail?