From owner-freebsd-stable@FreeBSD.ORG Wed May 2 19:07:36 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9ACB316A403 for ; Wed, 2 May 2007 19:07:36 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 74D9D13C44C for ; Wed, 2 May 2007 19:07:36 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 6AB191A4D86; Wed, 2 May 2007 12:08:10 -0700 (PDT) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 967C651446; Wed, 2 May 2007 15:07:33 -0400 (EDT) Date: Wed, 2 May 2007 15:07:33 -0400 From: Kris Kennaway To: "Mars G. Miro" Message-ID: <20070502190732.GA42282@xor.obsecurity.org> References: <28edec3c0705021139h45c785c2s915941c0afb93b5d@mail.gmail.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <28edec3c0705021139h45c785c2s915941c0afb93b5d@mail.gmail.com> User-Agent: Mutt/1.4.2.2i Cc: freebsd-stable@freebsd.org Subject: Re: mfs and buildworlds on da SunFire x4600 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 May 2007 19:07:36 -0000 On Thu, May 03, 2007 at 02:39:55AM +0800, Mars G. Miro wrote: > Greetz, > > I got my hands on a SunFire x4600. This is a dual-core 8-way > Opteron (dmesg shows 16 CPUs) w/c has 32G RAM. FreeBSD 6.2/amd64 runs > fine on it despite: > - 'reboot' doesnt work, machine just hangs in there. There is a sysctl to specify an alternate reboot method. > - front USB ports wont work for a USB keyboard, just use da ports at da > back. > > I've read a lot of threads in da past (and da BSDCan 2006 paper) > regarding mfs on /usr/src and /usr/obj to speed up buildworlds, > unfortunately it doesnt seem to improve things. I've tried both a > malloc and swap based async non-softupdates mfs (and rebooted da box > every after) but my buildworld speeds seem to be just da same as I do > it on da MPT SAS disk w/c is just around ~18mins. It is probably a combination of issues: 1) There is still some disk access because of accessing things like binaries in /usr. This will hurt more for parallel builds because your disk hardware is single-threaded, so I/O delays will serialize you. If you really wanted you could compare to a build in a md-hosted chroot to completely eliminate the disk, but this is just a game. 2) Buildworld doesn't parallelize well to 16 CPUs. Large parts of it are completely non-parallel. This is probably your main problem. You definitely should be measuring some difference - you need to use time(1) though instead of just estimating. Kris