From owner-freebsd-hackers Fri Jan 19 8:53:23 2001 Delivered-To: freebsd-hackers@freebsd.org Received: from homer.softweyr.com (bsdconspiracy.net [208.187.122.220]) by hub.freebsd.org (Postfix) with ESMTP id BF9EF37B69D for ; Fri, 19 Jan 2001 08:53:02 -0800 (PST) Received: from [127.0.0.1] (helo=softweyr.com ident=Fools trust ident!) by homer.softweyr.com with esmtp (Exim 3.16 #1) id 14Jetg-0000C1-00; Fri, 19 Jan 2001 10:00:20 -0700 Message-ID: <3A6872A4.C61233C0@softweyr.com> Date: Fri, 19 Jan 2001 10:00:20 -0700 From: Wes Peters Organization: Softweyr LLC X-Mailer: Mozilla 4.75 [en] (X11; U; Linux 2.2.12 i386) X-Accept-Language: en MIME-Version: 1.0 To: "Russell L. Carter" Cc: Uwe Pierau , freebsd-hackers@FreeBSD.ORG Subject: Re: Clustering FreeBSD References: <20010119054115.EA8F66A@pinyon.org> Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk X-Loop: FreeBSD.ORG "Russell L. Carter" wrote: > > %Uwe Pierau wrote: > %> > %> Jamie Heckford wrote: > %> # Hi, > %> # Does anyone have any details of Open Source, or software included > %> # with FreeBSD that allows the clustering of FreeBSD? > %> > %> Maybe you mean something like this... > %> http://acme.ecn.purdue.edu/index.html > %> ?! > % > %Yes! > % > %When is somebody going to get around to making a PVM version of make? > %Wouldn't that help those "build world" times a bit? > > No it would not! Back in '94 I ported dmake to FreeBSD > and built just about every numerics package out there > on a 4 CPU cluster. Worked fine, but not much in overall > speedup, because... tadum! Where do you get the source > files, and how do you get the objs back :-) Not low > latency, eh? F-Enet then, G-Enet now :) You need a better file server. My previous employer, where the software staff recompiles 3 million lines of code 20 or 30 times a day, employs pmake and a farm of Sun Ultra-5 workstations to parallelize their makes. It allows them to complete a build in an hour that would take a single Ultra-5 almost 20 hours to complete, even with 3 or 4 builds running in parallel. The network is 100BaseTX to the workstations and 1000BaseSX to the (NFS) fileserver. > Nowadays, you'd want to "globus ify" things, rather than > use use PVM. > > But critically, speedup would only happen if jobs were > allocated at a higher level than they are now. > > Now for building something like a full version of TAO, > why that might work. But even then, a factor of 2x is > unlikely until the dependencies are factored out at > the directory level. See the paper "Recursive Make Considered Harmful." Make is an amazing tool when used correctly. -- "Where am I, and what am I doing in this handbasket?" Wes Peters Softweyr LLC wes@softweyr.com http://softweyr.com/ To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message