From owner-freebsd-hackers Mon Jan 21 9: 4:12 2002 Delivered-To: freebsd-hackers@freebsd.org Received: from critter.freebsd.dk (critter.freebsd.dk [212.242.86.163]) by hub.freebsd.org (Postfix) with ESMTP id 7172F37B416 for ; Mon, 21 Jan 2002 09:04:05 -0800 (PST) Received: from critter.freebsd.dk (localhost [127.0.0.1]) by critter.freebsd.dk (8.11.6/8.11.6) with ESMTP id g0LH1KU23919; Mon, 21 Jan 2002 18:01:20 +0100 (CET) (envelope-from phk@critter.freebsd.dk) To: Brooks Davis Cc: hackers@FreeBSD.ORG Subject: Re: Project idea: Put PVM in /usr/bin/make In-Reply-To: Your message of "Mon, 21 Jan 2002 08:36:52 PST." <20020121083652.A1496@Odin.AC.HMC.Edu> Date: Mon, 21 Jan 2002 18:01:20 +0100 Message-ID: <23917.1011632480@critter.freebsd.dk> From: Poul-Henning Kamp Sender: owner-freebsd-hackers@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG In message <20020121083652.A1496@Odin.AC.HMC.Edu>, Brooks Davis writes: >On Mon, Jan 21, 2002 at 12:32:04PM +0100, Poul-Henning Kamp wrote: >> /usr/bin/make already have hooks for remote execution of jobs when >> running parallel. All that is missing before we can do distributed >> parallel make worlds is that somebody writes the necessary hooks >> based on PVM... >>=20 >> This is a really simple task, and the best of it all is that one >> does not need a cluster of machines to test it: Using jail(8) you >> can run a PVM cluster of any size on one machine. > >I'm all for parallel makes, but I don't think this is the right >approach. The problem with doing this directly on PVM is that PVM is a >message passing system. This is find if you are the only user of the >cluster, but if it's shared (the normal case) you need a schedular. A >better approach would be to allow make to tie into a POSIX batch >queueing framework. Since the syntax is pretty similar, you could >probably support both Sun Grid Engine and PBS fairly easily. As proof >that this can work, SGE ships with a parallel make. Well, you may think so, but while I wait for this Rolls-Royce you describe, I'll be perfectly content to upgrade my bike to a cheap japanese compact car... Adding PVM to /usr/bin/make is a simple task, less than 1000 lines of code. What you suggest is not going to happen in any of the next couple of years unless $BIGCORP pays somebody to do it. My suggestion consequently still stands: Please someone, add PVM to /usr/bin/make. Poul-Henning PS: you have no idea how I hate the "AAAAAAHHHH! what you propose will not be perfect so DO NOT DO IT!" attitude around here... -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence. To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-hackers" in the body of the message