From owner-freebsd-ports@FreeBSD.ORG Tue May 29 02:13:40 2007 Return-Path: X-Original-To: ports@freebsd.org Delivered-To: freebsd-ports@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0B8AD16A4F1; Tue, 29 May 2007 02:13:40 +0000 (UTC) (envelope-from stephen@math.missouri.edu) Received: from sccmmhc92.asp.att.net (sccmmhc92.asp.att.net [204.127.203.212]) by mx1.freebsd.org (Postfix) with ESMTP id B6A5A13C457; Tue, 29 May 2007 02:13:39 +0000 (UTC) (envelope-from stephen@math.missouri.edu) Received: from laptop2.montlan (12-216-253-187.client.mchsi.com[12.216.253.187]) by sccmmhc92.asp.att.net (sccmmhc92) with ESMTP id <20070529021338m9200da0ije>; Tue, 29 May 2007 02:13:38 +0000 Message-ID: <465B8C51.6010806@math.missouri.edu> Date: Mon, 28 May 2007 21:13:37 -0500 From: Stephen Montgomery-Smith User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.8.1.2) Gecko/20070525 SeaMonkey/1.1.1 MIME-Version: 1.0 To: Roman Divacky References: <4659EF80.70100@math.missouri.edu> <20070527223048.GA37505@icarus.home.lan> <465B0490.7080203@math.missouri.edu> <20070528212036.GA35796@freebsd.org> In-Reply-To: <20070528212036.GA35796@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: ports@freebsd.org, hackers@freebsd.org Subject: Re: Looking for speed increases in "make index" and pkg_version for ports X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 May 2007 02:13:40 -0000 Roman Divacky wrote: > On Mon, May 28, 2007 at 11:34:24AM -0500, Stephen Montgomery-Smith wrote: >> Jeremy Chadwick wrote: >>> On Sun, May 27, 2007 at 03:52:16PM -0500, Stephen Montgomery-Smith wrote: >>>> I have been thinking a lot about looking for speed increases for "make >>>> index" and pkg_version and things like that. So for example, in >>>> pkg_version, it calls "make -V PKGNAME" for every installed package. Now >>>> "make -V PKGNAME" should be a speedy operation, but the make has to load >>>> in and analyze bsd.port.mk, a quite complicated file with about 200,000 >>>> characters in it, when all it is needing to do is to figure out the >>>> value of the variable PKGNAME. >>> I have a related question, pertaining to "make all-depends-list" and the >>> utter atrocity that is the make variable ALL-DEPENDS-LIST. If you don't >>> know what it is, look for ^ALL-DEPENDS-LIST around line 5175, in >>> bsd.ports.mk. >> I posted this to ports@freebsd.org, but now I am realizing that it is >> hackers@freebsd.org that gets more responses. Anyway, here is a >> multithreaded program "all-depends-list" that can get you double the >> speed on dual processor systems, and even some small speed gains on >> single processor systems. E.g. >> >> all-depends-list /usr/ports/x11/xorg >> >> http://www.math.missouri.edu/~stephen/all-depends-list.c > > btw.. stehpen, when are you getting a commit bit? :) I certainly hope that soon enough ;) Probably not. The program seems to have a bug in it. In particular, I didn't read the fgetln man page sufficiently well. So think of it as a proof of concept rather than a finished product. I'm going to rest from this stuff for a while, but I enjoyed the exchanges and it has given me encouragement to work on it again in the future sometime. Stephen