From owner-freebsd-performance@FreeBSD.ORG Wed Feb 13 14:46:12 2008 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3545016A580; Wed, 13 Feb 2008 14:46:12 +0000 (UTC) (envelope-from erik@cederstrand.dk) Received: from mail.itu.dk (pluto.itu.dk [130.226.142.18]) by mx1.freebsd.org (Postfix) with ESMTP id F37FA13C442; Wed, 13 Feb 2008 14:46:11 +0000 (UTC) (envelope-from erik@cederstrand.dk) Received: from [192.168.1.148] (stud1-15.itu.dk [130.226.140.15]) by mail.itu.dk (Postfix) with ESMTP id AFA0D32DBAF; Wed, 13 Feb 2008 14:46:10 +0000 (UTC) Message-ID: <47B302B2.30607@cederstrand.dk> Date: Wed, 13 Feb 2008 15:46:10 +0100 From: Erik Cederstrand User-Agent: Thunderbird 2.0.0.6 (X11/20071022) MIME-Version: 1.0 To: Brooks Davis References: <4796C717.9000507@cederstrand.dk> <20080123193400.N63024@fledge.watson.org> <4797A245.7080202@cederstrand.dk> <20080123202433.E63024@fledge.watson.org> <4797A802.8060509@FreeBSD.org> <47A0BFE7.4070708@cederstrand.dk> <20080130190000.GA18333@lor.one-eyed-alien.net> <47AC15A5.5020009@cederstrand.dk> <20080208151756.GA35423@lor.one-eyed-alien.net> In-Reply-To: <20080208151756.GA35423@lor.one-eyed-alien.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-performance@freebsd.org, kris@freebsd.org Subject: Re: Performance Tracker project update X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Feb 2008 14:46:12 -0000 Brooks Davis skrev: > On Fri, Feb 08, 2008 at 09:41:09AM +0100, Erik Cederstrand wrote: >> I finally got around to testing this, and with a combination of mtree >> comparing md5 hashes, bsdiff compacting changed files and hardlinking >> unchanged files I get a reduction in size from 256MB to 10MB. Pretty good, >> and the whole operation only takes a few minutes. > > Cool! > >> I have one peculiarity, though. I install python2.5 into the directory >> containing the build, and even though the python version has not changed, I >> still get mismatching md5 sums on every .pyo and .pyc file. Any thoughts on >> this? > > I'm not a python guru by any means, but I think .pyc files probably have data > about the .py they are generated from because there's some sort of > auto-generation available. It may be possible to not store them at all and > just generate them before you use them or add some magic build flags to cause > them to store some sort of cooked values. I'm not sure where the .pyo files > come from. As suggested in other posts, deleting .pyo and .pyc files gets me down to 6MB. Static libraries (.a files) in /usr/lib and /usr/local/lib still have mismatching MD5 sums even though no source code change warrants this. Can I do anything about that? Are static libraries even needed anymore? Erik