From owner-svn-src-all@FreeBSD.ORG Mon Dec 26 23:27:42 2011 Return-Path: Delivered-To: svn-src-all@FreeBSD.org Received: from mx2.freebsd.org (mx2.freebsd.org [IPv6:2001:4f8:fff6::35]) by hub.freebsd.org (Postfix) with ESMTP id 57691106566B; Mon, 26 Dec 2011 23:27:42 +0000 (UTC) (envelope-from dougb@FreeBSD.org) Received: from 172-17-198-245.globalsuite.net (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 9F6E114ECC2; Mon, 26 Dec 2011 23:27:39 +0000 (UTC) Message-ID: <4EF902EB.5050009@FreeBSD.org> Date: Mon, 26 Dec 2011 15:27:39 -0800 From: Doug Barton Organization: http://SupersetSolutions.com/ User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:9.0) Gecko/20111222 Thunderbird/9.0 MIME-Version: 1.0 To: Steve Kargl References: <201112241216.pBOCGd1H012696@svn.freebsd.org> <4EF645D2.8080407@FreeBSD.org> <20111226102820.GT90831@alchemy.franken.de> <4EF8DC5B.9070404@FreeBSD.org> <20111226225136.GA79882@troutmask.apl.washington.edu> In-Reply-To: <20111226225136.GA79882@troutmask.apl.washington.edu> X-Enigmail-Version: undefined OpenPGP: id=1A1ABC84 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: svn-src-head@FreeBSD.org, svn-src-all@FreeBSD.org, src-committers@FreeBSD.org, Marius Strobl Subject: Re: svn commit: r228857 - in head/usr.bin: . csup X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Dec 2011 23:27:42 -0000 On 12/26/2011 14:51, Steve Kargl wrote: > On Mon, Dec 26, 2011 at 12:43:07PM -0800, Doug Barton wrote: >> On 12/26/2011 02:28, Marius Strobl wrote: >>> On Sat, Dec 24, 2011 at 01:36:18PM -0800, Doug Barton wrote: >>>> On 12/24/2011 04:16, Marius Strobl wrote: >>>>> On FreeBSD just use the MD5 implementation of libmd rather than that of >>>>> libcrypto so we don't need to relinquish csup when world is built without >>>>> OpenSSL. >>>> >>>> Did you benchmark this at all? I agree that keeping csup available >>>> absent openssl is a good goal, but csup is a prototypical "tool that >>>> does the same thing many thousands of times" so even tiny regressions >>>> could add up to a large cost in wall clock time. >>> >>> Well, in a real world test updating the same base on an amd64 machine >>> connected to the Internet >> >> Adding a network connection to the test is almost certainly going to >> obscure the results beyond utility. > > Given that the majority of FreeBSD users will be pulling code > from the internet, this seems to be the most relevant test. Sorry if I wasn't clear. The change was to how the md5 portion of csup is linked. In order to isolate the effects of that change you have to remove everything that isn't related to that change. But this is regression testing 101, so I'm sure that you know that already. >> The appropriate way to test this >> would be to create a binary out of the md5 routine in csup, and link it >> alternately with libcrypto and libmd. Then for each version run it >> against the src tree (or ports, either way) 10 times. Discard the first >> and last, and then plot the results with ministat. > > The proper way to test the libmd vs libcrypto versions of > the md5 routines is to use a profiler. That'll give you a good view of where the performance bottlenecks are if it turns out that libmd is actually slower, sure. But the interesting question in terms of this change is the effect on wall clock time, since that's what users are going to see. > Of course, one might ask the question on how the use of > libmd effects the majority of FreeBSD users (ie., not FreeBSD > developers). Does the majority run csup hourly? Daily? > Weekly? For those that use csup, I imagine that they use it at least daily. But that's not the point. > For a utility seldomly run be the majority of FreeBSD > users, Doug, you seem to be wasting Marius's time. How often it's used isn't really relevant to whether or not introducing a pessimization is worth it. In any case I didn't ask him to back it out, I only asked to have it be an option if it turns out that libmd is slower. I understand that what you're really trying to do here is to take a shot at me relative to my assertion that profiled libs should be off by default. If you're going to respond in kind to every message I send it's going to get boring really quick. Doug -- [^L] Breadth of IT experience, and depth of knowledge in the DNS. Yours for the right price. :) http://SupersetSolutions.com/