From owner-freebsd-performance@FreeBSD.ORG Mon Oct 7 17:49:31 2013 Return-Path: Delivered-To: performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 0382C99C; Mon, 7 Oct 2013 17:49:31 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (mx.catwhisker.org [198.144.209.73]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id AD8BA2532; Mon, 7 Oct 2013 17:49:30 +0000 (UTC) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.14.7/8.14.7) with ESMTP id r97HnTrY008260; Mon, 7 Oct 2013 10:49:29 -0700 (PDT) (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.14.7/8.14.7/Submit) id r97HnTwT008259; Mon, 7 Oct 2013 10:49:29 -0700 (PDT) (envelope-from david) Date: Mon, 7 Oct 2013 10:49:29 -0700 From: David Wolfskill To: Adrian Chadd Subject: Re: Apparent performance regression 8.3@ -> 8.4@r255966? Message-ID: <20131007174929.GO1611@albert.catwhisker.org> References: <20131007172804.GA7641@albert.catwhisker.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="31zvzas5NXT9fief" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: performance@freebsd.org X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 07 Oct 2013 17:49:31 -0000 --31zvzas5NXT9fief Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 07, 2013 at 10:32:57AM -0700, Adrian Chadd wrote: > On Oct 7, 2013 1:28 PM, "David Wolfskill" wrote: > > > > At work, we have a bunch of machines that developers use to build some > > software. The machines presently run FreeBSD/amd64 8.3-STABLE @rxxxxxx > > (with a few local patches, which have since been committed to stable/8), > > and the software is built within a 32-bit jail. >=20 > Well, whats the start commit? Xxxxxx isnt all that helpful. :-) r238914M -- sorry; I got impatient & sent th emessage off before I went through & plugged in the stuff I meant to plug in later.... :-( > Once you can establish that, we xan go over the commit logs to see what > changed. >=20 > Youre building exactly the same software on both, right? Yes: I have a script that checks out a "sandbox" from the repo, then tars it up. Each test iteration then: * Ensures there is nothing of an old sandbox (directory) around. * Unpacks the pristine copy of the sandbox. * Dives into the sandbox & performs a measured build. * Exits the sandbox (and removes it). > .... Here's the other bit I neglected to include: dwolf-fbsd(9.2-S)[30] /usr/bin/ministat -s baseline test_env x baseline + test_env +--------------------------------------------------------------------------= ----+ | xxxxx xx xxxxxxxx x xx x + = | |xxxxxxxx xx xxxxxxxx x xx xxxx x x +x *+ + ++ = x| | |___________A____________| = | | |____A____| = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 75 4.91961 6.16419 5.22432 5.2311616 0.20113192 + 7 5.68327 5.94078 5.86111 5.8563686 0.086090721 Difference at 95.0% confidence 0.625207 +/- 0.153262 11.9516% +/- 2.92979% (Student's t, pooled s =3D 0.194874) Peace, david --=20 David H. Wolfskill david@catwhisker.org Taliban: Evil cowards with guns afraid of truth from a 14-year old girl. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --31zvzas5NXT9fief Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (FreeBSD) iEYEARECAAYFAlJS9CgACgkQmprOCmdXAD22ugCdGUxYzWW+Q63QrNz1seNgIU8j anYAn0Q7+0yl9fREXDYPW92y8W2+bh53 =5vEF -----END PGP SIGNATURE----- --31zvzas5NXT9fief--