From owner-freebsd-performance@FreeBSD.ORG Tue Oct 26 17:45:02 2010 Return-Path: Delivered-To: performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D1CDA106566B for ; Tue, 26 Oct 2010 17:45:02 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (m209-73.dsl.rawbw.com [198.144.209.73]) by mx1.freebsd.org (Postfix) with ESMTP id 9F4578FC20 for ; Tue, 26 Oct 2010 17:45:02 +0000 (UTC) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.14.4/8.14.4) with ESMTP id o9QHj2ZL008369 for ; Tue, 26 Oct 2010 10:45:02 -0700 (PDT) (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.14.4/8.14.4/Submit) id o9QHj147008368 for performance@freebsd.org; Tue, 26 Oct 2010 10:45:02 -0700 (PDT) (envelope-from david) Date: Tue, 26 Oct 2010 10:45:01 -0700 From: David Wolfskill To: performance@freebsd.org Message-ID: <20101026174501.GH2262@albert.catwhisker.org> References: <20101020174854.GZ21226@albert.catwhisker.org> <20101021215330.GA86224@dan.emsphone.com> <20101021224237.GG52404@albert.catwhisker.org> <4CC6C396.1010905@freebsd.org> <20101026121352.GC2262@albert.catwhisker.org> <20101020174854.GZ21226@albert.catwhisker.org> <20101021215330.GA86224@dan.emsphone.com> <20101021224237.GG52404@albert.catwhisker.org> <4CC6C396.1010905@freebsd.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="TBNym+cBXeFsS4Vs" Content-Disposition: inline In-Reply-To: <4CC6C396.1010905@freebsd.org> User-Agent: Mutt/1.4.2.3i Cc: Subject: Re: Possible evidence of performance regression for 8.1-S (vs. 7.1) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Oct 2010 17:45:02 -0000 --TBNym+cBXeFsS4Vs Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 26, 2010 at 02:03:34PM +0200, Ivan Voras wrote: > ... > Since you now have the two kernels readily available, can you rule out > NFS by just repeating the step which involves it in both kernels and > compare the results? On Tue, Oct 26, 2010 at 02:47:11PM +0200, Ivan Voras wrote: > ... > Couldn't you simply run blogbench or just copy/untar a full /usr/ports > tree on NFS that while booting either of the kernels? OK; here are timing results from 5 iterations each of running "tar xf", reading aa gzipped tarball of /usr/ports (updated earlier this morning) from NFS & writing it to the same local file system that I used for the previously-cited builds. Each of these was run on the 8.x reference machine, and each terminated with a status code of 0: start stop real user sys os 1288111167 1288111298 131.14 12.77 17.88 7.1-R+ 1288111359 1288111488 128.40 12.50 19.40 7.1-R+ 1288111546 1288111678 131.85 12.80 19.24 7.1-R+ 1288111739 1288111862 122.84 12.61 19.60 7.1-R+ 1288111919 1288112050 131.35 12.12 19.73 7.1-R+ 1288109542 1288109653 111.26 12.03 14.88 8.1-S [7.1-R+ userland] 1288109686 1288109783 97.38 12.83 13.28 8.1-S [7.1-R+ userland] 1288109811 1288109923 112.18 12.32 14.21 8.1-S [7.1-R+ userland] 1288109958 1288110063 104.94 12.21 14.34 8.1-S [7.1-R+ userland] 1288110094 1288110205 110.98 12.02 14.72 8.1-S [7.1-R+ userland] 1288112673 1288112768 94.88 9.41 12.87 8.1-S 1288112793 1288112885 92.37 9.16 13.32 8.1-S 1288112909 1288113009 100.25 9.21 13.72 8.1-S 1288113035 1288113126 90.52 9.38 13.38 8.1-S 1288113149 1288113249 100.23 8.91 14.00 8.1-S And here are some ministat summaries of the above: dwolf-bsd(8.1-S)[12] ls real_k7_u7 real_k8_u8 sys_k8_u7 user_k7_u7 user_k8_u8 real_k8_u7 sys_k7_u7 sys_k8_u8 user_k8_u7 dwolf-bsd(8.1-S)[13] ministat -s real* x real_k7_u7 + real_k8_u7 * real_k8_u8 +--------------------------------------------------------------------------= ----+ | * = | |* * * + * + +++ x x = xx | | |______A___= M__|| | |___________A_____M____| = | | |______MA_______| = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 122.84 131.85 131.14 129.116 3.7570906 + 5 97.38 112.18 110.98 107.348 6.2650395 Difference at 95.0% confidence -21.768 +/- 7.5337 -16.8593% +/- 5.83483% (Student's t, pooled s =3D 5.16558) * 5 90.52 100.25 94.88 95.65 4.466671 Difference at 95.0% confidence -33.466 +/- 6.01922 -25.9193% +/- 4.66187% (Student's t, pooled s =3D 4.12716) dwolf-bsd(8.1-S)[14] ministat -s user* x user_k7_u7 + user_k8_u7 * user_k8_u8 +--------------------------------------------------------------------------= ----+ |* ** ** + x + + x x= x+| | |_____AM= ___|| | |____MA______|= | | |___A___| = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 12.12 12.8 12.61 12.56 0.27449954 + 5 12.02 12.83 12.21 12.282 0.33131556 No difference proven at 95.0% confidence * 5 8.91 9.41 9.21 9.214 0.20082331 Difference at 95.0% confidence -3.346 +/- 0.350755 -26.6401% +/- 2.79263% (Student's t, pooled s =3D 0.240499) dwolf-bsd(8.1-S)[15] ministat -s sys* x sys_k7_u7 + sys_k8_u7 * sys_k8_u8 +--------------------------------------------------------------------------= ----+ |* +** * * ++ + + x xx = xx | | |_______A_M__= ___|| | |_____AM_____| = | | |___A____| = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 17.88 19.73 19.4 19.17 0.74505033 + 5 13.28 14.88 14.34 14.286 0.62488399 Difference at 95.0% confidence -4.884 +/- 1.00282 -25.4773% +/- 5.2312% (Student's t, pooled s =3D 0.687597) * 5 12.87 14 13.38 13.458 0.42815885 Difference at 95.0% confidence -5.712 +/- 0.886188 -29.7966% +/- 4.62279% (Student's t, pooled s =3D 0.607627) dwolf-bsd(8.1-S)[16]=20 Peace, david --=20 David H. Wolfskill david@catwhisker.org Depriving a girl or boy of an opportunity for education is evil. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --TBNym+cBXeFsS4Vs Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkzHE50ACgkQmprOCmdXAD1gYQCeJbA/ffngJib88bCQRKQzccJH U2wAnjw3fpUq0lcnSDKBZWU061btBgZq =DL4O -----END PGP SIGNATURE----- --TBNym+cBXeFsS4Vs--