From owner-freebsd-performance@FreeBSD.ORG Fri Oct 29 16:58:53 2010 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 88C91106564A for ; Fri, 29 Oct 2010 16:58:53 +0000 (UTC) (envelope-from david@catwhisker.org) Received: from albert.catwhisker.org (m209-73.dsl.rawbw.com [198.144.209.73]) by mx1.freebsd.org (Postfix) with ESMTP id 426E38FC1B for ; Fri, 29 Oct 2010 16:58:52 +0000 (UTC) Received: from albert.catwhisker.org (localhost [127.0.0.1]) by albert.catwhisker.org (8.14.4/8.14.4) with ESMTP id o9TGwqND017153 for ; Fri, 29 Oct 2010 09:58:52 -0700 (PDT) (envelope-from david@albert.catwhisker.org) Received: (from david@localhost) by albert.catwhisker.org (8.14.4/8.14.4/Submit) id o9TGwqHe017152 for freebsd-performance@freebsd.org; Fri, 29 Oct 2010 09:58:52 -0700 (PDT) (envelope-from david) Date: Fri, 29 Oct 2010 09:58:52 -0700 From: David Wolfskill To: freebsd-performance@freebsd.org Message-ID: <20101029165852.GD10729@albert.catwhisker.org> References: <20101020174854.GZ21226@albert.catwhisker.org> <4CBF8032.8000609@freebsd.org> <20101025165548.GE1519@albert.catwhisker.org> <4CC662A1.9030708@freebsd.org> <20101026112916.GB2262@albert.catwhisker.org> <201010261434.o9QEY32Q037618@lava.sentex.ca> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="YToU2i3Vx8H2dn7O" Content-Disposition: inline In-Reply-To: <201010261434.o9QEY32Q037618@lava.sentex.ca> User-Agent: Mutt/1.4.2.3i Subject: Re: Possible evidence of performance regression for 8.1-S (vs. 7.1) X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Oct 2010 16:58:53 -0000 --YToU2i3Vx8H2dn7O Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 26, 2010 at 10:34:08AM -0400, Mike Tancsa wrote: > ... > ULE is the default in 7 as well. Perhaps remove some of the kernel=20 > options not in 7, that are in 8 by default? What is the disk=20 > subsystem ? just ata ? >=20 > They seem innocuous enough, but worth a try >=20 > options HWPMC_HOOKS # Necessary kernel hooks for hwpmc= (4) > options MAC # TrustedBSD MAC Framework > options FLOWTABLE # per-cpu routing cache OK; I now have the results from testing that. As noted earlier, we were using the MAC kernel config in 7.1, so I did not test removing the MAC option. I did build a kernel removing each of HWPMC_HOOKS and FLOWTABLE; results will be shown below as being associated with os "8.1-S-". To reduce the need for folks to find earlier messages to see the previous results, I'll paste them in, too: start stop real user sys host os = =20 1287525363 1287546846 21483.13 82628.20 21703.09 ref-7x 7.1-R+ = =20 1287548005 1287569100 21094.63 82853.19 22185.02 ref-7x 7.1-R+ = =20 1287570300 1287591371 21071.33 82756.81 21943.22 ref-7x 7.1-R+ = =20 1287592592 1287614103 21511.23 82637.30 21849.90 ref-7x 7.1-R+ = =20 1287615323 1287636770 21446.42 82715.81 21708.97 ref-7x 7.1-R+ = =20 = =20 1287436357 1287461948 25590.99 81502.22 18115.07 ref-8x 8.1-S@r214029= =20 1287462797 1287488766 25969.26 81452.14 17920.14 ref-8x 8.1-S@r214029= =20 1287489641 1287515287 25645.84 81548.40 18256.52 ref-8x 8.1-S@r214029= =20 1287516151 1287541481 25329.64 81546.23 18294.10 ref-8x 8.1-S@r214029= =20 1287542355 1287568599 26244.59 81431.47 17902.39 ref-8x 8.1-S@r214029= =20 = =20 1287710312 1287732046 21733.20 82688.01 22108.95 ref-8x 7.1-R+ = =20 1287733360 1287754549 21188.88 82869.09 21890.83 ref-8x 7.1-R+ = =20 1287755881 1287777566 21684.09 82772.50 21933.74 ref-8x 7.1-R+ = =20 1287879508 1287905173 25665.03 81696.22 18278.42 ref-8x 8.1-S[7.1-R+ = user] 1287906039 1287931709 25669.48 81735.00 18265.78 ref-8x 8.1-S[7.1-R+ = user] 1287932573 1287958275 25700.99 81700.40 18246.04 ref-8x 8.1-S[7.1-R+ = user] 1287959144 1287984859 25714.74 81800.40 18346.57 ref-8x 8.1-S[7.1-R+ = user] 1287985748 1288011752 26004.33 81569.28 17967.68 ref-8x 8.1-S[7.1-R+ = user] 1288198095 1288223776 25681.17 81550.12 18442.21 ref-8x 8.1-S- 1288224673 1288250350 25676.86 81561.61 18448.39 ref-8x 8.1-S- 1288269106 1288294837 25730.45 81535.38 18396.07 ref-8x 8.1-S- 1288295688 1288321338 25649.35 81552.34 18424.28 ref-8x 8.1-S- [Only 4 results posted, as one of the attempted builds failed.] And here are some ministat plots. As we have 3 "environment" variables (which machine is used, which kernel, and which userland), as well as 3 distinct variables being measured (real [wall clock] time; user CPU seconds; system CPU seconds), the file names reflect the measured variable ("real", "user", or "sys"), a "_h" to indicate that a "host designation" ("7" or "8") follows, a "_k" to indicate that a kernel designation follows ("7", "8", or "8-"), and a "_u" to indicate that a userland desgnation follows ("7" or "8"). So -- real time first: dwolf-bsd(8.1-S)[30] ministat -s real* x real_h7_k7_u7 + real_h8_k78_u7 * real_h8_k7_u7 : real_h8_k8-_u8 # real_h8_k8_u8 +--------------------------------------------------------------------------= ----+ |x * xx ** # #O@ O= #| ||___A_M| = | | |MA_| = | | |____A_M_| = | | |A = | | |___M_A___= _| | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 21071.33 21511.23 21446.42 21321.348 218.96441 + 5 25665.03 26004.33 25700.99 25750.914 143.20282 Difference at 95.0% confidence 4429.57 +/- 269.817 20.7753% +/- 1.26548% (Student's t, pooled s =3D 185.003) * 3 21188.88 21733.2 21684.09 21535.39 301.08941 No difference proven at 95.0% confidence : 4 25649.35 25730.45 25679.015 25684.457 33.745994 Difference at 95.0% confidence 4363.11 +/- 264.927 20.4636% +/- 1.24254% (Student's t, pooled s =3D 166.989) # 5 25329.64 26244.59 25645.84 25756.064 355.43859 Difference at 95.0% confidence 4434.72 +/- 430.527 20.7994% +/- 2.01923% (Student's t, pooled s =3D 295.197) dwolf-bsd(8.1-S)[31]=20 User CPU: dwolf-bsd(8.1-S)[31] ministat -s user* x user_h7_k7_u7 + user_h8_k7_u7 * user_h8_k8-_u8 : user_h8_k8_u7 # user_h8_k8_u9 +--------------------------------------------------------------------------= ----+ | O = :| |x* O = :| |** #O# = :| |A| = | ||A = | | A = | | = A| | |A = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 21071.33 21511.23 21446.42 21321.348 218.96441 + 3 21188.88 21733.2 21684.09 21535.39 301.08941 No difference proven at 95.0% confidence * 4 25649.35 25730.45 25679.015 25684.457 33.745994 Difference at 95.0% confidence 4363.11 +/- 264.927 20.4636% +/- 1.24254% (Student's t, pooled s =3D 166.989) : 5 81569.28 81800.4 81700.4 81700.26 84.271865 Difference at 95.0% confidence 60378.9 +/- 241.959 283.185% +/- 1.13482% (Student's t, pooled s =3D 165.902) # 5 25329.64 26244.59 25645.84 25756.064 355.43859 Difference at 95.0% confidence 4434.72 +/- 430.527 20.7994% +/- 2.01923% (Student's t, pooled s =3D 295.197) dwolf-bsd(8.1-S)[32]=20 Finally, system CPU: dwolf-bsd(8.1-S)[32] ministat -s sys* x sys_h7_k7_u7 + sys_h8_k7_u7 * sys_h8_k8-_u8 : sys_h8_k8_u7 # sys_h8_k8_u8 +--------------------------------------------------------------------------= ----+ |# : ** x + = | |#: # ##:** x x+x= +x| | |__A__= _| | | |MA= _| | | AM = | | |__AM| = | ||___A__| = | +--------------------------------------------------------------------------= ----+ N Min Max Median Avg Stddev x 5 21703.09 22185.02 21849.9 21878.04 199.04094 + 3 21890.83 22108.95 21933.74 21977.84 115.55385 No difference proven at 95.0% confidence * 4 18396.07 18448.39 18433.245 18427.737 23.457507 Difference at 95.0% confidence -3450.3 +/- 239.945 -15.7706% +/- 1.09674% (Student's t, pooled s =3D 151.242) : 5 17967.68 18346.57 18265.78 18220.898 146.5163 Difference at 95.0% confidence -3657.14 +/- 254.882 -16.716% +/- 1.16501% (Student's t, pooled s =3D 174.763) # 5 17902.39 18294.1 18115.07 18097.644 182.87428 Difference at 95.0% confidence -3780.4 +/- 278.75 -17.2794% +/- 1.27411% (Student's t, pooled s =3D 191.129) dwolf-bsd(8.1-S)[33]=20 Peace, david --=20 David H. Wolfskill david@catwhisker.org Depriving a girl or boy of an opportunity for education is evil. See http://www.catwhisker.org/~david/publickey.gpg for my public key. --YToU2i3Vx8H2dn7O Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.16 (FreeBSD) iEYEARECAAYFAkzK/UsACgkQmprOCmdXAD3C/gCdGIuyT3XyRVUz68Ly33zFJGUf bVEAniOjHlWnBphcrvdd74Zgh1sGvrW7 =eCAu -----END PGP SIGNATURE----- --YToU2i3Vx8H2dn7O--