Date: Tue, 26 Oct 2010 10:45:01 -0700 From: David Wolfskill <david@catwhisker.org> To: performance@freebsd.org Subject: Re: Possible evidence of performance regression for 8.1-S (vs. 7.1) Message-ID: <20101026174501.GH2262@albert.catwhisker.org> In-Reply-To: <AANLkTi=Q9EwPJ%2BC4n3UFF9uFtNsukntkmqSjrXsHE3cm@mail.gmail.com> <4CC6C396.1010905@freebsd.org> References: <20101020174854.GZ21226@albert.catwhisker.org> <20101021215330.GA86224@dan.emsphone.com> <20101021224237.GG52404@albert.catwhisker.org> <4CC6C396.1010905@freebsd.org> <20101026121352.GC2262@albert.catwhisker.org> <AANLkTi=Q9EwPJ%2BC4n3UFF9uFtNsukntkmqSjrXsHE3cm@mail.gmail.com> <20101020174854.GZ21226@albert.catwhisker.org> <20101021215330.GA86224@dan.emsphone.com> <20101021224237.GG52404@albert.catwhisker.org> <4CC6C396.1010905@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
--TBNym+cBXeFsS4Vs
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
On Tue, Oct 26, 2010 at 02:03:34PM +0200, Ivan Voras wrote:
> ...
> Since you now have the two kernels readily available, can you rule out
> NFS by just repeating the step which involves it in both kernels and
> compare the results?
On Tue, Oct 26, 2010 at 02:47:11PM +0200, Ivan Voras wrote:
> ...
> Couldn't you simply run blogbench or just copy/untar a full /usr/ports
> tree on NFS that while booting either of the kernels?
OK; here are timing results from 5 iterations each of running "tar
xf", reading aa gzipped tarball of /usr/ports (updated earlier this
morning) from NFS & writing it to the same local file system that
I used for the previously-cited builds. Each of these was run on
the 8.x reference machine, and each terminated with a status code of 0:
start stop real user sys os
1288111167 1288111298 131.14 12.77 17.88 7.1-R+
1288111359 1288111488 128.40 12.50 19.40 7.1-R+
1288111546 1288111678 131.85 12.80 19.24 7.1-R+
1288111739 1288111862 122.84 12.61 19.60 7.1-R+
1288111919 1288112050 131.35 12.12 19.73 7.1-R+
1288109542 1288109653 111.26 12.03 14.88 8.1-S [7.1-R+ userland]
1288109686 1288109783 97.38 12.83 13.28 8.1-S [7.1-R+ userland]
1288109811 1288109923 112.18 12.32 14.21 8.1-S [7.1-R+ userland]
1288109958 1288110063 104.94 12.21 14.34 8.1-S [7.1-R+ userland]
1288110094 1288110205 110.98 12.02 14.72 8.1-S [7.1-R+ userland]
1288112673 1288112768 94.88 9.41 12.87 8.1-S
1288112793 1288112885 92.37 9.16 13.32 8.1-S
1288112909 1288113009 100.25 9.21 13.72 8.1-S
1288113035 1288113126 90.52 9.38 13.38 8.1-S
1288113149 1288113249 100.23 8.91 14.00 8.1-S
And here are some ministat summaries of the above:
dwolf-bsd(8.1-S)[12] ls
real_k7_u7 real_k8_u8 sys_k8_u7 user_k7_u7 user_k8_u8
real_k8_u7 sys_k7_u7 sys_k8_u8 user_k8_u7
dwolf-bsd(8.1-S)[13] ministat -s real*
x real_k7_u7
+ real_k8_u7
* real_k8_u8
+--------------------------------------------------------------------------=
----+
| * =
|
|* * * + * + +++ x x =
xx |
| |______A___=
M__||
| |___________A_____M____| =
|
| |______MA_______| =
|
+--------------------------------------------------------------------------=
----+
N Min Max Median Avg Stddev
x 5 122.84 131.85 131.14 129.116 3.7570906
+ 5 97.38 112.18 110.98 107.348 6.2650395
Difference at 95.0% confidence
-21.768 +/- 7.5337
-16.8593% +/- 5.83483%
(Student's t, pooled s =3D 5.16558)
* 5 90.52 100.25 94.88 95.65 4.466671
Difference at 95.0% confidence
-33.466 +/- 6.01922
-25.9193% +/- 4.66187%
(Student's t, pooled s =3D 4.12716)
dwolf-bsd(8.1-S)[14] ministat -s user*
x user_k7_u7
+ user_k8_u7
* user_k8_u8
+--------------------------------------------------------------------------=
----+
|* ** ** + x + + x x=
x+|
| |_____AM=
___||
| |____MA______|=
|
| |___A___| =
|
+--------------------------------------------------------------------------=
----+
N Min Max Median Avg Stddev
x 5 12.12 12.8 12.61 12.56 0.27449954
+ 5 12.02 12.83 12.21 12.282 0.33131556
No difference proven at 95.0% confidence
* 5 8.91 9.41 9.21 9.214 0.20082331
Difference at 95.0% confidence
-3.346 +/- 0.350755
-26.6401% +/- 2.79263%
(Student's t, pooled s =3D 0.240499)
dwolf-bsd(8.1-S)[15] ministat -s sys*
x sys_k7_u7
+ sys_k8_u7
* sys_k8_u8
+--------------------------------------------------------------------------=
----+
|* +** * * ++ + + x xx =
xx |
| |_______A_M__=
___||
| |_____AM_____| =
|
| |___A____| =
|
+--------------------------------------------------------------------------=
----+
N Min Max Median Avg Stddev
x 5 17.88 19.73 19.4 19.17 0.74505033
+ 5 13.28 14.88 14.34 14.286 0.62488399
Difference at 95.0% confidence
-4.884 +/- 1.00282
-25.4773% +/- 5.2312%
(Student's t, pooled s =3D 0.687597)
* 5 12.87 14 13.38 13.458 0.42815885
Difference at 95.0% confidence
-5.712 +/- 0.886188
-29.7966% +/- 4.62279%
(Student's t, pooled s =3D 0.607627)
dwolf-bsd(8.1-S)[16]=20
Peace,
david
--=20
David H. Wolfskill david@catwhisker.org
Depriving a girl or boy of an opportunity for education is evil.
See http://www.catwhisker.org/~david/publickey.gpg for my public key.
--TBNym+cBXeFsS4Vs
Content-Type: application/pgp-signature
Content-Disposition: inline
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.16 (FreeBSD)
iEYEARECAAYFAkzHE50ACgkQmprOCmdXAD1gYQCeJbA/ffngJib88bCQRKQzccJH
U2wAnjw3fpUq0lcnSDKBZWU061btBgZq
=DL4O
-----END PGP SIGNATURE-----
--TBNym+cBXeFsS4Vs--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20101026174501.GH2262>