Date: Sat, 1 Dec 2007 15:46:54 -0500 From: "Josh Carroll" <josh.carroll@gmail.com> To: "Jeff Roberson" <jroberson@chesapeake.net> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 Message-ID: <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> In-Reply-To: <20071109145827.W639@10.0.0.1> References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1>
next in thread | previous in thread | raw e-mail | index | archive | help
Jeff,
I just ran through some of my benchmarks on a kernel build from
sources as of today, and I've noticed an improvement for the ffmpeg
workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3).
This is vanilla source with no patches applied:
x 4bsd
+ ule
* uleb3
+--------------------------------------------------------------------------------------------------+
|x x x x * * * * *
+ + ++ +|
| |____A_____| |_______AM_____|
|______A_______| |
+--------------------------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 5 93.28 94.05 93.74 93.746 0.29686697
+ 5 97.56 98.7 98.03 98.042 0.41924933
Difference at 95.0% confidence
4.296 +/- 0.529778
4.5826% +/- 0.565121%
(Student's t, pooled s = 0.363249)
* 5 95.58 96.69 96.37 96.278 0.42446437
Difference at 95.0% confidence
2.532 +/- 0.534176
2.70092% +/- 0.569812%
(Student's t, pooled s = 0.366265)
Unfortunately, I only have 3 data points for the buildworld and
sysbench runs. buildworld has slowed down slightly, and sysbench has
slightly improved:
buildworld:
x 4bsd
+ ule
* uleb3
+--------------------------------------------------------------------------------------------------+
|x x x xx +
+ + + +* * *|
| |____________MA_____________|
|________A________| |__MA____||
+--------------------------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 5 804.27 813.06 808.75 808.976 3.9655807
+ 5 822.11 828.74 825.13 825.248 2.5607655
Difference at 95.0% confidence
16.272 +/- 4.86816
2.01143% +/- 0.601768%
(Student's t, pooled s = 3.33791)
* 3 829.15 831.33 829.73 830.07 1.1290704
Difference at 95.0% confidence
21.094 +/- 5.90231
2.60749% +/- 0.729603%
(Student's t, pooled s = 3.30285)
sysbench (8 threads):
x 4bsd
+ ule
* uleb3
+--------------------------------------------------------------------------------------------------+
|x x xx x +
++ * + * *|
| |___A_M__|
|______AM_|____|MA______||
+--------------------------------------------------------------------------------------------------+
N Min Max Median Avg Stddev
x 5 2151.75 2172.05 2166.7 2163.14 8.1262968
+ 5 2274.13 2309.66 2298.99 2296.89 13.648515
Difference at 95.0% confidence
133.75 +/- 16.3813
6.18314% +/- 0.757294%
(Student's t, pooled s = 11.2321)
* 3 2303.61 2327.29 2313.17 2314.69 11.912951
Difference at 95.0% confidence
151.55 +/- 17.0782
7.00602% +/- 0.789509%
(Student's t, pooled s = 9.5567)
Thanks,
Josh
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?8cb6106e0712011246j4dbe6b48s575120dda25760c7>