From owner-freebsd-performance@FreeBSD.ORG Sun Dec 2 23:01:40 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2749416A417 for ; Sun, 2 Dec 2007 23:01:40 +0000 (UTC) (envelope-from julian@elischer.org) Received: from outM.internet-mail-service.net (outM.internet-mail-service.net [216.240.47.236]) by mx1.freebsd.org (Postfix) with ESMTP id 04F9113C448 for ; Sun, 2 Dec 2007 23:01:39 +0000 (UTC) (envelope-from julian@elischer.org) Received: from mx0.idiom.com (HELO idiom.com) (216.240.32.160) by out.internet-mail-service.net (qpsmtpd/0.40) with ESMTP; Sun, 02 Dec 2007 14:50:50 -0800 X-Client-Authorized: MaGic Cook1e X-Client-Authorized: MaGic Cook1e X-Client-Authorized: MaGic Cook1e Received: from julian-mac.elischer.org (home.elischer.org [216.240.48.38]) by idiom.com (Postfix) with ESMTP id DB115126B7D; Sun, 2 Dec 2007 14:50:49 -0800 (PST) Message-ID: <475336CA.70508@elischer.org> Date: Sun, 02 Dec 2007 14:50:50 -0800 From: Julian Elischer User-Agent: Thunderbird 2.0.0.9 (Macintosh/20071031) MIME-Version: 1.0 To: josh.carroll@gmail.com References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> <8cb6106e0712011319q59efa8absb81eb7e18a0867c6@mail.gmail.com> In-Reply-To: <8cb6106e0712011319q59efa8absb81eb7e18a0867c6@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: Jeff Roberson , freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 02 Dec 2007 23:01:40 -0000 Josh Carroll wrote: >> I just ran through some of my benchmarks on a kernel build from >> sources as of today, and I've noticed an improvement for the ffmpeg >> workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3). >> This is vanilla source with no patches applied: > > Sorry, the ministat output was mangled. I'll try this again with 80 > columns instead. > > Also, please disregard the buildworld comparison, as world has changed > since the previous 4bsd and ule runs, so obviously that's not a valid > comparison. Sorry about that. > > Here are the ministat outputs for ffmpeg and sysbench, truncated to 80 > columns instead. Hopefully that'll come through properly. > is bigger better or worse? > Josh > > > ffmpeg: > > x 4bsd > + ule > * uleb3 > +------------------------------------------------------------------------------+ > |x xx xx * * * * * + + ++ +| > | |____A___| |_____AM____| |____MA_____| | > +------------------------------------------------------------------------------+ > N Min Max Median Avg Stddev > x 5 93.28 94.05 93.74 93.746 0.29686697 > + 5 97.56 98.7 98.03 98.042 0.41924933 > Difference at 95.0% confidence > 4.296 +/- 0.529778 > 4.5826% +/- 0.565121% > (Student's t, pooled s = 0.363249) > * 5 95.58 96.69 96.37 96.278 0.42446437 > Difference at 95.0% confidence > 2.532 +/- 0.534176 > 2.70092% +/- 0.569812% > (Student's t, pooled s = 0.366265) > > sysbench: > > x 4bsd > + ule > * uleb3 > +------------------------------------------------------------------------------+ > |x x x x + ++ * + * *| > | |___A_M_| |_____AM|___|A_____|| > +------------------------------------------------------------------------------+ > N Min Max Median Avg Stddev > x 5 2151.75 2172.05 2166.7 2163.14 8.1262968 > + 5 2274.13 2309.66 2298.99 2296.89 13.648515 > Difference at 95.0% confidence > 133.75 +/- 16.3813 > 6.18314% +/- 0.757294% > (Student's t, pooled s = 11.2321) > * 3 2303.61 2327.29 2313.17 2314.69 11.912951 > Difference at 95.0% confidence > 151.55 +/- 17.0782 > 7.00602% +/- 0.789509% > (Student's t, pooled s = 9.5567) > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"