From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 21:19:04 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id D8C8916A420 for ; Sat, 1 Dec 2007 21:19:04 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.178]) by mx1.freebsd.org (Postfix) with ESMTP id 86B3813C461 for ; Sat, 1 Dec 2007 21:19:04 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so5869047pyb for ; Sat, 01 Dec 2007 13:19:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=SMpbyZxtGSuNR98U++rmtX1LlI3sIwhqS2xwFMEgQaI=; b=nw749aFGj1MTkZBevfgKTVSdouH0yYPvxnT8YRs9+ugR62hiqKpUi0Oz9BTmHVNAZ86xIozbATu0LYZIj7nBMDMv4AuDiEnNx6wsYIuH44K9bXScTs4foes68DtYglbMVldvD6skQUUwRbK7pfab/5lsttknqSkdywXZnb3Xn/A= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=ROMUK2RIedN0Fb/WX3qVAPlHgkaM035QnE3V+be7hfKnlHpKY2knQ82WWr/4P9ln9gGMjGWOOgRKjyTRHQD79MamzQd9HE4LLYGlgBCkXaj7pKK9EssKHaZeoid8JsM+FD28YpRiiVKbXqMr7W03Ij1r3xTlQiuhqAlxpjQUTAs= Received: by 10.35.91.1 with SMTP id t1mr242969pyl.1196543943632; Sat, 01 Dec 2007 13:19:03 -0800 (PST) Received: by 10.35.129.13 with HTTP; Sat, 1 Dec 2007 13:19:03 -0800 (PST) Message-ID: <8cb6106e0712011319q59efa8absb81eb7e18a0867c6@mail.gmail.com> Date: Sat, 1 Dec 2007 16:19:03 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 21:19:05 -0000 > I just ran through some of my benchmarks on a kernel build from > sources as of today, and I've noticed an improvement for the ffmpeg > workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3). > This is vanilla source with no patches applied: Sorry, the ministat output was mangled. I'll try this again with 80 columns instead. Also, please disregard the buildworld comparison, as world has changed since the previous 4bsd and ule runs, so obviously that's not a valid comparison. Sorry about that. Here are the ministat outputs for ffmpeg and sysbench, truncated to 80 columns instead. Hopefully that'll come through properly. Josh ffmpeg: x 4bsd + ule * uleb3 +------------------------------------------------------------------------------+ |x xx xx * * * * * + + ++ +| | |____A___| |_____AM____| |____MA_____| | +------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 93.28 94.05 93.74 93.746 0.29686697 + 5 97.56 98.7 98.03 98.042 0.41924933 Difference at 95.0% confidence 4.296 +/- 0.529778 4.5826% +/- 0.565121% (Student's t, pooled s = 0.363249) * 5 95.58 96.69 96.37 96.278 0.42446437 Difference at 95.0% confidence 2.532 +/- 0.534176 2.70092% +/- 0.569812% (Student's t, pooled s = 0.366265) sysbench: x 4bsd + ule * uleb3 +------------------------------------------------------------------------------+ |x x x x + ++ * + * *| | |___A_M_| |_____AM|___|A_____|| +------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 2151.75 2172.05 2166.7 2163.14 8.1262968 + 5 2274.13 2309.66 2298.99 2296.89 13.648515 Difference at 95.0% confidence 133.75 +/- 16.3813 6.18314% +/- 0.757294% (Student's t, pooled s = 11.2321) * 3 2303.61 2327.29 2313.17 2314.69 11.912951 Difference at 95.0% confidence 151.55 +/- 17.0782 7.00602% +/- 0.789509% (Student's t, pooled s = 9.5567)