From owner-freebsd-performance@FreeBSD.ORG Sat Dec 1 20:46:55 2007 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6875416A417 for ; Sat, 1 Dec 2007 20:46:55 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: from ag-out-0708.google.com (ag-out-0708.google.com [72.14.246.245]) by mx1.freebsd.org (Postfix) with ESMTP id 19DEE13C461 for ; Sat, 1 Dec 2007 20:46:54 +0000 (UTC) (envelope-from josh.carroll@gmail.com) Received: by ag-out-0708.google.com with SMTP id 35so3122547aga for ; Sat, 01 Dec 2007 12:46:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; bh=fktBFczkDF1i2rH0vsVFIfjooaE4YncHHz5N43HFRoM=; b=ck20Issjibs53P6odzXM5U2FkZsbVlYfVXPaHzKiCNO5rKR+BSENapAlykLKKVhapPZUn4019gFJVm9IWzb9xbP4Yfck2D0idphubJPrJ4AYbRiNn3EWG0gJ9LkM+n8A8IfYF6XAv5SBKiizJSm5gx1yih/tQ0pnaiqfZUsfRc4= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=mplPMWilkKubcIXTvsJN1m4zS+OI+t1rJeAVYx2vNcjweTPCft+XmLkTuwHaxce85Q5oon7eWP0o4edo/jalnXlREyNmaDV54gMfYdzudd+eiuRGFZLcLyfFaTzQ+6bWlmZ9VhvLxwe4gg4B63Sm9AmYCfC0b5730TVkr+Wk678= Received: by 10.150.201.13 with SMTP id y13mr302072ybf.1196542014446; Sat, 01 Dec 2007 12:46:54 -0800 (PST) Received: by 10.35.129.13 with HTTP; Sat, 1 Dec 2007 12:46:54 -0800 (PST) Message-ID: <8cb6106e0712011246j4dbe6b48s575120dda25760c7@mail.gmail.com> Date: Sat, 1 Dec 2007 15:46:54 -0500 From: "Josh Carroll" To: "Jeff Roberson" In-Reply-To: <20071109145827.W639@10.0.0.1> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <8cb6106e0710230902x4edf2c8eu2d912d5de1f5d4a2@mail.gmail.com> <20071103133711.Q544@10.0.0.1> <8cb6106e0711032221i2ecf1d59ge82f368d4162a827@mail.gmail.com> <20071104122546.S544@10.0.0.1> <8cb6106e0711041243s37ef92e3i9c5c79827f547dbb@mail.gmail.com> <20071104151722.M544@10.0.0.1> <8cb6106e0711050141g674a7733h53f7e6a20e75ad07@mail.gmail.com> <20071106171059.M544@10.0.0.1> <8cb6106e0711062136r18ca8e67sbdb4d4372e10e086@mail.gmail.com> <20071109145827.W639@10.0.0.1> Cc: freebsd-performance@freebsd.org Subject: Re: ULE vs. 4BSD in RELENG_7 X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: josh.carroll@gmail.com List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 01 Dec 2007 20:46:55 -0000 Jeff, I just ran through some of my benchmarks on a kernel build from sources as of today, and I've noticed an improvement for the ffmpeg workload. Here's a comparison of 4bsd, ule (BETA1) and ule (BETA3). This is vanilla source with no patches applied: x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x x x * * * * * + + ++ +| | |____A_____| |_______AM_____| |______A_______| | +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 93.28 94.05 93.74 93.746 0.29686697 + 5 97.56 98.7 98.03 98.042 0.41924933 Difference at 95.0% confidence 4.296 +/- 0.529778 4.5826% +/- 0.565121% (Student's t, pooled s = 0.363249) * 5 95.58 96.69 96.37 96.278 0.42446437 Difference at 95.0% confidence 2.532 +/- 0.534176 2.70092% +/- 0.569812% (Student's t, pooled s = 0.366265) Unfortunately, I only have 3 data points for the buildworld and sysbench runs. buildworld has slowed down slightly, and sysbench has slightly improved: buildworld: x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x x xx + + + + +* * *| | |____________MA_____________| |________A________| |__MA____|| +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 804.27 813.06 808.75 808.976 3.9655807 + 5 822.11 828.74 825.13 825.248 2.5607655 Difference at 95.0% confidence 16.272 +/- 4.86816 2.01143% +/- 0.601768% (Student's t, pooled s = 3.33791) * 3 829.15 831.33 829.73 830.07 1.1290704 Difference at 95.0% confidence 21.094 +/- 5.90231 2.60749% +/- 0.729603% (Student's t, pooled s = 3.30285) sysbench (8 threads): x 4bsd + ule * uleb3 +--------------------------------------------------------------------------------------------------+ |x x xx x + ++ * + * *| | |___A_M__| |______AM_|____|MA______|| +--------------------------------------------------------------------------------------------------+ N Min Max Median Avg Stddev x 5 2151.75 2172.05 2166.7 2163.14 8.1262968 + 5 2274.13 2309.66 2298.99 2296.89 13.648515 Difference at 95.0% confidence 133.75 +/- 16.3813 6.18314% +/- 0.757294% (Student's t, pooled s = 11.2321) * 3 2303.61 2327.29 2313.17 2314.69 11.912951 Difference at 95.0% confidence 151.55 +/- 17.0782 7.00602% +/- 0.789509% (Student's t, pooled s = 9.5567) Thanks, Josh