From owner-freebsd-current@FreeBSD.ORG Tue Mar 2 07:20:40 2004 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id B47A916A4CE; Tue, 2 Mar 2004 07:20:40 -0800 (PST) Received: from mailout1.pacific.net.au (mailout1.pacific.net.au [61.8.0.84]) by mx1.FreeBSD.org (Postfix) with ESMTP id E8B5B43D45; Tue, 2 Mar 2004 07:20:39 -0800 (PST) (envelope-from bde@zeta.org.au) Received: from mailproxy2.pacific.net.au (mailproxy2.pacific.net.au [61.8.0.87])i22FKcUe018913; Wed, 3 Mar 2004 02:20:38 +1100 Received: from gamplex.bde.org (katana.zip.com.au [61.8.7.246]) i22FKa5c019938; Wed, 3 Mar 2004 02:20:36 +1100 Date: Wed, 3 Mar 2004 02:20:35 +1100 (EST) From: Bruce Evans X-X-Sender: bde@gamplex.bde.org To: Robert Watson In-Reply-To: Message-ID: <20040303015020.V2502@gamplex.bde.org> References: MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII cc: freebsd-current@FreeBSD.org cc: Alexandre Sunny Kovalenko cc: Vincent Poy Subject: Re: buildworld times X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Mar 2004 15:20:40 -0000 On Tue, 2 Mar 2004, Robert Watson wrote: > On Mon, 1 Mar 2004, Robert Watson wrote: > > > FYI, I now have access to a build box at work with two Xeon 2.4GHz > > processors, each with two logical CPUs, and 1GB of memory. Here are the > > buildworld times, with -DNORESCUE and -DNOPROFILE, 5.2.1-RELEASE > > GENERICish kernel (no WITNESS, INVARIANTS): [Reformatted without tabs and with columns aligned] > > > > Real User Sys > > default 2195.16 1717.69 467.78 > > -j 2 2003.20 2151.49 539.67 > > -j 4 1703.15 2485.99 654.00 > > -j 6 1645.34 2595.67 718.12 > > -j 8 1627.88 2618.15 743.53 > > As a follow-up, this was with SCHED_4BSD, which is the default in 5.2.1. > Here's 5.2.1 with SCHED_ULE on the same hardware: > > Real User Sys > default 2191.03 1722.31 455.82 > -j 2 1993.30 2154.71 528.67 > -j 4 1688.14 2493.55 646.69 > -j 6 1630.02 2597.88 706.06 > -j 8 1617.72 2619.99 737.98 > > I should prefix a bit of interpretation by noting that SCHED_ULE has been > changed substantially since 5.2.1. What's interesting about these numbers > is that in the non-parallel case (default), we see moderately better > performance, and substantially less user or system time -- assuming the > time measurements are consistent between the two schedulers. At -j 2, > we're paying a moderate overhead in wall time for using ULE, but seeing > better utilization of resources. At -j 4, we pass a threshold and are > breaking about even, which we continue to do through -j 8. Erm, the above shows that 5.2.1+ULE is faster in wall time in all cases, with the largest benefits at -j4 and -j6, and the the smallest benefits at . The benefits are very small, however. Not enough to justify a new scheduler even on a machine that should benefit more than most from better scheduling. > So a couple of interesting questions to answer would be: > > (1) Are the utilization times between 4BSD and ULE directly comparable? > Do we believe that they are both accurate? Real time is directly comparable, but the user/sys time split is difficult to compare and not very important either. The placement of page zeroing probably affects the relative split more than anything (with fewer jobs, the pagezero daemon gets more chances to run and it sometimes does useful work that would otherwise be counted as system time). > (2) If we reran these tests with 5.2-CURRENT, how would the numbers > change? I would be surprised if they changed much. buildworld is mostly a gcc cpu hog benchmark, and about the only significant thing the kernel can do to speed up gcc is to reduce its memory contention. > (3) What is a nice rationalization for going from "using less resources" > to "slower compile". Using tabs so that the columns are not lined up and the data is misinterpreted ;-). Bruce