From owner-svn-src-all@FreeBSD.ORG Mon Jan 23 22:53:54 2012 Return-Path: Delivered-To: svn-src-all@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id AA1B9106566C; Mon, 23 Jan 2012 22:53:54 +0000 (UTC) (envelope-from flo@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 86D078FC13; Mon, 23 Jan 2012 22:53:54 +0000 (UTC) Received: from nibbler-wlan.fritz.box (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.5/8.14.5) with ESMTP id q0NMrpmk044561; Mon, 23 Jan 2012 22:53:52 GMT (envelope-from flo@FreeBSD.org) Message-ID: <4F1DE4FF.3080606@FreeBSD.org> Date: Mon, 23 Jan 2012 23:53:51 +0100 From: Florian Smeets User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:10.0) Gecko/20120118 Thunderbird/10.0 MIME-Version: 1.0 To: Andriy Gapon References: <201112112102.pBBL21kB068967@svn.freebsd.org> In-Reply-To: <201112112102.pBBL21kB068967@svn.freebsd.org> X-Enigmail-Version: 1.4a1pre Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig7C52202A2C5BCF9A80799909" Cc: svn-src-head@FreeBSD.org, svn-src-all@FreeBSD.org, src-committers@FreeBSD.org Subject: Re: svn commit: r228424 - in head/sys: kern sys X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2012 22:53:54 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig7C52202A2C5BCF9A80799909 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On 11.12.11 22:02, Andriy Gapon wrote: > Author: avg > Date: Sun Dec 11 21:02:01 2011 > New Revision: 228424 > URL: http://svn.freebsd.org/changeset/base/228424 >=20 > Log: > panic: add a switch and infrastructure for stopping other CPUs in SMP= case > =20 Hi, Attilio asked me to verify that this commit does not introduce a performance regression. The box used to run these tests was a 40 Core 32GB Xeon box (HTT was turned off, so 40 real hardware cores). As benchmark pgbench/PostgreSQL were used, a snapshot of PostgreSQL 9.2 from 16.01.2012 was used as they did a lot of scaling work in 9.2 which improved the numbers quite a lot vs. 9.1. The initial benchmarks were run with a scaling factor of 100 which creates a database work set of ~1.5GB. Max throughput was achieved at 20 Clients. x 228423-20 + 228424-20 +----------------------------------------------------------------------+ | x + | |x x x +* + + xxx * ++ + + x| | |___________________A______M_____________| | | |___________A____M_____| | +----------------------------------------------------------------------+ N Min Max Median Avg Stdd= ev x 10 111073.26 115016.79 113113.49 112745.69 1169.21= 32 + 10 112583.56 114454.33 113668.08 113343.31 661.317= 61 No difference proven at 95.0% confidence At 40 threads the results varied between 43000 - 76500 across reboots. Attilio suspects that this can be caused by the kernel memory layout changing under the woods creating cache effects difficult to control, therefor the scaling factor was reduced to 10 (~150MB work set) and the numbers got deterministic across reboot. x 228423-40-sf10 + 228424-40-sf10 * 228424-40-sf10-cl +----------------------------------------------------------------------+ |x x x *** * * + x **+ *+ * * ** + + +| | |__________A__________| | | |______________MA________________| | | |__________A__M_______| | +----------------------------------------------------------------------+ N Min Max Median Avg Stdd= ev x 10 192489.43 196045.39 194138.34 194149.19 986.615= 61 + 10 194093.35 198864.83 196129.36 196214.69 1545.87= 83 Difference at 95.0% confidence 2065.5 +/- 1218.43 1.06387% +/- 0.627572% (Student's t, pooled s =3D 1296.76) * 10 194288.28 197083.85 195955.26 195733.15 1012.35= 29 Difference at 95.0% confidence 1583.96 +/- 939.189 0.815847% +/- 0.483746% (Student's t, pooled s =3D 999.567) The 228424-40-sf10-cl results are with a patch from Attilio [1] which he will followup on. If anybody wants to look at the raw numbers they are available at [2]. There are results for pbzip2 runs here [3] also, the numbers are "real" time from /usr/bin/time. Cheers, Florian [1] http://people.freebsd.org/~attilio/cachelineunshare.patch [2] http://tb.smeets.im/~flo/stop-sched/pgsql/ [3] http://tb.smeets.im/~flo/stop-sched/pbzip2/ --------------enig7C52202A2C5BCF9A80799909 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iEYEARECAAYFAk8d5P8ACgkQapo8P8lCvwl5fgCgpfVmcd/4MSX3T2DaXj7/QfVK hqUAoNQ52OncFi3wsFTnrwJcN7exjFyG =eOKw -----END PGP SIGNATURE----- --------------enig7C52202A2C5BCF9A80799909--