From owner-freebsd-smp@FreeBSD.ORG Mon Nov 10 14:05:20 2008 Return-Path: Delivered-To: freebsd-smp@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 323441065679 for ; Mon, 10 Nov 2008 14:05:20 +0000 (UTC) (envelope-from freebsd-smp@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id A08598FC19 for ; Mon, 10 Nov 2008 14:05:19 +0000 (UTC) (envelope-from freebsd-smp@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KzWJj-0005GJ-2K for freebsd-smp@freebsd.org; Mon, 10 Nov 2008 12:56:31 +0000 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 10 Nov 2008 12:56:31 +0000 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Mon, 10 Nov 2008 12:56:31 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-smp@freebsd.org From: Ivan Voras Date: Mon, 10 Nov 2008 13:56:40 +0100 Lines: 75 Message-ID: References: <42e3d810811100033w172e90dbl209ecbab640cc24f@mail.gmail.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig0D62A50CF2198A0578721DE4" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 2.0.0.17 (X11/20080925) In-Reply-To: <42e3d810811100033w172e90dbl209ecbab640cc24f@mail.gmail.com> X-Enigmail-Version: 0.95.0 Sender: news Subject: Re: CPU affinity with ULE scheduler X-BeenThere: freebsd-smp@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: FreeBSD SMP implementation group List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Nov 2008 14:05:20 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig0D62A50CF2198A0578721DE4 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Archimedes Gaviola wrote: > To Whom It May Concerned: >=20 > Can someone explain or share about ULE scheduler (latest version 2 if > I'm not mistaken) dealing with CPU affinity? Is there any existing > benchmarks on this with FreeBSD? Because I am currently using 4BSD Yes but not for network loads. See for example benchmarks in http://people.freebsd.org/~kris/scaling/7.0%20and%20beyond.pdf > scheduler and as what I have observed especially on processing high > network load traffic on multiple CPU cores, only one CPU were being > stressed with network interrupt while the rests are mostly in idle > state. This is an AMD-64 (4x) dual-core IBM system with GigE Broadcom > network interface cards (bce0 and bce1). Below is the snapshot of the > case. This is unfortunately so and cannot be changed for now - you are not the first with this particular performance problem. BUT, looking at the data in the snapshot you gave, it's not clear that there is a performance problem in your case - bce is not nearly taking as much CPU time to be bottlenecking. What exactly do you think is wrong in your case? > PID USERNAME THR PRI NICE SIZE RES STATE C TIME WCPU COMMA= ND > 17 root 1 171 52 0K 16K RUN 0 96:04 97.71% idle:= cpu0 > 15 root 1 171 52 0K 16K RUN 2 98:41 97.07% idle:= cpu2 > 14 root 1 171 52 0K 16K RUN 3 103:56 95.90% idle:= cpu3 > 13 root 1 171 52 0K 16K RUN 4 104:17 88.23% idle:= cpu4 > 12 root 1 171 52 0K 16K RUN 5 97:59 86.57% idle:= cpu5 > 10 root 1 171 52 0K 16K RUN 7 81:51 82.08% idle:= cpu7 > 11 root 1 171 52 0K 16K RUN 6 95:28 81.35% idle:= cpu6 > 16 root 1 171 52 0K 16K RUN 1 102:15 77.78% idle:= cpu1 > 36 root 1 -68 -187 0K 16K WAIT 7 19:37 4.59% > irq23: bce0 bce1 > 18 root 1 -32 -151 0K 16K CPU0 0 2:13 0.00% > swi4: clock sio > 4488 root 1 96 0 30728K 4292K select 3 1:51 0.00% sshd > 43 root 1 171 52 0K 16K pgzero 3 1:08 0.00% pagez= ero > 218 root 1 96 0 3852K 1380K select 3 0:38 0.00% syslo= gd > 20 root 1 -44 -163 0K 16K WAIT 7 0:32 0.00% swi1:= net --------------enig0D62A50CF2198A0578721DE4 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFJGC+IldnAQVacBcgRAmZhAKCGm05TVnG2a9QfilPND5pc5lquAACdGBz6 2kywcxj15+WCN+Ufb+SoLtg= =X6RQ -----END PGP SIGNATURE----- --------------enig0D62A50CF2198A0578721DE4--