From owner-freebsd-net@FreeBSD.ORG Tue Sep 30 20:01:45 2008 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 169541065688 for ; Tue, 30 Sep 2008 20:01:45 +0000 (UTC) (envelope-from freebsd-net@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id C30038FC26 for ; Tue, 30 Sep 2008 20:01:44 +0000 (UTC) (envelope-from freebsd-net@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1KklPe-0007xt-6f for freebsd-net@freebsd.org; Tue, 30 Sep 2008 20:01:38 +0000 Received: from 78-1-218-66.adsl.net.t-com.hr ([78.1.218.66]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 30 Sep 2008 20:01:38 +0000 Received: from ivoras by 78-1-218-66.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 30 Sep 2008 20:01:38 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-net@freebsd.org From: Ivan Voras Date: Tue, 30 Sep 2008 22:01:20 +0200 Lines: 39 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigFDB417C7DB23F2FE24BFF4B7" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 78-1-218-66.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.17 (Windows/20080914) In-Reply-To: X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: Optimizing for high PPS, Intel NICs X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Sep 2008 20:01:45 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigFDB417C7DB23F2FE24BFF4B7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Ivan Voras wrote: > I've noticed something strange: the server is bottlenecked with "em1 > taskq" kernel thread taking 100% of a CPU core, while the global CPU > utilization is around 50%, but the client's em0 taskq thread for this > same load is ~~ 10% (with > 30% idle). The client CPU is a bit faster > then the server (2.4 GHz vs 2.0 GHz) but I don't think this can account= > for such a big difference. Toggling TSO on the server doesn't help. I've switched the server and the client role and the behaviour is always the same - on this one machine the taskq starts using 100% of a core when pushing more than about 150,000 PPS. It's the same when testing under Linux so it looks like I need to shop for a better NIC. Can anyone recommend a good but basic (no fancy features needed) PCI-E or PCI-X NIC that's known to be able to push > 500,000 PPS? --------------enigFDB417C7DB23F2FE24BFF4B7 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkjihZUACgkQldnAQVacBcgmFwCgh4ywiPFeJeQ8P0XKnVxOcuA+ JlEAniwVzZ0ckU1GNQpCsRH3Pv+JAKL4 =0LMd -----END PGP SIGNATURE----- --------------enigFDB417C7DB23F2FE24BFF4B7--