From owner-freebsd-net@FreeBSD.ORG Thu Sep 18 18:58:30 2008 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id DFAF7106564A; Thu, 18 Sep 2008 18:58:30 +0000 (UTC) (envelope-from oberman@es.net) Received: from postal1.es.net (postal4.es.net [198.124.252.66]) by mx1.freebsd.org (Postfix) with ESMTP id 75C3A8FC15; Thu, 18 Sep 2008 18:58:30 +0000 (UTC) (envelope-from oberman@es.net) Received: from postal1.es.net (postal3.es.net [198.128.3.207]) by postal4.es.net (Postal Node 4) with ESMTP (SSL) id YBY01129; Thu, 18 Sep 2008 11:58:29 -0700 Received: from ptavv.es.net (ptavv.es.net [198.128.4.29]) by postal3.es.net (Postal Node 3) with ESMTP (SSL) id YBY15428; Thu, 18 Sep 2008 11:58:28 -0700 Received: from ptavv.es.net (localhost [127.0.0.1]) by ptavv.es.net (Tachyon Server) with ESMTP id E05DA45047; Thu, 18 Sep 2008 11:58:27 -0700 (PDT) To: "Jian Qiu" In-Reply-To: Your message of "Thu, 18 Sep 2008 22:50:10 +0800." Mime-Version: 1.0 Content-Type: multipart/signed; boundary="==_Exmh_1221764307_89905P"; micalg=pgp-sha1; protocol="application/pgp-signature" Content-Transfer-Encoding: 7bit Date: Thu, 18 Sep 2008 11:58:27 -0700 From: "Kevin Oberman" Message-Id: <20080918185827.E05DA45047@ptavv.es.net> X-Sender-IP: 198.128.3.207 X-Sender-Domain: es.net X-Recipent: ; ; ; X-Sender: X-To_Name: Jian Qiu X-To_Domain: gmail.com X-To: "Jian Qiu" X-To_Email: swordqiu@gmail.com X-To_Alias: swordqiu Cc: freebsd-net@freebsd.org Subject: Re: What's the status of parallel netisr? X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Sep 2008 18:58:31 -0000 --==_Exmh_1221764307_89905P Content-Type: text/plain; charset=us-ascii Content-Disposition: inline > Date: Thu, 18 Sep 2008 22:50:10 +0800 > From: "Jian Qiu" > Sender: owner-freebsd-net@freebsd.org > > Thanks again for the info. > > As you suggested, I did test on the most recent 7.0-stable-200807 kernel. > > The SMP throughout on the new kernel was improved to around 90MB/s. > > However, SMP kernel still had no advantage over UP, at least for this > kind of single threaded applications. > > I further did the same test on Linux with both SMP and UP. > > I did observe the same trend. > > The throughput on UP (~210MB/ecs) was also much better than SMP (~170MB/sec). > > However, I was surprised again that the local UDP throughput on Linux > was more than double of FreeBSD. > > Since all these tests were performed on the same machine, it must be > because of the kernel that made such big differences. > > I'm curious what is the major performance bottleneck in FreeBSD network stack?? > > Is there any plan in community to address these issues? Did you try locking down the CPUs used with cpuset (FreeBSD) or taskset (Linux)? This can make a very substantial difference. Something like a UDP canon will run far more efficiently if locked to a single CPU and will run best if that CPU is not processing the interrupts. -- R. Kevin Oberman, Network Engineer Energy Sciences Network (ESnet) Ernest O. Lawrence Berkeley National Laboratory (Berkeley Lab) E-mail: oberman@es.net Phone: +1 510 486-8634 Key fingerprint:059B 2DDF 031C 9BA3 14A4 EADA 927D EBB3 987B 3751 --==_Exmh_1221764307_89905P Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (FreeBSD) Comment: Exmh version 2.5 06/03/2002 iD8DBQFI0qTTkn3rs5h7N1ERArElAJ9F9CZG9WHGTQv1+fFkcF8pSLkHGwCguAb0 +qXkgaxoKYLKHCL4r3WxsB8= =6VIt -----END PGP SIGNATURE----- --==_Exmh_1221764307_89905P--