From owner-freebsd-smp Fri Oct 11 17: 1:50 2002 Delivered-To: freebsd-smp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id BDB4637B401 for ; Fri, 11 Oct 2002 17:01:48 -0700 (PDT) Received: from snipe.mail.pas.earthlink.net (snipe.mail.pas.earthlink.net [207.217.120.62]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2B2A043EAA for ; Fri, 11 Oct 2002 17:01:08 -0700 (PDT) (envelope-from tlambert2@mindspring.com) Received: from pool0285.cvx40-bradley.dialup.earthlink.net ([216.244.43.30] helo=mindspring.com) by snipe.mail.pas.earthlink.net with esmtp (Exim 3.33 #1) id 1809hi-0000h3-00; Fri, 11 Oct 2002 17:00:27 -0700 Message-ID: <3DA765D1.D6C4B92C@mindspring.com> Date: Fri, 11 Oct 2002 16:59:13 -0700 From: Terry Lambert X-Mailer: Mozilla 4.79 [en] (Win98; U) X-Accept-Language: en MIME-Version: 1.0 To: Cheng Jin Cc: freebsd-smp@freebsd.org, Xiaoliang Wei Subject: Re: SMP + dual GbE References: Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Sender: owner-freebsd-smp@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.org Cheng Jin wrote: > We are currently working on a high-speed TCP project. We have a couple of > machines built on supermicro's P4DP6 board each with two 2.4 Ghz Xeon > processors and two GbE cards from SysKonnect. We were able to get close to > 1 Gbps throughput(loopback tests) on RedHat Linux 7.3 SMP kernel > (2.4.18-3) with interrupt moderation on the GbE cards (5000 interrupts/s) > and binding one CPU to each card. > > However, under FreeBSD SMP, we have only been able to achieve about 640 > Mbps on each card. I suppose the binding of CPU to card is implicit (?) > under FreeBSD SMP since we didn't notice any out-of-order packets. We > tried interrupt moderation going as high as 10,000 per second and as low > as 2500, but that didn't seem to help much. Furthermore, we were able to get > about 560 Mbps throughput for each card under a single-processor kernel so > it seems that the extra processor didn't help much under SMP. > > We don't know a whole lot about how SMP works under FreeBSD. Actually, we > don't know anything about FreeBSD SMP. Any comments/suggestions are > greatly appreciated. It may be your SysKonnect card. It's very easy to get full wire speed with 1500 MTU packets on an 800MHz machine with Tigon III cards (for example). It's all in the tuning. See previous threads in the FreeBSD-net mailing list archives for more information. -- Terry To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-smp" in the body of the message