From owner-freebsd-questions@FreeBSD.ORG Thu Jun 15 19:58:55 2006 Return-Path: X-Original-To: freebsd-questions@freebsd.org Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id D507316A479 for ; Thu, 15 Jun 2006 19:58:55 +0000 (UTC) (envelope-from danial_thom@yahoo.com) Received: from web33314.mail.mud.yahoo.com (web33314.mail.mud.yahoo.com [68.142.206.129]) by mx1.FreeBSD.org (Postfix) with SMTP id 6E87243D4C for ; Thu, 15 Jun 2006 19:58:55 +0000 (GMT) (envelope-from danial_thom@yahoo.com) Received: (qmail 34043 invoked by uid 60001); 15 Jun 2006 19:58:51 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Reply-To:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=jNLprImnf/UdUnkghxslXoPe6lUrWYmJojRw8R/d9ABlV5NITi2S0sEfDmO6VKjfRpn0ustY/IXSlrt8yxcbKhIZ6YY+e9bkDGk6+Wt273Jp5OGfr0oGVWGH43NhHnxVH0Baa3SOq/W8Km7BdCk1PksSiXnyvTUmsBQlnMnWN5s= ; Message-ID: <20060615195851.34041.qmail@web33314.mail.mud.yahoo.com> Received: from [65.34.182.15] by web33314.mail.mud.yahoo.com via HTTP; Thu, 15 Jun 2006 12:58:51 PDT Date: Thu, 15 Jun 2006 12:58:51 -0700 (PDT) From: Danial Thom To: Paul Marciano , freebsd-questions@freebsd.org In-Reply-To: <20060615182540.43537.qmail@web54009.mail.yahoo.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: fxp driver performance expectations X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: danial_thom@yahoo.com List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Jun 2006 19:58:55 -0000 --- Paul Marciano wrote: > Hello. > > I am running FreeBSD-5.4 on a 3GHz P4 with two > Intel > fxp NICs running IP forwarding with polling > enabled. > > For larger packets (e.g. 700 bytes) I am > getting > 100Mbps throughput port to port. > > For min-size packets (64 bytes) I am only > seeing > around 60Mbps. Increasing HZ and the polling > parameters does not help. > > I tried a couple of Gigabit Ethernet cards, > using the > em driver and they can sustain 100Mbps. > > For further comparison I tried a recent Linux > install > and got a little over 20Mbps for 64 byte > packets. So > much for that. > > > > Does anyone know if I should be expecting more > performance out of the fxp? Again, the em NICs > work > beyond 100Mbps with min sized frames. > > I want to know if there's more performance to > be had > from the hardware. My working assumption is > that the > driver is mature, it's a popular NIC, so maybe > I'm > getting all there is out of it. However, if > the > driver has been written optimized for larger > packets > at the expense of smaller packets, then perhaps > there's work I can do. > > > The goal, by the way, is to forward min-sized > frames > at line rate. It's a dumb goal, but one that > marketing people care about. You couldn't do 100Mb/s with em on a 100Mb/s line with min packets, because there are gaps between packets so its impossible. The more packets, tor more gaps. Where the em cards PCI-X? Realize that fxp parts are only 32bit/33mhz so the bus is a factor. Although its a 1Gb/s bus, thats only when bursting, so its really substantially less. With shorter packets you have more setups and I/O and therefore more overhead on the bus. fxp performs similarly to an em controller when they are both on a 32bit/33mhz bus in Freebsd 4.x. 5.x is about 20% slower than 4.x, but I expect the drivers to be about the same for 5.x as well. Are you using a traffic generator, or are you relying on some server to return packets? If you want to test the ethernet cards themselves, you are better off using bridging rather than IP forwarding, to get some of the OS and IP stack fat out of the equation. We have customers with fxp interfaces on freebsd 4.x pushing 90Mb/s+ (while doing a lot of other processing also), so its certainly possible. But you have to understand what you're testing, and avoid making the mistake of comparing apples to oranges. DT __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com