From owner-freebsd-net@FreeBSD.ORG Thu May 17 08:30:00 2007 Return-Path: X-Original-To: freebsd-net@freebsd.org Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6FC4B16A402 for ; Thu, 17 May 2007 08:30:00 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: from wr-out-0506.google.com (wr-out-0506.google.com [64.233.184.231]) by mx1.freebsd.org (Postfix) with ESMTP id 2BEE913C45E for ; Thu, 17 May 2007 08:29:59 +0000 (UTC) (envelope-from jfvogel@gmail.com) Received: by wr-out-0506.google.com with SMTP id 70so478574wra for ; Thu, 17 May 2007 01:29:59 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=On0KWBzONqGp1xgOcLGt4FgcUuBDCvRy807BZxSY6xEHV8JQdsz16FgObHVEhTOp9xLHmlQR0aTrAEPsciBuW8jev5MwuhGEkA/Mo71aeirupopLrkEOt824rqmtvUvbi4tkLWk39cO5amBGYb+6YSAVTtzr07wtep43Fxubfy8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=tuJMVLlpQP73565eUQ40JUaqMjkL+E5bl74mnb92LU0ncayIBu+8p/OlzbxYbHdT6wMhisX7aSYXkf2m0XZXjsQtRXp9ftaDY5isaezoijRw0jnabU5E1NhXWWKDzUuSb4IhqA6dBp6YSBaGx7kzvtQNOn2uC51yhQs+sbO/N1U= Received: by 10.114.175.16 with SMTP id x16mr101748wae.1179390598843; Thu, 17 May 2007 01:29:58 -0700 (PDT) Received: by 10.114.126.10 with HTTP; Thu, 17 May 2007 01:29:58 -0700 (PDT) Message-ID: <2a41acea0705170129j44d0bcb4ke943d82f634b35d3@mail.gmail.com> Date: Thu, 17 May 2007 01:29:58 -0700 From: "Jack Vogel" To: "Danny Braniss" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <2a41acea0705161030k40831aa5o168b5bc40fcf3352@mail.gmail.com> <20070516181531.GA62119@voi.aagh.net> <2a41acea0705161118g241a3375x7367bbc10a7c7d82@mail.gmail.com> Cc: freebsd-net , FreeBSD Current Subject: Re: EM and TSO X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 May 2007 08:30:00 -0000 On 5/17/07, Danny Braniss wrote: > > On 5/16/07, Thomas Hurst wrote: > > > * Jack Vogel (jfvogel@gmail.com) wrote: > > > > > > > I introduced a change yesterday that limited TSO to PCI Express > > > > adapters, I did this more for avoidance rather than a bug fix, and > > > > I'm not 100% sure its the right thing, so I thought I would poll > > > > everyone, do you have a PCI-X adapter and are using TSO without > > > > problems and wish to keep the support in? > > > > > > > > If no one is then I'll just leave it as is. > > > > > > We put CURRENT on one of our Sun X4200's for some MySQL tests a few days > > > ago and haven't noticed any problems, though it's only handled a few > > > million packets so far. > > > > > > Does this change remove support or just disable it by default? > > > > It removed it, but Andre and my own guilty conscience has convinced > > me that I should change it back, once I get an MSI/X bug that was > > discovered with the code solved there will be another delta that will > > reenable it for PCI-X again. > > em0@pci1:1:0: class=0x020000 card=0x10118086 chip=0x10108086 rev=0x03 > hdr=0x00 > vendor = 'Intel Corporation' > device = '82546EB Dual Port Gigabit Ethernet Controller (Copper)' > class = network > subclass = ethernet > cap 01[dc] = powerspec 2 supports D0 D3 current D0 > cap 07[e4] = PCI-X 64-bit supports 133MHz, 2048 burst read, 1 split > transaction > cap 05[f0] = MSI supports 1 message, 64 bit > > I have been testing TSO on a SunFire X4100, and though it works, I notice > that setting it on actually reduces throughput, from an average of 55MB/s > to 24MB/s > > any explanation? TSO is workload sensitive and its not always the right answer. The whole realm of performance tweaking has been outside my scope right now, but it needs to be done at some point. Most the testing I did while developing the code was on PCI-E, and on say an 82571 I saw no significant reduction of throughput, with a noticeable improvement in CPU. The adapter you are testing on is one that I just disabled by default because I dont think it is capable of showing TSO to its best advantage. The has been no real work on tweaking this stuff to understand its best usage yet, it would be a great task for someone to take on :) Jack