From owner-freebsd-current@FreeBSD.ORG Mon Dec 5 23:14:57 2011 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 684D41065676 for ; Mon, 5 Dec 2011 23:14:57 +0000 (UTC) (envelope-from luigi@onelab2.iet.unipi.it) Received: from onelab2.iet.unipi.it (onelab2.iet.unipi.it [131.114.59.238]) by mx1.freebsd.org (Postfix) with ESMTP id 2445F8FC14 for ; Mon, 5 Dec 2011 23:14:56 +0000 (UTC) Received: by onelab2.iet.unipi.it (Postfix, from userid 275) id 569C97300A; Tue, 6 Dec 2011 00:31:01 +0100 (CET) Date: Tue, 6 Dec 2011 00:31:01 +0100 From: Luigi Rizzo To: Jack Vogel Message-ID: <20111205233101.GB50697@onelab2.iet.unipi.it> References: <20111205192703.GA49118@onelab2.iet.unipi.it> <2D87D847-A2B7-4E77-B6C1-61D73C9F582F@digsys.bg> <20111205222834.GA50285@onelab2.iet.unipi.it> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.3i Cc: current@freebsd.org, Daniel Kalchev Subject: Re: datapoints on 10G throughput with TCP ? X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Dec 2011 23:14:57 -0000 On Mon, Dec 05, 2011 at 03:08:54PM -0800, Jack Vogel wrote: > You can't get line rate with ixgbe, in what configuration/hardware? > We surely do get line rate in validation here, but its sensitive to > your hardware and config. sources from HEAD as of a week or so, default parameter setting, 82599 on an Intel dual port 10G card, Intel i7-870 CPU (4 cores) at 2.93 GHz, on asus MB and the card on a PCIe-x16 slot, MTU=1500 bytes. Same hardware, same defaults and nuttcp on linux does 8.5 Gbit/s. I can do line rate with a single flow if i use MTU=9000 and set max_interrupt_rate=0 (even reducing the CPU speed to 1.2 GHz). I can saturate the link with multiple flows (say nuttcp -N 8). cheers luigi > Jack > > > On Mon, Dec 5, 2011 at 2:28 PM, Luigi Rizzo wrote: > > > On Mon, Dec 05, 2011 at 11:15:09PM +0200, Daniel Kalchev wrote: > > > > > > On Dec 5, 2011, at 9:27 PM, Luigi Rizzo wrote: > > > > > > > - have two machines connected by a 10G link > > > > - on one run "nuttcp -S" > > > > - on the other one run "nuttcp -t -T 5 -w 128 -v the.other.ip" > > > > > > > > > > Any particular tuning of FreeBSD? > > > > actually my point is first to see how good or bad are the defaults. > > > > I have noticed that setting hw.ixgbe.max_interrupt_rate=0 > > (it is a tunable, you need to do it before loading the module) > > improves the throughput by a fair amount (but still way below > > line rate with 1500 byte packets). > > > > other things (larger windows) don't seem to help much. > > > > cheers > > luigi > > _______________________________________________ > > freebsd-current@freebsd.org mailing list > > http://lists.freebsd.org/mailman/listinfo/freebsd-current > > To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org" > >