From owner-svn-src-head@FreeBSD.ORG Wed May 28 03:02:26 2014 Return-Path: Delivered-To: svn-src-head@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 6D0E5B2A; Wed, 28 May 2014 03:02:26 +0000 (UTC) Received: from vps.hungerhost.com (vps.hungerhost.com [216.38.53.176]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 40AAE223C; Wed, 28 May 2014 03:02:26 +0000 (UTC) Received: from pool-96-250-5-187.nycmny.fios.verizon.net ([96.250.5.187]:52687 helo=[192.168.1.11]) by vps.hungerhost.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.80.1) (envelope-from ) id 1WpU8E-00078t-Vk; Tue, 27 May 2014 23:02:23 -0400 From: "George Neville-Neil" To: "Navdeep Parhar" Subject: Re: svn commit: r266757 - in head/sys: conf dev/cxgbe dev/cxgbe/common modules/cxgbe/if_cxgbe Date: Tue, 27 May 2014 23:02:20 -0400 Message-ID: <897F102E-BDE2-454B-964A-BAF02369E70E@neville-neil.com> In-Reply-To: <538530E0.9090309@FreeBSD.org> References: <201405271818.s4RIIff9045225@svn.freebsd.org> <538530E0.9090309@FreeBSD.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Mailer: MailMate (1.7.2r3905) X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - vps.hungerhost.com X-AntiAbuse: Original Domain - freebsd.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - neville-neil.com X-Get-Message-Sender-Via: vps.hungerhost.com: authenticated_id: gnn@neville-neil.com Cc: svn-src-head@freebsd.org, svn-src-all@freebsd.org, src-committers@freebsd.org, Luigi Rizzo X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 May 2014 03:02:26 -0000 On 27 May 2014, at 20:42, Navdeep Parhar wrote: > On 05/27/14 17:36, Luigi Rizzo wrote: >> >> >> >> On Tue, May 27, 2014 at 8:18 PM, Navdeep Parhar > > wrote: >> >> Author: np >> Date: Tue May 27 18:18:41 2014 >> New Revision: 266757 >> URL: http://svnweb.freebsd.org/changeset/base/266757 >> >> Log: >> cxgbe(4): netmap support for Terminator 5 (T5) based 10G/40G cards. >> Netmap gets its own hardware-assisted virtual interface and won't take >> over or disrupt the "normal" interface in any way. You can use both >> simultaneously. >> >> For kernels with DEV_NETMAP, cxgbe(4) carves out an ncxl interface >> (note the 'n' prefix) in the hardware to accompany each cxl >> interface. These two ifnet's per port share the same wire but really >> are separate interfaces in the hardware and software. Each gets >> its own >> L2 MAC addresses (unicast and multicast), MTU, checksum caps, etc. >> You >> should run netmap on the 'n' interfaces only, that's what they are >> for. >> >> With this, pkt-gen is able to transmit > 45Mpps out of a single >> 40G port >> >> >> ​and just for the records, this is with 1 core in userland. >> Very cool. >> >> Do you have an easy way to check what kind of throughput >> you get when the netmap interface has one hw queue ? > > Both tx and rx are at around ~33Mpps right now with one hardware queue. > That's more than enough to saturate a 40G link with 128B sized frames. > We need to port more tools to netmap now that it's in more drivers. I'm looking at iperf3 but there are other packet oriented daemons we ought to be porting as well. PTPd is, of course, on my list. Best, George