From owner-freebsd-net@freebsd.org Mon Oct 26 14:38:12 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C76DAA1C689 for ; Mon, 26 Oct 2015 14:38:12 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) Received: from mga02.intel.com (mga02.intel.com [134.134.136.20]) by mx1.freebsd.org (Postfix) with ESMTP id A02161DED for ; Mon, 26 Oct 2015 14:38:12 +0000 (UTC) (envelope-from jeffrey.e.pieper@intel.com) Received: from fmsmga003.fm.intel.com ([10.253.24.29]) by orsmga101.jf.intel.com with ESMTP; 26 Oct 2015 07:38:05 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.20,201,1444719600"; d="scan'208";a="588219434" Received: from orsmsx109.amr.corp.intel.com ([10.22.240.7]) by FMSMGA003.fm.intel.com with ESMTP; 26 Oct 2015 07:38:05 -0700 Received: from orsmsx157.amr.corp.intel.com (10.22.240.23) by ORSMSX109.amr.corp.intel.com (10.22.240.7) with Microsoft SMTP Server (TLS) id 14.3.248.2; Mon, 26 Oct 2015 07:38:04 -0700 Received: from orsmsx111.amr.corp.intel.com ([169.254.11.194]) by ORSMSX157.amr.corp.intel.com ([169.254.9.113]) with mapi id 14.03.0248.002; Mon, 26 Oct 2015 07:38:04 -0700 From: "Pieper, Jeffrey E" To: "Eggert, Lars" , Kevin Oberman CC: "freebsd-net@freebsd.org" , Daniel Engberg Subject: RE: ixl 40G bad performance? Thread-Topic: ixl 40G bad performance? Thread-Index: AQHRDva7Dkkfpv1k90OSGi0PjZ1hUJ59lvyAgABhmQD//96psA== Date: Mon, 26 Oct 2015 14:38:04 +0000 Message-ID: <2A35EA60C3C77D438915767F458D6568807F2A8A@ORSMSX111.amr.corp.intel.com> References: <5aae0ee63c44627223d5d179f1901d00@pyret.net> <0E4C2D93-FBAF-48CB-A704-499ABFC892B9@netapp.com> In-Reply-To: <0E4C2D93-FBAF-48CB-A704-499ABFC892B9@netapp.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsIiwiaWQiOiIzZGZlM2NmNy01YmFlLTRmNzAtYTIyYy01N2Q4N2ZmNjE4ZWUiLCJwcm9wcyI6W3sibiI6IkludGVsRGF0YUNsYXNzaWZpY2F0aW9uIiwidmFscyI6W3sidmFsdWUiOiJDVFBfUFVCTElDIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE1LjQuMTAuMTkiLCJUcnVzdGVkTGFiZWxIYXNoIjoiY3RtQWkzekhCeFJTZG43ekNXZWc5YlZGbk9PRDZBbUtwZm5EckUrWTdsRT0ifQ== x-inteldataclassification: CTP_PUBLIC x-originating-ip: [10.22.254.138] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Oct 2015 14:38:12 -0000 -----Original Message----- From: owner-freebsd-net@freebsd.org [mailto:owner-freebsd-net@freebsd.org] = On Behalf Of Eggert, Lars Sent: Monday, October 26, 2015 2:28 AM To: Kevin Oberman Cc: freebsd-net@freebsd.org; Daniel Engberg Subject: Re: ixl 40G bad performance? On 2015-10-26, at 4:38, Kevin Oberman wrote: > On Sun, Oct 25, 2015 at 12:10 AM, Daniel Engberg < > daniel.engberg.lists@pyret.net> wrote: >=20 >> One thing I've noticed that probably affects your performance benchmarks >> somewhat is that you're using iperf(2) instead of the newer iperf3 but I >> could be wrong... >=20 > iperf3 is not a newer version of iperf. It is a total re-write and a rath= er > different tool. It has significant improvements in many areas and new > capabilities that might be of use. That said, there is no reason to think > that the results of tests using iperf2 are in any way inaccurate. However= , > it is entirely possible to get misleading results if options not properly > selected. > >FWIW, I've been using netperf and tried various options. > >I don't think the issues is the benchmarking tool. I think the issue is TS= O/LRO issues (per my earlier email.) > >Lars With the latest ixl component from: https://downloadcenter.intel.com/downlo= ad/25160/Network-Adapter-Driver-for-PCI-E-40-Gigabit-Network-Connections-un= der-FreeBSD- running on 10.2 amd64, I easily get 9.6 Gb/s with one netperf stream, eithe= r b2b or through a switch. This is with no driver/kernel tuning. Running 4 = streams easily gets me 36 GB/s.=20 Jeff