From owner-freebsd-net@freebsd.org Thu Oct 22 08:22:32 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 89098A1BBDB for ; Thu, 22 Oct 2015 08:22:32 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 616721B12 for ; Thu, 22 Oct 2015 08:22:32 +0000 (UTC) (envelope-from lars@netapp.com) Received: by mailman.ysv.freebsd.org (Postfix) id 5F969A1BBDA; Thu, 22 Oct 2015 08:22:32 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5E518A1BBD8 for ; Thu, 22 Oct 2015 08:22:32 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mx142.netapp.com (mx142.netapp.com [216.240.21.19]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx142.netapp.com", Issuer "Symantec Class 3 Secure Server CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0A9151B10; Thu, 22 Oct 2015 08:22:30 +0000 (UTC) (envelope-from lars@netapp.com) X-IronPort-AV: E=Sophos;i="5.20,181,1444719600"; d="asc'?scan'208";a="72286764" Received: from hioexcmbx04-prd.hq.netapp.com ([10.122.105.37]) by mx142-out.netapp.com with ESMTP; 22 Oct 2015 01:21:20 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx04-prd.hq.netapp.com (10.122.105.37) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Thu, 22 Oct 2015 01:21:19 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::e1d9:911e:3048:d510%21]) with mapi id 15.00.1104.000; Thu, 22 Oct 2015 01:21:19 -0700 From: "Eggert, Lars" To: hiren panchasara CC: "erj@FreeBSD.org" , "net@freebsd.org" Subject: Re: ixl 40G bad performance? Thread-Topic: ixl 40G bad performance? Thread-Index: AQHRCnVeClivuZWSFkK4WCM/ynkiH55zUwOAgAAMKACAAAITgIAA5BEAgAA8ooCAACxPAIAAP6UAgAFpzQCAAB5sgIAADIMAgAAWWYCAAQDgAIAAC9QA Date: Thu, 22 Oct 2015 08:21:19 +0000 Message-ID: <25588FF3-E5A7-47A7-990C-72740F30B654@netapp.com> References: <20151020190541.B15983@sola.nimnet.asn.au> <6CD6754D-FC0E-4B24-AAEC-7C9D68284141@netapp.com> <20151020232218.G1833@besplex.bde.org> <12938D48-44B9-456A-AD7C-630D7E09BB35@netapp.com> <99F14384-271F-4543-A7F8-E19F4006998A@netapp.com> <20151021161935.GF28288@strugglingcoder.info> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3096.5) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.122.56.79] Content-Type: multipart/signed; boundary="Apple-Mail=_B7DB74BD-B267-4025-B452-665EDBF0AEAE"; protocol="application/pgp-signature"; micalg=pgp-sha256 MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 22 Oct 2015 08:22:32 -0000 --Apple-Mail=_B7DB74BD-B267-4025-B452-665EDBF0AEAE Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 2015-10-22, at 9:38, Eggert, Lars wrote: > for those of you following along, I did try jumbograms and throughput = increases roughly 5x. So it looks like I'm hitting a packet-rate limit = somewhere. Does the ixl driver have an issue with TSO/LRO? If I tcpdump on the receiver when testing the 10G ix interfaces, I see = that most "packets" are up to 64KB in the traces on both sender and = receiver, which is expected with TSO/LRO. When I look at the traffic over the ixl interfaces, I see that most = "packets" on the sender are much smaller (~2896 aka 2 segments; although = some few are >40K). On the receiver, I only see 1448 byte packets. Lars --Apple-Mail=_B7DB74BD-B267-4025-B452-665EDBF0AEAE Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCUAwUBViicftZcnpRveo1xAQhJTgP4jHc0k76zbXDySTBQCB4ABoDKD60Pxsaf zlMzTxdu7it9oZhj1TQA2Qew7Xi6NtU6TJgo11nRcaztioXTQ0MMT8UNI5V5fbkQ bOBv1HFQNPiqA8tgnVUO+ZWSTbUNUXzyvYYmfhxQJbfL5QnaWPSGuphZj94yVoTU 1gdcj7/irg== =MpJK -----END PGP SIGNATURE----- --Apple-Mail=_B7DB74BD-B267-4025-B452-665EDBF0AEAE--