From owner-freebsd-net@freebsd.org Sat Oct 24 07:44:10 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id DA032A1D3F2 for ; Sat, 24 Oct 2015 07:44:10 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id AD844EE4 for ; Sat, 24 Oct 2015 07:44:10 +0000 (UTC) (envelope-from lars@netapp.com) Received: by mailman.ysv.freebsd.org (Postfix) id ABE0FA1D3F1; Sat, 24 Oct 2015 07:44:10 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id AB745A1D3F0 for ; Sat, 24 Oct 2015 07:44:10 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mx142.netapp.com (mx142.netapp.com [216.240.21.19]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx142.netapp.com", Issuer "Symantec Class 3 Secure Server CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 6C4C4EE3; Sat, 24 Oct 2015 07:44:09 +0000 (UTC) (envelope-from lars@netapp.com) X-IronPort-AV: E=Sophos;i="5.20,191,1444719600"; d="asc'?scan'208,217";a="72698554" Received: from hioexcmbx04-prd.hq.netapp.com ([10.122.105.37]) by mx142-out.netapp.com with ESMTP; 24 Oct 2015 00:43:06 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx04-prd.hq.netapp.com (10.122.105.37) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Sat, 24 Oct 2015 00:43:06 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::e1d9:911e:3048:d510%21]) with mapi id 15.00.1104.000; Sat, 24 Oct 2015 00:43:06 -0700 From: "Eggert, Lars" To: Eric Joyner CC: Bruce Evans , Ian Smith , Kevin Oberman , "net@freebsd.org" , "jfv@FreeBSD.org" , Luigi Rizzo , Giuseppe Lettieri Subject: Re: ixl 40G bad performance? Thread-Topic: ixl 40G bad performance? Thread-Index: AQHRCnVeClivuZWSFkK4WCM/ynkiH55zUwOAgAAMKACAAAITgIAA5BEAgAA8ooCAACxPAIAAP6UAgAQb94CAAQw8AIAAqZUA Date: Sat, 24 Oct 2015 07:43:06 +0000 Message-ID: <0CFE1957-8FEB-4000-9E39-1F6A8983EFA6@netapp.com> References: <79830D9D-94E6-47A9-92B9-D63DF5432272@netapp.com> <20151020190541.B15983@sola.nimnet.asn.au> <6CD6754D-FC0E-4B24-AAEC-7C9D68284141@netapp.com> <20151020232218.G1833@besplex.bde.org> <20151023162337.L1149@besplex.bde.org> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3096.5) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.120.60.34] Content-Type: multipart/signed; boundary="Apple-Mail=_C4A5AFE6-0FFD-49DB-AF8D-B08A2F3CBC4F"; protocol="application/pgp-signature"; micalg=pgp-sha256 MIME-Version: 1.0 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2015 07:44:10 -0000 --Apple-Mail=_C4A5AFE6-0FFD-49DB-AF8D-B08A2F3CBC4F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 2015-10-23, at 23:36, Eric Joyner wrote: > I see that the sysctl does clobber the global value, but have you = tried lowering the interval / raising the rate? You could try something = like 10usecs, and see if that helps. We'll do some more investigation = here -- 3Gb/s on a 40Gb/s using default settings is terrible, and we = shouldn't let that be happening. I played with different settings, but I've never been able to get more = than 4Gb/s, whereas under Linux 4.2 without any special settings I get = 13. See my other email on TSO/LRO not looking to be effective; that would = certainly explain it. Plausible? Anything to try here? Lars --Apple-Mail=_C4A5AFE6-0FFD-49DB-AF8D-B08A2F3CBC4F Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCVAwUBVis2jNZcnpRveo1xAQg0ZAP+I2aX0iZnfKUtEzndV/LNYZThZ87CtQNM /VY+BWiV5ciCyKqbISlcSOCznkDN+i9oEIdKa59CdfGI/WjVWYFp3zd5AuwxLFKx 1hQlapfG91vraC1D3y8dCmiaI0LKXs+8BzKfzm0AQw1yHthUtsu7/wS7SLH312yl 8RYXPRLK2gY= =RruI -----END PGP SIGNATURE----- --Apple-Mail=_C4A5AFE6-0FFD-49DB-AF8D-B08A2F3CBC4F--