From owner-freebsd-net@freebsd.org Sat Oct 24 08:47:00 2015 Return-Path: Delivered-To: freebsd-net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5D0D7A1C0A2 for ; Sat, 24 Oct 2015 08:47:00 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id 32CC17F5 for ; Sat, 24 Oct 2015 08:47:00 +0000 (UTC) (envelope-from lars@netapp.com) Received: by mailman.ysv.freebsd.org (Postfix) id 31E44A1C0A1; Sat, 24 Oct 2015 08:47:00 +0000 (UTC) Delivered-To: net@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19196A1C0A0 for ; Sat, 24 Oct 2015 08:47:00 +0000 (UTC) (envelope-from lars@netapp.com) Received: from mx142.netapp.com (mx142.netapp.com [216.240.21.19]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (Client CN "mx142.netapp.com", Issuer "Symantec Class 3 Secure Server CA - G4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D0EE77F4; Sat, 24 Oct 2015 08:46:59 +0000 (UTC) (envelope-from lars@netapp.com) X-IronPort-AV: E=Sophos;i="5.20,191,1444719600"; d="asc'?scan'208";a="72703441" Received: from hioexcmbx02-prd.hq.netapp.com ([10.122.105.35]) by mx142-out.netapp.com with ESMTP; 24 Oct 2015 01:45:54 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com (10.122.105.40) by hioexcmbx02-prd.hq.netapp.com (10.122.105.35) with Microsoft SMTP Server (TLS) id 15.0.1104.5; Sat, 24 Oct 2015 01:45:54 -0700 Received: from HIOEXCMBX07-PRD.hq.netapp.com ([::1]) by hioexcmbx07-prd.hq.netapp.com ([fe80::e1d9:911e:3048:d510%21]) with mapi id 15.00.1104.000; Sat, 24 Oct 2015 01:45:54 -0700 From: "Eggert, Lars" To: Jack Vogel CC: Ian Smith , Kevin Oberman , "net@freebsd.org" , "jfv@FreeBSD.org" , Giuseppe Lettieri , Eric Joyner , Luigi Rizzo Subject: Re: ixl 40G bad performance? Thread-Topic: ixl 40G bad performance? Thread-Index: AQHRCnVeClivuZWSFkK4WCM/ynkiH55zUwOAgAAMKACAAAITgIAA5BEAgAA8ooCAACxPAIAAP6UAgAQb94CAAQw8AIAAqZUAgAAN6gCAAAOdAA== Date: Sat, 24 Oct 2015 08:45:53 +0000 Message-ID: <0998C63C-F7D9-44FE-A535-9E57EEF36C58@netapp.com> References: <79830D9D-94E6-47A9-92B9-D63DF5432272@netapp.com> <20151020190541.B15983@sola.nimnet.asn.au> <6CD6754D-FC0E-4B24-AAEC-7C9D68284141@netapp.com> <20151020232218.G1833@besplex.bde.org> <20151023162337.L1149@besplex.bde.org> <0CFE1957-8FEB-4000-9E39-1F6A8983EFA6@netapp.com> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: yes X-MS-TNEF-Correlator: x-mailer: Apple Mail (2.3096.5) x-ms-exchange-messagesentrepresentingtype: 1 x-ms-exchange-transport-fromentityheader: Hosted x-originating-ip: [10.120.60.34] Content-Type: multipart/signed; boundary="Apple-Mail=_4F86EABF-4DE1-40E3-B029-6FCBBAC8136F"; protocol="application/pgp-signature"; micalg=pgp-sha256 MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 24 Oct 2015 08:47:00 -0000 --Apple-Mail=_4F86EABF-4DE1-40E3-B029-6FCBBAC8136F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 2015-10-24, at 10:32, Jack Vogel wrote: > 13 on a 40G interface?? I don't think that's very good for Linux = either, is > this a 4x10 adapter? No, its's a 2x40. And I can get it into the high 30s with tuning. I just = mentioned the value to illustrate that something seems to be seriously = broken under FreeBSD. Lars > Maybe elaborating on the details of the hardware, you sure you don't = have a > bad PCI slot > somewhere that might be throttling everything? >=20 > Cheers, >=20 > Jack >=20 >=20 > On Sat, Oct 24, 2015 at 12:43 AM, Eggert, Lars = wrote: >=20 >> On 2015-10-23, at 23:36, Eric Joyner wrote: >>=20 >> I see that the sysctl does clobber the global value, but have you = tried >> lowering the interval / raising the rate? You could try something = like >> 10usecs, and see if that helps. We'll do some more investigation here = -- >> 3Gb/s on a 40Gb/s using default settings is terrible, and we = shouldn't let >> that be happening. >>=20 >>=20 >> I played with different settings, but I've never been able to get = more >> than 4Gb/s, whereas under Linux 4.2 without any special settings I = get 13. >>=20 >> See my other email on TSO/LRO not looking to be effective; that would >> certainly explain it. Plausible? Anything to try here? >>=20 >> Lars >>=20 >>=20 > _______________________________________________ > freebsd-net@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" --Apple-Mail=_4F86EABF-4DE1-40E3-B029-6FCBBAC8136F Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="signature.asc" Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- iQCVAwUBVitFQdZcnpRveo1xAQi+jwP/cfm/zGSqsTHrF5vkIswsdufNTQw85FE8 gJ9ScG/vw+S6yKZQY2rNpXmZqCESY2g6vuNUacmDtgKh7z4FVg2WXwvucmhZITu5 fpTzTNOTrfmoYHoxVSXV6EPoqoeL9xwShmcWKIgc2+FGGTlfWzuSYmsVHSuGPryV sZEsEr3F/IY= =S1D+ -----END PGP SIGNATURE----- --Apple-Mail=_4F86EABF-4DE1-40E3-B029-6FCBBAC8136F--