From owner-freebsd-net@FreeBSD.ORG Tue Jun 28 18:06:17 2011 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1B5F1106564A for ; Tue, 28 Jun 2011 18:06:17 +0000 (UTC) (envelope-from rs@netapp.com) Received: from mx3.netapp.com (mx3.netapp.com [217.70.210.9]) by mx1.freebsd.org (Postfix) with ESMTP id A61F48FC12 for ; Tue, 28 Jun 2011 18:06:16 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.65,438,1304319600"; d="scan'208";a="261836177" Received: from smtp3.europe.netapp.com ([10.64.2.67]) by mx3-out.netapp.com with ESMTP; 28 Jun 2011 11:06:14 -0700 Received: from ldcrsexc1-prd.hq.netapp.com (ldcrsexc1-prd.hq.netapp.com [10.65.251.109]) by smtp3.europe.netapp.com (8.13.1/8.13.1/NTAP-1.6) with ESMTP id p5SI6EYh016273; Tue, 28 Jun 2011 11:06:14 -0700 (PDT) Received: from LDCMVEXC1-PRD.hq.netapp.com ([10.65.251.108]) by ldcrsexc1-prd.hq.netapp.com with Microsoft SMTPSVC(6.0.3790.3959); Tue, 28 Jun 2011 19:06:15 +0100 X-MimeOLE: Produced By Microsoft Exchange V6.5 Content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Date: Tue, 28 Jun 2011 19:06:10 +0100 Message-ID: <5FDC413D5FA246468C200652D63E627A0F014ED7@LDCMVEXC1-PRD.hq.netapp.com> In-Reply-To: X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: 1gbit LFN WAN link - odd tcp behavior Thread-Index: Acw0tvt/hyqWdAytQ5iuuA7lBeX37gBBuO0A References: From: "Scheffenegger, Richard" To: "William Salt" X-OriginalArrivalTime: 28 Jun 2011 18:06:15.0052 (UTC) FILETIME=[1217F4C0:01CC35BE] Cc: freebsd-net@freebsd.org Subject: RE: 1gbit LFN WAN link - odd tcp behavior X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Jun 2011 18:06:17 -0000 What is the effective latency under load, and the packet loss probability? Just to add some more detail. Richard Scheffenegger > -----Original Message----- > From: William Salt [mailto:williamejsalt@googlemail.com] > Sent: Montag, 27. Juni 2011 12:15 > To: freebsd-net@freebsd.org > Subject: 1gbit LFN WAN link - odd tcp behavior >=20 > Hi All, > For the last couple of months i have been pulling my hair out > trying to solve this problem. > We have a 1Gbps transatlantic link from the UK to the US, which has > successfully passed the RFC2544 test. >=20 > At either end, we have a media converter, and a supermicro server with > an > intel quad port NIC running pfsense 2 (freebsd 8.1) with the NIC > running on > the yandex IGB driver. >=20 > We can pass 1gbps either way with UDP. However we are experiencing very > strange issues with tcp connections. >=20 > With window scaling enabled, and a max socket buffer set to 16MB, we > see no > difference. > Even disabling window scaling and setting the window to 16MB makes no > difference. >=20 > Each TCP connection starts very slowly, and will max out at around > 190mbps, > taking nearly 2 minutes to climb to this speed before *plateauing*. >=20 > We have to initiate many (5+) connections to saturate the link with tcp > connections with iperf. >=20 > I have followed guides like this: > http://www.psc.edu/networking/projects/tcptune/#FreeBSD >=20 > With no luck, and have tweaked, disabled, and enabled nearly every > relevant > sysctl parameter with no luck. >=20 > Can anyone shed some light on this? >=20 > I am now doubting the IGB driver, and am looking to swap out the cards > as a > last ditch effort. > However, we have tried different hardware (L3 switches, media convertes > + > laptops etc), and the symptoms still persist... > The only constant is freebsd 8.1 (or 8.2 for production systems). >=20 >=20 > Cheers in advance > Will > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"