From owner-freebsd-stable@FreeBSD.ORG Wed Dec 31 10:49:15 2008 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 3C28A106564A for ; Wed, 31 Dec 2008 10:49:15 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from service2.sh.cvut.cz (ns2.sh.cvut.cz [IPv6:2001:718:2::241]) by mx1.freebsd.org (Postfix) with ESMTP id 821588FC1A for ; Wed, 31 Dec 2008 10:49:14 +0000 (UTC) (envelope-from v.haisman@sh.cvut.cz) Received: from localhost (localhost [127.0.0.1]) by service2.sh.cvut.cz (Postfix) with ESMTP id 3C6203BF0B; Wed, 31 Dec 2008 11:49:13 +0100 (CET) Received: from service2.sh.cvut.cz ([127.0.0.1]) by localhost (service2.sh.cvut.cz [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 11078-08; Wed, 31 Dec 2008 11:49:05 +0100 (CET) Received: from [192.168.1.2] (35.201.broadband4.iol.cz [85.71.201.35]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by service2.sh.cvut.cz (Postfix) with ESMTP id 9243A3BE2D; Wed, 31 Dec 2008 11:49:05 +0100 (CET) Message-ID: <495B4E1D.6020902@sh.cvut.cz> Date: Wed, 31 Dec 2008 11:49:01 +0100 From: =?UTF-8?B?VsOhY2xhdiBIYWlzbWFu?= User-Agent: Thunderbird 2.0.0.18 (Windows/20081105) MIME-Version: 1.0 References: <47713ee10812301206j12b35264o715976c154080a1b@mail.gmail.com> In-Reply-To: <47713ee10812301206j12b35264o715976c154080a1b@mail.gmail.com> X-Enigmail-Version: 0.95.7 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-Virus-Scanned: by amavisd-new-20030616-p10 (Debian) at service2.sh.cvut.cz X-Spam-Status: No, hits=1.6 tagged_above=-255.0 required=5.0 tests=AWL, BOTNET, CRM114_HAM_10, JR_RCVD_HOST_PROBS1, JR_RCVD_TOO_FEW_HOPS X-Spam-Level: * Cc: stable@freebsd.org Subject: Re: TCP packet out-of-order problem X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Dec 2008 10:49:15 -0000 Lin Jui-Nan Eric wrote, On 30.12.2008 21:06: > Dear listers, > > We recently found our new FreeBSD server (located in some foreign > region) has poor network performance. After doing some tcpdump and > iperf testing, we found that out-of-order TCP packets are not inserted > into queue. > > This is an 100Mbps line, and TSO is disabled. > > % uname -a > FreeBSD bsd 7.1-RC2 FreeBSD 7.1-RC2 #2: Wed Dec 31 03:12:39 CST 2008 > root@bsd:/usr/obj/usr/src/sys/KERNEL amd64 > > % iperf -c 10.1.1.250 > ------------------------------------------------------------ > Client connecting to office, TCP port 5001 > TCP window size: 3.07 MByte (default) > ------------------------------------------------------------ > [ 4] local 10.1.1.210 port 61488 connected with 10.1.1.250 port 5001 > [ ID] Interval Transfer Bandwidth > [ 4] 0.0-10.2 sec 5.74 MBytes 4.74 Mbits/sec > > 03:47:21.146397 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 159305:160753(1448) ack 1 win 1040 3216612488> > 03:47:21.146409 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 160753 > win 12568 > 03:47:21.146473 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 160753:162201(1448) ack 1 win 1040 3216612488> > 03:47:21.146485 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 162201 > win 12568 > 03:47:21.146972 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 163649:165097(1448) ack 1 win 1040 3216612488> > 03:47:21.146983 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 162201 > win 12573 > 03:47:21.146985 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 162201:163649(1448) ack 1 win 1040 3216612488> > 03:47:21.146996 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 163649 > win 12568 > 03:47:21.146998 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 165097:166545(1448) ack 1 win 1040 3216612488> > 03:47:21.147006 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 163649 > win 12573 > 03:47:21.147009 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 166545:167993(1448) ack 1 win 1040 3216612488> > 03:47:21.147017 IP 10.1.1.250.5001 > 10.1.1.210.54919: . ack 163649 > win 12573 > 03:47:21.147019 IP 10.1.1.210.54919 > 10.1.1.250.5001: . > 167993:169441(1448) ack 1 win 1040 3216612488> > > * You can see "ack 163649" repeating, but the packet is transmitted > before 163649:165097. > > % cat /etc/sysctl.conf > # $FreeBSD: src/etc/sysctl.conf,v 1.8 2003/03/13 18:43:50 mux Exp $ > # > # This file is read when going to multi-user and its contents piped thru > # ``sysctl'' to adjust kernel values. ``man 5 sysctl.conf'' for details. > # > > # Uncomment this to prevent users from seeing information about processes that > # are being run under another UID. > #security.bsd.see_other_uids=0 > debug.bootverbose=1 > kern.ipc.somaxconn=8192 > kern.maxfiles=65536 > kern.maxfilesperproc=32768 > kern.maxprocperuid=65536 > net.inet.ip.fastforwarding=1 > net.inet.tcp.delayed_ack=0 > vm.pmap.shpgperproc=2000 > kern.ipc.maxsockbuf=8388608 > net.inet.tcp.sendspace=3217968 > net.inet.tcp.recvspace=3217968 > > Is our configuration wrong? Or it is an known bug? I have searched > stable & net list, but found no similar discussion. > Thank you all in advance! Do you have net.inet.tcp.sack.enable=1? -- VH