From owner-freebsd-net@FreeBSD.ORG Tue May 12 06:18:27 2009 Return-Path: Delivered-To: freebsd-net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BBC521065673 for ; Tue, 12 May 2009 06:18:27 +0000 (UTC) (envelope-from mv@thebeastie.org) Received: from mail.jumbuck.com (p82.jumbuck.com [206.112.99.82]) by mx1.freebsd.org (Postfix) with ESMTP id A02EC8FC16 for ; Tue, 12 May 2009 06:18:27 +0000 (UTC) (envelope-from mv@thebeastie.org) Received: from mail.jumbuck.com (mail.jumbuck.com [206.112.99.82]) by mail.jumbuck.com (Postfix) with ESMTP id 02A60DDABEDD; Tue, 12 May 2009 05:58:45 +0000 (UTC) Received: from beaste5.jumbuck.com (ppp191-232.static.internode.on.net [59.167.191.232]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.jumbuck.com (Postfix) with ESMTPS id 7B7F9DDABEDB; Tue, 12 May 2009 05:58:44 +0000 (UTC) Received: from beaste5.jumbuck.com (beast5 [192.168.46.105]) by beaste5.jumbuck.com (Postfix) with ESMTP id D602B209D007; Tue, 12 May 2009 15:58:42 +1000 (EST) Received: from [127.0.0.1] (unknown [192.168.46.121]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by beaste5.jumbuck.com (Postfix) with ESMTPSA id A32DE209D000; Tue, 12 May 2009 15:58:42 +1000 (EST) Message-ID: <4A090FFF.3070105@thebeastie.org> Date: Tue, 12 May 2009 15:58:23 +1000 From: Michael Vince User-Agent: Thunderbird 2.0.0.21 (Windows/20090302) MIME-Version: 1.0 To: Oleg Baranov References: <49FF706F.1050209@csa.ru> In-Reply-To: <49FF706F.1050209@csa.ru> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-net@freebsd.org Subject: Re: Awful forwarding rate [7.2-Release, igb] X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 12 May 2009 06:18:28 -0000 Also make sure that the route for this specific test isn't going out on the Internet and coming back in at your outside link speed of around117kbits/sec? I had a similar problem once where I had 3 boxes hooked up and the speeds were blistering fast for 2 tests but the third test was horrid slow. Turns out I simply forgot to add the route so the packets jumped across the local network, instead the packets were taking a route of a pointless jump out to my first upstream provider and back again :) Mike Oleg Baranov wrote: > Hello! > > I have extremely low forwarding speed on 7.2-Release box with dual > Intel 82575. > > Box "B" with dual 82575 nic is connected between A and C using gigabit > swithes > A <---> B <----> C > > > iperf run from A to C shows: > > $ iperf -w 128k -c 192.168.111.3 > ------------------------------------------------------------ > Client connecting to 192.168.111.3, TCP port 5001 > TCP window size: 129 KByte (WARNING: requested 128 KByte) > ------------------------------------------------------------ > [ 3] local 192.168.1.15 port 51077 connected with 192.168.111.3 port > 5001 > [ ID] Interval Transfer Bandwidth > [ 3] 0.0-11.2 sec 160 KBytes 117 Kbits/sec > > > > the same run from A to B shows: > > ]$ iperf -w 128k -c 192.168.1.153 > ------------------------------------------------------------ > Client connecting to 192.168.1.153, TCP port 5001 > TCP window size: 129 KByte (WARNING: requested 128 KByte) > ------------------------------------------------------------ > [ 3] local 192.168.1.15 port 60907 connected with 192.168.1.153 port > 5001 > [ ID] Interval Transfer Bandwidth > [ 3] 0.0-10.0 sec 1.09 GBytes 933 Mbits/sec > > > and from B to C shows: > > $ iperf -w 128k -c 192.168.111.3 > ------------------------------------------------------------ > Client connecting to 192.168.111.3, TCP port 5001 > TCP window size: 129 KByte (WARNING: requested 128 KByte) > ------------------------------------------------------------ > [ 3] local 192.168.111.254 port 64290 connected with 192.168.111.3 > port 5001 > [ ID] Interval Transfer Bandwidth > [ 3] 0.0-10.0 sec 1.08 GBytes 930 Mbits/sec > > > Boxes B and C are both dual quad-core e5420 CPUs on Supermicro X7DWN+ > motherboard. > As A I tried several machines including dual quad-core Phenom system > as well as some portable PCs and workstations residing in the same LAN. > > Here is ifconfig from B > > $ ifconfig > igb0: flags=8843 metric 0 mtu > 1500 > options=19b > ether 00:30:48:c8:19:66 > inet 192.168.1.153 netmask 0xffffff00 broadcast 192.168.1.255 > media: Ethernet autoselect (1000baseTX ) > status: active > igb1: flags=8843 metric 0 mtu > 1500 > options=19b > ether 00:30:48:c8:19:67 > media: Ethernet autoselect (1000baseTX ) > status: active > lagg: laggdev lagg0 > lo0: flags=8049 metric 0 mtu 16384 > inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3 > inet6 ::1 prefixlen 128 > inet 127.0.0.1 netmask 0xff000000 > lagg0: flags=8843 metric 0 mtu > 1500 > options=19b > ether 00:30:48:c8:19:67 > inet 192.168.111.254 netmask 0xffffff00 broadcast 192.168.111.255 > media: Ethernet autoselect > status: active > laggproto lacp > laggport: igb1 flags=1c > gif0: flags=8051 metric 0 mtu 1280 > tunnel inet 192.168.1.153 --> 192.168.1.156 > inet 192.168.111.254 --> 192.168.112.254 netmask 0xffffffff > > > I tried to remove lagg & gif interfaces, boot GENERIC kernel and even > set up same net config from LiveFS cd - nothing helps. Forwarding > speed sometimes goes up to 1-2 Mbit/sec while local speeds are always > above 900Mbit. > System load is less 1%, logs contain nothing interesting... > > Any clues and ideas would be appreciated!!!! > > > > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org"