From owner-freebsd-current@FreeBSD.ORG Thu May 6 18:18:27 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A4A371065673 for ; Thu, 6 May 2010 18:18:27 +0000 (UTC) (envelope-from ianf@clue.co.za) Received: from inbound01.jnb1.gp-online.net (inbound01.jnb1.gp-online.net [41.161.16.135]) by mx1.freebsd.org (Postfix) with ESMTP id 2D1688FC13 for ; Thu, 6 May 2010 18:18:26 +0000 (UTC) Received: from [41.154.88.19] (helo=clue.co.za) by inbound01.jnb1.gp-online.net with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.63) (envelope-from ) id 1OA5eS-0000ZF-7P; Thu, 06 May 2010 20:18:24 +0200 Received: from localhost ([127.0.0.1] helo=clue.co.za) by clue.co.za with esmtp (Exim 4.69 (FreeBSD)) (envelope-from ) id 1OA5eK-0000qV-Ne; Thu, 06 May 2010 20:18:16 +0200 To: joe From: Ian FREISLICH In-Reply-To: <4BE2EB2E.90208@hostedcontent.com> References: <4BE2EB2E.90208@hostedcontent.com> <4B99031D.3080308@freebsd.org> X-Attribution: BOFH Date: Thu, 06 May 2010 20:18:11 +0200 Message-Id: Cc: freebsd-current@freebsd.org Subject: Re: Help with igb driver/nics, strange issue. X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 06 May 2010 18:18:27 -0000 joe wrote: > I have 3 boxes, each with two nics. One nic for the private network and > one for the public network. > The private network is all on the same vlan. All 6 nics are on the same > switch. All connections are 1000tx Full Duplex. > > I will call the servers Box A, Box B, and Box C. > > When i FTP data between Box A & B i get abou 25MB/sec. > When i FTP data from Box C to Box A or B, i get about 20MB/sec. > When i FTP data from Box A to C i get 10MB/sec > When i FTP data from Box B to C i get 200KB/sec... > > Can anyone suggest why i might only be getting 200KB when transfering > data from Box B to C but not when transferring data from Box A to C? Is the hardware exactly the same on all 3 hosts? From your enumeration it looks like there's something special about box C. How busy are the disks? One of the problems with FTP, at least the last time I tried to use it for benchmarking was that it used tiny, tiny transfers to and from disk. Strangely scp did better even with the crypto overhead. Have you tried using netperf to test the network performance? Have you checked your cables? I've seen all sorts of wierd problems caused by cables. netstat -ni should give an idea of transmission problems. If the switch is a managed switch, you can also check its interface counters. Ian -- Ian Freislich