From owner-freebsd-current@FreeBSD.ORG Tue Sep 5 15:09:13 2006 Return-Path: X-Original-To: freebsd-current@freebsd.org Delivered-To: freebsd-current@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id E93B316A4F0 for ; Tue, 5 Sep 2006 15:09:13 +0000 (UTC) (envelope-from dwoolworth@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.191]) by mx1.FreeBSD.org (Postfix) with ESMTP id A11D643F0D for ; Tue, 5 Sep 2006 15:05:53 +0000 (GMT) (envelope-from dwoolworth@gmail.com) Received: by nf-out-0910.google.com with SMTP id n29so1435487nfc for ; Tue, 05 Sep 2006 08:05:35 -0700 (PDT) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references; b=oXlLGGrMMgT1uCV3bSn5LG0LiCaeQCFcdQ99g0JWyewfxVGYZGq2xgXk3TQG9pMW8jeHbzwWxe3wfhVTx2/ZJnhO76OKS/r8PBNyKfc6d13auU3Y2DAwYLOUzgoZTqJ1f8U95yC403uKwX8yKietWQHElFjrDhphqec0H9NLzdA= Received: by 10.49.90.4 with SMTP id s4mr7827706nfl; Tue, 05 Sep 2006 08:05:35 -0700 (PDT) Received: by 10.48.207.16 with HTTP; Tue, 5 Sep 2006 08:05:29 -0700 (PDT) Message-ID: <10fd06c60609050805j52f4ea83kb53799255de7ab33@mail.gmail.com> Date: Tue, 5 Sep 2006 10:05:29 -0500 From: "Derrick T. Woolworth" To: "Jack Vogel" In-Reply-To: <2a41acea0609042326y3f020901ja5d020e6734a4b84@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <10fd06c60609031846x60c40383iaee659aa7ee74300@mail.gmail.com> <20060904081938.GX40020@FreeBSD.org> <2a41acea0609042326y3f020901ja5d020e6734a4b84@mail.gmail.com> Cc: freebsd-current@freebsd.org Subject: Re: Jumbo Frames with em X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Sep 2006 15:09:14 -0000 I'm using TCP currently, getting around 10MB/sec when writing one to three files over NFS. With UDP I get around 2 to 4/MB/sec. I did do a network test with netpipe and with the mtu set to 9000 on all cards, netpipe shows I'm getting 125MB/sec at 8192 byte packets. I assume this would be typical of a GB network and indicates that speed wise, the network is functioning well. I do notice a fairly large speed decrease when writing to either my RAID0 or RAID5 store (really shocked to find the RAID0 running slower than a NFS mount to an IDE drive, but nevertheless). The speed of NFS is orders of magnitude slower than the network or the disks. Thanks, D On 9/5/06, Jack Vogel wrote: > On 9/4/06, Gleb Smirnoff wrote: > > On Sun, Sep 03, 2006 at 08:46:21PM -0500, Derrick T. Woolworth wrote: > > D> I'm running -current on a NFS file server with a 3ware controller > > D> striping across multiple disks. The box uses the em driver with the > > D> mtu set to 8192 - client machines connecting via NFS that are also > > D> running -current with bge drivers with the mtu set to 8192 (and jumbo > > D> frames enabled on the switch)... > > D> > > D> The em driver's README says that UDP and Jumbo Frames don't play well > > D> together - just wondering if this would have any impact on NFS over > > D> TCP? > > > > This comment is quite old. It may happen that this isn't true anymore. > > May be developers from Intel will comment on this. > > > > D> Does anyone know anything about the future of the em driver or > > D> bge driver that might have performance issues with Jumbo Frames? > > D> > > D> I'm only ever seeing the storage system write about 10 to 15MB (bytes) > > D> per second over NFS. > > > > Have you tested the performance with ftp, netcat or some network > > benchmarking tool? The problem may be in NFS not in driver. > > Its not entirely clear in your post Derrick, are you using TCP or UDP > NFS? > > Jack > -- Derrick T. Woolworth, President ServeTheWeb, LLC. http://www.ServeTheWeb.com