From owner-freebsd-questions@FreeBSD.ORG  Wed Mar  2 17:05:32 2005
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id E3DF216A4CE
	for <freebsd-questions@freebsd.org>;
	Wed,  2 Mar 2005 17:05:32 +0000 (GMT)
Received: from wproxy.gmail.com (wproxy.gmail.com [64.233.184.196])
	by mx1.FreeBSD.org (Postfix) with ESMTP id 6D25643D46
	for <freebsd-questions@freebsd.org>;
	Wed,  2 Mar 2005 17:05:32 +0000 (GMT)
	(envelope-from freminlins@gmail.com)
Received: by wproxy.gmail.com with SMTP id 69so236096wri
	for <freebsd-questions@freebsd.org>;
	Wed, 02 Mar 2005 09:05:32 -0800 (PST)
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws;
	s=beta; d=gmail.com;
	h=received:message-id:date:from:reply-to:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:references;
	b=D93uqzxBfF/iXwhyHVDeY9G0S47QMjrNi0Mjs4q/+0cZhUMJ7ONQYofk5wyzWlmcHHavrpXcCXmh3IPbAbRKf8J7nnLrzvAUYpHXVIiyffji53MxZt59M1St1dzmaE/4bbBkYt+a+OwTS4auadZ+XTnLD0DcjwNFy7g5EEHKjp0=
Received: by 10.54.4.69 with SMTP id 69mr83676wrd;
        Wed, 02 Mar 2005 09:05:31 -0800 (PST)
Received: by 10.54.4.59 with HTTP; Wed, 2 Mar 2005 09:05:30 -0800 (PST)
Message-ID: <eeef1a4c050302090523b13996@mail.gmail.com>
Date: Wed, 2 Mar 2005 17:05:30 +0000
From: Freminlins <freminlins@gmail.com>
To: Tim Traver <tt-list@simplenet.com>
In-Reply-To: <4225EF40.8080409@simplenet.com>
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
References: <4225EF40.8080409@simplenet.com>
cc: freebsd-questions@freebsd.org
Subject: Re: NFS Write performance
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
Reply-To: Freminlins <freminlins@gmail.com>
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>,
	<mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>,
	<mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 02 Mar 2005 17:05:33 -0000

On Wed, 02 Mar 2005 08:52:16 -0800, Tim Traver <tt-list@simplenet.com> wrote:
> Hi all,
> 
> ok, I've searched far and wide, but I have to ask the FreeBSD gurus
> about it...
> 
> I'm using a Netapp NFS server to serve up content to FreeBSD clients,
> and I am seeing terrible write performances.

I don't call myself a guru, but we have a similar setup with 4 NetApps
with about 20 FreeBSD (dual Xeon) clients.

> I've turned on these in the rc.conf file :
> 
> nfs_client_enable="YES"
> nfs_client_flags="-n 4"
> nfs_bufpackets=8

You don't need these for the client:
> nfs_server_enable="YES"
> rpc_lockd_enable="YES"
> rpc_statd_enable="YES"

> and I've got these in the sysctl.cnf file :
> 
> kern.maxfiles=32768
> net.inet.tcp.keepidle=3600
> net.inet.tcp.sendspace=65536
> net.inet.tcp.recvspace=65536
> net.inet.tcp.slowstart_flightsize=2
> kern.ipc.somaxconn=16384
> kern.ipc.shmall=65536
> kern.ipc.shmmax=268435456
> kern.ipc.nmbclusters=32768
> 
> I'm using 5.3-RELEASE on a dual AMD Opteron machine.
 
> I guess my question is, how do I make NFS writes fly ???
> 
> The reads seem to be pretty good. I know that the settings on the netapp
> are per their settings...

What sort of performance are you getting? On one of our already busy
mail servers, using just normal mounting on fast ethernet, I get:
 
bash-2.05b# time dd if=/dev/zero of=/mail/A-D/100M bs=1024k count=100
100+0 records in
100+0 records out
104857600 bytes transferred in 9.284085 secs (11294339 bytes/sec)

Not bad! We also get extremely good I/O on email, i.e. small files.

> Thanks,
> 
> Tim.

Frem.