From owner-freebsd-questions@FreeBSD.ORG Fri May 21 09:50:48 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5204716A4CE for ; Fri, 21 May 2004 09:50:48 -0700 (PDT) Received: from arrow.wiznet.ca (arrow.wiznet.ca [216.138.223.232]) by mx1.FreeBSD.org (Postfix) with ESMTP id E435F43D1F for ; Fri, 21 May 2004 09:50:47 -0700 (PDT) (envelope-from steve@nomad.lets.net) Received: from nomad.lets.net (H74.C220.tor.velocet.net [216.138.220.74]) by arrow.wiznet.ca (Postfix) with SMTP id 1ECAC6701 for ; Fri, 21 May 2004 12:50:32 -0400 (EDT) Received: (qmail 2227 invoked by uid 1008); 21 May 2004 17:44:45 -0000 Date: Fri, 21 May 2004 13:44:45 -0400 From: Steve Shorter To: Eric Anderson Message-ID: <20040521174445.GA2211@nomad.lets.net> References: <40ABD7C8.7050405@centtech.com> <20040520154459.GA99944@nomad.lets.net> <40ACD24E.8010401@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <40ACD24E.8010401@centtech.com> User-Agent: Mutt/1.4i cc: freebsd-net@freebsd.org cc: Steve Shorter cc: freebsd-questions@freebsd.org Subject: Re: Max NFSD processes X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 21 May 2004 16:50:48 -0000 On Thu, May 20, 2004 at 10:44:14AM -0500, Eric Anderson wrote: > > > > That's good to hear. Did you do any other tweaks? sysctl settings? > mbufs? net.inet.udp.recvspace=524288 kern.ipc.maxsockbuf=1048576 net.inet.icmp.drop_redirect=1 net.inet.icmp.log_redirect=1 Telus-nfs1:# w 12:41PM up 212 days, 15 hrs, 3 users, load averages: 0.49, 0.62, 0.71 USER TTY FROM LOGIN@ IDLE WHAT nfs1:# netstat -m 441/1488/65536 mbufs in use (current/peak/max): 406 mbufs allocated to data 35 mbufs allocated to packet headers 242/1040/16384 mbuf clusters in use (current/peak/max) 2452 Kbytes allocated to network (4% of mb_map in use) 0 requests for memory denied 0 requests for memory delayed 0 calls to protocol drain routines > > > >>Thanks - any help/hints is appreciated. > >> > >> Disk design issues matter cause it is the ultimate bottleneck. RAID is you friend. Lots of RAM helps. I use 4G. and compile a custom kernel with maxusers at 256 and KVA_PAGES at 512. You can check/verify kvm usage with sysclt's vm.kvm_size and vm.kvm_free > >> > > > > You probably also want good nics (fxp0) and to > >increase UDP buffer space. I have found that nfs over udp > >offers supperior performance than tcp on a good LAN > > > > > I'm currently using 3com's (xl0,xl1) and Intel Gigabit cards (em0,em1). > Most of my clients are using udp. > > What did you set your buffer space to? Which sysctl did you change? > udp recvspace. see above. -steve