From owner-freebsd-performance@FreeBSD.ORG Tue Jun 10 12:56:35 2003 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id AAC2237B421 for ; Tue, 10 Jun 2003 12:56:34 -0700 (PDT) Received: from perrin.int.nxad.com (internal.ext.nxad.com [69.1.70.251]) by mx1.FreeBSD.org (Postfix) with ESMTP id AD88643FBD for ; Tue, 10 Jun 2003 12:56:33 -0700 (PDT) (envelope-from sean@nxad.com) Received: by perrin.int.nxad.com (Postfix, from userid 1001) id 69E6420F01; Tue, 10 Jun 2003 12:56:32 -0700 (PDT) Date: Tue, 10 Jun 2003 12:56:32 -0700 From: Sean Chittenden To: Eric Anderson Message-ID: <20030610195632.GQ65470@perrin.int.nxad.com> References: <20030609211526.58641.qmail@web14908.mail.yahoo.com> <3EE4FAED.6090603@centtech.com> <3EE595D2.B223CA19@mindspring.com> <3EE5F8DE.30001@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3EE5F8DE.30001@centtech.com> X-PGP-Key: finger seanc@FreeBSD.org X-PGP-Fingerprint: 3849 3760 1AFE 7B17 11A0 83A6 DD99 E31F BC84 B341 X-Web-Homepage: http://sean.chittenden.org/ User-Agent: Mutt/1.5.4i cc: freebsd-performance@freebsd.org cc: Terry Lambert Subject: Re: Slow disk write speeds over network X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jun 2003 19:56:35 -0000 > >...and yet more sysctl's for this: > > > > kern.polling.enable=1 > > kern.polling.user_frac=50 # 0..100; whatever works best > > > >If you've got a really terrible Gigabit Ethernet card, then > >you may be copying all your packets over again (e.g. m_pullup()), > >and that could be eating your bus, too. > > Ok, so the end result is that after playing around with sysctl's, > I've found that the tcp transfers are doing 20MB/s over FTP, but my > NFS is around 1-2MB/s - still slow.. So we've cleared up some tcp > issues, but 2yet still NFS is stinky.. > > Any more ideas? I'm using UDP NFS over a 100Mbit/FD link with the following settings and get about 12-14Mbps: net.inet.tcp.recvspace=65536 net.inet.tcp.sendspace=65536 kern.maxfiles=65536 kern.ipc.maxsockbuf=2097152 kern.ipc.somaxconn=8192 net.inet.tcp.delayed_ack=0 net.inet.udp.recvspace=65536 net.inet.udp.maxdgram=57344 net.local.stream.sendspace=65536 net.local.stream.recvspace=65536 vfs.nfs.async=1 net.inet.udp.log_in_vain=1 net.inet.icmp.icmplim=20000 I'm not taking into account jumbo frames or anything like that, so you may want to increase the size of some of these values where appropriate, but some of these may be a start. -sc -- Sean Chittenden