From owner-freebsd-performance@FreeBSD.ORG Wed Mar 9 22:51:51 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 451EA16A4CE for ; Wed, 9 Mar 2005 22:51:51 +0000 (GMT) Received: from coverity.dreamhost.com (coverity.dreamhost.com [66.33.192.105]) by mx1.FreeBSD.org (Postfix) with ESMTP id 029DE43D41 for ; Wed, 9 Mar 2005 22:51:51 +0000 (GMT) (envelope-from phessler@coverity.com) Received: from leela.theapt.org (piro.theapt.org [208.201.244.164]) by coverity.dreamhost.com (Postfix) with ESMTP id 721EA9089D for ; Wed, 9 Mar 2005 14:51:50 -0800 (PST) Date: Wed, 9 Mar 2005 14:48:26 -0800 From: Peter Hessler To: freebsd-performance@freebsd.org Message-Id: <20050309144826.2e44ebeb@leela.theapt.org> In-Reply-To: <422E5DE1.9040901@centtech.com> References: <20050309005628.5C6D1908B8@coverity.dreamhost.com> <422E541C.8040108@telus.net> <20050309014632.49895908B7@coverity.dreamhost.com> <20050309015119.44566908B7@coverity.dreamhost.com> <422E5DE1.9040901@centtech.com> X-Mailer: Sylpheed version 0.9.9claws (GTK+ 1.2.10; powerpc-unknown-openbsd3.6) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Subject: Re: NFS small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 22:51:51 -0000 On Tue, 08 Mar 2005 20:22:25 -0600 Eric Anderson wrote: :Peter Hessler wrote: :> I should mention that copying the same directory on the nfs server takes :> 15s, rather than the 54s over nfs. : : :Are you using TCP or UDP NFS connection, version 2 or 3? : TCP and v3. I didn't see a difference between TCP and UDP. : : :> On Tue, 8 Mar 2005 17:46:31 -0800 :> Peter Hessler wrote: :> :> : These files are sitting right next to each other on disk, I created :> them :> : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i :> : bs=128 count=128; done""". Then I timed the copy of that directory. :> : :> : Does seek really cause an 11x performance penalty? :> : :> : On Tue, 08 Mar 2005 17:40:44 -0800 :> : Peter Kieser wrote: :> : :> : : Copying single files are always going to take longer, because the :> : drive :> : : has to seek more thus latency is introduced. :> : : :> : : --Peter :> : : :> : : Peter Hessler wrote: :> : : :> : : >I'm setting up an NFS server to be used for compiling, and it seems :> : that :> : : >while speeds are acceptable for large files, small files take much :> : : >longer than expected. :> : : > :> : : >Copying 10000 16K files (in a directory) takes 54seconds, while :> : copying :> : : >a 170M single file takes 5s. :> : : > :> : : >Are there any tricks for speeding up small file performance? I'm :> : : >willing to give up large file performance. :> : : > :> : : >/etc/sysctl.conf: :> : : > vfs.vmiodirenable=1 :> : : > kern.ipc.somaxconn=2048 :> : : > kern.maxfiles=65536 :> : : > net.isr.enable=1 :> : : > :> : : >/boot/loader.conf: :> : : > kern.ipc.nmbclusters=32768 :> : : > :> : : >Kernel Conf: :> : : > include GENERIC :> : : > ident NFS :> : : > options DEVICE_POLLING :> : : > options HZ=1000 :> : : >_______________________________________________ :> : : >freebsd-performance@freebsd.org mailing list :> : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : : >To unsubscribe, send any mail to :> : "freebsd-performance-unsubscribe@freebsd.org" :> : : > :> : : > :> : : > :> : : :> : : _______________________________________________ :> : : freebsd-performance@freebsd.org mailing list :> : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : : To unsubscribe, send any mail to :> : "freebsd-performance-unsubscribe@freebsd.org" :> : _______________________________________________ :> : freebsd-performance@freebsd.org mailing list :> : http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : To unsubscribe, send any mail to :> "freebsd-performance-unsubscribe@freebsd.org" :> _______________________________________________ :> freebsd-performance@freebsd.org mailing list :> http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> To unsubscribe, send any mail to :"freebsd-performance-unsubscribe@freebsd.org" : : :-- :------------------------------------------------------------------------ :Eric Anderson Sr. Systems Administrator Centaur Technology :I have seen the future and it is just like the present, only longer. :------------------------------------------------------------------------ :_______________________________________________ :freebsd-performance@freebsd.org mailing list :http://lists.freebsd.org/mailman/listinfo/freebsd-performance :To unsubscribe, send any mail to :"freebsd-performance-unsubscribe@freebsd.org"