Date: Wed, 9 Mar 2005 14:48:26 -0800 From: Peter Hessler <phessler@coverity.com> To: freebsd-performance@freebsd.org Subject: Re: NFS small files Message-ID: <20050309144826.2e44ebeb@leela.theapt.org> In-Reply-To: <422E5DE1.9040901@centtech.com> References: <20050309005628.5C6D1908B8@coverity.dreamhost.com> <422E541C.8040108@telus.net> <20050309014632.49895908B7@coverity.dreamhost.com> <20050309015119.44566908B7@coverity.dreamhost.com> <422E5DE1.9040901@centtech.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, 08 Mar 2005 20:22:25 -0600 Eric Anderson <anderson@centtech.com> wrote: :Peter Hessler wrote: :> I should mention that copying the same directory on the nfs server takes :> 15s, rather than the 54s over nfs. : : :Are you using TCP or UDP NFS connection, version 2 or 3? : TCP and v3. I didn't see a difference between TCP and UDP. : : :> On Tue, 8 Mar 2005 17:46:31 -0800 :> Peter Hessler <phessler@coverity.com> wrote: :> :> : These files are sitting right next to each other on disk, I created :> them :> : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i :> : bs=128 count=128; done""". Then I timed the copy of that directory. :> : :> : Does seek really cause an 11x performance penalty? :> : :> : On Tue, 08 Mar 2005 17:40:44 -0800 :> : Peter Kieser <pfak@telus.net> wrote: :> : :> : : Copying single files are always going to take longer, because the :> : drive :> : : has to seek more thus latency is introduced. :> : : :> : : --Peter :> : : :> : : Peter Hessler wrote: :> : : :> : : >I'm setting up an NFS server to be used for compiling, and it seems :> : that :> : : >while speeds are acceptable for large files, small files take much :> : : >longer than expected. :> : : > :> : : >Copying 10000 16K files (in a directory) takes 54seconds, while :> : copying :> : : >a 170M single file takes 5s. :> : : > :> : : >Are there any tricks for speeding up small file performance? I'm :> : : >willing to give up large file performance. :> : : > :> : : >/etc/sysctl.conf: :> : : > vfs.vmiodirenable=1 :> : : > kern.ipc.somaxconn=2048 :> : : > kern.maxfiles=65536 :> : : > net.isr.enable=1 :> : : > :> : : >/boot/loader.conf: :> : : > kern.ipc.nmbclusters=32768 :> : : > :> : : >Kernel Conf: :> : : > include GENERIC :> : : > ident NFS :> : : > options DEVICE_POLLING :> : : > options HZ=1000 :> : : >_______________________________________________ :> : : >freebsd-performance@freebsd.org mailing list :> : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : : >To unsubscribe, send any mail to :> : "freebsd-performance-unsubscribe@freebsd.org" :> : : > :> : : > :> : : > :> : : :> : : _______________________________________________ :> : : freebsd-performance@freebsd.org mailing list :> : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : : To unsubscribe, send any mail to :> : "freebsd-performance-unsubscribe@freebsd.org" :> : _______________________________________________ :> : freebsd-performance@freebsd.org mailing list :> : http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> : To unsubscribe, send any mail to :> "freebsd-performance-unsubscribe@freebsd.org" :> _______________________________________________ :> freebsd-performance@freebsd.org mailing list :> http://lists.freebsd.org/mailman/listinfo/freebsd-performance :> To unsubscribe, send any mail to :"freebsd-performance-unsubscribe@freebsd.org" : : :-- :------------------------------------------------------------------------ :Eric Anderson Sr. Systems Administrator Centaur Technology :I have seen the future and it is just like the present, only longer. :------------------------------------------------------------------------ :_______________________________________________ :freebsd-performance@freebsd.org mailing list :http://lists.freebsd.org/mailman/listinfo/freebsd-performance :To unsubscribe, send any mail to :"freebsd-performance-unsubscribe@freebsd.org"
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20050309144826.2e44ebeb>