From owner-freebsd-performance@FreeBSD.ORG Wed Mar 9 02:22:43 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7DABF16A4CE for ; Wed, 9 Mar 2005 02:22:43 +0000 (GMT) Received: from mh1.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id 48D5643D3F for ; Wed, 9 Mar 2005 02:22:42 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [192.168.42.22] (andersonbox2.centtech.com [192.168.42.22]) by mh1.centtech.com (8.13.1/8.13.1) with ESMTP id j292MZ1B023495; Tue, 8 Mar 2005 20:22:35 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <422E5DE1.9040901@centtech.com> Date: Tue, 08 Mar 2005 20:22:25 -0600 From: Eric Anderson User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.7.5) Gecko/20050210 X-Accept-Language: en-us, en MIME-Version: 1.0 To: Peter Hessler References: <20050309005628.5C6D1908B8@coverity.dreamhost.com> <422E541C.8040108@telus.net> <20050309014632.49895908B7@coverity.dreamhost.com> <20050309015119.44566908B7@coverity.dreamhost.com> In-Reply-To: <20050309015119.44566908B7@coverity.dreamhost.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.82/757/Tue Mar 8 17:14:36 2005 on mh1.centtech.com X-Virus-Status: Clean cc: freebsd-performance@freebsd.org Subject: Re: NFS small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 02:22:43 -0000 Peter Hessler wrote: > I should mention that copying the same directory on the nfs server takes > 15s, rather than the 54s over nfs. Are you using TCP or UDP NFS connection, version 2 or 3? > On Tue, 8 Mar 2005 17:46:31 -0800 > Peter Hessler wrote: > > : These files are sitting right next to each other on disk, I created > them > : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i > : bs=128 count=128; done""". Then I timed the copy of that directory. > : > : Does seek really cause an 11x performance penalty? > : > : On Tue, 08 Mar 2005 17:40:44 -0800 > : Peter Kieser wrote: > : > : : Copying single files are always going to take longer, because the > : drive > : : has to seek more thus latency is introduced. > : : > : : --Peter > : : > : : Peter Hessler wrote: > : : > : : >I'm setting up an NFS server to be used for compiling, and it seems > : that > : : >while speeds are acceptable for large files, small files take much > : : >longer than expected. > : : > > : : >Copying 10000 16K files (in a directory) takes 54seconds, while > : copying > : : >a 170M single file takes 5s. > : : > > : : >Are there any tricks for speeding up small file performance? I'm > : : >willing to give up large file performance. > : : > > : : >/etc/sysctl.conf: > : : > vfs.vmiodirenable=1 > : : > kern.ipc.somaxconn=2048 > : : > kern.maxfiles=65536 > : : > net.isr.enable=1 > : : > > : : >/boot/loader.conf: > : : > kern.ipc.nmbclusters=32768 > : : > > : : >Kernel Conf: > : : > include GENERIC > : : > ident NFS > : : > options DEVICE_POLLING > : : > options HZ=1000 > : : >_______________________________________________ > : : >freebsd-performance@freebsd.org mailing list > : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance > : : >To unsubscribe, send any mail to > : "freebsd-performance-unsubscribe@freebsd.org" > : : > > : : > > : : > > : : > : : _______________________________________________ > : : freebsd-performance@freebsd.org mailing list > : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance > : : To unsubscribe, send any mail to > : "freebsd-performance-unsubscribe@freebsd.org" > : _______________________________________________ > : freebsd-performance@freebsd.org mailing list > : http://lists.freebsd.org/mailman/listinfo/freebsd-performance > : To unsubscribe, send any mail to > "freebsd-performance-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-performance@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-performance > To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org" -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology I have seen the future and it is just like the present, only longer. ------------------------------------------------------------------------