From owner-freebsd-performance@FreeBSD.ORG Wed Mar 9 01:51:20 2005 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 5513116A4CE for ; Wed, 9 Mar 2005 01:51:20 +0000 (GMT) Received: from coverity.dreamhost.com (coverity.dreamhost.com [66.33.192.105]) by mx1.FreeBSD.org (Postfix) with ESMTP id E755043D4C for ; Wed, 9 Mar 2005 01:51:19 +0000 (GMT) (envelope-from phessler@coverity.com) Received: from foo.coverity.int (64-173-147-27.ded.pacbell.net [64.173.147.27]) by coverity.dreamhost.com (Postfix) with ESMTP id 44566908B7 for ; Tue, 8 Mar 2005 17:51:19 -0800 (PST) Date: Tue, 8 Mar 2005 17:51:19 -0800 From: Peter Hessler To: freebsd-performance@freebsd.org In-Reply-To: <20050309014632.49895908B7@coverity.dreamhost.com> References: <20050309005628.5C6D1908B8@coverity.dreamhost.com> <422E541C.8040108@telus.net> <20050309014632.49895908B7@coverity.dreamhost.com> Organization: Coverity X-Mailer: Sylpheed version 0.9.99 (GTK+ 1.2.10; i386-unknown-openbsd3.6) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Message-Id: <20050309015119.44566908B7@coverity.dreamhost.com> Subject: Re: NFS small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Mar 2005 01:51:20 -0000 I should mention that copying the same directory on the nfs server takes 15s, rather than the 54s over nfs. On Tue, 8 Mar 2005 17:46:31 -0800 Peter Hessler wrote: : These files are sitting right next to each other on disk, I created them : at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i : bs=128 count=128; done""". Then I timed the copy of that directory. : : Does seek really cause an 11x performance penalty? : : On Tue, 08 Mar 2005 17:40:44 -0800 : Peter Kieser wrote: : : : Copying single files are always going to take longer, because the : drive : : has to seek more thus latency is introduced. : : : : --Peter : : : : Peter Hessler wrote: : : : : >I'm setting up an NFS server to be used for compiling, and it seems : that : : >while speeds are acceptable for large files, small files take much : : >longer than expected. : : > : : >Copying 10000 16K files (in a directory) takes 54seconds, while : copying : : >a 170M single file takes 5s. : : > : : >Are there any tricks for speeding up small file performance? I'm : : >willing to give up large file performance. : : > : : >/etc/sysctl.conf: : : > vfs.vmiodirenable=1 : : > kern.ipc.somaxconn=2048 : : > kern.maxfiles=65536 : : > net.isr.enable=1 : : > : : >/boot/loader.conf: : : > kern.ipc.nmbclusters=32768 : : > : : >Kernel Conf: : : > include GENERIC : : > ident NFS : : > options DEVICE_POLLING : : > options HZ=1000 : : >_______________________________________________ : : >freebsd-performance@freebsd.org mailing list : : >http://lists.freebsd.org/mailman/listinfo/freebsd-performance : : >To unsubscribe, send any mail to : "freebsd-performance-unsubscribe@freebsd.org" : : > : : > : : > : : : : _______________________________________________ : : freebsd-performance@freebsd.org mailing list : : http://lists.freebsd.org/mailman/listinfo/freebsd-performance : : To unsubscribe, send any mail to : "freebsd-performance-unsubscribe@freebsd.org" : _______________________________________________ : freebsd-performance@freebsd.org mailing list : http://lists.freebsd.org/mailman/listinfo/freebsd-performance : To unsubscribe, send any mail to "freebsd-performance-unsubscribe@freebsd.org"