From owner-freebsd-performance@FreeBSD.ORG  Wed Mar  9 01:46:33 2005
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125])
	by hub.freebsd.org (Postfix) with ESMTP id 1D48416A4CE
	for <freebsd-performance@freebsd.org>;
	Wed,  9 Mar 2005 01:46:33 +0000 (GMT)
Received: from coverity.dreamhost.com (coverity.dreamhost.com [66.33.192.105])
	by mx1.FreeBSD.org (Postfix) with ESMTP id D7D5543D49
	for <freebsd-performance@freebsd.org>;
	Wed,  9 Mar 2005 01:46:32 +0000 (GMT)
	(envelope-from phessler@coverity.com)
Received: from foo.coverity.int (64-173-147-27.ded.pacbell.net
	[64.173.147.27])
	by coverity.dreamhost.com (Postfix) with ESMTP id 49895908B7
	for <freebsd-performance@freebsd.org>;
	Tue,  8 Mar 2005 17:46:32 -0800 (PST)
Date: Tue, 8 Mar 2005 17:46:31 -0800
From: Peter Hessler <phessler@coverity.com>
To: freebsd-performance@freebsd.org
In-Reply-To: <422E541C.8040108@telus.net>
References: <20050309005628.5C6D1908B8@coverity.dreamhost.com>
	<422E541C.8040108@telus.net>
Organization: Coverity
X-Mailer: Sylpheed version 0.9.99 (GTK+ 1.2.10; i386-unknown-openbsd3.6)
Mime-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Message-Id: <20050309014632.49895908B7@coverity.dreamhost.com>
Subject: Re: NFS small files
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.1
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 09 Mar 2005 01:46:33 -0000

These files are sitting right next to each other on disk, I created them
at the same time: """for i in `jot 10000`; do dd if=/dev/random of=$i
bs=128 count=128; done""".  Then I timed the copy of that directory.

Does seek really cause an 11x performance penalty?

On Tue, 08 Mar 2005 17:40:44 -0800
Peter Kieser <pfak@telus.net> wrote:

: Copying single files are always going to take longer, because the
drive 
: has to seek more thus latency is introduced.
: 
: --Peter
: 
: Peter Hessler wrote:
: 
: >I'm setting up an NFS server to be used for compiling, and it seems
that
: >while speeds are acceptable for large files, small files take much
: >longer than expected.
: >
: >Copying 10000 16K files (in a directory) takes 54seconds, while
copying
: >a 170M single file takes 5s.
: >
: >Are there any tricks for speeding up small file performance?  I'm
: >willing to give up large file performance.
: >
: >/etc/sysctl.conf:
: > vfs.vmiodirenable=1
: > kern.ipc.somaxconn=2048
: > kern.maxfiles=65536
: > net.isr.enable=1
: >
: >/boot/loader.conf:
: > kern.ipc.nmbclusters=32768
: >
: >Kernel Conf:
: > include GENERIC
: > ident NFS
: > options DEVICE_POLLING
: > options HZ=1000
: >_______________________________________________
: >freebsd-performance@freebsd.org mailing list
: >http://lists.freebsd.org/mailman/listinfo/freebsd-performance
: >To unsubscribe, send any mail to
"freebsd-performance-unsubscribe@freebsd.org"
: >
: >  
: >
: 
: _______________________________________________
: freebsd-performance@freebsd.org mailing list
: http://lists.freebsd.org/mailman/listinfo/freebsd-performance
: To unsubscribe, send any mail to
"freebsd-performance-unsubscribe@freebsd.org"