From owner-freebsd-performance@FreeBSD.ORG  Sun Oct 11 20:50:20 2009
Return-Path: <owner-freebsd-performance@FreeBSD.ORG>
Delivered-To: freebsd-performance@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 451ED1065672
	for <freebsd-performance@freebsd.org>;
	Sun, 11 Oct 2009 20:50:20 +0000 (UTC)
	(envelope-from lists@stringsutils.com)
Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147])
	by mx1.freebsd.org (Postfix) with ESMTP id 180388FC1E
	for <freebsd-performance@freebsd.org>;
	Sun, 11 Oct 2009 20:50:19 +0000 (UTC)
Received: from shelca (zoraida.natserv.net [66.114.65.147])
	by zoraida.natserv.net (Postfix) with ESMTP id E4DEA1704F;
	Sun, 11 Oct 2009 16:50:18 -0400 (EDT)
References: <1255189612.42461.net.help@m2k.com.tw>
Message-ID: <cone.1255294210.110142.12459.1000@shelca>
X-Mailer: http://www.courier-mta.org/cone/
From: Francisco Reyes <lists@stringsutils.com>
To: net.help@m2k.com.tw
Date: Sun, 11 Oct 2009 16:50:10 -0400
Mime-Version: 1.0
Content-Type: text/plain; format=flowed; charset="US-ASCII"
Content-Disposition: inline
Content-Transfer-Encoding: 7bit
Cc: freebsd-performance <freebsd-performance@freebsd.org>
Subject: Re: Migrate large amount of small files
X-BeenThere: freebsd-performance@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Performance/tuning <freebsd-performance.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-performance>
List-Post: <mailto:freebsd-performance@freebsd.org>
List-Help: <mailto:freebsd-performance-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-performance>,
	<mailto:freebsd-performance-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sun, 11 Oct 2009 20:50:20 -0000

Ckcheng writes:

> 1. rsync
> 2. tar ..

If this is a migration I find that tar to the local machine, copy over, 
restore, then rsync are likely the best options.

In my experience copying lots of small files is going to take a long time, 
no matter which method you use.

>From all the combinations I have tried in the past tar first then rsync 
worked best for me.