From owner-freebsd-questions@FreeBSD.ORG  Tue Aug 20 13:32:40 2013
Return-Path: <owner-freebsd-questions@FreeBSD.ORG>
Delivered-To: freebsd-questions@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTP id 7CEF4ADD;
 Tue, 20 Aug 2013 13:32:40 +0000 (UTC)
 (envelope-from wblock@wonkity.com)
Received: from wonkity.com (wonkity.com [67.158.26.137])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id 318F42F19;
 Tue, 20 Aug 2013 13:32:40 +0000 (UTC)
Received: from wonkity.com (localhost [127.0.0.1])
 by wonkity.com (8.14.7/8.14.7) with ESMTP id r7KDWdov095815;
 Tue, 20 Aug 2013 07:32:39 -0600 (MDT)
 (envelope-from wblock@wonkity.com)
Received: from localhost (wblock@localhost)
 by wonkity.com (8.14.7/8.14.7/Submit) with ESMTP id r7KDWd2w095812;
 Tue, 20 Aug 2013 07:32:39 -0600 (MDT)
 (envelope-from wblock@wonkity.com)
Date: Tue, 20 Aug 2013 07:32:39 -0600 (MDT)
From: Warren Block <wblock@wonkity.com>
To: Mark Felder <feld@FreeBSD.org>
Subject: Re: copying milllions of small files and millions of dirs
In-Reply-To: <1376934082.25499.11612497.1C73C726@webmail.messagingengine.com>
Message-ID: <alpine.BSF.2.00.1308200732210.95636@wonkity.com>
References: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com>
 <20130816064612.GH1190@petole.demisel.net>
 <1376934082.25499.11612497.1C73C726@webmail.messagingengine.com>
User-Agent: Alpine 2.00 (BSF 1167 2008-08-23)
MIME-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3
 (wonkity.com [127.0.0.1]); Tue, 20 Aug 2013 07:32:39 -0600 (MDT)
Cc: freebsd-questions@freebsd.org
X-BeenThere: freebsd-questions@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: User questions <freebsd-questions.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-questions>
List-Post: <mailto:freebsd-questions@freebsd.org>
List-Help: <mailto:freebsd-questions-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-questions>, 
 <mailto:freebsd-questions-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Tue, 20 Aug 2013 13:32:40 -0000

On Mon, 19 Aug 2013, Mark Felder wrote:

> On Fri, Aug 16, 2013, at 1:46, Nicolas KOWALSKI wrote:
>> On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote:
>>> Is there a faster way to copy files over NFS?
>>
>> I would use find+cpio. This handles hard links, permissions, and in case
>> of later runs, will not copy files if they already exist on the
>> destination.
>>
>> # cd /source/dir
>> # find . | cpio -pvdm /destination/dir
>>
>
> I always found sysutils/cpdup to be faster than rsync.

sysutils/clone may do better as well.