From owner-freebsd-questions@FreeBSD.ORG Mon Aug 19 17:52:57 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4BE841A7; Mon, 19 Aug 2013 17:52:57 +0000 (UTC) (envelope-from aurfalien@gmail.com) Received: from mail-pa0-x233.google.com (mail-pa0-x233.google.com [IPv6:2607:f8b0:400e:c03::233]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 1F9A62E50; Mon, 19 Aug 2013 17:52:57 +0000 (UTC) Received: by mail-pa0-f51.google.com with SMTP id lf1so4846113pab.24 for ; Mon, 19 Aug 2013 10:52:56 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=JlTP/QWFIrFYlG2E67gvPcE3O1pQ88/ZXVw7vAcRo64=; b=gYDJ+kDtJ6dGcgtiZZx8cmIUlx8mj6ftRFWRetkjMpxIAMBS+mX8eOVWAOxSQsaEVd a9OpHOlDqC+tof6olQ+WZt39kVPC3opFUzevhEyDg+sSxJ94Zn2EjJQPu1h6X6V0Kf6n G6obLtCzO4isH567TVabkeL3vBBVOpxfuU68PZKrpUDxy9ZCGBwMmn4j9ZMUh3VR0hp9 p2i9T3KW4ppILihan5Nbg/XJJC55OORUXF7gHjjCrzTlyUGfvIdwnOh0MtWrcsGpofIC T8WuurQXqtmkcTTCxMTjT33PCJ6J0wFSa8DhczOs0ZsH8MsIJny021ySK8uNJdeuB2j2 diMQ== X-Received: by 10.66.171.13 with SMTP id aq13mr5761990pac.30.1376934776797; Mon, 19 Aug 2013 10:52:56 -0700 (PDT) Received: from briankrusicw.logan.tv ([64.17.255.138]) by mx.google.com with ESMTPSA id nj9sm16402056pbc.13.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 19 Aug 2013 10:52:55 -0700 (PDT) Subject: Re: copying milllions of small files and millions of dirs Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: text/plain; charset=us-ascii From: aurfalien In-Reply-To: <1376934082.25499.11612497.1C73C726@webmail.messagingengine.com> Date: Mon, 19 Aug 2013 10:52:53 -0700 Content-Transfer-Encoding: 7bit Message-Id: References: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com> <20130816064612.GH1190@petole.demisel.net> <1376934082.25499.11612497.1C73C726@webmail.messagingengine.com> To: Mark Felder X-Mailer: Apple Mail (2.1085) Cc: freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Aug 2013 17:52:57 -0000 On Aug 19, 2013, at 10:41 AM, Mark Felder wrote: > On Fri, Aug 16, 2013, at 1:46, Nicolas KOWALSKI wrote: >> On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote: >>> Is there a faster way to copy files over NFS? >> >> I would use find+cpio. This handles hard links, permissions, and in case >> of later runs, will not copy files if they already exist on the >> destination. >> >> # cd /source/dir >> # find . | cpio -pvdm /destination/dir >> > > I always found sysutils/cpdup to be faster than rsync. Ah, bookmarking this one. Many thanks. - aurf