From owner-freebsd-questions@FreeBSD.ORG Thu Oct 10 19:00:04 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id C29BD59B for ; Thu, 10 Oct 2013 19:00:04 +0000 (UTC) (envelope-from aurfalien@gmail.com) Received: from mail-pb0-x22b.google.com (mail-pb0-x22b.google.com [IPv6:2607:f8b0:400e:c01::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9C380246A for ; Thu, 10 Oct 2013 19:00:04 +0000 (UTC) Received: by mail-pb0-f43.google.com with SMTP id md4so2986909pbc.2 for ; Thu, 10 Oct 2013 12:00:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=tL3uTdckj2TxrlWmT5MWb8XJMSSsPXQINRB9XBwdads=; b=PhORFPhsyD/EIFy6fD1ORBivZNzyS0XKoUAOCFlY/MoCCfhpBeESz3Lu3SFRoVCBNR B/UOTqimnkwhHiGLYXu2d9QhJOqbp4ZEHDZybUMp6HXS+RcR9rHUX0SaigdSVIIL/Z7s Fsddor/ieDA22eWnahYAWYQiLwNtqVjM9CB2Vs82THQlORQWEWO9iBXC72Cb7f8so2/q Mrs7cjy7F/SaoPIZftccKQruaZ2Mpd7+A7kavDlCuG6WMCCLUOn+DA7L0+niWWcxZjci 4Dwx946RiCvk3iB5mJf7kwJFRP0hwKg3c0aTzJtKP9f60OaAzKHMd22FMX8+iUf9YiF7 LtHw== X-Received: by 10.68.139.168 with SMTP id qz8mr15763229pbb.1.1381431604235; Thu, 10 Oct 2013 12:00:04 -0700 (PDT) Received: from briankrusicw.logan.tv ([64.17.255.138]) by mx.google.com with ESMTPSA id tx5sm54783373pbc.29.1969.12.31.16.00.00 (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 10 Oct 2013 12:00:03 -0700 (PDT) Subject: Re: copying milllions of small files and millions of dirs Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: text/plain; charset=us-ascii From: aurfalien In-Reply-To: <20130816064612.GH1190@petole.demisel.net> Date: Thu, 10 Oct 2013 12:00:01 -0700 Content-Transfer-Encoding: 7bit Message-Id: <852D7000-F9D2-4C63-8D68-A56F77EB9B8C@gmail.com> References: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com> <20130816064612.GH1190@petole.demisel.net> To: Nicolas KOWALSKI X-Mailer: Apple Mail (2.1085) Cc: freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 10 Oct 2013 19:00:04 -0000 On Aug 15, 2013, at 11:46 PM, Nicolas KOWALSKI wrote: > On Thu, Aug 15, 2013 at 11:13:25AM -0700, aurfalien wrote: >> Is there a faster way to copy files over NFS? > > I would use find+cpio. This handles hard links, permissions, and in case > of later runs, will not copy files if they already exist on the > destination. > > # cd /source/dir > # find . | cpio -pvdm /destination/dir Old thread I know but cpio has proven twice as fast as rsync. Trusty ol cpio. Gonna try cpdup next. - aurf