From owner-freebsd-questions@FreeBSD.ORG Thu Aug 15 20:02:21 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 228718A7 for ; Thu, 15 Aug 2013 20:02:21 +0000 (UTC) (envelope-from frank2@fjl.co.uk) Received: from bs1.fjl.org.uk (bs1.fjl.org.uk [84.45.41.196]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9E9DC2692 for ; Thu, 15 Aug 2013 20:02:20 +0000 (UTC) Received: from [10.106.108.30] ([46.233.72.243]) (authenticated bits=0) by bs1.fjl.org.uk (8.14.4/8.14.4) with ESMTP id r7FK2Ghd091541 (version=TLSv1/SSLv3 cipher=DHE-DSS-CAMELLIA256-SHA bits=256 verify=NO) for ; Thu, 15 Aug 2013 21:02:17 +0100 (BST) (envelope-from frank2@fjl.co.uk) Message-ID: <520D33D6.8050607@fjl.co.uk> Date: Thu, 15 Aug 2013 21:02:30 +0100 From: Frank Leonhardt Organization: Frank Leonhardt User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: freebsd-questions@freebsd.org Subject: Re: copying milllions of small files and millions of dirs References: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com> In-Reply-To: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.14 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list Reply-To: frank2@fjl.co.uk List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Aug 2013 20:02:21 -0000 On 15/08/2013 19:13, aurfalien wrote: > Hi all, > > Is there a faster way to copy files over NFS? > > Currently breaking up a simple rsync over 7 or so scripts which copies 22 dirs having ~500,000 dirs or files each. > I'm reading all this with interest. The first thing I'd have tried would be tar (and probably netcat) but I'm a probably bit of a dinosaur. (If someone wants to buy me some really big drives I promise I'll update). If it's really NFS or nothing I guess you couldn't open a socket anyway. I'd be interested to know whether tar is still worth using in this world of volume managers and SMP.