From owner-freebsd-questions@FreeBSD.ORG Thu Aug 15 18:13:29 2013 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id C24BCB5C for ; Thu, 15 Aug 2013 18:13:29 +0000 (UTC) (envelope-from aurfalien@gmail.com) Received: from mail-pa0-x235.google.com (mail-pa0-x235.google.com [IPv6:2607:f8b0:400e:c03::235]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 9CA50207E for ; Thu, 15 Aug 2013 18:13:29 +0000 (UTC) Received: by mail-pa0-f53.google.com with SMTP id lb1so990694pab.26 for ; Thu, 15 Aug 2013 11:13:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version; bh=fFZCWDpl3evILL/l93O+34CEZnCnzacbQEenTbqxgKY=; b=SyymVokeBAOOF/sss+JQqMBCOjdFQq9OQW9Yw6igzQlEsj6ivT6aIxKkU8IR3DwUOJ +LAp1RqRDA/r4t+UqaXrDPQitM+4zQ1UEJEw/o9OF/+I+af8NXgtX96HyHw5S72IygwT W8nN4xiQ4wF+GX3WFYdVsHM6d0i09w+3CUAr7t1kvqSE1PY7KHn5FWt1/x0HAyyT0H+C otu5YBcQIF0p6fFdy0AqqBuPIsj0iv17nsqF7lHHc27K4eHOMNtip2Ml/WLiW5iegn9E HKSMHce2C6uPekhja5jN4vM8FHDdB4xFhsxI54lmENDXvKTIHhBzBILi3Bc8pEPfeWsM DPAg== X-Received: by 10.66.145.4 with SMTP id sq4mr16946304pab.46.1376590409189; Thu, 15 Aug 2013 11:13:29 -0700 (PDT) Received: from briankrusicw.logan.tv ([64.17.255.138]) by mx.google.com with ESMTPSA id bt1sm1352952pbb.2.2013.08.15.11.13.26 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 15 Aug 2013 11:13:27 -0700 (PDT) From: aurfalien Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: copying milllions of small files and millions of dirs Date: Thu, 15 Aug 2013 11:13:25 -0700 Message-Id: <7E7AEB5A-7102-424E-8B1E-A33E0A2C8B2C@gmail.com> To: FreeBSD Questions Mime-Version: 1.0 (Apple Message framework v1085) X-Mailer: Apple Mail (2.1085) X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 15 Aug 2013 18:13:29 -0000 Hi all, Is there a faster way to copy files over NFS? Currently breaking up a simple rsync over 7 or so scripts which copies = 22 dirs having ~500,000 dirs or files each. Obviously reading all the meta data is a PITA. Doin 10Gb/jumbos but in this case it don't make much of a hoot of a = diff. Going from a 38TB used, 50TB total BlueArc Titan 3200 to a new shiny = 80TB total FreeBSD 9.2RC1 ZFS bad boy. Thanks in advance, - aurf