From owner-freebsd-performance@FreeBSD.ORG Sat Oct 10 16:23:24 2009 Return-Path: Delivered-To: freebsd-performance@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 253E8106566B for ; Sat, 10 Oct 2009 16:23:24 +0000 (UTC) (envelope-from net.help@m2k.com.tw) Received: from py3.mail2000.com.tw (py3.mail2000.com.tw [203.69.82.67]) by mx1.freebsd.org (Postfix) with SMTP id 9F7448FC13 for ; Sat, 10 Oct 2009 16:23:23 +0000 (UTC) Received: from 10.0.0.81 by mx6.mail2000.com.tw with Mail2000 ESMTP Server V3.20M(54103:0:AUTH_RELAY) (envelope-from ); Sat, 10 Oct 2009 23:51:42 +0800 (CST) Received: from 10.0.0.50 by bak1.mail2000.com.tw with Mail2000 ESMTP Server V4.50S(8017:0:AUTH_LOGIN) (envelope-from ); Sat, 10 Oct 2009 23:46:56 +0800 (CST) Received: By OpenMail Mailer;Sat, 10 Oct 2009 23:46:52 +0800 (CST) From: "Ckcheng" Message-ID: <1255189612.42461.net.help@m2k.com.tw> To: "freebsd-performance" Date: Sat, 10 Oct 2009 23:46:52 +0800 (CST) MIME-Version: 1.0 X-Priority: 1 X-MSMail-Priority: High Content-Type: text/plain; charset=big5 Content-Transfer-Encoding: quoted-printable X-Mailman-Approved-At: Sat, 10 Oct 2009 16:43:50 +0000 Subject: Migrate large amount of small files X-BeenThere: freebsd-performance@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: net.help@m2k.com.tw List-Id: Performance/tuning List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 10 Oct 2009 16:23:24 -0000 Hi=20all, Currently,=20I=20have=20a=20directory=20with=20over=205M=20small=20files=20(= 1~32K).=20Now, I=20want=20to=20transfer=20this=20directory=20to=20another=20machine=20and=20= found that=20it's=20extremely=20slow=20and=20painful=20process.=20I=20tried=20the=20= following method: 1.=20rsync 2.=20tar=20via=20ssh 3.=20tar=20via=20nc (all=20take=20hours=20and=20hours=20to=20finish) None=20of=20them=20is=20able=20to=20give=20me=20a=20reasonable=20migration=20= time.=20So,=20I'm here=20for=20asking=20help.=20Any=20suggestion=20is=20extremely=20welcomed.=20= Thank=20you. Btw,=20here=20is=20brief=20information=20of=20my=20server.=20(both=20machine= s=20are=20the=20same) OS:=20FreeBSD=206.4-Stable=2064Bit CPU:=202=20x=20Xeon=20L5420=202.50GHz RAM:=202=20x=202G=20ECC=20DDR2-667=20(full=20buffered) DISK:=20Seagate=20Barracuda=20ES=2016MB=20(SATA=20300) Network:=201Gbps=20(Broadcom=20BCM5708) Filesystem:=20UFS2 Regards,