Date: Sat, 10 Oct 2009 23:46:52 +0800 (CST) From: "Ckcheng" <net.help@m2k.com.tw> To: "freebsd-performance" <freebsd-performance@freebsd.org> Subject: Migrate large amount of small files Message-ID: <1255189612.42461.net.help@m2k.com.tw>
next in thread | raw e-mail | index | archive | help
Hi all, Currently, I have a directory with over 5M small files (1~32K). Now, I want to transfer this directory to another machine and found that it's extremely slow and painful process. I tried the following method: 1. rsync 2. tar via ssh 3. tar via nc (all take hours and hours to finish) None of them is able to give me a reasonable migration time. So, I'm here for asking help. Any suggestion is extremely welcomed. Thank you. Btw, here is brief information of my server. (both machines are the same) OS: FreeBSD 6.4-Stable 64Bit CPU: 2 x Xeon L5420 2.50GHz RAM: 2 x 2G ECC DDR2-667 (full buffered) DISK: Seagate Barracuda ES 16MB (SATA 300) Network: 1Gbps (Broadcom BCM5708) Filesystem: UFS2 Regards,
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1255189612.42461.net.help>