Date: Mon, 28 Jul 2014 01:09:24 +0900 From: DarkSoul <darksoul@darkbsd.org> To: Vladislav Prodan <universite@ukr.net>, questions@freebsd.org Cc: fs@freebsd.org, "net@freebsd.org net@freebsd.org" <net@freebsd.org> Subject: Re: Say me, please, how I can transfer between servers ZFS-partitions larger than 20Gb. Message-ID: <53D52434.7030308@darkbsd.org> In-Reply-To: <1406471619.238727352.o7o2ccyx@frv35.fwdcdn.com> References: <1406471619.238727352.o7o2ccyx@frv35.fwdcdn.com>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] On 07/27/2014 11:45 PM, Vladislav Prodan wrote: > Say me, please, how I can transfer between servers ZFS-partitions larger than 20Gb. > I have 4 partitions with backup data. There are a lot of small pictures. > > NAME USED AVAIL REFER MOUNTPOINT > tank2 1,42T 1,32T 118M legacy > ... > tank2/ay-files 31,9G 1,32T 31,8G /backup/beastie/upload_ftp/ay/files > tank2/XXXXXmarket-images 135G 1,32T 135G /backup/beastie/upload_ftp/XXXXXmarket/images > tank2/XXXXXmarket-uploads 17,6G 1,32T 17,5G /backup/beastie/upload_ftp/XXXXXmarket/uploads > tank2/YYYYmarket 24,4G 1,32T 152K /backup/beastie/upload_ftp/YYYYmarket > tank2/YYYYmarket/uploads 24,4G 1,32T 24,2G /backup/beastie/upload_ftp/YYYYmarket/uploads > ... > > Say me, please, how I can transfer it at another server with ZFS. > Servers are connected through unmanaged 100M switch. > Sending via (zfs send) and (ssh host2 zfs recv) ends with error after 20GB of data. > Sending via rsync is very lasting and requires often restart of rsync. > > What an alternative? For the initial 20G upload, you could zfs send to a file, and transfer that file via rsync or other resumable file transfer system that ensures integrity : host1# zfs send tank2/XXXXXmarket-images@snapshot > tank2-XXXXXmarket-images@snapshot.zfs host1# rsync tank2-XXXXXmarket-images@snapshot.zfs host2: host2# cat tank2-XXXXXmarket-images@snapshot.zfs | zfs recv tank3 Then the rest can be done via small snapshots and plain zfs send | ssh host2 zfs recv. You could even add bzip2 compression and decompression at each endpoint. This is what I am doing to replicate data of often updated filesystems (mailbox filesystems, with LOTS of small files) between ZFS servers. Cheers, > -- > Stephane LAPIE, EPITA SRS, Promo 2005 > "Even when they have digital readouts, I can't understand them." > --MegaTokyo > > -- > Stephane LAPIE, EPITA SRS, Promo 2005 > "Even when they have digital readouts, I can't understand them." > --MegaTokyo [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.14 (GNU/Linux) Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/ iF4EAREIAAYFAlPVJDQACgkQDJ4OK7D3FWR20wEAlEwxKf4EqYiLuYSTLua3Pkdo vGLQncD91yq63gc2CSoA/3skYXgw/ADY6Fq77LHEHxBnSeWhJYfID6Kd/pPtWy9B =1/W9 -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53D52434.7030308>