Date: Sun, 26 Feb 2017 14:08:59 +0000 From: Shiva Bhanujan <Shiva.Bhanujan@Quorum.net> To: Jeremy Faulkner <gldisater@gmail.com>, "freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org> Subject: RE: FreeBSD restartable send/receive over WAN Message-ID: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> In-Reply-To: <67d44270-b644-612b-38be-30a038f45746@gmail.com> References: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB0FD40@QLEXC01.Quorum.local> <a6b56739-5a64-e5fe-f2e8-6971f80b545a@platinum.linux.pl> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB11492@QLEXC01.Quorum.local>, <67d44270-b644-612b-38be-30a038f45746@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
The compression that we use on our ZFS filesystems is lz4. So, if I have t= o pipe it through a compression algorithm, that'd be uncompressing and comp= ressing it 4 times.=0A= =0A= disk (lz4) -> zfs send (uncompress) -> compress (gzip) -> (network) -> unco= mpress (gzip) -> zfs recv (compress) -> disk (lz4)=0A= =0A= isn't this quite expensive? We have to transfer multi terabyte files on a = WAN link. I'm also of the understanding that gzip by itself is single-thre= aded, so that'd peg one of the CPUs to 100%. there might be other compress= ion algorithms that can be used, but sending the ZFS as it is compressed on= the filesystem is something that would be optimal, and would reduce the ov= erhead of the additional [de]compressions that are taking place?=0A= =0A= =0A= ________________________________________=0A= From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on behalf= of Jeremy Faulkner [gldisater@gmail.com]=0A= Sent: Saturday, February 25, 2017 4:03 PM=0A= To: freebsd-fs@freebsd.org=0A= Subject: Re: FreeBSD restartable send/receive over WAN=0A= =0A= Pipe it through a compressor=0A= =0A= On 2017-02-25 2:09 PM, Shiva Bhanujan wrote:=0A= > Hi,=0A= >=0A= > I just tried restartable send/receive in 10.3 and it works like a charm. = I was wondering if compressed send has made its way into FreeBSD? I check= ed 10.3 and 11.0-RELEASE, and I don't see the -c/--compressed option. Any = pointers?=0A= >=0A= > Regards,=0A= > Shiva=0A= >=0A= >=0A= > ________________________________________=0A= > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on beha= lf of Adam Nowacki [nowakpl@platinum.linux.pl]=0A= > Sent: Thursday, February 16, 2017 10:41 AM=0A= > To: freebsd-fs@freebsd.org=0A= > Subject: Re: FreeBSD restartable send/receive over WAN=0A= >=0A= > On 2017-02-16 19:22, Shiva Bhanujan wrote:=0A= >> Hello,=0A= >>=0A= >> I was wondering if restartable send/receive is available in FreeBSD? We= 're running 10.2 and have a requirement of sending and receiving ZFS snapsh= ots over a WAN link. The snapshots could be more than a few terabytes.=0A= >>=0A= >> Can somebody please give me pointers, and if this feature is or isn't av= ailable in FreeBSD?=0A= >=0A= > FreeBSD 10.3 and later.=0A= >=0A= > _______________________________________________=0A= > freebsd-fs@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A= > _______________________________________________=0A= > freebsd-fs@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A= >=0A= _______________________________________________=0A= freebsd-fs@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7>