From owner-freebsd-fs@freebsd.org Sun Feb 26 14:09:02 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 993DBCEEA39 for ; Sun, 26 Feb 2017 14:09:02 +0000 (UTC) (envelope-from Shiva.Bhanujan@Quorum.net) Received: from mail.quorumlabs.com (mail.quorum.net [64.74.133.216]) (using TLSv1 with cipher AES128-SHA (128/128 bits)) (Client CN "mail.quorumlabs.com", Issuer "mail.quorumlabs.com" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 7AF8BCA1 for ; Sun, 26 Feb 2017 14:09:01 +0000 (UTC) (envelope-from Shiva.Bhanujan@Quorum.net) Received: from QLEXC01.Quorum.local ([fe80::79eb:fde8:ed8e:5648]) by QLEXC01.Quorum.local ([fe80::79eb:fde8:ed8e:5648%14]) with mapi id 14.02.0318.001; Sun, 26 Feb 2017 06:09:00 -0800 From: Shiva Bhanujan To: Jeremy Faulkner , "freebsd-fs@freebsd.org" Subject: RE: FreeBSD restartable send/receive over WAN Thread-Topic: FreeBSD restartable send/receive over WAN Thread-Index: AdKIga96XkuYo0TvTyGgnDeYS4b6VAARaL2AAbS/t0UAGxyIgAAMgRdh Date: Sun, 26 Feb 2017 14:08:59 +0000 Message-ID: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> References: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB0FD40@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB11492@QLEXC01.Quorum.local>, <67d44270-b644-612b-38be-30a038f45746@gmail.com> In-Reply-To: <67d44270-b644-612b-38be-30a038f45746@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [24.6.174.236] Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Feb 2017 14:09:02 -0000 The compression that we use on our ZFS filesystems is lz4. So, if I have t= o pipe it through a compression algorithm, that'd be uncompressing and comp= ressing it 4 times.=0A= =0A= disk (lz4) -> zfs send (uncompress) -> compress (gzip) -> (network) -> unco= mpress (gzip) -> zfs recv (compress) -> disk (lz4)=0A= =0A= isn't this quite expensive? We have to transfer multi terabyte files on a = WAN link. I'm also of the understanding that gzip by itself is single-thre= aded, so that'd peg one of the CPUs to 100%. there might be other compress= ion algorithms that can be used, but sending the ZFS as it is compressed on= the filesystem is something that would be optimal, and would reduce the ov= erhead of the additional [de]compressions that are taking place?=0A= =0A= =0A= ________________________________________=0A= From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on behalf= of Jeremy Faulkner [gldisater@gmail.com]=0A= Sent: Saturday, February 25, 2017 4:03 PM=0A= To: freebsd-fs@freebsd.org=0A= Subject: Re: FreeBSD restartable send/receive over WAN=0A= =0A= Pipe it through a compressor=0A= =0A= On 2017-02-25 2:09 PM, Shiva Bhanujan wrote:=0A= > Hi,=0A= >=0A= > I just tried restartable send/receive in 10.3 and it works like a charm. = I was wondering if compressed send has made its way into FreeBSD? I check= ed 10.3 and 11.0-RELEASE, and I don't see the -c/--compressed option. Any = pointers?=0A= >=0A= > Regards,=0A= > Shiva=0A= >=0A= >=0A= > ________________________________________=0A= > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on beha= lf of Adam Nowacki [nowakpl@platinum.linux.pl]=0A= > Sent: Thursday, February 16, 2017 10:41 AM=0A= > To: freebsd-fs@freebsd.org=0A= > Subject: Re: FreeBSD restartable send/receive over WAN=0A= >=0A= > On 2017-02-16 19:22, Shiva Bhanujan wrote:=0A= >> Hello,=0A= >>=0A= >> I was wondering if restartable send/receive is available in FreeBSD? We= 're running 10.2 and have a requirement of sending and receiving ZFS snapsh= ots over a WAN link. The snapshots could be more than a few terabytes.=0A= >>=0A= >> Can somebody please give me pointers, and if this feature is or isn't av= ailable in FreeBSD?=0A= >=0A= > FreeBSD 10.3 and later.=0A= >=0A= > _______________________________________________=0A= > freebsd-fs@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A= > _______________________________________________=0A= > freebsd-fs@freebsd.org mailing list=0A= > https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A= >=0A= _______________________________________________=0A= freebsd-fs@freebsd.org mailing list=0A= https://lists.freebsd.org/mailman/listinfo/freebsd-fs=0A= To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"=0A=