From owner-freebsd-fs@freebsd.org Sun Feb 26 15:16:31 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3AE5ACEED30 for ; Sun, 26 Feb 2017 15:16:31 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from mail.in-addr.com (mail.in-addr.com [IPv6:2a01:4f8:191:61e8::2525:2525]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EEDABC1F for ; Sun, 26 Feb 2017 15:16:30 +0000 (UTC) (envelope-from gpalmer@freebsd.org) Received: from gjp by mail.in-addr.com with local (Exim 4.88 (FreeBSD)) (envelope-from ) id 1ci0Ym-0001NF-F3; Sun, 26 Feb 2017 15:16:28 +0000 Date: Sun, 26 Feb 2017 15:16:28 +0000 From: Gary Palmer To: Shiva Bhanujan Cc: Jeremy Faulkner , "freebsd-fs@freebsd.org" Subject: Re: FreeBSD restartable send/receive over WAN Message-ID: <20170226151628.GB51196@in-addr.com> References: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB0FD40@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB11492@QLEXC01.Quorum.local> <67d44270-b644-612b-38be-30a038f45746@gmail.com> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> X-SA-Exim-Connect-IP: X-SA-Exim-Mail-From: gpalmer@freebsd.org X-SA-Exim-Scanned: No (on mail.in-addr.com); SAEximRunCond expanded to false X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Feb 2017 15:16:31 -0000 On Sun, Feb 26, 2017 at 02:08:59PM +0000, Shiva Bhanujan wrote: > The compression that we use on our ZFS filesystems is lz4. So, if I have to pipe it through a compression algorithm, that'd be uncompressing and compressing it 4 times. > > disk (lz4) -> zfs send (uncompress) -> compress (gzip) -> (network) -> uncompress (gzip) -> zfs recv (compress) -> disk (lz4) > > isn't this quite expensive? We have to transfer multi terabyte files on a WAN link. I'm also of the understanding that gzip by itself is single-threaded, so that'd peg one of the CPUs to 100%. there might be other compression algorithms that can be used, but sending the ZFS as it is compressed on the filesystem is something that would be optimal, and would reduce the overhead of the additional [de]compressions that are taking place? Without going into the efficiency part of your message: archivers/pigz: Parallel GZIP archivers/pbzip2: Parallel BZIP2 archivers/pixz: Parallel, indexing version of XZ archivers/pxz: Parallel LZMA compressor using liblzma Regards, Gary > > ________________________________________ > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on behalf of Jeremy Faulkner [gldisater@gmail.com] > Sent: Saturday, February 25, 2017 4:03 PM > To: freebsd-fs@freebsd.org > Subject: Re: FreeBSD restartable send/receive over WAN > > Pipe it through a compressor > > On 2017-02-25 2:09 PM, Shiva Bhanujan wrote: > > Hi, > > > > I just tried restartable send/receive in 10.3 and it works like a charm. I was wondering if compressed send has made its way into FreeBSD? I checked 10.3 and 11.0-RELEASE, and I don't see the -c/--compressed option. Any pointers? > > > > Regards, > > Shiva > > > > > > ________________________________________ > > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on behalf of Adam Nowacki [nowakpl@platinum.linux.pl] > > Sent: Thursday, February 16, 2017 10:41 AM > > To: freebsd-fs@freebsd.org > > Subject: Re: FreeBSD restartable send/receive over WAN > > > > On 2017-02-16 19:22, Shiva Bhanujan wrote: > >> Hello, > >> > >> I was wondering if restartable send/receive is available in FreeBSD? We're running 10.2 and have a requirement of sending and receiving ZFS snapshots over a WAN link. The snapshots could be more than a few terabytes. > >> > >> Can somebody please give me pointers, and if this feature is or isn't available in FreeBSD? > > > > FreeBSD 10.3 and later. > > > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > _______________________________________________ > > freebsd-fs@freebsd.org mailing list > > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >