From owner-freebsd-fs@freebsd.org Sun Feb 26 15:50:57 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id B9F1CCEE4E4 for ; Sun, 26 Feb 2017 15:50:57 +0000 (UTC) (envelope-from nowakpl@platinum.linux.pl) Received: from platinum.edu.pl (platinum.edu.pl [137.74.1.182]) by mx1.freebsd.org (Postfix) with ESMTP id 7DC54E4B for ; Sun, 26 Feb 2017 15:50:57 +0000 (UTC) (envelope-from nowakpl@platinum.linux.pl) Received: from platinum.edu.pl (localhost [127.0.0.1]) by platinum.edu.pl (Postfix) with ESMTP id E5CE578022F for ; Sun, 26 Feb 2017 16:41:52 +0100 (CET) Received: by platinum.edu.pl (Postfix, from userid 87) id D5303780228; Sun, 26 Feb 2017 16:41:52 +0100 (CET) X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on platinum.edu.pl X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=ALL_TRUSTED,AWL autolearn=disabled version=3.4.1 Received: from [10.255.1.11] (unknown [109.231.16.141]) by platinum.edu.pl (Postfix) with ESMTPA id 4251B780228 for ; Sun, 26 Feb 2017 16:41:51 +0100 (CET) Subject: Re: FreeBSD restartable send/receive over WAN To: freebsd-fs@freebsd.org References: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB0FD40@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB11492@QLEXC01.Quorum.local> <67d44270-b644-612b-38be-30a038f45746@gmail.com> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> From: Adam Nowacki Message-ID: <504fda7c-260e-74dd-1de8-cbdb542cdfbb@platinum.linux.pl> Date: Sun, 26 Feb 2017 16:41:54 +0100 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.7.1 MIME-Version: 1.0 In-Reply-To: <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB114C7@QLEXC01.Quorum.local> Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 26 Feb 2017 15:50:57 -0000 On 2017-02-26 15:08, Shiva Bhanujan wrote: > The compression that we use on our ZFS filesystems is lz4. So, if I have to pipe it through a compression algorithm, that'd be uncompressing and compressing it 4 times. > > disk (lz4) -> zfs send (uncompress) -> compress (gzip) -> (network) -> uncompress (gzip) -> zfs recv (compress) -> disk (lz4) > > isn't this quite expensive? We have to transfer multi terabyte files on a WAN link. I'm also of the understanding that gzip by itself is single-threaded, so that'd peg one of the CPUs to 100%. there might be other compression algorithms that can be used, but sending the ZFS as it is compressed on the filesystem is something that would be optimal, and would reduce the overhead of the additional [de]compressions that are taking place? Well, yes, there is more cpu work but also better compression ratio. It all depends on how fast you can actually transfer the data over that WAN link. xz -0 should consume 5-10MB/s of uncompressed data while compressing 2x better than LZ4. > > > ________________________________________ > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on behalf of Jeremy Faulkner [gldisater@gmail.com] > Sent: Saturday, February 25, 2017 4:03 PM > To: freebsd-fs@freebsd.org > Subject: Re: FreeBSD restartable send/receive over WAN > > Pipe it through a compressor > > On 2017-02-25 2:09 PM, Shiva Bhanujan wrote: >> Hi, >> >> I just tried restartable send/receive in 10.3 and it works like a charm. I was wondering if compressed send has made its way into FreeBSD? I checked 10.3 and 11.0-RELEASE, and I don't see the -c/--compressed option. Any pointers? >> >> Regards, >> Shiva