From owner-freebsd-fs@freebsd.org Wed Jun 14 05:45:55 2017 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C3AC2D8690E for ; Wed, 14 Jun 2017 05:45:55 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from out4-smtp.messagingengine.com (out4-smtp.messagingengine.com [66.111.4.28]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8B5B17AE17 for ; Wed, 14 Jun 2017 05:45:55 +0000 (UTC) (envelope-from dch@skunkwerks.at) Received: from compute7.internal (compute7.nyi.internal [10.202.2.47]) by mailout.nyi.internal (Postfix) with ESMTP id 7D11920B53 for ; Wed, 14 Jun 2017 01:45:54 -0400 (EDT) Received: from web6 ([10.202.2.216]) by compute7.internal (MEProxy); Wed, 14 Jun 2017 01:45:54 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=skunkwerks.at; h=content-transfer-encoding:content-type:date:from:in-reply-to :message-id:mime-version:references:subject:to:x-me-sender :x-me-sender:x-sasl-enc; s=mesmtp; bh=Es41S5uC/V0EaWQglx8S1l4qB7 THBmIBOY6XRC0z8u8=; b=DfFuRtyKOj9nroFtbPNPb42aVYI3qhkSPI1hKTRFcY iL34Kyt5KBPGSaaCBOBz+NKN6+NqSSljIbdIwL9rpf78DN08rEvhiLkrEx7uZDZq 5qo720vPmMo1WVYJhaRove4843adPX0a5qVz5ij7NvFGltjO7qVPi47mdGxyb320 w= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:content-type :date:from:in-reply-to:message-id:mime-version:references :subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=Es41S5 uC/V0EaWQglx8S1l4qB7THBmIBOY6XRC0z8u8=; b=Ba5cHVKsmPRBGZzeJC74NG ZH0tT4mn9Tv280T8nwudlaEA/RWE7htgZXofCgmlPp5XICMOBrM0BilDgq5fflD7 wlZckFiJSmbZI7w5Tw/2+UEKm6vxUwqWICun7mDZpb/KviSEqR+8Nyx7TuSnpRaI 4gWeMdq7+xBrAoDDmjEhU8XBg94QZuHEixaaAYY1n5Rtc7XBBILTR2awIKpsW4sL 4nwyjEeypaZOAkiowlXtGJ9TYyNAEcDkS96pxy/L0o4q3ykG1m12Q7L1WjXXL4ar NL6Hkh8sDEaeBppjnlOjj2eeunds0bZOZ9AfWhezjD99fTSCtwGv/y8hL8BQSFnA == X-ME-Sender: Received: by mailuser.nyi.internal (Postfix, from userid 99) id 528AB48002; Wed, 14 Jun 2017 01:45:54 -0400 (EDT) Message-Id: <1497419154.879644.1008780888.162DA368@webmail.messagingengine.com> From: Dave Cottlehuber To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="utf-8" X-Mailer: MessagingEngine.com Webmail Interface - ajax-1fe24561 Subject: Re: FreeBSD restartable send/receive over WAN Date: Wed, 14 Jun 2017 07:45:54 +0200 In-Reply-To: <1497418488.877884.1008774696.75A50952@webmail.messagingengine.com> References: <0719669324a44fe0bfba3e8e08b0ae99@exch2-4.slu.se> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB12619@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701BDB12ABA@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701C35D8A68@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701C35DA475@QLEXC01.Quorum.local> <1497418488.877884.1008774696.75A50952@webmail.messagingengine.com> X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Jun 2017 05:45:55 -0000 > On Wed, 14 Jun 2017, at 01:34, Shiva Bhanujan wrote: > Hi Ronald, > > thanks for the info. I'm going to work w/ FreeBSD 11.0, as it has > restartable send/receive. the compressed send is desirable though. > > Regards, > Shivas A while back I hacked up a self-restarting zfs send, using mbuffer, which in my setup was faster than ssh. I can't recall if it can terminate itself or not, but it did the job, transferring 350GB over the Pacific Ocean migrating off servers. - use shells/fish - on source side while true sudo zfs send -Levt \ (ssh -p 2200 root@10.144.157.90 zfs get -Hpo value receive_resume_token zroot/shared/got) \ | mbuffer -4 -s 128k -m 1G -O 10.144.157.90:9000 end - on sink side while true mbuffer -4 -s 128k -m 1G -I 9000 \ | zfs recv -Fuvs zroot/shared/got end NB there's no encryption (security/hpenc is an excellent choice), or replace mbuffer with spiped. NNB https://gist.github.com/dch/26f2c660fee145c24ffc79126e9cbb21 is the pretty version. I'd love to hear back wrt perfomance/throughput. A+ Dave