From nobody Fri Sep 23 08:03:05 2022 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MYl5L16Bxz4dbVj for ; Fri, 23 Sep 2022 08:03:18 +0000 (UTC) (envelope-from SRS0=BMP7=Z2=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4MYl5J2zZ5z3Zmy for ; Fri, 23 Sep 2022 08:03:16 +0000 (UTC) (envelope-from SRS0=BMP7=Z2=perdition.city=julien@bebif.be) Received: from x1 (unknown [10.209.1.149]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 029DD1DA05; Fri, 23 Sep 2022 10:03:09 +0200 (CEST) Date: Fri, 23 Sep 2022 10:03:05 +0200 From: Julien Cigar To: mike tancsa Cc: questions@freebsd.org Subject: Re: zfs replication tool Message-ID: <20220923080305.alrgrrnxljtweo3i@x1> Mail-Followup-To: mike tancsa , questions@freebsd.org References: <0a0ba81b-88f2-fa75-9abe-6f41da5d2c69@sentex.net> <20220916140236.jeizzganrtnsrhlo@x1> <20220920092905.3k7qzt7lvhywhcfn@x1> <20220920122029.ufsoyo47qnxtmcqk@x1> <20220920132503.8bfd124b9697d90e474086b3@sohara.org> <20220920125154.n7lcqr3xzhsrylzr@x1> <20220920142314.df043149e82d63cbd289a92e@sohara.org> <4cf58433-a13b-9b35-fc3e-8fad6b2ac93d@sentex.net> <20220920141006.n6x6mxpafy3zqpk3@x1> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="lxdwwauxzgckwifz" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4MYl5J2zZ5z3Zmy X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=BMP7=Z2=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=BMP7=Z2=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-4.46 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.96)[-0.964]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=BMP7=Z2=perdition.city=julien@bebif.be]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; RCVD_NO_TLS_LAST(0.10)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_DKIM_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[perdition.city]; TO_DN_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=BMP7=Z2=perdition.city=julien@bebif.be] X-ThisMailContainsUnwantedMimeParts: N --lxdwwauxzgckwifz Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Sep 20, 2022 at 10:15:13AM -0400, mike tancsa wrote: > On 9/20/2022 10:10 AM, Julien Cigar wrote: > > In our case, for our bare metal restoration, we have a separate config > > file > > > to do restorations per server/vm where there are "special cases". Tha= nkfully > > > there are not many and its all scriptable for restoration. > > >=20 > > > For the A --> B -->C when we do are offload from B to C, we pick the > > > snapshots we want to send, place a hold on that snapshot and then do = the > > > send (1.5 day process). Zrepl cries that it cant prune the snapshot. = Once > > > the B-C process is complete, we remove the holds and zrepl happily de= letes > > > the snapshots it thinks its supposed to delete. > > I see, is it necessary to place holds manually? I thought zrepl already > > does this by default >=20 > zrepl does indeed manages its own holds/releases. But without my holds th= at > I place, I run the risk of having the snapshot pruned out from underneath= me > since the process of replicating to temporarily attached storage (C) takes > longer than a day. I'm still getting replication errors with zrepl on my test installation,=20 see https://github.com/zrepl/zrepl/issues/631 for details. The initial transfer works, but after that I'm getting weird "cannot receive incremental stream: destination ..." messages, despite all snapshots have been well preserved on both side >=20 > =C2=A0=C2=A0=C2=A0 ---Mike >=20 >=20 >=20 --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --lxdwwauxzgckwifz Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmMtaDYACgkQCLYqJMpB Hmngog//RN/u6DzOhWg6JqDEWtngvwrVoIKA3F3fXlLEiFAsTO+10vlvQePxDEIp MLYF22FlHxUk/bkcAIExEtf8JcECCPJRVAj2joR7gG7Ycd4tqaz34MX0eSBFKGk3 DgWFQAFe+3RWlSC1loxpAu2Pgr23/5N9a1t7mpncE1WiQZOpbujLeHzPfOUoN32R bzHQwqUDPc45DHoI/jVOXn9pnoXQZMFkGr/3bHAWDKAXrSh5C9GWFl0SLoTiZ8RM 0l3a2bNlOv2WPYaAUy57sjn6u5UnxCV2EStfHSz62sqqf8J8LJFo1yYH3woHIVwA DAcLnQlrmby+8bb5pp/693EPabi2WBCqdYeWgy8L+fOo3TmKOCcN5CLaFXurBVsL CIUHZyi9hLnuIOQvuJm49C5DUHKttOFrkCF/FW7XIl60w3HRCtWXyEDHjIgv64G3 mPMMg5T3HoeefqbBNE1x0sPOdwqRKZfn0TE4I08zLd7W6msvixg7+JRhNA016efb Kk5dkaAo3b7mn956deBFoLd4ZNMFE3zythXOb6uTE7XEnvtF3zJisNMSNo2O5K/G BWTUxOEBt4GAZSUgWGnUTagikw05bquWs8/BaPXbCjM4WwZLzZb6/eNANQ5qMx0d 4xYqdhwcKt/WP6DBnKno0O/neZp44yOtQADWMTs5t9iNvuVKb1Y= =5oD+ -----END PGP SIGNATURE----- --lxdwwauxzgckwifz--