From nobody Fri Sep 23 09:25:35 2022 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MYmwN4bGJz4cWg3 for ; Fri, 23 Sep 2022 09:25:40 +0000 (UTC) (envelope-from SRS0=BMP7=Z2=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4MYmwM5DKVz3lsm for ; Fri, 23 Sep 2022 09:25:39 +0000 (UTC) (envelope-from SRS0=BMP7=Z2=perdition.city=julien@bebif.be) Received: from x1 (unknown [10.209.1.149]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id 1A11F1DA10; Fri, 23 Sep 2022 11:25:38 +0200 (CEST) Date: Fri, 23 Sep 2022 11:25:35 +0200 From: Julien Cigar To: David Christensen Cc: questions@freebsd.org Subject: Re: zfs replication tool Message-ID: <20220923092535.jtrqgcxgxq3sstgp@x1> Mail-Followup-To: David Christensen , questions@freebsd.org References: <20220920092905.3k7qzt7lvhywhcfn@x1> <20220920122029.ufsoyo47qnxtmcqk@x1> <20220920132503.8bfd124b9697d90e474086b3@sohara.org> <20220920125154.n7lcqr3xzhsrylzr@x1> <20220920142314.df043149e82d63cbd289a92e@sohara.org> <4cf58433-a13b-9b35-fc3e-8fad6b2ac93d@sentex.net> <20220920141006.n6x6mxpafy3zqpk3@x1> <20220923080305.alrgrrnxljtweo3i@x1> <498d478e-7fe7-1840-6263-930b498c5bbf@holgerdanske.com> List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="wvsdmyz23rdw56r2" Content-Disposition: inline In-Reply-To: <498d478e-7fe7-1840-6263-930b498c5bbf@holgerdanske.com> X-Rspamd-Queue-Id: 4MYmwM5DKVz3lsm X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of "SRS0=BMP7=Z2=perdition.city=julien@bebif.be" designates 193.191.208.90 as permitted sender) smtp.mailfrom="SRS0=BMP7=Z2=perdition.city=julien@bebif.be" X-Spamd-Result: default: False [-4.46 / 15.00]; SIGNED_PGP(-2.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_LONG(-0.96)[-0.963]; MID_RHS_NOT_FQDN(0.50)[]; FORGED_SENDER(0.30)[julien@perdition.city,SRS0=BMP7=Z2=perdition.city=julien@bebif.be]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_SPF_ALLOW(-0.20)[+mx]; RCVD_NO_TLS_LAST(0.10)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE]; MLMMJ_DEST(0.00)[questions@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[julien@perdition.city,SRS0=BMP7=Z2=perdition.city=julien@bebif.be]; ARC_NA(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; FROM_HAS_DN(0.00)[]; DMARC_NA(0.00)[perdition.city]; TO_DN_SOME(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N --wvsdmyz23rdw56r2 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Sep 23, 2022 at 01:57:54AM -0700, David Christensen wrote: > On 9/23/22 01:03, Julien Cigar wrote: >=20 > > I'm still getting replication errors with zrepl on my test installation, > > see https://github.com/zrepl/zrepl/issues/631 for details. The initial > > transfer works, but after that I'm getting weird "cannot receive > > incremental stream: destination ..." messages, despite all snapshots > > have been well preserved on both side >=20 >=20 > Does zrepl script the zfs(8) command or does zrepl make ZFS API calls? I *think* raw zfs(8) is used, it's written in Go >=20 >=20 > Does zrepl have xtrace, verbose, debug, etc., options? >=20 yes, but I haven't found an explanation why some snapshots aren't transferred >=20 > I wrote homebrew scripts to automate ZFS replication and I saw that error > message many times in the past. The solution was to add the '-F' option = to > the 'zfs receive' commands. Is there a way to do this with zrepl? >=20 I'm not sure, and even if there was the possibility I'd like to understand why it is needed as all snapshots are there. Rollback to the most recent snapshot shouldn't be necessary in this case.. >=20 > David >=20 --=20 Julien Cigar PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --wvsdmyz23rdw56r2 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmMte4sACgkQCLYqJMpB HmmdpA//ZA8DNy05yWf5dCYLeqgL67N4TbnNyhCQo3SqjHA6NWxRo41Y5BGUW6Pk H8Ru79vRm0nc2zu+SLiYzxBx/HUqH25yPJbiFC1RQ3/yXnn1KHLqH0OubsM3Ykiw KYiqa5DiLz/fJOxyFWdnyXYjSzxeBTTO6YHgZjn8YszVjZFXFWo5n++GNsB4aA/A U9m3aEXeselPr2klu6BK2re9VSWUCBvKCHKIDWR3jVewz8h/wn3ULARMrwG64ueF Nvjvc4wVjXq2V4Dpv9O0RIxJKpIV9xJMb6y80QLsQZO0uU36TjTXztSSkAf/u2AR T+tJcZYZRX4mMSpGrZYc6Iscls6npc3tExN8rhE/1w509PHbYi4084q2mKbAmBOQ QzDp1AnsmG4Vjz3+zrIdobNSGw+V6ocvEXax2ZBf1XQPnltZWdzjxCcALx0a//Aq J2iEyxxieAhf/NiMUMi4wy3/RIbI7EovgLcV3ea1WZtCCJZ6w2RLjpw7S1q91IeY 0f04Suty+tZm4V+eFNWo7Q+7WiQvbyfMoZjbOUPWC28VL8FpKmnbxe5VwX2lTW4X QJ5D8eK6xaxMkeEk2F1D11WVA8sDte3vVxQ0ohtqRUe057mKBBe8aYGvoBBPj38X hcmxcaIR5B5jOz7dkySgI+GOaB+QCPGrVfKYy7XNj+w88fsrg4o= =kezK -----END PGP SIGNATURE----- --wvsdmyz23rdw56r2--