From nobody Mon Jul 4 11:53:15 2022 X-Original-To: freebsd-stable@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 810AB8A1B4B for ; Mon, 4 Jul 2022 11:53:25 +0000 (UTC) (envelope-from thilo@nispuk.com) Received: from metro707.hostmetro.com (metro707.hostmetro.com [50.31.160.160]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Lc42D4Qyfz50tf for ; Mon, 4 Jul 2022 11:53:24 +0000 (UTC) (envelope-from thilo@nispuk.com) Received: from rabenau.nispuk.com ([5.10.190.110] helo=localhost.nispuk.com) by metro707.hostmetro.com with esmtpsa (TLS1.2) tls TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256 (Exim 4.94.2) (envelope-from ) id 1o8KdD-0004xh-05 for freebsd-stable@freebsd.org; Mon, 04 Jul 2022 06:52:47 -0500 Received: from smtpclient.apple (ThilosMacBookM1.nispuk.com [192.168.0.178]) (authenticated bits=0) by localhost.nispuk.com (8.17.1.9/8.16.1) with ESMTPSA id 264BrFVH074900 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO) for ; Mon, 4 Jul 2022 13:53:16 +0200 (CEST) (envelope-from thilo@nispuk.com) X-Authentication-Warning: localhost.nispuk.com: Host ThilosMacBookM1.nispuk.com [192.168.0.178] claimed to be smtpclient.apple From: thilo jeremias Content-Type: multipart/alternative; boundary="Apple-Mail=_5931F2E6-83CB-46C2-9332-0603BDFCAF4F" List-Id: Production branch of FreeBSD source code List-Archive: https://lists.freebsd.org/archives/freebsd-stable List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.100.31\)) Subject: Problem ZFS send / receive 13.1-RELEASE Message-Id: Date: Mon, 4 Jul 2022 13:53:15 +0200 To: freebsd-stable X-Mailer: Apple Mail (2.3696.100.31) X-Authenticated-Id: thilo@nispuk.com X-Rspamd-Queue-Id: 4Lc42D4Qyfz50tf X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of thilo@nispuk.com designates 50.31.160.160 as permitted sender) smtp.mailfrom=thilo@nispuk.com X-Spamd-Result: default: False [-1.09 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-0.999]; FROM_HAS_DN(0.00)[]; MV_CASE(0.50)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; HAS_XAW(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-0.99)[-0.993]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[nispuk.com]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-0.30)[-0.298]; HFILTER_HELO_2(1.00)[metro707.hostmetro.com]; R_SPF_ALLOW(-0.20)[+a]; MLMMJ_DEST(0.00)[freebsd-stable]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:23352, ipnet:50.31.128.0/18, country:US]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-ThisMailContainsUnwantedMimeParts: N --Apple-Mail=_5931F2E6-83CB-46C2-9332-0603BDFCAF4F Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Hello everyone, I posted a question on ( = https://forums.freebsd.org/threads/zfs-replication-interrupted-and-resumed= -missing-snapshots.85666/ ) Which I now think is a bug in zfs send/receive for 13.1-RELEASE Essentially, an interrupted & restarted receive does not create all = snapshots from the stream. The following: #Interrupted transfer=20 zfs send -R "$D@final" | dd bs=3D10m count=3D200 | zfs recv -s "$D"_bad #Resume transfer TOKEN=3D"$(zfs get -H receive_resume_token "$D"_bad | cut -f 3)" zfs send -t "$TOKEN" | zfs recv -s "$D"_bad #Good transfer zfs send -R "$D@final" | zfs recv -s "$D"_good Produces: NAME USED AVAIL REFER MOUNTPOINT Backup/testset_good@initial 85.2K - 128K - Backup/testset_good@add100m 85.2K - 100M - Backup/testset_good@add300m 85.2K - 400M - Backup/testset_good@del100m 85.2K - 300M - Backup/testset_good@del300m 0B - 128K - Backup/testset_good@final 0B - 128K - NAME USED AVAIL REFER MOUNTPOINT Backup/testset_bad@initial 85.2K - 128K - Backup/testset_bad@add100m 0B - 100M - Which is not correct since it misses the snapshots from the original = stream (=E2=80=9Cgood=E2=80=9D) Can this be reproduced by anyone else? Thilo ------------------------------- Dipl. Ing. Thilo Jeremias Hauptstra=C3=9Fe 11 35466 Rabenau T: +49 15782492240 --Apple-Mail=_5931F2E6-83CB-46C2-9332-0603BDFCAF4F Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=utf-8 Hello= everyone,

I posted = a question on ( https://forums.freebsd.org/threads/zfs-replication-interrupted-= and-resumed-missing-snapshots.85666/ )
Which I = now think is a bug in zfs send/receive for 13.1-RELEASE


Essentially, an interrupted & restarted receive does not = create all snapshots from the stream.

The following:
#Interrupted transfer=20
zfs send -R "$D@final" | dd bs=3D10m count=3D200 | zfs recv -s "$D"_bad

#Resume transfer
TOKEN=3D"$(zfs get -H receive_resume_token   "$D"_bad  | cut -f 3)"
zfs send -t "$TOKEN" | zfs recv -s "$D"_bad


#Good transfer
zfs send -R "$D@final" | zfs recv -s "$D"_good


Produces:
NAME                   =
       USED  AVAIL     REFER  MOUNTPOINT
Backup/testset_good@initial  85.2K      -      128K  -
Backup/testset_good@add100m  85.2K      -      100M  -
Backup/testset_good@add300m  85.2K      -      400M  -
Backup/testset_good@del100m  85.2K      -      300M  -
Backup/testset_good@del300m     0B      -      128K  -
Backup/testset_good@final       0B      -      128K  -
NAME                         USED  AVAIL     REFER  MOUNTPOINT
Backup/testset_bad@initial  85.2K      -      128K  -
Backup/testset_bad@add100m     0B      -      100M  -

Which is not correct = since it misses the snapshots from the original stream = (=E2=80=9Cgood=E2=80=9D)

Can this be reproduced by anyone else?

Thilo


-------------------------------
Dipl. Ing. = Thilo Jeremias
Hauptstra=C3=9Fe 11
35466 = Rabenau

T: +49 15782492240


= --Apple-Mail=_5931F2E6-83CB-46C2-9332-0603BDFCAF4F--