From owner-freebsd-fs@freebsd.org Wed Oct 2 00:03:43 2019 Return-Path: Delivered-To: freebsd-fs@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D060DFBB5A for ; Wed, 2 Oct 2019 00:03:43 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: from mail-wm1-x32e.google.com (mail-wm1-x32e.google.com [IPv6:2a00:1450:4864:20::32e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46jbvf1WL0z4YVs for ; Wed, 2 Oct 2019 00:03:41 +0000 (UTC) (envelope-from eborisch@alumni.stanford.edu) Received: by mail-wm1-x32e.google.com with SMTP id m18so5026694wmc.1 for ; Tue, 01 Oct 2019 17:03:41 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=FjR/rOv43o//PT7YTLoii3BeT9JUMKdz4khb5Ja4hfo=; b=OwGdViFXAjtXVCWJtrKoOH8TaNZ1G9xXbkY975VxU2Skprwt6HHV6Pc64+Ciruj/3I y/OaWMDZPmljCj/3ZfA42g4SSbpuN5e+aoyRB6LdqibDzH6KBrtGUYbuFL+UhSTQdLUp mn3oY8p30xaU9x/jMDcuGxFN/2e6RmnHhFUP05YNExUQmxMdO10WD6Pm+AW2B8lAqJEe l2kpxir+/YKv9N1IQHnuzWDvGLllb8OkSQ39/KfGBgvAjDaFBeVuaOC0rIcHpPfbFIFc 3qyDMHdH2wb9TUC8UIzD5xr2CSrFCPa1S2DP1FycRBafCYpjCOHSAhAcKXjOoI2FtNCB OzYg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=FjR/rOv43o//PT7YTLoii3BeT9JUMKdz4khb5Ja4hfo=; b=eTYgPVJVZSTGB35+ZQMINj4IBnGfYNk3qJbBX0AZCO+bDdQnZnR11abwjspImjet6W Nn1xKVT04n5HJCfnttW0S62GSqAZonbMq9TG0sDD3shDvxfZ2ek9bvYcz9Nq15OFpaXI b2DaH9WEGOcep8ylibp8edX69fSs91DGgcZyrcmCwT4jt+TPpMKqFu7Z3Sl6HIVkXqoV jpFouj5TkDt5w/cWbQO2Li3/rCWymFTab5KmP7WKe8jVTYGh+trTPAaP1GrStyIoy6cJ LAi65EdCYtZqPSMY1qa+M3ev5Jcwf6Oee+TQ59eVytxTrZpRBuzfBemW/wrryCVigQZ5 FZJQ== X-Gm-Message-State: APjAAAUf46pGqBypQM31LcWZbefnvWa5a+n89EEtt0MJRljo3vm4BJIv mdrBQ4woyjerzTSsKE0RIjXiYJJeWykWb1jIw1l/dAtBnxA= X-Google-Smtp-Source: APXvYqxIYn1hvtLES0dmjyL8ycknq7wzBmPUWYdL2epVJb1wK+gvdZcIK04EhviWkurW/Cb+S2JUpq8F72veWr0yHuU= X-Received: by 2002:a7b:cd11:: with SMTP id f17mr485337wmj.12.1569974619276; Tue, 01 Oct 2019 17:03:39 -0700 (PDT) MIME-Version: 1.0 References: <20170807165118.72bde0a3@fabiankeil.de> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3767B55@QLEXC01.Quorum.local> In-Reply-To: <3A5A10BE32AC9E45B4A22F89FC90EC0701C3767B55@QLEXC01.Quorum.local> From: Eric Borisch Date: Tue, 1 Oct 2019 19:03:28 -0500 Message-ID: Subject: Re: [ZFS] Potential silent data corruption when receiving incremental stream with block size change on receiving side To: Shiva Bhanujan Cc: Fabian Keil , "freebsd-fs@freebsd.org" X-Rspamd-Queue-Id: 46jbvf1WL0z4YVs X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=OwGdViFX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of eborisch@alumni.stanford.edu designates 2a00:1450:4864:20::32e as permitted sender) smtp.mailfrom=eborisch@alumni.stanford.edu X-Spamd-Result: default: False [-2.70 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; TO_DN_SOME(0.00)[]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; RCVD_IN_DNSWL_NONE(0.00)[e.2.3.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.5.4.1.0.0.a.2.list.dnswl.org : 127.0.5.0]; FORGED_SENDER(0.30)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; RCVD_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+,1:+,2:~]; IP_SCORE(0.00)[ip: (-9.28), ipnet: 2a00:1450::/32(-2.89), asn: 15169(-2.16), country: US(-0.05)]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; FROM_NEQ_ENVFROM(0.00)[eborisch@gmail.com,eborisch@alumni.stanford.edu]; RCVD_TLS_ALL(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 02 Oct 2019 00:03:43 -0000 That sounds like a potential hole birth issue. You might consider upgrading to at least 10.4 or 11.1 and re-trying the send; these added the vfs.zfs.send_holes_without_birth_time (default true/1) tunable to avoid "numerous hole_birth bugs". See this [1] commit. - Eric [1] https://svnweb.freebsd.org/base/releng/10.4/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/dmu_traverse.c?revision=308086&view=markup On Tue, Oct 1, 2019 at 5:51 PM Shiva Bhanujan wrote: > Hello, > > This seems to be an older email, but I seem to be hitting this in FreeBSD > 10.3. Following is the precise version - > > FreeBSD R530-Filer-20-194.quorum.net 10.3-RELEASE-p29 FreeBSD > 10.3-RELEASE-p29 #12 r335461M: Wed Jun 20 16:11:04 PDT 2018 > root@R520-31-232.quorum.net:/usr/obj/usr/src/sys/QUORUM amd64 > > When I send an incremental snapshot, the md5sum of a couple of the files > in the source and the destination don't match. The previous incrementals > don't have a mismatch. > > Can somebody please advise on what I should be looking for? I've checked > the URLs mentioned here. The addition or removal of the -L option doesn't > have any change. > > Regards, > Shiva > > > ________________________________ > From: owner-freebsd-fs@freebsd.org [owner-freebsd-fs@freebsd.org] on > behalf of Fabian Keil [freebsd-listen@fabiankeil.de] > Sent: Monday, August 07, 2017 8:10 AM > To: freebsd-fs@freebsd.org > Subject: [ZFS] Potential silent data corruption when receiving incremental > stream with block size change on receiving side > > The original message is attached because it is signed. > ________________________________ > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >