From owner-freebsd-fs@FreeBSD.ORG Wed Mar 6 08:38:22 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 31F9CDAD for ; Wed, 6 Mar 2013 08:38:22 +0000 (UTC) (envelope-from prvs=1777d4b2b8=killing@multiplay.co.uk) Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) by mx1.freebsd.org (Postfix) with ESMTP id B5806A01 for ; Wed, 6 Mar 2013 08:38:21 +0000 (UTC) Received: from r2d2 ([46.65.172.4]) by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23]) (MDaemon PRO v10.0.4) with ESMTP id md50002574306.msg for ; Wed, 06 Mar 2013 08:38:18 +0000 X-Spam-Processed: mail1.multiplay.co.uk, Wed, 06 Mar 2013 08:38:18 +0000 (not processed: message from valid local sender) X-MDDKIM-Result: neutral (mail1.multiplay.co.uk) X-MDRemoteIP: 46.65.172.4 X-Return-Path: prvs=1777d4b2b8=killing@multiplay.co.uk X-Envelope-From: killing@multiplay.co.uk X-MDaemon-Deliver-To: freebsd-fs@freebsd.org Message-ID: <473BCD0A4A7A4E6AB08409A9B0C82363@multiplay.co.uk> From: "Steven Hartland" To: "Larry Rosenman" References: <7c93aef20a88cdbcca85739e67470dce@webmail.lerctr.org> <25894116c93a59dab1fd976b425c36d1@webmail.lerctr.org> <07b59d5d4b2a3dab1385b054eea4f2da@webmail.lerctr.org> <7619c6383449c7a316edb1cdffc98c54@webmail.lerctr.org> Subject: Re: zfs send/recv invalid data Date: Wed, 6 Mar 2013 08:38:22 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=response Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.5931 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: freebsd-fs@freebsd.org, Ronald Klop X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Mar 2013 08:38:22 -0000 ----- Original Message ----- From: "Larry Rosenman" >>>>>>> I received an "invalid data" in a zfs send (from 8.3) / zfs recv (to >>>>>>> 10.0) of a -R -I stream. >>>>>>> What data do I need to gather to figure out what side and what's wrong? >>>>>>> I've already started zpool scrubs on both sides. >>>>>>> I can insert a tee to grab the stream on either/both sides if that >>>>>>> would help. >>>>>>> >>>>>>> >>>>>>> >>>>>> Is the problem repeatable or is it just a network glitch? >>>>>> Ronald. >>>>> Repeatable....... >>>> >>>> Here is the exact error message: >>>> receiving incremental stream of vault/home/ctr@2013-03-05-test3 into >>>> zroot/backups/TBH/home/ctr@2013-03-05-test3 >>>> cannot receive incremental stream: invalid backup stream >>>> this is the script I'm running: >>>> #!/bin/sh >>>> DATE=`date "+%Y-%m-%d-BUG-REPRO"` >>>> DATE2=`date -v "-1d" "+%Y-%m-%d"` >>>> # snap the source >>>> ssh root@tbh.lerctr.org zfs snapshot -r vault@${DATE} >>>> # zfs copy the source to here. >>>> ssh root@tbh.lerctr.org "zfs send -R -D -I vault@${DATE2} vault@${DATE} >>>> | \ >>>> tee /tmp/backup.stream.send.${DATE} | \ >>>> ssh home.lerctr.org \"tee /tmp/backup.stream.receive.${DATE} | zfs >>>> recv -u -v -d zroot/backups/TBH\"" >>>> # make sure we NEVER allow the backup stuff to automount. >>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \ >>>> awk '{printf "/sbin/zfs set canmount=noauto %s\n",$1}' | sh >>>> both streams are in http://www.lerctr.org/~ler/ZFS_RECV >>> >>> Your send and receive sides differ, which indicates your ssh >>> shell my not be clean. >>> >>> Looking at the receive side its got what looks like a mail >>> message appended. >>> >>> I suspect if you manually copy the receive copy to the 10 machine and >>> the receive it will work fine. >> >> we're copying mail files........ >> >> and it still fails.... >> > I've put more example send/recv files in that directory. > > we're copying home dirs, which include lots of mail. > > (this one is my wife's) > > Ideas? > > I *CAN* give access to both sides via ssh..... The copy of the data stream on both sides should be identical though and its not, which leads me to believe something is corrupting the data on the way. Try the following:- >From source:- zfs send -R -D -I vault@${DATE2} vault@${DATE} > test.stream scp test.stream home.lerctr.org:~/ >From target: zfs recv -u -v -d zroot/backups/TBH < test.stream If this works then there is something unclean about your ssh shell. Regards Steve ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk.