Date: Wed, 6 Mar 2013 08:38:22 -0000 From: "Steven Hartland" <killing@multiplay.co.uk> To: "Larry Rosenman" <ler@lerctr.org> Cc: freebsd-fs@freebsd.org, Ronald Klop <ronald-freebsd8@klop.yi.org> Subject: Re: zfs send/recv invalid data Message-ID: <473BCD0A4A7A4E6AB08409A9B0C82363@multiplay.co.uk> References: <7c93aef20a88cdbcca85739e67470dce@webmail.lerctr.org> <op.wthqmth68527sy@212-182-167-131.ip.telfort.nl> <25894116c93a59dab1fd976b425c36d1@webmail.lerctr.org> <07b59d5d4b2a3dab1385b054eea4f2da@webmail.lerctr.org> <A3EA720372254541BCCB6C92DBA36A0E@multiplay.co.uk> <7619c6383449c7a316edb1cdffc98c54@webmail.lerctr.org> <alpine.BSF.2.00.1303052052300.52489@thebighonker.lerctr.org>
next in thread | previous in thread | raw e-mail | index | archive | help
----- Original Message -----
From: "Larry Rosenman" <ler@lerctr.org>
>>>>>>> I received an "invalid data" in a zfs send (from 8.3) / zfs recv (to
>>>>>>> 10.0) of a -R -I stream.
>>>>>>> What data do I need to gather to figure out what side and what's wrong?
>>>>>>> I've already started zpool scrubs on both sides.
>>>>>>> I can insert a tee to grab the stream on either/both sides if that
>>>>>>> would help.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>> Is the problem repeatable or is it just a network glitch?
>>>>>> Ronald.
>>>>> Repeatable.......
>>>>
>>>> Here is the exact error message:
>>>> receiving incremental stream of vault/home/ctr@2013-03-05-test3 into
>>>> zroot/backups/TBH/home/ctr@2013-03-05-test3
>>>> cannot receive incremental stream: invalid backup stream
>>>> this is the script I'm running:
>>>> #!/bin/sh
>>>> DATE=`date "+%Y-%m-%d-BUG-REPRO"`
>>>> DATE2=`date -v "-1d" "+%Y-%m-%d"`
>>>> # snap the source
>>>> ssh root@tbh.lerctr.org zfs snapshot -r vault@${DATE}
>>>> # zfs copy the source to here.
>>>> ssh root@tbh.lerctr.org "zfs send -R -D -I vault@${DATE2} vault@${DATE}
>>>> | \
>>>> tee /tmp/backup.stream.send.${DATE} | \
>>>> ssh home.lerctr.org \"tee /tmp/backup.stream.receive.${DATE} | zfs
>>>> recv -u -v -d zroot/backups/TBH\""
>>>> # make sure we NEVER allow the backup stuff to automount.
>>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \
>>>> awk '{printf "/sbin/zfs set canmount=noauto %s\n",$1}' | sh
>>>> both streams are in http://www.lerctr.org/~ler/ZFS_RECV
>>>
>>> Your send and receive sides differ, which indicates your ssh
>>> shell my not be clean.
>>>
>>> Looking at the receive side its got what looks like a mail
>>> message appended.
>>>
>>> I suspect if you manually copy the receive copy to the 10 machine and
>>> the receive it will work fine.
>>
>> we're copying mail files........
>>
>> and it still fails....
>>
> I've put more example send/recv files in that directory.
>
> we're copying home dirs, which include lots of mail.
>
> (this one is my wife's)
>
> Ideas?
>
> I *CAN* give access to both sides via ssh.....
The copy of the data stream on both sides should be identical
though and its not, which leads me to believe something is
corrupting the data on the way. Try the following:-
>From source:-
zfs send -R -D -I vault@${DATE2} vault@${DATE} > test.stream
scp test.stream home.lerctr.org:~/
>From target:
zfs recv -u -v -d zroot/backups/TBH < test.stream
If this works then there is something unclean about your ssh
shell.
Regards
Steve
================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it.
In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster@multiplay.co.uk.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?473BCD0A4A7A4E6AB08409A9B0C82363>