Date: Thu, 24 Jul 2014 13:46:23 -0500 From: Larry Rosenman <ler@lerctr.org> To: Allan Jude <allanjude@freebsd.org> Cc: Freebsd fs <freebsd-fs@freebsd.org>, freebsd-current@freebsd.org Subject: Re: zfs send/recv: STILL invalid Backup Stream Message-ID: <0a9cd451c3b4304d2b9d899fcb3decc3@thebighonker.lerctr.org> In-Reply-To: <53D15438.6040105@freebsd.org> References: <62315eb454a95db636b7764aad3c0f9b@thebighonker.lerctr.org> <53D1448C.40908@freebsd.org> <d0612ef9399b4e95bd09e5271c91505b@thebighonker.lerctr.org> <eefa10e173e2e23a88c85c38221a1c22@thebighonker.lerctr.org> <53D15438.6040105@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 2014-07-24 13:45, Allan Jude wrote:
> On 2014-07-24 14:25, Larry Rosenman wrote:
>> On 2014-07-24 12:43, Larry Rosenman wrote:
>>> On 2014-07-24 12:38, Allan Jude wrote:
>>>> On 2014-07-24 13:33, Larry Rosenman wrote:
>>>>> TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT
>>>>> system, and receive the non-descript
>>>>> "invalid backup stream".
>>>>>
>>>>> borg.lerctr.org /home/ler $ sudo bin/backup-TBH-ZFS-initial.sh
>>>>> Password:
>>>>> receiving full stream of zroot@2014-07-24 into
>>>>> zroot/backups/TBH@2014-07-24
>>>>> received 41.7KB stream in 300 seconds (142B/sec)
>>>>> receiving full stream of zroot/usr@2014-07-24 into
>>>>> zroot/backups/TBH/usr@2014-07-24
>>>>> received 41.7KB stream in 1 seconds (41.7KB/sec)
>>>>> receiving full stream of zroot/usr/local@2014-07-24 into
>>>>> zroot/backups/TBH/usr/local@2014-07-24
>>>>> received 2.81GB stream in 1116 seconds (2.58MB/sec)
>>>>> receiving full stream of zroot/usr/src@2014-07-24 into
>>>>> zroot/backups/TBH/usr/src@2014-07-24
>>>>> cannot receive new filesystem stream: invalid backup stream
>>>>> borg.lerctr.org /home/ler $ cat bin/backup-TBH-ZFS-initial.sh
>>>>> #!/bin/sh
>>>>> DATE=`date "+%Y-%m-%d"`
>>>>> #DATE2=2013-03-24
>>>>> #DATE2=`date -v "-1d" "+%Y-%m-%d"`
>>>>> # snap the source
>>>>> ssh root@tbh.lerctr.org zfs snapshot -r zroot@${DATE}
>>>>> # zfs copy the source to here.
>>>>> ssh root@tbh.lerctr.org "zfs send -R -D zroot@${DATE} | \
>>>>> ssh home.lerctr.org \"zfs recv -F -u -v -d
>>>>> zroot/backups/TBH\""
>>>>> # make sure we NEVER allow the backup stuff to automount.
>>>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \
>>>>> awk '{printf "/sbin/zfs set canmount=noauto %s\n",$1}' | sh
>>>>> borg.lerctr.org /home/ler $
>>>>>
>>>>> This has been happening for YEARS and I can't seem to interest
>>>>> anyone in
>>>>> fixing it.
>>>>>
>>>>> How can we get to the bottom of this?
>>>>>
>>>>> borg.lerctr.org /home/ler $ uname -a
>>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #56
>>>>> r268982M:
>>>>> Tue Jul 22 10:14:59 CDT 2014
>>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64
>>>>> borg.lerctr.org /home/ler $ ssh tbh uname -a
>>>>> FreeBSD thebighonker.lerctr.org 10.0-STABLE FreeBSD 10.0-STABLE #39
>>>>> r269019M: Wed Jul 23 11:44:35 CDT 2014
>>>>> root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/GENERIC amd64
>>>>> borg.lerctr.org /home/ler $
>>>>>
>>>>
>>>> Try adding -v to the 'zfs send' and see if it gives you more detail.
>>>>
>>>> Can you also try this script for the replication:
>>>>
>>>> http://github.com/allanjude/zxfer
>>> I've done that in the past and nothing, but I will try again.
>>>
>>> I will also look at zxfer.... :)
>>
>>
>> with the -v, no more info, just what looks like normal messages....
>>
>> 13:23:55 3.68G zroot/usr/src@2014-07-24
>> 13:23:56 3.68G zroot/usr/src@2014-07-24
>> 13:23:57 3.68G zroot/usr/src@2014-07-24
>> 13:23:58 3.68G zroot/usr/src@2014-07-24
>> 13:23:59 3.68G zroot/usr/src@2014-07-24
>> 13:24:00 3.69G zroot/usr/src@2014-07-24
>> 13:24:01 3.69G zroot/usr/src@2014-07-24
>> 13:24:02 3.69G zroot/usr/src@2014-07-24
>> 13:24:03 3.69G zroot/usr/src@2014-07-24
>> 13:24:04 3.69G zroot/usr/src@2014-07-24
>> 13:24:05 3.70G zroot/usr/src@2014-07-24
>> 13:24:06 3.70G zroot/usr/src@2014-07-24
>> 13:24:07 3.70G zroot/usr/src@2014-07-24
>> 13:24:08 3.70G zroot/usr/src@2014-07-24
>> 13:24:09 3.70G zroot/usr/src@2014-07-24
>> 13:24:10 3.71G zroot/usr/src@2014-07-24
>> 13:24:11 3.71G zroot/usr/src@2014-07-24
>> cannot receive new filesystem stream: invalid backup stream
>> borg.lerctr.org /home/ler/bin $
>
> I notice you are doing a deduplicated stream. Does it work without
> deduplication (zfs send -D)?
I will try that after this zxfer test I'm running finishes, but IIRC it
doesn't matter..
--
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: ler@lerctr.org
US Mail: 108 Turvey Cove, Hutto, TX 78634-5688
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0a9cd451c3b4304d2b9d899fcb3decc3>