Date: Thu, 24 Jul 2014 14:45:12 -0400 From: Allan Jude <allanjude@freebsd.org> To: freebsd-current@freebsd.org Subject: Re: zfs send/recv: STILL invalid Backup Stream Message-ID: <53D15438.6040105@freebsd.org> In-Reply-To: <eefa10e173e2e23a88c85c38221a1c22@thebighonker.lerctr.org> References: <62315eb454a95db636b7764aad3c0f9b@thebighonker.lerctr.org> <53D1448C.40908@freebsd.org> <d0612ef9399b4e95bd09e5271c91505b@thebighonker.lerctr.org> <eefa10e173e2e23a88c85c38221a1c22@thebighonker.lerctr.org>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--6mtk50ScExqxoOGmKbKvkRr531j6j2waI
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
On 2014-07-24 14:25, Larry Rosenman wrote:
> On 2014-07-24 12:43, Larry Rosenman wrote:
>> On 2014-07-24 12:38, Allan Jude wrote:
>>> On 2014-07-24 13:33, Larry Rosenman wrote:
>>>> TRYING to use zfs send/recv between a 10-STABLE and an 11-CURRENT
>>>> system, and receive the non-descript
>>>> "invalid backup stream".
>>>>
>>>> borg.lerctr.org /home/ler $ sudo bin/backup-TBH-ZFS-initial.sh
>>>> Password:
>>>> receiving full stream of zroot@2014-07-24 into
>>>> zroot/backups/TBH@2014-07-24
>>>> received 41.7KB stream in 300 seconds (142B/sec)
>>>> receiving full stream of zroot/usr@2014-07-24 into
>>>> zroot/backups/TBH/usr@2014-07-24
>>>> received 41.7KB stream in 1 seconds (41.7KB/sec)
>>>> receiving full stream of zroot/usr/local@2014-07-24 into
>>>> zroot/backups/TBH/usr/local@2014-07-24
>>>> received 2.81GB stream in 1116 seconds (2.58MB/sec)
>>>> receiving full stream of zroot/usr/src@2014-07-24 into
>>>> zroot/backups/TBH/usr/src@2014-07-24
>>>> cannot receive new filesystem stream: invalid backup stream
>>>> borg.lerctr.org /home/ler $ cat bin/backup-TBH-ZFS-initial.sh
>>>> #!/bin/sh
>>>> DATE=3D`date "+%Y-%m-%d"`
>>>> #DATE2=3D2013-03-24
>>>> #DATE2=3D`date -v "-1d" "+%Y-%m-%d"`
>>>> # snap the source
>>>> ssh root@tbh.lerctr.org zfs snapshot -r zroot@${DATE}
>>>> # zfs copy the source to here.
>>>> ssh root@tbh.lerctr.org "zfs send -R -D zroot@${DATE} | \
>>>> ssh home.lerctr.org \"zfs recv -F -u -v -d zroot/backups/TBH\""=
>>>> # make sure we NEVER allow the backup stuff to automount.
>>>> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \
>>>> awk '{printf "/sbin/zfs set canmount=3Dnoauto %s\n",$1}' | sh
>>>> borg.lerctr.org /home/ler $
>>>>
>>>> This has been happening for YEARS and I can't seem to interest
>>>> anyone in
>>>> fixing it.
>>>>
>>>> How can we get to the bottom of this?
>>>>
>>>> borg.lerctr.org /home/ler $ uname -a
>>>> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #56 r26898=
2M:
>>>> Tue Jul 22 10:14:59 CDT 2014
>>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/VT-LER amd64
>>>> borg.lerctr.org /home/ler $ ssh tbh uname -a
>>>> FreeBSD thebighonker.lerctr.org 10.0-STABLE FreeBSD 10.0-STABLE #39
>>>> r269019M: Wed Jul 23 11:44:35 CDT 2014
>>>> root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/GENERIC amd64
>>>> borg.lerctr.org /home/ler $
>>>>
>>>
>>> Try adding -v to the 'zfs send' and see if it gives you more detail.
>>>
>>> Can you also try this script for the replication:
>>>
>>> http://github.com/allanjude/zxfer
>> I've done that in the past and nothing, but I will try again.
>>
>> I will also look at zxfer.... :)
>=20
>=20
> with the -v, no more info, just what looks like normal messages....
>=20
> 13:23:55 3.68G zroot/usr/src@2014-07-24
> 13:23:56 3.68G zroot/usr/src@2014-07-24
> 13:23:57 3.68G zroot/usr/src@2014-07-24
> 13:23:58 3.68G zroot/usr/src@2014-07-24
> 13:23:59 3.68G zroot/usr/src@2014-07-24
> 13:24:00 3.69G zroot/usr/src@2014-07-24
> 13:24:01 3.69G zroot/usr/src@2014-07-24
> 13:24:02 3.69G zroot/usr/src@2014-07-24
> 13:24:03 3.69G zroot/usr/src@2014-07-24
> 13:24:04 3.69G zroot/usr/src@2014-07-24
> 13:24:05 3.70G zroot/usr/src@2014-07-24
> 13:24:06 3.70G zroot/usr/src@2014-07-24
> 13:24:07 3.70G zroot/usr/src@2014-07-24
> 13:24:08 3.70G zroot/usr/src@2014-07-24
> 13:24:09 3.70G zroot/usr/src@2014-07-24
> 13:24:10 3.71G zroot/usr/src@2014-07-24
> 13:24:11 3.71G zroot/usr/src@2014-07-24
> cannot receive new filesystem stream: invalid backup stream
> borg.lerctr.org /home/ler/bin $
I notice you are doing a deduplicated stream. Does it work without
deduplication (zfs send -D)?
--=20
Allan Jude
--6mtk50ScExqxoOGmKbKvkRr531j6j2waI
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.22 (MingW32)
Comment: Using GnuPG with Thunderbird - http://www.enigmail.net/
iQIcBAEBAgAGBQJT0VQ7AAoJEJrBFpNRJZKfiZkQAKJtwU+05G2nlINbejwhsS5y
upu1ewh/dumEjv+Sa06o2N6QwYE2pcNZGqewgZ5ZA2NOyS4Pr14NEVBkJzbzcqai
1F/EhAOyFb0fCo1k9qwua1E3JOs9fuJD/CdAc/1dR50/fUbgZ53y5pyGlytJHgkC
5HXzKHbh2zjIzYji6B4HbhxWmCeaM7Nd12s1SItegKQkpLYYCuJ9g30v0F5pd8mb
Sz4MyrGBjKET8eBIq4KaDqhAl2c26eNo3N0AhcO54EjoBDYbN4NkZiIQsNB5xMbn
zyok1EhguNdLl6zM1EN+1FWlcscTozQFuMd0vEbNmSE2xYa2s9Q6PjpWUI3Jlv6T
oF3a1uS/s5bQjczgCHjVVodnJ27BNZsM9Pi1QLFGlyKQ9TT7WNiUKo3dWjj5A1rd
sJiyGL7NN6Tc7V2dIeAasLJxhK90OgWZHVUz1d/ZF9QaKmll/btz921Iqu5eJ7nW
gew+REhpMZqt4T+fJKZzXW4/XfUh3py4cnxvZlTUF0937aU+ZFaMsCdj++JDlCK4
/FPODb71PVl24LKuqnlBLg7ZWRllWJ93jqdPEEZVGx5DkW47LPuvpdqmzFqLKNy/
od43BrohJQwVnxjClq13efP9J5VmK50ECa4ongCDm4GsZJlCQK9Ogqp53l2vMFWm
3Z6+naQj+I+KAN+PrjsB
=8cjN
-----END PGP SIGNATURE-----
--6mtk50ScExqxoOGmKbKvkRr531j6j2waI--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?53D15438.6040105>