From owner-freebsd-fs@FreeBSD.ORG Fri Oct 25 17:36:27 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id F154E81A; Fri, 25 Oct 2013 17:36:26 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (lrosenman-1-pt.tunnel.tserv8.dal1.ipv6.he.net [IPv6:2001:470:1f0e:3ad::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id BCC8025D9; Fri, 25 Oct 2013 17:36:26 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date:Content-Transfer-Encoding:Content-Type:MIME-Version; bh=KEvZtj/rYUHkioaRtH4m1x3Hn5nWHtoWI2AkwStOdRo=; b=NoxRMWAhICPzdL/7CnFn8K8CQdiJWYL0B7f3VWiMvQXVC/uWCh8NA+yi7YoBIpEwq/vn+myQ3gE/1Sc8fJeczW3Zjol6iZyb9m7wGGwao40kyJlTsMUlyGw5ajdJZBWX+8BxznEwa2PrPDhgS/8tV1Vd4QXW7d7ZIcVe0OUN8bI=; Received: from localhost.lerctr.org ([127.0.0.1]:20320 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpa (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1VZlIm-000LdS-59; Fri, 25 Oct 2013 12:36:23 -0500 Received: from [32.97.110.59] by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Fri, 25 Oct 2013 12:35:59 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 25 Oct 2013 12:35:59 -0500 From: Larry Rosenman To: Ian Lepore Subject: Re: ZFS: Invalid SEND/RECV stream still In-Reply-To: <1382722383.1170.107.camel@revolution.hippie.lan> References: <1382722383.1170.107.camel@revolution.hippie.lan> Message-ID: <4b27106e75966fc555478400915d375f@webmail.lerctr.org> X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/0.9.4 X-Spam-Score: -3.3 (---) X-LERCTR-Spam-Score: -3.3 (---) X-Spam-Report: SpamScore (-3.3/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.375 X-LERCTR-Spam-Report: SpamScore (-3.3/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.375 Cc: Freebsd fs , Freebsd current X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Oct 2013 17:36:27 -0000 On 2013-10-25 12:33, Ian Lepore wrote: > On Fri, 2013-10-25 at 12:07 -0500, Larry Rosenman wrote: >> between 10.0-BETA1 and 11.0-CURRENT. >> I've been fighting this battle for a LONG time. I had hoped(!) that >> it >> would be solved by the systems being >> closer in rev but that didn't happen. >> >> I'd LOVE someone to look at it. >> >> I can provide ssh / root access to both machines. >> >> >> Error Message: >> received 320KB stream in 1 seconds (320KB/sec) >> receiving incremental stream of vault/var@2013-10-25 into >> zroot/backups/TBH/var@2013-10-25 >> cannot receive incremental stream: invalid backup stream >> $ >> >> Script: >> $ cat backup-TBH-ZFS.sh >> #!/bin/sh >> DATE=`date "+%Y-%m-%d"` >> #DATE2=2013-03-24 >> DATE2=`date -v "-1d" "+%Y-%m-%d"` >> # snap the source >> ssh root@tbh.lerctr.org zfs snapshot -r vault@${DATE} >> # zfs copy the source to here. >> ssh root@tbh.lerctr.org "zfs send -R -D -I vault@${DATE2} >> vault@${DATE} | \ >> ssh home.lerctr.org \"zfs recv -F -u -v -d zroot/backups/TBH\"" >> # make sure we NEVER allow the backup stuff to automount. >> /sbin/zfs list -H -t filesystem -r zroot/backups/TBH| \ >> awk '{printf "/sbin/zfs set canmount=noauto %s\n",$1}' | sh >> $ >> >> Uname's: >> $ uname -a >> FreeBSD borg.lerctr.org 11.0-CURRENT FreeBSD 11.0-CURRENT #80 r257016: >> Wed Oct 23 17:36:15 CDT 2013 >> root@borg.lerctr.org:/usr/obj/usr/src/sys/BORG-DTRACE amd64 >> $ ssh tbh uname -a >> FreeBSD thebighonker.lerctr.org 10.0-BETA1 FreeBSD 10.0-BETA1 #1 >> r256791: Sun Oct 20 12:28:55 CDT 2013 >> root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/THEBIGHONKER amd64 >> $ >> >> What else do y'all need? >> >> >> > > I notice you're using ssh and a pipe -- does your shell logon script > echo anything to stdout when you connect? I've had that interfere with > piped ssh stuff. Most shells provide a way for the logon script to > determine "is this an interactive session?" and you can use that to > avoid echoing anything that would interfere with non-interactive > automation. > > -- Ian no, it does NOT. I've verified that, plus this error is a LONG way into the stream. (I cut a bunch of the previous output). I've even gathered tmp files from this before, but no one had the time to look at it. Thanks for at least looking. -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: ler@lerctr.org US Mail: 108 Turvey Cove, Hutto, TX 78634-5688