From owner-freebsd-fs@FreeBSD.ORG Thu Mar 7 01:14:15 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 03FB88D1 for ; Thu, 7 Mar 2013 01:14:15 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (lrosenman-1-pt.tunnel.tserv8.dal1.ipv6.he.net [IPv6:2001:470:1f0e:3ad::2]) by mx1.freebsd.org (Postfix) with ESMTP id A151A748 for ; Thu, 7 Mar 2013 01:14:14 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date:Content-Transfer-Encoding:Content-Type:MIME-Version; bh=Dv4UxrXV9rxs6UhKdOfvkRT5oqPD6tI0D4ACGMddGxI=; b=l3FIpCXlTMcrFP8tBp9pe+snwFyEFCyG5rlUkNvIPPwXEaJUL7tIW+9uHZypp8yrebOMjvW/3zDpar8BRk5lYeZ5CfTwvIFgnpvbGwwMAojYIkcvQGo28fKHZyPVxfIH4TtiGld5xdMnfk+PQ9PPQNkAedjH+VFbb7090YcaOPM=; Received: from localhost.lerctr.org ([127.0.0.1]:59769 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpa (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1UDPPK-000PgK-Lc; Wed, 06 Mar 2013 19:14:09 -0600 Received: from cpe-72-182-19-162.austin.res.rr.com ([72.182.19.162]) by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 06 Mar 2013 19:14:05 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 06 Mar 2013 19:14:05 -0600 From: Larry Rosenman To: Steven Hartland Subject: Re: zfs send/recv invalid data In-Reply-To: <5378B8D5A65A4F19BE1CF6C25A9CFE22@multiplay.co.uk> References: <7c93aef20a88cdbcca85739e67470dce@webmail.lerctr.org> <25894116c93a59dab1fd976b425c36d1@webmail.lerctr.org> <07b59d5d4b2a3dab1385b054eea4f2da@webmail.lerctr.org> <7619c6383449c7a316edb1cdffc98c54@webmail.lerctr.org> <473BCD0A4A7A4E6AB08409A9B0C82363@multiplay.co.uk> <6dcfb2284551025af3cf58703a2b5cdc@webmail.lerctr.org> <920990505611cd96a075c80d06691bb0@webmail.lerctr.org> <201303061857.r26IvLnc024186@higson.cam.lispworks.com> <9e133e088f6c3c3dafdc0a99eb7c48c1@webmail.lerctr.org> <218B0537E987442EAB8027EA478F8BE9@multiplay.co.uk> <5378B8D5A65A4F19BE1CF6C25A9CFE22@multiplay.co.uk> Message-ID: X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/0.8.5 X-Spam-Score: -3.5 (---) X-LERCTR-Spam-Score: -3.5 (---) X-Spam-Report: SpamScore (-3.5/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.628 X-LERCTR-Spam-Report: SpamScore (-3.5/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.628 Cc: tevans.uk@googlemail.com, freebsd-fs@freebsd.org, ronald-freebsd8@klop.yi.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 07 Mar 2013 01:14:15 -0000 On 2013-03-06 17:48, Steven Hartland wrote: > ----- Original Message ----- From: "Larry Rosenman" > To: "Steven Hartland" > Cc: "Martin Simmons" ; > ; ; > > Sent: Wednesday, March 06, 2013 11:16 PM > Subject: Re: zfs send/recv invalid data > > >> On 2013-03-06 17:00, Steven Hartland wrote: >>> ----- Original Message ----- From: "Larry Rosenman" >>>> # cat send.stream | ssh root@home openssl md5 >>>> (stdin)= 9cd1d73ea8411f1c222bc90e7bea3d33 >>>> # uname -a >>>> FreeBSD thebighonker.lerctr.org 8.3-STABLE FreeBSD 8.3-STABLE #54 >>>> r247820: Mon Mar 4 18:08:11 CST 2013 >>>> root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/THEBIGHONKER >>>> amd64 >>>> # >>>> # exec csh >>>> root@borg:/home/ler # pwd >>>> /home/ler >>>> root@borg:/home/ler # ssh tbh "cat >>>> /home/ler/public_html/ZFS_RECV/send.stream | ssh >>>> root@home.lerctr.org openssl md5" >>>> (stdin)= 9cd1d73ea8411f1c222bc90e7bea3d33 >>>> root@borg:/home/ler # uname -a >>>> FreeBSD borg.lerctr.org 10.0-CURRENT FreeBSD 10.0-CURRENT #124 >>>> r247826: Mon Mar 4 19:59:08 CST 2013 >>>> root@borg.lerctr.org:/usr/obj/usr/src/sys/BORG-DTRACE amd64 >>>> root@borg:/home/ler # >>> When you run a command from ssh it will run as the target users >>> shell >>> so for csh if there is something bad in .cshrc or iirc .profile then >>> you may get something output purely by logging in. >>> So ensure you shell config's for the user on the target machine are >>> clean. >>> You can confirm this by comparing the output from the following >>> two commands run from the sending machine:- >>> md5 send.stream >>> cat send.stream | ssh root@home.lerctr.org "cat" |md5 >>> If these two commands produce different md5's then the login >>> shell for root on home.lerctr.org is outputing something >>> even when there is no terminal. >>> You should be able to see what the shell is outputting using:- >>> echo -n '' | ssh root@home.lerctr.org "cat" > 1.log >>> After running this 1.log should be 0 bytes if its not your >>> shell is definitely your problem and I'd start by looking >>> at .cshrc and .profile for this user, or even the globals >>> for these in /etc/ >>> >> I've done that, and get identical md5's..... >> I'm at a loss. > > I believe what you ran was similar but not identical, if you > check the quoting subtly different. > > I'm not sure that will have any effect but both of the above > are worth running just to confirm. > > Regards > Steve $ ^DConnection to thebighonker.lerctr.org closed. $ ssh root@tbh Last login: Tue Mar 5 06:51:46 2013 from cpe-72-182-19-1 FreeBSD 8.3-STABLE (THEBIGHONKER) #54 r247820: Mon Mar 4 18:08:11 CST 2013 Welcome to FreeBSD! root@thebighonker:~ # pwd /root root@thebighonker:~ # md5 /home/ler/public_html/ZFS_RECV/send send-file-snap-list send.stream send.uname root@thebighonker:~ # md5 /home/ler/public_html/ZFS_RECV/send.stream MD5 (/home/ler/public_html/ZFS_RECV/send.stream) = 9cd1d73ea8411f1c222bc90e7bea3d33 root@thebighonker:~ # cat /home/ler/public_html/ZFS_RECV/send.stream |ssh root@home.lerctr.org "cat"|md5 9cd1d73ea8411f1c222bc90e7bea3d33 root@thebighonker:~ # looks like it's clean..... Other ideas? -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: ler@lerctr.org US Mail: 430 Valona Loop, Round Rock, TX 78681-3893