From owner-freebsd-fs@FreeBSD.ORG Wed Mar 6 19:15:11 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id BEE519C2 for ; Wed, 6 Mar 2013 19:15:11 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (lrosenman-1-pt.tunnel.tserv8.dal1.ipv6.he.net [IPv6:2001:470:1f0e:3ad::2]) by mx1.freebsd.org (Postfix) with ESMTP id 6BDFDFD8 for ; Wed, 6 Mar 2013 19:15:11 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date:Content-Transfer-Encoding:Content-Type:MIME-Version; bh=A3M7c4fG/WrjrZHUSCYetbJgTU5RYlkgGIuJV4P/Kt8=; b=V+qGr68kRJlWyBJfb7kySjeinU44kGzGjQ859Zk8qJ4/3X77wirSMYUK7tfVZHRGhrWylqPEiMm/2OKq5D0HOrOYlxknFVfF5Er/uGMlqGHUOpZTiIa6yzHFUBimgv7Fp9fU0fMVM2CrvUWOZbmDEUlI3hFFOtVTbFIrh2d2iNk=; Received: from localhost.lerctr.org ([127.0.0.1]:63037 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpa (Exim 4.80.1 (FreeBSD)) (envelope-from ) id 1UDJnr-000M2d-Pf; Wed, 06 Mar 2013 13:15:08 -0600 Received: from [32.97.110.59] by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Wed, 06 Mar 2013 13:15:02 -0600 MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Date: Wed, 06 Mar 2013 13:15:02 -0600 From: Larry Rosenman To: Martin Simmons Subject: Re: zfs send/recv invalid data In-Reply-To: References: <7c93aef20a88cdbcca85739e67470dce@webmail.lerctr.org> <25894116c93a59dab1fd976b425c36d1@webmail.lerctr.org> <07b59d5d4b2a3dab1385b054eea4f2da@webmail.lerctr.org> <7619c6383449c7a316edb1cdffc98c54@webmail.lerctr.org> <473BCD0A4A7A4E6AB08409A9B0C82363@multiplay.co.uk> <6dcfb2284551025af3cf58703a2b5cdc@webmail.lerctr.org> <920990505611cd96a075c80d06691bb0@webmail.lerctr.org> <201303061857.r26IvLnc024186@higson.cam.lispworks.com> Message-ID: <9e133e088f6c3c3dafdc0a99eb7c48c1@webmail.lerctr.org> X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/0.8.5 X-Spam-Score: -3.5 (---) X-LERCTR-Spam-Score: -3.5 (---) X-Spam-Report: SpamScore (-3.5/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.628 X-LERCTR-Spam-Report: SpamScore (-3.5/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.628 Cc: tevans.uk@googlemail.com, freebsd-fs@freebsd.org, ronald-freebsd8@klop.yi.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Mar 2013 19:15:11 -0000 On 2013-03-06 12:59, Larry Rosenman wrote: > On 2013-03-06 12:57, Martin Simmons wrote: >>>>>>> On Wed, 06 Mar 2013 05:07:28 -0600, Larry Rosenman said: >>> On 2013-03-06 04:56, Larry Rosenman wrote: >>>> On 2013-03-06 04:51, Tom Evans wrote: >>>>> On Wed, Mar 6, 2013 at 10:46 AM, Larry Rosenman >>>>> wrote: >>>>>> So, you are correct that something(tm) is unclean about the ssh >>>>>> path. >>>>>> >>>>> And what is it that is added? Surely that is trivial to determine? >>>>> echo hello > foo >>>>> cat foo | ssh host cat >>>>> Cheers >>>>> Tom >>>> it seems to be bytestream dependent, as this simple case works, and >>>> the vast majority of the sends work, but the particular >>>> case in the thread does NOT. >>>> # echo hello >foo >>>> # cat foo | ssh home cat >>>> hello >>>> # >>> stranger: >>> $ cd /tmp >>> $ cat send.stream | ssh home openssl md5 >>> (stdin)= 9cd1d73ea8411f1c222bc90e7bea3d33 >>> $ openssl md5 send.stream >>> MD5(send.stream)= 9cd1d73ea8411f1c222bc90e7bea3d33 >>> $ >>> so I'm not sure what is tripping it in the stream to a pipe case. >> Is that running under the same uid? The script you posted earlier >> runs the >> pipe under ssh root@tbh.lerctr.org. >> __Martin > Ooo, good point. Would csh vs. sh make a difference? Doesn't seem to make a difference.... # cat send.stream | ssh root@home openssl md5 (stdin)= 9cd1d73ea8411f1c222bc90e7bea3d33 # uname -a FreeBSD thebighonker.lerctr.org 8.3-STABLE FreeBSD 8.3-STABLE #54 r247820: Mon Mar 4 18:08:11 CST 2013 root@thebighonker.lerctr.org:/usr/obj/usr/src/sys/THEBIGHONKER amd64 # # exec csh root@borg:/home/ler # pwd /home/ler root@borg:/home/ler # ssh tbh "cat /home/ler/public_html/ZFS_RECV/send.stream | ssh root@home.lerctr.org openssl md5" (stdin)= 9cd1d73ea8411f1c222bc90e7bea3d33 root@borg:/home/ler # uname -a FreeBSD borg.lerctr.org 10.0-CURRENT FreeBSD 10.0-CURRENT #124 r247826: Mon Mar 4 19:59:08 CST 2013 root@borg.lerctr.org:/usr/obj/usr/src/sys/BORG-DTRACE amd64 root@borg:/home/ler # -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: ler@lerctr.org US Mail: 430 Valona Loop, Round Rock, TX 78681-3893