From owner-freebsd-current@FreeBSD.ORG Fri Jul 25 14:25:02 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id D07C7D68; Fri, 25 Jul 2014 14:25:02 +0000 (UTC) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [IPv6:2001:470:1f0f:3ad:223:7dff:fe9e:6e8a]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "thebighonker.lerctr.org", Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9B02D276F; Fri, 25 Jul 2014 14:25:02 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lerctr.org; s=lerami; h=Message-ID:References:In-Reply-To:Subject:Cc:To:From:Date:Content-Transfer-Encoding:Content-Type:MIME-Version; bh=mRYBlUEmymsa5DztnNC3VdSB98M8ptMmMf7yXLHpIvU=; b=GIXle22RcDfJoOAO7nTQ/lA6s1F9+MvCvCIvwqmDqLd6WWCdzLxGkggh1Kl/spu7tcFDSTA5fn3zPTfxuhFj7zYXYXPyAoZq2JLnCPcM7NbMRUKUnqJ6D+xsjj3LR5cCHm0jHT0qrcPv63juo+6o1oda6v0+sCfsqUP6f3WhFJ4=; Received: from localhost.lerctr.org ([127.0.0.1]:51560 helo=webmail.lerctr.org) by thebighonker.lerctr.org with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.83 (FreeBSD)) (envelope-from ) id 1XAgQb-0006aM-Ez; Fri, 25 Jul 2014 09:25:01 -0500 Received: from host.alcatel.com ([198.205.55.139]) by webmail.lerctr.org with HTTP (HTTP/1.1 POST); Fri, 25 Jul 2014 09:24:27 -0500 MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII; format=flowed Content-Transfer-Encoding: 7bit Date: Fri, 25 Jul 2014 09:24:27 -0500 From: Larry Rosenman To: Allan Jude Subject: Re: zfs send/recv: STILL invalid Backup Stream In-Reply-To: <53D263A6.5010907@freebsd.org> References: <3d2aac84d962a703fbf56a864ba5f19c@mailbox.ijs.si> <9eef3e7e964cb33fd163cc2f9300f326@mailbox.ijs.si> <53D1AB3D.1060205@freebsd.org> <33c478c3120c21d6cb9c325cc1119cf8@thebighonker.lerctr.org> <60845088153247fa31c50c9f52ef72cb@mailbox.ijs.si> <20140725134125.GA19293@thebighonker.lerctr.org> <258d3f814c0d0a1159608d9cf09d65ad@thebighonker.lerctr.org> <53D263A6.5010907@freebsd.org> Message-ID: <7d0d742431172d4d2e36a68d209a4597@thebighonker.lerctr.org> X-Sender: ler@lerctr.org User-Agent: Roundcube Webmail/1.0.1 X-Spam-Score: -2.9 (--) X-LERCTR-Spam-Score: -2.9 (--) X-Spam-Report: SpamScore (-2.9/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.001 X-LERCTR-Spam-Report: SpamScore (-2.9/5.0) ALL_TRUSTED=-1, BAYES_00=-1.9, RP_MATCHES_RCVD=-0.001 Cc: Freebsd fs , freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 25 Jul 2014 14:25:03 -0000 On 2014-07-25 09:03, Allan Jude wrote: > On 2014-07-25 09:49, Larry Rosenman wrote: >> On 2014-07-25 08:41, Larry Rosenman wrote: >>> On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote: >>>> Don't know, I'd guess some network-related memory limit is being hit >>>> on the sending site. >>>> >>>> Why not try to decouple the 'zfs send' from a network copy and ssh: >>>> Login to a remote side, do a 'zfs send' to some local temporary file >>>> there, then feed that file to ssh and send it over to a home host, >>>> where it can be piped into some simple program like md5 or 'wc -c' >>>> instead of a zfs recv. >>>> >>> I think I've done that, but it sort of defeats the purpose, as the >>> stream >>> becomes a big file on disk. >>> >>> I'd like to get some help chasing what parameter(s) need to be fixed >>> here. >>> >> sysctl output and other things at: >> >> http://www.lerctr.org/~ler/FreeBSD/ >> >> >>> Can I get some ideas on: >>> 1) what MIGHT need tweaking >>> 2) would (k|d)trace help? >>> 3) what else could we find out what's being told no memory? >> >> I *CAN* give SSH/Root/etc access to BOTH boxes on request. >> >> What else do you need? >> >> > > Try just ssh into the 'source' host, and do: > zfs send -v -R zroot@${DATE} > /dev/null > > and see if it actually finishes, or if it runs out of memory again. that, of course, worked fine :( -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 214-642-9640 (c) E-Mail: ler@lerctr.org US Mail: 108 Turvey Cove, Hutto, TX 78634-5688