Skip site navigation (1)Skip section navigation (2)
Date:      Fri, 25 Jul 2014 18:03:57 +0200
From:      Mark Martinec <Mark.Martinec+freebsd@ijs.si>
To:        freebsd-current@freebsd.org, Freebsd fs <freebsd-fs@freebsd.org>
Subject:   Re: zfs send/recv: STILL invalid Backup Stream
Message-ID:  <2f191a3e72b9d94a15128de806f8d1c8@mailbox.ijs.si>
In-Reply-To: <20140725134125.GA19293@thebighonker.lerctr.org>
References:  <cc635a377e817cb57d27650ed3e558f4@thebighonker.lerctr.org> <3d2aac84d962a703fbf56a864ba5f19c@mailbox.ijs.si> <c93ef94a8e9e076b86a65f4986d0e30d@thebighonker.lerctr.org> <9eef3e7e964cb33fd163cc2f9300f326@mailbox.ijs.si> <d5bda7f9ad7f86ec35ab6ba5571aa8bc@thebighonker.lerctr.org> <fbf874048b94066aabc4e656e2d3157d@thebighonker.lerctr.org> <c8e77e506bdba2bc1b9dd20ada388879@mailbox.ijs.si> <53D1AB3D.1060205@freebsd.org> <33c478c3120c21d6cb9c325cc1119cf8@thebighonker.lerctr.org> <60845088153247fa31c50c9f52ef72cb@mailbox.ijs.si> <20140725134125.GA19293@thebighonker.lerctr.org>

next in thread | previous in thread | raw e-mail | index | archive | help
2014-07-25 15:41, Larry Rosenman wrote:
> On Fri, Jul 25, 2014 at 11:58:48AM +0200, Mark Martinec wrote:
>> Don't know, I'd guess some network-related memory limit is being hit
>> on the sending site.
>> 
>> Why not try to decouple the 'zfs send' from a network copy and ssh:
>> Login to a remote side, do a 'zfs send' to some local temporary file
>> there, then feed that file to ssh and send it over to a home host,
>> where it can be piped into some simple program like md5 or 'wc -c'
>> instead of a zfs recv.
>> 
> I think I've done that, but it sort of defeats the purpose,

Does it? If you are lucky it would fail again, but this time
you'd know if it was a zfs or a network problem.

> as the stream becomes a big file on disk.

If it's an incremental stream and you have sufficient free space
available, than it's all fine and you should try that. If storage
is a problem you may try piping /dev/zero or /dev/random through
ssh to feed a remote consumer, simulating a huge stream, and hope
that it will eventually fail.


> I'd like to get some help chasing what parameter(s) need to be fixed 
> here.
[...]
> Can I get some ideas on:
> 1) what MIGHT need tweaking
> 2) would (k|d)trace help?
> 3) what else could we find out what's being told no memory?

Sorry, not deep enough into fs or network to be able to tell.

My guess it that it's a networking issue (not zfs), and not
directly related to virtual memory or swap or ARC management.

> To: freebsd-current@freebsd.org, Freebsd fs <freebsd-fs@freebsd.org>

If you'd be able to demonstrate that this is unrelated to zfs,
then the freebsd-net@freebsd.org mailing list would perhaps be
a suitable place to continue this thread.

   Mark



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2f191a3e72b9d94a15128de806f8d1c8>