From owner-freebsd-stable@FreeBSD.ORG  Sat Oct  2 03:07:28 2010
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 54B5D106564A
	for <freebsd-stable@freebsd.org>; Sat,  2 Oct 2010 03:07:28 +0000 (UTC)
	(envelope-from sean@gothic.net.au)
Received: from visi.gothic.net.au (visi.gothic.net.au [115.64.131.102])
	by mx1.freebsd.org (Postfix) with ESMTP id AA8818FC08
	for <freebsd-stable@freebsd.org>; Sat,  2 Oct 2010 03:07:27 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
	by visi.gothic.net.au (Postfix) with SMTP id 8C0CB12ADE
	for <freebsd-stable@freebsd.org>; Sat,  2 Oct 2010 12:51:19 +1000 (EST)
Received: from visi.gothic.net.au (localhost [127.0.0.1])
	by visi.gothic.net.au (Postfix) with ESMTP id F2A0312ADB;
	Sat,  2 Oct 2010 12:51:18 +1000 (EST)
X-Virus-Scanned: amavisd-new at gothic.net.au
Received: from visi.gothic.net.au ([127.0.0.1])
	by visi.gothic.net.au (visi.gothic.net.au [127.0.0.1]) (amavisd-new,
	port 10026)
	with ESMTP id Q68LpTNgnQoE; Sat,  2 Oct 2010 12:51:09 +1000 (EST)
Received: from sean-mbookpro.gothic.net.au (sean-mbookpro.gothic.net.au
	[10.168.1.40]) (using TLSv1 with cipher AES128-SHA (128/128 bits))
	(No client certificate requested) (Authenticated sender: sean)
	by visi.gothic.net.au (Postfix) with ESMTPSA id 74CAB12AD4;
	Sat,  2 Oct 2010 12:51:09 +1000 (EST)
Mime-Version: 1.0 (Apple Message framework v1081)
Content-Type: text/plain; charset=us-ascii
From: Sean <sean@gothic.net.au>
In-Reply-To: <AANLkTi=xnOmRXYgr8csy-tTa-GK+3V4Ty2ze0fruPQb4@mail.gmail.com>
Date: Sat, 2 Oct 2010 12:51:09 +1000
Content-Transfer-Encoding: quoted-printable
Message-Id: <E97572BA-F9A1-409F-8427-800B7D22AB8C@gothic.net.au>
References: <a263c3beaeb0fa3acd82650775e31ee3.squirrel@nyi.unixathome.org>
	<45cfd27021fb93f9b0877a1596089776.squirrel@nyi.unixathome.org>
	<AANLkTik0aTDDSNRUBvfX5sMfhW+-nfSV9Q89v+eJo0ov@mail.gmail.com>
	<4C511EF8-591C-4BB9-B7AA-30D5C3DDC0FF@langille.org>
	<AANLkTinyHZ1r39AYrV_Wwc2H3B=xMv3vbeDLY2Gc+kez@mail.gmail.com>
	<4CA68BBD.6060601@langille.org>
	<AANLkTi=xnOmRXYgr8csy-tTa-GK+3V4Ty2ze0fruPQb4@mail.gmail.com>
To: Artem Belevich <fbsdlist@src.cx>
X-Mailer: Apple Mail (2.1081)
Cc: freebsd-stable <freebsd-stable@freebsd.org>,
	Dan Langille <dan@langille.org>
Subject: Re: zfs send/receive: is this slow?
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 02 Oct 2010 03:07:28 -0000


On 02/10/2010, at 11:43 AM, Artem Belevich wrote:

>> As soon as I opened this email I knew what it would say.
>>=20
>>=20
>> # time zfs send storage/bacula@transfer | mbuffer | zfs receive
>> storage/compressed/bacula-mbuffer
>> in @  197 MB/s, out @  205 MB/s, 1749 MB total, buffer   0% full
> ..
>> Big difference.  :)
>=20
> I'm glad it helped.
>=20
> Does anyone know why sending/receiving stuff via loopback is so much
> slower compared to pipe?


Up and down the entire network stack, in and out of TCP buffers at both =
ends... might add some overhead, and other factors in limiting it.

Increasing TCP buffers, and disabling delayed acks might help. Nagle =
might also have to be disabled too. (delayed acks and nagle in =
combination can interact in odd ways)


>=20
> --Artem
> _______________________________________________
> freebsd-stable@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-stable
> To unsubscribe, send any mail to =
"freebsd-stable-unsubscribe@freebsd.org"