From owner-freebsd-stable@FreeBSD.ORG  Wed Sep 29 19:57:28 2010
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 826E6106564A
	for <freebsd-stable@freebsd.org>; Wed, 29 Sep 2010 19:57:28 +0000 (UTC)
	(envelope-from artemb@gmail.com)
Received: from mail-bw0-f54.google.com (mail-bw0-f54.google.com
	[209.85.214.54])
	by mx1.freebsd.org (Postfix) with ESMTP id 0CD058FC0A
	for <freebsd-stable@freebsd.org>; Wed, 29 Sep 2010 19:57:27 +0000 (UTC)
Received: by bwz15 with SMTP id 15so1124242bwz.13
	for <freebsd-stable@freebsd.org>; Wed, 29 Sep 2010 12:57:27 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=domainkey-signature:mime-version:received:sender:received
	:in-reply-to:references:date:x-google-sender-auth:message-id:subject
	:from:to:cc:content-type:content-transfer-encoding;
	bh=DpIrR9HCm56gCM8i0VJzZ3d4j7B1POvR9NCLUxhZp24=;
	b=wg3jADcF9Np2opjCJP0ZUeZUIJD6POG+BF4h/0s1rM9ZH099OQA4sRtMgvkIoLTwUP
	YAT8gXWQNtNftvu7nK+7Hcl8LBU/Dxe7a0nLJomr1AYpzSvszDdVOXKtg9KZe+iTMogb
	RjzarC00bT+uTLnDs/QiV3keb6f5JdyZixeC0=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
	h=mime-version:sender:in-reply-to:references:date
	:x-google-sender-auth:message-id:subject:from:to:cc:content-type
	:content-transfer-encoding;
	b=ogwDr+DYdfqBPBNrPsvsDSxZM6whCUdocrHxyHyINZ+u+EIFoJlc1H7pS6hjzc+vzd
	G6zuD6esC148B/wZBq8xKIriE34Is3qn/z4V3CcpH0HaeWKu64AI7pKrf4vIL0CxmUEq
	xovp9NL2fXrSWqpWLQowD9Z7/SuHaxOu2jQA0=
MIME-Version: 1.0
Received: by 10.204.123.137 with SMTP id p9mr1583786bkr.206.1285790246853;
	Wed, 29 Sep 2010 12:57:26 -0700 (PDT)
Sender: artemb@gmail.com
Received: by 10.220.176.77 with HTTP; Wed, 29 Sep 2010 12:57:26 -0700 (PDT)
In-Reply-To: <a263c3beaeb0fa3acd82650775e31ee3.squirrel@nyi.unixathome.org>
References: <a263c3beaeb0fa3acd82650775e31ee3.squirrel@nyi.unixathome.org>
Date: Wed, 29 Sep 2010 12:57:26 -0700
X-Google-Sender-Auth: 8IGHdFDATTEt_m7I4tN78i9er70
Message-ID: <AANLkTikb-uw25UJYT8bt_qWshRmz+=FcNzkSZt_eAe4q@mail.gmail.com>
From: Artem Belevich <fbsdlist@src.cx>
To: Dan Langille <dan@langille.org>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: freebsd-stable@freebsd.org
Subject: Re: zfs send/receive: is this slow?
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 29 Sep 2010 19:57:28 -0000

On Wed, Sep 29, 2010 at 11:04 AM, Dan Langille <dan@langille.org> wrote:
> It's taken about 15 hours to copy 800GB. =A0I'm sure there's some tuning =
I
> can do.
>
> The system is now running:
>
> # zfs send storage/bacula@transfer | zfs receive storage/compressed/bacul=
a

Try piping zfs data through mbuffer (misc/mbuffer in ports). I've
found that it does help a lot to smooth out data flow and increase
send/receive throughput even when send/receive happens on the same
host. Run it with a buffer large enough to accommodate few seconds
worth of write throughput for your target disks.

Here's an example:
http://blogs.everycity.co.uk/alasdair/2010/07/using-mbuffer-to-speed-up-slo=
w-zfs-send-zfs-receive/

--Artem