From owner-freebsd-fs@FreeBSD.ORG  Mon Jan 14 09:43:46 2013
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by hub.freebsd.org (Postfix) with ESMTP id BA7B2F3A
 for <freebsd-fs@freebsd.org>; Mon, 14 Jan 2013 09:43:46 +0000 (UTC)
 (envelope-from nicolas@i.0x5.de)
Received: from n.0x5.de (n.0x5.de [217.197.85.144])
 by mx1.freebsd.org (Postfix) with ESMTP id 6FB07F94
 for <freebsd-fs@freebsd.org>; Mon, 14 Jan 2013 09:43:46 +0000 (UTC)
Received: by pc5.i.0x5.de (Postfix, from userid 1003)
 id 3Yl8rd512Vz7ySF; Mon, 14 Jan 2013 10:43:45 +0100 (CET)
Date: Mon, 14 Jan 2013 10:43:45 +0100
From: Nicolas Rachinsky <fbsd-mas-0@ml.turing-complete.org>
To: Steven Hartland <killing@multiplay.co.uk>
Subject: Re: slowdown of zfs (tx->tx)
Message-ID: <20130114094345.GB75529@mid.pc5.i.0x5.de>
References: <20130108174225.GA17260@mid.pc5.i.0x5.de>
 <CAFqOu6jgA8RWV5d+rOBk8D=3Vu3yWSnDkAi1cFJ0esj4OpBy2Q@mail.gmail.com>
 <20130109162613.GA34276@mid.pc5.i.0x5.de>
 <CAFqOu6jrng=v8eVyhqV-PBqJM_dYy+U7X4+=ahBeoxvK4mxcSA@mail.gmail.com>
 <20130110193949.GA10023@mid.pc5.i.0x5.de>
 <20130111111147.GA34160@mid.pc5.i.0x5.de>
 <C3BE7751389046ED8A03C8EA9699A76B@multiplay.co.uk>
 <20130113235239.GA16318@mid.pc5.i.0x5.de>
 <778BCD159C6546A4ADC7D9FBBFC3DA8A@multiplay.co.uk>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <778BCD159C6546A4ADC7D9FBBFC3DA8A@multiplay.co.uk>
X-Powered-by: FreeBSD
X-Homepage: http://www.rachinsky.de
X-PGP-Keyid: 887BAE72
X-PGP-Fingerprint: 039E 9433 115F BC5F F88D  4524 5092 45C4 887B AE72
X-PGP-Keys: http://www.rachinsky.de/nicolas/gpg/nicolas_rachinsky.asc
User-Agent: Mutt/1.5.21 (2010-09-15)
Cc: freebsd-fs <freebsd-fs@freebsd.org>
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 14 Jan 2013 09:43:46 -0000

* Steven Hartland <killing@multiplay.co.uk> [2013-01-14 00:05 -0000]:
> 
> ----- Original Message ----- From: "Nicolas Rachinsky"
> <fbsd-mas-0@ml.turing-complete.org>
> To: "Steven Hartland" <killing@multiplay.co.uk>
> Cc: "freebsd-fs" <freebsd-fs@freebsd.org>
> Sent: Sunday, January 13, 2013 11:52 PM
> Subject: Re: slowdown of zfs (tx->tx)
> 
> 
> >* Steven Hartland <killing@multiplay.co.uk> [2013-01-11 13:58 -0000]:
> >>TBH looks like your just saturating your disks with the number of IOP's
> >>your doing.
> >
> >But now a backup takes forever (16hours and more) that took less than
> >30 minutes two weeks ago.
> >
> >I duplicated the complete setup to another (slower) server. There the
> >backups are slower than they were on this machine, but they are much
> >faster than on this machine.
              ^they are       ^now

> 
> Its not something silly like you have 4k disks which aren't 4k aligned
> is it?

No, these are 512 bytes/sector disks. And it started to become so slow
without any change (hardware or software). 

> IIRC you where using rsync, is there a reason why you aren't using
> zfs send - recv?

Most of the machines whose backups are put to this machine run with
linux and don't have zfs.

Nicolas
-- 
http://www.rachinsky.de/nicolas