From owner-freebsd-fs@FreeBSD.ORG  Wed Jan 30 01:28:58 2013
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115])
 by hub.freebsd.org (Postfix) with ESMTP id CA8297CD
 for <freebsd-fs@freebsd.org>; Wed, 30 Jan 2013 01:28:58 +0000 (UTC)
 (envelope-from prvs=1742e413e9=killing@multiplay.co.uk)
Received: from mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23])
 by mx1.freebsd.org (Postfix) with ESMTP id 679793FF
 for <freebsd-fs@freebsd.org>; Wed, 30 Jan 2013 01:28:58 +0000 (UTC)
Received: from r2d2 ([188.220.16.49])
 by mail1.multiplay.co.uk (mail1.multiplay.co.uk [85.236.96.23])
 (MDaemon PRO v10.0.4) with ESMTP id md50001920725.msg
 for <freebsd-fs@freebsd.org>; Wed, 30 Jan 2013 01:28:56 +0000
X-Spam-Processed: mail1.multiplay.co.uk, Wed, 30 Jan 2013 01:28:56 +0000
 (not processed: message from valid local sender)
X-MDRemoteIP: 188.220.16.49
X-Return-Path: prvs=1742e413e9=killing@multiplay.co.uk
X-Envelope-From: killing@multiplay.co.uk
X-MDaemon-Deliver-To: freebsd-fs@freebsd.org
Message-ID: <9792709BF58143EFBDAABE638F769775@multiplay.co.uk>
From: "Steven Hartland" <killing@multiplay.co.uk>
To: "Kevin Day" <toasty@dragondata.com>, "Matthew Ahrens" <mahrens@delphix.com>
References: <19DB8F4A-6788-44F6-9A2C-E01DEA01BED9@dragondata.com>
 <CAJjvXiE+8OMu_yvdRAsWugH7W=fhFW7bicOLLyjEn8YrgvCwiw@mail.gmail.com>
 <F4420A8C-FB92-4771-B261-6C47A736CF7F@dragondata.com>
Subject: Re: Improving ZFS performance for large directories
Date: Wed, 30 Jan 2013 01:29:35 -0000
MIME-Version: 1.0
Content-Type: text/plain; format=flowed; charset="iso-8859-1";
 reply-type=original
Content-Transfer-Encoding: 7bit
X-Priority: 3
X-MSMail-Priority: Normal
X-Mailer: Microsoft Outlook Express 6.00.2900.5931
X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157
Cc: FreeBSD Filesystems <freebsd-fs@freebsd.org>
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.14
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/options/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
 <mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 30 Jan 2013 01:28:58 -0000


----- Original Message ----- 
From: "Kevin Day" <toasty@dragondata.com>

> I think some of the issue is that nothing is being allowed to stay cached long. We have several parallel rsyncs running at once 
> that are basically scanning every directory as fast as they can, combined with a bunch of rsync, http and ftp clients. I'm 
> guessing with all that activity things are getting shoved out pretty quickly.

zfs send / recv a possible replacements for the rsyncs?

    Regards
    Steve 


================================================
This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. 

In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337
or return the E.mail to postmaster@multiplay.co.uk.