From owner-freebsd-fs@FreeBSD.ORG  Thu Jul 21 19:21:25 2011
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 4F735106564A;
	Thu, 21 Jul 2011 19:21:25 +0000 (UTC)
	(envelope-from dpd@bitgravity.com)
Received: from mail1.sjc1.bitgravity.com (mail1.sjc1.bitgravity.com
	[209.131.97.19])
	by mx1.freebsd.org (Postfix) with ESMTP id 322C18FC08;
	Thu, 21 Jul 2011 19:21:25 +0000 (UTC)
Received: from mail-pz0-f52.google.com ([209.85.210.52])
	by mail1.sjc1.bitgravity.com with esmtps (TLSv1:RC4-SHA:128)
	(Exim 4.69 (FreeBSD)) (envelope-from <dpd@bitgravity.com>)
	id 1QjyIG-000HLX-SY; Thu, 21 Jul 2011 11:48:20 -0700
Received: by pzd13 with SMTP id 13so2062740pzd.25
	for <multiple recipients>; Thu, 21 Jul 2011 11:48:15 -0700 (PDT)
Received: by 10.68.12.133 with SMTP id y5mr808908pbb.104.1311274095244;
	Thu, 21 Jul 2011 11:48:15 -0700 (PDT)
Received: from netops-173.sfo1.bitgravity.com (netops-173.sfo1.bitgravity.com
	[209.131.110.173])
	by mx.google.com with ESMTPS id d3sm1061911pbh.85.2011.07.21.11.48.13
	(version=TLSv1/SSLv3 cipher=OTHER);
	Thu, 21 Jul 2011 11:48:14 -0700 (PDT)
Mime-Version: 1.0 (Apple Message framework v1084)
Content-Type: text/plain; charset=us-ascii
From: David P Discher <dpd@bitgravity.com>
In-Reply-To: <CAF-QHFUs7OAAwcFvSymc3YYX3Cdq+QUUSP_4OFXCegCbzLkOUA@mail.gmail.com>
Date: Thu, 21 Jul 2011 11:48:12 -0700
Content-Transfer-Encoding: quoted-printable
Message-Id: <E3F8D6EC-2CCA-49A2-9BFD-982BF01A3531@bitgravity.com>
References: <j09hk8$svj$1@dough.gmane.org>
	<13577F3E-DE59-44F4-98F7-9587E26499B8@gmail.com>
	<CAF-QHFUs7OAAwcFvSymc3YYX3Cdq+QUUSP_4OFXCegCbzLkOUA@mail.gmail.com>
To: Ivan Voras <ivoras@freebsd.org>
X-Mailer: Apple Mail (2.1084)
Cc: freebsd-fs@freebsd.org
Subject: Re: ZFS and large directories - caveat report
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 21 Jul 2011 19:21:25 -0000


Ivan -

What's your uptime ?
Are you using l2 arc ?
what is the value of 'sysctl kstat.zfs.misc.arcstats.evict_skip' ?
  is this increasing quickly ?

How much cpu are the 'arc_reclaim_thread' and 'l2arc_feed_thread' taking =
up ?
  top -SHb 500 | grep arc


---
David P. Discher
dpd@bitgravity.com * AIM: bgDavidDPD
BITGRAVITY * http://www.bitgravity.com

On Jul 21, 2011, at 10:18 AM, Ivan Voras wrote:

> On 21 July 2011 18:38, Luiz Otavio O Souza <lists.br@gmail.com> wrote:
>=20
>> The general usage on this server is fine, but the periodic (daily) =
scripts take almost a day to complete and the server is slow as hell =
while the daily scripts are running.
>=20
> Yes, this is how my problem was first diagnosed.
>=20
>> So, yes, i can confirm that running 'find' on a ZFS FS with a lot of =
files is very, very slow (and looks like it isn't related to how the =
files are distributed on the FS).
>=20
> Only it's not just "find" - it's any directory operations - including
> file creation and removal. I cannot say that is not related to how
> files are distributed on the file system, except the unusually long
> operations on the parent of the shard directories in my case.
> _______________________________________________
> freebsd-fs@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-fs
> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"