From owner-freebsd-fs@FreeBSD.ORG Thu Jul 21 17:18:48 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 299141065672 for ; Thu, 21 Jul 2011 17:18:48 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from mail-gx0-f182.google.com (mail-gx0-f182.google.com [209.85.161.182]) by mx1.freebsd.org (Postfix) with ESMTP id DE39D8FC22 for ; Thu, 21 Jul 2011 17:18:47 +0000 (UTC) Received: by gxk28 with SMTP id 28so891383gxk.13 for ; Thu, 21 Jul 2011 10:18:47 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type; bh=KpXJU3JUhTGiHgGaDPpw5vgK4sTDCOluqPWxqRyGeRY=; b=D/Dyehy43KR2RIwC/BmrYQG0wF+h/TSWsGvn/2zAC8a9iALXi7PDCWQmLQHul1Hht5 viZLUtRWi2aUf76goAr//dWLsynjak7hwfTb9rH9b3gUq9cpzDuvM4KW5+2hyIVb4ECc 9mHaJOLJFJQsS+1xAw4wFT7dNISCyo1qz0KjE= Received: by 10.101.196.22 with SMTP id y22mr599177anp.17.1311268727126; Thu, 21 Jul 2011 10:18:47 -0700 (PDT) MIME-Version: 1.0 Sender: ivoras@gmail.com Received: by 10.100.198.5 with HTTP; Thu, 21 Jul 2011 10:18:07 -0700 (PDT) In-Reply-To: <13577F3E-DE59-44F4-98F7-9587E26499B8@gmail.com> References: <13577F3E-DE59-44F4-98F7-9587E26499B8@gmail.com> From: Ivan Voras Date: Thu, 21 Jul 2011 19:18:07 +0200 X-Google-Sender-Auth: Fr0nNfqsxEXb_7al86kqBT7k9Ho Message-ID: To: Luiz Otavio O Souza Content-Type: text/plain; charset=UTF-8 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS and large directories - caveat report X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jul 2011 17:18:48 -0000 On 21 July 2011 18:38, Luiz Otavio O Souza wrote: > The general usage on this server is fine, but the periodic (daily) scripts take almost a day to complete and the server is slow as hell while the daily scripts are running. Yes, this is how my problem was first diagnosed. > So, yes, i can confirm that running 'find' on a ZFS FS with a lot of files is very, very slow (and looks like it isn't related to how the files are distributed on the FS). Only it's not just "find" - it's any directory operations - including file creation and removal. I cannot say that is not related to how files are distributed on the file system, except the unusually long operations on the parent of the shard directories in my case.