From owner-freebsd-fs@FreeBSD.ORG Thu Jul 21 20:04:47 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5F7E7106564A for ; Thu, 21 Jul 2011 20:04:47 +0000 (UTC) (envelope-from ivoras@gmail.com) Received: from mail-yx0-f182.google.com (mail-yx0-f182.google.com [209.85.213.182]) by mx1.freebsd.org (Postfix) with ESMTP id 1C9A28FC0C for ; Thu, 21 Jul 2011 20:04:46 +0000 (UTC) Received: by yxl31 with SMTP id 31so979168yxl.13 for ; Thu, 21 Jul 2011 13:04:46 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:from:date :x-google-sender-auth:message-id:subject:to:cc:content-type; bh=4Gwf1YkwcRcUXptqAgWUlmp7T2KcK0ZKrmLLlrPsUYI=; b=Y6BJ3+9VbOR5Ic9CeMG55ZZkxBhTQnFBlrdYvWQbeZhhl/8gdRqGjdE3YNS8ZwF6x9 Sg89udkec7zt2WYAKzx0XA6Jj5JGouzCBoZN8AjYK4OEv5SYhfsDJRrgKLSlaEEmvdrM i6SnmLPUFDof/zP1M/RfLzFCoYvO94OhroQm0= Received: by 10.101.180.22 with SMTP id h22mr726829anp.149.1311278686273; Thu, 21 Jul 2011 13:04:46 -0700 (PDT) MIME-Version: 1.0 Sender: ivoras@gmail.com Received: by 10.100.198.5 with HTTP; Thu, 21 Jul 2011 13:04:06 -0700 (PDT) In-Reply-To: References: <13577F3E-DE59-44F4-98F7-9587E26499B8@gmail.com> <5542D910-0C5C-4B2B-885F-CC92901367F0@gmail.com> From: Ivan Voras Date: Thu, 21 Jul 2011 22:04:06 +0200 X-Google-Sender-Auth: pQmXl6Ac2EOQXWFtkBRuDGr8xAg Message-ID: To: Luiz Otavio O Souza Content-Type: text/plain; charset=UTF-8 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS and large directories - caveat report X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jul 2011 20:04:47 -0000 On 21 July 2011 21:45, Ivan Voras wrote: > On 21 July 2011 21:36, Luiz Otavio O Souza wrote: > >> But i guess i need to increase the arc_meta_limit as well: >> >> vfs.zfs.arc_meta_limit: 536870912 >> vfs.zfs.arc_meta_used: 579461312 > > You also have arc_meta_used larger than arc_meta_limit ... but not > nearly as big a difference as on my system. > > Can anyone speculate if raising vfs.zfs.arc_meta_limit would help? Well, it didn't help me - I raised it above what used to be arc_meta_used and after the reboot arc_meta_used simply rose again over arc_meta_limit. Here's another "symptom": while "find" is running, I do a ls of my home directory on the same zpool and get delays, always at the same place (after the postgresql source file): www:~> ll total 233 drwxrwxr-x 2 ivoras ivoras 8 Jun 1 2009 backup/ -rw-rw-r-- 1 ivoras ivoras 593 Nov 7 2007 c1.php -rw-rw-r-- 1 ivoras ivoras 37682863 Apr 30 2009 cms.tgz drwxrwxr-x 4 ivoras ivoras 4 Feb 12 2008 devel/ -rw-r--r-- 1 ivoras ivoras 44372 May 24 2007 etcdirs.tgz -rw-r--r-- 1 root ivoras 215397 Nov 22 2007 lock_profile.txt -rw-r--r-- 1 ivoras ivoras 18336 Nov 21 2007 lockmgr.diff -rw-rw-r-- 1 ivoras ivoras 32590585 Oct 31 2007 melc.sql -rw-r----- 1 ivoras ivoras 1712 Oct 15 2008 newreq.pem -rw-rw-r-- 1 root ivoras 3330572 Apr 30 2009 postgresql-server-8.3.1.tbz load: 0.38 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 3.25r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 5.00r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 5.47r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 6.34r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 8.30r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 8.70r 0.00u 0.01s 0% 2140k load: 0.67 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 9.17r 0.00u 0.01s 0% 2140k load: 0.70 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 11.08r 0.00u 0.01s 0% 2140k load: 0.70 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 11.54r 0.00u 0.01s 0% 2140k load: 0.70 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 13.00r 0.00u 0.01s 0% 2140k load: 0.70 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 13.49r 0.00u 0.01s 0% 2140k load: 0.70 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 14.10r 0.00u 0.01s 0% 2140k load: 0.64 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 14.62r 0.00u 0.01s 0% 2140k load: 0.64 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 17.41r 0.00u 0.01s 0% 2140k load: 0.64 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 19.74r 0.00u 0.01s 0% 2140k load: 0.75 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 20.53r 0.00u 0.01s 0% 2140k load: 0.75 cmd: ls 1786 [tx->tx_quiesce_done_cv)] 21.30r 0.00u 0.01s 0% 2140k lrwxrwxr-x 1 ivoras ivoras 9 Apr 23 2009 services@ -> /services -rw-rw-r-- 1 ivoras ivoras 160060550 Oct 31 2007 services.tgz -rw-rw-r-- 1 ivoras ivoras 0 Nov 1 2007 stress.txt drwxrwxr-x 5 ivoras ivoras 8 Mar 10 2010 temp/ -rw-rw-r-- 1 ivoras ivoras 257002 Oct 31 2007 ule.tgz -rw-r--r-- 1 ivoras ivoras 8965978 May 24 2007 wwwdirs.tgz The "load.." lines in between are me hitting Ctrl-T for process info. Observe almost 20 seconds delay in the middle of "ls"!