From owner-freebsd-stable@freebsd.org Tue Nov 24 16:11:56 2015 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C04F0A370BD for ; Tue, 24 Nov 2015 16:11:56 +0000 (UTC) (envelope-from albert@acervin.com) Received: from mail-wm0-x232.google.com (mail-wm0-x232.google.com [IPv6:2a00:1450:400c:c09::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 51FA41233 for ; Tue, 24 Nov 2015 16:11:56 +0000 (UTC) (envelope-from albert@acervin.com) Received: by wmec201 with SMTP id c201so33619590wme.1 for ; Tue, 24 Nov 2015 08:11:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=acervin-com.20150623.gappssmtp.com; s=20150623; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=Z2ZqjDX31e4kmOOFoop8xVtaJXoHxn0erCMt37sN8To=; b=f1sCowHhDs4zlIsmOOunnTD1jCBHHDqGgtMRYZ082FTVzlsYwmtr13l5l6eeF6OPOv RQGxeYo0yKdtJeqV0S7ywos7KzPgg8QTTcXEV1SuWhfFMWJG8lsXeK7Ap6Ztynl/9J7R PUZOm8M6izxKLBkfb7id307CZ+Mvb1iH5oorRYDByPiwjAbWuKftskqRyJWP/B3ESnwD +aa/OXhhvENBTPakBo10KhFdmqiXhfqj/qUy0sWa4qS60CEEebHlnR2yOU3/csLxz6Wf KUzEUV2y3QItg06EtKFhaCfALDRj1a2sLHGhHqdYC3M4M97XC4imubJRXLyApgiAi40N dQRg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=Z2ZqjDX31e4kmOOFoop8xVtaJXoHxn0erCMt37sN8To=; b=OoDSNV1aYRghTAI1UbMnA/YprYG9ViZFtgScsWe9yHVnr/dXKRGZ5PboTF5f6NkZfD qtoEPDjyZ+YpCKTjkplH9wo6u4h7v5EPzIXftGIr5Ge1e+57i5ji3MguYupzuGnogQ5r TjSqxs3w0aGsQkMhEckqKvw3MycN6uaBx+6Z2RB0uZABR5BytPGptfLLBrZZi0jL26dI BnxVL3GzYiQY/HwDA46z1veHZa7lOoa8MdJ8CYMgzhyv/wUSvfUg+mdfJBcHAPnKrU4b Om8YK1j6b5obiNVQPoIX6byNzkLe/0uyipKShijrzg6EjXW8beWOMSdoqHtLNYJFKw3A PV1g== X-Gm-Message-State: ALoCoQlXFdHuO2RQhG9YmA+hsx7gwvY/Qb5NjKtplH/NqDCk9tn6sBLnPL3Y96lkp3xmV+K50Spe MIME-Version: 1.0 X-Received: by 10.194.92.4 with SMTP id ci4mr44502849wjb.175.1448381514786; Tue, 24 Nov 2015 08:11:54 -0800 (PST) Received: by 10.28.195.195 with HTTP; Tue, 24 Nov 2015 08:11:54 -0800 (PST) X-Originating-IP: [80.239.191.4] In-Reply-To: <5654855F.2070502@sentex.net> References: <5654855F.2070502@sentex.net> Date: Tue, 24 Nov 2015 17:11:54 +0100 Message-ID: Subject: Re: ZFS - poor performance with "large" directories From: Albert Cervin To: Mike Tancsa Cc: Adam Vande More , "freebsd-stable@freebsd.org" Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Nov 2015 16:11:56 -0000 "8G is not that much really. In the thread they suggested increasing the meta limit so that the giant directory can fit into cache." It is not really short on ram judging from the usage though and sure 8Gb is not that much but on the other hand, neither is 8000 files in one directory in my opinion... Will try a bit with the meta limit. Thanks, Albert On Tue, Nov 24, 2015 at 4:42 PM, Mike Tancsa wrote: > On 11/24/2015 10:26 AM, Albert Cervin wrote: >> vfs.zfs.txg.timeout is already verified to be 5 (the default). I have >> also turned off atime and vfs.zfs.arc_meta_limit is 1287906304. >> >> "Do you have any memory pressures on your server ? Have a look at this >> thread" >> >> The server has 4 cores and 8Gb of memory and there is no memory >> pressure on the server. Thanks, will look at the thread! >> >> The setup is _really_ simple with just a single pool and no datasets. >> >> Any more ideas? > > 8G is not that much really. In the thread they suggested increasing the > meta limit so that the giant directory can fit into cache. > > ---Mike > > > > -- > ------------------- > Mike Tancsa, tel +1 519 651 3400 > Sentex Communications, mike@sentex.net > Providing Internet services since 1994 www.sentex.net > Cambridge, Ontario Canada http://www.tancsa.com/