From owner-freebsd-fs@FreeBSD.ORG Mon Sep 6 13:39:44 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 41136106567A for ; Mon, 6 Sep 2010 13:39:44 +0000 (UTC) (envelope-from jhellenthal@gmail.com) Received: from mail-iw0-f182.google.com (mail-iw0-f182.google.com [209.85.214.182]) by mx1.freebsd.org (Postfix) with ESMTP id EC2FB8FC13 for ; Mon, 6 Sep 2010 13:39:43 +0000 (UTC) Received: by iwn34 with SMTP id 34so4861513iwn.13 for ; Mon, 06 Sep 2010 06:39:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:sender:message-id:date:from :user-agent:mime-version:to:cc:subject:references:in-reply-to :x-enigmail-version:content-type; bh=SeCxFiKd4uKV33DJ/ZEijj+6MeFFDGjjJMr8o7DtHTg=; b=aTeRhhqsiMLa2B16r74GyLzqoTBK/vsaumLEbcLVxoJaptJZVI/ESviOkbiEDIuG35 K/U3mksqt70TgXLiGuU751s9Q7pBCblh4rZsq4FdJpBa1fSgWo6mT0AJE6DnVIiNIWg4 g/xSmAVPu/x4Q07vfD5eP/ZnzzKwe2GGj95F8= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=sender:message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:x-enigmail-version:content-type; b=ssW6DgV/OxYH9IYYsdMXtt/TTX92HNFvUGDWBmz1BhtB/hyFi33I6FlFs4IJotonL/ aEc0mgcTNcMg8s+s8XDDFX7bBu6l/GiznSyGQjtpaY1UWEPezRM9exvF37ufVWN4oRLN LQLGU0OT4qLC+6iuugvzIu8qkM1/nbgB9Lq2s= Received: by 10.231.161.73 with SMTP id q9mr6326547ibx.70.1283780383264; Mon, 06 Sep 2010 06:39:43 -0700 (PDT) Received: from centel.dataix.local (adsl-99-181-137-20.dsl.klmzmi.sbcglobal.net [99.181.137.20]) by mx.google.com with ESMTPS id h8sm5915455ibk.21.2010.09.06.06.39.41 (version=SSLv3 cipher=RC4-MD5); Mon, 06 Sep 2010 06:39:42 -0700 (PDT) Sender: "J. Hellenthal" Message-ID: <4C84EF1B.5040004@DataIX.net> Date: Mon, 06 Sep 2010 09:39:39 -0400 From: jhell User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.9.2.8) Gecko/20100806 Lightning/1.0b1 Thunderbird MIME-Version: 1.0 To: Andriy Gapon References: <5DB6E7C798E44D33A05673F4B773405E@multiplay.co.uk><4C825D65.3040004@DataIX.net> <7EA7AD058C0143B2BF2471CC121C1687@multiplay.co.uk> <1F64110BFBD5468B8B26879A9D8C94EF@multiplay.co.uk> <4C84C72A.3020506@icyb.net.ua> <4C84EBFE.7030408@icyb.net.ua> In-Reply-To: <4C84EBFE.7030408@icyb.net.ua> X-Enigmail-Version: 1.1.2 Content-Type: multipart/mixed; boundary="------------070309050609030205070100" Cc: freebsd-fs@freebsd.org Subject: Re: zfs very poor performance compared to ufs due to lack of cache? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Sep 2010 13:39:44 -0000 This is a multi-part message in MIME format. --------------070309050609030205070100 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit On 09/06/2010 09:26, Andriy Gapon wrote: > on 06/09/2010 16:23 Steven Hartland said the following: >> ----- Original Message ----- From: "Andriy Gapon" >>>> No joy, still drops down to arc_min even with those two patches and changing >>>> to vm_paging_needed from the post Artem mentioned: >>>> http://lists.freebsd.org/pipermail/freebsd-hackers/2010-August/032731.html >>>> >>>> So I suspect if I hadn't put in a high arc_min as well it would be back down >>>> at silly low levels. >>> >>> But we don't really know this, do we? >>> >>> I think that it would be useful for you and perhaps for us, if you'd set up >>> monitoring (and graphing) of key memory-related parameters. >>> E.g. at least the following sysctls: >>> kstat.zfs.misc.arcstats.size >>> vm.stats.vm.v_pdwakeups >>> vm.stats.vm.v_cache_count >>> vm.stats.vm.v_inactive_count >>> vm.stats.vm.v_active_count >>> vm.stats.vm.v_wire_count >>> vm.stats.vm.v_free_count >>> >>> This would allow to see dynamics of memory consumption and correlation with >>> pagedaemon events. >> >> Now monitoring these each minute to an rrd and text file and updated 8-STABLE >> with the following patches: >> http://people.freebsd.org/~mm/patches/zfs/v15/stable-8-v15.patch >> http://people.freebsd.org/~mm/patches/zfs/zfs_metaslab_v2.patch >> http://people.freebsd.org/~mm/patches/zfs/zfs_abe_stat_rrwlock.patch >> and then the needfree.patch I already posted. > > Cool! > > What about vm_paging_needed() patch? > Ugh! I keep forgetting about this one! and confusing it for the needfree change. /Ugh! It is attached as well. -- jhell,v --------------070309050609030205070100 Content-Type: text/plain; name="vm_paging_needed.patch" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="vm_paging_needed.patch" diff -r 1f75c636f0d4 sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c --- a/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c Mon Sep 06 09:32:32 2010 -0400 +++ b/sys/cddl/contrib/opensolaris/uts/common/fs/zfs/arc.c Mon Sep 06 09:36:57 2010 -0400 @@ -2164,7 +2164,7 @@ * If pages are needed or we're within 2048 pages * of needing to page need to reclaim */ - if (vm_pages_needed || (vm_paging_target() > -2048)) + if (vm_paging_needed()) return (1); #if 0 --------------070309050609030205070100--