From owner-freebsd-fs@FreeBSD.ORG Wed Apr 7 23:43:24 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5E880106566C for ; Wed, 7 Apr 2010 23:43:24 +0000 (UTC) (envelope-from nowak@funil.de) Received: from mail.csp-systems.de (mail.csp-systems.de [83.246.83.230]) by mx1.freebsd.org (Postfix) with ESMTP id 15F9B8FC13 for ; Wed, 7 Apr 2010 23:43:23 +0000 (UTC) Received: by mail.csp-systems.de (Postfix, from userid 602) id B96666928CB; Thu, 8 Apr 2010 01:20:52 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.2.5 (2008-06-10) on mail.csp-systems.de X-Spam-Level: * X-Spam-Status: No, score=1.3 required=6.0 tests=AWL, BAYES_00, FH_DATE_PAST_20XX, RDNS_NONE autolearn=no version=3.2.5 Received: from master.sinuspl.net (unknown [83.246.67.202]) by mail.csp-systems.de (Postfix) with ESMTP id 140C66901F7; Thu, 8 Apr 2010 01:20:48 +0200 (CEST) Received: by master.sinuspl.net (Postfix, from userid 8) id A6BAC108033F; Thu, 8 Apr 2010 01:20:46 +0200 (CEST) Received: from [172.19.191.2] (088156221125.bialystok.vectranet.pl [88.156.221.125]) by master.sinuspl.net (Postfix) with ESMTPA id F30FD10802D7; Thu, 8 Apr 2010 01:20:45 +0200 (CEST) Message-ID: <4BBD1345.9020503@funil.de> Date: Thu, 08 Apr 2010 01:20:37 +0200 From: Adam Nowacki User-Agent: Thunderbird 2.0.0.24 (Windows/20100228) MIME-Version: 1.0 To: Rich References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: ZFS arc sizing (maybe related to kern/145229) X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 07 Apr 2010 23:43:24 -0000 check kstat.zfs.misc.arcstats.memory_throttle_count This counter is increased every time zfs thinks system is running low on memory and will force a write flush and reduce arc size to minimum. Biggest problem is that the code is counting only free memory and completely ignoring other memory that can be immediately freed like cached files from ufs. This is very easy to trigger on mixed ufs and zfs system by just reading enough data from ufs to fill its cache, zfs will begin throttling and will continue doing so even with no further ufs reads or writes. Rich wrote: > A datapoint for you: > Now running 8-STABLE (plus the mbuf leak fix which went in recently), > here's my ARC stats and ARC sysctl settings after the server was up > for about a week (5 days) after that: > ARC Size: > Current Size: 587.49M (arcsize) > Target Size: (Adaptive) 587.63M (c) > Min Size (Hard Limit): 512.00M (arc_min) > Max Size (Hard Limit): 3072.00M (arc_max) > > ARC Size Breakdown: > Recently Used Cache Size: 98.28% 577.50M (p) > Frequently Used Cache Size: 1.72% 10.12M (c-p) > > ARC Efficiency: > Cache Access Total: 2602789964 > Cache Hit Ratio: 96.11% 2501461882 > Cache Miss Ratio: 3.89% 101328082 > Actual Hit Ratio: 87.65% 2281380527 > > and > > vfs.zfs.arc_meta_limit=1073741824 > vfs.zfs.arc_meta_used=548265792 > vfs.zfs.arc_min=536870912 > vfs.zfs.arc_max=3221225472 > > So it very clearly limits to near the minimum size, but whether this > is design or accidental behavior, I'm unsure. > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > >