From owner-freebsd-stable@FreeBSD.ORG Thu Aug 29 01:34:07 2013 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTP id 4F60FB1B; Thu, 29 Aug 2013 01:34:07 +0000 (UTC) (envelope-from dewayne.geraghty@heuristicsystems.com.au) Received: from nschwmtas04p.mx.bigpond.com (nschwmtas04p.mx.bigpond.com [61.9.189.146]) by mx1.freebsd.org (Postfix) with ESMTP id B19E6273B; Thu, 29 Aug 2013 01:34:06 +0000 (UTC) Received: from nschwcmgw08p ([61.9.190.168]) by nschwmtas04p.mx.bigpond.com with ESMTP id <20130829013359.SMGT2030.nschwmtas04p.mx.bigpond.com@nschwcmgw08p>; Thu, 29 Aug 2013 01:33:59 +0000 Received: from hermes.heuristicsystems.com.au ([58.172.113.247]) by nschwcmgw08p with BigPond Outbound id JRZz1m00H5LKYmq01RZzr3; Thu, 29 Aug 2013 01:33:59 +0000 X-Authority-Analysis: v=2.0 cv=LvIQOwhc c=1 sm=1 a=YibVxx38Z+cwdCKSMcELyg==:17 a=9F0kiUP6F10A:10 a=twTT4oUKOlYA:10 a=kj9zAlcOel0A:10 a=GHIR_BbyAAAA:8 a=KpPO2GPB2CoA:10 a=6I5d2MoRAAAA:8 a=eDDbEUom-Ko5lA9Eo9wA:9 a=CjuIK1q_8ugA:10 a=SV7veod9ZcQA:10 a=YibVxx38Z+cwdCKSMcELyg==:117 Received: from white (white.hs [10.0.5.2]) (authenticated bits=0) by hermes.heuristicsystems.com.au (8.14.5/8.13.6) with ESMTP id r7T1WKkg056313; Thu, 29 Aug 2013 11:32:21 +1000 (EST) (envelope-from dewayne.geraghty@heuristicsystems.com.au) From: "Dewayne Geraghty" To: "'Ivan Voras'" References: <521C9E85.4060801@UToledo.edu> <521D7552.5080008@UToledo.edu> Subject: RE: Suggest changing dirhash defaults for FreeBSD 9.2. Date: Thu, 29 Aug 2013 11:32:21 +1000 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Mailer: Microsoft Office Outlook 11 In-Reply-To: Thread-Index: Ac6j0+GtTebIRBeMSlWovKiHCwdrRwAfpyng X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.6157 Cc: freebsd-stable@freebsd.org X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Aug 2013 01:34:07 -0000 > -----Original Message----- > From: owner-freebsd-stable@freebsd.org > [mailto:owner-freebsd-stable@freebsd.org] On Behalf Of Ivan Voras > Sent: Wednesday, 28 August 2013 7:49 PM > To: freebsd-stable@freebsd.org > Subject: Re: Suggest changing dirhash defaults for FreeBSD 9.2. > > On 28/08/2013 05:58, Robert Burmeister wrote: > > > > On 8/27/2013 9:40 AM, Sergey Kandaurov wrote: > >> On 27 August 2013 16:41, Robert Burmeister > >> wrote: > >>> I have been experimenting with dirhash settings, and have scoured > >>> the internet for other peoples' experience with it. > >>> (I found the performance improvement in compiling has forestalled > >>> the need to add an SSD drive. ;-) > >>> > >>> I believe that increasing the following values by 10 > would benefit > >>> most FreeBSD users without disadvantage. > >>> > >>> vfs.ufs.dirhash_maxmem: 2097152 to 20971520 > >>> > >>> vfs.ufs.dirhash_reclaimage: 5 to 50 or 60 > >> vfs.ufs.dirhash_maxmem is further autotuned based on available > >> physical memory. > >> See r214359 for details. > >> > > [Spock Eyebrow of Thought] > > > > I'm running FreeBSD i386 9.2, that allows a max of 4 Gigs of RAM. > > To what value does the algorithm tune in your case? On my 16 > GB machine, it's ~~ 25 MB: > > vfs.ufs.dirhash_maxmem: 26968064 > > > I think the algorithm is still overly conservative for 32 > bit systems, > > which are more likely to be using UFS. > > > > As 64 bit platforms tend to have more RAM and use ZFS, is the same > > tuning algorithm appropriate for both? > > The policy is to use fractions of the installed RAM (though > in a roundabout way), so it should scale reasonably well to > both systems with large and small memories. > > I'll bump vfs.ufs.dirhash_reclaimage to 60, it's worth it. > > > Ivan, >From the analysis perforned in 2009, and referenced earlier by Robert, this https://wiki.freebsd.org/DirhashDynamicMemory and other material at this site, indicates that the reclaimage interval is workload dependent and that 5 to 8 seconds seems, on average, to be adequate. We perform quite a detailed analysis before changing our sysctls for customers' servers that range from 32bit machines with between 1G and 4G of memory, and 64bit with 30G of memory, incidentally all are UFS2. Is the discussion, rather than (synthetic) workload performance, sufficient to warrant changing the default settings by a factor of 12? Regards, Dewayne.