From owner-freebsd-stable@FreeBSD.ORG Tue Sep 28 13:46:34 2010 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 04837106566C; Tue, 28 Sep 2010 13:46:34 +0000 (UTC) (envelope-from avg@icyb.net.ua) Received: from citadel.icyb.net.ua (citadel.icyb.net.ua [212.40.38.140]) by mx1.freebsd.org (Postfix) with ESMTP id 10D8B8FC08; Tue, 28 Sep 2010 13:46:32 +0000 (UTC) Received: from odyssey.starpoint.kiev.ua (alpha-e.starpoint.kiev.ua [212.40.38.101]) by citadel.icyb.net.ua (8.8.8p3/ICyb-2.3exp) with ESMTP id QAA04711; Tue, 28 Sep 2010 16:46:29 +0300 (EEST) (envelope-from avg@icyb.net.ua) Message-ID: <4CA1F1B4.1020700@icyb.net.ua> Date: Tue, 28 Sep 2010 16:46:28 +0300 From: Andriy Gapon User-Agent: Mozilla/5.0 (X11; U; FreeBSD amd64; en-US; rv:1.9.2.9) Gecko/20100920 Lightning/1.0b2 Thunderbird/3.1.4 MIME-Version: 1.0 To: Willem Jan Withagen References: <4CA1D06C.9050305@digiware.nl> <20100928115047.GA62142@icarus.home.lan> <4CA1ECCC.4070801@digiware.nl> In-Reply-To: <4CA1ECCC.4070801@digiware.nl> X-Enigmail-Version: 1.1.2 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: stable@freebsd.org, fs@freebsd.org, Jeremy Chadwick Subject: Re: Still getting kmem exhausted panic X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 Sep 2010 13:46:34 -0000 on 28/09/2010 16:25 Willem Jan Withagen said the following: > Well advises seem to vary, and the latest I understood was that > 8.1-stable did not need any tuning. (The other system with a much older > kernel is tuned as to what most here are suggesting) > And I was shure led to believe that even since 8.0 panics were no longer > among us...... Well, now you have demonstrated yourself that it is not always so. >> vm.kmem_size >> vfs.zfs.arc_max > > real memory = 12889096192 (12292 MB) > avail memory = 12408684544 (11833 MB) > > So that prompts vm.kmem_size=18G. > > Form the other post: >> As to arc_max/arc_min, set them based your needs according to general >> ZFS recommendations. > > I'm seriously at a loss what general recommendations would be. Have you asked Mr. Google? :) - http://www.solarisinternals.com/wiki/index.php/ZFS_Best_Practices_Guide Search for "Memory and Dynamic Reconfiguration Recommendation" - http://www.solarisinternals.com/wiki/index.php/ZFS_Evil_Tuning_Guide#Limiting_the_ARC_Cache Short version - decide how much memory you need for everything else but ZFS ARC. If autotuned value suits you, then you don't need to change anything. > The other box has 8G > loader.conf: > vm.kmem_size="14G" # 2* phys RAM size for ZFS perf. > vm.kmem_size_scale="1" No need to set both of the above. vm.kmem_size overrides vm.kmem_size_scale. > vfs.zfs.arc_min="1G" > vfs.zfs.arc_max="6G" > > So I'd select something like 11G for arc_max on a box with 12G mem. -- Andriy Gapon