From owner-freebsd-stable@FreeBSD.ORG Fri Nov 20 10:38:30 2009 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 732CE1065672 for ; Fri, 20 Nov 2009 10:38:30 +0000 (UTC) (envelope-from se@freebsd.org) Received: from smtp146.mail.ukl.yahoo.com (smtp146.mail.ukl.yahoo.com [77.238.184.77]) by mx1.freebsd.org (Postfix) with SMTP id DE4358FC28 for ; Fri, 20 Nov 2009 10:38:29 +0000 (UTC) Received: (qmail 36646 invoked from network); 20 Nov 2009 10:10:27 -0000 Received: from xdsl-81-173-147-63.netcologne.de (se@81.173.147.63 with plain) by smtp146.mail.ukl.yahoo.com with SMTP; 20 Nov 2009 10:10:27 +0000 GMT X-Yahoo-SMTP: iDf2N9.swBDAhYEh7VHfpgq0lnq. X-YMail-OSG: 75ukFPoVM1nIg2A9QE4iFS7Vo1Nl7Lp7XWbbh6ilizVxkXSdwBxAORfPv16IyGMrdV_L6.fg5CyD7RT1MowmIrPq6RW44HNI2xjtnFCgc9WTQKZXoK.1_guBmkt09MV6MSp2ZbPm1vW7bHAv5MvDtle4w.mIpDQDKYSqf.VPIhWoEix19b.E4rf6x6ioBnWX4ZqEvLLVEP0To9EeCwzV7lOLqoO.RloKIqwBINb3TrIyusFviVPDLiGHkHkawzDR X-Yahoo-Newman-Property: ymail-3 Message-ID: <4B066B13.1070006@freebsd.org> Date: Fri, 20 Nov 2009 11:10:27 +0100 From: Stefan Esser User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; de; rv:1.9.1.4pre) Gecko/20090915 Lightning/1.0pre Thunderbird/3.0b4 MIME-Version: 1.0 To: Randy Bush References: In-Reply-To: X-Enigmail-Version: 0.97b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Cc: FreeBSD-STABLE Mailing List Subject: Re: 7.2 dies in midnight run again X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Nov 2009 10:38:30 -0000 Am 20.11.2009 01:45, schrieb Randy Bush: > i think the issue is how to tune for zfs > > i386 with 4G of RAM > > RELENG_7 cvsupped Nov 18 02:42 GMT > > panic: kmem_malloc(65536): kmem_map too small: 535019520 total allocated > cpuid = 0 > Uptime: 13h15m1s > Physical memory: 3958 MB > Dumping 637 MB: 622 606 590 574 558 542 526 510 494 478 462 446 430 414 398 382 366 350 334 318 302 286 270 254 238 222 206 190 174 158 142 126 110 94 78 62 46 30 14 > Dump complete > Automatic reboot in 15 seconds - press a key on the console to abort > > and it did not auto reboot > > # cat /boot/loader.conf.local > ipfw_load=YES > umass_load=YES > zfs_load=YES > vm.kmem_size=536870912 > vm.kmem_size_max=1073741824 > vfs.zfs.prefetch_disable=1 I'm using 8.0-i386 (but AFAIK with same ZFS and allocation behaviour) on a system with 2GB RAM and a RAIDZ1 consisting of 3*1TB (plus separate 10GB L2ARC cache on a separate disk, to become a SSD). Besides increasing KVA_PAGES to cover some 2GB (options KVA_PAGES=512), I use: vm.kmem_size=1500M vm.kmem_size_max=2G This is the result of quite some tuning, since I also suffered from kmem_map too small panics under high load. BTW: I use auto-tuning of the ARC cache size: vfs.zfs.arc_min: 122880000 vfs.zfs.arc_max: 983040000 Due to the extra ZFS cache drive, I could reduce arc_max to some 300MB (or even lower, Though I did not test lower values, yet), without noticeable impact (faster than with just a 700MB RAM cache in many tests). And since L2ARC caches can be removed from pools at any time and do not need redundancy, it is quite simple to test the effect ... Regards, STefan