From owner-freebsd-fs@FreeBSD.ORG Thu Jan 21 20:43:54 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 68444106566C for ; Thu, 21 Jan 2010 20:43:54 +0000 (UTC) (envelope-from gcorcoran@rcn.com) Received: from smtp02.lnh.mail.rcn.net (smtp02.lnh.mail.rcn.net [207.172.157.102]) by mx1.freebsd.org (Postfix) with ESMTP id 1ABA88FC08 for ; Thu, 21 Jan 2010 20:43:53 +0000 (UTC) Received: from mr08.lnh.mail.rcn.net ([207.172.157.28]) by smtp02.lnh.mail.rcn.net with ESMTP; 21 Jan 2010 15:43:53 -0500 Received: from smtp01.lnh.mail.rcn.net (smtp01.lnh.mail.rcn.net [207.172.4.11]) by mr08.lnh.mail.rcn.net (MOS 3.10.7-GA) with ESMTP id LJH05590; Thu, 21 Jan 2010 15:43:50 -0500 (EST) X-Auth-ID: gcorcoran Received: from 216-164-180-100.c3-0.tlg-ubr8.atw-tlg.pa.cable.rcn.com (HELO [10.56.78.161]) ([216.164.180.100]) by smtp01.lnh.mail.rcn.net with ESMTP; 21 Jan 2010 15:43:47 -0500 Message-ID: <4B58BD2D.30803@rcn.com> Date: Thu, 21 Jan 2010 15:46:37 -0500 From: Gary Corcoran User-Agent: Thunderbird 2.0.0.23 (Windows/20090812) MIME-Version: 1.0 To: Adam McDougall References: <4B58976E.1020402@polands.org> <4B58A069.8000802@egr.msu.edu> In-Reply-To: <4B58A069.8000802@egr.msu.edu> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Junkmail-Whitelist: YES (by domain whitelist at mr08.lnh.mail.rcn.net) Cc: freebsd-fs@freebsd.org Subject: Re: Repeatable ZFS "kmem map too small" panic on 8.0-STABLE X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jan 2010 20:43:54 -0000 Adam McDougall wrote: > Put this in /boot/loader.conf: > vm.kmem_size="20G" > > It is intentionally higher than your amount of ram. Would you mind explaining... 1) why this fixes the kmem_map too small problem ? 2) why it should be larger than the amount of RAM, and by how much ? Thanks, Gary > On 01/21/10 13:05, Doug Poland wrote: >> Hello, >> >> I've got an 8.0-STABLE (amd64) box with 4GB RAM. The machine is running >> off a 6-disk RAIDZ1 booting from GPT. The box consistently panics on >> unixbench's fsdisk program. >> >> I have been gathering some metrics in an attempt to isolate the >> parameters that are significant, but I admit I do not really understand >> all the relationships. At this point, I have nothing set in >> /boot/loader.conf >> >> Here are some of the values I was recording within seconds of the panic: >> >> # dmesg | grep memory >> real memory = 4294967296 (4096 MB) >> avail memory = 3961372672 (3777 MB) >> >> kstat.zfs.misc.arcstats.size: 308522248 >> vfs.zfs.arc_max: 829480960 >> vfs.zfs.arc_meta_limit: 207370240 >> vfs.zfs.arc_meta_used: 165575944 >> vfs.zfs.arc_min: 103685120 >> vm.kmem_size: 1327169536 >> vm.kmem_size_max: 329853485875 >> >> # vmstat -m | egrep 'InUse|solaris' >> Type InUse MemUse HighUse >> solaris 491349 1316172K - >> >> % zpool status >> pool: bethesda >> state: ONLINE >> scrub: none requested >> config: >> >> NAME STATE READ WRITE CKSUM >> bethesda ONLINE 0 0 0 >> raidz1 ONLINE 0 0 0 >> gpt/disk0 ONLINE 0 0 0 >> gpt/disk1 ONLINE 0 0 0 >> gpt/disk2 ONLINE 0 0 0 >> gpt/disk3 ONLINE 0 0 0 >> gpt/disk4 ONLINE 0 0 0 >> gpt/disk5 ONLINE 0 0 0 >> >> errors: No known data errors >> >> My concern is if I can panic the box with a simple file system >> benchmark, what will happen when I rysnc files across a 1GB LAN >> connection? I am very willing to run any number of tests and tweek ZFS >> as necessary. Please advise. >>