Date: Fri, 11 Jun 2010 16:12:50 +0200 From: Florian Smeets <flo@smeets.im> To: Yoshiaki Kasahara <kasahara@nc.kyushu-u.ac.jp> Cc: freebsd-stable@freebsd.org Subject: Re: Freebsd 8.0 kmem map too small Message-ID: <4C124462.30408@smeets.im> In-Reply-To: <20100608.181146.1224841629154014733.kasahara@nc.kyushu-u.ac.jp> References: <4BE110E3.8040902@zirakzigil.org> <q2vb269bc571005050819nde819098vfd3306170639a9c9@mail.gmail.com> <4BE82C5D.1080806@bit0.com> <20100608.181146.1224841629154014733.kasahara@nc.kyushu-u.ac.jp>
next in thread | previous in thread | raw e-mail | index | archive | help
On 6/8/10 11:11 AM, Yoshiaki Kasahara wrote: > Hello, > > I'd like to add another instance of similar problems. I recently > updated my FreeBSD amd64 box with ZFS root and 8GB RAM from 8-STABLE > (as of Mar 1st) to 8.1-PRERELEASE (as of May 27th). After that, my > box started to crash every couple of days due to kmem_map too small. > > Here is a (last week) screenshot of Munin graph about the memory usage > of the box: > > http://eron.info/munin-memory.png > > In "by month" graph, a white gap at the end of "Week 20" is the update > period from 8-STABLE to 8.1-PRERELEASE I mentioned above. Before the > upgrade, the system was rock solid without any kmem tuning in > loader.conf (vm.kmem_size was around 2.7GB IIRC). > > After the update, I could see that more wired memory was assigned, and > then steep drop (crash) occured. > > "by day" graph shows my experiment to bump vm.kmem_size=12G > (recommended somewhere in this thread) and explicitly limit > vfs.zfs.arc_max=2G. I was surprised because the wired memory quickly > increased over 5GB... > > Then I noticed that the default value of vfs.zfs.zio.use_uma was 1 on > amd64, so I turned it off and removed other memory tunings (kmem_size > and arc_max) in loader.conf on Tuesday at 16:00 and rebooted. It > seems that the usage of wired memory was stablized and no crash since > then with the default kmem_size and arc_max. > > Does anyone have any idea about this behavior? > > My wild guess is that ZFS/UMA code is not stable on amd64 too, and it > should be turned off by default for 8.1-RELEASE maybe.... > I can confirm this. I just upgraded a system from late January to yesterdays 8-STABLE. I had to set vfs.zfs.zio.use_uma="0", to get the system survive buildworld again. This is amd64 with only 1GB, (i know this is considered not enough for ZFS) with the kernel from January it was stable without any tuning. After disabling ZFSs UMA usage, it seems to be working fine again. Just another data point. Cheers, Florian
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4C124462.30408>