From owner-freebsd-current@FreeBSD.ORG Mon Oct 15 08:42:17 2007 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 5448616A419; Mon, 15 Oct 2007 08:42:17 +0000 (UTC) (envelope-from henrik@brixandersen.dk) Received: from solow.pil.dk (relay.pil.dk [195.41.47.164]) by mx1.freebsd.org (Postfix) with ESMTP id 12C9C13C46B; Mon, 15 Oct 2007 08:42:17 +0000 (UTC) (envelope-from henrik@brixandersen.dk) Received: from tirith.brixandersen.dk (osgiliath.brixandersen.dk [87.53.223.189]) by solow.pil.dk (Postfix) with ESMTP id 7662B1CC0F9; Mon, 15 Oct 2007 10:26:30 +0200 (CEST) Received: by tirith.brixandersen.dk (Postfix, from userid 1001) id AA35517036; Mon, 15 Oct 2007 10:26:29 +0200 (CEST) Date: Mon, 15 Oct 2007 10:26:29 +0200 From: Henrik Brix Andersen To: Claus Guttesen Message-ID: <20071015082629.GB1290@tirith.brixandersen.dk> Mail-Followup-To: Claus Guttesen , Pawel Jakub Dawidek , freebsd-fs@freebsd.org, freebsd-current@freebsd.org References: <20071005000046.GC92272@garage.freebsd.pl> <20071008121523.GM2327@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="d6Gm4EdcadzBjdND" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.brixandersen.dk/files/HenrikBrixAndersen.asc User-Agent: Mutt/1.5.16 (2007-06-09) Cc: freebsd-fs@freebsd.org, freebsd-current@freebsd.org, Pawel Jakub Dawidek Subject: Re: ZFS kmem_map too small. X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Oct 2007 08:42:17 -0000 --d6Gm4EdcadzBjdND Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Oct 08, 2007 at 07:18:10PM +0200, Claus Guttesen wrote: > > I was able to reproduce the panic by rsyncing big files and trying > > bonnie++ test suggested in this thread. > > > > Can you guys retry with this patch: > > > > http://people.freebsd.org/~pjd/patches/vm_kern.c.2.patch > > > > It's a hack, yes, but allows to mitigate the problem quite well. I'm > > looking for a solution that can be used for 7.0 before we find a better > > fix. >=20 > Congrats Pawel! You made my server survive my rsync of 90 GB. :-) >=20 > This is on same src as the one that required a reboot except for your > patch. So this fix does 'alleviate kmem_map too small' in my case. While we have come across the 'kmem_map too small' panics in the past, these are now solved - but our rsync processes still hang at random, just spinning the CPU. This is when running multiple rsyncs to the same zpool: http://www.brixandersen.dk/tmp/zfs-rsync-debug.1.txt This is reproduceable (but only after running an intensive set of rsync processes for ~10-12 hours or so) on our i386 RELENG_7 box with the above mentioned patch, 4GB RAM, KVA_PAGES=3D512 and the following settings in loader.conf: vfs.zfs.prefetch_disable=3D"1" vfs.zfs.zil_disable=3D"1" vfs.zfs.arc_max=3D"209715200" vm.kmem_size=3D"1258291200" vm.kmem_size_max=3D"1258291200" Regards, Brix --=20 Henrik Brix Andersen --d6Gm4EdcadzBjdND Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.7 (FreeBSD) Comment: GnuPG signed iD8DBQFHEyQ0v+Q4flTiePgRAidfAJ9wrMlBNTAZTdFHju8ycTDLO3j9oQCgojS1 +A03Kj/qCExUv6TZ8AM0xsA= =KyZg -----END PGP SIGNATURE----- --d6Gm4EdcadzBjdND--