From owner-freebsd-fs@FreeBSD.ORG Fri Mar 4 09:17:02 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C4D68106564A for ; Fri, 4 Mar 2011 09:17:02 +0000 (UTC) (envelope-from canevet@embl.fr) Received: from emblmta1.embl.fr (emblmta1.embl.fr [193.49.43.176]) by mx1.freebsd.org (Postfix) with ESMTP id 777808FC0C for ; Fri, 4 Mar 2011 09:16:57 +0000 (UTC) X-IronPort-AV: E=Sophos;i="4.62,263,1297033200"; d="asc'?png'150?scan'150,208,150";a="1305850" Received: from unknown (HELO [172.26.15.11]) ([172.26.15.11]) by emblmta1.embl.fr with ESMTP/TLS/DHE-RSA-CAMELLIA256-SHA; 04 Mar 2011 10:16:56 +0100 From: =?ISO-8859-1?Q?Micka=EBl_Can=E9vet?= To: freebsd-fs@freebsd.org Content-Type: multipart/signed; micalg="pgp-sha1"; protocol="application/pgp-signature"; boundary="=-b+Ay8tYp1UNUFZDYauXt" Date: Fri, 04 Mar 2011 09:23:05 +0100 Message-ID: <1299226985.3391.18.camel@pc286.embl.fr> Mime-Version: 1.0 X-Mailer: Evolution 2.32.2 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: kmem_map too small with ZFS and 8.2-RELEASE X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Mar 2011 09:17:02 -0000 --=-b+Ay8tYp1UNUFZDYauXt Content-Type: multipart/mixed; boundary="=-2veXdhvUEj85EjdT/NE6" --=-2veXdhvUEj85EjdT/NE6 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello, I know there is a lot of threads about "kmem_map too small" problems on former versions of FreeBSD with ZFS, but on the wiki (http://wiki.freebsd.org/ZFSTuningGuide) it is said that "FreeBSD 7.2+ has improved kernel memory allocation strategy and no tuning may be necessary on systems with more than 2 GB of RAM." I have a 64bits machine with 16GB of RAM with FreeBSD 8.2-RELEASE and no tuning: # sysctl -a | grep -e "vm.kmem_size_max:" -e "vm.kmem_size:" -e "vfs.zfs.arc_max:" vm.kmem_size_max: 329853485875 vm.kmem_size: 16624558080 vfs.zfs.arc_max: 15550816256 This morning this server crashed with: panic: kmem_malloc(1048576): kmem_map too small: 8658309120 total allocated At that time I was doing a quite huge "zfs send | zfs recv" to another server, this is maybe the origin of the memory consumption. Does anybody knows why the kernel crashed at around 8GB allocated while vm.kmem_size and vfs.zfs.arc_max are set at around 16GB and vm.kmem_size_max is set at around 300GB (is it not a little big huge by the way ?). Should I increase this values ? Thanks a lot for your answers. Micka=C3=ABl --=-2veXdhvUEj85EjdT/NE6-- --=-b+Ay8tYp1UNUFZDYauXt Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iEYEABECAAYFAk1woWkACgkQZjBmN5Hi/YZDzgCgpzbiFO0PMm2RIwvMQZLEdM6A fsgAn3yOd3ASQ06wagVqoUWQsXz2h/fu =kQcD -----END PGP SIGNATURE----- --=-b+Ay8tYp1UNUFZDYauXt--