Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 5 May 2007 18:11:32 +0200
From:      Pawel Jakub Dawidek <pjd@FreeBSD.org>
To:        Kenneth Vestergaard Schmidt <kvs@pil.dk>
Cc:        freebsd-fs@freebsd.org
Subject:   Re: Sun Fire X4500, FreeBSD and ZFS
Message-ID:  <20070505161132.GB16398@garage.freebsd.pl>
In-Reply-To: <m1vef8tv15.fsf@binarysolutions.dk>
References:  <m1k5vtgczd.fsf@binarysolutions.dk> <20070503190956.GC7177@garage.freebsd.pl> <m1vef8tv15.fsf@binarysolutions.dk>

next in thread | previous in thread | raw e-mail | index | archive | help

--v9Ux+11Zm5mwPlX6
Content-Type: text/plain; charset=iso-8859-2
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Fri, May 04, 2007 at 06:26:14PM +0200, Kenneth Vestergaard Schmidt wrote:
> At the very least, we want to do some heavy testing with FreeBSD. If we
> get the time, it would be fun to contrast them to Solaris. It does
> require that I reinstall Solaris, though :)
>=20
> How would you go about tweaking the machine for maximum efficiency? We
> have around 13 GB RAM free at the moment, just sitting doing nothing,
> and that might just as well be used for caching.

There is a lot memory and quite a few silly limits in the kernel.
Currently we allocate most memory for ZFS via malloc(9), so the memory
is allocate from kmem_map. This should change in the future, but until
then, you need to adjust vm_kmem_size, etc. to make memory usable with
ZFS. You'd also want to tune vfs.zfs.arc_max and vfs.zfs.arc_min,
because current auto-tuning won't be of any good from that much RAM. I'd
start from setting vfs.zfs.arc_max to kmem_map size minus 3GB. You can
tune all of them (vfs.zfs.arc_max, vfs.zfs.arc_min, vm.kmem_size and
vm.kmem_size_max from /boot/loader.conf).
Another old limit is for maximum number of vnodes in the system. It is
only auto-tuned up to 100000, which you may want to change. I'm not sure
if you can do it from kernel config, so just change MAXVNODES_MAX define
in sys/kern/vfs_subr.c.
Be aware that most debugging options like INVARIANTS, WITNESS, etc. have
very negative impact on ZFS performance in FreeBSD.

PS. Even if you don't want to install Solaris in there, there are plenty
benchmarks on the net for Solaris/ZFS on this very machine. Would be
good to know what results do we have.

Good luck!

--=20
Pawel Jakub Dawidek                       http://www.wheel.pl
pjd@FreeBSD.org                           http://www.FreeBSD.org
FreeBSD committer                         Am I Evil? Yes, I Am!

--v9Ux+11Zm5mwPlX6
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.6 (FreeBSD)

iD8DBQFGPKy0ForvXbEpPzQRAsY7AKCmvMQaXf2VTp+V/O/wE65fG60CrQCgnKBS
M1iOGRy3vNLjmLM4hCcJeoc=
=6a5R
-----END PGP SIGNATURE-----

--v9Ux+11Zm5mwPlX6--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20070505161132.GB16398>