From owner-freebsd-fs@FreeBSD.ORG Sat May 5 19:39:53 2007 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id D723C16A401 for ; Sat, 5 May 2007 19:39:53 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 2D5FB13C457 for ; Sat, 5 May 2007 19:39:42 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id F2EF545CD9; Sat, 5 May 2007 18:12:08 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id A66FF45684; Sat, 5 May 2007 18:12:02 +0200 (CEST) Date: Sat, 5 May 2007 18:11:32 +0200 From: Pawel Jakub Dawidek To: Kenneth Vestergaard Schmidt Message-ID: <20070505161132.GB16398@garage.freebsd.pl> References: <20070503190956.GC7177@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="v9Ux+11Zm5mwPlX6" Content-Disposition: inline In-Reply-To: X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-fs@freebsd.org Subject: Re: Sun Fire X4500, FreeBSD and ZFS X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 05 May 2007 19:39:53 -0000 --v9Ux+11Zm5mwPlX6 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, May 04, 2007 at 06:26:14PM +0200, Kenneth Vestergaard Schmidt wrote: > At the very least, we want to do some heavy testing with FreeBSD. If we > get the time, it would be fun to contrast them to Solaris. It does > require that I reinstall Solaris, though :) >=20 > How would you go about tweaking the machine for maximum efficiency? We > have around 13 GB RAM free at the moment, just sitting doing nothing, > and that might just as well be used for caching. There is a lot memory and quite a few silly limits in the kernel. Currently we allocate most memory for ZFS via malloc(9), so the memory is allocate from kmem_map. This should change in the future, but until then, you need to adjust vm_kmem_size, etc. to make memory usable with ZFS. You'd also want to tune vfs.zfs.arc_max and vfs.zfs.arc_min, because current auto-tuning won't be of any good from that much RAM. I'd start from setting vfs.zfs.arc_max to kmem_map size minus 3GB. You can tune all of them (vfs.zfs.arc_max, vfs.zfs.arc_min, vm.kmem_size and vm.kmem_size_max from /boot/loader.conf). Another old limit is for maximum number of vnodes in the system. It is only auto-tuned up to 100000, which you may want to change. I'm not sure if you can do it from kernel config, so just change MAXVNODES_MAX define in sys/kern/vfs_subr.c. Be aware that most debugging options like INVARIANTS, WITNESS, etc. have very negative impact on ZFS performance in FreeBSD. PS. Even if you don't want to install Solaris in there, there are plenty benchmarks on the net for Solaris/ZFS on this very machine. Would be good to know what results do we have. Good luck! --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --v9Ux+11Zm5mwPlX6 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGPKy0ForvXbEpPzQRAsY7AKCmvMQaXf2VTp+V/O/wE65fG60CrQCgnKBS M1iOGRy3vNLjmLM4hCcJeoc= =6a5R -----END PGP SIGNATURE----- --v9Ux+11Zm5mwPlX6--