From owner-freebsd-fs@FreeBSD.ORG Sun Jan 10 17:45:02 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A6AF010656BB for ; Sun, 10 Jan 2010 17:45:02 +0000 (UTC) (envelope-from rsmith@xs4all.nl) Received: from smtp-vbr1.xs4all.nl (smtp-vbr1.xs4all.nl [194.109.24.21]) by mx1.freebsd.org (Postfix) with ESMTP id 024408FC35 for ; Sun, 10 Jan 2010 17:45:01 +0000 (UTC) Received: from slackbox.xs4all.nl (slackbox.xs4all.nl [213.84.242.160]) by smtp-vbr1.xs4all.nl (8.13.8/8.13.8) with ESMTP id o0AHVRZ3058700; Sun, 10 Jan 2010 18:31:27 +0100 (CET) (envelope-from rsmith@xs4all.nl) Received: by slackbox.xs4all.nl (Postfix, from userid 1001) id 9688ABA8E; Sun, 10 Jan 2010 18:31:27 +0100 (CET) Date: Sun, 10 Jan 2010 18:31:27 +0100 From: Roland Smith To: Dan Naumov Message-ID: <20100110173127.GA52730@slackbox.xs4all.nl> References: MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="HlL+5n6rz5pIUxbD" Content-Disposition: inline In-Reply-To: X-GPG-Fingerprint: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 X-GPG-Key: http://www.xs4all.nl/~rsmith/pubkey.txt X-GPG-Notice: If this message is not signed, don't assume I sent it! User-Agent: Mutt/1.5.20 (2009-06-14) X-Virus-Scanned: by XS4ALL Virus Scanner Cc: freebsd-fs@freebsd.org, FreeBSD-STABLE Mailing List Subject: Re: ZFS on top of GELI X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jan 2010 17:45:02 -0000 --HlL+5n6rz5pIUxbD Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jan 10, 2010 at 05:08:29PM +0200, Dan Naumov wrote: > Hello list. >=20 > I am evaluating options for my new upcoming storage system, where for > various reasons the data will be stored on 2 x 2tb SATA disk in a > mirror and has to be encrypted (a 40gb Intel SSD will be used for the > system disk). Right now I am considering the options of FreeBSD with > GELI+ZFS and Debian Linux with MDRAID and cryptofs. Has anyone here > made any benchmarks regarding how much of a performance hit is caused > by using 2 geli devices as vdevs for a ZFS mirror pool in FreeBSD (a > similar configuration is described here: > http://blog.experimentalworks.net/2008/03/setting-up-an-encrypted-zfs-wit= h-freebsd/)? > Some direct comparisons using bonnie++ or similar, showing the number > differences of "this is read/write/IOPS on top of a ZFS mirror and > this is read/write/IOPS on top of a ZFS mirror using GELI" would be > nice. >=20 > I am mostly interested in benchmarks on lower end hardware, the system > is an Atom 330 which is currently using Windows 2008 server with > TrueCrypt in a non-raid configuration and with that setup, I am > getting roughly 55mb/s reads and writes when using TrueCrypt > (nonencrypted it's around 115mb/s). Although I cannot comment on ZFS, my $HOME partition is UFS2+geli. Reads (w= ith dd) of uncached big[1] files are ~70MB/s. Reading an unchached big file fro= m a non-encrypted UFS2 partition is ~120MB/s. Note that the vfs cache has a huge influence here; Repeating the same read will be 4 =E2=80=93 7 times faster! The sysctls for ZFS chaching will probably have a big impact too. Roland [1] several 100s of MiB. --=20 R.F.Smith http://www.xs4all.nl/~rsmith/ [plain text _non-HTML_ PGP/GnuPG encrypted/signed email much appreciated] pgp: 1A2B 477F 9970 BA3C 2914 B7CE 1277 EFB0 C321 A725 (KeyID: C321A725) --HlL+5n6rz5pIUxbD Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.14 (FreeBSD) iEYEARECAAYFAktKDu8ACgkQEnfvsMMhpyWdWwCeNcyvtNzeYvJIo8ObiJMjrIfF 7GgAoKjQ80Hx8SIgL6QuB8f61Zr/KKay =et7A -----END PGP SIGNATURE----- --HlL+5n6rz5pIUxbD--