From owner-freebsd-geom@FreeBSD.ORG Thu May 21 17:33:43 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0E7F61065676 for ; Thu, 21 May 2009 17:33:43 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 8CB2F8FC1C for ; Thu, 21 May 2009 17:33:42 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1M7C9D-0003Hg-RK for freebsd-geom@freebsd.org; Thu, 21 May 2009 17:33:39 +0000 Received: from 93-138-127-129.adsl.net.t-com.hr ([93.138.127.129]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 21 May 2009 17:33:39 +0000 Received: from ivoras by 93-138-127-129.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 21 May 2009 17:33:39 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Thu, 21 May 2009 19:33:15 +0200 Lines: 73 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig32B150921B8278834934ECCB" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 93-138-127-129.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.21 (Windows/20090302) In-Reply-To: X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: gjournal+gstripe+gmirror question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2009 17:33:43 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig32B150921B8278834934ECCB Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Alexei Troussov wrote: > Hello All, >=20 > I decided to build multi-terabyte data storage (file server) using 4 x > 1Tb disks. No special raid controller is used, FreeBSD 7.1 is running o= n > another disk, so the disk array is going to be used for file storage on= ly. > So, I tried several combinations of gmirror/gstripe and put gjournal on= it: >=20 > 1) two mirrors and stripe on them This is RAID 10 > 2) two stripes and mirror on them This is RAID 01. It is slightly worse because if one drive fails, no other drive must be allowed to fail. In the RAID10 case, each drive from the mirrored sets can fail. > Both configurations gave excellent I/O speed (around 100Mb/sec), and I You should get better - the total performance should be near or even slightly above 2-drive striped (RAID-0) configuration. Modern drives have sequential performance between 60 MB/s and 80 MB/s so you should be getting between 120 MB/s and 160 MB/s. > chose the first one as it needs less time to resync disks when one of > the mirrors fails. To make picture more complete, I didn't try graid3 > because it seems to load CPU more than configs above, which is not good= > for my barebone :) Correct. > Now when my top-level gstripe gets "gjournal"-ed, I see relatively poor= > write speed around 20-30 Mb/sec. > As far as I understand from man gjournal and some posts here, > performance usually drops about 40-50%, but what I have is much worse..= =2E >=20 > Are there a better way to configure/tune the whole thing? > Thanks in advance! >=20 > PS Here is my current playground config: > Stripesize: 131072 Try a stripe size of 16 kB. --------------enig32B150921B8278834934ECCB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkoVkGIACgkQldnAQVacBcgBoACg16Xn+MqSpMh0+bbw3CFwseMv wRwAn1Wgd5dB6R+ILxwLtbDtk30rhWPW =EVfG -----END PGP SIGNATURE----- --------------enig32B150921B8278834934ECCB--