Date: Mon, 19 Sep 2011 19:40:13 +1000 From: Peter Jeremy <peterjeremy@acm.org> To: Jason Usher <jusher71@yahoo.com> Cc: "freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org> Subject: Re: ZFS obn FreeBSD hardware model for 48 or 96 sata3 paths... Message-ID: <20110919094013.GA7771@server.vk2pj.dyndns.org> In-Reply-To: <1316222526.31565.YahooMailNeo@web121205.mail.ne1.yahoo.com> References: <1316222526.31565.YahooMailNeo@web121205.mail.ne1.yahoo.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--5vNYLRcllDrimb99 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2011-Sep-16 18:22:06 -0700, Jason Usher <jusher71@yahoo.com> wrote: >1) immediately support 48 internal sata3 drives at full bandwidth - >every drive has independent path to CPU This would seem to be overkill - no current HDD can saturate a SATA3 channel. And I suspect you will run into DRAM bandwidth issues well before you saturate 48 SATA3 channels. >Next, I see a lot of implementations done with LSI adaptors - is this >as simple as choosing (3) LSI SAS 9201-16i for the 48 internal drives >and (3) LSI SAS 9201-16e for the external drives ? I can't comment on driver support but I'd start by checking for motherboards that have 6 PCIe x16 slots with all lanes available. >I would also like to spec and use a ZIL+L2ARC and am not sure where >to go ... the system will be VERY write-biased and use a LOT of >inodes - so lots of scanning of large dirs with lots of inodes and >writing data.=A0 Something like 400 million inodes on a filesystem with >an average file size of 150 KB. ZIL will only be useful if you do lots of sync writes. L2ARC won't help write performance. Heavy write load implies you want mirroring rather than RAIDZ and mirroring 60TB with 48 spindles means 3TB disks. >- can I just skip the l2arc and just add more RAM ? Definitely - I'd be looking at around 200GB RAM - and you might need to tweak the ZFS (particularly) ARC parameters to suit the workload. >- provided I maintain the free pcie slot(s) and/or free 2.5" drive >slots, can I always just add a ZIL after the fact ? Yes. --=20 Peter Jeremy --5vNYLRcllDrimb99 Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (FreeBSD) iEYEARECAAYFAk53Df0ACgkQ/opHv/APuIfD9ACfaW5bN9fubqYkKq2l7RsOyZNj nIAAn2DtKwqYkMczTrZ+m7zS8m59amzU =jJBv -----END PGP SIGNATURE----- --5vNYLRcllDrimb99--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20110919094013.GA7771>