Date: Mon, 06 Feb 2012 20:52:00 +0100 From: Erik Stian Tefre <erik@tefre.com> To: freebsd-fs@freebsd.org Subject: Re: HPC and zfs. Message-ID: <4F302F60.3010302@tefre.com> In-Reply-To: <AB8B3E3A-1161-4855-B418-B37E16D0EC52@gmail.com> References: <4F2FF72B.6000509@pean.org> <20120206162206.GA541@icarus.home.lan> <AB8B3E3A-1161-4855-B418-B37E16D0EC52@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 02/06/2012 05:49 PM, Michael Aronsen wrote: >> - How you plan on getting roughly 410 hard disks (or 422 assuming >> an additional 12 SSDs) hooked up to a single machine > > Use LSI SAS92XX 4 (x4) port external controllers, and SuperMicro SC847E26-RJBOD1 disk shelves. > Each disk shelf needs 2 ports on the LSI controller, which means you get 90 disks per LSI card. > The DL580/585's have 11 PCIe slots, so you'd end up with 990 disks per server using this setup. The backplanes/expanders in the SC847E16-RJBOD1 (E16 = SATA/single expander version, E26 = SAS/dual expander version) can be daisy chained if you want to lower the number of controllers/ports. I have no E26 to test on but I guess it may support daisy chaining too. The LSI 9205-8e controller claims to support 1024 devices being connected to its two 4x6gb ports. Does anyone happen to know many daisy chain jumps are supported by SAS? Would it be possible to daisy chain 10 shelves with 450 drives onto 1 of those controllers? That would require 10 jumps on two chains or 20 jumps on one chain... (Yes, 6000*8/450 = 107 Mbit per drive, but ignore that part. ;) -- Erik
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4F302F60.3010302>