Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 31 May 2012 11:39:04 -0700 (PDT)
From:      Dennis Glatting <dg@pki2.com>
To:        Kaya Saman <kayasaman@gmail.com>
Cc:        freebsd-questions@freebsd.org, Oscar Hodgson <oscar.hodgson@gmail.com>
Subject:   Re: Anyone using freebsd ZFS for large storage servers?
Message-ID:  <alpine.BSF.2.00.1205311130070.48219@btw.pki2.com>
In-Reply-To: <CAPj0R5LiVorSRxzOUGN9T8Yeu33dy6o_SkO=WR%2Bbqy9qNAfBUg@mail.gmail.com>
References:  <CACxnZKM__Lt9LMabyUC_HOCg2zsMT=3bpqwVrGj16py1A=qffg@mail.gmail.com> <CAPj0R5LwBkQbRvV_1MWbkNwEHOL=zCqXQt1o0pKbyipJmBUbig@mail.gmail.com> <CACxnZKOJHeQH3=T4X3Jd-F3hrgOrirrgypG5HbdfhtFhkcaFzA@mail.gmail.com> <CAPj0R5LiVorSRxzOUGN9T8Yeu33dy6o_SkO=WR%2Bbqy9qNAfBUg@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
  This message is in MIME format.  The first part should be readable text,
  while the remaining parts are likely unreadable without MIME-aware tools.

--3463506553-125945988-1338489544=:48219
Content-Type: TEXT/PLAIN; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 8BIT



On Thu, 31 May 2012, Kaya Saman wrote:

> On Thu, May 31, 2012 at 5:05 PM, Oscar Hodgson <oscar.hodgson@gmail.com> wrote:
>> That helps.  Thank you.
>>
>> This is an academic departmental instructional / research environment.
>>  We had a great relationship with Sun, they provided great
>> opportunities to put Solaris in front of students.  Oracle, not so
>> much, and the Oracle single-tier support model simply isn't affordable
>> for this "business" (there's no ROI at the departmental level <g>).
>> Solaris is not a viable option.
>
> We found Oracle to be the cheapest out of all the solutions we looked
> at: Netapp, MSI, et el.....
>
>>
>> FreeBSD looks like the next best available option at the moment,
>> particularly considering the use of the storage heads as compute
>> machines.  OpenIndiana shows promise.  Nexenta has a great product,
>> but the user community expects more flexibility in software options.
>
> FreeBSD is better then Linux in my opinion though lacking some
> software and multimedia functionality that Linux has and not for the
> Desktop as it's not as "bleeding edge" as say Fedora 16, however, if
> FreeBSD offered Gnome3 and supported my wireless NIC I'd be all over
> it like a "bad rash" :-)
>
>>
>> Is there anything like a list of "supported" (known good) SAS HBA's?
>
> LSI HBA's are really good!
>
> For my DIY solution at home I used a SuperMicro system board with
> non-RAID LSI HBA.......
>

Similarly:

mc => Tyan S8812WGM3NR
iirc => Supermicro H8DGi
bd3 => Soon another Supermicro H8DGi

Others are consumer boards from Gigabyte (preferred).

I also have a small collection of Supermicro AOC-USAS2-L8i boards. 
Generally, I have had no trouble but ESXi 5.0 hated them.

For work I looked at two Supermicro 848A chassis with a H8QGL board and 20 
3TB disks for two different projects, but they lie in limbo.


> It is a similar solution that we will use for our test NAS at work
> though we already have a Dell R700 series server. For this setup
> however I will need to use an LSI HBA with both internal and external
> Mini-SAS ports.
>
> Instead of Promise we will use NetStor JBOD solutions as they work
> with 6Gbps drives and overall give better performance.
>
>>
>> Oscar
>
> Regards,
>
>
> Kaya
>
>>
>> On Thu, May 31, 2012 at 11:38 AM, Kaya Saman <kayasaman@gmail.com> wrote:
>>> If this is any consellation I run a 36TB cluster using a self built
>>> server with a Promise DAS (VessJBOD 1840) using ZFS at home! to
>>> support my OpenSource projects and personal files.
>>>
>>> As for OS take your pick: NexentaStor, FreeBSD, Solaris 11
>>>
>>>
>>> All capable, of course Solaris has latest version of ZFS but still.....
>>>
>>>
>>> At work we're looking into getting a StorEdge appliance wich will
>>> handle up to 140+ TB.
>>>
>>>
>>> I am also in charge of redesigning one of our virtual SAN's to a
>>> FreeBSD ZFS storage system which will run.... well how many JBOD's can
>>> you fit on the system?? Probably round ~100TB or so.....
>>>
>>>
>>> Regards,
>>>
>>>
>>> Kaya
>>>
>>>
>>> On Thu, May 31, 2012 at 4:32 PM, Oscar Hodgson <oscar.hodgson@gmail.com> wrote:
>>>> The subject is pretty much the question.  Perhaps there's a better
>>>> place to be asking this question ...
>>>>
>>>> We have (very briefly) discussed the possibility of using FreeBSD
>>>> pizza boxes as a storage heads direct attached to external JBOD arrays
>>>> with ZFS.  In perusing the list, I haven't stumbled across indications
>>>> of people actually doing this.  External JBODs would be running 24 to
>>>> 48TB each, roughly.  There would be a couple of units.  The pizza
>>>> boxes would be used for computational tasks, and nominally would have
>>>> 8 cores and 96G+ RAM.
>>>>
>>>> Obvious questions are hardware compatibility and stability.  I've set
>>>> up small FreeBSD 9 machines with ZFS roots and simple mirrors for
>>>> other tasks here, and those have been successful so far.
>>>>
>>>> Observations would be appreciated.
>>>>
>>>> Oscar.
>>>> _______________________________________________
>>>> freebsd-questions@freebsd.org mailing list
>>>> http://lists.freebsd.org/mailman/listinfo/freebsd-questions
>>>> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"
> _______________________________________________
> freebsd-questions@freebsd.org mailing list
> http://lists.freebsd.org/mailman/listinfo/freebsd-questions
> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org"
>
>
--3463506553-125945988-1338489544=:48219--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?alpine.BSF.2.00.1205311130070.48219>