Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 30 Sep 2015 14:03:47 +0200
From:      Marc UBM <ubm.freebsd@googlemail.com>
To:        freebsd-fs@freebsd.org
Subject:   Re: Cannot replace broken hard drive with LSI HBA
Message-ID:  <20150930140347.fcc10439bd1b1c9bee87d560@gmail.com>
In-Reply-To: <1443613432.5271.100.camel@data-b104.adm.slu.se>
References:  <1443447383.5271.66.camel@data-b104.adm.slu.se> <5609578E.1050606@physics.umn.edu> <560A4640.3030200@internetx.com> <560A9461.8090300@physics.umn.edu> <560A977C.1070102@internetx.com> <560AD2B9.5040706@fuckner.net> <CAOjFWZ69Jw6D1Mo5GyZvHfpTaHW7Dg1-z=LNZ_1PN_YAhy3jrA@mail.gmail.com> <CAFHbX1%2BdZRyJUMa6nuC8S0NspocAfpRrfWC=ZHW6WeExt_j=qA@mail.gmail.com> <1443613432.5271.100.camel@data-b104.adm.slu.se>

next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, 30 Sep 2015 11:43:52 +0000
Karli Sj=F6berg <karli.sjoberg@slu.se> wrote:

> ons 2015-09-30 klockan 12:39 +0100 skrev Tom Evans via freebsd-fs:
> > On Tue, Sep 29, 2015 at 7:25 PM, Freddie Cash <fjwcash@gmail.com> wrote:
> > > On Tue, Sep 29, 2015 at 11:04 AM, Michael Fuckner <michael@fuckner.ne=
t>
> > > wrote:
> > >
> > >> On 9/29/2015 3:51 PM, InterNetX - Juergen Gotteswinter wrote:
> > >>
> > >>>  From my Experience using SATA Disks on SAS Controllers, no matter =
if
> > >>> theres an Expander between or not or mixed, those Setups keep on be=
eing
> > >>> flakey / unreliable. I might work under certain conditions, but its
> > >>> nothing you can bet on.
> > >>>
> > >>> Garret Damore (Illumos Project) describes the problem more detailed=
 here
> > >>>
> > >>> http://garrett.damore.org/2010/08/why-sas-sata-is-not-such-great-id=
ea.html
> > >>>
> > >>>
> > >> come on, the article is 5 years old, some things changed since then!
> > >>
> > >> - MUX Boards are unreliable and expensive- long time since I last saw
> > >> those boards
> > >> - SAS Disks are not just 10/15k high performance Disks anymore, most
> > >> Nearline Disks are available with native SAS interface as well
> > >> - if you pick the right disk there is no trouble using SATA Disks on=
 SAS
> > >> Expanders or SAS Controllers (they should have R/V sensors, optimized
> > >> FW...).
> > >> - if you use desktop drives in a shelf with lets say 24 slots you sh=
ould
> > >> not expect it to work ;-)
> > >>
> > >
> > > Why not?  ;)
> > >
> > > We use desktop-class drives in our backups storage servers without any
> > > issues.  Even the monster boxes with 90 drives in them (2 JBODs of 45
> > > drives each) run without issues using desktop-class drives.
> > >
> > > We're using a mix of WD Black (1, 2, 4 TB), Toshiba (2 TB), and Seaga=
te (1,
> > > 2 TB).
> > >
> > > 2 systems using 24 drive bays.  2 systems using 90 drive bays.  Plugg=
ed
> > > into SuperMicro SAS expanders and LSI 9211-8i or 9211-8e (I think tha=
t's
> > > the model number) controllers.  All SAS2008 chipsets using mps(4) dri=
vers.
> > >
> >=20
> > Just a me too. This is just for my own personal storage (so everything
> > is second hand from ebay), but I use LSI SAS2008 [1], which is mps(4),
> > with a couple of Rackable SE3016 16 bay enclosures, using around 20 of
> > the cheapest SATA drives[2] I could afford at the time. I've never had
> > any problems with it, my party trick[3] is to pull and swap drive
> > locations, it does a full scrub every other weekend, and I've replaced
> > several drives that have died and resilvered with no complications.
> >=20
> > Of course, I don't put that much stress on the hardware, so I'm aware
> > that problems may not be occurring for me because of that. Perhaps
> > I've just been lucky so far, but they are easily the best $300 I've
> > spent on ebay.
> >=20
> > No SSDs however, they are all directly attached to motherboard SATA con=
trollers.
> >=20
> > Cheers
> >=20
> > Tom
> >=20
> > [1] With firmware 15, in IT mode - I know, I should update..
> > [2] Currently a mix of "SAMSUNG HD154UI 1118", "TOSHIBA DT01ABA3 ABB0"
> > and "WDC WD30EZRX-00M 0A80". Yep, super-cheap consumer desktop hard
> > drives.
> > [3] Yes, they are quite dull parties.
> > _______________________________________________
> > freebsd-fs@freebsd.org mailing list
> > https://lists.freebsd.org/mailman/listinfo/freebsd-fs
> > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"
>=20
>=20
> Which version FreeBSD is it running?

Just a "me too" here, running a mix of 16 consumer-/servergrade
SATA-drives (WD and Samsung) on a LSI SAS2116 (mps, flashed with
IT firmware (JBOD)). Drives are connected with a SAS-4x SATA cable (1m
length).
I've been running regular scrubs and encountered no problems at all so
far - the system is used as a file server with low usage though.
FreeBSD version is 10.1-BETA1.

Bye
Marc=20



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20150930140347.fcc10439bd1b1c9bee87d560>