Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 18 Jun 2022 10:54:12 +0200
From:      Michael Gmelin <grembo@freebsd.org>
To:        Larry Rosenman <ler@lerctr.org>
Cc:        Alexander Motin <mav@freebsd.org>, Freebsd current <freebsd-current@freebsd.org>
Subject:   Re: SAS/SATA controllers: 8 port that support 8TB Drives
Message-ID:  <F44C5611-5147-42B4-BBE5-403DCBB5157C@freebsd.org>
In-Reply-To: <5936c6368df3c7d762d4710d23e7c57c@lerctr.org>
References:  <5936c6368df3c7d762d4710d23e7c57c@lerctr.org>

next in thread | previous in thread | raw e-mail | index | archive | help

--Apple-Mail-A1E7CE4B-3070-4935-B3D7-D687F871FECC
Content-Type: text/plain;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable



> On 18. Jun 2022, at 01:31, Larry Rosenman <ler@lerctr.org> wrote:
> =EF=BB=BFOn 06/17/2022 6:20 pm, Michael Gmelin wrote:
>>>> On 18. Jun 2022, at 00:57, Larry Rosenman <ler@lerctr.org> wrote:
>>> =EF=BB=BFOn 06/17/2022 5:48 pm, Michael Gmelin wrote:
>>>>> On 18. Jun 2022, at 00:31, Alexander Motin <mav@freebsd.org> wrote:
>>>>> =EF=BB=BF
>>>>>> On 17.06.2022 18:24, Alexander Motin wrote:
>>>>>>> On 17.06.2022 18:16, Larry Rosenman wrote:
>>>>>>> On 06/17/2022 5:08 pm, Alexander Motin wrote:
>>>>>>>> On 17.06.2022 11:59, Larry Rosenman wrote:
>>>>>>>>> I'm looking to upgrade the controllers in my TrueNAS box to someth=
ing that will
>>>>>>>>> support 8TB drives because apparently my LSI 2108 controllers do n=
ot support 8TB drives.
>>>>>>>>> What's the communities recommendation?
>>>>>>>>> needs to support SFF connectors for a total of 4 SFF connectors, a=
s I have 16 slots.
>>>>>>>> We at iX are still using LSI/Broadcom HBAs, just moved from long
>>>>>>>> discontinued mps(4) to newer mpr(4).  And I don't believe the probl=
em
>>>>>>>> is directly related to capacity.  According to my observations it m=
ay
>>>>>>>> be Seagate HDDs of/above certain (8TB) generation.  We do not use
>>>>>>>> Seagate HDDs in our products, so about that instability I only hear=
d
>>>>>>>> from forums and TrueNAS community user reports.
>>>>>>> This is a mfi(4) set of controllers, and a ST80000Nm0045 8TB (CMR) d=
rive.
>>>>>>> Is this a bad combo?
>>>>>>> mfi0: 9973 (708793330s/0x0002/WARN) - PD 00(e0xfc/s3) is not support=
ed
>>>>>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00
>>>>>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error=

>>>>>>> (probe0:mfi0:0:0:0): Retrying command, 3 more tries remain
>>>>>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00
>>>>>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error=

>>>>>>> (probe0:mfi0:0:0:0): Retrying command, 2 more tries remain
>>>>>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00
>>>>>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error=

>>>>>>> (probe0:mfi0:0:0:0): Retrying command, 1 more tries remain
>>>>>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00
>>>>>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error=

>>>>>>> (probe0:mfi0:0:0:0): Retrying command, 0 more tries remain
>>>>>>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00
>>>>>>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error=

>>>>>>> (probe0:mfi0:0:0:0): Error 5, Retries exhausted
>>>>>>> mfi0 Physical Drives:
>>>>>>> 0 (  932G) UNCONFIGURED GOOD <ST8000NM0045-1RL UG07 serial=3DZA1AC91=
2> SATA E1:S3
>>>>>> mfi(4) are RAIDs, not HBAs.  We do not recommend RAIDs with TrueNAS d=
ue to problems with hot-plug, disk identification, etc. and so have limited e=
xperience with them.  But I know some of LSI RAIDs can be reflashed into equ=
ivalent HBAs, so if they share the hardware, I can speculate that they may s=
hare some issues.
>>>>> I've just noticed "932G" instead of "8000G".  It is obviously a bigger=
 problem than what we heard for HBAs.  It looks like a kind of problems that=
 should not happen to HBAs, since they should not care about disk capacity.
>>>> What does `smartctl -a <device>` report (especially sector sizes)?
>>>> -m
>>>>> --
>>>>> Alexander Motin
>>> It's not even making a mfid* node (it is a 4Kn disk)
>> Ok, that=E2=80=99s sad (and explains the wrong size calculation as 4096/5=
12=3D8).
>> Is this in HBA mode? (Like Alexander suggested, re-/crossflashing
>> using an IT firmware might be an option). What controller / firmware
>> image version is it?
>> -m
>>> --
>>> Larry Rosenman                     http://www.lerctr.org/~ler
>>> Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
>>> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106
>=20
>=20
> mfi0@pci0:8:0:0:    class=3D0x010400 rev=3D0x05 hdr=3D0x00 vendor=3D0x1000=
 device=3D0x0079 subvendor=3D0x1734 subdevice=3D0x1176
>    vendor     =3D 'Broadcom / LSI'
>    device     =3D 'MegaRAID SAS 2108 [Liberator]'
>    class      =3D mass storage
>    subclass   =3D RAID
>=20
> mfi1@pci0:3:0:0:    class=3D0x010400 rev=3D0x05 hdr=3D0x00 vendor=3D0x1000=
 device=3D0x0079 subvendor=3D0x1734 subdevice=3D0x1176
>    vendor     =3D 'Broadcom / LSI'
>    device     =3D 'MegaRAID SAS 2108 [Liberator]'
>    class      =3D mass storage
>    subclass   =3D RAID
>=20
> mfi0: <LSI MegaSAS Gen2> port 0xd000-0xd0ff mem 0xfbc9c000-0xfbc9ffff,0xfb=
cc0000
> -0xfbcfffff irq 26 at device 0.0 on pci3
> mfi0: Using MSI
> mfi0: Megaraid SAS driver Ver 4.23
> mfi0: FW MaxCmds =3D 1008, limiting to 128
> mfip0: <SCSI Passthrough Bus> on mfi0
> mfi0: 10014 (708822708s/0x0020/info) - Shutdown command received from host=

> mfi0: 10015 (boot + 3s/0x0020/info) - Firmware initialization started (PCI=
 ID 00
> 79/1000/1176/1734)
> mfi0: 10016 (boot + 3s/0x0020/info) - Firmware version 2.130.353-2727
> mfi0: 10017 (boot + 6s/0x0020/info) - Package version 12.12.0-0174
> mfi0: 10018 (boot + 6s/0x0020/info) - Board Revision
>=20
> mfi1: <LSI MegaSAS Gen2> port 0xc000-0xc0ff mem 0xfba9c000-0xfba9ffff,0xfb=
ac0000
> -0xfbafffff irq 16 at device 0.0 on pci8
> mfi1: Using MSI
> mfi1: Megaraid SAS driver Ver 4.23
> mfi1: FW MaxCmds =3D 1008, limiting to 128
>=20

Subvendor is Fujitsu Siemens - so I guess this is integrated into a system b=
y them.

Seems like flashing the 2108 to an IT firmware isn=E2=80=99t an option (base=
d on what I found online). You could check if there are firmware updates ava=
ilable though. How did you configure the drives in the megaraid utility (ctr=
l-h after boot)? Did you create a RAID-0 for each disk? And what capacity is=
 shown in there?

Based on [0], 2108 based controllers don=E2=80=99t support 4kn. IT mode woul=
d help (true passthrough), but as written above, I don=E2=80=99t think it=E2=
=80=99s an option for this model.

-m

[0] https://bitdeals.tech/blogs/news/4kn-lsi-compatibility-list

>=20
> --=20
> Larry Rosenman                     http://www.lerctr.org/~ler
> Phone: +1 214-642-9640                 E-Mail: ler@lerctr.org
> US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106

--Apple-Mail-A1E7CE4B-3070-4935-B3D7-D687F871FECC
Content-Type: text/html;
	charset=utf-8
Content-Transfer-Encoding: quoted-printable

<html><head><meta http-equiv=3D"content-type" content=3D"text/html; charset=3D=
utf-8"></head><body dir=3D"auto"><div dir=3D"ltr"><div dir=3D"ltr"><div dir=3D=
"ltr"><div dir=3D"ltr"></div><div dir=3D"ltr"><br></div><div dir=3D"ltr"><br=
><blockquote type=3D"cite">On 18. Jun 2022, at 01:31, Larry Rosenman &lt;ler=
@lerctr.org&gt; wrote:<br><br></blockquote></div><blockquote type=3D"cite"><=
div dir=3D"ltr">=EF=BB=BF<span>On 06/17/2022 6:20 pm, Michael Gmelin wrote:<=
/span><br><blockquote type=3D"cite"><blockquote type=3D"cite"><span>On 18. J=
un 2022, at 00:57, Larry Rosenman &lt;ler@lerctr.org&gt; wrote:</span><br></=
blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite">=
<span>=EF=BB=BFOn 06/17/2022 5:48 pm, Michael Gmelin wrote:</span><br></bloc=
kquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blo=
ckquote type=3D"cite"><blockquote type=3D"cite"><span>On 18. Jun 2022, at 00=
:31, Alexander Motin &lt;mav@freebsd.org&gt; wrote:</span><br></blockquote><=
/blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>=EF=BB=
=BF</span><br></blockquote></blockquote></blockquote></blockquote><blockquot=
e type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockqu=
ote type=3D"cite"><blockquote type=3D"cite"><span>On 17.06.2022 18:24, Alexa=
nder Motin wrote:</span><br></blockquote></blockquote></blockquote></blockqu=
ote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockq=
uote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><bloc=
kquote type=3D"cite"><span>On 17.06.2022 18:16, Larry Rosenman wrote:</span>=
<br></blockquote></blockquote></blockquote></blockquote></blockquote></block=
quote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><span>On 06/17/2022 5:08 pm, Alexander Motin wrote:</span><br></block=
quote></blockquote></blockquote></blockquote></blockquote></blockquote><bloc=
kquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><bl=
ockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><=
blockquote type=3D"cite"><span>On 17.06.2022 11:59, Larry Rosenman wrote:</s=
pan><br></blockquote></blockquote></blockquote></blockquote></blockquote></b=
lockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><=
blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"=
><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cit=
e"><span>I'm looking to upgrade the controllers in my TrueNAS box to somethi=
ng that will</span><br></blockquote></blockquote></blockquote></blockquote><=
/blockquote></blockquote></blockquote></blockquote><blockquote type=3D"cite"=
><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cit=
e"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"c=
ite"><blockquote type=3D"cite"><span>support 8TB drives because apparently m=
y LSI 2108 controllers do not support 8TB drives.</span><br></blockquote></b=
lockquote></blockquote></blockquote></blockquote></blockquote></blockquote><=
/blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote=
 type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>Wha=
t's the communities recommendation?</span><br></blockquote></blockquote></bl=
ockquote></blockquote></blockquote></blockquote></blockquote></blockquote><b=
lockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite=
"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>needs to support=
 SFF connectors for a total of 4 SFF connectors, as I have 16 slots.</span><=
br></blockquote></blockquote></blockquote></blockquote></blockquote></blockq=
uote></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>We at iX ar=
e still using LSI/Broadcom HBAs, just moved from long</span><br></blockquote=
></blockquote></blockquote></blockquote></blockquote></blockquote></blockquo=
te><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"c=
ite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><span>discontinued mps(4) to newer mpr(4). &=
nbsp;And I don't believe the problem</span><br></blockquote></blockquote></b=
lockquote></blockquote></blockquote></blockquote></blockquote><blockquote ty=
pe=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote=
 type=3D"cite"><span>is directly related to capacity. &nbsp;According to my o=
bservations it may</span><br></blockquote></blockquote></blockquote></blockq=
uote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><block=
quote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blo=
ckquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><s=
pan>be Seagate HDDs of/above certain (8TB) generation. &nbsp;We do not use</=
span><br></blockquote></blockquote></blockquote></blockquote></blockquote></=
blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite=
"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>Seagate HDDs in o=
ur products, so about that instability I only heard</span><br></blockquote><=
/blockquote></blockquote></blockquote></blockquote></blockquote></blockquote=
><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cit=
e"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"c=
ite"><blockquote type=3D"cite"><span>from forums and TrueNAS community user r=
eports.</span><br></blockquote></blockquote></blockquote></blockquote></bloc=
kquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><span>This is a mfi(4) set of controllers, a=
nd a ST80000Nm0045 8TB (CMR) drive.</span><br></blockquote></blockquote></bl=
ockquote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><b=
lockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><blockquote type=3D"cite"><span>Is this a bad comb=
o?</span><br></blockquote></blockquote></blockquote></blockquote></blockquot=
e></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquo=
te type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockq=
uote type=3D"cite"><span>mfi0: 9973 (708793330s/0x0002/WARN) - PD 00(e0xfc/s=
3) is not supported</span><br></blockquote></blockquote></blockquote></block=
quote></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): INQUIRY. CDB: 12=
 00 00 00 24 00</span><br></blockquote></blockquote></blockquote></blockquot=
e></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"ci=
te"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"=
cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): CAM status: CCB r=
equest completed with an error</span><br></blockquote></blockquote></blockqu=
ote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockq=
uote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><bloc=
kquote type=3D"cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): Re=
trying command, 3 more tries remain</span><br></blockquote></blockquote></bl=
ockquote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><b=
lockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0=
): INQUIRY. CDB: 12 00 00 00 24 00</span><br></blockquote></blockquote></blo=
ckquote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><bl=
ockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><=
blockquote type=3D"cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0)=
: CAM status: CCB request completed with an error</span><br></blockquote></b=
lockquote></blockquote></blockquote></blockquote></blockquote><blockquote ty=
pe=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>(prob=
e0:mfi0:0:0:0): Retrying command, 2 more tries remain</span><br></blockquote=
></blockquote></blockquote></blockquote></blockquote></blockquote><blockquot=
e type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockqu=
ote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>=
(probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00</span><br></blockquote>=
</blockquote></blockquote></blockquote></blockquote></blockquote><blockquote=
 type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquo=
te type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>(=
probe0:mfi0:0:0:0): CAM status: CCB request completed with an error</span><b=
r></blockquote></blockquote></blockquote></blockquote></blockquote></blockqu=
ote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"=
cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><span>(probe0:mfi0:0:0:0): Retrying command, 1 more tries remain</spa=
n><br></blockquote></blockquote></blockquote></blockquote></blockquote></blo=
ckquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=
=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote ty=
pe=3D"cite"><span>(probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00</span=
><br></blockquote></blockquote></blockquote></blockquote></blockquote></bloc=
kquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><span>(probe0:mfi0:0:0:0): CAM status: CCB request completed with an e=
rror</span><br></blockquote></blockquote></blockquote></blockquote></blockqu=
ote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blockq=
uote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><bloc=
kquote type=3D"cite"><span>(probe0:mfi0:0:0:0): Retrying command, 0 more tri=
es remain</span><br></blockquote></blockquote></blockquote></blockquote></bl=
ockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><b=
lockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 0=
0 24 00</span><br></blockquote></blockquote></blockquote></blockquote></bloc=
kquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite"><blo=
ckquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><b=
lockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): CAM status: CCB request c=
ompleted with an error</span><br></blockquote></blockquote></blockquote></bl=
ockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote typ=
e=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><span>(probe0:mfi0:0:0:0): Error 5, R=
etries exhausted</span><br></blockquote></blockquote></blockquote></blockquo=
te></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"c=
ite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D=
"cite"><blockquote type=3D"cite"><span>mfi0 Physical Drives:</span><br></blo=
ckquote></blockquote></blockquote></blockquote></blockquote></blockquote><bl=
ockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><=
blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"=
><span> 0 ( &nbsp;932G) UNCONFIGURED GOOD &lt;ST8000NM0045-1RL UG07 serial=3D=
ZA1AC912&gt; SATA E1:S3</span><br></blockquote></blockquote></blockquote></b=
lockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquote ty=
pe=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><blockquote t=
ype=3D"cite"><span>mfi(4) are RAIDs, not HBAs. &nbsp;We do not recommend RAI=
Ds with TrueNAS due to problems with hot-plug, disk identification, etc. and=
 so have limited experience with them. &nbsp;But I know some of LSI RAIDs ca=
n be reflashed into equivalent HBAs, so if they share the hardware, I can sp=
eculate that they may share some issues.</span><br></blockquote></blockquote=
></blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquot=
e type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>I'=
ve just noticed "932G" instead of "8000G". &nbsp;It is obviously a bigger pr=
oblem than what we heard for HBAs. &nbsp;It looks like a kind of problems th=
at should not happen to HBAs, since they should not care about disk capacity=
.</span><br></blockquote></blockquote></blockquote></blockquote><blockquote t=
ype=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><span>What d=
oes `smartctl -a &lt;device&gt;` report (especially sector sizes)?</span><br=
></blockquote></blockquote></blockquote><blockquote type=3D"cite"><blockquot=
e type=3D"cite"><blockquote type=3D"cite"><span>-m</span><br></blockquote></=
blockquote></blockquote><blockquote type=3D"cite"><blockquote type=3D"cite">=
<blockquote type=3D"cite"><blockquote type=3D"cite"><span>--</span><br></blo=
ckquote></blockquote></blockquote></blockquote><blockquote type=3D"cite"><bl=
ockquote type=3D"cite"><blockquote type=3D"cite"><blockquote type=3D"cite"><=
span>Alexander Motin</span><br></blockquote></blockquote></blockquote></bloc=
kquote><blockquote type=3D"cite"><blockquote type=3D"cite"><span>It's not ev=
en making a mfid* node (it is a 4Kn disk)</span><br></blockquote></blockquot=
e><blockquote type=3D"cite"><span>Ok, that=E2=80=99s sad (and explains the w=
rong size calculation as 4096/512=3D8).</span><br></blockquote><blockquote t=
ype=3D"cite"><span>Is this in HBA mode? (Like Alexander suggested, re-/cross=
flashing</span><br></blockquote><blockquote type=3D"cite"><span>using an IT f=
irmware might be an option). What controller / firmware</span><br></blockquo=
te><blockquote type=3D"cite"><span>image version is it?</span><br></blockquo=
te><blockquote type=3D"cite"><span>-m</span><br></blockquote><blockquote typ=
e=3D"cite"><blockquote type=3D"cite"><span>--</span><br></blockquote></block=
quote><blockquote type=3D"cite"><blockquote type=3D"cite"><span>Larry Rosenm=
an &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;http://www.lerctr.org/~ler</s=
pan><br></blockquote></blockquote><blockquote type=3D"cite"><blockquote type=
=3D"cite"><span>Phone: +1 214-642-9640 &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;E-Mail: ler@lerct=
r.org</span><br></blockquote></blockquote><blockquote type=3D"cite"><blockqu=
ote type=3D"cite"><span>US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106</=
span><br></blockquote></blockquote><span></span><br><span></span><br><span>m=
fi0@pci0:8:0:0: &nbsp; &nbsp;class=3D0x010400 rev=3D0x05 hdr=3D0x00 vendor=3D=
0x1000 device=3D0x0079 subvendor=3D0x1734 subdevice=3D0x1176</span><br><span=
> &nbsp;&nbsp;&nbsp;vendor &nbsp;&nbsp;&nbsp;&nbsp;=3D 'Broadcom / LSI'</spa=
n><br><span> &nbsp;&nbsp;&nbsp;device &nbsp;&nbsp;&nbsp;&nbsp;=3D 'MegaRAID S=
AS 2108 [Liberator]'</span><br><span> &nbsp;&nbsp;&nbsp;class &nbsp;&nbsp;&n=
bsp;&nbsp;&nbsp;=3D mass storage</span><br><span> &nbsp;&nbsp;&nbsp;subclass=
 &nbsp;&nbsp;=3D RAID</span><br><span></span><br><span>mfi1@pci0:3:0:0: &nbs=
p; &nbsp;class=3D0x010400 rev=3D0x05 hdr=3D0x00 vendor=3D0x1000 device=3D0x0=
079 subvendor=3D0x1734 subdevice=3D0x1176</span><br><span> &nbsp;&nbsp;&nbsp=
;vendor &nbsp;&nbsp;&nbsp;&nbsp;=3D 'Broadcom / LSI'</span><br><span> &nbsp;=
&nbsp;&nbsp;device &nbsp;&nbsp;&nbsp;&nbsp;=3D 'MegaRAID SAS 2108 [Liberator=
]'</span><br><span> &nbsp;&nbsp;&nbsp;class &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;=3D=
 mass storage</span><br><span> &nbsp;&nbsp;&nbsp;subclass &nbsp;&nbsp;=3D RA=
ID</span><br><span></span><br><span>mfi0: &lt;LSI MegaSAS Gen2&gt; port 0xd0=
00-0xd0ff mem 0xfbc9c000-0xfbc9ffff,0xfbcc0000</span><br><span>-0xfbcfffff i=
rq 26 at device 0.0 on pci3</span><br><span>mfi0: Using MSI</span><br><span>=
mfi0: Megaraid SAS driver Ver 4.23</span><br><span>mfi0: FW MaxCmds =3D 1008=
, limiting to 128</span><br><span>mfip0: &lt;SCSI Passthrough Bus&gt; on mfi=
0</span><br><span>mfi0: 10014 (708822708s/0x0020/info) - Shutdown command re=
ceived from host</span><br><span>mfi0: 10015 (boot + 3s/0x0020/info) - Firmw=
are initialization started (PCI ID 00</span><br><span>79/1000/1176/1734)</sp=
an><br><span>mfi0: 10016 (boot + 3s/0x0020/info) - Firmware version 2.130.35=
3-2727</span><br><span>mfi0: 10017 (boot + 6s/0x0020/info) - Package version=
 12.12.0-0174</span><br><span>mfi0: 10018 (boot + 6s/0x0020/info) - Board Re=
vision</span><br><span></span><br><span>mfi1: &lt;LSI MegaSAS Gen2&gt; port 0=
xc000-0xc0ff mem 0xfba9c000-0xfba9ffff,0xfbac0000</span><br><span>-0xfbaffff=
f irq 16 at device 0.0 on pci8</span><br><span>mfi1: Using MSI</span><br><sp=
an>mfi1: Megaraid SAS driver Ver 4.23</span><br><span>mfi1: FW MaxCmds =3D 1=
008, limiting to 128</span><br><span></span><br></div></blockquote><div><br>=
</div><div>Subvendor is Fujitsu Siemens - so I guess this is integrated into=
 a system by them.</div><div><br></div><div>Seems like flashing the 2108 to a=
n IT firmware isn=E2=80=99t an option (based on what I found online). You co=
uld check if there are firmware updates available though. How did you config=
ure the drives in the megaraid utility (ctrl-h after boot)? Did you create a=
 RAID-0 for each disk? And what capacity is shown in there?</div><div><br></=
div><div>Based on [0], 2108 based controllers don=E2=80=99t support 4kn. IT m=
ode would help (true passthrough), but as written above, I don=E2=80=99t thi=
nk it=E2=80=99s an option for this model.</div><div><br></div><div>-m</div><=
div dir=3D"ltr"><br></div>[0]&nbsp;<a href=3D"https://bitdeals.tech/blogs/ne=
ws/4kn-lsi-compatibility-list">https://bitdeals.tech/blogs/news/4kn-lsi-comp=
atibility-list</a></div><div dir=3D"ltr"><br><blockquote type=3D"cite"><div d=
ir=3D"ltr"><span></span><br><span>-- </span><br><span>Larry Rosenman &nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp=
;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;http://www.lerctr.org/~ler</span><br><s=
pan>Phone: +1 214-642-9640 &nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&=
nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;E-Mail: ler@lerctr.org</span>=
<br><span>US Mail: 5708 Sabbia Dr, Round Rock, TX 78665-2106</span><br></div=
></blockquote></div></div></div></body></html>=

--Apple-Mail-A1E7CE4B-3070-4935-B3D7-D687F871FECC--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?F44C5611-5147-42B4-BBE5-403DCBB5157C>