Date: Fri, 17 Jun 2022 18:39:56 -0400 From: Alexander Motin <mav@FreeBSD.org> To: Larry Rosenman <ler@lerctr.org> Cc: Freebsd current <freebsd-current@freebsd.org> Subject: Re: SAS/SATA controllers: 8 port that support 8TB Drives Message-ID: <2bc77869-244e-e3bd-709d-f24bf96782bc@FreeBSD.org> In-Reply-To: <5366dceb38e43bc5bd1e84cb90ea31ac@lerctr.org> References: <96f9a47659ac052b8d806bb9b7ab2b51@lerctr.org> <1a795a4e-2b1e-2cba-484b-52811546e277@FreeBSD.org> <97624e2a4e0887ede029e71c47bb6060@lerctr.org> <9ad99f2c-3d63-ccab-f730-e355f0297d72@FreeBSD.org> <5366dceb38e43bc5bd1e84cb90ea31ac@lerctr.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On 17.06.2022 18:29, Larry Rosenman wrote: > On 06/17/2022 5:24 pm, Alexander Motin wrote: >> On 17.06.2022 18:16, Larry Rosenman wrote: >>> On 06/17/2022 5:08 pm, Alexander Motin wrote: >>>> On 17.06.2022 11:59, Larry Rosenman wrote: >>>>> I'm looking to upgrade the controllers in my TrueNAS box to >>>>> something that will >>>>> support 8TB drives because apparently my LSI 2108 controllers do >>>>> not support 8TB drives. >>>>> >>>>> What's the communities recommendation? >>>>> needs to support SFF connectors for a total of 4 SFF connectors, as >>>>> I have 16 slots. >>>> >>>> We at iX are still using LSI/Broadcom HBAs, just moved from long >>>> discontinued mps(4) to newer mpr(4). And I don't believe the problem >>>> is directly related to capacity. According to my observations it may >>>> be Seagate HDDs of/above certain (8TB) generation. We do not use >>>> Seagate HDDs in our products, so about that instability I only heard >>>> from forums and TrueNAS community user reports. >>> >>> This is a mfi(4) set of controllers, and a ST80000Nm0045 8TB (CMR) >>> drive. >>> >>> Is this a bad combo? >>> >>> mfi0: 9973 (708793330s/0x0002/WARN) - PD 00(e0xfc/s3) is not supported >>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>> (probe0:mfi0:0:0:0): Retrying command, 3 more tries remain >>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>> (probe0:mfi0:0:0:0): Retrying command, 2 more tries remain >>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>> (probe0:mfi0:0:0:0): Retrying command, 1 more tries remain >>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>> (probe0:mfi0:0:0:0): Retrying command, 0 more tries remain >>> (probe0:mfi0:0:0:0): INQUIRY. CDB: 12 00 00 00 24 00 >>> (probe0:mfi0:0:0:0): CAM status: CCB request completed with an error >>> (probe0:mfi0:0:0:0): Error 5, Retries exhausted >>> >>> mfi0 Physical Drives: >>> 0 ( 932G) UNCONFIGURED GOOD <ST8000NM0045-1RL UG07 >>> serial=ZA1AC912> SATA E1:S3 >> >> mfi(4) are RAIDs, not HBAs. We do not recommend RAIDs with TrueNAS >> due to problems with hot-plug, disk identification, etc. and so have >> limited experience with them. But I know some of LSI RAIDs can be >> reflashed into equivalent HBAs, so if they share the hardware, I can >> speculate that they may share some issues. > I bought 2 of these: > https://www.ebay.com/itm/194910024856 > to replace the 2 mfi(4)'s > > Hopefully I can just move the controllers and TrueNAS 13.0-RELEASE will > just notice them. > and pick up the new 8T disks. > > let me know if I'm setting myself up for failure. Not so obvious. They should work at least on a short run. But as I have told, I've heard number of rumors about mps(4) and 8TB Seagates. Though nothing confirmed, only some instability, that nobody is really motivated to debug now. Next 93xx line of mpr(4) HBAs still seems cost few times more on EBay thogh, so there is a choice. -- Alexander Motin
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?2bc77869-244e-e3bd-709d-f24bf96782bc>