Date: Thu, 19 Oct 2017 22:09:25 -0400 From: Ken Merry <ken@freebsd.org> To: Shiva Bhanujan <Shiva.Bhanujan@Quorum.com> Cc: Steven Hartland <killing@multiplay.co.uk>, "freebsd-scsi@freebsd.org" <freebsd-scsi@freebsd.org> Subject: Re: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-Express Fusion-MPT SAS-3 Message-ID: <96BAD947-4AB0-4EAC-9DA8-4B1F10253287@freebsd.org> In-Reply-To: <3A5A10BE32AC9E45B4A22F89FC90EC0701C36666F5@QLEXC01.Quorum.local> References: <3A5A10BE32AC9E45B4A22F89FC90EC0701C3665D5D@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3665E8B@QLEXC01.Quorum.local> <20171016144231.GA94858@mithlond.kdm.org> <3A5A10BE32AC9E45B4A22F89FC90EC0701C366610E@QLEXC01.Quorum.local> <20171017023126.GA6559@mithlond.kdm.org> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3666143@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3666345@QLEXC01.Quorum.local> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3666352@QLEXC01.Quorum.local> <3E746990-8C6D-4CA1-BD79-B5566CFB07F4@freebsd.org> <32C157CE-A122-435F-8430-9531BEEB5914@freebsd.org> <3A5A10BE32AC9E45B4A22F89FC90EC0701C3666647@QLEXC01.Quorum.local> <CAHEMsqY1ijV659MabfRPWecDVRbzwYGynd2hUfUOwmZe_Tg=Lw@mail.gmail.com> <3A5A10BE32AC9E45B4A22F89FC90EC0701C36666F5@QLEXC01.Quorum.local>
next in thread | previous in thread | raw e-mail | index | archive | help
There are probably 3 solutions to get things fixed for you: 1. Track down why the mpr driver is sending requests that the drive doesn=E2= =80=99t like and fix it. 2. Turn on DPICZ in the drive and disable setting protection information in t= he mpr driver. This will take commenting out the right code and recompiling t= he kernel. 3. Use an older version of FreeBSD to read the data and the reformat and wri= te it back. We need to do #1 for the sake of the users who will run into this. #2 hopefu= lly will work and won=E2=80=99t require running an old OS. #3 is essentially= giving up. For #2, If you feel comfortable modifying the mpr driver, just look for the e= edp code and turn it off. Otherwise I can try to come up with something tomo= rrow. Ken --=20 Ken Merry ken@FreeBSD.ORG > On Oct 19, 2017, at 20:51, Shiva Bhanujan <Shiva.Bhanujan@Quorum.com> wrot= e: >=20 > would it possible to by default read SCSI disks w/ type 2 protection in 10= .3 and above? Please note, that the issue that I'm facing, is that the part= itions are created in FreeBSD 10.2, and for the Seagate drives ST4000NM0005,= they are created w/ type 2 partition. read/write to these disks in FreeBSD= 10.2 works just fine. However, if I upgrade to FreeBSD 10.3 and above, I g= et SCSI errors for only these disks. Would it be possible, that the SCSI re= ads default to reading disks that have type 2 partition? In such a case, re= moving type 2 partition would not be needed. >=20 > all other params in the output of sg_readcap look the same for the ST4000N= M0023, where this issue isn't seen. >=20 > root@Filer:~ # > root@Filer:~ # camcontrol devlist | grep da0 > <SEAGATE ST4000NM0023 GS14> at scbus2 target 0 lun 0 (pass1,da0) > root@Filer:~ # > root@Filer:~ # camcontrol devlist | grep da2 > <SEAGATE ST4000NM0005 MS05> at scbus2 target 2 lun 0 (pass3,da2) > root@Filer:~ # > root@Filer:~ # sg_readcap --16 da0 > Read Capacity results: > Protection: prot_en=3D0, p_type=3D0, p_i_exponent=3D0 > Logical block provisioning: lbpme=3D0, lbprz=3D0 > Last logical block address=3D7814037167 (0x1d1c0beaf), Number of logical= blocks=3D7814037168 > Logical block length=3D512 bytes > Logical blocks per physical block exponent=3D0 > Lowest aligned logical block address=3D0 > Hence: > Device size: 4000787030016 bytes, 3815447.8 MiB, 4000.79 GB > root@Filer:~ # > root@Filer:~ # sg_readcap --16 da2 > Read Capacity results: > Protection: prot_en=3D1, p_type=3D1, p_i_exponent=3D0 [type 2 protection= ] > Logical block provisioning: lbpme=3D0, lbprz=3D0 > Last logical block address=3D7814037167 (0x1d1c0beaf), Number of logical= blocks=3D7814037168 > Logical block length=3D512 bytes > Logical blocks per physical block exponent=3D0 > Lowest aligned logical block address=3D0 > Hence: > Device size: 4000787030016 bytes, 3815447.8 MiB, 4000.79 GB > root@Filer:~ # >=20 >=20 > is there some default SCSI read that is configurable in FreeBSD 10.3 and a= bove? >=20 >=20 >=20 >=20 >=20 >=20 >=20 > From: Steven Hartland [killing@multiplay.co.uk] >=20 > Sent: Thursday, October 19, 2017 3:23 PM >=20 > To: Ken Merry; Shiva Bhanujan >=20 > Cc: freebsd-scsi@freebsd.org >=20 > Subject: Re: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > With type 2 protection the ref tag has to match the LBA + N=20 >=20 > Some info about it is here >=20 > https://www.usenix.org/legacy/event/lsf07/tech/petersen.pdf >=20 >=20 > https://www.seagate.com/files/staticfiles/docs/pdf/whitepaper/safeguarding= -data-from-corruption-technology-paper-tp621us.pdf >=20 > =46rom reading the seagate paper the only way to change the protection lev= el is to format. >=20 >=20 >=20 >=20 > On Thu, 19 Oct 2017 at 22:43, Shiva Bhanujan <Shiva.Bhanujan@quorum.com> w= rote: >=20 >=20 >=20 > Here's the output of sg_readcap. >=20 >=20 >=20 > [root@Filer-20-241 ~]# sg_readcap --16 da1 >=20 > Read Capacity results: >=20 > Protection: prot_en=3D1, p_type=3D1, p_i_exponent=3D0 [type 2 protection= ] >=20 > Logical block provisioning: lbpme=3D0, lbprz=3D0 >=20 > Last logical block address=3D7814037167 (0x1d1c0beaf), Number of logical= blocks=3D7814037168 >=20 > Logical block length=3D512 bytes >=20 > Logical blocks per physical block exponent=3D0 >=20 > Lowest aligned logical block address=3D0 >=20 > Hence: >=20 > Device size: 4000787030016 bytes, 3815447.8 MiB, 4000.79 GB >=20 > [root@Filer-20-241 ~]# >=20 >=20 >=20 > [root@Filer-20-241 ~]# camcontrol modepage da1 -v -m 10 | grep DPICZ >=20 > DPICZ: 1 >=20 > [root@Filer-20-241 ~]# >=20 >=20 >=20 > I did toggle the DPICZ on the drive from 1 to 0 and back. The sg_readcap s= till shows 'type 2 protection', and that gpart still shows the SCSI errors. = I've narrowed this down to the Seagate ST4000NM0005, w/ a DOM of 03/2016. W= e also have Constellation ES.3 > drives model ST4000NM0023 that don't exhibit this issue. >=20 >=20 >=20 > I did go through the URLs that you have mentioned and that's how I found t= hat using sg_format did address this issue. Again, that works only for new d= rives and we have appliances that already have data, for which sg_format isn= 't an option. >=20 >=20 >=20 > Is this boiling down to the 'type 2 protection' tag that we see in sg_read= cap? if so, would there be a way to turn it off? >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > From: Ken Merry [ken@freebsd.org] >=20 >=20 >=20 > Sent: Thursday, October 19, 2017 2:17 PM >=20 >=20 >=20 > To: Shiva Bhanujan >=20 >=20 >=20 > Cc:=20 > freebsd-scsi@freebsd.org >=20 >=20 >=20 > Subject: Re: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > By the way, the message you referenced is here: >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > https://lists.freebsd.org/pipermail/freebsd-scsi/2017-January/007237.html >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > And there is more here: >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > https://bugs.freenas.org/issues/14517 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > Ken >=20 >=20 >=20 >=20 >=20 >=20 >=20 > =E2=80=94 >=20 >=20 >=20 > Ken Merry >=20 >=20 >=20 > ken@FreeBSD.ORG >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > On Oct 19, 2017, at 5:15 PM, Ken Merry <ken@freebsd.org> wrote: >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > What does sg_readcap =E2=80=9416 show for these drives? >=20 >=20 >=20 > If it has type 2 protection turned on, check to see what the DCIPZ value i= s in the control mode page: >=20 >=20 >=20 > camcontrol modepage daX -v -m 10 >=20 >=20 >=20 > If that is set to 0, add a -e to the above command line and see if you can= set it to 1. That may or may not help anything. >=20 >=20 >=20 > The mpr(4) and mps(4) drivers try to support protection information if it i= s turned on on the drive. So, they set the protection information if protec= tion information is turned on in the drive. For that reason, setting the DC= IPZ bit may not fix it. >=20 >=20 >=20 > There could be a problem with how that is implemented that=E2=80=99s causi= ng the drives to reject the command, but I=E2=80=99m not sure. >=20 >=20 >=20 > If it is, Steve (CCed) can help us debug it. >=20 >=20 >=20 > Ken >=20 > =E2=80=94 >=20 > Ken Merry >=20 > ken@FreeBSD.ORG >=20 >=20 >=20 >=20 >=20 >=20 >=20 > On Oct 17, 2017, at 9:54 PM, Shiva Bhanujan <Shiva.Bhanujan@Quorum.com> wr= ote: >=20 >=20 >=20 > Sorry. perhaps I have failed to mention, the SCSI errors are only w/ the s= eagate drives. These are of the model ST4000NM0023. >=20 >=20 >=20 >=20 >=20 > From: Shiva Bhanujan >=20 > Sent: Tuesday, October 17, 2017 6:53 PM >=20 > To: Kenneth D. Merry >=20 > Cc:=20 > freebsd-scsi@freebsd.org <mailto:freebsd-scsi@freebsd.org> >=20 > Subject: RE: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 > Please note, that this isn't an issue w/ Toshiba drives. is this a firmwa= re issue by any chance? >=20 >=20 >=20 >=20 >=20 >=20 >=20 > From:=20 > owner-freebsd-scsi@freebsd.org <mailto:owner-freebsd-scsi@freebsd.org> [ow= ner-freebsd-scsi@freebsd.org > <mailto:owner-freebsd-scsi@freebsd.org>] on behalf of Shiva Bhanujan [shiv= a.bhanujan@quorum.net > <mailto:shiva.bhanujan@quorum.net>] >=20 > Sent: Tuesday, October 17, 2017 6:08 AM >=20 > To: Kenneth D. Merry >=20 > Cc:=20 > freebsd-scsi@freebsd.org <mailto:freebsd-scsi@freebsd.org> >=20 > Subject: RE: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 > Since I started having the SCSI errors, I ended up running sg_format to fo= rmat the disks. I've found that once the disks are formatted using sg_format= , there are no SCSI errors. The errors that show up during the format are to= wards the end of the dmesg output. >=20 >=20 >=20 > (da0:mpr0:0:8:0): SCSI sense: NOT READY asc:4,4 (Logical unit not ready, f= ormat in progress) >=20 > (da0:mpr0:0:8:0): Progress: 9% (6256/65536) complete >=20 >=20 >=20 > once the format is done, I can successfully format and partition using gpa= rt. >=20 >=20 >=20 >=20 >=20 > The errors that show up when I try to run gpart for the first time are as f= ollows: >=20 >=20 >=20 > (da9:mpr0:0:17:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00 >=20 > (da9:mpr0:0:17:0): CAM status: SCSI Status Error >=20 > (da9:mpr0:0:17:0): SCSI status: Check Condition >=20 > (da9:mpr0:0:17:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command o= peration code) >=20 > (da9:mpr0:0:17:0): Error 22, Unretryable error >=20 >=20 >=20 >=20 >=20 > It seems that it's the read that is failing, and is being tagged as an ill= egal request. While sg_format will address the issue at hand, this isn't an o= ption for us, because there are appliances that were formatted using FreeBSD= 10.2, and an upgrade to 10.3 >=20 > or 11.x might be an issue? >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > ________________________________ >=20 > From: Kenneth D. Merry [ken@FreeBSD.ORG <mailto:ken@FreeBSD.ORG>] >=20 > Sent: Monday, October 16, 2017 7:31 PM >=20 > To: Shiva Bhanujan >=20 > Cc:=20 > freebsd-scsi@freebsd.org <mailto:freebsd-scsi@freebsd.org> >=20 > Subject: Re: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 > On Tue, Oct 17, 2017 at 01:19:27 +0000, Shiva Bhanujan wrote: >=20 > Hi Ken, >=20 >=20 >=20 > I've attached the output of dmesg. Here's the SCSI CDB for a sample drive,= da3. >=20 >=20 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 a0 00 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 a0 02 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 22 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 22 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 00 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 02 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 9f fc 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 9f fe 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 00 00 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 02 00 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 00 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 00 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 a0 00 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 a0 02 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 ba 22 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(16). CDB: 88 00 00 00 00 01 d1 c0 bc 22 00 00 01 0= 0 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 00 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 00 02 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 9f fc 22 00 01 00 00 >=20 > (da3:mpr0:0:11:0): READ(10). CDB: 28 00 00 9f fe 22 00 01 00 00 >=20 >=20 >=20 >=20 >=20 > My understanding is that FreeBSD 11.1 contains the mpr(4) driver? I've tri= ed this w/ 11.1, w/ the same results. >=20 >=20 >=20 >=20 >=20 >=20 >=20 > Yes, the mpr(4) driver is in all recent FreeBSD releases. >=20 >=20 >=20 > In looking at the dmesg, this is telling: >=20 >=20 >=20 > (da0:mpr0:0:8:0): WRITE(6). CDB: 0a 00 00 00 01 00 >=20 > (da0:mpr0:0:8:0): CAM status: SCSI Status Error >=20 > (da0:mpr0:0:8:0): SCSI status: Check Condition >=20 > (da0:mpr0:0:8:0): SCSI sense: NOT READY asc:4,4 (Logical unit not ready, f= ormat in progress) >=20 > (da0:mpr0:0:8:0): Progress: 9% (6256/65536) complete >=20 > (da0:mpr0:0:8:0): Error 16, Unretryable error >=20 >=20 >=20 > If the drives are in the process of formatting, I guess it may make sense >=20 > for them to reject read commands. Otherwise, it makes no sense for a hard >=20 > drive to reject reads. >=20 >=20 >=20 > Are you able to check the status of the format? You should be able to send= >=20 > a test unit ready and figure out how far along the format is: >=20 >=20 >=20 > camcontrol tur da0 -v >=20 >=20 >=20 > And so on for each of the drives. >=20 >=20 >=20 > Ken >=20 >=20 >=20 > ________________________________ >=20 > From: Kenneth D. Merry [ken@FreeBSD.ORG <mailto:ken@FreeBSD.ORG><mailto:ke= n@FreeBSD.ORG> > <mailto:ken@FreeBSD.ORG>>] >=20 > Sent: Monday, October 16, 2017 7:42 AM >=20 > To: Shiva Bhanujan >=20 > Cc:=20 > freebsd-scsi@freebsd.org <mailto:freebsd-scsi@freebsd.org><mailto:freebsd-= scsi@freebsd.org> > <mailto:freebsd-scsi@freebsd.org>> >=20 > Subject: Re: FreeBSD 10.3/11.0 SCSI errors with Symbios Logic SAS3008 PCI-= Express Fusion-MPT SAS-3 >=20 >=20 >=20 > On Fri, Oct 13, 2017 at 20:12:02 +0000, Shiva Bhanujan wrote: >=20 > Hello, >=20 >=20 >=20 > I have a FreeBSD 10.3 install in a HVM on XenServer 6.5. The HBA330 SAS-3 c= ontroller is in pcipassthrough mode to the FreeBSD VM. When I try to access t= he disks (/dev/da0...) using gpart, I get SCSI errors, like the following: >=20 >=20 >=20 >=20 >=20 >=20 >=20 > (da0:mpr0:0:0:0): CAM status: SCSI Status Error >=20 >=20 >=20 > (da0:mpr0:0:0:0): SCSI status: Check Condition >=20 >=20 >=20 > (da0:mpr0:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command op= eration code) >=20 >=20 >=20 >=20 >=20 >=20 >=20 > The error message above is missing the SCSI CDB. We need that in order to >=20 > figure out what command the drive is complaining about. >=20 >=20 >=20 > The error message means that FreeBSD is sending a SCSI command that the >=20 > drive doesn't support. That can be benign, or it can cause a problem. >=20 >=20 >=20 > So, what error does gpart give you when you have this problem? >=20 >=20 >=20 > I get the same errors w/ FreeBSD 11.0 also. Running 10.3 natively also has= the same result. >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > Please note, that these errors don't show up on a Fusion-MPT SAS-2 control= ler, or a MegaRAID SAS 2208 controller. Additionally, FreeBSD 10.2 doesn't h= ave any SCSI errors on the HBA330 SAS-3 controller either. >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > Is there a different version of the mpr driver I should be using? I haven'= t checked the differences between the mpr driver in 10.2 vs 10.3 and 11.0. I= do see that there are others who have experienced these issues. Can somebod= y please provide me some pointers >=20 > as to why this is occurring? Or if there are some driver changes that I mi= ght be able to incorporate? >=20 >=20 >=20 >=20 >=20 >=20 >=20 > In general, the latest mpr(4) driver is the best one. The driver itself >=20 > generally doesn't send SCSI commands (there are a few exceptions), but >=20 > rather passes them through from the upper layers of CAM. >=20 >=20 >=20 > Please note, that I have gone through the mail titled "scsi error at SEAGA= TE ST1200MM0088 TT31" and have started sg_format on all the SEAGATE disks. H= aving said that, I still need to figure out what would happen, if the disks >=20 > were written to using FreeBSD 10.2, which doesn't seem to have SCSI errors= , and when I try to upgrade to 10.3. Any help is appreciated. >=20 >=20 >=20 >=20 >=20 >=20 >=20 > Send the full error messages, and we may be able to figure out what's goin= g >=20 > on. >=20 >=20 >=20 > Ken >=20 > -- >=20 > Kenneth Merry >=20 > ken@FreeBSD.ORG <mailto:ken@FreeBSD.ORG><mailto:ken@FreeBSD.ORG> > <mailto:ken@FreeBSD.ORG>><mailto:ken@FreeBSD.ORG> > <mailto:ken@FreeBSD.ORG>> >=20 > ________________________________ >=20 >=20 >=20 >=20 >=20 >=20 >=20 > -- >=20 > Kenneth Merry >=20 > ken@FreeBSD.ORG <mailto:ken@FreeBSD.ORG><mailto:ken@FreeBSD.ORG> > <mailto:ken@FreeBSD.ORG>> >=20 > ________________________________ >=20 > _______________________________________________ >=20 > freebsd-scsi@freebsd.org <mailto:freebsd-scsi@freebsd.org> > mailing list >=20 > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi <https://lists.fre= ebsd.org/mailman/listinfo/freebsd-scsi> >=20 > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org <ma= ilto:freebsd-scsi-unsubscribe@freebsd.org>" >=20 >=20 >=20 >=20 >=20 > _______________________________________________ >=20 > freebsd-scsi@freebsd.org mailing list >=20 > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >=20 > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 > _______________________________________________ >=20 > freebsd-scsi@freebsd.org mailing list >=20 > https://lists.freebsd.org/mailman/listinfo/freebsd-scsi >=20 > To unsubscribe, send any mail to "freebsd-scsi-unsubscribe@freebsd.org" >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20 >=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?96BAD947-4AB0-4EAC-9DA8-4B1F10253287>