From owner-freebsd-scsi@freebsd.org Fri Feb 24 14:00:04 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21604CEB825 for ; Fri, 24 Feb 2017 14:00:04 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CC4DB7E8; Fri, 24 Feb 2017 14:00:03 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 821) id 16AB71BFF; Fri, 24 Feb 2017 14:00:02 +0000 (UTC) Date: Fri, 24 Feb 2017 14:00:02 +0000 From: John To: Alexander Motin Cc: FreeBSD-SCSI Subject: Re: sesutil not seeing disk in first bay Message-ID: <20170224140002.GA77466@FreeBSD.org> References: <20170224102748.GA34792@FreeBSD.org> <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ZPt4rx8FFjLCG7dd" Content-Disposition: inline In-Reply-To: <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> User-Agent: Mutt/1.7.1 (2016-10-04) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 14:00:04 -0000 --ZPt4rx8FFjLCG7dd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable ----- Alexander Motin's Original Message ----- > Hi. >=20 > I am not sure I completely understand from your description how exactly > detected disks match their enclosure slots, but make sure to take a look > on this change: > https://svnweb.freebsd.org/base?view=3Drevision&revision=3D308425 Yes - this patch is on my system. To phrase it differently - the shelf contains 25 drives. Disks da0 through da23 show up via sesutil: # sesutil map -u /dev/ses0 | grep da Device Names: da0,pass0 Device Names: da1,pass1 Device Names: da2,pass2 Device Names: da3,pass3 Device Names: da4,pass4 Device Names: da5,pass5 Device Names: da6,pass6 Device Names: da7,pass7 Device Names: da8,pass8 Device Names: da9,pass9 Device Names: da10,pass10 Device Names: da11,pass11 Device Names: da12,pass12 Device Names: da13,pass13 Device Names: da14,pass14 Device Names: da15,pass15 Device Names: da16,pass16 Device Names: da17,pass17 Device Names: da18,pass18 Device Names: da19,pass19 Device Names: da20,pass20 Device Names: da21,pass21 Device Names: da22,pass22 Device Names: da23,pass23 Disk da24 does not show up but is present in the first bay. da0 is in bay 2, etc. I hope this helps. Thanks, John > On 24.02.2017 12:27, John wrote: > > Hi Folks - > >=20 > > Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2= 017. > >=20 > > I'm wondering if anyone using sesutil has seen the following issue > > with an HP D2700 shelf (25 x 600GB SAS drives): > >=20 > > sesutil map -u /dev/ses0 > > ses0: > > Enclosure Name: HP D2700 SAS AJ941A 0149 > > Enclosure ID: 5001438023432c00 > > Element 0, Type: Array Device Slot > > Status: Unsupported (0x00 0x80 0x00 0x00) > > Element 1, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Element 2, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da0,pass0 > > Element 3, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da1,pass1 > > Element 4, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da2,pass2 > > ... > > ... full list below > > ... > > Element 25, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da23,pass23 > >=20 > >=20 > > Note Element 1 is an does not contain any device names. > >=20 > > Sesutil is getting an ENODEV back from the ioctl requesting the names. > >=20 > > In scsi_enc.c the error seems be coming from here: > >=20 > > cam_periph_lock(periph); > > error =3D (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); > > cam_periph_unlock(periph); > >=20 > > which eventually calls cam_periph_list() which "looks" ok to me. > >=20 > > I'm wondering if there is some sort of off by 1 error somewhere in > > the code with respect to how this shelf reports devices and are > > assigned since da0 is not allocated to the first bay, but instead bay 2. > >=20 > > Device da24 (the 25th device) is in the first bay. If I run a dd or > > iozone to da24 the drive works correctly and the activity light > > comes on as expected. > >=20 > > This process works correctly on a set of supermicro shelves. > >=20 > > Any thoughts or pointers? > >=20 > > Thanks, > > John > >=20 > > dmesg for da0/da1 > >=20 > > (da0:mps0:0:8:0): UNMAPPED > > da0 at mps0 bus 0 scbus0 target 8 lun 0 > > da0: Fixed Direct Access SPC-3 SCSI device > > da0: Serial Number EA01PC91LLBB1239 > > da0: 600.000MB/s transfers > > da0: Command Queueing enabled > > da0: 572325MB (1172123568 512 byte sectors) > > (da1:mps0:0:9:0): UNMAPPED > > da1 at mps0 bus 0 scbus0 target 9 lun 0 > > da1: Fixed Direct Access SPC-3 SCSI device > > da1: Serial Number EA01PC91LPG91239 > > da1: 600.000MB/s transfers > > da1: Command Queueing enabled > > da1: 572325MB (1172123568 512 byte sectors) > >=20 > >=20 > >=20 > > # sesutil map -u /dev/ses0=20 > > ses0: > > Enclosure Name: HP D2700 SAS AJ941A 0149 > > Enclosure ID: 5001438023432c00 > > Element 0, Type: Array Device Slot > > Status: Unsupported (0x00 0x80 0x00 0x00) > > Element 1, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Element 2, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da0,pass0 > > Element 3, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da1,pass1 > > Element 4, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da2,pass2 > > Element 5, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da3,pass3 > > Element 6, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da4,pass4 > > Element 7, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da5,pass5 > > Element 8, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da6,pass6 > > Element 9, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da7,pass7 > > Element 10, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da8,pass8 > > Element 11, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da9,pass9 > > Element 12, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da10,pass10 > > Element 13, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da11,pass11 > > Element 14, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da12,pass12 > > Element 15, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da13,pass13 > > Element 16, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da14,pass14 > > Element 17, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da15,pass15 > > Element 18, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da16,pass16 > > Element 19, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da17,pass17 > > Element 20, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da18,pass18 > > Element 21, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da19,pass19 > > Element 22, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da20,pass20 > > Element 23, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da21,pass21 > > Element 24, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da22,pass22 > > Element 25, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da23,pass23 > > Element 26, Type: SAS Connector > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 27, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 28, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 29, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 30, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 31, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 32, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 33, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 34, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 35, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 36, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 37, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 38, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 39, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 40, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 41, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 42, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 43, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 44, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 45, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 46, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 47, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 48, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 49, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 50, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 51, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 52, Type: > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 53, Type: > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 5C7236P2L5 =20 > > Element 54, Type: Power Supply > > Status: Unsupported (0x00 0x00 0x00 0x80) > > Element 55, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x80) > > Description: 20Delta 5ANLD0C4D3A0XN=20 > > Element 56, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x80) > > Description: 20Delta 5ANLD0C4D3A0XS=20 > > Element 57, Type: Cooling > > Status: OK (0x01 0x00 0x00 0x80) > > Description: B PAVCA0B9V3B0GH =20 > > Extra status: > > - Speed: 0 rpm > > Element 58, Type: Cooling > > Status: Unsupported (0x00 0x02 0x8f 0x02) > > Extra status: > > - Speed: 6550 rpm > > Element 59, Type: Cooling > > Status: Unsupported (0x00 0x02 0x6b 0x02) > > Extra status: > > - Speed: 6190 rpm > > Element 60, Type: Cooling > > Status: OK (0x01 0x00 0x00 0x80) > > Description: B PAVCA0B9V3B0DL =20 > > Extra status: > > - Speed: 0 rpm > > Element 61, Type: Cooling > > Status: Unsupported (0x00 0x02 0xa3 0x02) > > Extra status: > > - Speed: 6750 rpm > > Element 62, Type: Cooling > > Status: Unsupported (0x00 0x02 0x6b 0x02) > > Extra status: > > - Speed: 6190 rpm > > Element 63, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 64, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 014901B0PAZAV0BTM3D3AX 0026 > > Element 65, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 66, Type: SAS Connector > > Status: OK (0x01 0x02 0x00 0x00) > > Element 67, Type: SAS Connector > > Status: OK (0x01 0x02 0x01 0x00) > > Element 68, Type: SAS Connector > > Status: OK (0x01 0x02 0x02 0x00) > > Element 69, Type: SAS Connector > > Status: OK (0x01 0x02 0x03 0x00) > > Element 70, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 71, Type: SAS Connector > > Status: OK (0x01 0x02 0x00 0x00) > > Element 72, Type: SAS Connector > > Status: OK (0x01 0x02 0x01 0x00) > > Element 73, Type: SAS Connector > > Status: OK (0x01 0x02 0x02 0x00) > > Element 74, Type: SAS Connector > > Status: OK (0x01 0x02 0x03 0x00) > > Element 75, Type: SAS Expander > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 76, Type: SAS Expander > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 900080050002 > > Element 77, Type: Display > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 0.107SEGDISP C:03 =20 > > Element 78, Type: Display > > Status: Unsupported (0x00 0x02 0x30 0x00) > > Element 79, Type: Display > > Status: Unsupported (0x00 0x02 0x31 0x00) > > Element 80, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 81, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 82, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 83, Type: Enclosure Services Controller Electronics > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: 0149 0026 > > Element 84, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 85, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x00 0x00) > > Element 86, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x01 0x00) > > Element 87, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x02 0x00) > > Element 88, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x03 0x00) > > Element 89, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 90, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x00 0x00) > > Element 91, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x01 0x00) > > Element 92, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x02 0x00) > > Element 93, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x03 0x00) > > Element 94, Type: SAS Expander > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 95, Type: SAS Expander > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: =20 > > Element 96, Type: Display > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: =20 > > Element 97, Type: Display > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 98, Type: Display > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 99, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 100, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 101, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 102, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 002803D0PARHV0DTM3B0FF =20 > > Element 103, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 104, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 1.02 > > Element 105, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 1.02 > > Element 106, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x30 0x00) > > Extra status: > > - Temperature: 28 C > > Element 107, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x31 0x00) > > Extra status: > > - Temperature: 29 C > > Element 108, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x30 0x00) > > Extra status: > > - Temperature: 28 C > > Element 109, Type: Power Supply > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 110, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x00) > > Element 111, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x00) > >=20 >=20 > --=20 > Alexander Motin --ZPt4rx8FFjLCG7dd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQF8BAEBCgBmBQJYsDxhXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQwNDBGOTgxNzM0NzQ3OEFBNDYyODNGQzVC NjI0OTlBMTQyNEY3RjgxAAoJELYkmaFCT3+BxUsH/0cBA8yVmOWlraHjDZ9kP5/0 kPlMZk0bome+OMyB//7gBDZclI4knu/czveXG0OEng3043aMvf090aTSIHyp+FzE WHyJWEoS4n+xNt2Z/qcHUsGOHVZeobQWZ66n0Z6oluLmK0rII9gJZULMvQnY3ax9 Ve10mbl/6DSqYJ+KiXLemW9R3el1bZi/9KeeyZ+IhAPm42WiaNkw26kGwvMhq9km BD6OIwMOqD3SqeEbqKuUpb/NLQcjd3jtx+MTQSNR2yWM63jB/CGChsakhtsY4ReI vMa/787mDKGiY/ueyPZR0mujRf1iQVru9iW0U18AZoDVKskqvnXQyw3GcwaZasw= =83SZ -----END PGP SIGNATURE----- --ZPt4rx8FFjLCG7dd--