From owner-freebsd-scsi@freebsd.org Fri Feb 24 10:27:49 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E1D70CEB2BB for ; Fri, 24 Feb 2017 10:27:49 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id AE7B8160B; Fri, 24 Feb 2017 10:27:49 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 821) id 0741E7B7F; Fri, 24 Feb 2017 10:27:49 +0000 (UTC) Date: Fri, 24 Feb 2017 10:27:48 +0000 From: John To: FreeBSD-SCSI Subject: sesutil not seeing disk in first bay Message-ID: <20170224102748.GA34792@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="liOOAslEiF7prFVr" Content-Disposition: inline User-Agent: Mutt/1.7.1 (2016-10-04) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 10:27:50 -0000 --liOOAslEiF7prFVr Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi Folks - Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2017. I'm wondering if anyone using sesutil has seen the following issue with an HP D2700 shelf (25 x 600GB SAS drives): sesutil map -u /dev/ses0 ses0: Enclosure Name: HP D2700 SAS AJ941A 0149 Enclosure ID: 5001438023432c00 Element 0, Type: Array Device Slot Status: Unsupported (0x00 0x80 0x00 0x00) Element 1, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Element 2, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da0,pass0 Element 3, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da1,pass1 Element 4, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da2,pass2 ... ... full list below ... Element 25, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da23,pass23 Note Element 1 is an does not contain any device names. Sesutil is getting an ENODEV back from the ioctl requesting the names. In scsi_enc.c the error seems be coming from here: cam_periph_lock(periph); error =3D (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); cam_periph_unlock(periph); which eventually calls cam_periph_list() which "looks" ok to me. I'm wondering if there is some sort of off by 1 error somewhere in the code with respect to how this shelf reports devices and are assigned since da0 is not allocated to the first bay, but instead bay 2. Device da24 (the 25th device) is in the first bay. If I run a dd or iozone to da24 the drive works correctly and the activity light comes on as expected. This process works correctly on a set of supermicro shelves. Any thoughts or pointers? Thanks, John dmesg for da0/da1 (da0:mps0:0:8:0): UNMAPPED da0 at mps0 bus 0 scbus0 target 8 lun 0 da0: Fixed Direct Access SPC-3 SCSI device da0: Serial Number EA01PC91LLBB1239 da0: 600.000MB/s transfers da0: Command Queueing enabled da0: 572325MB (1172123568 512 byte sectors) (da1:mps0:0:9:0): UNMAPPED da1 at mps0 bus 0 scbus0 target 9 lun 0 da1: Fixed Direct Access SPC-3 SCSI device da1: Serial Number EA01PC91LPG91239 da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 572325MB (1172123568 512 byte sectors) # sesutil map -u /dev/ses0=20 ses0: Enclosure Name: HP D2700 SAS AJ941A 0149 Enclosure ID: 5001438023432c00 Element 0, Type: Array Device Slot Status: Unsupported (0x00 0x80 0x00 0x00) Element 1, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Element 2, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da0,pass0 Element 3, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da1,pass1 Element 4, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da2,pass2 Element 5, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da3,pass3 Element 6, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da4,pass4 Element 7, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da5,pass5 Element 8, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da6,pass6 Element 9, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da7,pass7 Element 10, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da8,pass8 Element 11, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da9,pass9 Element 12, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da10,pass10 Element 13, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da11,pass11 Element 14, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da12,pass12 Element 15, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da13,pass13 Element 16, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da14,pass14 Element 17, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da15,pass15 Element 18, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da16,pass16 Element 19, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da17,pass17 Element 20, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da18,pass18 Element 21, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da19,pass19 Element 22, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da20,pass20 Element 23, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da21,pass21 Element 24, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da22,pass22 Element 25, Type: Array Device Slot Status: OK (0x01 0x80 0x00 0x00) Device Names: da23,pass23 Element 26, Type: SAS Connector Status: Unsupported (0x00 0x00 0x00 0x00) Element 27, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 28, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 29, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 30, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 31, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 32, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 33, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 34, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 35, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 36, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 37, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 38, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 39, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 40, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 41, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 42, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 43, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 44, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 45, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 46, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 47, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 48, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 49, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 50, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 51, Type: SAS Connector Status: OK (0x01 0x20 0x00 0x00) Element 52, Type: Status: Unsupported (0x00 0x00 0x00 0x00) Element 53, Type: Status: OK (0x01 0x00 0x00 0x00) Description: 5C7236P2L5 =20 Element 54, Type: Power Supply Status: Unsupported (0x00 0x00 0x00 0x80) Element 55, Type: Power Supply Status: OK (0x01 0x00 0x00 0x80) Description: 20Delta 5ANLD0C4D3A0XN=20 Element 56, Type: Power Supply Status: OK (0x01 0x00 0x00 0x80) Description: 20Delta 5ANLD0C4D3A0XS=20 Element 57, Type: Cooling Status: OK (0x01 0x00 0x00 0x80) Description: B PAVCA0B9V3B0GH =20 Extra status: - Speed: 0 rpm Element 58, Type: Cooling Status: Unsupported (0x00 0x02 0x8f 0x02) Extra status: - Speed: 6550 rpm Element 59, Type: Cooling Status: Unsupported (0x00 0x02 0x6b 0x02) Extra status: - Speed: 6190 rpm Element 60, Type: Cooling Status: OK (0x01 0x00 0x00 0x80) Description: B PAVCA0B9V3B0DL =20 Extra status: - Speed: 0 rpm Element 61, Type: Cooling Status: Unsupported (0x00 0x02 0xa3 0x02) Extra status: - Speed: 6750 rpm Element 62, Type: Cooling Status: Unsupported (0x00 0x02 0x6b 0x02) Extra status: - Speed: 6190 rpm Element 63, Type: Enclosure Services Controller Electronics Status: Unsupported (0x00 0x00 0x00 0x00) Element 64, Type: Enclosure Services Controller Electronics Status: OK (0x01 0x00 0x00 0x00) Description: 014901B0PAZAV0BTM3D3AX 0026 Element 65, Type: SAS Connector Status: Unsupported (0x00 0x02 0x00 0x00) Element 66, Type: SAS Connector Status: OK (0x01 0x02 0x00 0x00) Element 67, Type: SAS Connector Status: OK (0x01 0x02 0x01 0x00) Element 68, Type: SAS Connector Status: OK (0x01 0x02 0x02 0x00) Element 69, Type: SAS Connector Status: OK (0x01 0x02 0x03 0x00) Element 70, Type: SAS Connector Status: Unsupported (0x00 0x02 0x00 0x00) Element 71, Type: SAS Connector Status: OK (0x01 0x02 0x00 0x00) Element 72, Type: SAS Connector Status: OK (0x01 0x02 0x01 0x00) Element 73, Type: SAS Connector Status: OK (0x01 0x02 0x02 0x00) Element 74, Type: SAS Connector Status: OK (0x01 0x02 0x03 0x00) Element 75, Type: SAS Expander Status: Unsupported (0x00 0x00 0x00 0x00) Element 76, Type: SAS Expander Status: OK (0x01 0x00 0x00 0x00) Description: 900080050002 Element 77, Type: Display Status: OK (0x01 0x00 0x00 0x00) Description: 0.107SEGDISP C:03 =20 Element 78, Type: Display Status: Unsupported (0x00 0x02 0x30 0x00) Element 79, Type: Display Status: Unsupported (0x00 0x02 0x31 0x00) Element 80, Type: Temperature Sensors Status: Unsupported (0x00 0x00 0x43 0x00) Extra status: - Temperature: 47 C Element 81, Type: Temperature Sensors Status: OK (0x01 0x00 0x43 0x00) Extra status: - Temperature: 47 C Element 82, Type: Enclosure Services Controller Electronics Status: Unsupported (0x00 0x00 0x00 0x00) Element 83, Type: Enclosure Services Controller Electronics Status: Unknown (0x06 0x00 0x00 0x00) Description: 0149 0026 Element 84, Type: SAS Connector Status: Unsupported (0x00 0x02 0x00 0x00) Element 85, Type: SAS Connector Status: Unknown (0x06 0x02 0x00 0x00) Element 86, Type: SAS Connector Status: Unknown (0x06 0x02 0x01 0x00) Element 87, Type: SAS Connector Status: Unknown (0x06 0x02 0x02 0x00) Element 88, Type: SAS Connector Status: Unknown (0x06 0x02 0x03 0x00) Element 89, Type: SAS Connector Status: Unsupported (0x00 0x02 0x00 0x00) Element 90, Type: SAS Connector Status: Unknown (0x06 0x02 0x00 0x00) Element 91, Type: SAS Connector Status: Unknown (0x06 0x02 0x01 0x00) Element 92, Type: SAS Connector Status: Unknown (0x06 0x02 0x02 0x00) Element 93, Type: SAS Connector Status: Unknown (0x06 0x02 0x03 0x00) Element 94, Type: SAS Expander Status: Unsupported (0x00 0x00 0x00 0x00) Element 95, Type: SAS Expander Status: Unknown (0x06 0x00 0x00 0x00) Description: =20 Element 96, Type: Display Status: Unknown (0x06 0x00 0x00 0x00) Description: =20 Element 97, Type: Display Status: Unsupported (0x00 0x00 0x00 0x00) Element 98, Type: Display Status: Unsupported (0x00 0x00 0x00 0x00) Element 99, Type: Temperature Sensors Status: Unsupported (0x00 0x00 0x43 0x00) Extra status: - Temperature: 47 C Element 100, Type: Temperature Sensors Status: OK (0x01 0x00 0x43 0x00) Extra status: - Temperature: 47 C Element 101, Type: Enclosure Services Controller Electronics Status: Unsupported (0x00 0x00 0x00 0x00) Element 102, Type: Enclosure Services Controller Electronics Status: OK (0x01 0x00 0x00 0x00) Description: 002803D0PARHV0DTM3B0FF =20 Element 103, Type: Enclosure Services Controller Electronics Status: Unsupported (0x00 0x00 0x00 0x00) Element 104, Type: Enclosure Services Controller Electronics Status: OK (0x01 0x00 0x00 0x00) Description: 1.02 Element 105, Type: Enclosure Services Controller Electronics Status: OK (0x01 0x00 0x00 0x00) Description: 1.02 Element 106, Type: Temperature Sensors Status: Unsupported (0x00 0x00 0x30 0x00) Extra status: - Temperature: 28 C Element 107, Type: Temperature Sensors Status: OK (0x01 0x00 0x31 0x00) Extra status: - Temperature: 29 C Element 108, Type: Temperature Sensors Status: OK (0x01 0x00 0x30 0x00) Extra status: - Temperature: 28 C Element 109, Type: Power Supply Status: Unsupported (0x00 0x00 0x00 0x00) Element 110, Type: Power Supply Status: OK (0x01 0x00 0x00 0x00) Element 111, Type: Power Supply Status: OK (0x01 0x00 0x00 0x00) --liOOAslEiF7prFVr Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQF8BAEBCgBmBQJYsAqjXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQwNDBGOTgxNzM0NzQ3OEFBNDYyODNGQzVC NjI0OTlBMTQyNEY3RjgxAAoJELYkmaFCT3+BhgQH/0IgitPZq6M/iCJmZvioWozJ QkGfwuPtxlj1NSWZWQpQceeyMy4FoF1T02wf0LrcqN29IZJEwTGbQM+VxeeG83Av 2jLhX7n1xFpsX+2mNQWOjILccmErj6FvuDRjYTEmpbH3HFGpAYEkJ0OCau0JjNOX 9k+gCp23J1XEjGSmzy53nM5NjmP1ZAj+ZgRwy6ElzDV7qLm1HbbWvN8e40pmEKSX lJRmAK+XuOG0UQwxwjWaIcd0jle2wJGlZ2COdhyIYerZV68UCG4wnxRA/bRegZzO S7kFlYAZ2RsX9/FgZCUDPr3taep6mRi8Rho1b1BQbvKedRM+AbTAyuUFdxXlwwY= =PWBR -----END PGP SIGNATURE----- --liOOAslEiF7prFVr-- From owner-freebsd-scsi@freebsd.org Fri Feb 24 10:33:39 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62EE7CEB53D for ; Fri, 24 Feb 2017 10:33:39 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-lf0-x231.google.com (mail-lf0-x231.google.com [IPv6:2a00:1450:4010:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E5866198C; Fri, 24 Feb 2017 10:33:38 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-lf0-x231.google.com with SMTP id g134so7168452lfe.1; Fri, 24 Feb 2017 02:33:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=XXkIlvVWkBsXNeKnTJRSBXGfXYY9uGWsX9154G71e6c=; b=emvFOrOYdxIH62f9nVy9tJRGqIAZdmyfbSJKzZZBsg6Y8UlBTfW/L1h2Arm1ao+y24 Rc0mr5RHm5sf1HELVx+Z22rcl0vZ+BJOfR5D8iHkyCcs6RTUbG+8eER4Gw4TH0CWKaFy NaCG7vvZqFXZtG/QL2Lq1FEVz1rmzGZT69p7juUhDk0WY6J9AWJpMEmXPUlb0TaNMcbe i2ilb+xacPOsz2aFbrWlmKXUhruTkChELPulXlUYTemaopeQ0K+7X1+V856QVODXcOFY rYo9wbiWaV7JzM9sykWA1JwcTppYt8MB+bH2rtVa3ns603oi6FBgx+v+Xbrc7s/E81zQ j7bA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=XXkIlvVWkBsXNeKnTJRSBXGfXYY9uGWsX9154G71e6c=; b=Y2XnQTl+5HC4/PEuqTAcAdjWTddQFtpUW5m/ynulOcVhf/qs2W/FzEOW2PwGE10jWb ZbyU1xC0tGjMMbMvl5BMXs4zlG7fAo5rkU7pfaTBlfkjse2uj7FCi7UwOrwugE4L9R8g uYdYCAiBxo/13N/8V3zsR+AWCpfWacGY0WYHlCJCTiJziLIpzCBjveGkLVCEHFATGZPf FgdQE1pedQK050+83lhcSAwUQcKvQY+axULfNkaO9E+9VFuqcGlT0sL8q4osMAFqq0hH 4pDpV8Iug/0HvEqYez4CAtmiZlExgwymjSLl7O/lqjlfoU4wIeoQ/W2HDxrus93vsEvf tLyw== X-Gm-Message-State: AMke39liIf6c+ouJkDn56xSqdXXwA2hq9ef8hM6O1Fwpbi+sfGVyiPKnlEdpFD+LHdKMfQ== X-Received: by 10.46.5.135 with SMTP id 129mr357069ljf.66.1487932416735; Fri, 24 Feb 2017 02:33:36 -0800 (PST) Received: from spectre.mavhome.dp.ua ([134.249.139.101]) by smtp.gmail.com with ESMTPSA id f133sm1905787lfg.32.2017.02.24.02.33.35 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 Feb 2017 02:33:35 -0800 (PST) Sender: Alexander Motin Subject: Re: sesutil not seeing disk in first bay To: John , FreeBSD-SCSI References: <20170224102748.GA34792@FreeBSD.org> From: Alexander Motin Message-ID: <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> Date: Fri, 24 Feb 2017 12:33:34 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <20170224102748.GA34792@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 10:33:39 -0000 Hi. I am not sure I completely understand from your description how exactly detected disks match their enclosure slots, but make sure to take a look on this change: https://svnweb.freebsd.org/base?view=revision&revision=308425 On 24.02.2017 12:27, John wrote: > Hi Folks - > > Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2017. > > I'm wondering if anyone using sesutil has seen the following issue > with an HP D2700 shelf (25 x 600GB SAS drives): > > sesutil map -u /dev/ses0 > ses0: > Enclosure Name: HP D2700 SAS AJ941A 0149 > Enclosure ID: 5001438023432c00 > Element 0, Type: Array Device Slot > Status: Unsupported (0x00 0x80 0x00 0x00) > Element 1, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Element 2, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da0,pass0 > Element 3, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da1,pass1 > Element 4, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da2,pass2 > ... > ... full list below > ... > Element 25, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da23,pass23 > > > Note Element 1 is an does not contain any device names. > > Sesutil is getting an ENODEV back from the ioctl requesting the names. > > In scsi_enc.c the error seems be coming from here: > > cam_periph_lock(periph); > error = (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); > cam_periph_unlock(periph); > > which eventually calls cam_periph_list() which "looks" ok to me. > > I'm wondering if there is some sort of off by 1 error somewhere in > the code with respect to how this shelf reports devices and are > assigned since da0 is not allocated to the first bay, but instead bay 2. > > Device da24 (the 25th device) is in the first bay. If I run a dd or > iozone to da24 the drive works correctly and the activity light > comes on as expected. > > This process works correctly on a set of supermicro shelves. > > Any thoughts or pointers? > > Thanks, > John > > dmesg for da0/da1 > > (da0:mps0:0:8:0): UNMAPPED > da0 at mps0 bus 0 scbus0 target 8 lun 0 > da0: Fixed Direct Access SPC-3 SCSI device > da0: Serial Number EA01PC91LLBB1239 > da0: 600.000MB/s transfers > da0: Command Queueing enabled > da0: 572325MB (1172123568 512 byte sectors) > (da1:mps0:0:9:0): UNMAPPED > da1 at mps0 bus 0 scbus0 target 9 lun 0 > da1: Fixed Direct Access SPC-3 SCSI device > da1: Serial Number EA01PC91LPG91239 > da1: 600.000MB/s transfers > da1: Command Queueing enabled > da1: 572325MB (1172123568 512 byte sectors) > > > > # sesutil map -u /dev/ses0 > ses0: > Enclosure Name: HP D2700 SAS AJ941A 0149 > Enclosure ID: 5001438023432c00 > Element 0, Type: Array Device Slot > Status: Unsupported (0x00 0x80 0x00 0x00) > Element 1, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Element 2, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da0,pass0 > Element 3, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da1,pass1 > Element 4, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da2,pass2 > Element 5, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da3,pass3 > Element 6, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da4,pass4 > Element 7, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da5,pass5 > Element 8, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da6,pass6 > Element 9, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da7,pass7 > Element 10, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da8,pass8 > Element 11, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da9,pass9 > Element 12, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da10,pass10 > Element 13, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da11,pass11 > Element 14, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da12,pass12 > Element 15, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da13,pass13 > Element 16, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da14,pass14 > Element 17, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da15,pass15 > Element 18, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da16,pass16 > Element 19, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da17,pass17 > Element 20, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da18,pass18 > Element 21, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da19,pass19 > Element 22, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da20,pass20 > Element 23, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da21,pass21 > Element 24, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da22,pass22 > Element 25, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da23,pass23 > Element 26, Type: SAS Connector > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 27, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 28, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 29, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 30, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 31, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 32, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 33, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 34, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 35, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 36, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 37, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 38, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 39, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 40, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 41, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 42, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 43, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 44, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 45, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 46, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 47, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 48, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 49, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 50, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 51, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 52, Type: > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 53, Type: > Status: OK (0x01 0x00 0x00 0x00) > Description: 5C7236P2L5 > Element 54, Type: Power Supply > Status: Unsupported (0x00 0x00 0x00 0x80) > Element 55, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x80) > Description: 20Delta 5ANLD0C4D3A0XN > Element 56, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x80) > Description: 20Delta 5ANLD0C4D3A0XS > Element 57, Type: Cooling > Status: OK (0x01 0x00 0x00 0x80) > Description: B PAVCA0B9V3B0GH > Extra status: > - Speed: 0 rpm > Element 58, Type: Cooling > Status: Unsupported (0x00 0x02 0x8f 0x02) > Extra status: > - Speed: 6550 rpm > Element 59, Type: Cooling > Status: Unsupported (0x00 0x02 0x6b 0x02) > Extra status: > - Speed: 6190 rpm > Element 60, Type: Cooling > Status: OK (0x01 0x00 0x00 0x80) > Description: B PAVCA0B9V3B0DL > Extra status: > - Speed: 0 rpm > Element 61, Type: Cooling > Status: Unsupported (0x00 0x02 0xa3 0x02) > Extra status: > - Speed: 6750 rpm > Element 62, Type: Cooling > Status: Unsupported (0x00 0x02 0x6b 0x02) > Extra status: > - Speed: 6190 rpm > Element 63, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 64, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 014901B0PAZAV0BTM3D3AX 0026 > Element 65, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 66, Type: SAS Connector > Status: OK (0x01 0x02 0x00 0x00) > Element 67, Type: SAS Connector > Status: OK (0x01 0x02 0x01 0x00) > Element 68, Type: SAS Connector > Status: OK (0x01 0x02 0x02 0x00) > Element 69, Type: SAS Connector > Status: OK (0x01 0x02 0x03 0x00) > Element 70, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 71, Type: SAS Connector > Status: OK (0x01 0x02 0x00 0x00) > Element 72, Type: SAS Connector > Status: OK (0x01 0x02 0x01 0x00) > Element 73, Type: SAS Connector > Status: OK (0x01 0x02 0x02 0x00) > Element 74, Type: SAS Connector > Status: OK (0x01 0x02 0x03 0x00) > Element 75, Type: SAS Expander > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 76, Type: SAS Expander > Status: OK (0x01 0x00 0x00 0x00) > Description: 900080050002 > Element 77, Type: Display > Status: OK (0x01 0x00 0x00 0x00) > Description: 0.107SEGDISP C:03 > Element 78, Type: Display > Status: Unsupported (0x00 0x02 0x30 0x00) > Element 79, Type: Display > Status: Unsupported (0x00 0x02 0x31 0x00) > Element 80, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 81, Type: Temperature Sensors > Status: OK (0x01 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 82, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 83, Type: Enclosure Services Controller Electronics > Status: Unknown (0x06 0x00 0x00 0x00) > Description: 0149 0026 > Element 84, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 85, Type: SAS Connector > Status: Unknown (0x06 0x02 0x00 0x00) > Element 86, Type: SAS Connector > Status: Unknown (0x06 0x02 0x01 0x00) > Element 87, Type: SAS Connector > Status: Unknown (0x06 0x02 0x02 0x00) > Element 88, Type: SAS Connector > Status: Unknown (0x06 0x02 0x03 0x00) > Element 89, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 90, Type: SAS Connector > Status: Unknown (0x06 0x02 0x00 0x00) > Element 91, Type: SAS Connector > Status: Unknown (0x06 0x02 0x01 0x00) > Element 92, Type: SAS Connector > Status: Unknown (0x06 0x02 0x02 0x00) > Element 93, Type: SAS Connector > Status: Unknown (0x06 0x02 0x03 0x00) > Element 94, Type: SAS Expander > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 95, Type: SAS Expander > Status: Unknown (0x06 0x00 0x00 0x00) > Description: > Element 96, Type: Display > Status: Unknown (0x06 0x00 0x00 0x00) > Description: > Element 97, Type: Display > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 98, Type: Display > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 99, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 100, Type: Temperature Sensors > Status: OK (0x01 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 101, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 102, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 002803D0PARHV0DTM3B0FF > Element 103, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 104, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 1.02 > Element 105, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 1.02 > Element 106, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x30 0x00) > Extra status: > - Temperature: 28 C > Element 107, Type: Temperature Sensors > Status: OK (0x01 0x00 0x31 0x00) > Extra status: > - Temperature: 29 C > Element 108, Type: Temperature Sensors > Status: OK (0x01 0x00 0x30 0x00) > Extra status: > - Temperature: 28 C > Element 109, Type: Power Supply > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 110, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x00) > Element 111, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x00) > -- Alexander Motin From owner-freebsd-scsi@freebsd.org Fri Feb 24 14:00:04 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 21604CEB825 for ; Fri, 24 Feb 2017 14:00:04 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CC4DB7E8; Fri, 24 Feb 2017 14:00:03 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 821) id 16AB71BFF; Fri, 24 Feb 2017 14:00:02 +0000 (UTC) Date: Fri, 24 Feb 2017 14:00:02 +0000 From: John To: Alexander Motin Cc: FreeBSD-SCSI Subject: Re: sesutil not seeing disk in first bay Message-ID: <20170224140002.GA77466@FreeBSD.org> References: <20170224102748.GA34792@FreeBSD.org> <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ZPt4rx8FFjLCG7dd" Content-Disposition: inline In-Reply-To: <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> User-Agent: Mutt/1.7.1 (2016-10-04) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 14:00:04 -0000 --ZPt4rx8FFjLCG7dd Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable ----- Alexander Motin's Original Message ----- > Hi. >=20 > I am not sure I completely understand from your description how exactly > detected disks match their enclosure slots, but make sure to take a look > on this change: > https://svnweb.freebsd.org/base?view=3Drevision&revision=3D308425 Yes - this patch is on my system. To phrase it differently - the shelf contains 25 drives. Disks da0 through da23 show up via sesutil: # sesutil map -u /dev/ses0 | grep da Device Names: da0,pass0 Device Names: da1,pass1 Device Names: da2,pass2 Device Names: da3,pass3 Device Names: da4,pass4 Device Names: da5,pass5 Device Names: da6,pass6 Device Names: da7,pass7 Device Names: da8,pass8 Device Names: da9,pass9 Device Names: da10,pass10 Device Names: da11,pass11 Device Names: da12,pass12 Device Names: da13,pass13 Device Names: da14,pass14 Device Names: da15,pass15 Device Names: da16,pass16 Device Names: da17,pass17 Device Names: da18,pass18 Device Names: da19,pass19 Device Names: da20,pass20 Device Names: da21,pass21 Device Names: da22,pass22 Device Names: da23,pass23 Disk da24 does not show up but is present in the first bay. da0 is in bay 2, etc. I hope this helps. Thanks, John > On 24.02.2017 12:27, John wrote: > > Hi Folks - > >=20 > > Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2= 017. > >=20 > > I'm wondering if anyone using sesutil has seen the following issue > > with an HP D2700 shelf (25 x 600GB SAS drives): > >=20 > > sesutil map -u /dev/ses0 > > ses0: > > Enclosure Name: HP D2700 SAS AJ941A 0149 > > Enclosure ID: 5001438023432c00 > > Element 0, Type: Array Device Slot > > Status: Unsupported (0x00 0x80 0x00 0x00) > > Element 1, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Element 2, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da0,pass0 > > Element 3, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da1,pass1 > > Element 4, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da2,pass2 > > ... > > ... full list below > > ... > > Element 25, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da23,pass23 > >=20 > >=20 > > Note Element 1 is an does not contain any device names. > >=20 > > Sesutil is getting an ENODEV back from the ioctl requesting the names. > >=20 > > In scsi_enc.c the error seems be coming from here: > >=20 > > cam_periph_lock(periph); > > error =3D (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); > > cam_periph_unlock(periph); > >=20 > > which eventually calls cam_periph_list() which "looks" ok to me. > >=20 > > I'm wondering if there is some sort of off by 1 error somewhere in > > the code with respect to how this shelf reports devices and are > > assigned since da0 is not allocated to the first bay, but instead bay 2. > >=20 > > Device da24 (the 25th device) is in the first bay. If I run a dd or > > iozone to da24 the drive works correctly and the activity light > > comes on as expected. > >=20 > > This process works correctly on a set of supermicro shelves. > >=20 > > Any thoughts or pointers? > >=20 > > Thanks, > > John > >=20 > > dmesg for da0/da1 > >=20 > > (da0:mps0:0:8:0): UNMAPPED > > da0 at mps0 bus 0 scbus0 target 8 lun 0 > > da0: Fixed Direct Access SPC-3 SCSI device > > da0: Serial Number EA01PC91LLBB1239 > > da0: 600.000MB/s transfers > > da0: Command Queueing enabled > > da0: 572325MB (1172123568 512 byte sectors) > > (da1:mps0:0:9:0): UNMAPPED > > da1 at mps0 bus 0 scbus0 target 9 lun 0 > > da1: Fixed Direct Access SPC-3 SCSI device > > da1: Serial Number EA01PC91LPG91239 > > da1: 600.000MB/s transfers > > da1: Command Queueing enabled > > da1: 572325MB (1172123568 512 byte sectors) > >=20 > >=20 > >=20 > > # sesutil map -u /dev/ses0=20 > > ses0: > > Enclosure Name: HP D2700 SAS AJ941A 0149 > > Enclosure ID: 5001438023432c00 > > Element 0, Type: Array Device Slot > > Status: Unsupported (0x00 0x80 0x00 0x00) > > Element 1, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Element 2, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da0,pass0 > > Element 3, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da1,pass1 > > Element 4, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da2,pass2 > > Element 5, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da3,pass3 > > Element 6, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da4,pass4 > > Element 7, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da5,pass5 > > Element 8, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da6,pass6 > > Element 9, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da7,pass7 > > Element 10, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da8,pass8 > > Element 11, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da9,pass9 > > Element 12, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da10,pass10 > > Element 13, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da11,pass11 > > Element 14, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da12,pass12 > > Element 15, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da13,pass13 > > Element 16, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da14,pass14 > > Element 17, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da15,pass15 > > Element 18, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da16,pass16 > > Element 19, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da17,pass17 > > Element 20, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da18,pass18 > > Element 21, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da19,pass19 > > Element 22, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da20,pass20 > > Element 23, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da21,pass21 > > Element 24, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da22,pass22 > > Element 25, Type: Array Device Slot > > Status: OK (0x01 0x80 0x00 0x00) > > Device Names: da23,pass23 > > Element 26, Type: SAS Connector > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 27, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 28, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 29, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 30, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 31, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 32, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 33, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 34, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 35, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 36, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 37, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 38, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 39, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 40, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 41, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 42, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 43, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 44, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 45, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 46, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 47, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 48, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 49, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 50, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 51, Type: SAS Connector > > Status: OK (0x01 0x20 0x00 0x00) > > Element 52, Type: > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 53, Type: > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 5C7236P2L5 =20 > > Element 54, Type: Power Supply > > Status: Unsupported (0x00 0x00 0x00 0x80) > > Element 55, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x80) > > Description: 20Delta 5ANLD0C4D3A0XN=20 > > Element 56, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x80) > > Description: 20Delta 5ANLD0C4D3A0XS=20 > > Element 57, Type: Cooling > > Status: OK (0x01 0x00 0x00 0x80) > > Description: B PAVCA0B9V3B0GH =20 > > Extra status: > > - Speed: 0 rpm > > Element 58, Type: Cooling > > Status: Unsupported (0x00 0x02 0x8f 0x02) > > Extra status: > > - Speed: 6550 rpm > > Element 59, Type: Cooling > > Status: Unsupported (0x00 0x02 0x6b 0x02) > > Extra status: > > - Speed: 6190 rpm > > Element 60, Type: Cooling > > Status: OK (0x01 0x00 0x00 0x80) > > Description: B PAVCA0B9V3B0DL =20 > > Extra status: > > - Speed: 0 rpm > > Element 61, Type: Cooling > > Status: Unsupported (0x00 0x02 0xa3 0x02) > > Extra status: > > - Speed: 6750 rpm > > Element 62, Type: Cooling > > Status: Unsupported (0x00 0x02 0x6b 0x02) > > Extra status: > > - Speed: 6190 rpm > > Element 63, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 64, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 014901B0PAZAV0BTM3D3AX 0026 > > Element 65, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 66, Type: SAS Connector > > Status: OK (0x01 0x02 0x00 0x00) > > Element 67, Type: SAS Connector > > Status: OK (0x01 0x02 0x01 0x00) > > Element 68, Type: SAS Connector > > Status: OK (0x01 0x02 0x02 0x00) > > Element 69, Type: SAS Connector > > Status: OK (0x01 0x02 0x03 0x00) > > Element 70, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 71, Type: SAS Connector > > Status: OK (0x01 0x02 0x00 0x00) > > Element 72, Type: SAS Connector > > Status: OK (0x01 0x02 0x01 0x00) > > Element 73, Type: SAS Connector > > Status: OK (0x01 0x02 0x02 0x00) > > Element 74, Type: SAS Connector > > Status: OK (0x01 0x02 0x03 0x00) > > Element 75, Type: SAS Expander > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 76, Type: SAS Expander > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 900080050002 > > Element 77, Type: Display > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 0.107SEGDISP C:03 =20 > > Element 78, Type: Display > > Status: Unsupported (0x00 0x02 0x30 0x00) > > Element 79, Type: Display > > Status: Unsupported (0x00 0x02 0x31 0x00) > > Element 80, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 81, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 82, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 83, Type: Enclosure Services Controller Electronics > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: 0149 0026 > > Element 84, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 85, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x00 0x00) > > Element 86, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x01 0x00) > > Element 87, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x02 0x00) > > Element 88, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x03 0x00) > > Element 89, Type: SAS Connector > > Status: Unsupported (0x00 0x02 0x00 0x00) > > Element 90, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x00 0x00) > > Element 91, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x01 0x00) > > Element 92, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x02 0x00) > > Element 93, Type: SAS Connector > > Status: Unknown (0x06 0x02 0x03 0x00) > > Element 94, Type: SAS Expander > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 95, Type: SAS Expander > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: =20 > > Element 96, Type: Display > > Status: Unknown (0x06 0x00 0x00 0x00) > > Description: =20 > > Element 97, Type: Display > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 98, Type: Display > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 99, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 100, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x43 0x00) > > Extra status: > > - Temperature: 47 C > > Element 101, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 102, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 002803D0PARHV0DTM3B0FF =20 > > Element 103, Type: Enclosure Services Controller Electronics > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 104, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 1.02 > > Element 105, Type: Enclosure Services Controller Electronics > > Status: OK (0x01 0x00 0x00 0x00) > > Description: 1.02 > > Element 106, Type: Temperature Sensors > > Status: Unsupported (0x00 0x00 0x30 0x00) > > Extra status: > > - Temperature: 28 C > > Element 107, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x31 0x00) > > Extra status: > > - Temperature: 29 C > > Element 108, Type: Temperature Sensors > > Status: OK (0x01 0x00 0x30 0x00) > > Extra status: > > - Temperature: 28 C > > Element 109, Type: Power Supply > > Status: Unsupported (0x00 0x00 0x00 0x00) > > Element 110, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x00) > > Element 111, Type: Power Supply > > Status: OK (0x01 0x00 0x00 0x00) > >=20 >=20 > --=20 > Alexander Motin --ZPt4rx8FFjLCG7dd Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQF8BAEBCgBmBQJYsDxhXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQwNDBGOTgxNzM0NzQ3OEFBNDYyODNGQzVC NjI0OTlBMTQyNEY3RjgxAAoJELYkmaFCT3+BxUsH/0cBA8yVmOWlraHjDZ9kP5/0 kPlMZk0bome+OMyB//7gBDZclI4knu/czveXG0OEng3043aMvf090aTSIHyp+FzE WHyJWEoS4n+xNt2Z/qcHUsGOHVZeobQWZ66n0Z6oluLmK0rII9gJZULMvQnY3ax9 Ve10mbl/6DSqYJ+KiXLemW9R3el1bZi/9KeeyZ+IhAPm42WiaNkw26kGwvMhq9km BD6OIwMOqD3SqeEbqKuUpb/NLQcjd3jtx+MTQSNR2yWM63jB/CGChsakhtsY4ReI vMa/787mDKGiY/ueyPZR0mujRf1iQVru9iW0U18AZoDVKskqvnXQyw3GcwaZasw= =83SZ -----END PGP SIGNATURE----- --ZPt4rx8FFjLCG7dd-- From owner-freebsd-scsi@freebsd.org Fri Feb 24 15:52:11 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 86A54CEB905 for ; Fri, 24 Feb 2017 15:52:11 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-yw0-x22a.google.com (mail-yw0-x22a.google.com [IPv6:2607:f8b0:4002:c05::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4E7521670; Fri, 24 Feb 2017 15:52:11 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-yw0-x22a.google.com with SMTP id p77so11556105ywg.1; Fri, 24 Feb 2017 07:52:11 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=kI3XzLy4lspf3APmZBuQzD/YoCi9RRicjmrar8+v/Kc=; b=aje2i8mYmCx0j7AYifrKPRRfXsAZvNoIL3bphGQRhK6mZUh79q5erF/dvzlKH8txYG rIM1riK2ZiAZ41seczAQg3RTDzQv3nrj6luxKqHTO8gcfj4sgBHX/u5zW0oxFxopop65 AITgMmlE2fvpRTisq7vJ/A+IBQWokuAYA6fdlaGdEdqEDfu7S6pTY6VwRnt9YsgxRqr4 kB3sqr7YUBu8w7ZP7C7ySsmmYyMaFZLHA8rO7qbtL2meKfRnlUjTGH/wQu+xQo64MY4f HinGstIrAGUGLnf/Z+yZBA5ILUiThXoDaJDpfdnSFprF86HCbCBqohzxi9bIkqik5Zjk ibdw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=kI3XzLy4lspf3APmZBuQzD/YoCi9RRicjmrar8+v/Kc=; b=m9slEA2fjwCzLv7UIznSLXYk20QyOILq1TRA7sKjM8rkhVmMhNMKJeRD1+znk5TjLw EoI7eXlG0wLYh7wWXGGbmTrQwTyC3rXepjDwFv00loawNUQOmtVafwovcOPe7nBekj+6 mJksjEUHVjMtSCWypnwAhhk96cLcji7PK1RvhcBhEned5b7hZOUnOws085hILTMxIDlM swapFgK3cUk8WKhwH7QQtq0OiUh8NbknqMn+ieNtdi8kKq5+0J3f5I6wnw3/O570c9aT ozKSlysVyMMeHkLmPC6IsOMBPziEbzqO2PqLvaiq5wOwStwxw5SlSZVMTmeCrCNSpstN I9iw== X-Gm-Message-State: AMke39nv56NQQNAsvFacwlT55m5e+IqY7m8sVCxg9/He6vel6bUyMBEQpk+Njuawi5Bs38Aw/gWhsCwXwAeeXw== X-Received: by 10.129.141.6 with SMTP id d6mr2029303ywg.36.1487951530064; Fri, 24 Feb 2017 07:52:10 -0800 (PST) MIME-Version: 1.0 Sender: asomers@gmail.com Received: by 10.129.38.133 with HTTP; Fri, 24 Feb 2017 07:52:09 -0800 (PST) In-Reply-To: <20170224140002.GA77466@FreeBSD.org> References: <20170224102748.GA34792@FreeBSD.org> <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> <20170224140002.GA77466@FreeBSD.org> From: Alan Somers Date: Fri, 24 Feb 2017 08:52:09 -0700 X-Google-Sender-Auth: yRIHcVBStfHPCybwZ_acmh4eAhc Message-ID: Subject: Re: sesutil not seeing disk in first bay To: John Cc: Alexander Motin , FreeBSD-SCSI Content-Type: text/plain; charset=UTF-8 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 15:52:11 -0000 Hard to say whether the problem is in sesutil or in your expander's firmware. Could you please install sysutils/sg3_utils and run "sg_ses -p2 /dev/ses0" and "sg_ses -p10 /dev/ses0" ? -Alan On Fri, Feb 24, 2017 at 7:00 AM, John wrote: > ----- Alexander Motin's Original Message ----- >> Hi. >> >> I am not sure I completely understand from your description how exactly >> detected disks match their enclosure slots, but make sure to take a look >> on this change: >> https://svnweb.freebsd.org/base?view=revision&revision=308425 > > Yes - this patch is on my system. > > To phrase it differently - the shelf contains 25 drives. Disks da0 > through da23 show up via sesutil: > > # sesutil map -u /dev/ses0 | grep da > Device Names: da0,pass0 > Device Names: da1,pass1 > Device Names: da2,pass2 > Device Names: da3,pass3 > Device Names: da4,pass4 > Device Names: da5,pass5 > Device Names: da6,pass6 > Device Names: da7,pass7 > Device Names: da8,pass8 > Device Names: da9,pass9 > Device Names: da10,pass10 > Device Names: da11,pass11 > Device Names: da12,pass12 > Device Names: da13,pass13 > Device Names: da14,pass14 > Device Names: da15,pass15 > Device Names: da16,pass16 > Device Names: da17,pass17 > Device Names: da18,pass18 > Device Names: da19,pass19 > Device Names: da20,pass20 > Device Names: da21,pass21 > Device Names: da22,pass22 > Device Names: da23,pass23 > > Disk da24 does not show up but is present in the first bay. da0 > is in bay 2, etc. > > I hope this helps. > > Thanks, > John > >> On 24.02.2017 12:27, John wrote: >> > Hi Folks - >> > >> > Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2017. >> > >> > I'm wondering if anyone using sesutil has seen the following issue >> > with an HP D2700 shelf (25 x 600GB SAS drives): >> > >> > sesutil map -u /dev/ses0 >> > ses0: >> > Enclosure Name: HP D2700 SAS AJ941A 0149 >> > Enclosure ID: 5001438023432c00 >> > Element 0, Type: Array Device Slot >> > Status: Unsupported (0x00 0x80 0x00 0x00) >> > Element 1, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Element 2, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da0,pass0 >> > Element 3, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da1,pass1 >> > Element 4, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da2,pass2 >> > ... >> > ... full list below >> > ... >> > Element 25, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da23,pass23 >> > >> > >> > Note Element 1 is an does not contain any device names. >> > >> > Sesutil is getting an ENODEV back from the ioctl requesting the names. >> > >> > In scsi_enc.c the error seems be coming from here: >> > >> > cam_periph_lock(periph); >> > error = (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); >> > cam_periph_unlock(periph); >> > >> > which eventually calls cam_periph_list() which "looks" ok to me. >> > >> > I'm wondering if there is some sort of off by 1 error somewhere in >> > the code with respect to how this shelf reports devices and are >> > assigned since da0 is not allocated to the first bay, but instead bay 2. >> > >> > Device da24 (the 25th device) is in the first bay. If I run a dd or >> > iozone to da24 the drive works correctly and the activity light >> > comes on as expected. >> > >> > This process works correctly on a set of supermicro shelves. >> > >> > Any thoughts or pointers? >> > >> > Thanks, >> > John >> > >> > dmesg for da0/da1 >> > >> > (da0:mps0:0:8:0): UNMAPPED >> > da0 at mps0 bus 0 scbus0 target 8 lun 0 >> > da0: Fixed Direct Access SPC-3 SCSI device >> > da0: Serial Number EA01PC91LLBB1239 >> > da0: 600.000MB/s transfers >> > da0: Command Queueing enabled >> > da0: 572325MB (1172123568 512 byte sectors) >> > (da1:mps0:0:9:0): UNMAPPED >> > da1 at mps0 bus 0 scbus0 target 9 lun 0 >> > da1: Fixed Direct Access SPC-3 SCSI device >> > da1: Serial Number EA01PC91LPG91239 >> > da1: 600.000MB/s transfers >> > da1: Command Queueing enabled >> > da1: 572325MB (1172123568 512 byte sectors) >> > >> > >> > >> > # sesutil map -u /dev/ses0 >> > ses0: >> > Enclosure Name: HP D2700 SAS AJ941A 0149 >> > Enclosure ID: 5001438023432c00 >> > Element 0, Type: Array Device Slot >> > Status: Unsupported (0x00 0x80 0x00 0x00) >> > Element 1, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Element 2, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da0,pass0 >> > Element 3, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da1,pass1 >> > Element 4, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da2,pass2 >> > Element 5, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da3,pass3 >> > Element 6, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da4,pass4 >> > Element 7, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da5,pass5 >> > Element 8, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da6,pass6 >> > Element 9, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da7,pass7 >> > Element 10, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da8,pass8 >> > Element 11, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da9,pass9 >> > Element 12, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da10,pass10 >> > Element 13, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da11,pass11 >> > Element 14, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da12,pass12 >> > Element 15, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da13,pass13 >> > Element 16, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da14,pass14 >> > Element 17, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da15,pass15 >> > Element 18, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da16,pass16 >> > Element 19, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da17,pass17 >> > Element 20, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da18,pass18 >> > Element 21, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da19,pass19 >> > Element 22, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da20,pass20 >> > Element 23, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da21,pass21 >> > Element 24, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da22,pass22 >> > Element 25, Type: Array Device Slot >> > Status: OK (0x01 0x80 0x00 0x00) >> > Device Names: da23,pass23 >> > Element 26, Type: SAS Connector >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 27, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 28, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 29, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 30, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 31, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 32, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 33, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 34, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 35, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 36, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 37, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 38, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 39, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 40, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 41, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 42, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 43, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 44, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 45, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 46, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 47, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 48, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 49, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 50, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 51, Type: SAS Connector >> > Status: OK (0x01 0x20 0x00 0x00) >> > Element 52, Type: >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 53, Type: >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 5C7236P2L5 >> > Element 54, Type: Power Supply >> > Status: Unsupported (0x00 0x00 0x00 0x80) >> > Element 55, Type: Power Supply >> > Status: OK (0x01 0x00 0x00 0x80) >> > Description: 20Delta 5ANLD0C4D3A0XN >> > Element 56, Type: Power Supply >> > Status: OK (0x01 0x00 0x00 0x80) >> > Description: 20Delta 5ANLD0C4D3A0XS >> > Element 57, Type: Cooling >> > Status: OK (0x01 0x00 0x00 0x80) >> > Description: B PAVCA0B9V3B0GH >> > Extra status: >> > - Speed: 0 rpm >> > Element 58, Type: Cooling >> > Status: Unsupported (0x00 0x02 0x8f 0x02) >> > Extra status: >> > - Speed: 6550 rpm >> > Element 59, Type: Cooling >> > Status: Unsupported (0x00 0x02 0x6b 0x02) >> > Extra status: >> > - Speed: 6190 rpm >> > Element 60, Type: Cooling >> > Status: OK (0x01 0x00 0x00 0x80) >> > Description: B PAVCA0B9V3B0DL >> > Extra status: >> > - Speed: 0 rpm >> > Element 61, Type: Cooling >> > Status: Unsupported (0x00 0x02 0xa3 0x02) >> > Extra status: >> > - Speed: 6750 rpm >> > Element 62, Type: Cooling >> > Status: Unsupported (0x00 0x02 0x6b 0x02) >> > Extra status: >> > - Speed: 6190 rpm >> > Element 63, Type: Enclosure Services Controller Electronics >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 64, Type: Enclosure Services Controller Electronics >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 014901B0PAZAV0BTM3D3AX 0026 >> > Element 65, Type: SAS Connector >> > Status: Unsupported (0x00 0x02 0x00 0x00) >> > Element 66, Type: SAS Connector >> > Status: OK (0x01 0x02 0x00 0x00) >> > Element 67, Type: SAS Connector >> > Status: OK (0x01 0x02 0x01 0x00) >> > Element 68, Type: SAS Connector >> > Status: OK (0x01 0x02 0x02 0x00) >> > Element 69, Type: SAS Connector >> > Status: OK (0x01 0x02 0x03 0x00) >> > Element 70, Type: SAS Connector >> > Status: Unsupported (0x00 0x02 0x00 0x00) >> > Element 71, Type: SAS Connector >> > Status: OK (0x01 0x02 0x00 0x00) >> > Element 72, Type: SAS Connector >> > Status: OK (0x01 0x02 0x01 0x00) >> > Element 73, Type: SAS Connector >> > Status: OK (0x01 0x02 0x02 0x00) >> > Element 74, Type: SAS Connector >> > Status: OK (0x01 0x02 0x03 0x00) >> > Element 75, Type: SAS Expander >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 76, Type: SAS Expander >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 900080050002 >> > Element 77, Type: Display >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 0.107SEGDISP C:03 >> > Element 78, Type: Display >> > Status: Unsupported (0x00 0x02 0x30 0x00) >> > Element 79, Type: Display >> > Status: Unsupported (0x00 0x02 0x31 0x00) >> > Element 80, Type: Temperature Sensors >> > Status: Unsupported (0x00 0x00 0x43 0x00) >> > Extra status: >> > - Temperature: 47 C >> > Element 81, Type: Temperature Sensors >> > Status: OK (0x01 0x00 0x43 0x00) >> > Extra status: >> > - Temperature: 47 C >> > Element 82, Type: Enclosure Services Controller Electronics >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 83, Type: Enclosure Services Controller Electronics >> > Status: Unknown (0x06 0x00 0x00 0x00) >> > Description: 0149 0026 >> > Element 84, Type: SAS Connector >> > Status: Unsupported (0x00 0x02 0x00 0x00) >> > Element 85, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x00 0x00) >> > Element 86, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x01 0x00) >> > Element 87, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x02 0x00) >> > Element 88, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x03 0x00) >> > Element 89, Type: SAS Connector >> > Status: Unsupported (0x00 0x02 0x00 0x00) >> > Element 90, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x00 0x00) >> > Element 91, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x01 0x00) >> > Element 92, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x02 0x00) >> > Element 93, Type: SAS Connector >> > Status: Unknown (0x06 0x02 0x03 0x00) >> > Element 94, Type: SAS Expander >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 95, Type: SAS Expander >> > Status: Unknown (0x06 0x00 0x00 0x00) >> > Description: >> > Element 96, Type: Display >> > Status: Unknown (0x06 0x00 0x00 0x00) >> > Description: >> > Element 97, Type: Display >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 98, Type: Display >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 99, Type: Temperature Sensors >> > Status: Unsupported (0x00 0x00 0x43 0x00) >> > Extra status: >> > - Temperature: 47 C >> > Element 100, Type: Temperature Sensors >> > Status: OK (0x01 0x00 0x43 0x00) >> > Extra status: >> > - Temperature: 47 C >> > Element 101, Type: Enclosure Services Controller Electronics >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 102, Type: Enclosure Services Controller Electronics >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 002803D0PARHV0DTM3B0FF >> > Element 103, Type: Enclosure Services Controller Electronics >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 104, Type: Enclosure Services Controller Electronics >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 1.02 >> > Element 105, Type: Enclosure Services Controller Electronics >> > Status: OK (0x01 0x00 0x00 0x00) >> > Description: 1.02 >> > Element 106, Type: Temperature Sensors >> > Status: Unsupported (0x00 0x00 0x30 0x00) >> > Extra status: >> > - Temperature: 28 C >> > Element 107, Type: Temperature Sensors >> > Status: OK (0x01 0x00 0x31 0x00) >> > Extra status: >> > - Temperature: 29 C >> > Element 108, Type: Temperature Sensors >> > Status: OK (0x01 0x00 0x30 0x00) >> > Extra status: >> > - Temperature: 28 C >> > Element 109, Type: Power Supply >> > Status: Unsupported (0x00 0x00 0x00 0x00) >> > Element 110, Type: Power Supply >> > Status: OK (0x01 0x00 0x00 0x00) >> > Element 111, Type: Power Supply >> > Status: OK (0x01 0x00 0x00 0x00) >> > >> >> -- >> Alexander Motin