From owner-freebsd-scsi@freebsd.org Fri Feb 24 10:33:39 2017 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 62EE7CEB53D for ; Fri, 24 Feb 2017 10:33:39 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: from mail-lf0-x231.google.com (mail-lf0-x231.google.com [IPv6:2a00:1450:4010:c07::231]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E5866198C; Fri, 24 Feb 2017 10:33:38 +0000 (UTC) (envelope-from mavbsd@gmail.com) Received: by mail-lf0-x231.google.com with SMTP id g134so7168452lfe.1; Fri, 24 Feb 2017 02:33:38 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=sender:subject:to:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-transfer-encoding; bh=XXkIlvVWkBsXNeKnTJRSBXGfXYY9uGWsX9154G71e6c=; b=emvFOrOYdxIH62f9nVy9tJRGqIAZdmyfbSJKzZZBsg6Y8UlBTfW/L1h2Arm1ao+y24 Rc0mr5RHm5sf1HELVx+Z22rcl0vZ+BJOfR5D8iHkyCcs6RTUbG+8eER4Gw4TH0CWKaFy NaCG7vvZqFXZtG/QL2Lq1FEVz1rmzGZT69p7juUhDk0WY6J9AWJpMEmXPUlb0TaNMcbe i2ilb+xacPOsz2aFbrWlmKXUhruTkChELPulXlUYTemaopeQ0K+7X1+V856QVODXcOFY rYo9wbiWaV7JzM9sykWA1JwcTppYt8MB+bH2rtVa3ns603oi6FBgx+v+Xbrc7s/E81zQ j7bA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:subject:to:references:from:message-id :date:user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=XXkIlvVWkBsXNeKnTJRSBXGfXYY9uGWsX9154G71e6c=; b=Y2XnQTl+5HC4/PEuqTAcAdjWTddQFtpUW5m/ynulOcVhf/qs2W/FzEOW2PwGE10jWb ZbyU1xC0tGjMMbMvl5BMXs4zlG7fAo5rkU7pfaTBlfkjse2uj7FCi7UwOrwugE4L9R8g uYdYCAiBxo/13N/8V3zsR+AWCpfWacGY0WYHlCJCTiJziLIpzCBjveGkLVCEHFATGZPf FgdQE1pedQK050+83lhcSAwUQcKvQY+axULfNkaO9E+9VFuqcGlT0sL8q4osMAFqq0hH 4pDpV8Iug/0HvEqYez4CAtmiZlExgwymjSLl7O/lqjlfoU4wIeoQ/W2HDxrus93vsEvf tLyw== X-Gm-Message-State: AMke39liIf6c+ouJkDn56xSqdXXwA2hq9ef8hM6O1Fwpbi+sfGVyiPKnlEdpFD+LHdKMfQ== X-Received: by 10.46.5.135 with SMTP id 129mr357069ljf.66.1487932416735; Fri, 24 Feb 2017 02:33:36 -0800 (PST) Received: from spectre.mavhome.dp.ua ([134.249.139.101]) by smtp.gmail.com with ESMTPSA id f133sm1905787lfg.32.2017.02.24.02.33.35 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 24 Feb 2017 02:33:35 -0800 (PST) Sender: Alexander Motin Subject: Re: sesutil not seeing disk in first bay To: John , FreeBSD-SCSI References: <20170224102748.GA34792@FreeBSD.org> From: Alexander Motin Message-ID: <0fec6ff8-ede3-d74d-0b81-6ed7e80dfc6d@FreeBSD.org> Date: Fri, 24 Feb 2017 12:33:34 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.6.0 MIME-Version: 1.0 In-Reply-To: <20170224102748.GA34792@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Feb 2017 10:33:39 -0000 Hi. I am not sure I completely understand from your description how exactly detected disks match their enclosure slots, but make sure to take a look on this change: https://svnweb.freebsd.org/base?view=revision&revision=308425 On 24.02.2017 12:27, John wrote: > Hi Folks - > > Running fresh fbsd 11.0-STABLE #1 r314197: Fri Feb 24 05:05:34 EST 2017. > > I'm wondering if anyone using sesutil has seen the following issue > with an HP D2700 shelf (25 x 600GB SAS drives): > > sesutil map -u /dev/ses0 > ses0: > Enclosure Name: HP D2700 SAS AJ941A 0149 > Enclosure ID: 5001438023432c00 > Element 0, Type: Array Device Slot > Status: Unsupported (0x00 0x80 0x00 0x00) > Element 1, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Element 2, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da0,pass0 > Element 3, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da1,pass1 > Element 4, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da2,pass2 > ... > ... full list below > ... > Element 25, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da23,pass23 > > > Note Element 1 is an does not contain any device names. > > Sesutil is getting an ENODEV back from the ioctl requesting the names. > > In scsi_enc.c the error seems be coming from here: > > cam_periph_lock(periph); > error = (*enc->enc_vec.get_elm_devnames)(enc, &elmdn); > cam_periph_unlock(periph); > > which eventually calls cam_periph_list() which "looks" ok to me. > > I'm wondering if there is some sort of off by 1 error somewhere in > the code with respect to how this shelf reports devices and are > assigned since da0 is not allocated to the first bay, but instead bay 2. > > Device da24 (the 25th device) is in the first bay. If I run a dd or > iozone to da24 the drive works correctly and the activity light > comes on as expected. > > This process works correctly on a set of supermicro shelves. > > Any thoughts or pointers? > > Thanks, > John > > dmesg for da0/da1 > > (da0:mps0:0:8:0): UNMAPPED > da0 at mps0 bus 0 scbus0 target 8 lun 0 > da0: Fixed Direct Access SPC-3 SCSI device > da0: Serial Number EA01PC91LLBB1239 > da0: 600.000MB/s transfers > da0: Command Queueing enabled > da0: 572325MB (1172123568 512 byte sectors) > (da1:mps0:0:9:0): UNMAPPED > da1 at mps0 bus 0 scbus0 target 9 lun 0 > da1: Fixed Direct Access SPC-3 SCSI device > da1: Serial Number EA01PC91LPG91239 > da1: 600.000MB/s transfers > da1: Command Queueing enabled > da1: 572325MB (1172123568 512 byte sectors) > > > > # sesutil map -u /dev/ses0 > ses0: > Enclosure Name: HP D2700 SAS AJ941A 0149 > Enclosure ID: 5001438023432c00 > Element 0, Type: Array Device Slot > Status: Unsupported (0x00 0x80 0x00 0x00) > Element 1, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Element 2, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da0,pass0 > Element 3, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da1,pass1 > Element 4, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da2,pass2 > Element 5, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da3,pass3 > Element 6, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da4,pass4 > Element 7, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da5,pass5 > Element 8, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da6,pass6 > Element 9, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da7,pass7 > Element 10, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da8,pass8 > Element 11, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da9,pass9 > Element 12, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da10,pass10 > Element 13, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da11,pass11 > Element 14, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da12,pass12 > Element 15, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da13,pass13 > Element 16, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da14,pass14 > Element 17, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da15,pass15 > Element 18, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da16,pass16 > Element 19, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da17,pass17 > Element 20, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da18,pass18 > Element 21, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da19,pass19 > Element 22, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da20,pass20 > Element 23, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da21,pass21 > Element 24, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da22,pass22 > Element 25, Type: Array Device Slot > Status: OK (0x01 0x80 0x00 0x00) > Device Names: da23,pass23 > Element 26, Type: SAS Connector > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 27, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 28, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 29, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 30, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 31, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 32, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 33, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 34, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 35, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 36, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 37, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 38, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 39, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 40, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 41, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 42, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 43, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 44, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 45, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 46, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 47, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 48, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 49, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 50, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 51, Type: SAS Connector > Status: OK (0x01 0x20 0x00 0x00) > Element 52, Type: > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 53, Type: > Status: OK (0x01 0x00 0x00 0x00) > Description: 5C7236P2L5 > Element 54, Type: Power Supply > Status: Unsupported (0x00 0x00 0x00 0x80) > Element 55, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x80) > Description: 20Delta 5ANLD0C4D3A0XN > Element 56, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x80) > Description: 20Delta 5ANLD0C4D3A0XS > Element 57, Type: Cooling > Status: OK (0x01 0x00 0x00 0x80) > Description: B PAVCA0B9V3B0GH > Extra status: > - Speed: 0 rpm > Element 58, Type: Cooling > Status: Unsupported (0x00 0x02 0x8f 0x02) > Extra status: > - Speed: 6550 rpm > Element 59, Type: Cooling > Status: Unsupported (0x00 0x02 0x6b 0x02) > Extra status: > - Speed: 6190 rpm > Element 60, Type: Cooling > Status: OK (0x01 0x00 0x00 0x80) > Description: B PAVCA0B9V3B0DL > Extra status: > - Speed: 0 rpm > Element 61, Type: Cooling > Status: Unsupported (0x00 0x02 0xa3 0x02) > Extra status: > - Speed: 6750 rpm > Element 62, Type: Cooling > Status: Unsupported (0x00 0x02 0x6b 0x02) > Extra status: > - Speed: 6190 rpm > Element 63, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 64, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 014901B0PAZAV0BTM3D3AX 0026 > Element 65, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 66, Type: SAS Connector > Status: OK (0x01 0x02 0x00 0x00) > Element 67, Type: SAS Connector > Status: OK (0x01 0x02 0x01 0x00) > Element 68, Type: SAS Connector > Status: OK (0x01 0x02 0x02 0x00) > Element 69, Type: SAS Connector > Status: OK (0x01 0x02 0x03 0x00) > Element 70, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 71, Type: SAS Connector > Status: OK (0x01 0x02 0x00 0x00) > Element 72, Type: SAS Connector > Status: OK (0x01 0x02 0x01 0x00) > Element 73, Type: SAS Connector > Status: OK (0x01 0x02 0x02 0x00) > Element 74, Type: SAS Connector > Status: OK (0x01 0x02 0x03 0x00) > Element 75, Type: SAS Expander > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 76, Type: SAS Expander > Status: OK (0x01 0x00 0x00 0x00) > Description: 900080050002 > Element 77, Type: Display > Status: OK (0x01 0x00 0x00 0x00) > Description: 0.107SEGDISP C:03 > Element 78, Type: Display > Status: Unsupported (0x00 0x02 0x30 0x00) > Element 79, Type: Display > Status: Unsupported (0x00 0x02 0x31 0x00) > Element 80, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 81, Type: Temperature Sensors > Status: OK (0x01 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 82, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 83, Type: Enclosure Services Controller Electronics > Status: Unknown (0x06 0x00 0x00 0x00) > Description: 0149 0026 > Element 84, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 85, Type: SAS Connector > Status: Unknown (0x06 0x02 0x00 0x00) > Element 86, Type: SAS Connector > Status: Unknown (0x06 0x02 0x01 0x00) > Element 87, Type: SAS Connector > Status: Unknown (0x06 0x02 0x02 0x00) > Element 88, Type: SAS Connector > Status: Unknown (0x06 0x02 0x03 0x00) > Element 89, Type: SAS Connector > Status: Unsupported (0x00 0x02 0x00 0x00) > Element 90, Type: SAS Connector > Status: Unknown (0x06 0x02 0x00 0x00) > Element 91, Type: SAS Connector > Status: Unknown (0x06 0x02 0x01 0x00) > Element 92, Type: SAS Connector > Status: Unknown (0x06 0x02 0x02 0x00) > Element 93, Type: SAS Connector > Status: Unknown (0x06 0x02 0x03 0x00) > Element 94, Type: SAS Expander > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 95, Type: SAS Expander > Status: Unknown (0x06 0x00 0x00 0x00) > Description: > Element 96, Type: Display > Status: Unknown (0x06 0x00 0x00 0x00) > Description: > Element 97, Type: Display > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 98, Type: Display > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 99, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 100, Type: Temperature Sensors > Status: OK (0x01 0x00 0x43 0x00) > Extra status: > - Temperature: 47 C > Element 101, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 102, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 002803D0PARHV0DTM3B0FF > Element 103, Type: Enclosure Services Controller Electronics > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 104, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 1.02 > Element 105, Type: Enclosure Services Controller Electronics > Status: OK (0x01 0x00 0x00 0x00) > Description: 1.02 > Element 106, Type: Temperature Sensors > Status: Unsupported (0x00 0x00 0x30 0x00) > Extra status: > - Temperature: 28 C > Element 107, Type: Temperature Sensors > Status: OK (0x01 0x00 0x31 0x00) > Extra status: > - Temperature: 29 C > Element 108, Type: Temperature Sensors > Status: OK (0x01 0x00 0x30 0x00) > Extra status: > - Temperature: 28 C > Element 109, Type: Power Supply > Status: Unsupported (0x00 0x00 0x00 0x00) > Element 110, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x00) > Element 111, Type: Power Supply > Status: OK (0x01 0x00 0x00 0x00) > -- Alexander Motin