From owner-freebsd-scsi@freebsd.org Sun Apr 22 21:00:40 2018 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1218BFBD4C1 for <freebsd-scsi@mailman.ysv.freebsd.org>; Sun, 22 Apr 2018 21:00:40 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id A9E5875949 for <freebsd-scsi@freebsd.org>; Sun, 22 Apr 2018 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: by mailman.ysv.freebsd.org (Postfix) id 5800CFBD4B9; Sun, 22 Apr 2018 21:00:39 +0000 (UTC) Delivered-To: scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 18D84FBD4B7 for <scsi@mailman.ysv.freebsd.org>; Sun, 22 Apr 2018 21:00:39 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org [IPv6:2001:1900:2254:206a::19:3]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "mxrelay.ysv.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id A6D2A75910 for <scsi@FreeBSD.org>; Sun, 22 Apr 2018 21:00:38 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id E633E233A3 for <scsi@FreeBSD.org>; Sun, 22 Apr 2018 21:00:37 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w3ML0bYv033975 for <scsi@FreeBSD.org>; Sun, 22 Apr 2018 21:00:37 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w3ML0bm0033974 for scsi@FreeBSD.org; Sun, 22 Apr 2018 21:00:37 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <201804222100.w3ML0bm0033974@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: scsi@FreeBSD.org Subject: Problem reports for scsi@FreeBSD.org that need special attention Date: Sun, 22 Apr 2018 21:00:37 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Sun, 22 Apr 2018 21:00:40 -0000 To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- In Progress | 218830 | [cam] [patch] add CAM pass(4) support for NVMe New | 221952 | cam iosched: Fix trim statistics New | 221956 | cam iosched: Schedule cam_iosched_ticker() quanta New | 221957 | cam iosched: Add a handler for the quanta sysctl 4 problems total for which you should take action. From owner-freebsd-scsi@freebsd.org Tue Apr 24 01:39:09 2018 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 75ADBFB1DAB for <freebsd-scsi@mailman.ysv.freebsd.org>; Tue, 24 Apr 2018 01:39:09 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 273A7825D3; Tue, 24 Apr 2018 01:39:09 +0000 (UTC) (envelope-from jwd@freebsd.org) Received: by freefall.freebsd.org (Postfix, from userid 821) id 1FA8EEFB; Tue, 24 Apr 2018 01:39:09 +0000 (UTC) Date: Tue, 24 Apr 2018 01:39:09 +0000 From: John <jwd@freebsd.org> To: SCSI List <freebsd-scsi@freebsd.org> Subject: Re: /dev/enc@ SES doc? Message-ID: <20180424013909.GA19649@FreeBSD.org> References: <20180413150704.GA77097@FreeBSD.org> <CAOtMX2hcSS5MwG1_iS05U1mNtGhopPiJkPorGfXfEpjC-ibWxQ@mail.gmail.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="ikeVEW9yuYc//A+q" Content-Disposition: inline In-Reply-To: <CAOtMX2hcSS5MwG1_iS05U1mNtGhopPiJkPorGfXfEpjC-ibWxQ@mail.gmail.com> User-Agent: Mutt/1.9.2 (2017-12-15) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Tue, 24 Apr 2018 01:39:09 -0000 --ikeVEW9yuYc//A+q Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable ----- Alan Somers's Original Message ----- > The ses(4) man page describes the ioctls supported by the /dev/sesX nodes. > The /dev/enc@... nodes, however, are simply aliases for /dev/da* nodes I've been poking around in the code and am probably missing something obvious. I have 3 shelves, dual expanders each, 4 cables from a pair of LSI 9300-16e cards. I have one disk in each shelf, bay 1 in the 1st shelf, bay 2 in the 2nd, bay 3 in the 3rd. One drive shows up on each cable/channel: WBN06J1R0000E8283APS - ses1-da0 ses9-da10 ses3-da4 ses7-da6 WBN0414K0000E81627LM - ses11-da11 ses2-da2 ses5-da5 ses8-da8 WBN05GME0000E8280DY5 - ses0-da1 ses4-da3 ses6-da7 ses10-da9 And the readout of /dev/enc@* (trailing ses annotation added by hand): # find /dev/enc@* -name 'da*' /dev/enc@n500304801f25c63d/type@0/slot@3/elmdesc@Slot02/da3 (ses4) /dev/enc@n500304801f25c6bd/type@0/slot@3/elmdesc@Slot02/da1 (ses0) /dev/enc@n500304801f25c73d/type@0/slot@1/elmdesc@Slot00/da4 (ses3) /dev/enc@n500304801f25c7bd/type@0/slot@1/elmdesc@Slot00/da0 (ses1) /dev/enc@n500304801f25c83d/type@0/slot@2/elmdesc@Slot01/da5 (ses5) /dev/enc@n500304801f25c8bd/type@0/slot@2/elmdesc@Slot01/da2 (ses2) The 1st 6 ses units are shown - the 2nd 6 ses units are missing (ses6 ->= ses11). I think the following represents the issue, not sure how to fix it? # for i in /dev/ses*; do camcontrol smpphylist $i 2>/dev/null | grep ses done | awk '{print $2;}' 0x500304801f25c6bd 0x500304801f25c7bd 0x500304801f25c6bd 0x500304801f25c8bd 0x500304801f25c8bd 0x500304801f25c73d 0x500304801f25c63d 0x500304801f25c83d 0x500304801f25c63d 0x500304801f25c73d 0x500304801f25c83d 0x500304801f25c7bd # for i in /dev/ses*; do camcontrol smpphylist $i 2>/dev/null | grep ses done | awk '{print $2;}' | sort -u 0x500304801f25c63d 0x500304801f25c6bd 0x500304801f25c73d 0x500304801f25c7bd 0x500304801f25c83d 0x500304801f25c8bd The ses unit adds a level of uniqueness not provided by just the logical= identifier? Thoughts? Thanks, John > On Fri, Apr 13, 2018 at 9:07 AM, John <jwd@freebsd.org> wrote: >=20 > > Hi Folks, > > > > Just curious... > > > > Is there any doc for the /dev/enc@.... entries that map > > any attached SES enabled storage? > > > > cam/scsi/scsi_enc_ses.c does contain a good amount of info. > > > > Thanks! > > John --ikeVEW9yuYc//A+q Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQF8BAEBCgBmBQJa3oq7XxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQwNDBGOTgxNzM0NzQ3OEFBNDYyODNGQzVC NjI0OTlBMTQyNEY3RjgxAAoJELYkmaFCT3+Bw4UH/2pxynR68lvZDXocZvNb+M6G OuU57lYVQhk4ZEhf0kngJjSWvmGzp+oa2AJ5aAg3uoLu0fy1reEqXp87zJsWRVDK 5oo2mGMCELKx/7+T2GwdXn1mHRepM91kyL/lSWv7gDjDrkjqqXOR++Ma+FX1xq3Q euDRi8uuRug5H84q2NVq6amJyHJ6P5ngE8u3XtlzwVCcC3gy5EoqoEcNCmrq7WhE 59VxuuPLon/dHo+1KBcBnkVaRAFsDVRFcEWybIpgDrBv/UdTYYw9f89+PGHgdT2A L3MsTBXeYEmRU13sgBgseb8IkxcKQf7qAS0dRKzLuHrIpFYfmZvWflOVqntDBOE= =yhEI -----END PGP SIGNATURE----- --ikeVEW9yuYc//A+q-- From owner-freebsd-scsi@freebsd.org Tue Apr 24 02:12:15 2018 Return-Path: <owner-freebsd-scsi@freebsd.org> Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 19AF3FB384D for <freebsd-scsi@mailman.ysv.freebsd.org>; Tue, 24 Apr 2018 02:12:15 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lf0-x236.google.com (mail-lf0-x236.google.com [IPv6:2a00:1450:4010:c07::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 72AA868913; Tue, 24 Apr 2018 02:12:14 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lf0-x236.google.com with SMTP id u21-v6so16253532lfu.9; Mon, 23 Apr 2018 19:12:14 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:sender:in-reply-to:references:from:date:message-id :subject:to:cc; bh=TmkwlgTsRXhR+aJot+HVtYyy2Xw1LuWRUdgkRKR4EpI=; b=L4wmp+0Jnxlzt8R4zE6u1CVSFg00tk8YLEbYHq4AqaAGkFAnTfsRqHPNo5xJttdbTn fE+jx4c8CLWQOGBuWbsUyHE4rcCYb+6lvi1hKdhTd8H0Dnhlk8/D31/pPokeIvWGz1vm E5gY82gwIgG/sYoDr5BLh9Q813wvXW6g6WqA/lPwxJPMJtN2OwEbWpEuUMPKGpB5fHYF TZL/HTQeTl56Cv3QMctUArHZRcASeShEPrOFdSBP/pZAZSaBqFgwUQ8tuOsemOHq6Qjv sR9WatPAIbPuZevXh5UsC/GUeyFject+fzyhpDpGUGhATv3J9l0k2U9RfbLgIpaxOec8 Oosg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc; bh=TmkwlgTsRXhR+aJot+HVtYyy2Xw1LuWRUdgkRKR4EpI=; b=uj4296r/qEEZ2sg/ACpfkq+qZ/czYdNtSg9+RoekkfQ2JFxw14mj3+9SYqKXylrsHU OUiU6MSnPffpF7Y17plUAJAl4KysJVbk6gmfPnCMrPwMQgfOmnTOLKqxcAqiZi62wsBg IMXI5M2+Z04hQ6xwOdugbTsoNBu7PpjhZeSBBl7+2rCU4MC+kgxnF4iIlFUE1qyLgVk/ +DdptYaYXGBYVOwT/LdA8ajndgcFWXB44xt5R0Pu3158Dm17m2/ZfoaMdHQjqoYtvw/l undkR2Ed5dryNEq4v8r6r/hdEzh7A6T0kj1v5dpVOLNIeVPUjwhiu2BNTl40Wg6R2X4w 3Tsg== X-Gm-Message-State: ALQs6tClZmdRf1fql8n8MYqayFcXax8eu9T29aXfOJPFaIIPRIBedYJv OuOAo3DsiTmjIJLWmW2FaZnhlbcX/bG4XI7haA4= X-Google-Smtp-Source: AB8JxZpa0+9vMNgzP2tFpIf4p8vjmIXzN7RG3J2/O1Jn9JW6emONOA2AhwREEG6kzYCrUonFpOCdUi9EJmoqAifmoLU= X-Received: by 2002:a19:7906:: with SMTP id u6-v6mr337726lfc.34.1524535931777; Mon, 23 Apr 2018 19:12:11 -0700 (PDT) MIME-Version: 1.0 Sender: asomers@gmail.com Received: by 10.179.6.21 with HTTP; Mon, 23 Apr 2018 19:12:11 -0700 (PDT) In-Reply-To: <20180424013909.GA19649@FreeBSD.org> References: <20180413150704.GA77097@FreeBSD.org> <CAOtMX2hcSS5MwG1_iS05U1mNtGhopPiJkPorGfXfEpjC-ibWxQ@mail.gmail.com> <20180424013909.GA19649@FreeBSD.org> From: Alan Somers <asomers@freebsd.org> Date: Mon, 23 Apr 2018 20:12:11 -0600 X-Google-Sender-Auth: ycZ8iYosQuPRis7yLn2Vm6nKphc Message-ID: <CAOtMX2jKHjc+=0yJioFZWmpSnMZ++kXqYnqm2o1sMzdMn+5Fkg@mail.gmail.com> Subject: Re: /dev/enc@ SES doc? To: John <jwd@freebsd.org> Cc: SCSI List <freebsd-scsi@freebsd.org>, Alan Somers <asomers@freebsd.org> Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.25 X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: SCSI subsystem <freebsd-scsi.freebsd.org> List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=unsubscribe> List-Archive: <http://lists.freebsd.org/pipermail/freebsd-scsi/> List-Post: <mailto:freebsd-scsi@freebsd.org> List-Help: <mailto:freebsd-scsi-request@freebsd.org?subject=help> List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-scsi>, <mailto:freebsd-scsi-request@freebsd.org?subject=subscribe> X-List-Received-Date: Tue, 24 Apr 2018 02:12:15 -0000 If you have 3 shelves each with dual expanders, then you should have six /dev/ses devices. The fact that you see 12 means that something is cabled incorrectly. It sounds like each expander has two SAS ports (each of which has 4 SAS lanes). Are there really only two LSI 9300-16e cards? It sounds like there must be three. What you _should_ do is connect both of each expanders' ports to the same HBA. That way it will form a wide port of 8 lanes. If you connect a single expander to two different HBAs, then the OS sees them as separate expanders and doesn't realize that they're really the same. -Alan On Mon, Apr 23, 2018 at 7:39 PM, John <jwd@freebsd.org> wrote: > ----- Alan Somers's Original Message ----- > > The ses(4) man page describes the ioctls supported by the /dev/sesX > nodes. > > The /dev/enc@... nodes, however, are simply aliases for /dev/da* nodes > > I've been poking around in the code and am probably missing > something obvious. > > I have 3 shelves, dual expanders each, 4 cables from a pair > of LSI 9300-16e cards. I have one disk in each shelf, bay 1 > in the 1st shelf, bay 2 in the 2nd, bay 3 in the 3rd. One drive > shows up on each cable/channel: > > WBN06J1R0000E8283APS - ses1-da0 ses9-da10 ses3-da4 ses7-da6 > WBN0414K0000E81627LM - ses11-da11 ses2-da2 ses5-da5 ses8-da8 > WBN05GME0000E8280DY5 - ses0-da1 ses4-da3 ses6-da7 ses10-da9 > > And the readout of /dev/enc@* (trailing ses annotation added by hand): > > # find /dev/enc@* -name 'da*' > /dev/enc@n500304801f25c63d/type@0/slot@3/elmdesc@Slot02/da3 (ses4) > /dev/enc@n500304801f25c6bd/type@0/slot@3/elmdesc@Slot02/da1 (ses0) > /dev/enc@n500304801f25c73d/type@0/slot@1/elmdesc@Slot00/da4 (ses3) > /dev/enc@n500304801f25c7bd/type@0/slot@1/elmdesc@Slot00/da0 (ses1) > /dev/enc@n500304801f25c83d/type@0/slot@2/elmdesc@Slot01/da5 (ses5) > /dev/enc@n500304801f25c8bd/type@0/slot@2/elmdesc@Slot01/da2 (ses2) > > The 1st 6 ses units are shown - the 2nd 6 ses units are missing (ses6 > -> ses11). > > I think the following represents the issue, not sure how to fix it? > > # for i in /dev/ses*; do > camcontrol smpphylist $i 2>/dev/null | grep ses > done | awk '{print $2;}' > 0x500304801f25c6bd > 0x500304801f25c7bd > 0x500304801f25c6bd > 0x500304801f25c8bd > 0x500304801f25c8bd > 0x500304801f25c73d > 0x500304801f25c63d > 0x500304801f25c83d > 0x500304801f25c63d > 0x500304801f25c73d > 0x500304801f25c83d > 0x500304801f25c7bd > # for i in /dev/ses*; do > camcontrol smpphylist $i 2>/dev/null | grep ses > done | awk '{print $2;}' | sort -u > 0x500304801f25c63d > 0x500304801f25c6bd > 0x500304801f25c73d > 0x500304801f25c7bd > 0x500304801f25c83d > 0x500304801f25c8bd > > The ses unit adds a level of uniqueness not provided by just the > logical identifier? > > Thoughts? > > Thanks, > John > > > On Fri, Apr 13, 2018 at 9:07 AM, John <jwd@freebsd.org> wrote: > > > > > Hi Folks, > > > > > > Just curious... > > > > > > Is there any doc for the /dev/enc@.... entries that map > > > any attached SES enabled storage? > > > > > > cam/scsi/scsi_enc_ses.c does contain a good amount of info. > > > > > > Thanks! > > > John >