From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 10:14:43 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 28F08B43 for ; Mon, 8 Dec 2014 10:14:43 +0000 (UTC) Received: from rack.patpro.net (rack.patpro.net [193.30.227.216]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "patpro.net", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E2384B0E for ; Mon, 8 Dec 2014 10:14:42 +0000 (UTC) Received: from patpro.univ-lyon2.fr (patpro.univ-lyon2.fr [159.84.113.250]) by rack.patpro.net (Postfix) with ESMTPSA id 59F594F6 for ; Mon, 8 Dec 2014 11:14:33 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=patpro.net; s=patpro; t=1418033673; bh=ZUOIbZQJW7LRbl/Y+1dn/29tcfrad9Ssg8sjtuVqRpk=; h=From:Subject:Date:To; b=FV15D7HqGuKFP23wkk3qv4F8Te7cthS6VlUH2hhi6iGsDtAEdKvqz7i43E09d4vsP 7iFyf+xSWym2tR2tF5xmoJTiOIdblbq87u2eF19yH2mc2Y8oYk/NVHfS/S550mpt8+ ix2nrlajwvMXzBbkrQZlicI3jXEzPuhDGQTh8Mi0= From: patpro@patpro.net Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: multipath problem: active provider chosen on passive FC path? Message-Id: <23F06C2E-558A-4E68-AD35-B3CD49760DFE@patpro.net> Date: Mon, 8 Dec 2014 11:14:31 +0100 To: freebsd-scsi@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) X-Mailer: Apple Mail (2.1510) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 10:14:43 -0000 Hello, I'm not sure it's the best place to expose my problem, let me know if = another mailing list is recommended. I've installed FreeBSD 9.3 on two HP blade servers (G6), into an HP = C7000 chassis. This chassis uses two Brocade FC switches (active/passive = if I'm not mistaken). The blade servers use QLogic HBA: isp0: port 0x4000-0x40ff mem = 0xfbff0000-0xfbff3fff irq 30 at device 0.0 on pci6 isp1: port 0x4400-0x44ff mem = 0xfbfe0000-0xfbfe3fff irq 37 at device 0.1 on pci6 A SAN array presents a dedicated logical unit to each FreeBSD server. On = a given server I see 4 paths to the presented LU that I use to create a = GEOM_MULTIPATH device: (from dmesg) GEOM_MULTIPATH: SPLUNK_1 created GEOM_MULTIPATH: da2 added to SPLUNK_1 GEOM_MULTIPATH: da2 is now active path in SPLUNK_1 GEOM_MULTIPATH: da3 added to SPLUNK_1 GEOM_MULTIPATH: da6 added to SPLUNK_1 GEOM_MULTIPATH: da7 added to SPLUNK_1 # camcontrol devlist | grep VRAID at scbus0 target 2 lun 0 (pass4,da2) at scbus0 target 3 lun 0 (pass5,da3) at scbus1 target 4 lun 0 (pass12,da6) at scbus1 target 5 lun 0 (pass13,da7) # gmultipath status Name Status Components multipath/SPLUNK_1 OPTIMAL da2 (ACTIVE) da3 (PASSIVE) da6 (PASSIVE) da7 (PASSIVE) Unfortunately during boot, and during normal operation, the first = provider (da2 here) seems faulty: isp0: Chan 0 Abort Cmd for N-Port 0x0008 @ Port 0x090a00 (da2:isp0:0:2:0): Command Aborted (da2:isp0:0:2:0): READ(6). CDB: 08 00 03 28 02 00=20 (da2:isp0:0:2:0): CAM status: CCB request aborted by the host (da2:isp0:0:2:0): Retrying command ../.. isp0: Chan 0 Abort Cmd for N-Port 0x0008 @ Port 0x090a00 (da2:isp0:0:2:0): Command Aborted (da2:isp0:0:2:0): WRITE(10). CDB: 2a 00 00 50 20 21 00 00 05 00=20 (da2:isp0:0:2:0): CAM status: CCB request aborted by the host (da2:isp0:0:2:0): Retrying command ../.. Those errors make the boot really slow (10-15 minutes), but the device = is not deactivated. On both servers it's always the first provider of = the multipath device that seems faulty (always the first one on scbus0). = So I guess scbus0 is connected to the passive FC switch. If I use extensively on the multipath device, the faulty provider will = eventually be marked as failed and another one will be marked ACTIVE, = chosen on scbus1. As soon as a provider on scbus1 is marked ACTIVE, the = read/write throughput comes back to expected values. For example, disktnfo(1) shows horrendous performances (+240ms seek = time...) # diskinfo -t /dev/multipath/SPLUNK_1 /dev/multipath/SPLUNK_1 512 # sectorsize 107374181888 # mediasize in bytes (100G) 209715199 # mediasize in sectors 0 # stripesize 0 # stripeoffset 13054 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. CKM00114800912 # Disk ident. Seek times: Full stroke: 250 iter in 1.172849 sec =3D 4.691 msec Half stroke: 250 iter in 2.499101 sec =3D 9.996 msec Quarter stroke: 500 iter in 124.113431 sec =3D 248.227 msec Short forward: 400 iter in 62.483828 sec =3D 156.210 msec Short backward: 400 iter in 62.844187 sec =3D 157.110 msec Seq outer: 2048 iter in 240.999614 sec =3D 117.676 msec Seq inner: 2048 iter in 121.210282 sec =3D 59.185 msec (during this test da2 is marked failed: GEOM_MULTIPATH: Error 5, da2 in SPLUNK_1 marked FAIL=20 GEOM_MULTIPATH: da7 is now active path in SPLUNK_1=20 and the transfer rates test goes well:) Transfer rates: outside: 102400 kbytes in 1.023942 sec =3D 100006 = kbytes/sec middle: 102400 kbytes in 1.104299 sec =3D 92729 = kbytes/sec inside: 102400 kbytes in 1.137533 sec =3D 90019 = kbytes/sec # gmultipath status Name Status Components multipath/SPLUNK_1 DEGRADED da2 (FAIL) da3 (PASSIVE) da6 (PASSIVE) da7 (ACTIVE) Is there any way I can tell GEOM to use an active provider chosen on = scbus1 at boot time? Is there any chance I totally misunderstand the = problem? (other blades in the same chassis are used for ESXi VMware production = for years without any problem, so I guess switches and SAN are correctly = configured) thanks, Patrick --=20 # sysctl -a | grep dev.isp dev.isp.0.%desc: Qlogic ISP 2432 PCI FC-AL Adapter dev.isp.0.%driver: isp dev.isp.0.%location: slot=3D0 function=3D0 handle=3D\_SB_.PCI0.PT07.SLT0 dev.isp.0.%pnpinfo: vendor=3D0x1077 device=3D0x2432 subvendor=3D0x103c = subdevice=3D0x1705 class=3D0x0c0400 dev.isp.0.%parent: pci6 dev.isp.0.wwnn: 5764963215108688473 dev.isp.0.wwpn: 5764963215108688472 dev.isp.0.loop_down_limit: 60 dev.isp.0.gone_device_time: 30 dev.isp.1.%desc: Qlogic ISP 2432 PCI FC-AL Adapter dev.isp.1.%driver: isp dev.isp.1.%location: slot=3D0 function=3D1 handle=3D\_SB_.PCI0.PT07.SLT1 dev.isp.1.%pnpinfo: vendor=3D0x1077 device=3D0x2432 subvendor=3D0x103c = subdevice=3D0x1705 class=3D0x0c0400 dev.isp.1.%parent: pci6 dev.isp.1.wwnn: 5764963215108688475 dev.isp.1.wwpn: 5764963215108688474 dev.isp.1.loop_down_limit: 60 dev.isp.1.gone_device_time: 30 From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 15:58:20 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 69C8C92D for ; Mon, 8 Dec 2014 15:58:20 +0000 (UTC) Received: from mail-qa0-f53.google.com (mail-qa0-f53.google.com [209.85.216.53]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EE2DA5EB for ; Mon, 8 Dec 2014 15:58:19 +0000 (UTC) Received: by mail-qa0-f53.google.com with SMTP id bm13so3470997qab.40 for ; Mon, 08 Dec 2014 07:58:18 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=u2BVHNWVIvyTvDIHE5Rl3lFtvltQlWtf+JV3a24P7UM=; b=i+NaCJYG5WT9Bl4gaLCpir5NgDtewKu6qYZ6qOckmPqWS5o+KpiRoIPg5l0DSnSAIs uG+M9Rvwwkk+NrAbWLLexbb51gSsFOLgxfSoD1C6T0okhD4LM22JuHkdAW7xq6onju0j YkHwW8D+WB8iQoNDgAF1k9+AI46icK/vJHUrSM5cJ+8wZeIUlnyMsAp4wV4dlgXFmE84 /4RjS6GzU9BTb87XtXi3EyQ7hawtCjhzo97q/Z9ht1ZUSmEeQuyqD5vpsbOeoWlglS4a xlQ3/UfoPKHScv12m/9oaaoCpKPjZq8gMT0yIcKoMqYHthzfnJQhWDfaocoxdADVJogt Q4/A== X-Gm-Message-State: ALoCoQneY8aUjeBJy9H3ZyyCM1zPWIzEQN9n809cGwRkzyUyPKfPC6Lo9T8UZUKkal8OhHOdOz2s X-Received: by 10.140.39.201 with SMTP id v67mr51756393qgv.45.1418054298435; Mon, 08 Dec 2014 07:58:18 -0800 (PST) Received: from [10.1.1.2] (pool-71-184-234-181.bstnma.fios.verizon.net. [71.184.234.181]) by mx.google.com with ESMTPSA id p67sm38077048qga.26.2014.12.08.07.58.16 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 08 Dec 2014 07:58:17 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) Subject: Re: LSI SAS 3008 card - 35 out of 36 disks detected From: Justin O'Conor In-Reply-To: Date: Mon, 8 Dec 2014 10:58:14 -0500 Content-Transfer-Encoding: quoted-printable Message-Id: References: <54822835.3080800@crystal.harvard.edu> To: Alan Somers X-Mailer: Apple Mail (2.1510) Cc: FreeBSD-scsi X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 15:58:20 -0000 Hi All, Thanks, this is encouraging. smp_discover ses0|1 see 36 sata disks. This = is from the 10.1 install. Lets start with the short ones - root@rhea:~ # sg_inq --hex --len=3D64 ses0 00 0d 00 05 02 34 00 40 02 4c 53 49 20 20 20 20 20 ....4.@.LSI = =20 10 53 41 53 32 58 33 36 20 20 20 20 20 20 20 20 20 SAS2X36 = =20 20 30 65 31 32 78 33 36 2d 35 35 2e 31 34 2e 31 38 = 0e12x36-55.14.18 30 2e 30 00 20 20 20 20 20 .0. =20 root@rhea:~ # sg_inq --hex --len=3D64 ses1 00 0d 00 05 02 34 00 40 02 4c 53 49 20 20 20 20 20 ....4.@.LSI = =20 10 53 41 53 32 58 32 38 20 20 20 20 20 20 20 20 20 SAS2X28 = =20 20 30 65 31 32 78 33 36 2d 35 35 2e 31 34 2e 31 38 = 0e12x36-55.14.18 30 2e 30 00 20 20 20 20 20=20 root@rhea:~ # smp_discover ses0 phy 0:S:attached:[500605b009150c20:02 i(SSP+STP+SMP)] 6 Gbps phy 1:S:attached:[500605b009150c20:03 i(SSP+STP+SMP)] 6 Gbps phy 2:S:attached:[500605b009150c20:01 i(SSP+STP+SMP)] 6 Gbps phy 3:S:attached:[500605b009150c20:00 i(SSP+STP+SMP)] 6 Gbps phy 4:U:attached:[50030480017bd5bf:00 exp t(SMP)] 6 Gbps phy 5:U:attached:[50030480017bd5bf:01 exp t(SMP)] 6 Gbps phy 6:U:attached:[50030480017bd5bf:02 exp t(SMP)] 6 Gbps phy 7:U:attached:[50030480017bd5bf:03 exp t(SMP)] 6 Gbps phy 12:U:attached:[50030480017ae20c:00 t(SATA)] 6 Gbps phy 13:U:attached:[50030480017ae20d:00 t(SATA)] 6 Gbps phy 14:U:attached:[50030480017ae20e:00 t(SATA)] 6 Gbps phy 15:U:attached:[50030480017ae20f:00 t(SATA)] 6 Gbps phy 16:U:attached:[50030480017ae210:00 t(SATA)] 6 Gbps phy 17:U:attached:[50030480017ae211:00 t(SATA)] 6 Gbps phy 18:U:attached:[50030480017ae212:00 t(SATA)] 6 Gbps phy 19:U:attached:[50030480017ae213:00 t(SATA)] 6 Gbps phy 20:U:attached:[50030480017ae214:00 t(SATA)] 6 Gbps phy 21:U:attached:[50030480017ae215:00 t(SATA)] 6 Gbps phy 22:U:attached:[50030480017ae216:00 t(SATA)] 6 Gbps phy 23:U:attached:[50030480017ae217:00 t(SATA)] 6 Gbps phy 24:U:attached:[50030480017ae218:00 t(SATA)] 6 Gbps phy 25:U:attached:[50030480017ae219:00 t(SATA)] 6 Gbps phy 26:U:attached:[50030480017ae21a:00 t(SATA)] 6 Gbps phy 27:U:attached:[50030480017ae21b:00 t(SATA)] 6 Gbps phy 28:U:attached:[50030480017ae21c:00 t(SATA)] 6 Gbps phy 29:U:attached:[50030480017ae21d:00 t(SATA)] 6 Gbps phy 30:U:attached:[50030480017ae21e:00 t(SATA)] 6 Gbps phy 31:U:attached:[50030480017ae21f:00 t(SATA)] 6 Gbps phy 32:U:attached:[50030480017ae220:00 t(SATA)] 6 Gbps phy 33:U:attached:[50030480017ae221:00 t(SATA)] 6 Gbps phy 34:U:attached:[50030480017ae222:00 t(SATA)] 6 Gbps phy 35:U:attached:[50030480017ae223:00 t(SATA)] 6 Gbps phy 36:D:attached:[50030480017ae23d:00 V i(SSP+SMP) t(SSP)] 6 Gbps root@rhea:~ # foreach PHY ( `seq 0 1 36` ) foreach? smp_discover -p $PHY ses0 foreach? end Discover response: expander change count: 1328 phy identifier: 0 attached device type: SAS or SATA device attached reason: power on negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D1 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x500605b009150c20 attached phy identifier: 2 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 33 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x500605b009150c20 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 1 attached device type: SAS or SATA device attached reason: power on negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D1 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x500605b009150c20 attached phy identifier: 3 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 33 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x500605b009150c20 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 2 attached device type: SAS or SATA device attached reason: power on negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D1 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x500605b009150c20 attached phy identifier: 1 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 33 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x500605b009150c20 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 3 attached device type: SAS or SATA device attached reason: power on negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D1 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x500605b009150c20 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 33 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x500605b009150c20 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 4 attached device type: expander device attached reason: SMP phy control requested negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017bd5bf attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 4 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017bd5bf requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 5 attached device type: expander device attached reason: SMP phy control requested negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017bd5bf attached phy identifier: 1 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 4 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017bd5bf requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 6 attached device type: expander device attached reason: SMP phy control requested negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017bd5bf attached phy identifier: 2 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 4 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017bd5bf requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 7 attached device type: expander device attached reason: SMP phy control requested negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017bd5bf attached phy identifier: 3 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 4 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017bd5bf requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 8 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 9 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 10 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 11 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 12 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae20c attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 13 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae20d attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 1 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 14 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae20e attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 2 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 15 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae20f attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 3 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 16 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae210 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 4 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 17 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae211 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 5 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 18 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae212 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 6 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 19 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae213 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 7 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 20 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae214 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 8 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 21 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae215 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 9 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 22 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae216 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 10 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 23 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae217 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 11 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 24 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae218 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 12 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 25 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae219 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 13 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 26 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21a attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 48 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 14 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 27 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21b attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 49 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 15 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 28 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21c attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 16 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 29 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21d attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 17 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 30 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21e attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 18 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 31 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae21f attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 19 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 32 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae220 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 20 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 33 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae221 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 21 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 34 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae222 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 22 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 35 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae223 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 45 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 23 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 1328 phy identifier: 36 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D0 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D1 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017ae23f attached SAS address: 0x50030480017ae23d attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 6 Gbps hardware minimum physical link rate: 6 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 1 partial pathway timeout value: 7 us routing attribute: direct connector type: SAS virtual connector [max 1 phy] connector element index: 24 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 1 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 root@rhea:~ # smp_discover ses1 phy 0:S:attached:[50030480017ae23f:04 exp t(SMP)] 6 Gbps phy 1:S:attached:[50030480017ae23f:05 exp t(SMP)] 6 Gbps phy 2:S:attached:[50030480017ae23f:06 exp t(SMP)] 6 Gbps phy 3:S:attached:[50030480017ae23f:07 exp t(SMP)] 6 Gbps phy 8:D:disabled phy 9:D:disabled phy 10:D:disabled phy 11:D:disabled phy 12:U:attached:[50030480017bd5ac:00 t(SATA)] 6 Gbps phy 13:U:attached:[50030480017bd5ad:00 t(SATA)] 6 Gbps phy 14:U:attached:[50030480017bd5ae:00 t(SATA)] 6 Gbps phy 15:U:attached:[50030480017bd5af:00 t(SATA)] 6 Gbps phy 16:U:attached:[50030480017bd5b0:00 t(SATA)] 6 Gbps phy 17:U:attached:[50030480017bd5b1:00 t(SATA)] 6 Gbps phy 18:U:attached:[50030480017bd5b2:00 t(SATA)] 6 Gbps phy 19:U:attached:[50030480017bd5b3:00 t(SATA)] 6 Gbps phy 20:U:attached:[50030480017bd5b4:00 t(SATA)] 6 Gbps phy 21:U:attached:[50030480017bd5b5:00 t(SATA)] 6 Gbps phy 22:U:attached:[50030480017bd5b6:00 t(SATA)] 6 Gbps phy 23:U:attached:[50030480017bd5b7:00 t(SATA)] 6 Gbps phy 24:D:disabled phy 25:D:disabled phy 26:D:disabled phy 27:D:disabled phy 28:D:attached:[50030480017bd5bd:00 V i(SSP+SMP) t(SSP)] 6 Gbps root@rhea:~ # foreach PHY ( `seq 0 1 28` ) foreach? smp_discover -p $PHY ses1 foreach? end Discover response: expander change count: 241 phy identifier: 0 attached device type: expander device attached reason: loss of dword synchronization negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017ae23f attached phy identifier: 4 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017ae23f requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 1 attached device type: expander device attached reason: loss of dword synchronization negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017ae23f attached phy identifier: 5 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017ae23f requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 2 attached device type: expander device attached reason: loss of dword synchronization negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017ae23f attached phy identifier: 6 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017ae23f requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 3 attached device type: expander device attached reason: loss of dword synchronization negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D1 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017ae23f attached phy identifier: 7 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 1 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: subtractive connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x50030480017ae23f requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 1 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 4 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 5 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 6 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 7 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy enabled; unknown attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled; unknown optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 8 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 9 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 10 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 11 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 12 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5ac attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 21 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 13 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5ad attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 19 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 1 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 14 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5ae attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 19 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 2 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 15 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5af attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 3 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 16 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 19 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 4 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 17 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b1 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 5 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 18 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b2 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 6 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 19 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b3 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 7 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 20 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b4 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 8 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 21 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b5 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 9 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 22 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b6 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 10 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 23 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D1 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5b7 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 18 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: table connector type: SAS Drive backplane receptacle (SFF-8482) [max 2 phys] connector element index: 11 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 24 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 25 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 26 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 27 attached device type: no device attached attached reason: unknown negotiated logical link rate: phy disabled attached initiator: ssp=3D0 stp=3D0 smp=3D0 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D0 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x0 attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 1.5 Gbps hardware minimum physical link rate: 1.5 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 0 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 0 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy disabled optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 Discover response: expander change count: 241 phy identifier: 28 attached device type: SAS or SATA device attached reason: unknown negotiated logical link rate: phy enabled, 6 Gbps attached initiator: ssp=3D1 stp=3D0 smp=3D1 sata_host=3D0 attached sata port selector: 0 STP buffer too small: 0 attached target: ssp=3D1 stp=3D0 smp=3D0 sata_device=3D0 SAS address: 0x50030480017bd5bf attached SAS address: 0x50030480017bd5bd attached phy identifier: 0 attached persistent capable: 0 attached power capable: 0 attached slumber capable: 0 attached partial capable: 0 attached inside ZPSDS persistent: 0 attached requested inside ZPSDS: 0 attached break_reply capable: 0 attached pwr_dis capable: 0 programmed minimum physical link rate: 6 Gbps hardware minimum physical link rate: 6 Gbps programmed maximum physical link rate: 6 Gbps hardware maximum physical link rate: 6 Gbps phy change count: 1 virtual phy: 1 partial pathway timeout value: 7 us routing attribute: direct connector type: No information connector element index: 0 connector physical link: 0 phy power condition: 0 sas power capable: 0 sas slumber capable: 0 sas partial capable: 0 sata slumber capable: 0 sata partial capable: 0 pwr_dis signal: 0 pwr_dis control capable: 0 sas slumber enabled: 0 sas partial enabled: 0 sata slumber enabled: 0 sata partial enabled: 0 attached device name: 0x0 requested inside ZPSDS changed by expander: 0 inside ZPSDS persistent: 0 requested inside ZPSDS: 0 zone group persistent: 1 inside ZPSDS: 1 zoning enabled: 0 zone group: 1 self-configuration status: 0 self-configuration levels completed: 0 self-configuration sas address: 0x0 programmed phy capabilities: 0x0 current phy capabilities: 0x0 attached phy capabilities: 0x0 reason: unknown negotiated physical link rate: phy enabled, 6 Gbps optical mode enabled: 0 negotiated SSC: 0 hardware muxing supported: 0 default inside ZPSDS persistent: 0 default requested inside ZPSDS: 0 default zone group persistent: 1 default zoning enabled: 0 default zone group: 1 saved inside ZPSDS persistent: 0 saved requested inside ZPSDS: 0 saved zone group persistent: 1 saved zoning enabled: 0 saved zone group: 1 shadow inside ZPSDS persistent: 0 shadow requested inside ZPSDS: 0 shadow zone group persistent: 1 shadow zoning enabled: 0 shadow zone group: 1 device slot number: 255 device slot group number: 255 device slot group output connector: =20 root@rhea:~ #=20 On Dec 5, 2014, at 5:05 PM, Alan Somers wrote: > I had a very similar problem that ended up being a bug in the expander > firmware. It was exposed by the mpr(4) driver because that driver > enumerates drives differently than mps(4) or Linux. Please install > sysutils.smp_utils and post the output of "smp_discover -p $PHY $DEV" > where $DEV is each expander (probably ses0 and ses1) and $PHY is every > phy on each expander. You can see the list of phys by doing > "smp_discover $DEV" without the "-p" option. Also, would you mind > running "sg_inq --hex --len=3D64 $DEV" so I know what we're working > with? >=20 > -Alan >=20 From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 18:20:31 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8AEDF8A7 for ; Mon, 8 Dec 2014 18:20:31 +0000 (UTC) Received: from mail-wg0-x230.google.com (mail-wg0-x230.google.com [IPv6:2a00:1450:400c:c00::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 186ACBF3 for ; Mon, 8 Dec 2014 18:20:31 +0000 (UTC) Received: by mail-wg0-f48.google.com with SMTP id y19so6821473wgg.21 for ; Mon, 08 Dec 2014 10:20:28 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=m6cCIQYb5TvqgmuTf22HxG6QEzjlXxmw7GG2SAvG/Mk=; b=v/8OroESHqq+2HKyJ4NNVyaCyauF2MLQVXmPtDKkCPejrm8xrtSPSBJwPFml0+qf1f 3p36IWe3u7fwz3bBwOVQwBmFQuY+JagEHoucs2QMeRzTXOiaf6/KgSdsHW2wfL6r2ZZE j+qIUXkMjepn+Bu7wFN+TzgZmHSoYFnM5uT/jL8ENWzQh4lSFLaHiHPGJWDrgVKFivSj YBzFdjDD4JVnsLHVKzxbFb44odragxDQIXLZ02V8WTH5Nt+IsuXQxMpJtORoNoMgmDVV f8eeCH0TKagcYGo8uPSQwiNqf4JVfKd8Mt7ZCrlP30VBbLC4yoVdz+SFBJSn9NMK0seH Gy2g== MIME-Version: 1.0 X-Received: by 10.180.106.33 with SMTP id gr1mr26318618wib.82.1418062828635; Mon, 08 Dec 2014 10:20:28 -0800 (PST) Sender: asomers@gmail.com Received: by 10.194.17.129 with HTTP; Mon, 8 Dec 2014 10:20:28 -0800 (PST) In-Reply-To: References: <54822835.3080800@crystal.harvard.edu> Date: Mon, 8 Dec 2014 11:20:28 -0700 X-Google-Sender-Auth: 4GaG-15aPYyIuD_wEvpFBM08ajY Message-ID: Subject: Re: LSI SAS 3008 card - 35 out of 36 disks detected From: Alan Somers To: "Justin O'Conor" Content-Type: multipart/mixed; boundary=f46d044519992ba4680509b87b14 Cc: FreeBSD-scsi X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 18:20:31 -0000 --f46d044519992ba4680509b87b14 Content-Type: text/plain; charset=UTF-8 On Mon, Dec 8, 2014 at 8:58 AM, Justin O'Conor wrote: > Hi All, > Thanks, this is encouraging. smp_discover ses0|1 see 36 sata disks. This is from the 10.1 install. > There are certainly some inconsistencies in the smp_discover responses. For example, the SEP on ses0 (phy identifier: 36) has "connector type: SAS virtual connector" and "connector element index: 24" But the SEP on ses1 (phy identifier: 28) has "connector type: No information" and "connector element index: 0". Also note that "phy identifier: 12" on ses1 has "connector element index: 0". That would be the first slot on the rear expander, if the slots and phys are numbered the same way. My best guess is that phy 12 and phy 28 mapped to the same map_idx in mpr_mapping.c:1168. So the information for the SEP overwrote the information for the first disk slot. If my guess is true, then recabling your chassis as you suggested wouldn't help. However, you might try the attached but untested patch. It will prevent the SEP from being added to the mapping table while printing a useful error message. If I'm correct, then the patch will let you use all 36 disk slots, but you won't have ses1 anymore. In the meantime, I'll try to reproduce your problem. I have all the required equipment in my lab. -Alan --f46d044519992ba4680509b87b14 Content-Type: text/plain; charset=US-ASCII; name="mpr_mapping.diff" Content-Disposition: attachment; filename="mpr_mapping.diff" Content-Transfer-Encoding: base64 X-Attachment-Id: f_i3g5zkc30 SW5kZXg6IHN5cy9kZXYvbXByL21wcl9tYXBwaW5nLmMKPT09PT09PT09PT09PT09PT09PT09PT09 PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PT09PQotLS0gc3lzL2Rldi9t cHIvbXByX21hcHBpbmcuYwkocmV2aXNpb24gMjc1NjIwKQorKysgc3lzL2Rldi9tcHIvbXByX21h cHBpbmcuYwkod29ya2luZyBjb3B5KQpAQCAtMTE2OCw2ICsxMTY4LDIyIEBACiAJCQltYXBfaWR4 ID0gZXRfZW50cnktPnN0YXJ0X2luZGV4ICsgcGh5X2NoYW5nZS0+c2xvdCAtCiAJCQkgICAgZXRf ZW50cnktPnN0YXJ0X3Nsb3Q7CiAJCQltdF9lbnRyeSA9ICZzYy0+bWFwcGluZ190YWJsZVttYXBf aWR4XTsKKwkJCWlmIChtdF9lbnRyeS0+cGh5c2ljYWxfaWQgIT0gMCAmJgorCQkJICAgIG10X2Vu dHJ5LT5waHlzaWNhbF9pZCAhPSBwaHlfY2hhbmdlLT5waHlzaWNhbF9pZCkgeworCQkJCXByaW50 ZigiJXM6IGZhaWxlZCB0byBhZGQgdGhlIGRldmljZSB3aXRoIHNsb3QgIgorCQkJCSAgICAiJTVk IGJlY2F1c2UgdGhhdCBlbnRyeSBpbiB0aGUgbWFwcGluZyAiCisJCQkJICAgICJ0YWJsZSBpdCBh bHJlYWR5IHVzZWQuICBUaGlzIGlzIGEgYnVnIGluICIKKwkJCQkgICAgImVpdGhlciB0aGUgSEJB IGZpcm13YXJlIG9yIHRoZSBleHBhbmRlciAiCisJCQkJICAgICJmaXJtd2FyZS4gT2xkIGVudHJ5 OiBwaHlzaWNhbF9pZD0lMTZseCAiCisJCQkJICAgICJkZXZfaGFuZGxlPSUjMDR4LiAgTmV3IGVu dHJ5OiAiCisJCQkJICAgICJwaHlzaWNhbF9pZD0lMTZseCBoYW5kbGU9JSMwNHhcbiIsCisJCQkJ ICAgIF9fZnVuY19fLCBwaHlfY2hhbmdlLT5zbG90LAorCQkJCSAgICBtdF9lbnRyeS0+cGh5c2lj YWxfaWQsCisJCQkJICAgIG10X2VudHJ5LT5kZXZfaGFuZGxlLAorCQkJCSAgICBwaHlfY2hhbmdl LT5waHlzaWNhbF9pZCwKKwkJCQkgICAgcGh5X2NoYW5nZS0+ZGV2X2hhbmRsZSk7CisJCQkJY29u dGludWU7CisJCQl9CiAJCQltdF9lbnRyeS0+cGh5c2ljYWxfaWQgPSBwaHlfY2hhbmdlLT5waHlz aWNhbF9pZDsKIAkJCW10X2VudHJ5LT5jaGFubmVsID0gMDsKIAkJCW10X2VudHJ5LT5pZCA9IG1h cF9pZHg7Cg== --f46d044519992ba4680509b87b14-- From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 20:34:52 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 621C7D0E for ; Mon, 8 Dec 2014 20:34:52 +0000 (UTC) Received: from mail-pd0-f181.google.com (mail-pd0-f181.google.com [209.85.192.181]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 355EDC8B for ; Mon, 8 Dec 2014 20:34:51 +0000 (UTC) Received: by mail-pd0-f181.google.com with SMTP id v10so5725027pde.26 for ; Mon, 08 Dec 2014 12:34:51 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:content-type:mime-version:subject:from :in-reply-to:date:cc:content-transfer-encoding:message-id:references :to; bh=NhTN+I8bOWgtkowwPw04GUX+Sz3t0t9gLIJcVBaAXsM=; b=SU2uRF/Q1fcJ/4WNY6tTo3e/IjcWOncDusB/XD/kd9RplKC76PCe967KXRpqksdmyR d9RPrNaxy9W+ENeNdYIkIvHHDQ/TDqg13EFP69F5OcipQtKNJJbT9dUo92WvQlJ24MFr V/evyFDsJ7EB7SiRs4v4+eWFM6tJvOygSp8R0In0NrXjxuvk5Ai+HF3z125aE0ESQonW IEkHDP8vopETiuj032EoWtPTTlzpYb7+5jvZCW+bUTvMENUwdWXpllWnu+3Mbtwrpy2L 1qcETYbViduXP+gkDg1rG3bvowuVV5vrJ0ANE8BHPQAQqjZHzxIRwh1kXhI0AEdf/QG+ BFaA== X-Gm-Message-State: ALoCoQkN0G9zK0aSEwo1XlBH29GxIVIXpkRQ7L6/NggxwTHZ/isyXzSbDK3FZy/kHyPcZwqRar8B X-Received: by 10.66.65.202 with SMTP id z10mr53448814pas.104.1418069028906; Mon, 08 Dec 2014 12:03:48 -0800 (PST) Received: from [10.0.1.19] (dy2.sdf.com. [216.113.193.86]) by mx.google.com with ESMTPSA id b16sm37224613pdj.76.2014.12.08.12.03.47 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 08 Dec 2014 12:03:48 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 8.1 \(1993\)) Subject: Re: multipath problem: active provider chosen on passive FC path? From: Tom Samplonius In-Reply-To: <23F06C2E-558A-4E68-AD35-B3CD49760DFE@patpro.net> Date: Mon, 8 Dec 2014 12:03:46 -0800 Content-Transfer-Encoding: quoted-printable Message-Id: <81548287-A118-4AFD-8AB5-F76CD3B060FF@samplonius.org> References: <23F06C2E-558A-4E68-AD35-B3CD49760DFE@patpro.net> To: patpro@patpro.net X-Mailer: Apple Mail (2.1993) Cc: freebsd-scsi@freebsd.org X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 20:34:52 -0000 >=20 > I've installed FreeBSD 9.3 on two HP blade servers (G6), into an HP = C7000 chassis. This chassis uses two Brocade FC switches (active/passive = if I'm not mistaken). The blade servers use=20 > Unfortunately during boot, and during normal operation, the first = provider (da2 here) seems faulty: >=20 > isp0: Chan 0 Abort Cmd for N-Port 0x0008 @ Port 0x090a00 > (da2:isp0:0:2:0): Command Aborted > (da2:isp0:0:2:0): READ(6). CDB: 08 00 03 28 02 00=20 > (da2:isp0:0:2:0): CAM status: CCB request aborted by the host > (da2:isp0:0:2:0): Retrying command FC switches are typically active-active, as the FC switch fabric is = "intelligent" and doesn't have looping issues like ethernet. Your issue is probably on the storage array. Storage arrays typically = have an OS profile, and various advanced settings for how a LUN is = exported to a client. Storage arrays typically support SCSI = Reservations, where the LUN must be reserved before it can be used. = Also, storage arrays typically have multiple controller cards, and = typically an LUN is owned by one of the controllers at a time. The = storage array can signal to the client via SCSI that it wants to move = the the ownership to another controller. With proper client support, = migrating a LUN to another controller is typically hit-less.=20 In your case, the storage array is probably configured to use one = controller/path at a time. And it is probably expecting to see specific = SCSI messages between itself and the host. These type of settings are = typically set by the OS profile. Generally, storage arrays work best if you only send IO to one = controller at a time. And this involves co-ordination between the array = and the client using SCSI control messages. Though active-active paths = can usually be supported as well. Tom From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 20:44:21 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4C0ACEC1; Mon, 8 Dec 2014 20:44:21 +0000 (UTC) Received: from mail-wg0-x229.google.com (mail-wg0-x229.google.com [IPv6:2a00:1450:400c:c00::229]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CE94ADA2; Mon, 8 Dec 2014 20:44:20 +0000 (UTC) Received: by mail-wg0-f41.google.com with SMTP id y19so7165695wgg.28 for ; Mon, 08 Dec 2014 12:44:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=TimU8P/2Nx68oJeOPhPdBTH5rIRopXZuqUcz6X7qGOg=; b=k9CTa15f0my4Ny6SDjTyLh9Uo6J4in3/HVEwIdpzncCmHh+NTCoxsCWLcCYQKLOFeB nsgwLUquIOPNV3xL97ZghsvBxeMd6KExkGIPx5WhlXi8IHcLzh/aRZut37uLEKFIcvdd sXsEBKx7zXLl/mun5WGrpjKfagNsq46ZBPQGIfmqPYaBvlUmnZi5omkw1IrNkWsQntM0 lO0JzRXEnQbgWeMmubEI4ykmbseXd0e7ozMoaMezzFzZJqpzf+ghiWKaQR9DqeATnznR bMyv0frxA7WyNaUSYJ71F+1RquHdRlyPx9UXGL6xTlVG9TUZMe7BAxpHWrvexqasU0SO cyfw== MIME-Version: 1.0 X-Received: by 10.194.23.202 with SMTP id o10mr48606844wjf.73.1418071459202; Mon, 08 Dec 2014 12:44:19 -0800 (PST) Received: by 10.217.152.195 with HTTP; Mon, 8 Dec 2014 12:44:19 -0800 (PST) In-Reply-To: References: <54822835.3080800@crystal.harvard.edu> Date: Mon, 8 Dec 2014 13:44:19 -0700 Message-ID: Subject: Re: LSI SAS 3008 card - 35 out of 36 disks detected From: Jason Wolfe To: Alan Somers Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD-scsi X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 20:44:21 -0000 On Mon, Dec 8, 2014 at 11:20 AM, Alan Somers wrote: > On Mon, Dec 8, 2014 at 8:58 AM, Justin O'Conor > wrote: >> Hi All, >> Thanks, this is encouraging. smp_discover ses0|1 see 36 sata disks. This is from the 10.1 install. >> > > There are certainly some inconsistencies in the smp_discover > responses. For example, the SEP on ses0 (phy identifier: 36) has > "connector type: SAS virtual connector" and "connector element index: > 24" But the SEP on ses1 (phy identifier: 28) has "connector type: No > information" and "connector element index: 0". Also note that "phy > identifier: 12" on ses1 has "connector element index: 0". That would > be the first slot on the rear expander, if the slots and phys are > numbered the same way. My best guess is that phy 12 and phy 28 mapped > to the same map_idx in mpr_mapping.c:1168. So the information for the > SEP overwrote the information for the first disk slot. If my guess is > true, then recabling your chassis as you suggested wouldn't help. > However, you might try the attached but untested patch. It will > prevent the SEP from being added to the mapping table while printing a > useful error message. If I'm correct, then the patch will let you use > all 36 disk slots, but you won't have ses1 anymore. > > In the meantime, I'll try to reproduce your problem. I have all the > required equipment in my lab. > > -Alan > I believe this is the same issue we ran into a few years ago on the LSI2008, where the ses0 device would map over the boot disk. It's long and spans over multiple months, so just the relevant bits: Initial report: https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005243.html The issue seems to be a shortcoming in the detection method where it has no problem assigning the ses over an already mapped disk, LSI's initial response was to use the LSI config utility and map the drives manually: https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005243.html https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005267.html https://lists.freebsd.org/pipermail/freebsd-scsi/2012-March/005343.html This was not an option for us as we had 2000 of these devices in the field, and entering the LSI BIOS would be a large undertaking. In the end after an internal dialogue with LSI guys, Kashyap was kind enough to write a one off for us, that never made it upstream. It simply assigns the ses device to max target + 1 when a conflict is found. The core issue seems to be with the way LSI detects and assigns devices on FreeBSD, so this is by no means 'proper', but it's sound enough so resolve the issue for us on the LSI2008. In case it's interesting to anyone: http://nitrology.com/mps_fix-fbsd10stable.diff Jason From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 21:33:52 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2396CBF for ; Mon, 8 Dec 2014 21:33:52 +0000 (UTC) Received: from rack.patpro.net (rack.patpro.net [193.30.227.216]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "patpro.net", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id D9238316 for ; Mon, 8 Dec 2014 21:33:51 +0000 (UTC) Received: from [192.168.0.2] (boleskine.patpro.net [82.230.142.222]) by rack.patpro.net (Postfix) with ESMTPSA id 9D60F947; Mon, 8 Dec 2014 22:33:46 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=patpro.net; s=patpro; t=1418074426; bh=5YYZC52AQiJQlG5TDsp6ZGkQ6/9J2bzIlAdnO+YUKas=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=C64OC2ccQhfg9dvQgkEY2ZTmP/ccFocUbZ0hpwG+6txhFB2xHMiMrE9BjYHLjNYzJ 7jNwLexXHiw5Lu1fx4oCZbo1BbzXrkJmBeFsvFwn4ueVtJ0hMQMW0HXQZlGkt23uwo PhUPKNgFxJpB2MfKLe3BwjOdcS9paCzDL4cvZkSE= Subject: Re: multipath problem: active provider chosen on passive FC path? Mime-Version: 1.0 (Apple Message framework v1085) Content-Type: text/plain; charset=iso-8859-1 From: Patrick Proniewski In-Reply-To: <81548287-A118-4AFD-8AB5-F76CD3B060FF@samplonius.org> Date: Mon, 8 Dec 2014 22:33:46 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <23F06C2E-558A-4E68-AD35-B3CD49760DFE@patpro.net> <81548287-A118-4AFD-8AB5-F76CD3B060FF@samplonius.org> To: Tom Samplonius X-Mailer: Apple Mail (2.1085) Cc: freebsd-scsi@freebsd.org X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 21:33:52 -0000 On 08 d=E9c. 2014, at 21:03, Tom Samplonius wrote: >>=20 >> I've installed FreeBSD 9.3 on two HP blade servers (G6), into an HP = C7000 chassis. This chassis uses two Brocade FC switches (active/passive = if I'm not mistaken). The blade servers use=20 >=20 >=20 >> Unfortunately during boot, and during normal operation, the first = provider (da2 here) seems faulty: >>=20 >> isp0: Chan 0 Abort Cmd for N-Port 0x0008 @ Port 0x090a00 >> (da2:isp0:0:2:0): Command Aborted >> (da2:isp0:0:2:0): READ(6). CDB: 08 00 03 28 02 00=20 >> (da2:isp0:0:2:0): CAM status: CCB request aborted by the host >> (da2:isp0:0:2:0): Retrying command >=20 >=20 > FC switches are typically active-active, as the FC switch fabric is = "intelligent" and doesn't have looping issues like ethernet. >=20 > Your issue is probably on the storage array. Storage arrays = typically have an OS profile, and various advanced settings for how a = LUN is exported to a client. Storage arrays typically support SCSI = Reservations, where the LUN must be reserved before it can be used. = Also, storage arrays typically have multiple controller cards, and = typically an LUN is owned by one of the controllers at a time. The = storage array can signal to the client via SCSI that it wants to move = the the ownership to another controller. With proper client support, = migrating a LUN to another controller is typically hit-less.=20 >=20 > In your case, the storage array is probably configured to use one = controller/path at a time. And it is probably expecting to see specific = SCSI messages between itself and the host. These type of settings are = typically set by the OS profile. >=20 > Generally, storage arrays work best if you only send IO to one = controller at a time. And this involves co-ordination between the array = and the client using SCSI control messages. Though active-active paths = can usually be supported as well. Thank you for your reply. The SAN is an EMC VNX 5300. By default it = presents LUNs using ALUA as failover mechanism. I though GEOM could not = handle ALUA properly, so I changed the failover setting for this LUN, = now the FreeBSD hang during boot. If I boot in single user mode, it = boots completely but the result is the same default active path is not = functioning correctly. Tomorrow, I'll try another failover setting (dubbed "legacy"). The SAN = also allows me to specify initiator type (default to Clariion), I'll dig = into this setting to see if something exists that is more adapted to = FreeBSD host. Any other idea is welcome... Patrick= From owner-freebsd-scsi@FreeBSD.ORG Mon Dec 8 21:54:22 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 1DB56968; Mon, 8 Dec 2014 21:54:22 +0000 (UTC) Received: from mail-wi0-x22a.google.com (mail-wi0-x22a.google.com [IPv6:2a00:1450:400c:c05::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9ED79775; Mon, 8 Dec 2014 21:54:21 +0000 (UTC) Received: by mail-wi0-f170.google.com with SMTP id bs8so8394518wib.3 for ; Mon, 08 Dec 2014 13:54:20 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=exuh8rmE8NMY37VPH3qR1I3YfBL1pK5aNi/8FplO2sk=; b=ZmjVr73HoUxGDD16ubQwXAUanh3qZClrNqIZR6H5hNv1hwy989S0E6C9qQww2ghC6w nHJoFiboUZ9i2xjbsjqSfIRF+ioqJ+xPeV92Ew/OfeuAyd/0fozFnofe4kuX7WgWNCue SIP8arqvlrLGlAOZOjsBzKDmxrKQ3hXSzUZwa/yus9YpwoiGW8lS9rK2ZnRX6++LD4A8 2aQjyIDDi2oqJRpxviQLR9G5qD1nm0gElieOC2clcSAcD8tgLWl8f76U9xddE7WLrLtE 5OSNC62OyMD1oFpDg7KwWl1WuoGundf2LetKgScYCx3KjQ8jzsDv8G8w0qsmHpezLB6A vEDw== MIME-Version: 1.0 X-Received: by 10.194.60.45 with SMTP id e13mr49071011wjr.109.1418075656086; Mon, 08 Dec 2014 13:54:16 -0800 (PST) Sender: asomers@gmail.com Received: by 10.194.17.129 with HTTP; Mon, 8 Dec 2014 13:54:16 -0800 (PST) In-Reply-To: References: <54822835.3080800@crystal.harvard.edu> Date: Mon, 8 Dec 2014 14:54:16 -0700 X-Google-Sender-Auth: TAwfPGPAohVIyb59DFQEdm0YYmg Message-ID: Subject: Re: LSI SAS 3008 card - 35 out of 36 disks detected From: Alan Somers To: Jason Wolfe Content-Type: text/plain; charset=UTF-8 Cc: FreeBSD-scsi X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Dec 2014 21:54:22 -0000 On Mon, Dec 8, 2014 at 1:44 PM, Jason Wolfe wrote: > On Mon, Dec 8, 2014 at 11:20 AM, Alan Somers wrote: >> On Mon, Dec 8, 2014 at 8:58 AM, Justin O'Conor >> wrote: >>> Hi All, >>> Thanks, this is encouraging. smp_discover ses0|1 see 36 sata disks. This is from the 10.1 install. >>> >> >> There are certainly some inconsistencies in the smp_discover >> responses. For example, the SEP on ses0 (phy identifier: 36) has >> "connector type: SAS virtual connector" and "connector element index: >> 24" But the SEP on ses1 (phy identifier: 28) has "connector type: No >> information" and "connector element index: 0". Also note that "phy >> identifier: 12" on ses1 has "connector element index: 0". That would >> be the first slot on the rear expander, if the slots and phys are >> numbered the same way. My best guess is that phy 12 and phy 28 mapped >> to the same map_idx in mpr_mapping.c:1168. So the information for the >> SEP overwrote the information for the first disk slot. If my guess is >> true, then recabling your chassis as you suggested wouldn't help. >> However, you might try the attached but untested patch. It will >> prevent the SEP from being added to the mapping table while printing a >> useful error message. If I'm correct, then the patch will let you use >> all 36 disk slots, but you won't have ses1 anymore. >> >> In the meantime, I'll try to reproduce your problem. I have all the >> required equipment in my lab. >> >> -Alan >> > > I believe this is the same issue we ran into a few years ago on the > LSI2008, where the ses0 device would map over the boot disk. It's > long and spans over multiple months, so just the relevant bits: > > Initial report: > https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005243.html > > The issue seems to be a shortcoming in the detection method where it > has no problem assigning the ses over an already mapped disk, LSI's > initial response was to use the LSI config utility and map the drives > manually: > https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005243.html > https://lists.freebsd.org/pipermail/freebsd-scsi/2012-February/005267.html > https://lists.freebsd.org/pipermail/freebsd-scsi/2012-March/005343.html > > This was not an option for us as we had 2000 of these devices in the > field, and entering the LSI BIOS would be a large undertaking. In the > end after an internal dialogue with LSI guys, Kashyap was kind enough > to write a one off for us, that never made it upstream. It simply > assigns the ses device to max target + 1 when a conflict is found. > The core issue seems to be with the way LSI detects and assigns > devices on FreeBSD, so this is by no means 'proper', but it's sound > enough so resolve the issue for us on the LSI2008. In case it's > interesting to anyone: > > http://nitrology.com/mps_fix-fbsd10stable.diff > > Jason I've reproduced the problem, and it's the same one that I saw before. It's also the same one that Jason described, but the full problem is a little more general than just the SEP device's mapping. First a little background: LSI controllers have two methods for mapping phys to SCSI Bus and Target IDs. One method is called Device Persistence mapping. It is based on the SAS WWN attached to each phy. The other method is called Enclosure/Slot mapping. That method uses the Connector Element Index or the Device Slot Number field of the expander's SMP DISCOVER response for the given phy. It seems that all of LSI's SAS2 HBAs used Device Persistence mapping by default, but the SAS3 HBAs use Enclosure/Slot mapping. That's why this problem rarely or never shows up with SAS 2 HBAs. The SAS Protocol Layer 3 rev 6g spec, section 9.4.3.11, says that the CONNECTOR ELEMENT INDEX field shall be ignored if the CONNECTOR TYPE field is set to 0. Clearly, the HBA firmware isn't ignoring that field. That's a bug with the HBA firmware. But the expander firmware could be doing better. If it reported a unique CONNECTOR ELEMENT INDEX for the SEP phy, then we wouldn't have this problem. I'll take that up with the expander vendor. In the meantime, there is a workaround. Don't use the patch I sent you; it doesn't work. The workaround is to configure your HBA to use Device Persistence mapping. You can do that from FreeBSD using a tool called lsiutil. Unfortunately, it isn't publicly distributed, but you can ask Steve McConnell (cc'ed) for a copy. Here are the instructions: 1) Ensure that the hba of concern is named "mpr0". 2) Start lsiutil 3) Select "mps0" [sic] 4) (Optionally) enter e for expert mode 5) Enter 9 for "Read/change configuration pages" 6) Enter 1 for Page Type (that means the IOC pages, FYI) 7) Enter 8 for Page Number 8) Enter 0 for NVRAM values 9) Enter "yes" to make changes 10) Offset is "c" 11) Change "00000002" to "00000001". 12) Enter "yes" to save changes. 13) Either reboot, or unload and reload mpr(4). That change will put you in Device Persistence mapping but with persistent mapping disabled. All of the slots should work again. At least I hope so. -Alan From owner-freebsd-scsi@FreeBSD.ORG Tue Dec 9 13:59:12 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4296D1B9 for ; Tue, 9 Dec 2014 13:59:12 +0000 (UTC) Received: from rack.patpro.net (rack.patpro.net [193.30.227.216]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (Client CN "patpro.net", Issuer "Gandi Standard SSL CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E4C9787E for ; Tue, 9 Dec 2014 13:59:11 +0000 (UTC) Received: from patpro.univ-lyon2.fr (patpro.univ-lyon2.fr [159.84.113.250]) by rack.patpro.net (Postfix) with ESMTPSA id AA747DC0; Tue, 9 Dec 2014 14:59:02 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=patpro.net; s=patpro; t=1418133543; bh=t6WsvQFhotEBLIgMvMQ2Bd9ATyw0UgSYljZ7T0SUiHU=; h=Subject:From:In-Reply-To:Date:Cc:References:To; b=IxoEAoMxpuNsOy8jl33Apl1me6wJR87m80956J6LVcclD/JCY7kE3keLWylzz6Yfr 7PBNo6Jj0DbMazUqRRr4EudgbT3vc+Uk3KmaL+MQi+j8iLUm4z7c0B4olk8mmkQvVh 38j6AJsa6HMwtGxZh2vX2Nuu4Q6s/qZZwG7QLt38= Content-Type: text/plain; charset=iso-8859-1 Mime-Version: 1.0 (Mac OS X Mail 6.6 \(1510\)) Subject: Re: multipath problem: active provider chosen on passive FC path? From: patpro@patpro.net In-Reply-To: Date: Tue, 9 Dec 2014 14:59:01 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <23F06C2E-558A-4E68-AD35-B3CD49760DFE@patpro.net> <81548287-A118-4AFD-8AB5-F76CD3B060FF@samplonius.org> To: "freebsd-scsi@freebsd.org" X-Mailer: Apple Mail (2.1510) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Dec 2014 13:59:12 -0000 On 8 d=E9c. 2014, at 22:33, Patrick Proniewski = wrote: >> FC switches are typically active-active, as the FC switch fabric is = "intelligent" and doesn't have looping issues like ethernet. >>=20 >> Your issue is probably on the storage array. Storage arrays = typically have an OS profile, and various advanced settings for how a = LUN is exported to a client. Storage arrays typically support SCSI = Reservations, where the LUN must be reserved before it can be used. = Also, storage arrays typically have multiple controller cards, and = typically an LUN is owned by one of the controllers at a time. The = storage array can signal to the client via SCSI that it wants to move = the the ownership to another controller. With proper client support, = migrating a LUN to another controller is typically hit-less.=20 >>=20 >> In your case, the storage array is probably configured to use one = controller/path at a time. And it is probably expecting to see specific = SCSI messages between itself and the host. These type of settings are = typically set by the OS profile. >>=20 >> Generally, storage arrays work best if you only send IO to one = controller at a time. And this involves co-ordination between the array = and the client using SCSI control messages. Though active-active paths = can usually be supported as well. >=20 >=20 > Thank you for your reply. The SAN is an EMC VNX 5300. By default it = presents LUNs using ALUA as failover mechanism. I though GEOM could not = handle ALUA properly, so I changed the failover setting for this LUN, = now the FreeBSD hang during boot. If I boot in single user mode, it = boots completely but the result is the same default active path is not = functioning correctly. >=20 > Tomorrow, I'll try another failover setting (dubbed "legacy"). The SAN = also allows me to specify initiator type (default to Clariion), I'll dig = into this setting to see if something exists that is more adapted to = FreeBSD host. Ok, I've tried a lot of things, but the problem is the same: I can = create a gmultipath device, play with it, but it will always have very = poor performances until providers are marked "FAIL". Eventually it ends with this kind of situation: # gmultipath status Name Status Components multipath/SPLUNK_2 DEGRADED da3 (PASSIVE) da7 (FAIL) da2 (ACTIVE) da6 (FAIL) If I play with every settings, I can come up with more than 70 = combinations. Far more than I can afford to test, unfortunately. Unless = a clever solution exists that I don't know yet, I'll have to give up on = FreeBSD for this project. I've asked EMC for support. Let's hope it does not end with a "not in = compatibility matrix" answer. Any help still appreciated... Patrick From owner-freebsd-scsi@FreeBSD.ORG Fri Dec 12 20:18:05 2014 Return-Path: Delivered-To: freebsd-scsi@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 3499BF41 for ; Fri, 12 Dec 2014 20:18:05 +0000 (UTC) Received: from mail-qg0-f44.google.com (mail-qg0-f44.google.com [209.85.192.44]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E07E0C96 for ; Fri, 12 Dec 2014 20:18:04 +0000 (UTC) Received: by mail-qg0-f44.google.com with SMTP id q107so3995887qgd.3 for ; Fri, 12 Dec 2014 12:18:04 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:message-id:date:from:user-agent:mime-version:to :cc:subject:references:in-reply-to:content-type :content-transfer-encoding; bh=r7k9d86fpJ9RlqfHhHKR7FTFkSCenLR15MNMa232ChU=; b=lMLt8o2slxbhRBefSBZtOiTJeYtzBnnpfU5846Ag1ZE/c+EBHtBGuBJm0QXiHWM2I4 y0qbDu0f1z/1/Ac7J4ZQd+1p33OvKWQ2TS3pv74fF7IeYEDktDiJBv3Pa7EjH2LFsXzf lGkl0/Exbh2aP0zZCh1/7V1nluogh233Wp8r0RWanhpQSuDddrCabyVAsHooN8UxhzSd 4fE9S0cUUHFWrWwnKLGrthKrw9LsJtTL8ozEtv5tM5yY1Ldz1LCpxbfraNF8ladUC10T Vzjbq0L+dC9wS1OzBhstKk/6sMvtqDLUAY9MaiEqV780T54ON/wcoq5GqEy3G/KhDApu n7+g== X-Gm-Message-State: ALoCoQlMN8EdpwyBQU2bY9jl6fWb+C4mcrsceUOxkppCfGMRv5OV/5MG06FEKKdalTu08fPXE6Bo X-Received: by 10.140.17.75 with SMTP id 69mr6272386qgc.29.1418415143898; Fri, 12 Dec 2014 12:12:23 -0800 (PST) Received: from justino.sbgrid.org (sb.med.harvard.edu. [134.174.140.235]) by mx.google.com with ESMTPSA id g66sm2323184qgf.37.2014.12.12.12.12.21 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 12 Dec 2014 12:12:22 -0800 (PST) Message-ID: <548B4C25.8010501@crystal.harvard.edu> Date: Fri, 12 Dec 2014 15:12:21 -0500 From: Justin O'Connor User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:24.0) Gecko/20100101 Thunderbird/24.1.0 MIME-Version: 1.0 To: Alan Somers , Jason Wolfe Subject: Re: LSI SAS 3008 card - 35 out of 36 disks detected References: <54822835.3080800@crystal.harvard.edu> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: FreeBSD-scsi X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 12 Dec 2014 20:18:05 -0000 On 12/08/14 16:54, Alan Somers wrote: > In the meantime, there is a workaround. Don't use the patch I sent > you; it doesn't work. The workaround is to configure your HBA to use > Device Persistence mapping. You can do that from FreeBSD using a tool > called lsiutil. Unfortunately, it isn't publicly distributed, but you > can ask Steve McConnell (cc'ed) for a copy. Here are the > instructions: > > 1) Ensure that the hba of concern is named "mpr0". > 2) Start lsiutil > 3) Select "mps0" [sic] > 4) (Optionally) enter e for expert mode > 5) Enter 9 for "Read/change configuration pages" > 6) Enter 1 for Page Type (that means the IOC pages, FYI) > 7) Enter 8 for Page Number > 8) Enter 0 for NVRAM values > 9) Enter "yes" to make changes > 10) Offset is "c" > 11) Change "00000002" to "00000001". > 12) Enter "yes" to save changes. > 13) Either reboot, or unload and reload mpr(4). > > That change will put you in Device Persistence mapping but with > persistent mapping disabled. All of the slots should work again. At > least I hope so. > > -Alan Thanks a lot everyone! This workaround worked using 10.1-RELEASE (did not test on 10.0). Cheers, Justin