Date: Fri, 25 Aug 2017 14:11:50 -0700 From: Jason Wolfe <j@nitrology.com> To: freebsd-scsi@freebsd.org Subject: Re: Disk reordering on LSI SAS2008/mps(4) Message-ID: <1112cc2edb666ce7fa9c72c11cdd284c@nitrology.com> In-Reply-To: <a7ebb9bef2dbb417d72a233706e50da6@nitrology.com> References: <a7ebb9bef2dbb417d72a233706e50da6@nitrology.com>
next in thread | previous in thread | raw e-mail | index | archive | help
[-- Attachment #1 --]
Attachments are useful.
On 2017-08-25 13:58, Jason Wolfe wrote:
> Hi!
>
> We've been having an issue where we see some disk reordering on boot
> on HEAD from mid July on LSI controllers, maybe 5% of the time. We
> brought mps current as of r322364 with no change behavior.
>
> I have a few logs attached with various debug output. In all cases
> I've seen the pass ordering to be proper, and cam does try to resolve
> the da ordering, but the device it tries to reassign to is already
> taken. Attached is the full output, and listing some relevant bits
> below for the casual reader. Being that the functionality in scsi_da.c
> has been fairly static, and it's attempting to reassign, it seems more
> likely we are running into something in mps here. The targets always
> look to be proper.
>
> The various settings of hw.mps.use_phy_num (-1/0/1) don't change the
> behavior, and neither does hw.mps.enable_ssu=0. We have machines over
> various FW versions (15/16) that see the issue. I'm wondering if the
> fact that we see this issue over soft reboots means that the firmware
> isn't coming into play. To confirm, we are booting from the
> controller, so the LSI BIOS is enabled.
>
> mps0@pci0:3:0:0: class=0x010700 card=0x040015d9 chip=0x00721000
> rev=0x03 hdr=0x00
> vendor = 'LSI Logic / Symbios Logic'
> device = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
> class = mass storage
> subclass = SAS
>
> reorder-verbose.txt:
> boot_verbose="YES"
> hw.mps.debug_level="71"
>
> da0 at mps0 bus 0 scbus0 target 17 lun 0
> cam_periph_alloc: attempt to re-allocate valid device da0 rejected
> flags 0x102 refcount 4
> da1 at mps0 bus 0 scbus0 target 8 lun 0
> daasync: Unable to attach to new device due to status 0x6
> da2 at mps0 bus 0 scbus0 target 9 lun 0
> ...
> da8 at mps0 bus 0 scbus0 target 15 lun 0
> da9 at mps0 bus 0 scbus0 target 16 lun 0
> da10 at mps0 bus 0 scbus0 target 18 lun 0
> da11 at mps0 bus 0 scbus0 target 19 lun 0
>
> pass0 at mps0 bus 0 scbus0 target 8 lun 0
> pass1 at mps0 bus 0 scbus0 target 9 lun 0
> ...
> pass9 at mps0 bus 0 scbus0 target 17 lun 0
> pass10 at mps0 bus 0 scbus0 target 18 lun 0
> pass11 at mps0 bus 0 scbus0 target 19 lun 0
>
>
>
>
> reorder-mps-mapping.txt:
> hw.mps.debug_level="583"
>
> da0 at mps0 bus 0 scbus0 target 19 lun 0
> da1 at mps0 bus 0 scbus0 target 8 lun 0
> da2 at mps0 bus 0 scbus0 target 9 lun 0
> ...
> da9 at mps0 bus 0 scbus0 target 16 lun 0
> da10 at mps0 bus 0 scbus0 target 17 lun 0
> da11 at mps0 bus 0 scbus0 target 18 lun 0
> cam_periph_alloc: attempt to re-allocate valid device da0 rejected
> flags 0x106 refcount 6
> daasync: Unable to attach to new device due to status 0x6
>
> ses0: da1,pass0: Element descriptor: 'Slot 01'
> ses0: da1,pass0: SAS Device Slot Element: 1 Phys at Slot 0
> ses0: da0,pass11: Element descriptor: 'Slot 12'
> ses0: da0,pass11: SAS Device Slot Element: 1 Phys at Slot 11
>
>
> Luckily we have found a way to fairly easily repro it over a few
> hours, so we are open to any suggestions.
>
> Thanks!
> Jason
[-- Attachment #2 --]
mps0: mpssas_add_device: Target ID for added device is 8.
mps0: SAS Address from SAS device page0 = 857e5127e0b3a5bf
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000a> <2/0>
mps0: Target id 0x8 added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0xb with try_count = 1
mps0: SAS Address from SATA device = 8c7d5127e0b3a6ba
mps0: mpssas_add_device: Target ID for added device is 9.
mps0: SAS Address from SAS device page0 = 8c7d5127e0b3a6ba
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000b> <2/1>
mps0: Target id 0x9 added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0xc with try_count = 1
mps0: SAS Address from SATA device = 86825127e0b3a6bb
mps0: mpssas_add_device: Target ID for added device is 10.
mps0: SAS Address from SAS device page0 = 86825127e0b3a6bb
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000c> <2/2>
mps0: Target id 0xa added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0xd with try_count = 1
mps0: SAS Address from SATA device = 88815127e0b3a3bf
mps0: mpssas_add_device: Target ID for added device is 11.
mps0: SAS Address from SAS device page0 = 88815127e0b3a3bf
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000d> <2/3>
mps0: Target id 0xb added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0xe with try_count = 1
mps0: SAS Address from SATA device = 87825127e0b3a3bf
mps0: mpssas_add_device: Target ID for added device is 12.
mps0: SAS Address from SAS device page0 = 87825127e0b3a3bf
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000e> <2/4>
mps0: Target id 0xc added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0xf with try_count = 1
mps0: SAS Address from SATA device = 8b845127e0b3a3bf
mps0: mpssas_add_device: Target ID for added device is 13.
mps0: SAS Address from SAS device page0 = 8b845127e0b3a3bf
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x000f> <2/5>
mps0: Target id 0xd added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x10 with try_count = 1
mps0: SAS Address from SATA device = 8c7c5127e0b3a6bc
mps0: mpssas_add_device: Target ID for added device is 14.
mps0: SAS Address from SAS device page0 = 8c7c5127e0b3a6bc
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0010> <2/6>
mps0: Target id 0xe added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x11 with try_count = 1
mps0: SAS Address from SATA device = 8d845127e0b3a6bc
mps0: mpssas_add_device: Target ID for added device is 15.
mps0: SAS Address from SAS device page0 = 8d845127e0b3a6bc
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0011> <2/7>
mps0: Target id 0xf added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x12 with try_count = 1
mps0: SAS Address from SATA device = 8d7f5127e0b3a3be
mps0: mpssas_add_device: Target ID for added device is 16.
mps0: SAS Address from SAS device page0 = 8d7f5127e0b3a3be
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0012> <2/8>
mps0: Target id 0x10 added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x13 with try_count = 1
mps0: SAS Address from SATA device = 877f5127e0b3a3c0
mps0: mpssas_add_device: Target ID for added device is 17.
mps0: SAS Address from SAS device page0 = 877f5127e0b3a3c0
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0013> <2/9>
mps0: Target id 0x11 added
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_decrement refcount 1
mps0: (5)->(mpssas_fw_work) Event Free: [1c]
mps0: (5)->(mpssas_fw_work) Working on Event: [1c]
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x14 with try_count = 1
mps0: SAS Address for SATA device = 86805127e0b3a6bc
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x15 with try_count = 1
mps0: SAS Address for SATA device = 8c805127e0b3a3bf
mps0: mpssas_startup_increment refcount 2
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x14 with try_count = 1
mps0: SAS Address from SATA device = 86805127e0b3a6bc
mps0: mpssas_add_device: Target ID for added device is 18.
mps0: SAS Address from SAS device page0 = 86805127e0b3a6bc
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0014> <2/10>
mps0: Target id 0x12 added
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_increment refcount 2
mps0: mpssas_get_sas_address_for_sata_disk: got SATA identify successfully for handle = 0x15 with try_count = 1
mps0: SAS Address from SATA device = 8c805127e0b3a3bf
mps0: mpssas_add_device: Target ID for added device is 19.
mps0: SAS Address from SAS device page0 = 8c805127e0b3a3bf
mps0: Found device <81<SataDev>,End Device> <6.0Gbps> <0x0015> <2/11>
mps0: Target id 0x13 added
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_increment refcount 2
mps0: mpssas_add_device: Target ID for added device is 20.
mps0: SAS Address from SAS device page0 = 5003048000f625bd
mps0: Found device <4451<SmpInit,SspInit,SspTarg,SepDev>,End Device> <6.0Gbps> <0x0016> <2/0>
mps0: Target id 0x14 added
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_decrement releasing simq
mps0: mpssas_startup_decrement refcount 0
mps0: (6)->(mpssas_fw_work) Event Free: [1c]
mps0: (6)->(mpssas_fw_work) Working on Event: [16]
mps0: Discovery has completed. Check for missing devices in the mapping table.
mps0: (7)->(mpssas_fw_work) Event Free: [16]
da0 at mps0 bus 0 scbus0 target 19 lun 0
da0: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number S1G1NYAF500684
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 457862MB (937703088 512 byte sectors)
da0: quirks=0x8<4K>
da1 at mps0 bus 0 scbus0 target 8 lun 0
da1: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number S1G1NYAF502612
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 457862MB (937703088 512 byte sectors)
da1: quirks=0x8<4K>
da3 at mps0 bus 0 scbus0 target 10 lun 0
da3: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number S1G1NYAF503226
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 457862MB (937703088 512 byte sectors)
da3: quirks=0x8<4K>
da4 at mps0 bus 0 scbus0 target 11 lun 0
da4: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number S1G1NYAF500645
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 457862MB (937703088 512 byte sectors)
da4: quirks=0x8<4K>
cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0x106 refcount 6
da6 at mps0 bus 0 scbus0 target 13 lun 0
da6: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number S1G1NYAF500678
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 457862MB (937703088 512 byte sectors)
da6: quirks=0x8<4K>
daasync: Unable to attach to new device due to status 0x6
da7: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number S1G1NYAF503380
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 457862MB (937703088 512 byte sectors)
da7: quirks=0x8<4K>
da9 at mps0 bus 0 scbus0 target 16 lun 0
da9: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number S1G1NYAF500593
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 457862MB (937703088 512 byte sectors)
da9: quirks=0x8<4K>
da10 at mps0 bus 0 scbus0 target 17 lun 0
da10: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number S1G1NYAF500733
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 457862MB (937703088 512 byte sectors)
da10: quirks=0x8<4K>
da2 at mps0 bus 0 scbus0 target 9 lun 0
da2: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number S1G1NYAF503181
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 457862MB (937703088 512 byte sectors)
da2: quirks=0x8<4K>
da5 at mps0 bus 0 scbus0 target 12 lun 0
da5: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number S1G1NYAF500636
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 457862MB (937703088 512 byte sectors)
da5: quirks=0x8<4K>
da8 at mps0 bus 0 scbus0 target 15 lun 0
da8: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number S1G1NYAF503398
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 457862MB (937703088 512 byte sectors)
da8: quirks=0x8<4K>
da11 at mps0 bus 0 scbus0 target 18 lun 0
da11: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number S1G1NYAF503324
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 457862MB (937703088 512 byte sectors)
da11: quirks=0x8<4K>
ses0 at mps0 bus 0 scbus0 target 20 lun 0
ses0: <LSI SAS2X28 0e12> Fixed Enclosure Services SPC-3 SCSI device
ses0: Serial Number
ses0: 600.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
ses1 at ahciem0 bus 0 scbus8 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
ses0: da1,pass0: Element descriptor: 'Slot 01'
ses0: da1,pass0: SAS Device Slot Element: 1 Phys at Slot 0
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ac
ses0: da2,pass1: Element descriptor: 'Slot 02'
ses0: da2,pass1: SAS Device Slot Element: 1 Phys at Slot 1
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ad
ses0: da3,pass2: Element descriptor: 'Slot 03'
ses0: da3,pass2: SAS Device Slot Element: 1 Phys at Slot 2
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ae
ses0: da4,pass3: Element descriptor: 'Slot 04'
ses0: da4,pass3: SAS Device Slot Element: 1 Phys at Slot 3
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625af
ses0: da5,pass4: Element descriptor: 'Slot 05'
ses0: da5,pass4: SAS Device Slot Element: 1 Phys at Slot 4
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b0
ses0: da6,pass5: Element descriptor: 'Slot 06'
ses0: da6,pass5: SAS Device Slot Element: 1 Phys at Slot 5
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b1
ses0: da7,pass6: Element descriptor: 'Slot 07'
ses0: da7,pass6: SAS Device Slot Element: 1 Phys at Slot 6
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b2
ses0: da8,pass7: Element descriptor: 'Slot 08'
ses0: da8,pass7: SAS Device Slot Element: 1 Phys at Slot 7
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b3
ses0: da9,pass8: Element descriptor: 'Slot 09'
ses0: da9,pass8: SAS Device Slot Element: 1 Phys at Slot 8
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b4
ses0: da10,pass9: Element descriptor: 'Slot 10'
ses0: da10,pass9: SAS Device Slot Element: 1 Phys at Slot 9
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b5
ses0: da11,pass10: Element descriptor: 'Slot 11'
ses0: da11,pass10: SAS Device Slot Element: 1 Phys at Slot 10
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b6
ses0: da0,pass11: Element descriptor: 'Slot 12'
ses0: da0,pass11: SAS Device Slot Element: 1 Phys at Slot 11
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b7
[-- Attachment #3 --]
AHCI reset...
ahcich0: SATA connect timeout time=10000us status=00000000
ahcich0: mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
AHCI reset: device not found
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
ahcich1: Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AHCI reset...
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
ahcich1: AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
SATA connect timeout time=10000us status=00000000
mps0: ahcich1: AHCI reset: device not found
(0)->(mpssas_fw_work) Working on Event: [17]
mps0: (1)->(mpssas_fw_work) Event Free: [17]
mps0: (1)->(mpssas_fw_work) Working on Event: [17]
mps0: (2)->(mpssas_fw_work) Event Free: [17]
mps0: (2)->(mpssas_fw_work) Working on Event: [17]
mps0: (3)->(mpssas_fw_work) Event Free: [17]
ahcich2: AHCI reset...
mps0: (3)->(mpssas_fw_work) Working on Event: [17]
mps0: (4)->(mpssas_fw_work) Event Free: [17]
mps0: (4)->(mpssas_fw_work) Working on Event: [17]
mps0: ahcich2: SATA connect timeout time=10000us status=00000000
ahcich2: AHCI reset: device not found
(5)->(mpssas_fw_work) Event Free: [17]
mps0: (5)->(mpssas_fw_work) Working on Event: [17]
ahcich3: AHCI reset...
mps0: (6)->(mpssas_fw_work) Event Free: [17]
mps0: (6)->(mpssas_fw_work) Working on Event: [17]
mps0: (7)->(mpssas_fw_work) Event Free: [17]
mps0: (7)->(mpssas_fw_work) Working on Event: [17]
mps0: (8)->(mpssas_fw_work) Event Free: [17]
ahcich3: SATA connect timeout time=10000us status=00000000
ahcich3: AHCI reset: device not found
ahcich4: AHCI reset...
mps0: EventReply :
EventDataLength: 2
AckRequired: 0
ahcich4: SATA connect timeout time=10000us status=00000000
ahcich4: AHCI reset: device not found
Event: SasDiscovery (0x16)
EventContext: 0x0
Flags: 1<InProgress>
ReasonCode: Discovery Started
PhysicalPort: 0
ahcich5: AHCI reset...
DiscoveryStatus: 0
mps0: EventReply :
EventDataLength: 5
AckRequired: 0
Event: SasEnclDeviceStatusChange (0x1d)
EventContext: 0x0
EnclosureHandle: 0x1
ahcich5: ReasonCode: Added
PhysicalPort: 0
NumSlots: 8
StartSlot: 0
PhyBits: 0x0
mps0: EventReply :
EventDataLength: 11
AckRequired: 0
Event: SasTopologyChangeList (0x1c)
EventContext: 0x0
SATA connect timeout time=10000us status=00000000
ahcich5: AHCI reset: device not found
EnclosureHandle: 0x1
ExpanderDevHandle: 0x0
NumPhys: 8
NumEntries: 8
StartPhyNum: 0
ExpStatus: Unknown (0x0)
PhysicalPort: 0
PHY[0].AttachedDevHandle: 0x0009
PHY[0].LinkRate: 6.0Gbps (0xa0)
PHY[0].PhyStatus: PHYLinkStatusChange
PHY[1].AttachedDevHandle: 0x0009
PHY[1].LinkRate: 6.0Gbps (0xa0)
PHY[1].PhyStatus: PHYLinkStatusChange
PHY[2].AttachedDevHandle: 0x0009
PHY[2].LinkRate: 6.0Gbps (0xa0)
PHY[2].PhyStatus: PHYLinkStatusChange
PHY[3].AttachedDevHandle: 0x0009
PHY[3].LinkRate: 6.0Gbps (0xa0)
PHY[3].PhyStatus: PHYLinkStatusChange
PHY[4].AttachedDevHandle: 0x0009
PHY[4].LinkRate: 6.0Gbps (0xa0)
PHY[4].PhyStatus: PHYLinkStatusChange
PHY[5].AttachedDevHandle: 0x0009
PHY[5].LinkRate: 6.0Gbps (0xa0)
PHY[5].PhyStatus: PHYLinkStatusChange
PHY[6].AttachedDevHandle: 0x0009
PHY[6].LinkRate: 6.0Gbps (0xa0)
PHY[6].PhyStatus: PHYLinkStatusChange
PHY[7].AttachedDevHandle: 0x0009
PHY[7].LinkRate: 6.0Gbps (0xa0)
PHY[7].PhyStatus: PHYLinkStatusChange
mps0: mpssas_startup_increment refcount 2
mps0: EventReply :
EventDataLength: 5
AckRequired: 0
Event: SasEnclDeviceStatusChange (0x1d)
EventContext: 0x0
EnclosureHandle: 0x2
ReasonCode: Added
PhysicalPort: 0
NumSlots: 13
StartSlot: 0
PhyBits: 0xff
mps0: EventReply :
EventDataLength: 25
AckRequired: 0
Event: SasTopologyChangeList (0x1c)
EventContext: 0x0
EnclosureHandle: 0x2
ExpanderDevHandle: 0x9
NumPhys: 30
NumEntries: 22
StartPhyNum: 0
ExpStatus: Added (0x1)
PhysicalPort: 0
PHY[0].AttachedDevHandle: 0x0001
PHY[0].LinkRate: 6.0Gbps (0xa0)
PHY[0].PhyStatus: PHYLinkStatusChange
PHY[1].AttachedDevHandle: 0x0001
PHY[1].LinkRate: 6.0Gbps (0xa0)
PHY[1].PhyStatus: PHYLinkStatusChange
PHY[2].AttachedDevHandle: 0x0001
PHY[2].LinkRate: 6.0Gbps (0xa0)
PHY[2].PhyStatus: PHYLinkStatusChange
PHY[3].AttachedDevHandle: 0x0001
PHY[3].LinkRate: 6.0Gbps (0xa0)
PHY[3].PhyStatus: PHYLinkStatusChange
PHY[4].AttachedDevHandle: 0x0001
PHY[4].LinkRate: 6.0Gbps (0xa0)
PHY[4].PhyStatus: PHYLinkStatusChange
PHY[5].AttachedDevHandle: 0x0001
PHY[5].LinkRate: 6.0Gbps (0xa0)
PHY[5].PhyStatus: PHYLinkStatusChange
PHY[6].AttachedDevHandle: 0x0001
PHY[6].LinkRate: 6.0Gbps (0xa0)
PHY[6].PhyStatus: PHYLinkStatusChange
PHY[7].AttachedDevHandle: 0x0001
PHY[7].LinkRate: 6.0Gbps (0xa0)
PHY[7].PhyStatus: PHYLinkStatusChange
PHY[8].AttachedDevHandle: 0x0000
PHY[8].LinkRate: PHY disabled (0x10)
PHY[8].PhyStatus: PHYLinkStatusChange
PHY[9].AttachedDevHandle: 0x0000
PHY[9].LinkRate: PHY disabled (0x10)
PHY[9].PhyStatus: PHYLinkStatusChange
PHY[10].AttachedDevHandle: 0x0000
PHY[10].LinkRate: PHY disabled (0x10)
PHY[10].PhyStatus: PHYLinkStatusChange
PHY[11].AttachedDevHandle: 0x0000
PHY[11].LinkRate: PHY disabled (0x10)
PHY[11].PhyStatus: PHYLinkStatusChange
PHY[12].AttachedDevHandle: 0x000a
PHY[12].LinkRate: 6.0Gbps (0xaa)
PHY[12].PhyStatus: NewTargetAdded
PHY[13].AttachedDevHandle: 0x000b
PHY[13].LinkRate: 6.0Gbps (0xaa)
PHY[13].PhyStatus: NewTargetAdded
PHY[14].AttachedDevHandle: 0x000c
PHY[14].LinkRate: 6.0Gbps (0xaa)
PHY[14].PhyStatus: NewTargetAdded
PHY[15].AttachedDevHandle: 0x000d
PHY[15].LinkRate: 6.0Gbps (0xaa)
PHY[15].PhyStatus: NewTargetAdded
PHY[16].AttachedDevHandle: 0x000e
PHY[16].LinkRate: 6.0Gbps (0xaa)
PHY[16].PhyStatus: NewTargetAdded
PHY[17].AttachedDevHandle: 0x000f
PHY[17].LinkRate: 6.0Gbps (0xaa)
PHY[17].PhyStatus: NewTargetAdded
PHY[18].AttachedDevHandle: 0x0010
PHY[18].LinkRate: 6.0Gbps (0xaa)
PHY[18].PhyStatus: NewTargetAdded
PHY[19].AttachedDevHandle: 0x0011
PHY[19].LinkRate: 6.0Gbps (0xaa)
PHY[19].PhyStatus: NewTargetAdded
PHY[20].AttachedDevHandle: 0x0012
PHY[20].LinkRate: 6.0Gbps (0xaa)
PHY[20].PhyStatus: NewTargetAdded
PHY[21].AttachedDevHandle: 0x0013
PHY[21].LinkRate: 6.0Gbps (0xaa)
PHY[21].PhyStatus: NewTargetAdded
mps0: mpssas_startup_increment refcount 3
mps0: EventReply :
EventDataLength: 11
AckRequired: 0
Event: SasTopologyChangeList (0x1c)
EventContext: 0x0
EnclosureHandle: 0x2
ExpanderDevHandle: 0x9
NumPhys: 30
NumEntries: 8
StartPhyNum: 22
ExpStatus: Responding (0x3)
PhysicalPort: 0
PHY[22].AttachedDevHandle: 0x0014
PHY[22].LinkRate: 6.0Gbps (0xaa)
PHY[22].PhyStatus: NewTargetAdded
PHY[23].AttachedDevHandle: 0x0015
PHY[23].LinkRate: 6.0Gbps (0xaa)
PHY[23].PhyStatus: NewTargetAdded
PHY[24].AttachedDevHandle: 0x0000
PHY[24].LinkRate: PHY disabled (0x10)
PHY[24].PhyStatus: PHYLinkStatusChange
PHY[25].AttachedDevHandle: 0x0000
PHY[25].LinkRate: PHY disabled (0x10)
PHY[25].PhyStatus: PHYLinkStatusChange
PHY[26].AttachedDevHandle: 0x0000
PHY[26].LinkRate: PHY disabled (0x10)
PHY[26].PhyStatus: PHYLinkStatusChange
PHY[27].AttachedDevHandle: 0x0000
PHY[27].LinkRate: PHY disabled (0x10)
PHY[27].PhyStatus: PHYLinkStatusChange
PHY[28].AttachedDevHandle: 0x0016
PHY[28].LinkRate: 6.0Gbps (0xa0)
PHY[28].PhyStatus: NewTargetAdded
PHY[29].AttachedDevHandle: 0x0000
PHY[29].LinkRate: LinkRate Unknown (0x0)
PHY[29].PhyStatus: PHYLinkStatusChange
mps0: mpssas_startup_increment refcount 4
mps0: EventReply :
EventDataLength: 2
AckRequired: 0
Event: SasDiscovery (0x16)
EventContext: 0x0
Flags: 2<DeviceChange>
ReasonCode: Discovery Complete
PhysicalPort: 0
DiscoveryStatus: 0
mps0: mpssas_startup_decrement refcount 3
mps0: (8)->(mpssas_fw_work) Working on Event: [16]
mps0: (9)->(mpssas_fw_work) Event Free: [16]
mps0: (9)->(mpssas_fw_work) Working on Event: [1d]
mps0: (10)->(mpssas_fw_work) Event Free: [1d]
mps0: (10)->(mpssas_fw_work) Working on Event: [1c]
mps0: mpssas_startup_decrement refcount 2
mps0: (11)->(mpssas_fw_work) Event Free: [1c]
mps0: (11)->(mpssas_fw_work) Working on Event: [1d]
mps0: (12)->(mpssas_fw_work) Event Free: [1d]
mps0: (12)->(mpssas_fw_work) Working on Event: [1c]
mps0: SAS Address for SATA device = 857e5127e0b3a5bf
mps0: SAS Address for SATA device = 8c7d5127e0b3a6ba
mps0: SAS Address for SATA device = 86825127e0b3a6bb
mps0: SAS Address for SATA device = 88815127e0b3a3bf
mps0: SAS Address for SATA device = 87825127e0b3a3bf
mps0: SAS Address for SATA device = 8b845127e0b3a3bf
mps0: SAS Address for SATA device = 8c7c5127e0b3a6bc
mps0: SAS Address for SATA device = 8d845127e0b3a6bc
mps0: SAS Address for SATA device = 8d7f5127e0b3a3be
mps0: SAS Address for SATA device = 877f5127e0b3a3c0
mps0: mpssas_startup_increment refcount 3
mps0: SAS Address from SATA device = 857e5127e0b3a5bf
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe0:mps0:0:8:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8c7d5127e0b3a6ba
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe1:mps0:0:9:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 86825127e0b3a6bb
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe2:mps0:0:10:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 88815127e0b3a3bf
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe3:mps0:0:11:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 87825127e0b3a3bf
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe4:mps0:0:12:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8b845127e0b3a3bf
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe5:mps0:0:13:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8c7c5127e0b3a6bc
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe6:mps0:0:14:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8d845127e0b3a6bc
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe7:mps0:0:15:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8d7f5127e0b3a3be
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_increment refcount 3
(probe8:mps0:0:16:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 877f5127e0b3a3c0
mps0: mpssas_startup_decrement refcount 2
mps0: mpssas_startup_decrement refcount 1
mps0: (13)->(mpssas_fw_work) Event Free: [1c]
mps0: (13)->(mpssas_fw_work) Working on Event: [1c]
(probe9:mps0:0:17:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address for SATA device = 86805127e0b3a6bc
mps0: SAS Address for SATA device = 8c805127e0b3a3bf
mps0: mpssas_startup_increment refcount 2
mps0: SAS Address from SATA device = 86805127e0b3a6bc
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_increment refcount 2
(probe10:mps0:0:18:0): Down reving Protocol Version from 4 to 0?
mps0: SAS Address from SATA device = 8c805127e0b3a3bf
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_increment refcount 2
(probe11:mps0:0:19:0): Down reving Protocol Version from 4 to 0?
mps0: mpssas_startup_decrement refcount 1
mps0: mpssas_startup_decrement releasing simq
mps0: mpssas_startup_decrement refcount 0
mps0: (14)->(mpssas_fw_work) Event Free: [1c]
mps0: (14)->(mpssas_fw_work) Working on Event: [16]
mps0: (15)->(mpssas_fw_work) Event Free: [16]
(probe12:mps0:0:20:0): Down reving Protocol Version from 4 to 0?
GEOM: new disk da0
da0 at mps0 bus 0 scbus0 target 17 lun 0
da0: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number S1G1NYAF500733
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 457862MB (937703088 512 byte sectors)
da0: quirks=0x8<4K>
GEOM: new disk da1
da3 at mps0 bus 0 scbus0 target 10 lun 0
da3: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number S1G1NYAF503226
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 457862MB (937703088 512 byte sectors)
da3: quirks=0x8<4K>
cam_periph_alloc: attempt to re-allocate valid device da0 rejected flags 0x102 refcount 4
da1 at mps0 bus 0 scbus0 target 8 lun 0
da1: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number S1G1NYAF502612
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 457862MB (937703088 512 byte sectors)
da1: quirks=0x8<4K>
daasync: Unable to attach to new device due to status 0x6
da6 at mps0 bus 0 scbus0 target 13 lun 0
da6: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number S1G1NYAF500678
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 457862MB (937703088 512 byte sectors)
da6: quirks=0x8<4K>
da2 at mps0 bus 0 scbus0 target 9 lun 0
da2: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number S1G1NYAF503181
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 457862MB (937703088 512 byte sectors)
da2: quirks=0x8<4K>
da4 at mps0 bus 0 scbus0 target 11 lun 0
da4: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number S1G1NYAF500645
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 457862MB (937703088 512 byte sectors)
da4: quirks=0x8<4K>
da9 at mps0 bus 0 scbus0 target 16 lun 0
da9: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da9: Serial Number S1G1NYAF500593
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 457862MB (937703088 512 byte sectors)
da9: quirks=0x8<4K>
da7 at mps0 bus 0 scbus0 target 14 lun 0
da7: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da7: Serial Number S1G1NYAF503380
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 457862MB (937703088 512 byte sectors)
da7: quirks=0x8<4K>
da11 at mps0 bus 0 scbus0 target 19 lun 0
da11: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da11: Serial Number S1G1NYAF500684
da11: 600.000MB/s transfers
da11: Command Queueing enabled
da11: 457862MB (937703088 512 byte sectors)
da11: quirks=0x8<4K>
da5 at mps0 bus 0 scbus0 target 12 lun 0
da5: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number S1G1NYAF500636
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 457862MB (937703088 512 byte sectors)
da5: quirks=0x8<4K>
da8 at mps0 bus 0 scbus0 target 15 lun 0
da8: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da8: Serial Number S1G1NYAF503398
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 457862MB (937703088 512 byte sectors)
da8: quirks=0x8<4K>
da10 at mps0 bus 0 scbus0 target 18 lun 0
da10: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da10: Serial Number S1G1NYAF503324
da10: 600.000MB/s transfers
da10: Command Queueing enabled
da10: 457862MB (937703088 512 byte sectors)
da10: quirks=0x8<4K>
da0: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
pass0 at mps0 bus 0 scbus0 target 8 lun 0
pass0: GEOM: new disk da2
<ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
da3: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
pass0: Serial Number S1G1NYAF502612
pass0: 600.000MB/s transfers
pass0: Command Queueing enabled
GEOM: new disk da3
pass1 at mps0 bus 0 scbus0 target 9 lun 0
pass1: da1: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
da4: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
<ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass1: Serial Number S1G1NYAF503181
da6: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
GEOM: new disk da4
GEOM: new disk da5
pass1: 600.000MB/s transfers
pass1: Command Queueing enabled
GEOM: new disk da6
GEOM: new disk da7
da2: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
da7: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
da5: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
pass2 at mps0 bus 0 scbus0 target 10 lun 0
pass2: GEOM: new disk da8
da9: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
da11: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
GEOM: new disk da9
da8: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
da10: Delete methods: <ATA_TRIM(*),UNMAP,WS16,ZERO>
GEOM: new disk da10
<ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass2: Serial Number S1G1NYAF503226
pass2: 600.000MB/s transfers
pass2: Command Queueing enabled
GEOM: new disk da11
pass3 at mps0 bus 0 scbus0 target 11 lun 0
pass3: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass3: Serial Number S1G1NYAF500645
pass3: 600.000MB/s transfers
pass3: Command Queueing enabled
pass4 at mps0 bus 0 scbus0 target 12 lun 0
pass4: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass4: Serial Number S1G1NYAF500636
pass4: 600.000MB/s transfers
pass4: Command Queueing enabled
pass5 at mps0 bus 0 scbus0 target 13 lun 0
pass5: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass5: Serial Number S1G1NYAF500678
pass5: 600.000MB/s transfers
pass5: Command Queueing enabled
pass6 at mps0 bus 0 scbus0 target 14 lun 0
pass6: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass6: Serial Number S1G1NYAF503380
pass6: 600.000MB/s transfers
pass6: Command Queueing enabled
pass7 at mps0 bus 0 scbus0 target 15 lun 0
pass7: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass7: Serial Number S1G1NYAF503398
pass7: 600.000MB/s transfers
pass7: Command Queueing enabled
pass8 at mps0 bus 0 scbus0 target 16 lun 0
pass8: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass8: Serial Number S1G1NYAF500593
pass8: 600.000MB/s transfers
pass8: Command Queueing enabled
pass9 at mps0 bus 0 scbus0 target 17 lun 0
pass9: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass9: Serial Number S1G1NYAF500733
pass9: 600.000MB/s transfers
pass9: Command Queueing enabled
pass10 at mps0 bus 0 scbus0 target 18 lun 0
pass10: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass10: Serial Number S1G1NYAF503324
pass10: 600.000MB/s transfers
pass10: Command Queueing enabled
pass11 at mps0 bus 0 scbus0 target 19 lun 0
pass11: <ATA SAMSUNG MZ7WD480 203Q> Fixed Direct Access SPC-4 SCSI device
pass11: Serial Number S1G1NYAF500684
pass11: 600.000MB/s transfers
pass11: Command Queueing enabled
pass12: <LSI SAS2X28 0e12> Fixed Enclosure Services SPC-3 SCSI device
pass12: Serial Number
pass12: 600.000MB/s transfers
pass12: Command Queueing enabled
pass13 at ahciem0 bus 0 scbus8 target 0 lun 0
pass13: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses0 at mps0 bus 0 scbus0 target 20 lun 0
ses0: <LSI SAS2X28 0e12> Fixed Enclosure Services SPC-3 SCSI device
ses0: Serial Number
ses0: 600.000MB/s transfers
ses0: Command Queueing enabled
ses0: SCSI-3 ENC Device
ses1 at ahciem0 bus 0 scbus8 target 0 lun 0
ses1: <AHCI SGPIO Enclosure 1.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
ses0: Generation Code 0x0 has 1 SubEnclosures
ses0: ses1: Generation Code 0x0 has 1 SubEnclosures
ses1: SubEnclosure ID 0, 1 Types With this ID, Descriptor Length 36, offset 8
ses1: WWN: 0
ses1: Type Desc[0]: Type 0x17, MaxElt 6, In Subenc 0, Text Length 0:
SubEnclosure ID 0, 8 Types With this ID, Descriptor Length 44, offset 8
ses0: WWN: 5003048000f625bf
ses0: Type Desc[0]: Type 0x17, MaxElt 12, In Subenc 0, Text Length 11: Drive Slots
ses0: Type Desc[1]: Type 0x4, MaxElt 1, In Subenc 0, Text Length 19: Temperature Sensors
ses0: Type Desc[2]: Type 0x12, MaxElt 2, In Subenc 0, Text Length 15: Voltage Sensors
ses0: Type Desc[3]: Type 0x2, MaxElt 2, In Subenc 0, Text Length 14: Power Supplies
ses0: Type Desc[4]: Type 0xe, MaxElt 1, In Subenc 0, Text Length 9: Enclosure
ses0: Type Desc[5]: Type 0x18, MaxElt 1, In Subenc 0, Text Length 13: SAS Expanders
ses0: Type Desc[6]: Type 0x19, MaxElt 14, In Subenc 0, Text Length 14: SAS Connectors
ses0: Type Desc[7]: Type 0x11, MaxElt 2, In Subenc 0, Text Length 14: Ethernet ports
ses0: da1,pass0: Element descriptor: 'Slot 01'
ses0: da1,pass0: SAS Device Slot Element: 1 Phys at Slot 0
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ac
ses0: da2,pass1: Element descriptor: 'Slot 02'
ses0: da2,pass1: SAS Device Slot Element: 1 Phys at Slot 1
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ad
ses0: da3,pass2: Element descriptor: 'Slot 03'
ses0: da3,pass2: SAS Device Slot Element: 1 Phys at Slot 2
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625ae
ses0: da4,pass3: Element descriptor: 'Slot 04'
ses0: da4,pass3: SAS Device Slot Element: 1 Phys at Slot 3
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625af
ses0: da5,pass4: Element descriptor: 'Slot 05'
ses0: da5,pass4: SAS Device Slot Element: 1 Phys at Slot 4
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b0
ses0: da6,pass5: Element descriptor: 'Slot 06'
ses0: da6,pass5: SAS Device Slot Element: 1 Phys at Slot 5
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b1
ses0: da7,pass6: Element descriptor: 'Slot 07'
ses0: da7,pass6: SAS Device Slot Element: 1 Phys at Slot 6
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b2
ses0: da8,pass7: Element descriptor: 'Slot 08'
ses0: da8,pass7: SAS Device Slot Element: 1 Phys at Slot 7
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b3
ses0: da9,pass8: Element descriptor: 'Slot 09'
ses0: da9,pass8: SAS Device Slot Element: 1 Phys at Slot 8
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b4
ses0: da0,pass9: Element descriptor: 'Slot 10'
ses0: da0,pass9: SAS Device Slot Element: 1 Phys at Slot 9
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b5
ses0: da10,pass10: Element descriptor: 'Slot 11'
ses0: da10,pass10: SAS Device Slot Element: 1 Phys at Slot 10
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b6
ses0: da11,pass11: Element descriptor: 'Slot 12'
ses0: da11,pass11: SAS Device Slot Element: 1 Phys at Slot 11
ses0: phy 0: SATA device
ses0: phy 0: parent 5003048000f625bf addr 5003048000f625b7
mountroot>
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: (15)->(mpssas_fw_work) Working on Event: [17]
mps0: (16)->(mpssas_fw_work) Event Free: [17]
mps0: (16)->(mpssas_fw_work) Working on Event: [17]
mps0: (17)->(mpssas_fw_work) Event Free: [17]
mps0: (17)->(mpssas_fw_work) Working on Event: [17]
mps0: (18)->(mpssas_fw_work) Event Free: [17]
mps0: (18)->(mpssas_fw_work) Working on Event: [17]
mps0: (19)->(mpssas_fw_work) Event Free: [17]
mps0: (19)->(mpssas_fw_work) Working on Event: [17]
mps0: (20)->(mpssas_fw_work) Event Free: [17]
mps0: (20)->(mpssas_fw_work) Working on Event: [17]
mps0: (21)->(mpssas_fw_work) Event Free: [17]
mps0: (21)->(mpssas_fw_work) Working on Event: [17]
mps0: (22)->(mpssas_fw_work) Event Free: [17]
mps0: (22)->(mpssas_fw_work) Working on Event: [17]
mps0: (23)->(mpssas_fw_work) Event Free: [17]
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: (23)->(mpssas_fw_work) Working on Event: [17]
mps0: (24)->(mpssas_fw_work) Event Free: [17]
mps0: (24)->(mpssas_fw_work) Working on Event: [17]
mps0: (25)->(mpssas_fw_work) Event Free: [17]
mps0: (25)->(mpssas_fw_work) Working on Event: [17]
mps0: (26)->(mpssas_fw_work) Event Free: [17]
mps0: (26)->(mpssas_fw_work) Working on Event: [17]
mps0: (27)->(mpssas_fw_work) Event Free: [17]
mps0: (27)->(mpssas_fw_work) Working on Event: [17]
mps0: (28)->(mpssas_fw_work) Event Free: [17]
mps0: (28)->(mpssas_fw_work) Working on Event: [17]
mps0: (29)->(mpssas_fw_work) Event Free: [17]
mps0: (29)->(mpssas_fw_work) Working on Event: [17]
mps0: (30)->(mpssas_fw_work) Event Free: [17]
mps0: (30)->(mpssas_fw_work) Working on Event: [17]
mps0: (31)->(mpssas_fw_work) Event Free: [17]
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: (47)->(mpssas_fw_work) Working on Event: [17]
mps0: (48)->(mpssas_fw_work) Event Free: [17]
mps0: (48)->(mpssas_fw_work) Working on Event: [17]
mps0: (49)->(mpssas_fw_work) Event Free: [17]
mps0: (49)->(mpssas_fw_work) Working on Event: [17]
mps0: (50)->(mpssas_fw_work) Event Free: [17]
mps0: (50)->(mpssas_fw_work) Working on Event: [17]
mps0: (51)->(mpssas_fw_work) Event Free: [17]
mps0: (51)->(mpssas_fw_work) Working on Event: [17]
mps0: (52)->(mpssas_fw_work) Event Free: [17]
mps0: (52)->(mpssas_fw_work) Working on Event: [17]
mps0: (53)->(mpssas_fw_work) Event Free: [17]
mps0: (53)->(mpssas_fw_work) Working on Event: [17]
mps0: (54)->(mpssas_fw_work) Event Free: [17]
mps0: (54)->(mpssas_fw_work) Working on Event: [17]
mps0: (55)->(mpssas_fw_work) Event Free: [17]
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: (55)->(mpssas_fw_work) Working on Event: [17]
mps0: (56)->(mpssas_fw_work) Event Free: [17]
mps0: (56)->(mpssas_fw_work) Working on Event: [17]
mps0: (57)->(mpssas_fw_work) Event Free: [17]
mps0: (57)->(mpssas_fw_work) Working on Event: [17]
mps0: (58)->(mpssas_fw_work) Event Free: [17]
mps0: (58)->(mpssas_fw_work) Working on Event: [17]
mps0: (59)->(mpssas_fw_work) Event Free: [17]
mps0: (59)->(mpssas_fw_work) Working on Event: [17]
mps0: (60)->(mpssas_fw_work) Event Free: [17]
mps0: (60)->(mpssas_fw_work) Working on Event: [17]
mps0: (61)->(mpssas_fw_work) Event Free: [17]
mps0: (61)->(mpssas_fw_work) Working on Event: [17]
mps0: (62)->(mpssas_fw_work) Event Free: [17]
mps0: (62)->(mpssas_fw_work) Working on Event: [17]
mps0: (63)->(mpssas_fw_work) Event Free: [17]
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: EventReply :
EventDataLength: 1
AckRequired: 0
Event: SasBroadcastPrimitive (0x17)
EventContext: 0x0
mps0: (63)->(mpssas_fw_work) Working on Event: [17]
mps0: (64)->(mpssas_fw_work) Event Free: [17]
mps0: (64)->(mpssas_fw_work) Working on Event: [17]
mps0: (65)->(mpssas_fw_work) Event Free: [17]
mps0: (65)->(mpssas_fw_work) Working on Event: [17]
mps0: (66)->(mpssas_fw_work) Event Free: [17]
mps0: (66)->(mpssas_fw_work) Working on Event: [17]
mps0: (67)->(mpssas_fw_work) Event Free: [17]
mps0: (67)->(mpssas_fw_work) Working on Event: [17]
mps0: (68)->(mpssas_fw_work) Event Free: [17]
mps0: (68)->(mpssas_fw_work) Working on Event: [17]
mps0: (69)->(mpssas_fw_work) Event Free: [17]
mps0: (69)->(mpssas_fw_work) Working on Event: [17]
mps0: (70)->(mpssas_fw_work) Event Free: [17]
mps0: (70)->(mpssas_fw_work) Working on Event: [17]
mps0: (71)->(mpssas_fw_work) Event Free: [17]
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1112cc2edb666ce7fa9c72c11cdd284c>