From owner-freebsd-scsi@freebsd.org Fri Dec 9 14:23:45 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id F1C61C68486 for ; Fri, 9 Dec 2016 14:23:45 +0000 (UTC) (envelope-from h.schmalzbauer@omnilan.de) Received: from mx0.gentlemail.de (mx0.gentlemail.de [IPv6:2a00:e10:2800::a130]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 161B01AA for ; Fri, 9 Dec 2016 14:23:44 +0000 (UTC) (envelope-from h.schmalzbauer@omnilan.de) Received: from mh0.gentlemail.de (ezra.dcm1.omnilan.net [78.138.80.135]) by mx0.gentlemail.de (8.14.5/8.14.5) with ESMTP id uB9ENfWU056333 for ; Fri, 9 Dec 2016 15:23:41 +0100 (CET) (envelope-from h.schmalzbauer@omnilan.de) Received: from titan.inop.mo1.omnilan.net (titan.inop.mo1.omnilan.net [IPv6:2001:a60:f0bb:1::3:1]) (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mh0.gentlemail.de (Postfix) with ESMTPSA id 44F5FAE0; Fri, 9 Dec 2016 15:23:40 +0100 (CET) Message-ID: <584ABE6B.8060703@omnilan.de> Date: Fri, 09 Dec 2016 15:23:39 +0100 From: Harald Schmalzbauer Organization: OmniLAN User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; de-DE; rv:1.9.2.8) Gecko/20100906 Lightning/1.0b2 Thunderbird/3.1.2 MIME-Version: 1.0 To: freebsd-scsi@freebsd.org Subject: sporadic CAM (all devices) outage on 11-stable, mps(4), ahci(4) and bhyve(8) involved. X-Enigmail-Version: 1.1.2 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigF2CB364B72E040B5B6F2EB6E" X-Greylist: ACL 119 matched, not delayed by milter-greylist-4.2.7 (mx0.gentlemail.de [78.138.80.130]); Fri, 09 Dec 2016 15:23:41 +0100 (CET) X-Milter: Spamilter (Reciever: mx0.gentlemail.de; Sender-ip: 78.138.80.135; Sender-helo: mh0.gentlemail.de; ) X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 09 Dec 2016 14:23:46 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigF2CB364B72E040B5B6F2EB6E Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Hello, I have big problems with my 11-stable bhyve playground. Suddenly (the machine ran without CAM-I/O-load for days), all CAM devices fail one after another =E2=80=93 reproducable. It happens e.g. during buildworld, in the following example buildworld run inside bhyve guest. The system has a zfs bootpool and root on mirror-stripe zpool. Unfortunately I only have the kernel messages, see next lines. I guess the interesting point is that _all_ devices over different controllers are affected. There's mps(4) and ahci(4) involved. Can someony with SCB/CAM/SCSIcmd understanding see what's wrong here? Thanks in advance, -Harry ahcich6: Timeout on slot 6 port 0 ahcich6: is 00000000 cs 00000000 ss 00003fc0 rs 00003fc0 tfd 40 serr 00000000 cmd 0004cc17 (ada6:ahcich6:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 18 c0 da 7f 40 06 00 00 00 00 00 (ada6:ahcich6:0:0:0): CAM status: Command timeout (ada6:ahcich6:0:0:0): Retrying command ahcich6: Timeout on slot 20 port 0 ahcich6: is 00000000 cs 0e000000 ss 0ff00000 rs 0ff00000 tfd c0 serr 00000000 cmd 0004d917 (ada6:ahcich6:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 18 c0 da 7f 40 06 00 00 00 00 00 (ada6:ahcich6:0:0:0): CAM status: Command timeout (ada6:ahcich6:0:0:0): Retrying command ahcich6: Timeout on slot 28 port 0 ahcich6: is 00000000 cs 10000000 ss 00000000 rs 10000000 tfd 150 serr 00000000 cmd 0004dc17 (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Retrying command ahcich6: Timeout on slot 29 port 0 ahcich6: is 00000000 cs 20000000 ss 00000000 rs 20000000 tfd 150 serr 00000000 cmd 0004dd17 (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted ahcich6: Timeout on slot 30 port 0 ahcich6: is 00000000 cs 40000000 ss 00000000 rs 40000000 tfd 150 serr 00000000 cmd 0004de17 (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Error 5, Retry was blocked ada6 at ahcich6 bus 0 scbus12 target 0 lun 0 ada6: s/n BTMP317600EG060AGN detached ahcich6: Timeout on slot 31 port 0 ahcich6: is 00000000 cs 80000000 ss 00000000 rs 80000000 tfd 150 serr 00000000 cmd 0004df17 (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Retrying command ahcich6: Timeout on slot 0 port 0 ahcich6: is 00000000 cs 00000001 ss 00000000 rs 00000001 tfd 150 serr 00000000 cmd 0004c017 (aprobe0:ahcich6:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted ahcich6: Poll timeout on slot 1 port 0 ahcich6: is 00000000 cs 00000002 ss 00000000 rs 00000002 tfd 150 serr 00000000 cmd 0004c117 (aprobe0:ahcich6:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted SGL for command 0xfffffe000112f750 0000 0c 00 00 00 00 00 00 00 00 00 00 00 7c d1 b9 bc |............|...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0d81000 SGL for command 0xfffffe000112c810 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da0: 00mps0:0: 002: 000): 00Retrying command 00 00 00 00 00 00 00 0c ae b9 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Retrying command (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe000112ff30 (da0:0000 mps0:0: 0c2: 000): 00Retrying command (per sense data) 00 00 00 00 00 00 00 00 00 64 d7 b9 bc |............d...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0d81000 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Retrying command (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe000112c030 0000 0c 00 00 00 00 00 00 00 00 00 00 00 24 a8 b9 bc |............$...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0d81000 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Retrying command (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe00010fd800 0000 0a 00 00 00 00 00 00 00 00 00 00 00 00 7a b7 bc |.............z..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................| 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000000 addr=3D0x0000000000000000 SGL for command 0xfffffe00010f2ac0 (da2:mps0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da2: 00mps0:0: 004: 000): 00Retrying command 00 00 00 00 00 00 00 10 f8 b6 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 SGL for command 0xfffffe0001105750 0000 0c 00 00 00 00 00 00 00 00 00 00 00 7c d9 b7 bc |............|...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................| 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000000 addr=3D0x0000000000000000 SGL for command 0xfffffe00010ed180 0000 0c 00 00 00 00 00 00 00 00 00 00 00 20 b5 b6 bc |............ ...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 f0 ce ed 00 00 08 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0d81000 (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Retrying command (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Error 5, Retries exhausted (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 f0 ce ed 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Error 5, Retries exhausted (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) (da0:mps0:0:2:0): READ(10). CDB: 28 00 1b e2 9e 10 00 00 10 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe00010ea4e0 0000 0a 00 00 00 00 00 00 00 00 00 00 00 a8 93 b6 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 30 00 00 |.............0..| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 00 b9 a1 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 16 00 30 bc be 00 00 00 00 00 10 00 96 |.....0..........| 0070 00 10 b7 bb 00 00 00 00 80 00 00 30 00 16 b2 bc |...........0....| seg0 flags=3D0x16 len=3D0x001000 addr=3D0x00000000bebc3000 seg1 flags=3D0x96 len=3D0x001000 addr=3D0x00000000bbb71000 chain flags=3D0x30 len=3D0x80 Offset=3D0x0 Address=3D0xbcb21600 0000 00 10 00 d7 00 70 29 a7 01 00 00 00 00 00 00 00 |.....p).........| 0010 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0040 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| seg2 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001a7297000 SGL for command 0xfffffe000112d530 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 b9 a1 18 00 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da2: 00mps0:0: 004: 000): 00Retrying command 00 00 00 00 00 00 00 e4 b7 b9 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 41 ae ed 00 00 08 00 00 00 00 00 00 00 |*..A............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 (da2:mps0:0:4:0): WRITE(10). CDB: 2a 00 05 41 ae ed 00 00 08 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Error 5, Retries exhausted (da2:mps0:0:4:0): READ(6). CDB: 08 00 02 10 10 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) SGL for command 0xfffffe000110a760 0000 0a 00 00 00 00 00 00 00 00 00 00 00 88 15 b8 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000e00 addr=3D0x00000001d0d81000 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Retrying command (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) SGL for command 0xfffffe0001105b40 0000 0a 00 00 00 00 00 00 00 00 00 00 00 70 dc b7 bc |............p...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................| 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000000 addr=3D0x0000000000000000 SGL for command 0xfffffe0001108fc0 (da2:mps0:0:4:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da2: 00mps0:0: 004: 000): 00Retrying command 00 00 00 00 00 00 00 d0 03 b8 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000e00 addr=3D0x00000001d0d81000 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Retrying command (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) SGL for command 0xfffffe0001115350 0000 0a 00 00 00 00 00 00 00 00 00 00 00 7c 96 b8 bc |............|...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0e 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 1e e3 6e 07 00 00 00 00 00 00 00 00 00 00 00 |...n............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0e 00 d7 00 10 d8 d0 01 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000e00 addr=3D0x00000001d0d81000 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 6e 07 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): Error 5, Retries exhausted (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 49 08 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e3 98 f4 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mps0:0:4:0): Retrying command (per sense data) SGL for command 0xfffffe00010e5cb0 0000 0c 00 00 00 00 00 00 00 00 00 00 00 84 5d b6 bc |.............]..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._...........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 d0 b4 bb 00 00 00 00 00 00 00 00 00 00 00 00 |................| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Retrying command (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe00010ff4e0 0000 0c 00 00 00 00 00 00 00 00 00 00 00 a8 8f b7 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 af d9 99 00 00 08 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x0000000012fc8000 SGL for command 0xfffffe0001130080 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error 0c(da0: 00mps0:0: 002: 000): 00Retrying command 00 00 00 00 00 00 00 60 d8 b9 bc |............`...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._ahcich6: =2ETimeout on slot 2 port 0 =2Eahcich6: .is 00000000 cs 00000004 ss 00000000 rs 00000004 tfd 150 serr= 00000000 cmd 0004c217 =2E.......| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 (ada6:ahcich6:0:0:0): SETFEATURES ENABLE RCACHE. ACB: ef aa 00 00 00 40 00 00 00 00 00 00 (ada6:ahcich6:0:0:0): CAM status: Command timeout (ada6:ahcich6:0:0:0): Error 5, Periph was invalidated ahcich6: Poll timeout on slot 3 port 0 ahcich6: is 00000000 cs 00000008 ss 00000000 rs 00000008 tfd 150 serr 00000000 cmd 0004c317 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Retrying command (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af d9 99 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) (aprobe0:ahcich6:0:0:0): SOFT_RESET. ACB: 00 00 00 00 00 00 00 00 00 00 00 00 (aprobe0:ahcich6:0:0:0): CAM status: Command timeout (aprobe0:ahcich6:0:0:0): Error 5, Retries exhausted (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe0001125340 0000 0c 00 00 00 00 00 00 00 00 00 00 00 70 56 b9 bc |............pV..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................| 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000000 addr=3D0x0000000000000000 SGL for command 0xfffffe00010f9510 (da0:mps0:0:2:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error 0c(da0: 00mps0:0: 002: 000): 00Retrying command 00 00 00 00 00 00 00 cc 47 b7 bc |.............G..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 05 ef 5f 0b 00 00 08 00 00 00 00 00 00 00 |*..._...........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 90 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x00000001d0709000 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 05 ef 5f 0b 00 00 08 00 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): Error 5, Retries exhausted (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 3d 00 00 0a 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 9e 00 00 03 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mps0:0:2:0): Retrying command (per sense data) SGL for command 0xfffffe0001115dd0 0000 09 00 00 00 00 00 00 00 00 00 00 00 5c 9e b8 bc |............\134...= | 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe000112f8a0 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 0000 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error 0b(da3: 00mps0:0: 005: 000): 00Retrying command 00 00 00 00 00 00 00 78 d2 b9 bc |............x...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error (da1:mps0:0:3:0): Retrying command (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: SCSI Status Error (da3:mps0:0:5:0): SCSI status: Check Condition (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da3:mps0:0:5:0): Retrying command (per sense data) (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: SCSI Status Error (da1:mps0:0:3:0): SCSI status: Check Condition (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe000111ade0 (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data) 00 00 00 00 00 00 00 00 00 68 da b8 bc |............h...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error (da3:mps0:0:5:0): Retrying command SGL for command 0xfffffe00011165b0 0000 0b 00 00 00 00 00 00 00 00 00 00 00 44 a4 b8 bc |............D...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 00 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 02 00 00 |................| 0040 35 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |5...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 00 00 d7 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000000 addr=3D0x0000000000000000 SGL for command 0xfffffe000112a9e0 (da1:mps0:0:3:0): SYNCHRONIZE CACHE(10). CDB: 35 00 00 00 00 00 00 00 00 = 00 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error 0b(da1: 00mps0:0: 003: 000): 00Retrying command 00 00 00 00 00 00 00 68 97 b9 bc |............h...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error (da1:mps0:0:3:0): Retrying command (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: SCSI Status Error (da3:mps0:0:5:0): SCSI status: Check Condition (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da3:mps0:0:5:0): Retrying command (per sense data) (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: SCSI Status Error (da1:mps0:0:3:0): SCSI status: Check Condition (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe000111a4b0 (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data) 00 00 00 00 00 00 00 00 00 84 d3 b8 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error (da3:mps0:0:5:0): Error 5, Retries exhausted SGL for command 0xfffffe000112dbc0 0000 0b 00 00 00 00 00 00 00 00 00 00 00 d0 bc b9 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error (da1:mps0:0:3:0): Error 5, Retries exhausted (da3:mps0:0:5:0): WRITE(6). CDB: 0a 0c 0d a4 08 00 (da3:mps0:0:5:0): CAM status: SCSI Status Error (da3:mps0:0:5:0): SCSI status: Check Condition (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da3:mps0:0:5:0): Retrying command (per sense data) (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 af 8b 04 00 00 10 00 (da1:mps0:0:3:0): CAM status: SCSI Status Error (da1:mps0:0:3:0): SCSI status: Check Condition (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da1:mps0:0:3:0): Retrying command (per sense data) SGL for command 0xfffffe00010e1870 0000 0b 00 00 00 00 00 00 00 00 00 00 00 54 2a b6 bc |............T*..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 30 d5 76 01 00 00 00 80 00 00 30 80 13 b2 bc |.0.v.......0....| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe0001123a50 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error 09(da1: 00mps0:0: 003: 000): 00Retrying command 00 00 00 00 00 00 00 bc 43 b9 bc |.............C..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe0001107040 0000 0c 00 00 00 00 00 00 00 00 00 00 00 30 ec b7 bc |............0...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 af da 71 00 00 08 00 00 00 00 00 00 00 |*....q..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................| 0070 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x0000000012fc8000 SGL for command 0xfffffe00010ea390 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da 71 00 00 08 00 0000 0c 00 00 00 00 00 00 00 00 00 00 00 ac 92 b6 bc |................| 0010 00(da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error= 00(da0: fcmps0:0: 002: 180): 00Retrying command 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe000112e640 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00 0000 (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da0: 00mps0:0: 002: 00 00 00 00 00 00 00 00 00 b0 c4 b9 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 10 00 00 |................| 0020 00 00 000): 00Retrying command 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 00 ba 71 08 00 00 00 00 00 00 00 00 00 00 00 |...q............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 10 00 d7 00 80 fc 12 00 00 00 00 00 00 00 00 |................| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x001000 addr=3D0x0000000012fc8000 SGL for command 0xfffffe00011312e0 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 71 08 00 0000 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error 0a(da2: 00mps0:0: 004: 000): 00Retrying command 00 00 00 00 00 00 00 28 e6 b9 bc |............(...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 1e e7 e1 05 00 00 00 00 00 00 00 00 00 00 00 |................| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:(da3:mps0:0:mps0:0:4:5:0): 0): Retrying command Retrying command (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: SCSI Status Error (da3:mps0:0:5:0): SCSI status: Check Condition (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da3:mps0:0:5:0): Retrying command (per sense data) (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: SCSI Status Error (da1:mps0:0:3:0): SCSI status: Check Condition (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe0001125b20 (da1:0000 mps0:0: 093: 000): 00Retrying command (per sense data) 00 00 00 00 00 00 00 00 00 58 5c b9 bc |............X\134..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error (da3:mps0:0:5:0): Retrying command SGL for command 0xfffffe00010ed960 0000 0b 00 00 00 00 00 00 00 00 00 00 00 08 bb b6 bc |................| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 20 84 01 00 00 00 00 00 00 00 00 00 00 00 |.. .............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error (da2:mps0:0:4:0): WRITE(6). CDB: 0a 00 ba 71 08 00 (da1:(da2:mps0:0:4:0): CAM status: SCSI Status Error mps0:0:(da2:mps0:0:4:0): SCSI status: Check Condition 3:(da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) 0): (da2:Retrying command mps0:0:(da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 4:(da3:mps0:0:5:0): CAM status: SCSI Status Error 0): SGL for command 0xfffffe00010e1f00 (da3:mps0:0:5:0): SCSI status: Check Condition Retrying command (per sense data) 0000 (da3:mps0:0:5:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) 0a(da3: 00mps0:0: 005:(da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da 71 00 00 08 00 000): (da0:mps0:0:2:0): CAM status: SCSI Status Error 00(da0:mps0:0:2:0): SCSI status: Check Condition Retrying command (per sense data) 00 00 00 00 00 00 00 40 2f b6 bc |............@/..| 0010 00(da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) 00(da0: fcmps0:0: 002: 180): 00Retrying command (per sense data) 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 1e e7 e1 05 00 00 00 00 00 00 00 00 00 00 00 |................| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe000112b460 0000 0c 00 00 00 00 00 00 00 00 00 00 00 48 9f b9 bc |............H...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00 (da1:mps0:0:3:0): CAM status: SCSI Status Error (da1:mps0:0:3:0): SCSI status: Check Condition (da1:mps0:0:3:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe000111b710 (da2:mps0:0:4:0): CAM status: Unrecoverable Host Bus Adapter Error (da1:(da2:0000 mps0:0:mps0:0: 093: 000): 4:Retrying command (per sense da= ta) 0): 00 00Retrying command 00 00 00 00 00 00 00 00 4c e1 b8 bc |............L...| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 06 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 0a 14 3b 7d 05 00 00 00 00 00 00 00 00 00 00 00 |..;}............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 60 0c 00 00 00 00 00 00 00 00 00 00 00 00 |..`.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da3:mps0:0:5:0): WRITE(6). CDB: 0a 14 3b 7d 05 00 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00 (da3:mps0:0:5:0): CAM status: Unrecoverable Host Bus Adapter Error (da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error (da3:(da0:mps0:0:mps0:0:5:2:0): 0): Error 5, Retries exhausted Retrying command (da2:mps0:0:4:0): WRITE(6). CDB: 0a 1e e7 e1 05 00 (da2:mps0:0:4:0): CAM status: SCSI Status Error (da2:mps0:0:4:0): SCSI status: Check Condition (da2:mps0:0:4:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe00011272c0 (da2:0000 mps0:0: 0b4: 000): 00Retrying command (per sense data) 00 00 00 00 00 00 00 00 00 10 6e b9 bc |.............n..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 c3 5b 7d 00 00 05 00 00 00 00 00 00 00 |*...[}..........| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 SGL for command 0xfffffe000110de80 (da1:mps0:0:3:0): WRITE(10). CDB: 2a 00 00 c3 5b 7d 00 00 05 00 0000 (da1:mps0:0:3:0): CAM status: Unrecoverable Host Bus Adapter Error 0c(da1: 00mps0:0: 003: 000): 00Error 5, Retries exhausted 00 00 00 00 00 00 00 e0 3e b8 bc |.............>..| 0010 00 00 fc 00 18 00 00 00 00 00 00 00 00 0a 00 00 |................| 0020 00 00 00 00 0a 00 00 00 00 00 00 00 00 00 00 00 |................| 0030 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 01 |................| 0040 2a 00 00 ce 07 e1 00 00 05 00 00 00 00 00 00 00 |*...............| 0050 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 |................| 0060 00 0a 00 d7 00 c0 70 d0 01 00 00 00 00 00 00 00 |......p.........| 0070 00 00 40 13 00 00 00 00 00 00 00 00 00 00 00 00 |..@.............| seg0 flags=3D0xd7 len=3D0x000a00 addr=3D0x00000001d070c000 (da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 af da 71 00 00 08 00 (da0:mps0:0:2:0): CAM status: SCSI Status Error (da0:mps0:0:2:0): SCSI status: Check Condition (da0:mps0:0:2:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) SGL for command 0xfffffe0001126450 (da0:0000 mps0:0: 0a2: 000): 00Retrying command (per sense data) 00(da0:mps0:0:2:0): WRITE(10). CDB: 2a 00 00 ce 07 e1 00 00 05 00 00(da0:mps0:0:2:0): CAM status: Unrecoverable Host Bus Adapter Error 00(da0: 00 00 00 00 00 00 3c 63 b9 bc |............