Date: Mon, 10 Apr 2017 10:49:59 -0700 From: "Mahlon E. Smith" <mahlon@martini.nu> To: freebsd-stable@freebsd.org Subject: CAM timeouts at startup Message-ID: <20170410174959.GC73510@martini.nu>
next in thread | raw e-mail | index | archive | help
[-- Attachment #1 --] Hi. Got some new machines running 11.0-RELEASE-p8 with a small pile of SSD in them. Getting some strange CAM timeouts at boot, that dramatically delay startup times. These errors don't happen at all after boot, everything seems just fine. Any clues / tuning suggestions are appreciated. Relevant stuff from dmesg: mpr0: <Avago Technologies (LSI) SAS3008> port 0x3000-0x30ff mem 0x92000000-0x9200ffff,0x91f00000-0x91ffffff at device 0.0 numa-domain 0 on pci3 mpr0: IOCFacts : MsgVersion: 0x205 HeaderVersion: 0x2a00 IOCNumber: 0 IOCExceptions: 0x0 MaxChainDepth: 128 NumberOfPorts: 1 RequestCredit: 9680 ProductID: 0x2221 IOCRequestFrameSize: 32 MaxInitiators: 0 MaxTargets: 544 MaxSasExpanders: 125 MaxEnclosures: 126 HighPriorityCredit: 124 MaxReplyDescriptorPostQueueDepth: 65504 ReplyFrameSize: 32 MaxVolumes: 0 MaxDevHandle: 677 MaxPersistentEntries: 240 mpr0: Firmware: 13.00.00.00, Driver: 13.01.00.00-fbsd mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc> da0 at mpr0 bus 0 scbus0 target 19 lun 0 da0: <ATA SAMSUNG MZ7KM960 GB32> Fixed Direct Access SPC-4 SCSI device da0: Serial Number S2HTNX0H701448 da0: 1200.000MB/s transfers da0: Command Queueing enabled da0: 915715MB (1875385008 512 byte sectors) da0: quirks=0x8<4K> mpr0: Sending reset from mprsas_send_abort for target ID 19 mpr0: Unfreezing devq for target ID 19 (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da0:mpr0:0:19:0): CAM status: Command timeout (da0:mpr0:0:19:0): Retrying command (da0:mpr0:0:19:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da0:mpr0:0:19:0): CAM status: SCSI Status Error (da0:mpr0:0:19:0): SCSI status: Check Condition (da0:mpr0:0:19:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da0:mpr0:0:19:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 2 Aborting command 0xfffffe00026066c0 mpr0: Sending reset from mprsas_send_abort for target ID 20 mpr0: Unfreezing devq for target ID 20 (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da1:mpr0:0:20:0): CAM status: Command timeout (da1:mpr0:0:20:0): Retrying command (da1:mpr0:0:20:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da1:mpr0:0:20:0): CAM status: SCSI Status Error (da1:mpr0:0:20:0): SCSI status: Check Condition (da1:mpr0:0:20:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da1:mpr0:0:20:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 3 Aborting command 0xfffffe0002609750 mpr0: Sending reset from mprsas_send_abort for target ID 21 (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 mpr0: (da2:mpr0:0:21:0): CAM status: Command timeout Unfreezing devq for target ID 21 (da2:mpr0:0:21:0): Retrying command (da2:mpr0:0:21:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da2:mpr0:0:21:0): CAM status: SCSI Status Error (da2:mpr0:0:21:0): SCSI status: Check Condition (da2:mpr0:0:21:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da2:mpr0:0:21:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 4 Aborting command 0xfffffe000260c7e0 mpr0: Sending reset from mprsas_send_abort for target ID 22 mpr0: Unfreezing devq for target ID 22 (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da3:mpr0:0:22:0): CAM status: Command timeout (da3:mpr0:0:22:0): Retrying command (da3:mpr0:0:22:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da3:mpr0:0:22:0): CAM status: SCSI Status Error (da3:mpr0:0:22:0): SCSI status: Check Condition (da3:mpr0:0:22:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da3:mpr0:0:22:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 5 Aborting command 0xfffffe0002614f10 mpr0: Sending reset from mprsas_send_abort for target ID 25 mpr0: Unfreezing devq for target ID 25 (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da6:mpr0:0:25:0): CAM status: Command timeout (da6:mpr0:0:25:0): Retrying command (da6:mpr0:0:25:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da6:mpr0:0:25:0): CAM status: SCSI Status Error (da6:mpr0:0:25:0): SCSI status: Check Condition (da6:mpr0:0:25:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da6:mpr0:0:25:0): Retrying command (per sense data) (noperiph:mpr0:0:4294967295:0): SMID 6 Aborting command 0xfffffe0002617fa0 mpr0: Sending reset from mprsas_send_abort for target ID 26 mpr0: Unfreezing devq for target ID 26 (da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da7:mpr0:0:26:0): CAM status: Command timeout (da7:mpr0:0:26:0): Retrying command (da7:mpr0:0:26:0): READ(10). CDB: 28 00 6f c8 1a af 00 00 01 00 (da7:mpr0:0:26:0): CAM status: SCSI Status Error (da7:mpr0:0:26:0): SCSI status: Check Condition (da7:mpr0:0:26:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da7:mpr0:0:26:0): Retrying command (per sense data) -- Mahlon E. Smith http://www.martini.nu/ [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAABCgAGBQJY68XDAAoJEAdBeh7mMHXS+XsQANjE4vyT/mv859vvhYqmiV5z +KCn3kpLtrjK7fMqgGa94y1JWVQe+d20ju7+mAtwXzHQBSu59McxfzLPfA8JspHx Obaq6rjdWL9npKwsueSAXerxyCHmjhTrF6rIv9CdtPbHhhF3se6craOWRgifkJa/ sZV5fYiND3gtiZTdIbL5XaZhGICBKMbARxARX10cfPAjTRMpU+djWOXSMoNl+jL8 FI1k9eKSTGnVGnj8dpUvvtSS0kKiEmHDTlM2QfTBPsEKOP+fOvL1GfEITGg7Gmi8 9qLqrLN3dr6DDZFLS0GB9GlM7+uI5NyEW3Vx1EAmK3eEMwvrTKRveb1RS247Cb0S jU5NJ7GJZh1A2i7LYwUDhzMIuZpMCfvxICVeizxc8ZARIWySccqF5/iEJyLPQ4ZN qMuHWEcVN4tQbeIuks34xRlNNqw3drfJyTbYtPYKqUhJ3I8V+9osVw5DsgVM9Z+4 kWL33WAqQCFNm33uPK0swba0ZrEfAAX18yL0VGo1nlkHfMr0yzHvXzJQaTCal6R5 YZr47GQ9BUj0PG3UEYzEGPfoEVBO3Y97uRpPCfvb6jlvtAZVMAQibS3z4V4qrlSR TnLKIyEtQN200wgQKyiCUD9czs5+SvDk3j2PYaDh+mR10OJc4nYiFRDI0p7wWIzG G8gUi8GrYu1WtuvE8kzE =iWBQ -----END PGP SIGNATURE-----
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20170410174959.GC73510>