From owner-freebsd-scsi@freebsd.org Mon Dec 12 14:37:09 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 7CD5FC72E12 for ; Mon, 12 Dec 2016 14:37:09 +0000 (UTC) (envelope-from dgeo@centrale-marseille.fr) Received: from mel1.ec-m.fr (melout.ec-m.fr [147.94.19.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 42071120E for ; Mon, 12 Dec 2016 14:37:08 +0000 (UTC) (envelope-from dgeo@centrale-marseille.fr) To: FreeBSD-scsi DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=centrale-marseille.fr; s=smtp0; t=1481553044; bh=iINwAOeZm36xdyJ4qsJuRqp55CncmVLsVHYJh8W8nYA=; h=To:From:Subject:Date; b=YKDWJ90B+1A1jAKYPZ7kGjoMx4medN6iTxuosx+sdLWnT7VGKM2jWiKbBsTSFN8fM Sj5LEwTFx6Odmu1wE/Zju04t5aj8G43Xn+U6y0sUPza3Hi9vACWmmcR+3F/etaC6iA fHf4Yo1G6a4llxmrcLtJkV9hy4x4/+4B5B7+6bf39jmXsdAiL02UmL99W8vOHfC3p9 /IzcnQhrRcKRGwF8AlgRnppNhRH8bIJPV8ZZjs+zdiYF7HJfKgYC8Mq/y2ZDQ+ZPNz +mzlrOrpVWVL4Ks2G7iyKiIl4Kh7QkE7s1YkV+APsLJHnospEiCyPt3EAu6DL5k0MW 21J290HUKXtww== From: geoffroy desvernay Subject: mpr(4) bug ? Openpgp: id=E15095B3F06A1012EE2921023FCFF4094587A0F0 Message-ID: <2ae74eaa-80da-2b81-900b-9b9d21080e5c@centrale-marseille.fr> Date: Mon, 12 Dec 2016 15:30:24 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:45.0) Gecko/20100101 Thunderbird/45.5.1 MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="s8UhIMLDtkRFbXCvK8eIKJpp82atFihbq" X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 12 Dec 2016 14:37:09 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --s8UhIMLDtkRFbXCvK8eIKJpp82atFihbq Content-Type: multipart/mixed; boundary="0urjAb0MDHMBCqoq3LjLq58VcFsBOmuhk"; protected-headers="v1" From: geoffroy desvernay To: FreeBSD-scsi Message-ID: <2ae74eaa-80da-2b81-900b-9b9d21080e5c@centrale-marseille.fr> Subject: mpr(4) bug ? --0urjAb0MDHMBCqoq3LjLq58VcFsBOmuhk Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi all, First, I'm not fluently speaking SCSI nor kernel-c, so please don't byte too hard if I'm missing something obvious :) I tried some thing before posting here, from testing the hardware under linux (it work flawlessly there) and vendor's tests software, changing the adapter (for a different one, but with same chipset, that's all I have), upgrading firmwares where available (card and dell enclosure), trying to read mpr(4)'s code=E2=80=A6 well this is beyond my knowledge. Hardware: dell PowerEgde R430 with an LSI SAS3008 card and an MD1420 enclosure with 24 2T Seagate sas drives. This machine also have an embedded SAS3008 (dell perc H330) in non-raid mode (mrsas driver) with 4 SSD drives to be used as ZFS cache/log=E2=80=A6= System: FreeBSD 11.0-RELEASE-p3 Please tell me if there are tests I could do, patches to try, or ? Currently compiling 11-STABLE kernel with sys/dev/mpr from CURRENT, but with no clues=E2=80=A6 #pciconf -lv: mpr0@pci0:4:0:0: class=3D0x010700 card=3D0x1f461028 chip=3D0x00971= 000 rev=3D0x02 hdr=3D0x00 vendor =3D 'LSI Logic / Symbios Logic' device =3D 'SAS3008 PCI-Express Fusion-MPT SAS-3' class =3D mass storage subclass =3D SAS Symptoms: any zpool create fails with # zpool create ztest raidz da20 da21 da22 cannot create 'ztest': invalid argument for this pool operation # dmesg show a buncf of messages like this one: (da22:mpr0:0:26:0): READ(10). CDB: 28 00 e8 e0 88 af 00 00 01 00 (da22:mpr0:0:26:0): CAM status: SCSI Status Error (da22:mpr0:0:26:0): SCSI status: Check Condition (da22:mpr0:0:26:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code) (da22:mpr0:0:26:0): Error 22, Unretryable error (see http://dgeo.perso.ec-m.fr/mpr_fail.txt for full related dmesg) # camcontrol devlist 2 seems normal to me: at scbus1 target 0 lun 0 (pass0,da0) at scbus1 target 1 lun 0 (pass1,da1) at scbus1 target 2 lun 0 (pass2,da2) at scbus1 target 3 lun 0 (pass3,da3) at scbus1 target 32 lun 0 (pass4,ses0)= at scbus2 target 8 lun 0 (pass5,da4) at scbus2 target 9 lun 0 (pass6,da5) at scbus2 target 10 lun 0 (pass7,da6) at scbus2 target 11 lun 0 (pass8,da7) at scbus2 target 12 lun 0 (pass9,da8) at scbus2 target 13 lun 0 (pass10,da9)= at scbus2 target 14 lun 0 (pass11,da10= ) at scbus2 target 15 lun 0 (pass12,da11= ) at scbus2 target 16 lun 0 (pass13,da12= ) at scbus2 target 17 lun 0 (pass14,da13= ) at scbus2 target 18 lun 0 (pass15,da14= ) at scbus2 target 19 lun 0 (pass16,da15= ) at scbus2 target 20 lun 0 (pass17,da16= ) at scbus2 target 21 lun 0 (pass18,da17= ) at scbus2 target 22 lun 0 (pass19,da18= ) at scbus2 target 23 lun 0 (pass20,da19= ) at scbus2 target 24 lun 0 (pass21,da20= ) at scbus2 target 25 lun 0 (pass22,da21= ) at scbus2 target 26 lun 0 (pass23,da22= ) at scbus2 target 27 lun 0 (pass24,da23= ) at scbus2 target 28 lun 0 (pass25,da24= ) at scbus2 target 29 lun 0 (pass26,da25= ) at scbus2 target 30 lun 0 (pass27,da26= ) at scbus2 target 31 lun 0 (pass28,da27= ) at scbus2 target 32 lun 0 (pass29,ses1= ) at scbus7 target 0 lun 0 (pass30,ses2)= With dev.mpr.0.debug_level: 1023, I tried a simple dd test: dd reports success if bs < 127k; fails if >=3D 128k (in both tests there are ILLEGAL= REQUEST in logs): dd if=3D/tmp/rnd of=3D/dev/da20 bs=3D127k: http://dgeo.perso.ec-m.fr/dd_bs_127k.debug.log bs=3D128k: http://dgeo.perso.ec-m.fr/dd_bs_128k.debug.log --=20 *geoffroy desvernay* C.R.I - Administration syst=C3=A8mes et r=C3=A9seaux Ecole Centrale de Marseille Tel: (+33|0)4 91 05 45 24 Fax: (+33|0)4 91 05 44 26 --0urjAb0MDHMBCqoq3LjLq58VcFsBOmuhk-- --s8UhIMLDtkRFbXCvK8eIKJpp82atFihbq Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE4VCVs/BqEBLuKSECP8/0CUWHoPAFAlhOtIAACgkQP8/0CUWH oPDXTQ/+MLSK9T8f1yWAYUfViXERMMt3Hp5wL0MLgqD5iDxsRWKNbV14NHma/z++ qCsCK1sGtYhMJy4wao/MWK6e8aqh55Qfgcmh55yCPBPbMIWvMmxWZZUFh0G0QWw7 EXWHT/ZCnfAEEJDeSEiZ6zkENLxWcr6bEP9UbsNMKbOZhaXzaHO96oxQrMEQsbHI t5u5a7b0262GbnMm5CN3cFyOr1qo75QN5nuJ+UVGe7nhUY2RSVe+XvdNUJB/9lzM D8vvDPykBys0EjYXbETanzQCuTrvNUcAqN2WctQZnh6qOJDA3ZdieYtvgQlLblFO 5b3nACK638VqUQiMhXlhSlK0Sns3vbPR6fJ3B+xULbgF8oKtqEV+vsL0owJ5nTvQ Fz9AjhlYZEr9y75QGuhR26smBX5I9MM1KlD9xvCxY1Olsag6tAjBbsBPGhbTHqcu RAzeNWqt6YLtLvMDmbna6kKyrPpmL0eIgocZTFHR0TXU/CDfu74+uwRYZfAmZAbN vjLH7wiS7b0ZlTA9fHp9WZXagz5u/sxDZUfpJbSnuF3GLM0eVoMVXh+uYAaRx5wG kamopfNwqQCoN52QoG7t0eqv0AHad1PVnY5YqrWMnAYlO7z5ArKZMiksu+PMrVfO yI77hllWtE7OuiiZRIXBaLCWaRsk6IDt6dscWX5NP3LsVsYdnXg= =DlcC -----END PGP SIGNATURE----- --s8UhIMLDtkRFbXCvK8eIKJpp82atFihbq--