From owner-freebsd-scsi@freebsd.org Wed Dec 14 17:49:07 2016 Return-Path: Delivered-To: freebsd-scsi@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43222C80727 for ; Wed, 14 Dec 2016 17:49:07 +0000 (UTC) (envelope-from dgeo@centrale-marseille.fr) Received: from mel1.ec-m.fr (melout.ec-m.fr [147.94.19.33]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id F379178D for ; Wed, 14 Dec 2016 17:49:06 +0000 (UTC) (envelope-from dgeo@centrale-marseille.fr) Subject: Re: mpr(4) bug ? DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=centrale-marseille.fr; s=smtp0; t=1481737737; bh=FTtoMcmEYf+grGiyqchH9w5OkaXQgeHLOCHaX9j4Xns=; h=Subject:To:References:From:Date:In-Reply-To; b=sHJy4blIZGTD2hVhBM+bBDHbymYThKa2CI9iIoRuSEyP4kWZgHd9rq2nTjUO2RzxO mhTWvA20jP9HjWgGWsQkOEhWznQrT9Jub/UIyDOn48f4lZE8dvXVKqg0PJle3SwKF+ 33/zU4/mACX+zJHM+5NbD9RMvH4cKemw30cpm/oteQGRthXjlmU+ObdJS7cX4jvt3H vN4Z74eLfWZpGM8KDgzHVHWzUso6BH/hukAujs5qzpNFHvBLmSpL9e3YidJxlFDGbx Q8Ze0Vm95Ui5jOxdI9VHhjPzEzQvCGtYFEFNO73i2cTkw7QuMb7zgLTmfJkoKPiB5Z PyQgvX+H1I6cA== To: freebsd-scsi@freebsd.org References: <2ae74eaa-80da-2b81-900b-9b9d21080e5c@centrale-marseille.fr> From: geoffroy desvernay Message-ID: <95d92193-ba66-ba40-e417-01f29510e73c@centrale-marseille.fr> Date: Wed, 14 Dec 2016 18:48:55 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:45.0) Gecko/20100101 Icedove/45.4.0 MIME-Version: 1.0 In-Reply-To: <2ae74eaa-80da-2b81-900b-9b9d21080e5c@centrale-marseille.fr> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="bcP0XOxgjgj0V8cS1VQfvH6RnoFITDqge" X-BeenThere: freebsd-scsi@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: SCSI subsystem List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 14 Dec 2016 17:49:07 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --bcP0XOxgjgj0V8cS1VQfvH6RnoFITDqge Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Did I say something silly, is there an obvious thing I'm missing ? Isn't it the right mailing list to post this ? The very same setup works flawlessly under debian or centos=E2=80=A6 Isn'= t there something to investigate ? Is there someone from Avago around ? Thank you for reading=E2=80=A6 On 12/12/2016 03:30 PM, geoffroy desvernay wrote: > Hi all, >=20 > First, I'm not fluently speaking SCSI nor kernel-c, so please don't byt= e > too hard if I'm missing something obvious :) >=20 > I tried some thing before posting here, from testing the hardware under= > linux (it work flawlessly there) and vendor's tests software, changing > the adapter (for a different one, but with same chipset, that's all I > have), upgrading firmwares where available (card and dell enclosure), > trying to read mpr(4)'s code=E2=80=A6 well this is beyond my knowledge.= >=20 > Hardware: dell PowerEgde R430 with an LSI SAS3008 card and an MD1420 > enclosure with 24 2T Seagate sas drives. > This machine also have an embedded SAS3008 (dell perc H330) in non-rai= d > mode (mrsas driver) with 4 SSD drives to be used as ZFS cache/log=E2=80= =A6 >=20 > System: FreeBSD 11.0-RELEASE-p3 >=20 > Please tell me if there are tests I could do, patches to try, or ? > Currently compiling 11-STABLE kernel with sys/dev/mpr from CURRENT, but= > with no clues=E2=80=A6 >=20 > #pciconf -lv: > mpr0@pci0:4:0:0: class=3D0x010700 card=3D0x1f461028 chip=3D0x009= 71000 > rev=3D0x02 hdr=3D0x00 > vendor =3D 'LSI Logic / Symbios Logic' > device =3D 'SAS3008 PCI-Express Fusion-MPT SAS-3' > class =3D mass storage > subclass =3D SAS >=20 > Symptoms: any zpool create fails with > # zpool create ztest raidz da20 da21 da22 > cannot create 'ztest': invalid argument for this pool operation >=20 > # dmesg show a buncf of messages like this one: > (da22:mpr0:0:26:0): READ(10). CDB: 28 00 e8 e0 88 af 00 00 01 00 > (da22:mpr0:0:26:0): CAM status: SCSI Status Error > (da22:mpr0:0:26:0): SCSI status: Check Condition > (da22:mpr0:0:26:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid > command operation code) > (da22:mpr0:0:26:0): Error 22, Unretryable error >=20 > (see http://dgeo.perso.ec-m.fr/mpr_fail.txt for full related dmesg) >=20 > # camcontrol devlist 2 seems normal to me: > at scbus1 target 0 lun 0 (pass0,da0)= > at scbus1 target 1 lun 0 (pass1,da1)= > at scbus1 target 2 lun 0 (pass2,da2)= > at scbus1 target 3 lun 0 (pass3,da3)= > at scbus1 target 32 lun 0 (pass4,ses= 0) > at scbus2 target 8 lun 0 (pass5,da4)= > at scbus2 target 9 lun 0 (pass6,da5)= > at scbus2 target 10 lun 0 (pass7,da6= ) > at scbus2 target 11 lun 0 (pass8,da7= ) > at scbus2 target 12 lun 0 (pass9,da8= ) > at scbus2 target 13 lun 0 (pass10,da= 9) > at scbus2 target 14 lun 0 (pass11,da= 10) > at scbus2 target 15 lun 0 (pass12,da= 11) > at scbus2 target 16 lun 0 (pass13,da= 12) > at scbus2 target 17 lun 0 (pass14,da= 13) > at scbus2 target 18 lun 0 (pass15,da= 14) > at scbus2 target 19 lun 0 (pass16,da= 15) > at scbus2 target 20 lun 0 (pass17,da= 16) > at scbus2 target 21 lun 0 (pass18,da= 17) > at scbus2 target 22 lun 0 (pass19,da= 18) > at scbus2 target 23 lun 0 (pass20,da= 19) > at scbus2 target 24 lun 0 (pass21,da= 20) > at scbus2 target 25 lun 0 (pass22,da= 21) > at scbus2 target 26 lun 0 (pass23,da= 22) > at scbus2 target 27 lun 0 (pass24,da= 23) > at scbus2 target 28 lun 0 (pass25,da= 24) > at scbus2 target 29 lun 0 (pass26,da= 25) > at scbus2 target 30 lun 0 (pass27,da= 26) > at scbus2 target 31 lun 0 (pass28,da= 27) > at scbus2 target 32 lun 0 (pass29,se= s1) > at scbus7 target 0 lun 0 (pass30,ses= 2) >=20 > With dev.mpr.0.debug_level: 1023, I tried a simple dd test: dd reports > success if bs < 127k; fails if >=3D 128k (in both tests there are ILLEG= AL > REQUEST in logs): > dd if=3D/tmp/rnd of=3D/dev/da20 bs=3D127k: > http://dgeo.perso.ec-m.fr/dd_bs_127k.debug.log >=20 > bs=3D128k: http://dgeo.perso.ec-m.fr/dd_bs_128k.debug.log >=20 >=20 --=20 geoffroy desvernay C.R.I - Administration syst=C3=A8mes et r=C3=A9seaux Ecole Centrale de Marseille Tel: (+33|0)4 91 05 45 24 Fax: (+33|0)4 91 05 45 98 dgeo@centrale-marseille.fr --bcP0XOxgjgj0V8cS1VQfvH6RnoFITDqge Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQIcBAEBCAAGBQJYUYYIAAoJED/P9AlFh6DwJv4QALXgoiSVhMWpDXTxMMBJwGl6 OsZ1Yo92Luv9dnrjROB/dgotoYBaxI5wF/UptuBg4j3tphbLlhSjuuCmfhMs1mFT +0+c9rAuZOxOuPQ6E66PUEVhdig/1pycgVUO4exY1O/F0BKiRl0FqKN5tKrDpZpC 5x8VBa+8G1tsvdj94dErE3wI5wBGxBm7CnStWlh7c/p0Cusfrqzff87eSRTMZUfq GCpF3JGophpC1oe0YsCXr4cfSLJdjyI60etFKj7OO8AQKVoTORH4/QYUeM/Pg5ot 6O4BGYyLhAWysfZb3KsffFgBmpGketMjx9o2A8GY2oCjgKLARUkUBARhEy7zXgRb KbqkHpAr6oYHiOvJQKTulcckOEN6ioi269eMAHs2Rwsrtc1498iZ8dl6bPfdDRKk xAheNVpfQk57Y6Ayd0fZWo3GRUlrgmoh0qDL04tYT9c6MrteAvwBJpOBKNbRN5ia ewUa0lDdwdwutViJYdVonR0OcxGmJpTHFs6oIyaeXByAWehOD4wHwXjVZlaXSrlg 5w4SevPvl/g6PDJLF/+q4QiBGNy3aGvatCvOeLNG5wddTfFrXWo7irblUAGeOyCc 8Ri8w/myd6U8TMWY8uzmBSrUvPpnvsCnT3Th546ZyKAGAt6Vho/a4qPRP57SHfmS ZDmJK//fXTsLNWP2Yjli =xkIO -----END PGP SIGNATURE----- --bcP0XOxgjgj0V8cS1VQfvH6RnoFITDqge--