From nobody Thu Oct 27 19:55:36 2022 X-Original-To: freebsd-scsi@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4MyxHd4yRvz4fx8Z for ; Thu, 27 Oct 2022 19:55:41 +0000 (UTC) (envelope-from sumit.saxena@broadcom.com) Received: from mail-pg1-x533.google.com (mail-pg1-x533.google.com [IPv6:2607:f8b0:4864:20::533]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4MyxHd02tPz3KSw for ; Thu, 27 Oct 2022 19:55:40 +0000 (UTC) (envelope-from sumit.saxena@broadcom.com) Received: by mail-pg1-x533.google.com with SMTP id h185so2600452pgc.10 for ; Thu, 27 Oct 2022 12:55:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=broadcom.com; s=google; h=to:in-reply-to:cc:references:message-id:date:subject:mime-version :from:from:to:cc:subject:date:message-id:reply-to; bh=MAgfR/LkpDBrBQJN/64HHp8pvnSbJRVXR0RAWiv2aQc=; b=NaEAvfCHuvCOf5c9iSmKbgHR9ojOSqCHBWEhHLQ0QssUmphVc2zIP03tPjNu25dIYG 7FfYC72M4QzDMh9ZlBHcoduwmXnE0oS1biJU+8Z4gklApKJI988izw368NlmiL/UUU14 NoXd+6OS7HwxDTDZ/ZA3XG01bFO2pu2AuSsZo= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=to:in-reply-to:cc:references:message-id:date:subject:mime-version :from:x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=MAgfR/LkpDBrBQJN/64HHp8pvnSbJRVXR0RAWiv2aQc=; b=EJy4gw1+FjrgrqpoYwItm15LsGPCYAvPpkcr0q4101DmnzqWZLERSjKLmwMcDjkF77 4ajGHBvyGd0pKD8McJxcnHwQhgXzoYX5bEn+ntRyGU4fV8AnvbfhIuzaL5Mm/Jcx8/u6 /YPSCnlOoXBRI3xXrrxuHwofwRYmmNyaROIoHvWEbvMdDkXJb/qrezgHjbKitbdyx0QZ 6I31S93KYhDxrnF0jVKNumrjon5Q9YuTq1ePa4mIVoB2ysJJU+BNtKFQwPZDXn9HVcIx 2SYPtpGXTjh0vkqSIyXlzIelwBwTOlVxgtZweKUUXgceN0ty9Cg8+gfV5NycJnnm0nNZ JHEw== X-Gm-Message-State: ACrzQf1R5DwUvAy0Blpt1Xoty8xPTpyDFe67lCzkSI3Mm5Pw3bqbcaRp OCWBLka8KAAvpgLeP9pjychsUqKWDlFJxQNqG3hP2kiuitCtJIxchHtCvcWpw4Bwr4sriT+dyqS bhe+irhb9iNc3jYeoLppfo5Pal3T37CgdtmKx9+gsT6SsScq+jxkotQZ1Usc/tJRI4k9SlcgucI 7e0A== X-Google-Smtp-Source: AMsMyM6bekziqOSt03EBBrgZ8+DuYztqCy38N0WE8virGweETa6ttsOwnHcGpf2WYHlI78JF1VZ+Aw== X-Received: by 2002:a05:6a00:429a:b0:56b:a4f8:8f2d with SMTP id bx26-20020a056a00429a00b0056ba4f88f2dmr26434998pfb.24.1666900539054; Thu, 27 Oct 2022 12:55:39 -0700 (PDT) Received: from smtpclient.apple ([2401:4900:1cb9:1968:ddef:753b:890d:6000]) by smtp.gmail.com with ESMTPSA id i7-20020a170902c94700b00186b3c3e2dasm1574458pla.155.2022.10.27.12.55.38 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Thu, 27 Oct 2022 12:55:38 -0700 (PDT) From: Sumit Saxena List-Id: SCSI subsystem List-Archive: https://lists.freebsd.org/archives/freebsd-scsi List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-scsi@freebsd.org X-BeenThere: freebsd-scsi@freebsd.org Mime-Version: 1.0 (1.0) Subject: Re: Broadcom AERO SAS adapter: JBOD personality bug Date: Fri, 28 Oct 2022 01:25:36 +0530 Message-Id: <0F74B882-A0EB-44D6-80F3-28EE45749843@broadcom.com> References: Cc: freebsd-scsi@freebsd.org In-Reply-To: To: Borja Marcos X-Mailer: iPhone Mail (19F77) Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha-256; boundary="0000000000008abaae05ec098689" X-Rspamd-Queue-Id: 4MyxHd02tPz3KSw X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=broadcom.com header.s=google header.b=NaEAvfCH; dmarc=pass (policy=quarantine) header.from=broadcom.com; spf=pass (mx1.freebsd.org: domain of sumit.saxena@broadcom.com designates 2607:f8b0:4864:20::533 as permitted sender) smtp.mailfrom=sumit.saxena@broadcom.com X-Spamd-Result: default: False [-7.60 / 15.00]; DWL_DNSWL_MED(-2.00)[broadcom.com:dkim]; SIGNED_SMIME(-2.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.997]; DMARC_POLICY_ALLOW(-0.50)[broadcom.com,quarantine]; MV_CASE(0.50)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; R_DKIM_ALLOW(-0.20)[broadcom.com:s=google]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-scsi@freebsd.org]; ARC_NA(0.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::533:from]; RCVD_COUNT_THREE(0.00)[3]; HAS_ATTACHMENT(0.00)[]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; DKIM_TRACE(0.00)[broadcom.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; MLMMJ_DEST(0.00)[freebsd-scsi@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N --0000000000008abaae05ec098689 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Borja, It=E2=80=99s a design decision and beyond the mrsas driver=E2=80=99s control= . Please open a ticket to Broadcom support channel and they should be able t= o help on your queries. Thanks, Sumit > On 19-Oct-2022, at 7:01 PM, Borja Marcos wrote: >=20 > =EF=BB=BFHi, >=20 > Hope someone from Broadcom is still lurking here ;) >=20 > I have seen a problem with a new Broadcom Aero SAS adapter on FreeBSD. I f= irst detected it on TruNAS 12 but the > issue affects FreeBSD 13.1 as well. >=20 > The card came with RAID firmware installed (dealer fault, but with crazy d= elivery times now I am afraid we must swallow it) > but fortunately it has =E2=80=9CPersonalities=E2=80=9D.=20 >=20 > So, if I set it up in =E2=80=9CJBOD personality=E2=80=9D it does behave li= ke a plain HBA. Good! >=20 > However, I have noticed a problem in the JBOD personality. I am not sure w= hether it is a firmware bug, a design error > or a problem with the mrsas driver although after a quick look at the sou= rce code I don=E2=80=99t think the driver can > solve this. >=20 > After a disk failure (for example, pulling a disk from the backplane) the c= ontroller will mark it as > UNCONFIGURED BAD. Which is a dead end that may require a system reboot or a= t least using a tool such as > StorCli (if it is possible, I haven=E2=80=99t verified that yet). >=20 > If this is a design decision I THINK THIS IS A MISTAKE. If the JBOD person= ality is equivalent to an HBA (it should > be!) the controller firmware should not interfere with decisions made by t= he operating system itself. >=20 > As for the mrsas driver, I am not sure, is there a possibility to add a tu= nable so that can ignore the =E2=80=9Cunconfigured badness=E2=80=9D > and proceed?=20 >=20 > The controller is a Broadcom AERO 10E2 > Firmware: 5.180.02-2512 > NVDATA version: 5.1800.21-0642 >=20 >=20 > Thanks! >=20 >=20 >=20 >=20 >=20 > Borja Marcos. >=20 >=20 --0000000000008abaae05ec098689 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIIQbQYJKoZIhvcNAQcCoIIQXjCCEFoCAQExDzANBglghkgBZQMEAgEFADALBgkqhkiG9w0BBwGg gg3EMIIFDTCCA/WgAwIBAgIQeEqpED+lv77edQixNJMdADANBgkqhkiG9w0BAQsFADBMMSAwHgYD VQQLExdHbG9iYWxTaWduIFJvb3QgQ0EgLSBSMzETMBEGA1UEChMKR2xvYmFsU2lnbjETMBEGA1UE AxMKR2xvYmFsU2lnbjAeFw0yMDA5MTYwMDAwMDBaFw0yODA5MTYwMDAwMDBaMFsxCzAJBgNVBAYT AkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTEwLwYDVQQDEyhHbG9iYWxTaWduIEdDQyBS MyBQZXJzb25hbFNpZ24gMiBDQSAyMDIwMIIBIjANBgkqhkiG9w0BAQEFAAOCAQ8AMIIBCgKCAQEA vbCmXCcsbZ/a0fRIQMBxp4gJnnyeneFYpEtNydrZZ+GeKSMdHiDgXD1UnRSIudKo+moQ6YlCOu4t rVWO/EiXfYnK7zeop26ry1RpKtogB7/O115zultAz64ydQYLe+a1e/czkALg3sgTcOOcFZTXk38e aqsXsipoX1vsNurqPtnC27TWsA7pk4uKXscFjkeUE8JZu9BDKaswZygxBOPBQBwrA5+20Wxlk6k1 e6EKaaNaNZUy30q3ArEf30ZDpXyfCtiXnupjSK8WU2cK4qsEtj09JS4+mhi0CTCrCnXAzum3tgcH cHRg0prcSzzEUDQWoFxyuqwiwhHu3sPQNmFOMwIDAQABo4IB2jCCAdYwDgYDVR0PAQH/BAQDAgGG MGAGA1UdJQRZMFcGCCsGAQUFBwMCBggrBgEFBQcDBAYKKwYBBAGCNxQCAgYKKwYBBAGCNwoDBAYJ KwYBBAGCNxUGBgorBgEEAYI3CgMMBggrBgEFBQcDBwYIKwYBBQUHAxEwEgYDVR0TAQH/BAgwBgEB /wIBADAdBgNVHQ4EFgQUljPR5lgXWzR1ioFWZNW+SN6hj88wHwYDVR0jBBgwFoAUj/BLf6guRSSu TVD6Y5qL3uLdG7wwegYIKwYBBQUHAQEEbjBsMC0GCCsGAQUFBzABhiFodHRwOi8vb2NzcC5nbG9i YWxzaWduLmNvbS9yb290cjMwOwYIKwYBBQUHMAKGL2h0dHA6Ly9zZWN1cmUuZ2xvYmFsc2lnbi5j b20vY2FjZXJ0L3Jvb3QtcjMuY3J0MDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6Ly9jcmwuZ2xvYmFs c2lnbi5jb20vcm9vdC1yMy5jcmwwWgYDVR0gBFMwUTALBgkrBgEEAaAyASgwQgYKKwYBBAGgMgEo CjA0MDIGCCsGAQUFBwIBFiZodHRwczovL3d3dy5nbG9iYWxzaWduLmNvbS9yZXBvc2l0b3J5LzAN BgkqhkiG9w0BAQsFAAOCAQEAdAXk/XCnDeAOd9nNEUvWPxblOQ/5o/q6OIeTYvoEvUUi2qHUOtbf jBGdTptFsXXe4RgjVF9b6DuizgYfy+cILmvi5hfk3Iq8MAZsgtW+A/otQsJvK2wRatLE61RbzkX8 9/OXEZ1zT7t/q2RiJqzpvV8NChxIj+P7WTtepPm9AIj0Keue+gS2qvzAZAY34ZZeRHgA7g5O4TPJ /oTd+4rgiU++wLDlcZYd/slFkaT3xg4qWDepEMjT4T1qFOQIL+ijUArYS4owpPg9NISTKa1qqKWJ jFoyms0d0GwOniIIbBvhI2MJ7BSY9MYtWVT5jJO3tsVHwj4cp92CSFuGwunFMzCCA18wggJHoAMC AQICCwQAAAAAASFYUwiiMA0GCSqGSIb3DQEBCwUAMEwxIDAeBgNVBAsTF0dsb2JhbFNpZ24gUm9v dCBDQSAtIFIzMRMwEQYDVQQKEwpHbG9iYWxTaWduMRMwEQYDVQQDEwpHbG9iYWxTaWduMB4XDTA5 MDMxODEwMDAwMFoXDTI5MDMxODEwMDAwMFowTDEgMB4GA1UECxMXR2xvYmFsU2lnbiBSb290IENB IC0gUjMxEzARBgNVBAoTCkdsb2JhbFNpZ24xEzARBgNVBAMTCkdsb2JhbFNpZ24wggEiMA0GCSqG SIb3DQEBAQUAA4IBDwAwggEKAoIBAQDMJXaQeQZ4Ihb1wIO2hMoonv0FdhHFrYhy/EYCQ8eyip0E XyTLLkvhYIJG4VKrDIFHcGzdZNHr9SyjD4I9DCuul9e2FIYQebs7E4B3jAjhSdJqYi8fXvqWaN+J J5U4nwbXPsnLJlkNc96wyOkmDoMVxu9bi9IEYMpJpij2aTv2y8gokeWdimFXN6x0FNx04Druci8u nPvQu7/1PQDhBjPogiuuU6Y6FnOM3UEOIDrAtKeh6bJPkC4yYOlXy7kEkmho5TgmYHWyn3f/kRTv riBJ/K1AFUjRAjFhGV64l++td7dkmnq/X8ET75ti+w1s4FRpFqkD2m7pg5NxdsZphYIXAgMBAAGj QjBAMA4GA1UdDwEB/wQEAwIBBjAPBgNVHRMBAf8EBTADAQH/MB0GA1UdDgQWBBSP8Et/qC5FJK5N UPpjmove4t0bvDANBgkqhkiG9w0BAQsFAAOCAQEAS0DbwFCq/sgM7/eWVEVJu5YACUGssxOGhigH M8pr5nS5ugAtrqQK0/Xx8Q+Kv3NnSoPHRHt44K9ubG8DKY4zOUXDjuS5V2yq/BKW7FPGLeQkbLmU Y/vcU2hnVj6DuM81IcPJaP7O2sJTqsyQiunwXUaMld16WCgaLx3ezQA3QY/tRG3XUyiXfvNnBB4V 14qWtNPeTCekTBtzc3b0F5nCH3oO4y0IrQocLP88q1UOD5F+NuvDV0m+4S4tfGCLw0FREyOdzvcy a5QBqJnnLDMfOjsl0oZAzjsshnjJYS8Uuu7bVW/fhO4FCU29KNhyztNiUGUe65KXgzHZs7XKR1g/ XzCCBUwwggQ0oAMCAQICDB2B69csh2jp9sI0jzANBgkqhkiG9w0BAQsFADBbMQswCQYDVQQGEwJC RTEZMBcGA1UEChMQR2xvYmFsU2lnbiBudi1zYTExMC8GA1UEAxMoR2xvYmFsU2lnbiBHQ0MgUjMg UGVyc29uYWxTaWduIDIgQ0EgMjAyMDAeFw0yMjA5MTAwOTE1MzVaFw0yNTA5MTAwOTE1MzVaMIGO MQswCQYDVQQGEwJJTjESMBAGA1UECBMJS2FybmF0YWthMRIwEAYDVQQHEwlCYW5nYWxvcmUxFjAU BgNVBAoTDUJyb2FkY29tIEluYy4xFTATBgNVBAMTDFN1bWl0IFNheGVuYTEoMCYGCSqGSIb3DQEJ ARYZc3VtaXQuc2F4ZW5hQGJyb2FkY29tLmNvbTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoC ggEBALoGydo8plkxTqXV8MOi06PQvWWLx02gZEgN0QNCmUbBNjDUSFh3ONINOfWPHBGHm7xAZwkv 4t5gJ0bMkTp/mTSrDsXyD6voKaTveYz6fDPfzcb+NvqXiDHmYnxR1h2BJ3N37GR8/gMG9J4H9Uny hExFVC4t1YMhXlpVGcRlHPt/nMF8z9sE9vd7z2HFKhRfIQ7eChsb4fv7Qb6gYdK7eMHs2EEeyY1W 1J8x62/iEVbCstJaE1Nt3oXnL5yBlqX1Ihp8cZLe1weS7Wp/v5Jg2Ks13jeYOKW45xXExpqPPd1f 3meFjTf9K+rGZHb63htWaJtf0NYbE+5yIbXFv21cBxECAwEAAaOCAdowggHWMA4GA1UdDwEB/wQE AwIFoDCBowYIKwYBBQUHAQEEgZYwgZMwTgYIKwYBBQUHMAKGQmh0dHA6Ly9zZWN1cmUuZ2xvYmFs c2lnbi5jb20vY2FjZXJ0L2dzZ2NjcjNwZXJzb25hbHNpZ24yY2EyMDIwLmNydDBBBggrBgEFBQcw AYY1aHR0cDovL29jc3AuZ2xvYmFsc2lnbi5jb20vZ3NnY2NyM3BlcnNvbmFsc2lnbjJjYTIwMjAw TQYDVR0gBEYwRDBCBgorBgEEAaAyASgKMDQwMgYIKwYBBQUHAgEWJmh0dHBzOi8vd3d3Lmdsb2Jh bHNpZ24uY29tL3JlcG9zaXRvcnkvMAkGA1UdEwQCMAAwSQYDVR0fBEIwQDA+oDygOoY4aHR0cDov L2NybC5nbG9iYWxzaWduLmNvbS9nc2djY3IzcGVyc29uYWxzaWduMmNhMjAyMC5jcmwwJAYDVR0R BB0wG4EZc3VtaXQuc2F4ZW5hQGJyb2FkY29tLmNvbTATBgNVHSUEDDAKBggrBgEFBQcDBDAfBgNV HSMEGDAWgBSWM9HmWBdbNHWKgVZk1b5I3qGPzzAdBgNVHQ4EFgQUTIFIrhFDaoMEbXuV9O+Y+XgS kVwwDQYJKoZIhvcNAQELBQADggEBAFyioHqB2PHWcQ5cU8nprPRk37uSWK2x0w7W50jjc0cooz6G G6pltJ+DvbG7XIzCU8cKHmuyAxoe1+/vhB8yJH78MVdfKDDND7zL/IqfhZedxHcHG5jVqbVH/ufu H19y4fHxo5bLkybX3UxkN9b3bMsBZ4FFCLSCFgFfjI0BmTx6IoGyi0R89rzD0H1rURy7WTn0ijl1 nERsqENeyGfUTJLcDSURb49qpFqqWweJ7ifC64Iak8wCK2CxCe8lHfTyEgC9MuEa586NMQJDguvw jlC7kxrgwf4sZ/9Wj/GS2HLzZPkxWCcQIrgNJm2wceHQwPBpM0ZoqL1D2tsFgOA8BvYxggJtMIIC aQIBATBrMFsxCzAJBgNVBAYTAkJFMRkwFwYDVQQKExBHbG9iYWxTaWduIG52LXNhMTEwLwYDVQQD EyhHbG9iYWxTaWduIEdDQyBSMyBQZXJzb25hbFNpZ24gMiBDQSAyMDIwAgwdgevXLIdo6fbCNI8w DQYJYIZIAWUDBAIBBQCggdQwLwYJKoZIhvcNAQkEMSIEIFsGwu+Z+hO1tUEPAuaYxLjCqMTXDlaB ehRlP4JYpKdBMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcNAQkFMQ8XDTIyMTAy NzE5NTUzOVowaQYJKoZIhvcNAQkPMVwwWjALBglghkgBZQMEASowCwYJYIZIAWUDBAEWMAsGCWCG SAFlAwQBAjAKBggqhkiG9w0DBzALBgkqhkiG9w0BAQowCwYJKoZIhvcNAQEHMAsGCWCGSAFlAwQC ATANBgkqhkiG9w0BAQEFAASCAQAx4tFusKYujzxjCZegpDIzTfxbcyyFbi4R2xuaFX+z4mHmzSuP pmpDPeyf86wn6HGw5k7Unmri2AWI+i0Gq9L6bmpo7GpZLWLjSSAXazmKJA6DmNgS0n/xc3McvmnA UQOXdgyeNZRUyKssA0B/S51kYBI1eAmMrnTb0CgPbEvUIyby+sI+kxsUZ+F2Mr0wRI1ZT/dUEdZQ AdyFmEAkyO4JJVpITNPEtTxGPzQxzlZrKdwMgNIJpJzZMnC4aF6qky05z91QEhRO0rXvjlhtIDsC KigsUdjXk9aaXTbFUoMfD9ibtauH4GzYsOd4Q0dS36JG5Mlhor18wSGMCUOgbnhR --0000000000008abaae05ec098689--