Date: Fri, 15 Mar 2024 15:09:56 -0400 From: Karl Denninger <karl@denninger.net> To: freebsd-hardware@freebsd.org Subject: Re: WD Blue 510 SSD and strange write performance Message-ID: <0b98d5fc-0bfb-4d13-8e14-79cb3ee873c0@denninger.net> In-Reply-To: <e02f55c5-947e-4650-b711-78f1e3004b50@sentex.net> References: <e5c2a99d-931e-48b4-9445-fc4ad05ccc70@sentex.net> <CCAB653B-4DC6-4C69-AB68-CD258200D22F@gid.co.uk> <6504bd49-eca5-4e0a-b2bd-23d29405bb7a@sentex.net> <4832DE6A-5C82-4805-99BB-220D4342AE0F@fjl.co.uk> <69e47494-01aa-4149-a326-91d82dfdc46e@sentex.net> <C6B95542-AB00-4689-9918-738108C4F8FB@fjl.co.uk> <e02f55c5-947e-4650-b711-78f1e3004b50@sentex.net>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms020200020503040109090109 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit I've got both the Kingston and Micron versions of these in production use and have seen nothing like this at all; they get hit pretty hard too, including release building (both direct and cross-builds) and similar stuff. On 3/15/2024 2:17 PM, mike tancsa wrote: > On 3/14/2024 4:58 PM, Frank Leonhardt wrote: >> Sorry - not that deeply into modern SSD (never written a driver for >> one), but based on my understanding your TRIM theory makes sense to >> me. I'd try turning it off. It does seem to be an ongoing source of >> snafus. >> >> I did use WD Blue SSDs but I suspect they vary quite a bit. I've had >> rather too many early failures. I wouldn't use them in production but >> okay for Windoze. We all know deep down there's a reason the >> enterprise SSDs cost what they do :-) >> >> I'll keep thinking > > Thanks for the input. I think these drives are just kinda broken :( I > noticed we had the 2TB versions of this line, but they seem rather > different and I am not able to trigger the errors with them > thankfully. Even stranger, I have a 1TB version of this drive I > bought from a while back that has the same firmware, but does NOT have > this issue. However, the output of the identifier is slightly > different. Who knows, it could be some component WD uses that *should > be* the same but is not and is causing some subtle pathology. > > > I tried turning off NCQ on the controller and it didnt seem to make a > difference. Then I turned off autotrim and did a manual trim of the > pool, then did the tests and same sorts of errors. I think I am just > gonna cut my losses with these disks :( Even if I figured out some > work around at this point, I would not deploy them into production. I > doubt I will be able to get anywhere with WD. Farewell my 400 bucks :( > > (da6:mpr0:0:16:0): READ(10). CDB: 28 00 6d e0 ae 28 00 00 08 00 > (da6:mpr0:0:16:0): CAM status: CCB request completed with an error > (da6:mpr0:0:16:0): Retrying command, 3 more tries remain > (da6:mpr0:0:16:0): WRITE(10). CDB: 2a 00 0c cb 3f 00 00 00 e8 00 > (da6:mpr0:0:16:0): CAM status: CCB request completed with an error > (da6:mpr0:0:16:0): Retrying command, 3 more tries remain > (da6:mpr0:0:16:0): READ(10). CDB: 28 00 6d e0 ad 28 00 01 00 00 > (da6:mpr0:0:16:0): CAM status: CCB request completed with an error > (da6:mpr0:0:16:0): Retrying command, 3 more tries remain > (da6:mpr0:0:16:0): READ(10). CDB: 28 00 6d e0 ac 28 00 00 f8 00 > (da6:mpr0:0:16:0): CAM status: CCB request completed with an error > (da6:mpr0:0:16:0): Retrying command, 3 more tries remain > (da6:mpr0:0:16:0): WRITE(10). CDB: 2a 00 40 07 df 88 00 01 00 00 > (da6:mpr0:0:16:0): CAM status: CCB request completed with an error > (da6:mpr0:0:16:0): Retrying command, 3 more tries remain > (da6:mpr0:0:16:0): WRITE(10). CDB: 2a 00 3f 48 72 08 00 01 00 00 > (da6:mpr0:0:16:0): CAM status: SCSI Status Error > (da6:mpr0:0:16:0): SCSI status: Check Condition > (da6:mpr0:0:16:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, > reset, or bus device reset occurred) > (da6:mpr0:0:16:0): Retrying command (per sense data) > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 2036 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 637 loginfo > 31110f00 > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 41 98 42 00 00 01 00 00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 1242 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 979 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 1243 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 2091 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 1612 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 2093 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 152 loginfo > 31110f00 > mpr0: Controller reported scsi ioc terminated tgt 15 SMID 2132 loginfo > 31110f00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 43 17 dc 88 00 01 00 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 41 98 43 00 00 00 50 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 0c d4 f6 80 00 00 68 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 0c d4 f5 80 00 01 00 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): READ(10). CDB: 28 00 05 dc 12 28 00 00 f8 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): READ(10). CDB: 28 00 05 dc 0f b0 00 00 88 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 02 96 7e 80 00 00 10 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): READ(10). CDB: 28 00 6f 5b 8d 68 00 01 00 00 > (da5:mpr0:0:15:0): CAM status: CCB request completed with an error > (da5:mpr0:0:15:0): Retrying command, 3 more tries remain > (da5:mpr0:0:15:0): WRITE(10). CDB: 2a 00 41 98 42 00 00 01 00 00 > (da5:mpr0:0:15:0): CAM status: SCSI Status Error > (da5:mpr0:0:15:0): SCSI status: Check Condition > (da5:mpr0:0:15:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, > reset, or bus device reset occurred) > (da5:mpr0:0:15:0): Retrying command (per sense data) > > > > -- -- Karl Denninger /The Market-Ticker/ S/MIME Email accepted and preferred --------------ms020200020503040109090109 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC DbowggagMIIEiKADAgECAhMA5EiKghDOXrvfxYxjITXYDdhIMA0GCSqGSIb3DQEBCwUAMIGL MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkw FwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAf BgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQTAeFw0xNzA4MTcxNjQyMTdaFw0yNzA4 MTUxNjQyMTdaMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9yaWRhMRkwFwYDVQQKDBBD dWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExJTAjBgNVBAMMHEN1 ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0EwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIK AoICAQC1aJotNUI+W4jP7xQDO8L/b4XiF4Rss9O0B+3vMH7Njk85fZ052QhZpMVlpaaO+sCI KqG3oNEbuOHzJB/NDJFnqh7ijBwhdWutdsq23Ux6TvxgakyMPpT6TRNEJzcBVQA0kpby1DVD 0EKSK/FrWWBiFmSxg7qUfmIq/mMzgE6epHktyRM3OGq3dbRdOUgfumWrqHXOrdJz06xE9NzY vc9toqZnd79FUtE/nSZVm1VS3Grq7RKV65onvX3QOW4W1ldEHwggaZxgWGNiR/D4eosAGFxn uYeWlKEC70c99Mp1giWux+7ur6hc2E+AaTGh+fGeijO5q40OGd+dNMgK8Es0nDRw81lRcl24 SWUEky9y8DArgIFlRd6d3ZYwgc1DMTWkTavx3ZpASp5TWih6yI8ACwboTvlUYeooMsPtNa9E 6UQ1nt7VEi5syjxnDltbEFoLYcXBcqhRhFETJe9CdenItAHAtOya3w5+fmC2j/xJz29og1KH YqWHlo3Kswi9G77an+zh6nWkMuHs+03DU8DaOEWzZEav3lVD4u76bKRDTbhh0bMAk4eXriGL h4MUoX3Imfcr6JoyheVrAdHDL/BixbMH1UUspeRuqQMQ5b2T6pabXP0oOB4FqldWiDgJBGRd zWLgCYG8wPGJGYgHibl5rFiI5Ix3FQncipc6SdUzOQIDAQABo4IBCjCCAQYwHQYDVR0OBBYE FF3AXsKnjdPND5+bxVECGKtc047PMIHABgNVHSMEgbgwgbWAFBu1oRhUMNEzjODolDka5k4Q EDBioYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJ TmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5 c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBDQYIJAKxAy1WBo2kY MBIGA1UdEwEB/wQIMAYBAf8CAQAwDgYDVR0PAQH/BAQDAgGGMA0GCSqGSIb3DQEBCwUAA4IC AQCB5686UCBVIT52jO3sz9pKuhxuC2npi8ZvoBwt/IH9piPA15/CGF1XeXUdu2qmhOjHkVLN gO7XB1G8CuluxofOIUce0aZGyB+vZ1ylHXlMeB0R82f5dz3/T7RQso55Y2Vog2Zb7PYTC5B9 oNy3ylsnNLzanYlcW3AAfzZcbxYuAdnuq0Im3EpGm8DoItUcf1pDezugKm/yKtNtY6sDyENj tExZ377cYA3IdIwqn1Mh4OAT/Rmh8au2rZAo0+bMYBy9C11Ex0hQ8zWcvPZBDn4v4RtO8g+K uQZQcJnO09LJNtw94W3d2mj4a7XrsKMnZKvm6W9BJIQ4Nmht4wXAtPQ1xA+QpxPTmsGAU0Cv HmqVC7XC3qxFhaOrD2dsvOAK6Sn3MEpH/YrfYCX7a7cz5zW3DsJQ6o3pYfnnQz+hnwLlz4MK 17NIA0WOdAF9IbtQqarf44+PEyUbKtz1r0KGeGLs+VGdd2FLA0e7yuzxJDYcaBTVwqaHhU2/ Fna/jGU7BhrKHtJbb/XlLeFJ24yvuiYKpYWQSSyZu1R/gvZjHeGb344jGBsZdCDrdxtQQcVA 6OxsMAPSUPMrlg9LWELEEYnVulQJerWxpUecGH92O06wwmPgykkz//UmmgjVSh7ErNvL0lUY UMfunYVO/O5hwhW+P4gviCXzBFeTtDZH259O7TCCBxIwggT6oAMCAQICEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQsFADB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlk YTEZMBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENB MSUwIwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBMB4XDTIyMDYyOTE2MTYz NloXDTI3MDYyODE2MTYzNlowOjELMAkGA1UEBhMCVVMxEjAQBgNVBAgMCVRlbm5lc3NlZTEX MBUGA1UEAwwOS2FybCBEZW5uaW5nZXIwggIiMA0GCSqGSIb3DQEBAQUAA4ICDwAwggIKAoIC AQC+HVSyxVtJhy3Ohs+PAGRuO//Dha9A16l5FPATr6wude9zjX5f2lrkRyU8vhCXTZW7WbvW ZKpcZ8r0dtZmiK9uF58Ec6hhvfkxJzbg96WHBw5Fumd5ahZzuCJDtCAWW8R7/KN+zwzQf1+B 3MVLmbaXAFBuKzySKhKMcHbK3/wjUYTgy+3UK6v2SBrowvkUBC+jxNg3Wy12GsTXcUS/8FYI XgVVPgfZZrbJJb5HWOQpvvhILpPCD3xsYJFNKEPltXKWHT7Qtc2HNqikgNwj8oqOb+PeZGMi WapsatKm8mxuOOGOEBhAoTVTwUHlMNTg6QUCJtuWFCK38qOCyk9Haj+86lUU8RG6FkRXWgMb NQm1mWREQhw3axgGLSntjjnznJr5vsvXSYR6c+XKLd5KQZcS6LL8FHYNjqVKHBYM+hDnrTZM qa20JLAF1YagutDiMRURU23iWS7bA9tMcXcqkclTSDtFtxahRifXRI7Epq2GSKuEXe/1Tfb5 CE8QsbCpGsfSwv2tZ/SpqVG08MdRiXxN5tmZiQWo15IyWoeKOXl/hKxA9KPuDHngXX022b1l y+5ZOZbxBAZZMod4y4b4FiRUhRI97r9lCxsP/EPHuuTIZ82BYhrhbtab8HuRo2ofne2TfAWY 2BlA7ExM8XShMd9bRPZrNTokPQPUCWCgCdIATQIDAQABo4IBzzCCAcswPAYIKwYBBQUHAQEE MDAuMCwGCCsGAQUFBzABhiBodHRwOi8vb2NzcC5jdWRhc3lzdGVtcy5uZXQ6ODg4ODAJBgNV HRMEAjAAMBEGCWCGSAGG+EIBAQQEAwIFoDAOBgNVHQ8BAf8EBAMCBeAwHQYDVR0lBBYwFAYI KwYBBQUHAwIGCCsGAQUFBwMEMDMGCWCGSAGG+EIBDQQmFiRPcGVuU1NMIEdlbmVyYXRlZCBD bGllbnQgQ2VydGlmaWNhdGUwHQYDVR0OBBYEFLElmNWeVgsBPe7O8NiBzjvjYnpRMIHKBgNV HSMEgcIwgb+AFF3AXsKnjdPND5+bxVECGKtc047PoYGRpIGOMIGLMQswCQYDVQQGEwJVUzEQ MA4GA1UECAwHRmxvcmlkYTESMBAGA1UEBwwJTmljZXZpbGxlMRkwFwYDVQQKDBBDdWRhIFN5 c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMgQ0ExITAfBgNVBAMMGEN1ZGEgU3lz dGVtcyBMTEMgMjAxNyBDQYITAORIioIQzl6738WMYyE12A3YSDAdBgNVHREEFjAUgRJrYXJs QGRlbm5pbmdlci5uZXQwDQYJKoZIhvcNAQELBQADggIBAKquc7cu0xc8FNtAQauZvocDzWQj 7HG9YvMbWnMi+ckhiA3rdW5NwWg0HBhBho1YlnqV+ntCVE2L8ezohHWm+KAdfXgpraL86Vsn 3ywNlZu/3COMpo2ALuHln8YQtH3Y8ebvzKMdlf2b5WB+7mOFIxXIr4AnNOLKCkq5ZhzC6JW6 Jvw3P0csiGa3UrfatYID5NvPgkaQvEgimEjG3psZqwQTL2Wxohvw783PrDt3wS0XeNhvQ61g 3QJFZKuv+bmGH3YBSPo1t6NUGAr+JozX5lDihB8JGkBt/NwdYec49a08uL0BbPaAJ7NjuIPG 7Y0Ak7PXZT37yx/Zla9PzLMJFgbelOkaatdzbblMZPDEVZ27l4lGMmV83Lm3YP17sdAyS/Wp mav7WmJUkQ9iuIKzSpdc82i9Mfujl1vbBtwtkHNPPtKuulIFM4ZwrPKjlVdLqTSqD8m9yHEi Y0PuAooq63OpJWF6hvMaiIPBWEAVIaDW9uG0MshLl9DnHnMyrJTfuC33Z9mOGMz7dRBjJd5Y W02xAzYnUuEBOpj+LQv5R8XIFMHFXktqEKvQrXeM2RU+PcZqKOBkTktxBLn3NI5VfA15Jk0c 5V5XcOqo3p2hvrwvXrinrb2pEREnoqmfrkXT3zOq5Y6ryRH8u734lGEF0dILXzoV4PM7XFit oTePoEjmMYIFBDCCBQACAQEwgZEwezELMAkGA1UEBhMCVVMxEDAOBgNVBAgMB0Zsb3JpZGEx GTAXBgNVBAoMEEN1ZGEgU3lzdGVtcyBMTEMxGDAWBgNVBAsMD0N1ZGEgU3lzdGVtcyBDQTEl MCMGA1UEAwwcQ3VkYSBTeXN0ZW1zIExMQyAyMDE3IEludCBDQQISAsbzIfg9AV1t33FSCanO XWNfMA0GCWCGSAFlAwQCAwUAoIICQzAYBgkqhkiG9w0BCQMxCwYJKoZIhvcNAQcBMBwGCSqG SIb3DQEJBTEPFw0yNDAzMTUxOTA5NTZaME8GCSqGSIb3DQEJBDFCBECcoDVxDdG1qdJQ2QPn WfT4VRKtmvsrM2WMR27FxNVumIE1lAcaPiy98yixpFZPEHzPSrYvsMNSmsbhHAg22YrDMGwG CSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG9w0DBzAO BggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcNAwICASgw gaIGCSsGAQQBgjcQBDGBlDCBkTB7MQswCQYDVQQGEwJVUzEQMA4GA1UECAwHRmxvcmlkYTEZ MBcGA1UECgwQQ3VkYSBTeXN0ZW1zIExMQzEYMBYGA1UECwwPQ3VkYSBTeXN0ZW1zIENBMSUw IwYDVQQDDBxDdWRhIFN5c3RlbXMgTExDIDIwMTcgSW50IENBAhICxvMh+D0BXW3fcVIJqc5d Y18wgaQGCyqGSIb3DQEJEAILMYGUoIGRMHsxCzAJBgNVBAYTAlVTMRAwDgYDVQQIDAdGbG9y aWRhMRkwFwYDVQQKDBBDdWRhIFN5c3RlbXMgTExDMRgwFgYDVQQLDA9DdWRhIFN5c3RlbXMg Q0ExJTAjBgNVBAMMHEN1ZGEgU3lzdGVtcyBMTEMgMjAxNyBJbnQgQ0ECEgLG8yH4PQFdbd9x Ugmpzl1jXzANBgkqhkiG9w0BAQEFAASCAgCDKQx+d8w+va/Rs6Atc34Y4yaQmEPBrQ1+H/Yx 227DMicJ47AF+VNCb8LqxyABhYkjv45qHyyydLYLDoN45svC/TBVl07lx7oRuPkiZM/CMTZM XOsLr9pv72sVLcnpGVhWs2G9GK/yZVqV3GTpNtWH3ilxCNTRe5Tty2jsuf1RczMNvrOxKAvN B/upVicr6thgea2D5YRa5cH5V2bqN5Q3H6KgQwvxbbyOQHBYTH4HEfXAV2XpOgHrH1kITDV5 yCOsJtYQCKHBECuzFb3IIHpeHLirDX8Cptm0uKLIDVb4LaVaf0PQSSOAS5MF9U3QLV76nrW6 I3TzrYm1ZjIkW/VrLbm+3iC2VeoZfgwo+S2hpfyIp3HlgP8dLl5mp+KJBUxgxnVhK6pAspZd 3uV0yAH4ZEB3nzgFvl8X61HUqaZtKeSubt8T+Ai675qIRXQFgqB4OSGTI76nDOW4GmCC44TW DOkeTgGEKCmoUnKIJe+H6FplQ6KTnHPGQ10cbzR2S3qOIsMSFvF+Bl8q3zGzTxJgziLvBSEg tQuy1F+Vz/ZFso6lLDqqqasDZID26Fi8kzXlKKs+cRWAMtqkB2nldxfe3VezK90vQCcqG3fy wGoNsbcODVAxnfrojh2FXM8HYosVYYuCjQzGA3RwM7nuYKZSF+iRQh9Q+1Hh2ijShlI9/gAA AAAAAA== --------------ms020200020503040109090109--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?0b98d5fc-0bfb-4d13-8e14-79cb3ee873c0>