Date: Mon, 22 Aug 2016 11:22:42 -0500 From: Karl Denninger <karl@denninger.net> To: freebsd-fs@freebsd.org Subject: Re: Recommended HBA for ZFS, contemporary Message-ID: <ba972848-140c-31a8-505e-2470ed750fc8@denninger.net> In-Reply-To: <alpine.BSF.2.00.1608221904270.82304@woozle.rinet.ru> References: <alpine.BSF.2.00.1608221904270.82304@woozle.rinet.ru>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a cryptographically signed message in MIME format. --------------ms000000040104070106000601 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable I'm still a fan of the LSI SAS-9211 cards along with (for higher density) a SAS port expander. I've been extremely happy with this combination with one caveat -- most systems must boot from the actual card and not a port on the expander(s) you connect to it due to BIOS constraints. They're also crazily cost-effective on-balance. In practice this means you have 4 ports on the base card available (2 used for mirrored boot drives, 2 for other things) and the rest of the disks go on the expander, or you run more than one card. Whether you can actually saturate this combination depends on what you attach. In large configurations, especially those stuffed with SSDs, you can -- at which point something faster such as the 93xx series which are materially faster (but still in "host" mode as opposed to any sort of "smart", "raid" or "buffered" mode) should be considered. The "smarter" the card the dumber the results tend to be when ZFS is in use, in my experience :) Pay attention as well to the slots on your server board and the number of lanes they can support. It makes no sense to buy a fast board that your motherboard cripples because it cannot run it in the slot(s) you have available at full speed. On 8/22/2016 11:08, Dmitry Morozovsky wrote: > Dear colleagues, > > what is the list of preferred disk controllers to build storage server,= say=20 > 12-24 amd more 3.5" disks? Not too much IOPS are expected, and some co= uld be=20 > mitigated with L2ARC with only metadata cached, I suppose. > > Two usage schemes are file server for big files (mostly cold storage) a= nd=20 > backup/surveillance server (constant stream writes, occasional random r= eads) > > Any hints? Thanks! > --=20 Karl Denninger karl@denninger.net <mailto:karl@denninger.net> /The Market Ticker/ /[S/MIME encrypted email preferred]/ --------------ms000000040104070106000601 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: S/MIME Cryptographic Signature MIAGCSqGSIb3DQEHAqCAMIACAQExDzANBglghkgBZQMEAgMFADCABgkqhkiG9w0BBwEAAKCC Bl8wggZbMIIEQ6ADAgECAgEpMA0GCSqGSIb3DQEBCwUAMIGQMQswCQYDVQQGEwJVUzEQMA4G A1UECBMHRmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3Rl bXMgTExDMRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhND dWRhIFN5c3RlbXMgTExDIENBMB4XDTE1MDQyMTAyMjE1OVoXDTIwMDQxOTAyMjE1OVowWjEL MAkGA1UEBhMCVVMxEDAOBgNVBAgTB0Zsb3JpZGExGTAXBgNVBAoTEEN1ZGEgU3lzdGVtcyBM TEMxHjAcBgNVBAMTFUthcmwgRGVubmluZ2VyIChPQ1NQKTCCAiIwDQYJKoZIhvcNAQEBBQAD ggIPADCCAgoCggIBALmEWPhAdphrWd4K5VTvE5pxL3blRQPyGF3ApjUjgtavqU1Y8pbI3Byg XDj2/Uz9Si8XVj/kNbKEjkRh5SsNvx3Fc0oQ1uVjyCq7zC/kctF7yLzQbvWnU4grAPZ3IuAp 3/fFxIVaXpxEdKmyZAVDhk9az+IgHH43rdJRIMzxJ5vqQMb+n2EjadVqiGPbtG9aZEImlq7f IYDTnKyToi23PAnkPwwT+q1IkI2DTvf2jzWrhLR5DTX0fUYC0nxlHWbjgpiapyJWtR7K2YQO aevQb/3vN9gSojT2h+cBem7QIj6U69rEYcEDvPyCMXEV9VcXdcmW42LSRsPvZcBHFkWAJqMZ Myiz4kumaP+s+cIDaXitR/szoqDKGSHM4CPAZV9Yh8asvxQL5uDxz5wvLPgS5yS8K/o7zDR5 vNkMCyfYQuR6PAJxVOk5Arqvj9lfP3JSVapwbr01CoWDBkpuJlKfpQIEeC/pcCBKknllbMYq yHBO2TipLyO5Ocd1nhN/nOsO+C+j31lQHfOMRZaPQykXVPWG5BbhWT7ttX4vy5hOW6yJgeT/ o3apynlp1cEavkQRS8uJHoQszF6KIrQMID/JfySWvVQ4ksnfzwB2lRomrdrwnQ4eG/HBS+0l eozwOJNDIBlAP+hLe8A5oWZgooIIK/SulUAsfI6Sgd8dTZTTYmlhAgMBAAGjgfQwgfEwNwYI KwYBBQUHAQEEKzApMCcGCCsGAQUFBzABhhtodHRwOi8vY3VkYXN5c3RlbXMubmV0Ojg4ODgw CQYDVR0TBAIwADARBglghkgBhvhCAQEEBAMCBaAwCwYDVR0PBAQDAgXgMCwGCWCGSAGG+EIB DQQfFh1PcGVuU1NMIEdlbmVyYXRlZCBDZXJ0aWZpY2F0ZTAdBgNVHQ4EFgQUxRyULenJaFwX RtT79aNmIB/u5VkwHwYDVR0jBBgwFoAUJHGbnYV9/N3dvbDKkpQDofrTbTUwHQYDVR0RBBYw FIESa2FybEBkZW5uaW5nZXIubmV0MA0GCSqGSIb3DQEBCwUAA4ICAQBPf3cYtmKowmGIYsm6 eBinJu7QVWvxi1vqnBz3KE+HapqoIZS8/PolB/hwiY0UAE1RsjBJ7yEjihVRwummSBvkoOyf G30uPn4yg4vbJkR9lTz8d21fPshWETa6DBh2jx2Qf13LZpr3Pj2fTtlu6xMYKzg7cSDgd2bO sJGH/rcvva9Spkx5Vfq0RyOrYph9boshRN3D4tbWgBAcX9POdXCVfJONDxhfBuPHsJ6vEmPb An+XL5Yl26XYFPiODQ+Qbk44Ot1kt9s7oS3dVUrh92Qv0G3J3DF+Vt6C15nED+f+bk4gScu+ JHT7RjEmfa18GT8DcT//D1zEke1Ymhb41JH+GyZchDRWtjxsS5OBFMzrju7d264zJUFtX7iJ 3xvpKN7VcZKNtB6dLShj3v/XDsQVQWXmR/1YKWZ93C3LpRs2Y5nYdn6gEOpL/WfQFThtfnat HNc7fNs5vjotaYpBl5H8+VCautKbGOs219uQbhGZLYTv6okuKcY8W+4EJEtK0xB08vqr9Jd0 FS9MGjQE++GWo+5eQxFt6nUENHbVYnsr6bYPQsZH0CRNycgTG9MwY/UIXOf4W034UpR82TBG 1LiMsYfb8ahQJhs3wdf1nzipIjRwoZKT1vGXh/cj3gwSr64GfenURBxaFZA5O1acOZUjPrRT n3ci4McYW/0WVVA3lDGCBRMwggUPAgEBMIGWMIGQMQswCQYDVQQGEwJVUzEQMA4GA1UECBMH RmxvcmlkYTESMBAGA1UEBxMJTmljZXZpbGxlMRkwFwYDVQQKExBDdWRhIFN5c3RlbXMgTExD MRwwGgYDVQQDExNDdWRhIFN5c3RlbXMgTExDIENBMSIwIAYJKoZIhvcNAQkBFhNDdWRhIFN5 c3RlbXMgTExDIENBAgEpMA0GCWCGSAFlAwQCAwUAoIICTTAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xNjA4MjIxNjIyNDJaME8GCSqGSIb3DQEJBDFCBEAy v3fhZ6StHQV6OPN/zRimbislMyeA4CYkRRPq1lp5rZTeeR/g7Cu7xjMHWkJxCiSrFXYPmEty 5xHq501xI2uwMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAK BggqhkiG9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYI KoZIhvcNAwICASgwgacGCSsGAQQBgjcQBDGBmTCBljCBkDELMAkGA1UEBhMCVVMxEDAOBgNV BAgTB0Zsb3JpZGExEjAQBgNVBAcTCU5pY2V2aWxsZTEZMBcGA1UEChMQQ3VkYSBTeXN0ZW1z IExMQzEcMBoGA1UEAxMTQ3VkYSBTeXN0ZW1zIExMQyBDQTEiMCAGCSqGSIb3DQEJARYTQ3Vk YSBTeXN0ZW1zIExMQyBDQQIBKTCBqQYLKoZIhvcNAQkQAgsxgZmggZYwgZAxCzAJBgNVBAYT AlVTMRAwDgYDVQQIEwdGbG9yaWRhMRIwEAYDVQQHEwlOaWNldmlsbGUxGTAXBgNVBAoTEEN1 ZGEgU3lzdGVtcyBMTEMxHDAaBgNVBAMTE0N1ZGEgU3lzdGVtcyBMTEMgQ0ExIjAgBgkqhkiG 9w0BCQEWE0N1ZGEgU3lzdGVtcyBMTEMgQ0ECASkwDQYJKoZIhvcNAQEBBQAEggIAK/4JUMWH tJZ8rZF4vpZwLkcbZfD9i2UPeOqBU53MYXuwLMJIlwaDOcgUYyJ8Kgth5JbA55pBkz3BINZb JhMt4c7JNycisV+FcYiBv8AnJC5Wm6FTBFLrOnSBkGowZg777LXD9AhYH7f9KyYkTqtWPVHY 7ed7iEb2jWu8utjVV4iOjnWqmCCGKVLbrV/4uwlS0vinf2oXf/2/rqygCspa7sz0o0vb9obV u3V0Oh4vVrrq6SVJiOsJVllG2ZFvCDhhvhYi8wmRHmiTT02r+xrMXVCfBNME4Z1Zv+AKwEC0 BKLjk5/XHWhnahO3l3SpFrG38Fyi7Db8rFhYR4RLv7EcOCpHYJ2nq0wZJ4uhNlio9I8uM5Rx PQ5s9lNrIaq4TnXvd57msoTXCCjWY7vvinQPJkG4gsHBm3cV8jruR0nb7ZQdmHekJ5zfFuDF wzlLS4I77/wy43ez4zPX6xyr8vXZJgXy1KFNMybXLN4CFnR4IN2Zo2/siokPskzDclLMMCa2 2VIC35Mmm9pJ7itdN6kKYkl3BkSI4fxouu0xxjoVWLGpiL9kXu5ioFJTjfnmkvMzBwxD7bvr GhhSyefm9/Fo4vYZxXQGsq0Q4RopdUHYofNLKlELagGP/MccMSr1AGufrXdtJICvwoV7JR6C qr8NqyOeLtZ4bcvQNoRr4R9Zd38AAAAAAAA= --------------ms000000040104070106000601--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?ba972848-140c-31a8-505e-2470ed750fc8>