From owner-freebsd-fs@freebsd.org Mon Aug 22 17:18:13 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4A98FBC2CD5 for ; Mon, 22 Aug 2016 17:18:13 +0000 (UTC) (envelope-from lkateley@kateley.com) Received: from mail-it0-x236.google.com (mail-it0-x236.google.com [IPv6:2607:f8b0:4001:c0b::236]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0FF411337 for ; Mon, 22 Aug 2016 17:18:13 +0000 (UTC) (envelope-from lkateley@kateley.com) Received: by mail-it0-x236.google.com with SMTP id x131so98151395ite.0 for ; Mon, 22 Aug 2016 10:18:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=kateley-com.20150623.gappssmtp.com; s=20150623; h=reply-to:subject:references:to:from:organization:message-id:date :user-agent:mime-version:in-reply-to:content-transfer-encoding; bh=Y65/l5jd/0HRhUK74lgkLxxyG2ePNxzXHj0B1I8Ktc8=; b=T7I5WDStt7mn0PszK7M8EQj/801Oxk5DHfwk7eS9AaRMDi8etWkUDbWJktQ+R0Uw6Q DGb+ADpLK2md0ZGcsK2zTTyaXi1SsLEH6yxO5tlYl64b5ukRUwva/ZVM4sm7wq7XFYPk VzW5GPZSAHiq9xPP0DMnmJdf/FLsXC7QtAsxaXahsu5Rx5ZEDPHZv9A3s6s1Tv9JbvtN OGxZaXfC+vrIxNkiJow8o8uGYjSVwDtNgbpHygX+C5F3C25XBh0DaRA0Iw6zLLJmvqM2 tf4yrcxysmkMbEZIt2apREZnw2W36isfC1HIyfgmXMCMcByp+maYdx8/9dq0HYgqK/Xn TyDQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:reply-to:subject:references:to:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-transfer-encoding; bh=Y65/l5jd/0HRhUK74lgkLxxyG2ePNxzXHj0B1I8Ktc8=; b=cU6FvG0EbFd2jLuCsSGs3KvBrl51k/nYpByCYlJoe0kjD4JIirTxmHyHIyuAe8SZLQ 6WxO/594QrwO1t5vXpcuA+itNz5M7fExhpQqwCkiH67AN1UBNC1iPzrt1UUcTZd6ZvpO 7TA3YePzuZhF7vJMmPuJkb3I0q4bfPKENG9qpwShh/oa9vvYZzpH6Fe7w/kCo0I+XhaB c6ZDWAhRj7TGzBIIupbz1HYtXKwhrv/jP9Wx1wGlxzSR3Hdex5GqTNXkTVfGTsq0qQhu 7DyGYd2i6aIl+wuiOsHTlDFV5ZoVh21EYRENhazuF/1+8AqmRAeEnkdbT9eOHG4d3j+o gHgQ== X-Gm-Message-State: AEkooutbv5kpwwVVO8g6Zzt68Cm2rUOoWpnpHUzYqkcwR8duDA9D6ECCIpcLAqOEAhwimQ== X-Received: by 10.107.200.212 with SMTP id y203mr24726324iof.187.1471886292425; Mon, 22 Aug 2016 10:18:12 -0700 (PDT) Received: from Kateleyco-iMac.local (c-50-188-36-30.hsd1.mn.comcast.net. [50.188.36.30]) by smtp.googlemail.com with ESMTPSA id o15sm11292323ith.2.2016.08.22.10.18.11 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Mon, 22 Aug 2016 10:18:11 -0700 (PDT) Reply-To: linda@kateley.com Subject: Re: Recommended HBA for ZFS, contemporary References: To: freebsd-fs@freebsd.org From: Linda Kateley Organization: Kateley Company Message-ID: Date: Mon, 22 Aug 2016 12:18:11 -0500 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.11; rv:45.0) Gecko/20100101 Thunderbird/45.2.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Aug 2016 17:18:13 -0000 On 8/22/16 11:30 AM, Dmitry Morozovsky wrote: > Karl, > > On Mon, 22 Aug 2016, Karl Denninger wrote: > >> I'm still a fan of the LSI SAS-9211 cards along with (for higher >> density) a SAS port expander. I've been extremely happy with this >> combination with one caveat -- most systems must boot from the actual >> card and not a port on the expander(s) you connect to it due to BIOS >> constraints. They're also crazily cost-effective on-balance. >> >> In practice this means you have 4 ports on the base card available (2 >> used for mirrored boot drives, 2 for other things) and the rest of the >> disks go on the expander, or you run more than one card. >> >> Whether you can actually saturate this combination depends on what you >> attach. In large configurations, especially those stuffed with SSDs, >> you can -- at which point something faster such as the 93xx series which > which immediately leads me to the question: what is the driver supporting 9300 > in HBA mode? Quick googling does not reveal interoperability, and 9300 is not > in hardware list for FreeBSD yet. The avago website has driver firmware combos for all of the different cards. The only ones that are troublesome are the onboard supermicro. I was told by an SE at avago that you need to go to supermicro for the oem firmware. ftp.supermicro.com > >> are materially faster (but still in "host" mode as opposed to any sort >> of "smart", "raid" or "buffered" mode) should be considered. >> >> The "smarter" the card the dumber the results tend to be when ZFS is in >> use, in my experience :) > Yes, I'm well aware of it ;) > > Thanks! > >