From owner-freebsd-questions@FreeBSD.ORG Thu Oct 20 03:24:58 2011 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0AEE6106564A for ; Thu, 20 Oct 2011 03:24:58 +0000 (UTC) (envelope-from freebsd@penx.com) Received: from Elmer.dco.penx.com (elmer.dco.penx.com [174.46.214.165]) by mx1.freebsd.org (Postfix) with ESMTP id B83618FC0A for ; Thu, 20 Oct 2011 03:24:57 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by Elmer.dco.penx.com (8.14.5/8.14.4) with ESMTP id p9K3OrrM079163 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Wed, 19 Oct 2011 21:24:55 -0600 (MDT) (envelope-from freebsd@penx.com) Date: Wed, 19 Oct 2011 21:24:53 -0600 (MDT) From: Dennis Glatting X-X-Sender: dennisg@Elmer.dco.penx.com To: "Fajar A. Nugraha" In-Reply-To: Message-ID: References: <20111019141443.GQ4592@pcjas.obspm.fr> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: Albert Shih , zfs-discuss@opensolaris.org, freebsd-questions@freebsd.org Subject: Re: [zfs-discuss] ZFS on Dell with FreeBSD X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 20 Oct 2011 03:24:58 -0000 On Thu, 20 Oct 2011, Fajar A. Nugraha wrote: > On Thu, Oct 20, 2011 at 7:56 AM, Dave Pooser wrote: >> On 10/19/11 9:14 AM, "Albert Shih" wrote: >> >>> When we buy a MD1200 we need a RAID PERC H800 card on the server >> >> No, you need a card that includes 2 external x4 SFF8088 SAS connectors. >> I'd recommend an LSI SAS 9200-8e HBA flashed with the IT firmware-- then >> it presents the individual disks and ZFS can handle redundancy and >> recovery. > > Exactly, thanks for suggesting an exact controller model that can > present disks as JBOD. > > With hardware RAID, you'd pretty much rely on the controller to behave > nicely, which is why I suggested to simply create one big volume for zfs > to use (so you pretty much only use features like snapshot, clones, etc, > but don't use zfs self healing feature). Again, others might (and have) > disagree and suggest using volumes for individual disk (even when you're > still relying on hardware RAID controller). But ultimately there's no > question that the best possible setup would be to present the disks as > JBOD and let zfs handle it directly. > I saw something interesting and different today, which I'll just throw out. A buddy has a HP370 loaded with disks (not the only machine that provides these services, rather the one he was showing off). The 370's disks are managed by the underlying hardware RAID controller, which he built as multiple RAID1 volumes. ESXi 5.0 is loaded and in control of the volumes, some of which are partitioned. Consequently, his result is vendor supported interfaces between disks, RAID controller, ESXi, and managing/reporting software. The HP370 has multiple FreeNAS instances whose "disks" are the "disks" (volumes/partitions) from ESXi (all on the same physical hardware). The FreeNAS instances are partitioned according to their physical and logical function within the infrastructure, whether by physical or logical connections. The FreeNAS instances then serves its "disks" to consumers. We have not done any performance testing. Generally, his NAS consumers are not I/O pigs though we want the best performance possible (some consumers are over the WAN resulting in any HP/ESXi/FreeNAS performance issues possibly moot). (I want to do some performance testing because, well, it may have significant amusement value.) A question we have is whether ZFS (ARC, maybe L2ARC) within FreeNAS is possible or would provide any value.