From owner-freebsd-questions@FreeBSD.ORG Thu May 31 16:12:55 2012 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 79CE31065672 for ; Thu, 31 May 2012 16:12:55 +0000 (UTC) (envelope-from kayasaman@gmail.com) Received: from mail-qa0-f47.google.com (mail-qa0-f47.google.com [209.85.216.47]) by mx1.freebsd.org (Postfix) with ESMTP id 321E68FC15 for ; Thu, 31 May 2012 16:12:55 +0000 (UTC) Received: by qabg1 with SMTP id g1so3045169qab.13 for ; Thu, 31 May 2012 09:12:54 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type:content-transfer-encoding; bh=ry1NsVHAGow+Bqy56PRpuvV4RtJp65tnSowf+pvXj+U=; b=fJLQ3dE+8D/YUgyPsKP7H2kHZ2b/HBrgzDr5EScpicweTvIgxmF3dQj8uUCv+qdUOG JTI7g0aaCIMTZDPWwKVfnEU6AoHWjeTUw77Kv8eNLTJmWgCz/cOzEAryg9LHg8syl2xE AHzN89gUoXP6DbqO1RnZmaJwwYco0sHxke0KcFuCMZNM2kjgUAusH8TjhfyhEDJH0/lQ n1bbEJZD9fGesWDan2oAJEGg1MDU+7kBP827Hrzd7MjI3qWgwoJTLK2mhlP0SUp6h5sb xlWcdxQ/UWIG+7MhCPNtXBvE5lN0L5IF8I91HIgmAMRPAK246JZ5rImwDbQsplXlT5NL vhPA== MIME-Version: 1.0 Received: by 10.229.135.130 with SMTP id n2mr1176589qct.124.1338480774471; Thu, 31 May 2012 09:12:54 -0700 (PDT) Received: by 10.229.26.136 with HTTP; Thu, 31 May 2012 09:12:54 -0700 (PDT) In-Reply-To: References: Date: Thu, 31 May 2012 17:12:54 +0100 Message-ID: From: Kaya Saman To: Oscar Hodgson Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-questions@freebsd.org Subject: Re: Anyone using freebsd ZFS for large storage servers? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 31 May 2012 16:12:55 -0000 On Thu, May 31, 2012 at 5:05 PM, Oscar Hodgson wr= ote: > That helps. =A0Thank you. > > This is an academic departmental instructional / research environment. > =A0We had a great relationship with Sun, they provided great > opportunities to put Solaris in front of students. =A0Oracle, not so > much, and the Oracle single-tier support model simply isn't affordable > for this "business" (there's no ROI at the departmental level ). > Solaris is not a viable option. We found Oracle to be the cheapest out of all the solutions we looked at: Netapp, MSI, et el..... > > FreeBSD looks like the next best available option at the moment, > particularly considering the use of the storage heads as compute > machines. =A0OpenIndiana shows promise. =A0Nexenta has a great product, > but the user community expects more flexibility in software options. FreeBSD is better then Linux in my opinion though lacking some software and multimedia functionality that Linux has and not for the Desktop as it's not as "bleeding edge" as say Fedora 16, however, if FreeBSD offered Gnome3 and supported my wireless NIC I'd be all over it like a "bad rash" :-) > > Is there anything like a list of "supported" (known good) SAS HBA's? LSI HBA's are really good! For my DIY solution at home I used a SuperMicro system board with non-RAID LSI HBA....... It is a similar solution that we will use for our test NAS at work though we already have a Dell R700 series server. For this setup however I will need to use an LSI HBA with both internal and external Mini-SAS ports. Instead of Promise we will use NetStor JBOD solutions as they work with 6Gbps drives and overall give better performance. > > Oscar Regards, Kaya > > On Thu, May 31, 2012 at 11:38 AM, Kaya Saman wrote: >> If this is any consellation I run a 36TB cluster using a self built >> server with a Promise DAS (VessJBOD 1840) using ZFS at home! to >> support my OpenSource projects and personal files. >> >> As for OS take your pick: NexentaStor, FreeBSD, Solaris 11 >> >> >> All capable, of course Solaris has latest version of ZFS but still..... >> >> >> At work we're looking into getting a StorEdge appliance wich will >> handle up to 140+ TB. >> >> >> I am also in charge of redesigning one of our virtual SAN's to a >> FreeBSD ZFS storage system which will run.... well how many JBOD's can >> you fit on the system?? Probably round ~100TB or so..... >> >> >> Regards, >> >> >> Kaya >> >> >> On Thu, May 31, 2012 at 4:32 PM, Oscar Hodgson = wrote: >>> The subject is pretty much the question. =A0Perhaps there's a better >>> place to be asking this question ... >>> >>> We have (very briefly) discussed the possibility of using FreeBSD >>> pizza boxes as a storage heads direct attached to external JBOD arrays >>> with ZFS. =A0In perusing the list, I haven't stumbled across indication= s >>> of people actually doing this. =A0External JBODs would be running 24 to >>> 48TB each, roughly. =A0There would be a couple of units. =A0The pizza >>> boxes would be used for computational tasks, and nominally would have >>> 8 cores and 96G+ RAM. >>> >>> Obvious questions are hardware compatibility and stability. =A0I've set >>> up small FreeBSD 9 machines with ZFS roots and simple mirrors for >>> other tasks here, and those have been successful so far. >>> >>> Observations would be appreciated. >>> >>> Oscar. >>> _______________________________________________ >>> freebsd-questions@freebsd.org mailing list >>> http://lists.freebsd.org/mailman/listinfo/freebsd-questions >>> To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd= .org"