From owner-freebsd-fs@FreeBSD.ORG  Sat Sep 17 05:45:51 2011
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 4609A106564A
	for <freebsd-fs@freebsd.org>; Sat, 17 Sep 2011 05:45:51 +0000 (UTC)
	(envelope-from rincebrain@gmail.com)
Received: from mail-qy0-f182.google.com (mail-qy0-f182.google.com
	[209.85.216.182])
	by mx1.freebsd.org (Postfix) with ESMTP id E20358FC16
	for <freebsd-fs@freebsd.org>; Sat, 17 Sep 2011 05:45:50 +0000 (UTC)
Received: by qyk4 with SMTP id 4so5029218qyk.13
	for <multiple recipients>; Fri, 16 Sep 2011 22:45:50 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=mime-version:in-reply-to:references:date:message-id:subject:from:to
	:cc:content-type;
	bh=sNEKOnFzZCEpFBNnY6Hcdr0dpVlKmDtzQO92khhxyLI=;
	b=gIezBUN8DtByTbA68HNusfUFRPNPXomqPOWtNUBEBMB6idhfjll6I+GQ8Q5FiCdu2K
	hQPeQH6Iq51/XKms8Vf6TJzSUJIyj5CbWSMMpUOIFzHdPPbwGWzV1kRhRk/W4mmKlmkF
	86IJMfdLULaJJeW9CLKbgwzQ2mw5JOjqdA/jo=
MIME-Version: 1.0
Received: by 10.229.224.149 with SMTP id io21mr151467qcb.81.1316238350061;
	Fri, 16 Sep 2011 22:45:50 -0700 (PDT)
Received: by 10.229.168.132 with HTTP; Fri, 16 Sep 2011 22:45:50 -0700 (PDT)
In-Reply-To: <4E742E5C.2010900@freebsd.org>
References: <1316222526.31565.YahooMailNeo@web121205.mail.ne1.yahoo.com>
	<CAHcKe7kfdirJL-vPw=pnFvtzo7ZouDQNPkLVbKs_s35Amz40NQ@mail.gmail.com>
	<4E742E5C.2010900@freebsd.org>
Date: Sat, 17 Sep 2011 01:45:50 -0400
Message-ID: <CAOeNLuprLpbMppZ_Wd47Ph_VDXbaEUd2r+1Fs+1XcJfx_AcNnw@mail.gmail.com>
From: Rich <rincebrain@gmail.com>
To: Julian Elischer <julian@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Cc: Jason Usher <jusher71@yahoo.com>,
	"freebsd-fs@freebsd.org" <freebsd-fs@freebsd.org>
Subject: Re: ZFS obn FreeBSD hardware model for 48 or 96 sata3 paths...
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 17 Sep 2011 05:45:51 -0000

The 9201-16e or similar would do fine for 6 Gbit SAS rates if you
don't want hardware RAID.

To get full bandwidth SATA 3 from 48/96 drives, that's 750 MB/s * 8/10
(8 data bytes per 10 bytes transmitted raw - SATA 3 does an 8b10b
encoding) ~ 600 MB/s * 48/96 = 28800/57600 MB/s

PCIe 2.x is 500 MB/s per lane, so that's 57/114 lanes of PCIe 2.x to
do full bandwidth.

And that all assumes you have sufficient memory bandwidth anyway.

- Rich