From owner-freebsd-fs@FreeBSD.ORG Mon Sep 19 18:52:21 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 013011065672 for ; Mon, 19 Sep 2011 18:52:21 +0000 (UTC) (envelope-from jusher71@yahoo.com) Received: from nm34-vm2.bullet.mail.ne1.yahoo.com (nm34-vm2.bullet.mail.ne1.yahoo.com [98.138.229.82]) by mx1.freebsd.org (Postfix) with SMTP id A204B8FC16 for ; Mon, 19 Sep 2011 18:52:20 +0000 (UTC) Received: from [98.138.90.51] by nm34.bullet.mail.ne1.yahoo.com with NNFMP; 19 Sep 2011 18:52:20 -0000 Received: from [98.138.89.233] by tm4.bullet.mail.ne1.yahoo.com with NNFMP; 19 Sep 2011 18:52:20 -0000 Received: from [127.0.0.1] by omp1048.mail.ne1.yahoo.com with NNFMP; 19 Sep 2011 18:52:20 -0000 X-Yahoo-Newman-Property: ymail-3 X-Yahoo-Newman-Id: 44129.21879.bm@omp1048.mail.ne1.yahoo.com Received: (qmail 94627 invoked by uid 60001); 19 Sep 2011 18:52:20 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1316458339; bh=CXIRTo1wBLXJpnMu23lUQQPu+VS9vR2ou63Q2rID/N8=; h=X-YMail-OSG:Received:X-Mailer:Message-ID:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=yyI9YFYVknCQ6ZOV8B6wqD1/Hah4xh7Kpx6bkl/y1NlO3u27O/nhxIigus0Hjd1T7LKw6k8Z4WRJYfIXT2BA5btTdcYflUgv1SQa4mqkCaJjfT92tDYA5ZPKR2DEZswyHxlWzqllIOWZDT3/7+haYTAx99xL4TYW1DaTMNjFzzI= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:X-Mailer:Message-ID:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type; b=LnQN25y9T4OulwlvmykkiUNs0Fu+hsVzUHnuJQwWrcW6BBJnP0zfKzZ46uxsefV22TSVdmHdHBB4FKePpVrGXfMSDuK5ZywFlZqVzYrvNa6KyO8NwXN+nb1etFkFVcCHcg3MzveidiwoOXTMGiuZZRszuHE6penyhdhBRmcdNDM=; X-YMail-OSG: OTLAMU4VM1npm7FBweMWiD_p1d71jmriRYeoXE2Op.mxIU0 em1Um8s8RhW7s4BY3mrzYa0Wcjn67hXmhBEbb7bWGEB4LlrwY31qRYp8h4QJ _O8eZi.OoLgahveR1JUbmkE9S8DqE7pyQ1d0uopdeZyk2WiPlQBeGYEDHNRt Ob0VPTx81t_yEPsKtDtup9a1rnQFeMony.MA8rtceUs.bsAvGZ2Z.SS.MnAZ kUOxsYObnIBv4Oa3DawTpzXQxCD.rp0LT1HnKHM7ag0aFowZvl3wJwHmd.9h F80GnUei0OZG.W4MHhLG5A4OU4BSLn89XsXaZMsTthzDX7SRZMBJ3MzbIsmt YDVh3Y5r_NHqUx8HFok73Jj10vvkl8qydBCWBMoPyBQiVXdfMwuFfs8KZMMi 0KWk- Received: from [80.237.226.76] by web121216.mail.ne1.yahoo.com via HTTP; Mon, 19 Sep 2011 11:52:19 PDT X-Mailer: YahooMailClassic/14.0.5 YahooMailWebService/0.8.114.317681 Message-ID: <1316458339.73301.YahooMailClassic@web121216.mail.ne1.yahoo.com> Date: Mon, 19 Sep 2011 11:52:19 -0700 (PDT) From: Jason Usher To: freebsd-fs@freebsd.org In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Subject: Re: ZFS obn FreeBSD hardware model for 48 or 96 sata3 paths... X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 19 Sep 2011 18:52:21 -0000 --- On Fri, 9/16/11, Rich wrote: > To get full bandwidth SATA 3 from 48/96 drives, that's 750 > MB/s * 8/10 > (8 data bytes per 10 bytes transmitted raw - SATA 3 does an > 8b10b > encoding) ~ 600 MB/s * 48/96 = 28800/57600 MB/s > > PCIe 2.x is 500 MB/s per lane, so that's 57/114 lanes of > PCIe 2.x to > do full bandwidth. > > And that all assumes you have sufficient memory bandwidth > anyway. But does that exist ? I do not see any motherboards with even 64 lanes of pcie 2.0, much less 128 of them ... I'm seeing 32 @ pcie2.0 ... I guess 7 slots @ 16x would be 112 lanes, yes ? I just don't see a board like that in existence...