From owner-freebsd-isp@FreeBSD.ORG Tue Sep 2 10:54:28 2003 Return-Path: Delivered-To: freebsd-isp@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 476A216A4BF for ; Tue, 2 Sep 2003 10:54:28 -0700 (PDT) Received: from Chow.corp.media.net (rottie.media.net [66.113.65.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id 9437543FE1 for ; Tue, 2 Sep 2003 10:54:27 -0700 (PDT) (envelope-from max.clark@media.net) Received: from MCLARK (76.0.6.10.IN-ADDR.ARPA [10.6.0.76]) by Chow.corp.media.net (Netscape Messaging Server 4.15) with SMTP id HKLLIV00.33M for ; Tue, 2 Sep 2003 10:49:43 -0700 From: "Max Clark" To: Date: Tue, 2 Sep 2003 11:00:13 -0700 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2911.0) Importance: Normal X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2800.1165 Subject: 20TB Storage System X-BeenThere: freebsd-isp@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Internet Services Providers List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 02 Sep 2003 17:54:28 -0000 Hi all, I need to attach 20TB of storage to a network (as low cost as possible), I need to sustain 250Mbit/s or 30MByte/s of sustained IO from the storage to the disk. I have found external Fibre Channel -> ATA 133 Raid enclosures. These enclosures will house 16 drives so with 250GB drives a total of 3.5TB each after a RAID 5 format. These enclosures have advertised sustained IO of 90-100MByte/s each. One solution we are thinking about is to use a Intel XEON server with 3x FC HBA controller cards in the server each attached to a separate storage enclosure. In any event we would be required to use ccd or vinum to stripe multiple storage enclosures together to form one logical volume. I can partition this system into two separate 10TB storage pools. Given the above: 1) What would my expected IO be using vinum to stripe the storage enclosures detailed above? 2) What is the maximum size of a filesystem that I can present to the host OS using vinum/ccd? Am I limited anywhere that I am not aware of? 3) Could I put all 20TB on one system, or will I need two to sustain the IO required? 4) If you were building this system how would you do it? (The installed $/GB must be below $5.00 dollars). My other options are to use Solaris or Windows (which I would rather not do). Thanks in advance, Max