From owner-freebsd-stable@FreeBSD.ORG Sun Feb 14 23:10:52 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 6AA9F106566B for ; Sun, 14 Feb 2010 23:10:52 +0000 (UTC) (envelope-from dan.naumov@gmail.com) Received: from mail-yx0-f191.google.com (mail-yx0-f191.google.com [209.85.210.191]) by mx1.freebsd.org (Postfix) with ESMTP id 1D8A98FC0C for ; Sun, 14 Feb 2010 23:10:51 +0000 (UTC) Received: by yxe29 with SMTP id 29so3512166yxe.14 for ; Sun, 14 Feb 2010 15:10:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=iQPo6kRs4KnRa+qTiVj7DW8vSiFmnCjMBzQANZoX6C4=; b=MlasVk3J2Z3j5R93Gx2L3l5TxHbZmk13W8F0TfL9UFrmr7/7mOpX8vG2o9pq5q0h5Y wTMbPdBlotD+wRFdlak/3gvdKzbP+ULENQXpoBFUX+egAZi3EeE6bJKGoFqbvTDFZ/Wr rp/a6ux3etM6O8E+C96VB+jkEGEFfX6MN3+xg= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type:content-transfer-encoding; b=TEKnC/F76G5tsujWTjdAsoqwo9djXhWLtuv1JQ3ihMQ6uG/5WAqygJom4lZNZAfEA4 G8zu5n6Vgwy9WRwybu5nZd9IpfKJRvgtUZSZPrFRdQsWteJC5BOntUoay7asaIAzASp+ vZkn7QMhJtHu4Za8xC65majbi0Y0scn87pRB4= MIME-Version: 1.0 Received: by 10.150.8.10 with SMTP id 10mr8281020ybh.125.1266189049949; Sun, 14 Feb 2010 15:10:49 -0800 (PST) In-Reply-To: References: <4B786D3A.3000408@langille.org> Date: Mon, 15 Feb 2010 01:10:49 +0200 Message-ID: From: Dan Naumov To: FreeBSD-STABLE Mailing List , dan@langille.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Subject: Re: hardware for home use large storage X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 14 Feb 2010 23:10:52 -0000 On Mon, Feb 15, 2010 at 12:42 AM, Dan Naumov wrote: > On Sun, Feb 14, 2010 at 11:38 PM, Dan Langille wrote: >> Dan Naumov wrote: >>>> >>>> On Sun, 14 Feb 2010, Dan Langille wrote: >>>>> >>>>> After creating three different system configurations (Athena, >>>>> Supermicro, and HP), my configuration of choice is this Supermicro >>>>> setup: >>>>> >>>>> =A0 =A01. Samsung SATA CD/DVD Burner $20 (+ $8 shipping) >>>>> =A0 =A02. SuperMicro 5046A $750 (+$43 shipping) >>>>> =A0 =A03. LSI SAS 3081E-R $235 >>>>> =A0 =A04. SATA cables $60 >>>>> =A0 =A05. Crucial 3=D72G ECC DDR3-1333 $191 (+ $6 shipping) >>>>> =A0 =A06. Xeon W3520 $310 >>> >>> You do realise how much of a massive overkill this is and how much you >>> are overspending? >> >> >> I appreciate the comments and feedback. =A0I'd also appreciate alternati= ve >> suggestions in addition to what you have contributed so far. =A0Spec out= the >> box you would build. > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Case: Fractal Design Define R2 - 89 euro: > http://www.fractal-design.com/?view=3Dproduct&prod=3D32 > > Mobo/CPU: Supermicro X7SPA-H / Atom D510 - 180-220 euro: > http://www.supermicro.com/products/motherboard/ATOM/ICH9/X7SPA.cfm?typ=3D= H > > PSU: Corsair 400CX 80+ - 59 euro: > http://www.corsair.com/products/cx/default.aspx > > RAM: Corsair 2x2GB, DDR2 800MHz SO-DIMM, CL5 - 85 euro > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > Total: ~435 euro > > The motherboard has 6 native AHCI-capable ports on ICH9R controller > and you have a PCI-E slot free if you want to add an additional > controller card. Feel free to blow the money you've saved on crazy > fast SATA disks and if your system workload is going to have a lot of > random reads, then spend 200 euro on a 80gb Intel X25-M for use as a > dedicated L2ARC device for your pool. And to expand a bit, if you want that crazy performance without blowing silly amounts of money: Get a dock for holding 2 x 2,5" disks in a single 5,25" slot and put it at the top, in the only 5,25" bay of the case. Now add an additional PCI-E SATA controller card, like the often mentioned PCIE SIL3124. Now you have 2 x 2,5" disk slots and 8 x 3,5" disk slots, with 6 native SATA ports on the motherboard and more ports on the controller card. Now get 2 x 80gb Intel SSDs and put them into the dock. Now partition each of them in the following fashion: 1: swap: 4-5gb 2: freebsd-zfs: ~10-15gb for root filesystem 3: freebsd-zfs: rest of the disk: dedicated L2ARC vdev GMirror your SSD swap partitions. Make a ZFS mirror pool out of your SSD root filesystem partitions Build your big ZFS pool however you like out of the mechanical disks you ha= ve. Add the 2 x ~60gb partitions as dedicated independant L2ARC devices for your SATA disk ZFS pool. Now you have redundant swap, redundant and FAST root filesystem and your ZFS pool of SATA disks has 120gb worth of L2ARC space on the SSDs. The L2ARC vdevs dont need to be redundant, because should an IO error occur while reading off L2ARC, the IO is deferred to the "real" data location on the pool of your SATA disks. You can also remove your L2ARC vdevs from your pool at will, on a live pool. - Sincerely, Dan Naumov