From owner-freebsd-questions@FreeBSD.ORG Mon Jan 5 04:39:55 2009 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A33E1106566B for ; Mon, 5 Jan 2009 04:39:55 +0000 (UTC) (envelope-from richardsc@gmail.com) Received: from yx-out-2324.google.com (yx-out-2324.google.com [74.125.44.29]) by mx1.freebsd.org (Postfix) with ESMTP id 50D1E8FC1E for ; Mon, 5 Jan 2009 04:39:55 +0000 (UTC) (envelope-from richardsc@gmail.com) Received: by yx-out-2324.google.com with SMTP id 8so3159857yxb.13 for ; Sun, 04 Jan 2009 20:39:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:cc:message-id:from:to :in-reply-to:content-type:content-transfer-encoding:mime-version :subject:date:references:x-mailer; bh=AnmVsBqcI6Pfm29gWEPZ9XryKdO7IlrLav35mniEFVQ=; b=uiZWw6C0QbHL1EIa8XHHxYr3O66NV1GrhwX3vnrDyzsa6xZDWfGxqsbYK7ZH2c1tXj dtDi1+kGobOVmWO3Rpm5PwuSxkr8XOf6CBwrPuGf3LjEn99gMCq1KMMSJElJ5BLBrEQR YJXosMYE56b7dOuxFT6eP8zIv+WtAyKNZvvfA= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=cc:message-id:from:to:in-reply-to:content-type :content-transfer-encoding:mime-version:subject:date:references :x-mailer; b=A3Uc0gpoMS+p6hKDgv7KJeEJpEe/inUDO8j9fZAOdCFY+Gkz7dhaL5xcOG7fPbC7zd 16AgNIQRXwkZ4mLJf2QTnPAz2HaNvXOPEoMAxO9+iaPcpHp70uno/6y8oBM63fpIuxS2 cqu/m438osGgbjrNbzlRWdnHXfK9hsBMuSlxM= Received: by 10.64.151.10 with SMTP id y10mr15543593qbd.95.1231130393844; Sun, 04 Jan 2009 20:39:53 -0800 (PST) Received: from ?72.18.142.201? ([72.18.142.201]) by mx.google.com with ESMTPS id p27sm31879686qbp.32.2009.01.04.20.39.52 (version=TLSv1/SSLv3 cipher=RC4-MD5); Sun, 04 Jan 2009 20:39:53 -0800 (PST) Message-Id: <39EE5CBD-5640-47E3-88FA-EEC77A8002CA@gmail.com> From: Charles Richards To: Frederique Rijsdijk In-Reply-To: <495F57E5.7040905@isafeelin.org> Content-Type: text/plain; charset=US-ASCII; format=flowed; delsp=yes Content-Transfer-Encoding: 7bit Mime-Version: 1.0 (Apple Message framework v926) Date: Sun, 4 Jan 2009 21:39:50 -0700 References: <495E17AD.30707@isafeelin.org> <20090102160727.A38841@wojtek.tensor.gdynia.pl> <495F2919.6040103@isafeelin.org> <495F57E5.7040905@isafeelin.org> X-Mailer: Apple Mail (2.926) Cc: freebsd-questions@freebsd.org Subject: Re: Using HDD's for ZFS: 'desktop' vs 'raid / enterprise' -edition drives? X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jan 2009 04:39:55 -0000 Just FWIW, the "proper" way to do "online expansion" with ZFS is quite different than that of a RAID controller, as doing a regular OCE process is quite difficult in ZFS (due to the variable-size stripes that ZFS uses, which makes the simple expansion of regular RAID-5 or RAID-6 not workable - or so I've read on the ZFS mailing lists) The way that I believe you can add capacity to an existing RAIDZ / RAIDZ2 is as follows: (this is based directly off of their documentation: http://docs.sun.com/app/docs/doc/819-5461/gcvjg?a=view) Your ZFS "pool" is made up of "vdevs", which are in turn made up of raw disks / partitions / unicorns, other block devices. To increase the capacity of your existing pool, you simply add another "vdev" to it, and ZFS will intelligently start distributing the data between the two vdevs. The example, straight from their documentation (with some commentary from me) is an existing ZFS pool named "rpool", which as 3 disks and is in a RAIDZ configuration # zpool status pool: rpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 c1t4d0 ONLINE 0 0 0 errors: No known data errors Now, we want to add three *new* disks to the storage pool - to do this, we simply add a new RAIDZ device comprised of our three new disks into the existing pool: # zpool add rpool raidz c2t2d0 c2t3d0 c2t4d0 # zpool status pool: rpool state: ONLINE scrub: none requested config: NAME STATE READ WRITE CKSUM rpool ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c1t2d0 ONLINE 0 0 0 c1t3d0 ONLINE 0 0 0 c1t4d0 ONLINE 0 0 0 raidz1 ONLINE 0 0 0 c2t2d0 ONLINE 0 0 0 c2t3d0 ONLINE 0 0 0 c2t4d0 ONLINE 0 0 0 errors: No known data errors If you're looking for more info on ZFS, I suggest looking at the Sun ZFS administration guide: http://docs.sun.com/app/docs/doc/819-5461/gavwn?a=browse Particularly, the section #5, on ZFS Storage Pools: http://docs.sun.com/app/docs/doc/819-5461/gavwn?a=view Charles Richards richardsc@gmail.com charlesrichards.net On Jan 3, 2009, at 5:19 AM, Frederique Rijsdijk wrote: > After some reading, I come back from my original idea. Main reason > is I'd like to be able to grow the fs as the need develops in time. > > One could create a raidz zpool with a couple of disks, but when > adding a disk later on, it will not become part of the raidz (I > tested this). > > It seems vdevs can not be nested (create raidz sets and join them as > a whole), so I came up with the following: > > Start out with 4*1TB, and use geom_raid5 to create an independent > redundant pool of storage: > > 'graid5 label -v graid5a da0 da1 da2 da3' (this is all tested in > vmware, one of these 'da' drives is 8GB) > > Then I 'zpool create bigvol /dev/raid5/graid5a', and I have a / > bigvol of 24G - sounds about right to me for a raid5 volume. > > Now lets say later in time I need more storage, I buy another 4 of > these drives, and > > 'graid5 label -v graid5b da4 da5 da6 da7' > and > 'zpool add bigvol /dev/raid5/graid5b' > > Now my bigvol is 48G. Very cool! Now I have redundant storage that > can grow and it's pretty easy too. > > Is this OK (besides from the fact that graid5 is not in production > yet, nor is ZFS ;) or are there easier (or better) ways to do this? > > - So I want redundancy (I don't want one failing drive to cause me > to loose all my data) > - I want to be able to grow the filesystem if I need to, by adding a > (set of) drive(s) later on. > > > > -- FR > _______________________________________________ > freebsd-questions@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-questions > To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org > "