From owner-freebsd-fs@FreeBSD.ORG Mon Dec 15 20:39:42 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 146701065679 for ; Mon, 15 Dec 2008 20:39:42 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: from mail-gx0-f10.google.com (mail-gx0-f10.google.com [209.85.217.10]) by mx1.freebsd.org (Postfix) with ESMTP id 701A28FC14 for ; Mon, 15 Dec 2008 20:39:41 +0000 (UTC) (envelope-from zbeeble@gmail.com) Received: by gxk3 with SMTP id 3so2285251gxk.12 for ; Mon, 15 Dec 2008 12:39:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=d3jxlC3/OvT1M3VFwkEK2zuHF1f6fO65yKmpRLpIHYs=; b=HsaJ+/bW0s4c/ven3odI7Kn/C4V2o1x1+lbW84xPQcDwNOMPxZ9lswFHGcrUd32mmY A05dL3PIKRTqWQovdCtRdsI7gTk5nvyHfi5h5oxz6FwZBL9afW3j/GgWVpgrsxtZeThg kC6kE1axc+kzy6MmErtYJ6ajR8nRpT851i+l0= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=nziRhlfH/IzLTEg8yrUqtYK5ZZ27+BRzx6ndnBs+GvL/1fLwYXQDebdCif7YjIUr3p r/jhfFXsk6ozt6YiaMFIu81QeZtsDivZa8cACgGq6mgMZNQr5brCDAJ6q4BJwQdWC/vY NgaeSh/d19k4yEeNWXRAQoZGm5X3bZeMa1B3w= Received: by 10.150.177.20 with SMTP id z20mr13247463ybe.193.1229373580513; Mon, 15 Dec 2008 12:39:40 -0800 (PST) Received: by 10.151.130.10 with HTTP; Mon, 15 Dec 2008 12:39:40 -0800 (PST) Message-ID: <5f67a8c40812151239o2b1f1f4cje7170cb1221133cd@mail.gmail.com> Date: Mon, 15 Dec 2008 15:39:40 -0500 From: "Zaphod Beeblebrox" To: "Bryan Alves" In-Reply-To: <92f477740812090804k102dcb62qcd893b3263da56a9@mail.gmail.com> MIME-Version: 1.0 References: <92f477740812082155y3365bec7v5574206dd1a98e26@mail.gmail.com> <493E2AD2.8070704@jrv.org> <92f477740812090804k102dcb62qcd893b3263da56a9@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS resize disk vdev X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Dec 2008 20:39:42 -0000 On Tue, Dec 9, 2008 at 11:04 AM, Bryan Alves wrote: > On Tue, Dec 9, 2008 at 3:22 AM, James R. Van Artsdalen < > james-freebsd-fs2@jrv.org> wrote: > > > > I'm not sure how ZFS reacts to an existing disk drive suddenly becoming > > larger. Real disk drives don't do that and ZFS is intended to use real > > disks. There are some uberblocks (pool superblocks) at the end of the > > disk and ZFS probably won't be able to find them if the uberblocks at > > the front of the disk are clobbered and the "end of the disk" has moved > > out away from the remaining uberblocks. > Very well, in fact. In fact, one way to "grow" a RAID Z1 or Z2 pool is to replace each disk with a larger one. When the last one is finished resilvering, you will have more space. My reason for wanting to use my hardware controller isn't for speed, it's > for the ability to migrate in place. I'm currently using 5 750GB drives, > and I would like the flexibility to be able to purchase a 6th and grow my > array by 750GB in place. If I could achieve something, anything, similar > in > ZFS (namely, buy an amount of disks smaller than the number of total disks > in the array and see a gain in storage capacity), I would use ZFS. You can't add one disk... but you can add several (easily). There are two ways ZFS grows and both are well documented. The first is add another set of disks (at least 2 for mirroring, 3 for Z1 and 4 for z2). ZFS recomends not more than 9 disks per RAID group anyways. In my case, I have 6 750G drives in my array. They're pretty much full... so I'm looking at adding another 6 1T drives shortly. This is transparent and the "industry" would call this RAID50... that is two raid 5 (Z1) groups striped together. The second way to add space is to replace disks with larger ones (one-by-one). Lets say, down the road, that my disks are full again and 4T disks are common and cheap. I replace each 750G disk with a 4T disk and let things resilver. My array would have been 8.75 gig (3.75T from the 750's and 5T from the 1T drives) and it would suddenly be 25T (20 from the 4T drives and 5T from the 1T drives). This increase in space occurs when the last drive is resilvered. This last step is good because at some point drives are not worth the power to run. I turned off my array of 18G SCSI drives a couple of years ago --- it wasn't worth the power. In the ZFS realm... instead of transferring the data and turning off the system, you upgrade.