From owner-freebsd-fs@FreeBSD.ORG Mon Dec 15 21:12:09 2008 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 387581065672 for ; Mon, 15 Dec 2008 21:12:09 +0000 (UTC) (envelope-from bryanalves@gmail.com) Received: from wa-out-1112.google.com (wa-out-1112.google.com [209.85.146.183]) by mx1.freebsd.org (Postfix) with ESMTP id 068EC8FC1A for ; Mon, 15 Dec 2008 21:12:08 +0000 (UTC) (envelope-from bryanalves@gmail.com) Received: by wa-out-1112.google.com with SMTP id m34so1384203wag.27 for ; Mon, 15 Dec 2008 13:12:08 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type:references; bh=rHn9XaBRCsVcKttsN+JskJKAOxsxVdoFk2Odb9ClEF8=; b=puKoWMjwqNYtR/m/WqJWP5zXEHr4MDYjPq4eOACgBwcKOFz/UzYZor4WZgbbMljGLV gxfmFadWhYrLdYX4Q5vC6thhqT1XPxIBqt96RQtWIirxFia4vtIaWkms65eqfin47dmN Fajxg9siHr7YAy0U+r79hBi7vNMpmRQuI4GxQ= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:references; b=GlBHB50PNly7bJ+EwxD0Jw+IUZdhX9Quhe5tIIJ9sJXnB3a7XcVrq97zKrtpNriFPC UrOoRtkKMBJ6EeduhYlPwnQs7zXm1Q3Q16JXd3pLHJUzQicnFMegZ5IYlceCR3vxEJlJ LFm5oiDQUmWiuh4X+rG7VSbhZoRXeOoZ2Ob0Y= Received: by 10.115.94.1 with SMTP id w1mr5198491wal.177.1229375528568; Mon, 15 Dec 2008 13:12:08 -0800 (PST) Received: by 10.114.103.20 with HTTP; Mon, 15 Dec 2008 13:12:08 -0800 (PST) Message-ID: <92f477740812151312vccef91eu171062a50eb46ca1@mail.gmail.com> Date: Mon, 15 Dec 2008 16:12:08 -0500 From: "Bryan Alves" To: "Zaphod Beeblebrox" In-Reply-To: <5f67a8c40812151239o2b1f1f4cje7170cb1221133cd@mail.gmail.com> MIME-Version: 1.0 References: <92f477740812082155y3365bec7v5574206dd1a98e26@mail.gmail.com> <493E2AD2.8070704@jrv.org> <92f477740812090804k102dcb62qcd893b3263da56a9@mail.gmail.com> <5f67a8c40812151239o2b1f1f4cje7170cb1221133cd@mail.gmail.com> Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit Content-Disposition: inline X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS resize disk vdev X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Dec 2008 21:12:09 -0000 On Mon, Dec 15, 2008 at 3:39 PM, Zaphod Beeblebrox wrote: > On Tue, Dec 9, 2008 at 11:04 AM, Bryan Alves wrote: > >> On Tue, Dec 9, 2008 at 3:22 AM, James R. Van Artsdalen < >> james-freebsd-fs2@jrv.org> wrote: >> > > >> >> > I'm not sure how ZFS reacts to an existing disk drive suddenly becoming >> > larger. Real disk drives don't do that and ZFS is intended to use real >> > disks. There are some uberblocks (pool superblocks) at the end of the >> > disk and ZFS probably won't be able to find them if the uberblocks at >> > the front of the disk are clobbered and the "end of the disk" has moved >> > out away from the remaining uberblocks. >> > > Very well, in fact. In fact, one way to "grow" a RAID Z1 or Z2 pool is to > replace each disk with a larger one. When the last one is finished > resilvering, you will have more space. > > My reason for wanting to use my hardware controller isn't for speed, it's >> for the ability to migrate in place. I'm currently using 5 750GB drives, >> and I would like the flexibility to be able to purchase a 6th and grow my >> array by 750GB in place. If I could achieve something, anything, similar >> in >> ZFS (namely, buy an amount of disks smaller than the number of total disks >> in the array and see a gain in storage capacity), I would use ZFS. > > > You can't add one disk... but you can add several (easily). There are two > ways ZFS grows and both are well documented. > > The first is add another set of disks (at least 2 for mirroring, 3 for Z1 > and 4 for z2). ZFS recomends not more than 9 disks per RAID group anyways. > In my case, I have 6 750G drives in my array. They're pretty much full... > so I'm looking at adding another 6 1T drives shortly. This is transparent > and the "industry" would call this RAID50... that is two raid 5 (Z1) groups > striped together. > > The second way to add space is to replace disks with larger ones > (one-by-one). Lets say, down the road, that my disks are full again and 4T > disks are common and cheap. I replace each 750G disk with a 4T disk and let > things resilver. My array would have been 8.75 gig (3.75T from the 750's > and 5T from the 1T drives) and it would suddenly be 25T (20 from the 4T > drives and 5T from the 1T drives). This increase in space occurs when the > last drive is resilvered. > > This last step is good because at some point drives are not worth the power > to run. I turned off my array of 18G SCSI drives a couple of years ago --- > it wasn't worth the power. In the ZFS realm... instead of transferring the > data and turning off the system, you upgrade. > In the case of option one, after this stripe of 2 raidz's is created though, those old drives can't be pulled from the array can they? More specifically, after we "upgrade" to what would be termed Raid50, we can't "downgrade" back to Raid5, right?