From owner-freebsd-fs@freebsd.org Mon Jan 11 11:18:01 2016 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 95D7CA6B7FF for ; Mon, 11 Jan 2016 11:18:01 +0000 (UTC) (envelope-from octavianh@gmail.com) Received: from mail-qg0-x22a.google.com (mail-qg0-x22a.google.com [IPv6:2607:f8b0:400d:c04::22a]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5A0261A20 for ; Mon, 11 Jan 2016 11:18:01 +0000 (UTC) (envelope-from octavianh@gmail.com) Received: by mail-qg0-x22a.google.com with SMTP id b35so269715806qge.0 for ; Mon, 11 Jan 2016 03:18:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=rILZ2mg8JdMNHWGoLdZGyok329CfK+vWGsrzo94u2UU=; b=Hjczu7KAFaMXrEmD3/SC0vjSqmYYx/3cyL1zUd8gyTak94BZHEo59dfXymG8YTu0vn kTCtkuFo/Hbi5jK4reLww4/ZKXUKdiIhBllUSEcDneoOqANgTjjuZ0ZquHCaKhtKJrWR TJVdnl7TccKPwHAhWdiBr/m97JOo98swcJ51tDucNw/fWVRwITnY/Jtrm1b+C/eC/yal Duf8xve3p1UcY5gG/nRGwUavbymhUYHe5omNi6SJLPqRoDIACW1bVnbUyafbFFhZ+OI/ 6WVhwI3kdzaxNSOh9PqsAaiyuyMsGCHgigYpsftUholKGEGSvVUOqsWRKDqL09xrnGN1 /SOQ== MIME-Version: 1.0 X-Received: by 10.140.220.207 with SMTP id q198mr34346158qhb.24.1452511080449; Mon, 11 Jan 2016 03:18:00 -0800 (PST) Received: by 10.140.81.16 with HTTP; Mon, 11 Jan 2016 03:18:00 -0800 (PST) Received: by 10.140.81.16 with HTTP; Mon, 11 Jan 2016 03:18:00 -0800 (PST) In-Reply-To: References: Date: Mon, 11 Jan 2016 03:18:00 -0800 Message-ID: Subject: Question on gmirror and zfs fs behavior in unusual setup From: Octavian Hornoiu To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=UTF-8 X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Jan 2016 11:18:01 -0000 I currently have several storage servers. For historical reasons they have 6x 1TB Western Digital Black SATA drives in each server. Configuration is as follows: GPT disk config with boot sector /dev/ada0p1 freebsd-boot 64k /dev/ada0p2 freebsd-swap 1G /dev/ada0p3 freebsd-ufs 30G /dev/ada0p4 freebsd-zfs rest of drive The drive names are ada0 through ada5. The six drives all have the same partition scheme. - They are all bootable - Each swap has a label from swap0 through swap5 which all mount on boot - The UFS partitions are all in mirror/rootfs mirrored using gmirror in a 6 way mirror (The goal of the boot and mirror redundancy is any drive can die and I can still boot off any other drive like nothing happened. This partition contains the entire OS. - The zfs partitions are in RAIDZ-2 configuration and are redundant automatically. They contain the network accessible storage data. My dilemma is this. I am upgrading to 5 TB Western Digital Black drives. I have replaced drive ada5 as a test. I used the -a 4k command while partitioning to make sure sector alignment is correct. There are two major changes: - ada5p3 is now 100 G - ada5p4 is now much larger due to the size of the drive My understanding is that zfs will automatically change the total volume size once all drives are upgraded to the new 5 TB drives. Please correct me if I'm wrong! The resilver went without a hitch. My concern is with gmirror. Will gmirror grow to fit the new 100 G size automatically once the last drive is replaced? I got no errors using insert with the 100 G partition into the mix with the other 5 30 G partitions. It synchronized fine. The volume shows as complete and all providers are healthy. Anyone with knowledge of gmirror and zfs replication able to confirm that they'll grow automatically once all 6 drives are replaced or do I have to sync them at existing size and do some growfs trick later? Thanks!