From owner-freebsd-fs@FreeBSD.ORG Thu Jul 30 07:21:54 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C05A5106564A for ; Thu, 30 Jul 2009 07:21:54 +0000 (UTC) (envelope-from numisemis@yahoo.com) Received: from web37301.mail.mud.yahoo.com (web37301.mail.mud.yahoo.com [209.191.90.244]) by mx1.freebsd.org (Postfix) with SMTP id 7EE8C8FC18 for ; Thu, 30 Jul 2009 07:21:54 +0000 (UTC) (envelope-from numisemis@yahoo.com) Received: (qmail 11604 invoked by uid 60001); 30 Jul 2009 07:21:54 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1248938514; bh=E9DPUTM9Zkl0fHuZYPZwl9fSGGAMuwpZUFkrvLLLUG0=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=H54ms7JyUuVBL19eCWocPIGOdIfXMTQCSRoC8z+JevJIp+01tzyjDDz4avTNx9o0IA2MPxZmXqINa15BP3oV/LDfJrVueJ6Wj+g1YcPSjup0yPwU+973VFgFpLQmXrC1tfGtdiWv3KwuFcQKGMCSD9sA6XHCI30yJFDITXRXxCo= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=KA7fkJXTnhoQJkVdgNEmECCJdJkcN72d+QL6YUAbF4m9RuFqDdp8vkeQ/7HijD00bPcApltrQ5bITTUQ+Ye33QrSSzDU5t923QwU8prBj/+P+aD0ClwltQgSRA4k3Ubo+D+0MKfDZL31zQR/fE9th2AT04AQ7yRaEgWgFptd47I=; Message-ID: <46899.11156.qm@web37301.mail.mud.yahoo.com> X-YMail-OSG: EUGMqmQVM1kn2PW9AyTlKASSsDKvCHDToeYPOmr8E0P2jqW2lhCzQQvYTG4kiwDlRy4vy3TbRX3xLv6guCxoqXJzTUkdZtBheQqO2.YfhDnQUd2bS5tF0yKVvIzKPBf0VVlJyA8ckY_8qFggz9kIox3_R37aOijz7ROOBje37s7z8uemMy2wrZW8PmU8wKaP8NLWI1aJGDLnZ1Mj1EOWe6m0Xv3FeJCYuXjsOmNOw9VmzewNJAWJduT.UQrlJw2YUnAjEkWZX6pVGB8DgQWRu8WTutHQgOpviK0113TiS65HOu7Ru.sJRmdAnyzmckOjPZXscujfm.xRRAv4eJjWZLhy Received: from [213.147.110.159] by web37301.mail.mud.yahoo.com via HTTP; Thu, 30 Jul 2009 00:21:53 PDT X-Mailer: YahooMailRC/1358.22 YahooMailWebService/0.7.289.15 References: <4A712290.9030308@chip-web.com> Date: Thu, 30 Jul 2009 00:21:53 -0700 (PDT) From: Simun Mikecin To: Ludwig Pummer In-Reply-To: <4A712290.9030308@chip-web.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-fs@freebsd.org Subject: Re: ZFS raidz1 pool unavailable from losing 1 device X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 30 Jul 2009 07:21:55 -0000 Ludwin Pummer wrote: > My system is 7.2-STABLE Jul 27, amd64, 4GB memory, just upgraded from 6.4-STABLE > from last year. I just set up a ZFS raidz volume to replace a graid5 volume I > had been using. I had it successfully set up using partitions across 4 disks, > ad{6,8,10,12}s1e. Then I wanted to expand the raidz volume by merging the space > from the adjacent disk partition. I thought I could just fail out the partition > device in ZFS, edit the bsdlabel, and re-add the larger partition, ZFS would > resilver, repeat until done. That's when I found out that ZFS doesn't let you > fail out a device in a raidz volume. No big deal, I thought, I'll just go to > single user mode and mess with the partition when ZFS isn't looking. When it > comes back up it should notice that one of the device is gone, I can do a 'zfs > replace' and continue my plan. > > Well, after rebooting to single user mode, combining partitions ad12s1d and > ad12s1e (removed the d partiton), "zfs volinit", then "zpool status" just hung > (Ctrl-C didn't kill it, so I rebooted). I thought this was a bit odd so I > thought perhaps ZFS is confused by the ZFS metadata left on ad12s1e, so I > blanked it out with "dd". That didn't help. I changed the name of the partition > to ad12s1d thinking perhaps that would help. After that, "zfs volinit; zfs mount > -a; zpool status" showed my raidz pool UNAVAIL with the message "insufficient > replicas", ad{6,8,10}s1e ONLINE, and ad12s1e UNAVAIL "cannot open", and a more > detailed message pointing me to http://www.sun.com/msg/ZFS-8000-3C. I tried > doing a "zpool replace storage ad12s1e ad12s1d" but it refused, saying my zpool > ("storage") was unavailable. Ditto for pretty much every zpool command I tried. > "zpool clear" gave me a "permission denied" error. Was your pool imported while you were repartitioning in single user mode?