From owner-freebsd-fs@FreeBSD.ORG  Fri Aug 21 03:10:42 2009
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 2A0ED106568F
	for <freebsd-fs@freebsd.org>; Fri, 21 Aug 2009 03:10:42 +0000 (UTC)
	(envelope-from randy@psg.com)
Received: from ran.psg.com (ran.psg.com [IPv6:2001:418:1::36])
	by mx1.freebsd.org (Postfix) with ESMTP id 0B85E8FC6E
	for <freebsd-fs@freebsd.org>; Fri, 21 Aug 2009 03:10:42 +0000 (UTC)
Received: from localhost ([127.0.0.1] helo=rmac.psg.com)
	by ran.psg.com with esmtp (Exim 4.69 (FreeBSD))
	(envelope-from <randy@psg.com>)
	id 1MeKWW-000IUY-WB; Fri, 21 Aug 2009 03:10:41 +0000
Received: from rmac.wdcguest.wdc.sri.com.psg.com (localhost [127.0.0.1])
	by rmac.psg.com (Postfix) with ESMTP id 84451296D6B2;
	Fri, 21 Aug 2009 12:10:40 +0900 (JST)
Date: Fri, 21 Aug 2009 12:10:40 +0900
Message-ID: <m23a7lkgjz.wl%randy@psg.com>
From: Randy Bush <randy@psg.com>
To: Andrew Snow <andrew@modulus.org>
In-Reply-To: <4A8E0F39.6070407@modulus.org>
References: <m2eir5khm7.wl%randy@psg.com> <4A8E0C80.9030908@modulus.org>
	<m263chkh0l.wl%randy@psg.com> <4A8E0F39.6070407@modulus.org>
User-Agent: Wanderlust/2.15.5 (Almost Unreal) Emacs/22.3 Mule/5.0 (SAKAKI)
MIME-Version: 1.0 (generated by SEMI 1.14.6 - "Maruoka")
Content-Type: text/plain; charset=US-ASCII
Cc: freebsd-fs <freebsd-fs@freebsd.org>
Subject: Re: re-adding a replacement into a pool of mirrors
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 21 Aug 2009 03:10:42 -0000



Andrew Snow wrote:
> 
> 
> OK, with mirrored vdevs you can detach and re-attach disks.
> 
> So:
> 
> 
> zpool detach tank da1s3   <-- remove it from the mirror
> zpool attach tank da0s3 da1s3     <-- add a disk into the mirror vdev

# zpool detach tank da1s3
# zpool status
  pool: tank
 state: ONLINE
 scrub: scrub completed after 0h14m with 0 errors on Wed Aug 19 12:03:14 2009
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          da0s3     ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da2s1   ONLINE       0     0     0
            da3s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da4s1   ONLINE       0     0     0
            da5s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da6s1   ONLINE       0     0     0
            da7s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da8s1c  ONLINE       0     0     0
            da9s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da10s1  ONLINE       0     0     0
            da11s1  ONLINE       0     0     0

errors: No known data errors
# zpool attach tank da0s3 da1s3
cannot attach da1s3 to da0s3: permission denied
# zpool status
  pool: tank
 state: ONLINE
 scrub: scrub completed after 0h14m with 0 errors on Wed Aug 19 12:03:14 2009
config:

        NAME        STATE     READ WRITE CKSUM
        tank        ONLINE       0     0     0
          da0s3     ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da2s1   ONLINE       0     0     0
            da3s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da4s1   ONLINE       0     0     0
            da5s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da6s1   ONLINE       0     0     0
            da7s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da8s1c  ONLINE       0     0     0
            da9s1   ONLINE       0     0     0
          mirror    ONLINE       0     0     0
            da10s1  ONLINE       0     0     0
            da11s1  ONLINE       0     0     0

errors: No known data errors

uh oh!

randy