From owner-freebsd-stable@FreeBSD.ORG Tue Feb 9 14:06:10 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 03D0E106568D for ; Tue, 9 Feb 2010 14:06:10 +0000 (UTC) (envelope-from gerrit@pmp.uni-hannover.de) Received: from mrelay1.uni-hannover.de (mrelay1.uni-hannover.de [130.75.2.106]) by mx1.freebsd.org (Postfix) with ESMTP id 8988E8FC17 for ; Tue, 9 Feb 2010 14:06:09 +0000 (UTC) Received: from www.pmp.uni-hannover.de (www.pmp.uni-hannover.de [130.75.117.2]) by mrelay1.uni-hannover.de (8.14.2/8.14.2) with ESMTP id o19E66o7007047 for ; Tue, 9 Feb 2010 15:06:08 +0100 Received: from pmp.uni-hannover.de (arc.pmp.uni-hannover.de [130.75.117.1]) by www.pmp.uni-hannover.de (Postfix) with SMTP id BB86524 for ; Tue, 9 Feb 2010 15:06:06 +0100 (CET) Date: Tue, 9 Feb 2010 15:06:06 +0100 From: Gerrit =?ISO-8859-1?Q?K=FChn?= To: freebsd-stable@freebsd.org Message-Id: <20100209150606.ddba52dc.gerrit@pmp.uni-hannover.de> Organization: Albert-Einstein-Institut (MPI =?ISO-8859-1?Q?f=FCr?= Gravitationsphysik & IGP =?ISO-8859-1?Q?Universit=E4t?= Hannover) X-Mailer: Sylpheed 2.7.1 (GTK+ 2.18.4; i386-portbld-freebsd7.0) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-PMX-Version: 5.5.9.388399, Antispam-Engine: 2.7.2.376379, Antispam-Data: 2010.2.9.135416 Subject: zpool vdev vs. glabel X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Feb 2010 14:06:10 -0000 Hi, I have created a raidz2 with disk I labeled with glabel before. Right after creation this pool looked fine, using devices label/tank[1-6]. I did some tests with replacing/swapping disks and so on. After doing a zpool offline tank label/tank6 remove disk camcontrol rescan all insert disk camcontrol rescan all zpool online tank label/tank6 I got the disk back, but not under the requested label, but under the da device name: pool: tank state: ONLINE scrub: resilver completed after 0h0m with 0 errors on Tue Feb 9 14:56:37 2010 config: NAME STATE READ WRITE CKSUM tank ONLINE 0 0 0 raidz2 ONLINE 0 0 0 label/tank1 ONLINE 0 0 0 8.50K resilvered label/tank2 ONLINE 0 0 0 7.50K resilvered label/tank3 ONLINE 0 0 0 8.50K resilvered label/tank4 ONLINE 0 0 0 7.50K resilvered label/tank5 ONLINE 0 0 0 9K resilvered da6 ONLINE 0 0 0 13.5K resilvered errors: No known data errors Why does this happen? Is there any way to get zfs to use the label again? After the device is in use, the label in /dev/label disappears. When taking the device offline again, the label is there, but cannot be used: pigpen# zpool offline tank da6 pigpen# zpool status pool: system state: ONLINE status: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected. action: Determine if the device needs to be replaced, and clear the errors using 'zpool clear' or replace the device with 'zpool replace'. see: http://www.sun.com/msg/ZFS-8000-9P scrub: resilver completed after 0h0m with 0 errors on Tue Feb 9 14:49:14 2010 config: NAME STATE READ WRITE CKSUM system ONLINE 0 0 0 mirror ONLINE 0 0 0 label/system1 ONLINE 3 617 0 126K resilvered label/system2 ONLINE 0 0 0 41K resilvered errors: No known data errors pool: tank state: DEGRADED status: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected. action: Determine if the device needs to be replaced, and clear the errors using 'zpool clear' or replace the device with 'zpool replace'. see: http://www.sun.com/msg/ZFS-8000-9P scrub: resilver completed after 0h0m with 0 errors on Tue Feb 9 14:56:37 2010 config: NAME STATE READ WRITE CKSUM tank DEGRADED 0 0 0 raidz2 DEGRADED 0 0 0 label/tank1 ONLINE 0 0 0 8.50K resilvered label/tank2 ONLINE 0 0 0 7.50K resilvered label/tank3 ONLINE 0 0 0 8.50K resilvered label/tank4 ONLINE 0 0 0 7.50K resilvered label/tank5 ONLINE 0 0 0 9K resilvered da6 OFFLINE 0 38 0 13.5K resilvered errors: No known data errors pigpen# ll /dev/label/ total 0 crw-r----- 1 root operator 0, 104 Feb 9 14:04 lisacrypt1 crw-r----- 1 root operator 0, 112 Feb 9 14:04 lisacrypt2 crw-r----- 1 root operator 0, 113 Feb 9 14:04 lisacrypt3 crw-r----- 1 root operator 0, 134 Feb 9 14:48 system1 crw-r----- 1 root operator 0, 115 Feb 9 14:04 system2 crw-r----- 1 root operator 0, 116 Feb 9 14:04 tank1 crw-r----- 1 root operator 0, 117 Feb 9 14:04 tank2 crw-r----- 1 root operator 0, 118 Feb 9 14:04 tank3 crw-r----- 1 root operator 0, 101 Feb 9 14:04 tank4 crw-r----- 1 root operator 0, 102 Feb 9 14:04 tank5 crw-r----- 1 root operator 0, 103 Feb 9 15:02 tank6 pigpen# zpool online tank label/tank6 cannot online label/tank6: no such device in pool In a different thread I found the hint to use zpool replace to get to the usage of labels, but this seems not possible, either: pigpen# zpool replace tank label/tank6 invalid vdev specification use '-f' to override the following errors: /dev/label/tank6 is part of active pool 'tank' pigpen# zpool replace -f tank label/tank6 invalid vdev specification the following errors must be manually repaired: /dev/label/tank6 is part of active pool 'tank' pigpen# zpool replace -f tank da6 label/tank6 invalid vdev specification the following errors must be manually repaired: /dev/label/tank6 is part of active pool 'tank' I'm running out of ideas here... cu Gerrit