From owner-freebsd-fs@FreeBSD.ORG Tue Nov 17 04:10:54 2009 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A74C1106566B for ; Tue, 17 Nov 2009 04:10:52 +0000 (UTC) (envelope-from ndenev@gmail.com) Received: from fg-out-1718.google.com (fg-out-1718.google.com [72.14.220.156]) by mx1.freebsd.org (Postfix) with ESMTP id 395358FC0A for ; Tue, 17 Nov 2009 04:10:51 +0000 (UTC) Received: by fg-out-1718.google.com with SMTP id e12so1339420fga.13 for ; Mon, 16 Nov 2009 20:10:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:from:content-type :content-transfer-encoding:subject:date:message-id:to:mime-version :x-mailer; bh=eL/UX6rRaRygweUP+MUx+c1qeLUqPuYh1pF5OdVb5yE=; b=OM4bmU8JWxsnv6RwGtxHiHAXQ+H0M42TuYrfj2eUZWHsfX0Wbv+ZTK46aufyZDNO6n BH/EZQPJkRt3a8T9OpUNB3UbQ4+7sKzjik76NMX8iXwt9MR35ZYVPl73oIwT6g2h7dod 33N8paXg2wZrcoDO41V2kaST3tyqx3RbWKEUc= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=from:content-type:content-transfer-encoding:subject:date:message-id :to:mime-version:x-mailer; b=ilupfoxHqFD2KlO5LreC+PFKFE1IKbEqQtjJK4eeWwDf9+XKeuKFvRpUDoDwthvy9o SY1z13A7QhSCho/tChDplv8uBLKnjfB7Eg51CWaDIW55uS3CzWaX0W04hLe3O5HLH3CR HycGk9wRmDGN3OcJ9t0G7gF0cy7wjtv+iJrRI= Received: by 10.103.85.28 with SMTP id n28mr4077533mul.66.1258431051068; Mon, 16 Nov 2009 20:10:51 -0800 (PST) Received: from ?10.0.0.10? (93-152-151-19.ddns.onlinedirect.bg [93.152.151.19]) by mx.google.com with ESMTPS id 12sm15844901muq.18.2009.11.16.20.10.50 (version=TLSv1/SSLv3 cipher=RC4-MD5); Mon, 16 Nov 2009 20:10:50 -0800 (PST) From: Nikolay Denev Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Date: Tue, 17 Nov 2009 06:10:46 +0200 Message-Id: <982FC0F3-0071-41E7-94A5-A49720B1771B@gmail.com> To: freebsd-fs@freebsd.org Mime-Version: 1.0 (Apple Message framework v1077) X-Mailer: Apple Mail (2.1077) Subject: ZFS resilver/replace changed vdev names from da(4) to gptid X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Nov 2009 04:10:54 -0000 Hello, Something strange happened while resilvering a 6 disk raidz1 array with = one failed drive. I've initially put the new disk and issued : zfs replace tank da1p2 But the resilver process found unrecoverable errors in one snapshot and = after resilvering for 7 hours it still showed da1p2/old and the new da1p2 and shortly after this after = issuing another zfs scrub command the machine livelocked. The strange thing happened after I rebooted the machine and restarted = the zfs scrub. This time ZFS picked up the new device not by da(4) name, but by gptid, = this pass also failed and I was forced to destroy a snapshot containing the unrecoverable errors and restart the = scrub again. This time it completed normally and the pool is now ONLINE but even more = strangely this time it replaced another vdev with it's gptid, and this is not the vdev that was being resilvered... = and now the pool looks like this : pool: tank state: ONLINE scrub: resilver completed after 7h18m with 0 errors on Tue Nov 17 = 00:16:20 2009 config: NAME STATE READ = WRITE CKSUM tank ONLINE 0 = 0 0 raidz1 ONLINE 0 = 0 0 da0p2 ONLINE 0 = 0 0 4.55G resilvered gptid/b8baba94-d068-11de-a6d5-003048c1b5fa ONLINE 0 = 0 0 63.2G resilvered gptid/c00174b1-d068-11de-a6d5-003048c1b5fa ONLINE 0 = 0 0 4.55G resilvered da3p2 ONLINE 0 = 0 0 4.21G resilvered da4p2 ONLINE 0 = 0 0 4.55G resilvered da5p2 ONLINE 0 = 0 0 4.21G resilvered errors: No known data errors P.S.: This also makes me wonder how I can safely make all of the other = vdevs use gptid, as I plan to replace the SATA controller with a new one that probably is going to export the = devices as ad(4) or ada(4). -- Regards, Nikolay Denev