From owner-freebsd-fs@FreeBSD.ORG Wed Apr 23 10:18:42 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 45006D19 for ; Wed, 23 Apr 2014 10:18:42 +0000 (UTC) Received: from mail-ee0-x231.google.com (mail-ee0-x231.google.com [IPv6:2a00:1450:4013:c00::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id CAC67105B for ; Wed, 23 Apr 2014 10:18:41 +0000 (UTC) Received: by mail-ee0-f49.google.com with SMTP id c41so593287eek.8 for ; Wed, 23 Apr 2014 03:18:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:cc:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=azQUHNfkcq5CO2zn/+MNNuvFXXRlTV1x2NMY6TfrNG4=; b=g0tGb7Ku2ZlyvMYpHBhgPnmP/klGhdgyGYexaEtgmKYRpmdLEOyttjWsrJF767VN0q rW3F/3eAdeSzCcVv0uuVBM2b5NTas9QGu8VLeQRBSyvIIsiwvJv7gH/gyAqsY6w3VS8H mxCno2SYsKZQJwqf7l1Zn3q6HADZEStnybS5ci0jeE+BLOqLhpP3NVXdZhCO1fWQkAPi lR+jZfEtq08Yg8vfH3hbYTKhmkPzezb+PEUUpEX3v+OK7phUm1RxJzM6Ci/ach6/wx9k QxIf2NLn7WZuwYTMrUNx4YXBux0jgPN/wNA1MssfiSD3EYQOYmhwccgegtp6NYtiIS5v a0aA== X-Received: by 10.14.246.196 with SMTP id q44mr62483510eer.45.1398248318786; Wed, 23 Apr 2014 03:18:38 -0700 (PDT) Received: from [192.168.1.117] (schavemaker.nl. [213.84.84.186]) by mx.google.com with ESMTPSA id t50sm4922533eev.28.2014.04.23.03.18.37 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 23 Apr 2014 03:18:38 -0700 (PDT) Message-ID: <5357937D.4080302@gmail.com> Date: Wed, 23 Apr 2014 12:18:37 +0200 From: Johan Hendriks User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.4.0 MIME-Version: 1.0 To: Hugo Lombard Subject: Re: ZFS unable to import pool References: <20140423064203.GD2830@sludge.elizium.za.net> <20140423080056.GE2830@sludge.elizium.za.net> <20140423091852.GH2830@sludge.elizium.za.net> <20140423100126.GJ2830@sludge.elizium.za.net> In-Reply-To: <20140423100126.GJ2830@sludge.elizium.za.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Apr 2014 10:18:42 -0000 op 23-04-14 12:01, Hugo Lombard schreef: > Hello > > In your original 'zpool import' output, it shows the following: > > Additional devices are known to be part of this pool, though their > exact configuration cannot be determined. > > I'm thinking your problem might be related to devices that's supposed to > be part of the pool but that's not shown in the import. > > For instance, here's my attempt at recreating your scenario: > > # zpool import > pool: t > id: 15230454775812525624 > state: DEGRADED > status: One or more devices are missing from the system. > action: The pool can be imported despite missing or damaged devices. The > fault tolerance of the pool may be compromised if imported. > see: http://illumos.org/msg/ZFS-8000-2Q > config: > > t DEGRADED > raidz1-0 DEGRADED > md3 ONLINE > md4 ONLINE > md5 ONLINE > md6 ONLINE > 3421664295019948379 UNAVAIL cannot open > cache > md1s2 > logs > md1s1 ONLINE > # > > As you can see, the pool stattus is 'DEGRADED' instead of 'UNAVAIL', and > I don't have the 'Additional devices...' message. > > The pool imports OK: > > # zpool import t > # zpool status t > pool: t > state: DEGRADED > status: One or more devices could not be opened. Sufficient replicas exist for > the pool to continue functioning in a degraded state. > action: Attach the missing device and online it using 'zpool online'. > see: http://illumos.org/msg/ZFS-8000-2Q > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > t DEGRADED 0 0 0 > raidz1-0 DEGRADED 0 0 0 > md3 ONLINE 0 0 0 > md4 ONLINE 0 0 0 > md5 ONLINE 0 0 0 > md6 ONLINE 0 0 0 > 3421664295019948379 UNAVAIL 0 0 0 was /dev/md7 > logs > md1s1 ONLINE 0 0 0 > cache > md1s2 ONLINE 0 0 0 > > errors: No known data errors > # > > As a further test, let's see what happens when the cache disk > disappears: > > # zpool export t > # gpart delete -i 2 md1 > md1s2 deleted > # zpool import > pool: t > id: 15230454775812525624 > state: DEGRADED > status: One or more devices are missing from the system. > action: The pool can be imported despite missing or damaged devices. The > fault tolerance of the pool may be compromised if imported. > see: http://illumos.org/msg/ZFS-8000-2Q > config: > > t DEGRADED > raidz1-0 DEGRADED > md3 ONLINE > md4 ONLINE > md5 ONLINE > md6 ONLINE > 3421664295019948379 UNAVAIL cannot open > cache > 7736388725784014558 > logs > md1s1 ONLINE > # zpool import t > # zpool status t > pool: t > state: DEGRADED > status: One or more devices could not be opened. Sufficient replicas exist for > the pool to continue functioning in a degraded state. > action: Attach the missing device and online it using 'zpool online'. > see: http://illumos.org/msg/ZFS-8000-2Q > scan: none requested > config: > > NAME STATE READ WRITE CKSUM > t DEGRADED 0 0 0 > raidz1-0 DEGRADED 0 0 0 > md3 ONLINE 0 0 0 > md4 ONLINE 0 0 0 > md5 ONLINE 0 0 0 > md6 ONLINE 0 0 0 > 3421664295019948379 UNAVAIL 0 0 0 was /dev/md7 > logs > md1s1 ONLINE 0 0 0 > cache > 7736388725784014558 UNAVAIL 0 0 0 was /dev/md1s2 > > errors: No known data errors > # > > So even with a missing raidz component and a missing cache device, the > pool still imports. > > I think some crucial piece of information is missing to complete the > picture. > Did you in the past add an extra disk to the pool? This could explain the whole issue as the pool is missing a whole vdev. regards Johan