From owner-freebsd-fs@FreeBSD.ORG Wed Apr 23 09:58:13 2014 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 037DC516 for ; Wed, 23 Apr 2014 09:58:13 +0000 (UTC) Received: from squishy.elizium.za.net (squishy.elizium.za.net [80.68.90.178]) by mx1.freebsd.org (Postfix) with ESMTP id 8C7521AD2 for ; Wed, 23 Apr 2014 09:58:12 +0000 (UTC) Received: from sludge.elizium.za.net (sludge.elizium.za.net [196.41.137.247]) by squishy.elizium.za.net (Postfix) with ESMTPSA id DB84D803F; Wed, 23 Apr 2014 11:58:10 +0200 (SAST) Date: Wed, 23 Apr 2014 12:01:26 +0200 From: Hugo Lombard To: Gennadiy Gulchin Subject: Re: ZFS unable to import pool Message-ID: <20140423100126.GJ2830@sludge.elizium.za.net> References: <20140423064203.GD2830@sludge.elizium.za.net> <20140423080056.GE2830@sludge.elizium.za.net> <20140423091852.GH2830@sludge.elizium.za.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20140423091852.GH2830@sludge.elizium.za.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: FreeBSD Filesystems X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 23 Apr 2014 09:58:13 -0000 Hello In your original 'zpool import' output, it shows the following: Additional devices are known to be part of this pool, though their exact configuration cannot be determined. I'm thinking your problem might be related to devices that's supposed to be part of the pool but that's not shown in the import. For instance, here's my attempt at recreating your scenario: # zpool import pool: t id: 15230454775812525624 state: DEGRADED status: One or more devices are missing from the system. action: The pool can be imported despite missing or damaged devices. The fault tolerance of the pool may be compromised if imported. see: http://illumos.org/msg/ZFS-8000-2Q config: t DEGRADED raidz1-0 DEGRADED md3 ONLINE md4 ONLINE md5 ONLINE md6 ONLINE 3421664295019948379 UNAVAIL cannot open cache md1s2 logs md1s1 ONLINE # As you can see, the pool stattus is 'DEGRADED' instead of 'UNAVAIL', and I don't have the 'Additional devices...' message. The pool imports OK: # zpool import t # zpool status t pool: t state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://illumos.org/msg/ZFS-8000-2Q scan: none requested config: NAME STATE READ WRITE CKSUM t DEGRADED 0 0 0 raidz1-0 DEGRADED 0 0 0 md3 ONLINE 0 0 0 md4 ONLINE 0 0 0 md5 ONLINE 0 0 0 md6 ONLINE 0 0 0 3421664295019948379 UNAVAIL 0 0 0 was /dev/md7 logs md1s1 ONLINE 0 0 0 cache md1s2 ONLINE 0 0 0 errors: No known data errors # As a further test, let's see what happens when the cache disk disappears: # zpool export t # gpart delete -i 2 md1 md1s2 deleted # zpool import pool: t id: 15230454775812525624 state: DEGRADED status: One or more devices are missing from the system. action: The pool can be imported despite missing or damaged devices. The fault tolerance of the pool may be compromised if imported. see: http://illumos.org/msg/ZFS-8000-2Q config: t DEGRADED raidz1-0 DEGRADED md3 ONLINE md4 ONLINE md5 ONLINE md6 ONLINE 3421664295019948379 UNAVAIL cannot open cache 7736388725784014558 logs md1s1 ONLINE # zpool import t # zpool status t pool: t state: DEGRADED status: One or more devices could not be opened. Sufficient replicas exist for the pool to continue functioning in a degraded state. action: Attach the missing device and online it using 'zpool online'. see: http://illumos.org/msg/ZFS-8000-2Q scan: none requested config: NAME STATE READ WRITE CKSUM t DEGRADED 0 0 0 raidz1-0 DEGRADED 0 0 0 md3 ONLINE 0 0 0 md4 ONLINE 0 0 0 md5 ONLINE 0 0 0 md6 ONLINE 0 0 0 3421664295019948379 UNAVAIL 0 0 0 was /dev/md7 logs md1s1 ONLINE 0 0 0 cache 7736388725784014558 UNAVAIL 0 0 0 was /dev/md1s2 errors: No known data errors # So even with a missing raidz component and a missing cache device, the pool still imports. I think some crucial piece of information is missing to complete the picture. -- Hugo Lombard .___. (o,o) /) ) ---"-"---