From owner-freebsd-fs@FreeBSD.ORG Fri May 10 13:45:45 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id F0946679 for ; Fri, 10 May 2013 13:45:45 +0000 (UTC) (envelope-from c.kworr@gmail.com) Received: from mail-la0-x231.google.com (mail-la0-x231.google.com [IPv6:2a00:1450:4010:c03::231]) by mx1.freebsd.org (Postfix) with ESMTP id 79E82A76 for ; Fri, 10 May 2013 13:45:45 +0000 (UTC) Received: by mail-la0-f49.google.com with SMTP id ee20so731049lab.8 for ; Fri, 10 May 2013 06:45:44 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:message-id:date:from:user-agent:mime-version:to:subject :references:in-reply-to:content-type:content-transfer-encoding; bh=ZKFNc6yNos5PKmZ7QpMgeTL/8ciXrBxP4iQfZBczE7s=; b=golrbXJx5Ul3za4QKI/A2YFmdW+Y9BS86wmOn1OhGXe9BcqMBBRjQaG9dO7Kcz6Ptj SlupMENZ0qgCne/li/v7d9HpwUF5qqCyQ1MLR2q1udsl17jdTOkJEG/X10Pnia99m3OP NElvZhnJqS+TRo0iV6pvOaYxpo/03CjLPVuMxY0VutDpaT1tKWs9FHpbzXKIaLVWwAW+ NCV0AMTtZkHfoEH9OM69ZY5EhNopduOrqcyB3s3l+Qdr7g0NZtJxDVeGolsbkxVQsXmP n0/FfRybRnfRe1cdD1qWsfbuKENKe3J1gBPdKhH8ekmmiPwmisPq3F4mlM0pu21Y8kRj oRbA== X-Received: by 10.152.1.232 with SMTP id 8mr7767652lap.33.1368193544487; Fri, 10 May 2013 06:45:44 -0700 (PDT) Received: from [192.168.1.129] (mau.donbass.com. [92.242.127.250]) by mx.google.com with ESMTPSA id c15sm902727lbj.17.2013.05.10.06.45.43 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Fri, 10 May 2013 06:45:43 -0700 (PDT) Message-ID: <518CFA05.6090706@gmail.com> Date: Fri, 10 May 2013 16:45:41 +0300 From: Volodymyr Kostyrko User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:20.0) Gecko/20100101 Firefox/20.0 SeaMonkey/2.17 MIME-Version: 1.0 To: Outback Dingo , freebsd-fs@freebsd.org Subject: Re: Corrupted zpool import -f FAILS state FAULTED References: In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 10 May 2013 13:45:46 -0000 09.05.2013 15:31, Outback Dingo: > ok zfsgurus, FreeBSD 9.1-STABLE box zpool import -f reports pool status > Faulted, one of more devices contains corrupted data, however its showing > the guid as faulted in the poll, and not the actual disk device /dev/daX, > the pool is a single vdev 24 disk raidz3. Essentially the hardward platform > is a dual node system, with 8 enclosures connected to 24 SAS drives via 4 > LSI cards. I am not currently using geom_multipath, but the box is zoned so > that each node can see 50% of the drives, > in case of Failure, carp kicks in and migrates "zpool import -af" the pools > onto the other node. it seems as though somehow the pool is now seeing guid > and not devices, not sure if they have switched devices ids due to a reboot. Am not a zfs guru, but I'll try to help. Any console log snippets are welcome. What does "showing the guid as faulted in the pool" looks like. What are the guids for all partitions? Do they interlap for different nodes? ZFS recognizes devices by tasting they vdev labels and not by their logical location and naming. It can safely report any vdev location - but it requires the same set vdevs to bring pool online. -- Sphinx of black quartz, judge my vow.