From owner-freebsd-fs@FreeBSD.ORG Mon Mar 8 18:51:54 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9B158106564A for ; Mon, 8 Mar 2010 18:51:54 +0000 (UTC) (envelope-from mattjreimer@gmail.com) Received: from mail-yw0-f204.google.com (mail-yw0-f204.google.com [209.85.211.204]) by mx1.freebsd.org (Postfix) with ESMTP id 55C908FC14 for ; Mon, 8 Mar 2010 18:51:54 +0000 (UTC) Received: by ywh42 with SMTP id 42so2953714ywh.7 for ; Mon, 08 Mar 2010 10:51:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=FQpTCa1pNdWfkVS4xXNasSbKPDsB8W618VAGvW3jRUo=; b=uk68aFjBEQk8j9/hVC6rJU8R2Su9LJ/ZHY+WKp0Gd1dwvz37h5nkTWeoZh7NY1yXMZ aO93h+i/w5fr7ZZu1dqzA4Q3ilijKaHpS+DEi3LZNhfmaa4NM3ROZ02BG+ntgut3Pw2u XB+gKby1ix6uLECYIymIBguGO5IU4SdvLEKeM= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=jx/dqYEH9Fy4ZYKHW0r0lvnUaylK4EEffcT+P3OFNDOyxDxVUTSlgm4+NvH1/ClIp9 wmmauwL2IWab9vogBARVwBImu3z5DkWPLbw0d68wHxKRu8wSpOoRd99dzPcKmUgGsZh7 QO33Nxghfm4/PIPHtH/2dCC6yHI5tD/RxM728= MIME-Version: 1.0 Received: by 10.150.65.3 with SMTP id n3mr4470027yba.322.1268074313455; Mon, 08 Mar 2010 10:51:53 -0800 (PST) In-Reply-To: <9EB2D14A-ABED-4DEC-A88F-09B0AB32905E@onpuls.com> References: <9EB2D14A-ABED-4DEC-A88F-09B0AB32905E@onpuls.com> Date: Mon, 8 Mar 2010 10:51:53 -0800 Message-ID: From: Matt Reimer To: Morrison Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS Boot problem after hard shutdown while resilvering RAIDZ1 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 08 Mar 2010 18:51:54 -0000 On Sat, Mar 6, 2010 at 12:04 AM, Morrison wrote: > Hello folks. > > Here are my specs: > FreeBSD Current 8.0 (amd64) > 3x 2TB HDD combined to a RAIDZ1 > GPT > Root is running on ZFS, > I used the following Guideline ( > http://wiki.freebsd.org/RootOnZFS/GPTZFSBoot/RAIDZ1) > > > Here is the problem: > > I had to replace a drive, but chose by accident a spare which hat some > strange malfunction as well. > I used the command: > zpool replace zroot gpt/disk1 > > zpool status > gave me the information that resilvering would take 2500h (increasing). > After a couple of MB were resilvered (very slowly), I decided to shut the > system down safely, which didn't work, so I powered it off by holding the > power switch. > I detached the malfunctioned spare drive and tried to start the system with > the two HDDs, but now I am getting > > ZFS: can only boot from disk, mirror or raidz vdevs > ZFS: i/o error - all block copies unavailable > ZFS: can't read object set for dataset lld > Can't find root filesystem - giving up > ZFS: unexpected object set type lld > ZFS: unexpected object set type lld > > FreeBSD/i386 boot > Default: zroot:/boot/kernel/kernel > boot: > ZFS: unexpected object set type lld > > FreeBSD/i386 boot > Default: zroot:/boot/kernel/kernel > boot:_ > Those 'type lld' suggests you're running an older gptzfsboot. Try the latest from -CURRENT or -STABLE. Newer gptzfsboot can boot from a degraded array. > I used my LiveFS USB and tried with Fixit, after loading opensolaris.ko and > zfs.ko: > zpool import -f zroot > > After that, all HDDs started making noises as if they try to heal/restore > them self. But all commands I entered then, gave me errors like: > /libexec/ld-elf.so.1: Shared object "libavl.so.2" not found, > required by "zpool" > Even sImple commands like "ls" produce simular messages. > I waited one night until the HDDs went silent and rebooted, but without any > luck. > Maybe you should import the pool using an alternate root, like "zpool import -f -R /mnt" so you're not replacing /usr etc. out from under Fixit? Matt