From owner-freebsd-fs@FreeBSD.ORG Sat Jul 16 22:03:14 2011 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7EE3E106566B for ; Sat, 16 Jul 2011 22:03:14 +0000 (UTC) (envelope-from jorgen.ness@gmail.com) Received: from mail-yw0-f54.google.com (mail-yw0-f54.google.com [209.85.213.54]) by mx1.freebsd.org (Postfix) with ESMTP id 413D48FC0A for ; Sat, 16 Jul 2011 22:03:13 +0000 (UTC) Received: by ywf7 with SMTP id 7so1139037ywf.13 for ; Sat, 16 Jul 2011 15:03:13 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:date:message-id:subject:from:to:content-type; bh=rejwceHugA0sjTTjUOfFXkLLVDHhQmm7JoGKcu7NJOM=; b=qGLTv/w7c8wyJRwNbs+c3ZC7XdQjEHRd/LA15TIYe6c43Fiw7kyEkotdkAQwA2x8rm NVq2Q9iChIXmTYBY3hAkTHIOPhTKb0ERBEddx2wsvG1gCBNiNuY/e9bXEg0AxlyWgDa6 XEm63NQHOVP08m9l+m3f4uTVPn9+c5p5fjTgk= MIME-Version: 1.0 Received: by 10.151.11.4 with SMTP id o4mr3765730ybi.99.1310852021672; Sat, 16 Jul 2011 14:33:41 -0700 (PDT) Received: by 10.151.99.15 with HTTP; Sat, 16 Jul 2011 14:33:41 -0700 (PDT) Date: Sat, 16 Jul 2011 23:33:41 +0200 Message-ID: From: =?ISO-8859-1?Q?J=F8rgen_Dovregubbe_N=E6ss?= To: freebsd-fs@freebsd.org Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS v13 running vicious replacement loop. X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 16 Jul 2011 22:03:14 -0000 Hi. Im running freeNAS v.0.7.2 with zfs v3 and zpool v13. I was trying to upgrade my raidz1 from 1 TB drives to 2TB drives, replacing 1 drive at a time. here's the current layout: freenas:~# zpool status pool: guitar state: DEGRADED scrub: resilver completed after 0h0m with 0 errors on Sat Jul 16 17:19:48 2011 config: NAME STATE READ WRITE CKSUM guitar DEGRADED 0 0 0 raidz1 DEGRADED 0 0 0 replacing DEGRADED 0 25 4 ad4.nop ONLINE 0 0 0 88K resilvered 9203819577564534483 FAULTED 0 0 0 was /dev/ad4.nop ad6.nop ONLINE 0 0 0 96K resilvered ad8.nop ONLINE 0 0 0 100K resilvered ad10.nop ONLINE 0 0 0 96K resilvered ad16.nop ONLINE 0 0 0 124K resilvered ad18.nop ONLINE 0 0 0 116K resilvered spares da1 AVAIL errors: No known data errors Without taking ad4.nop offline, i turned the machine off, replaced the drive, and did a "zpool replace guitar ad4.nop ad4" It started replacing the drive, but got I/o write and read errors, so it restarted (happened like 30 times per minute). I have tried everything. zpool replace guitar ad4.nop /dev/da1 (can't replace because already being replaced) zpool offline guitar ad4.nop (no valid replicas) zpool offline guitar 9203819577564534483 (no valid replicas) zpool clear guitar ad4.nop zpool export / import (thus the 9203819577564534483, it said ad4.nop before= ) The spare was added later to try and put that in instead of ad4.nop, withou= t luck. The box only have 6 sata ports, so I am unable to connect the drive i was trying to replace ad4.nop with. I do have another computer that i could use as a temp server, but that one also has 6 sata ports. The next raidz1 will be with only 5 drives, and 1 spare ( so i dont have to meet this problem again) The problem now is, that i can't access the files that are on the NAS, thus being unable to do a backup of it. ( I can transfer like a coulple of GB, then the whole box gets unreachable (web, ssh ftp). Any Idea how to solve this? Best Regards J=F8rgen