From owner-freebsd-fs@FreeBSD.ORG Sat Jan 23 08:14:08 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1E16D1065672 for ; Sat, 23 Jan 2010 08:14:08 +0000 (UTC) (envelope-from rincebrain@gmail.com) Received: from mail-fx0-f218.google.com (mail-fx0-f218.google.com [209.85.220.218]) by mx1.freebsd.org (Postfix) with ESMTP id A91238FC14 for ; Sat, 23 Jan 2010 08:14:07 +0000 (UTC) Received: by fxm10 with SMTP id 10so201744fxm.14 for ; Sat, 23 Jan 2010 00:14:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:mime-version:received:in-reply-to:references :date:message-id:subject:from:to:cc:content-type; bh=7lVsUlf5FQc1L0ROTBiXAm2ZlBwCw6+O2CZhMxUBxKc=; b=aVLBF/nueahLUSaKUqTRQ+Ms/31qKh4RF/XPsJFFroQt2thZFAAOxXQW4Fb2PJxumJ F6MXRcVzRAbqbX9F07aJ7KtKEGeHGLOXN9U6T0ADxo+BCM3503j5iL4z99EZkChSwxjL s+LAOX3NLW+ZSw/g18wqstaJ69x0mvySKc01Y= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; b=BLXY3CoZHeqctUkZ8BEaczlY8RmOj2yekpsazJ/MhPMDhXtWG8ZNlW4bpyk7gTWlCy 7nk2rgqbyA0Rs7nmuasTPwLyfFWnrdQgHvP+uT/06hSOgK61DyvyDFd7cWuTBSE/VWXl wVCh8Ijue765UOdk2OPNCgmVFTKsExmG8opE4= MIME-Version: 1.0 Received: by 10.239.185.195 with SMTP id d3mr421549hbh.184.1264234446382; Sat, 23 Jan 2010 00:14:06 -0800 (PST) In-Reply-To: References: <5da0588e1001222223m773648am907267235bdcf882@mail.gmail.com> Date: Sat, 23 Jan 2010 03:14:06 -0500 Message-ID: <5da0588e1001230014k1b8a32f8v42046497265429ed@mail.gmail.com> From: Rich To: Artem Belevich Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-fs Subject: Re: Errors on a file on a zpool: How to remove? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jan 2010 08:14:08 -0000 I already diagnosed the bad hardware - one of the two sticks of RAM had gone bad, and fails memtest in the other machine. pool: rigatoni state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scrub: scrub completed after 15h28m with 1 errors on Thu Jan 21 18:09:25 2010 config: NAME STATE READ WRITE CKSUM rigatoni ONLINE 0 0 1 da4 ONLINE 0 0 2 da5 ONLINE 0 0 2 da7 ONLINE 0 0 0 da6 ONLINE 0 0 0 da2 ONLINE 0 0 2 errors: Permanent errors have been detected in the following files: rigatoni/mirrors:<0x0> Scrubbing repeatedly does nothing to remove the note about that error, and I'd rather like to avoid trying to recreate a 7TB pool. - Rich On Sat, Jan 23, 2010 at 3:11 AM, Artem Belevich wrote: > The directory that those files are in may be corrupted. What does > zpool status -v show? > > You may want to scrub the pool if you haven't done so yet. That would > help to find all corrupted files. > > When plain files are corrupted, you should be able to remove them. You > may also try to set atime=off on the filesystem to avoid filesystem > updates on reads. > Some time back when I had zpool corruption I've found no way to remove > corrupted directory that still had some files in it. In the end I had > to rebuild the pool. > > BTW, given that your pool did get corrupted, perhaps it might be a > good idea to start moving your data somewhere else rather than worry > about how to remove corrupted files. If corruption is due to bad > hardware, bad files would just keep popping up. > > --Artem > > > > On Fri, Jan 22, 2010 at 10:23 PM, Rich wrote: >> Hey world, >> I've got a series of files in a non-redundant zpool which all report >> Input/Output Error on attempting to manipulate them in any way - stat, >> read, rm, anything. >> >> Whenever anything is attempted, the following style of thing is >> printed to /var/log/messages: >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da4 offset=1231402180608 size=8192 >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da5 offset=446136819712 size=8192 >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da2 offset=320393101312 size=8192 >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da5 offset=446136819712 size=8192 >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da2 offset=320393101312 size=8192 >> Jan 23 01:22:34 manticore root: ZFS: checksum mismatch, zpool=rigatoni >> path=/dev/da4 offset=1231402180608 size=8192 >> Jan 23 01:22:35 manticore root: ZFS: zpool I/O failure, zpool=rigatoni error=86 >> >> What can I do? I really would like to just purge all of these files >> from orbit, since I can recreate them, but I can't seem to delete >> them, and deleting the pool is a really inconvenient option, as I have >> other data on it. >> >> I'm running 8.0-RELEASE stock on amd64. >> >> Thanks! >> >> - Rich >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >> > -- Todo homem morre, mas nem todo homem vive. -- William Wallace