From owner-freebsd-fs@FreeBSD.ORG Wed Jun 20 17:20:29 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 96ED21065670 for ; Wed, 20 Jun 2012 17:20:29 +0000 (UTC) (envelope-from rondzierwa@comcast.net) Received: from qmta04.westchester.pa.mail.comcast.net (qmta04.westchester.pa.mail.comcast.net [76.96.62.40]) by mx1.freebsd.org (Postfix) with ESMTP id 540C78FC1A for ; Wed, 20 Jun 2012 17:20:29 +0000 (UTC) Received: from omta08.westchester.pa.mail.comcast.net ([76.96.62.12]) by qmta04.westchester.pa.mail.comcast.net with comcast id QgXC1j0040Fqzac54hLPlT; Wed, 20 Jun 2012 17:20:23 +0000 Received: from sz0192.wc.mail.comcast.net ([76.96.59.160]) by omta08.westchester.pa.mail.comcast.net with comcast id QhLP1j00Z3TRaxG3UhLPzT; Wed, 20 Jun 2012 17:20:23 +0000 Date: Wed, 20 Jun 2012 17:20:23 +0000 (UTC) From: rondzierwa@comcast.net To: freebsd-fs@freebsd.org Message-ID: <1610905794.19241.1340212823047.JavaMail.root@sz0192a.westchester.pa.mail.comcast.net> In-Reply-To: <20120618120031.84A4D1065749@hub.freebsd.org> MIME-Version: 1.0 X-Originating-IP: [68.50.136.212] X-Mailer: Zimbra 6.0.13_GA_2944 (ZimbraWebClient - FF3.0 (Win)/6.0.13_GA_2944) Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS Checksum errors X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Jun 2012 17:20:29 -0000 Greetings, I have a zfs filesystem on an 8.2-release amd64 system. hardware is amd phenom 964 with 8gb memory, 3ware 9650 controller with 8x seagate ST2000DL003 drives. the disks are configured in a raid-5, and present one device to the system. Early today I got some checksum and i/o errors on the console: Jun 20 07:33:43 phoenix root: ZFS: checksum mismatch, zpool=zfsPool path=/dev/da0 offset=7698387574272 size=9728 Jun 20 07:33:43 phoenix root: ZFS: checksum mismatch, zpool=zfsPool path=/dev/da0 offset=7698387564544 size=9728 Jun 20 07:33:43 phoenix root: ZFS: zpool I/O failure, zpool=zfsPool error=86 Jun 20 07:33:43 phoenix root: ZFS: checksum mismatch, zpool=zfsPool path=/dev/da0 offset=7698387574272 size=9728 Jun 20 07:33:43 phoenix root: ZFS: zpool I/O failure, zpool=zfsPool error=86 So I ran a scrub, after a couple of hours i got a pile of checksum errors that looked rather similar: Jun 20 12:45:24 phoenix root: ZFS: checksum mismatch, zpool=zfsPool path=/dev/da0 offset=560450768384 size=4096 zpool status indicates that a file has errors, but doesn't tell me its name: phoenix# zpool status -v zfsPool pool: zfsPool state: ONLINE status: One or more devices has experienced an error resulting in data corruption. Applications may be affected. action: Restore the file in question if possible. Otherwise restore the entire pool from backup. see: http://www.sun.com/msg/ZFS-8000-8A scrub: scrub in progress for 5h27m, 18.71% done, 23h42m to go config: NAME STATE READ WRITE CKSUM zfsPool ONLINE 0 0 38 da0 ONLINE 0 0 434 1.06M repaired errors: Permanent errors have been detected in the following files: zfsPool/raid:<0x9e241> phoenix# How can I locate and get rid of the offending file? thanks, ron.