From owner-freebsd-fs@FreeBSD.ORG  Mon Aug 20 07:28:04 2007
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 8C70C16A417
	for <freebsd-fs@freebsd.org>; Mon, 20 Aug 2007 07:28:04 +0000 (UTC)
	(envelope-from kvs@binarysolutions.dk)
Received: from solow.pil.dk (relay.pil.dk [195.41.47.164])
	by mx1.freebsd.org (Postfix) with ESMTP id 548F113C481
	for <freebsd-fs@freebsd.org>; Mon, 20 Aug 2007 07:28:04 +0000 (UTC)
	(envelope-from kvs@binarysolutions.dk)
Received: from coruscant.local (naboo.binarysolutions.dk [80.196.17.173])
	by solow.pil.dk (Postfix) with ESMTP id D7C0B1CC09C
	for <freebsd-fs@freebsd.org>; Mon, 20 Aug 2007 09:28:02 +0200 (CEST)
Received: by coruscant.local (Postfix, from userid 502)
	id BEC33587CEE; Mon, 20 Aug 2007 09:28:00 +0200 (CEST)
To: freebsd-fs@freebsd.org
References: <m1wsvtkviw.fsf@binarysolutions.dk>
From: Kenneth Vestergaard Schmidt <kvs@pil.dk>
Date: Mon, 20 Aug 2007 09:28:00 +0200
In-Reply-To: <m1wsvtkviw.fsf@binarysolutions.dk> (Kenneth Vestergaard
	Schmidt's message of "Sat\, 18 Aug 2007 12\:05\:27 +0200")
Message-ID: <m17inq1x8f.fsf@binarysolutions.dk>
User-Agent: Gnus/5.11 (Gnus v5.11) Emacs/22.1 (darwin)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Subject: Re: ZFS: 'checksum mismatch' all over the place
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 20 Aug 2007 07:28:04 -0000

Kenneth Vestergaard Schmidt <kvs@pil.dk> writes:
> We've just put a 12x750 GB raidz2 pool into use, but we're seeing
> constant 'checksum mismatch' errors. The drives are brand new.

And now the pool failed :(

I'm very puzzled by the fact, that the 'checksum mismatch' errors seem
to occur at the same offset on multiple disks:

Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da0 offset=58350080 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da1 offset=58350080 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da2 offset=58350080 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da3 offset=58350080 size=512

Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da2 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da3 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da4 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da5 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da6 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da7 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da8 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da9 offset=38010880 size=512
Aug 20 01:00:24 leibniz root: ZFS: checksum mismatch, zpool=pil path=/dev/da10 offset=38010880 size=512

Can anybody offer anything to help me with this? I'm pretty much at a
loss as to how I can find the cause of this.

-- 
Kenneth Schmidt
pil.dk