From owner-freebsd-current@FreeBSD.ORG Mon Oct 3 22:20:00 2011 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id CD42D106566C for ; Mon, 3 Oct 2011 22:20:00 +0000 (UTC) (envelope-from artemb@gmail.com) Received: from mail-yw0-f54.google.com (mail-yw0-f54.google.com [209.85.213.54]) by mx1.freebsd.org (Postfix) with ESMTP id 89F3F8FC12 for ; Mon, 3 Oct 2011 22:20:00 +0000 (UTC) Received: by ywp17 with SMTP id 17so4923819ywp.13 for ; Mon, 03 Oct 2011 15:19:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=mime-version:sender:in-reply-to:references:date :x-google-sender-auth:message-id:subject:from:to:cc:content-type :content-transfer-encoding; bh=NoTd1xmMX5wqncgooRiGRbBXzr2F4FH7M+kUiGhXHKo=; b=I4Ab7xgiTyeAgafglhDHvFQgz8eVx6HSIJ+WCnE/lvRjuWydf87eXFkOpMmPPt/bPY FCsAbmbmFDzzcIWW69s9E8QTFZMTFDITcY9GLZ+ajs0ZbOAykrZLJR03mSt4TjhEewWI 9w6jwrja35WL8nskAbYmHhIWVCFER2un58vq4= MIME-Version: 1.0 Received: by 10.236.175.164 with SMTP id z24mr2637021yhl.114.1317680399731; Mon, 03 Oct 2011 15:19:59 -0700 (PDT) Sender: artemb@gmail.com Received: by 10.236.103.33 with HTTP; Mon, 3 Oct 2011 15:19:59 -0700 (PDT) In-Reply-To: <8B59D754-9062-4499-9873-7C2167622032@gromit.dlib.vt.edu> References: <8B59D754-9062-4499-9873-7C2167622032@gromit.dlib.vt.edu> Date: Mon, 3 Oct 2011 15:19:59 -0700 X-Google-Sender-Auth: BvamFBEIEYd3LMH1i3vGaBn0wWI Message-ID: From: Artem Belevich To: Paul Mather Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: freebsd-current@freebsd.org Subject: Re: Strange ZFS filesystem corruption X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 03 Oct 2011 22:20:00 -0000 On Mon, Oct 3, 2011 at 11:21 AM, Paul Mather wrot= e: > =3D=3D=3D=3D=3D > > The pool itself reports no errors. =A0I performed a scrub on the pool yet= this bizarre filesystem corruption persists: > > =3D=3D=3D=3D=3D > tape# zpool status backups > =A0pool: backups > =A0state: ONLINE > =A0scan: scrub repaired 15K in 7h33m with 0 errors on Sat Oct =A01 19:22:= 35 2011 The pool *did* report 15K errors that it was able to repair. I'd start with testing your RAM with memtest86 or memtest86+. ZFS errors without reported checksum errors may be the sign of bad memory. I.e. data gets corrupted before ZFS gets to calculate checksum and later invalid data with valid checksum gets written to disk. --Artem