From owner-freebsd-fs@FreeBSD.ORG Tue Jan 26 18:03:47 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 32027106568D for ; Tue, 26 Jan 2010 18:03:47 +0000 (UTC) (envelope-from pathiaki2@yahoo.com) Received: from web110504.mail.gq1.yahoo.com (web110504.mail.gq1.yahoo.com [67.195.8.252]) by mx1.freebsd.org (Postfix) with SMTP id 002988FC1A for ; Tue, 26 Jan 2010 18:03:46 +0000 (UTC) Received: (qmail 76607 invoked by uid 60001); 26 Jan 2010 18:03:46 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1264529026; bh=C5dWfDgOVH7xUwMg0dy2a1VVVHapctK2AKxbHBKIM8Q=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=QnqNF//RHqVss3AEHRzu5sC0FXTapbKOpmqv0Np6aa17ef7vQ75oVl9tX8640ZtO+HxAN58Mtca0CzUjFch5H/QQjaVjtiw4zclgnJNtmwB4qybFMccuf1xFJr9s2jnk7vk8AxKV/zz2WFy5n8Ev48F83uOKRc4nIjivKGuGfgQ= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type; b=2iC1bFpFwC/y751YxvdINfTbvgUEc6qo93tRrBwEG2oJsZh9wOXGU0gF7aC8Dwqug2TedquUpKG4xpVEYA17NdRUMeBbMtFNNjS97jWXQhsMHZFUdydRVeO4f38ahLONveH6+4cFmk6fUSS6u3yaf5w93cK7UKAmjZNZsvj6boA=; Message-ID: <422431.76479.qm@web110504.mail.gq1.yahoo.com> X-YMail-OSG: n6r3MdQVM1mMPgEoVq5e79WxkXmEaknf36S9IE9UPvth5ObYCVz7Azmje4B2BSSx2IwSNIsLO.d.T2f5nN8u0PqWm1WNlFkBuh0YlRTJLoP8paHPwSmEW1g1onDX31mQ19x4FWHTm6XVqqyX6KHX9zt38ORVq15EHVdK_YpaRj3EgIOPSZOx42lKnanbC54XovYaNWOTBj0my8CWpwcJ5OjtP7wfkTHoT9oJfWwNaGuHAA84ekllYXsHEwyo74cSVRLE0q6D6QdTUzugUMKBVImZ3SJqdm2qfankGAYURSyrHZk31XsL6lDikFZ0sj_zvc6oLum58ZoAMwFwXagxcuQj9YxbdESeA5BDCfmpVYwv0fUgJ4gW3xnPzXhxP9EO1n9Q40yUGf_BhQMVzobm78dul3mNBR.2SrkcTUJ_tZNcikoeEDEvm3cyEWXmzvNC77R_HV6v4b0N0oUiyY2CT0Xs6J1488MOieqef84Gsxm.UzowTemEiHuDTZn2Z0Nj7bAYiAWoJA-- Received: from [71.174.61.120] by web110504.mail.gq1.yahoo.com via HTTP; Tue, 26 Jan 2010 10:03:46 PST X-Mailer: YahooMailRC/272.7 YahooMailWebService/0.8.100.260964 References: <419976.64363.qm@web110515.mail.gq1.yahoo.com> Date: Tue, 26 Jan 2010 10:03:46 -0800 (PST) From: Paul Pathiakis To: Bob Friesenhahn , Xin LI In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-fs@freebsd.org Subject: Re: ZFS - scrub lead to corruption? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jan 2010 18:03:47 -0000 From: Bob Friesenhahn To: Xin LI Cc: Paul Pathiakis ; freebsd-fs@freebsd.org Sent: Tue, January 26, 2010 11:04:39 AM Subject: Re: ZFS - scrub lead to corruption? On Mon, 25 Jan 2010, Xin LI wrote: >> 16) scrub continues to over 75% (I wasn't watching for the exact #) and then *panic* level 12 > > Do you have console access to the server? Try setting up a crash dump > and see if you can obtain a backtrace? > > By the way, 'zpool status -x' may give some information that is useful. Since scrub automatically re-starts after system reboots, it should help to use 'zpool scrub -s pool' immediately after boot (assuming there is enough time to do a console login) to stop the existing scrub. This may defer the panic enough to figure out what is going wrong. I used to get system panics here (Solaris 10) during scrub, but it was eventually determined that a flaky fiber channel card was to blame. Two systems paniced here during 'zfs scrub' and both times it was due to problems with an adaptor card. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/ Thank you, Bob. It worked fine. I'm up and working on the machine as I'm typing this. The zpool status says everything's fine. (??!!) That's a relief. However, why did the scrub cause it to crash? I'd like to ask this list a serious question: What can I do to check what is causing scrub to panic the machine? Is there any other consistency tool that I can run on ZFS to see if something is corrupted/wrong? As a forward action, I'm going to cvsup STABLE again and try rebuilding. I'm about to check to see if m4 is still there but I'm worried that the /usr/bin directory is where my trouble exists and I'll be crashing again. Please let me know. (Bob, BTW, I just checked into OpenSolaris bootable CD it's nice, you may want to check it out - FreeBSD is still a passion due to it's BSD storied history.) Thanks! Paul I'd like to ask this list