From owner-freebsd-fs@FreeBSD.ORG Tue Jan 26 00:11:01 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 283361065676 for ; Tue, 26 Jan 2010 00:11:01 +0000 (UTC) (envelope-from pathiaki2@yahoo.com) Received: from web110515.mail.gq1.yahoo.com (web110515.mail.gq1.yahoo.com [67.195.8.120]) by mx1.freebsd.org (Postfix) with SMTP id EAD538FC1E for ; Tue, 26 Jan 2010 00:11:00 +0000 (UTC) Received: (qmail 65958 invoked by uid 60001); 25 Jan 2010 23:44:19 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1264463059; bh=lItq8spPMhE4siLdt3cJEtcVAQbdqeQsCr7zK/K21W0=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=HXysMSFqVyZfRQSDG/mbCwnYazk1kmkMyl7du7zXNh+/IdW3DLyqAZm4od7FML1HdnhN7xQJ8WllQ5OBW/B2uMXYcVXa8lKfeyJIzLsH38AWXQVGoIGgYUYhLnsGVl4ixeHVW6wBppenGBIUhWYEg5WbI53XxHvUGxTFpDfblZ0= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type; b=I2K6HiEzSags6IWxueCeGWrJVWlT83nwcEMA2cSWseXdtkk8GS6XgJXtdfYnCwd4fany2BKoXWVMIVI/q0tUi9DZSXUfat+R7xKrOt3v/ccBZej045znhr13Rys6pPf7F60IspDTauB1sxrPL7kYN4uXCYpHmhms2oIVrgtwDRw=; Message-ID: <419976.64363.qm@web110515.mail.gq1.yahoo.com> X-YMail-OSG: dK1Ak4oVM1kGAkxXG18SG2hVmUAU4qYTosgzNZUHc8GRQX6Ff0HIzZ5ijFG3T_NZKOzlX7KqLg.tPvg9h9b7Y7B5067XqWLrVR.ALZ6l2jt_SZsDzL4yforw6ZiwcuysUNEzC9f0cBMJOBJOFRHfAKXO5.NmvizQJcKbXoYEQTTf30GGQzNH2Ywqq6EIyZzsboY26wNGD2tj6P.l01RPe0JDfB7.8zVKAC1AzqKmOU7eRyG06.4Luc6IH4lXTEXauiaTNmirKp8VR8ynpkMou3yAjXLrBYmlQNzPnDr3chnyZf46Q5_LDNcVjg-- Received: from [71.174.61.120] by web110515.mail.gq1.yahoo.com via HTTP; Mon, 25 Jan 2010 15:44:19 PST X-Mailer: YahooMailRC/272.7 YahooMailWebService/0.8.100.260964 Date: Mon, 25 Jan 2010 15:44:19 -0800 (PST) From: Paul Pathiakis To: freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: ZFS - scrub lead to corruption? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jan 2010 00:11:01 -0000 Hi, My ZFS-only machine running on 8.0-stable as of ???? is down hard. It is a mirrored pair of Segate 1500 GB drives (yes, I know the firmware history of these drives and they are a late version.) The sequence of events is as follows: 1) cvsup ports 2) portupgrade -a -r -p 3) everything completes successfully. 4) cvsup the latest 8.0 code. 5) make buildworld 6) while it was compiling, it requested m4 and said "not found" 7) which m4 -> not found 8) I find that /usr/bin/m4 is "there" with ls /usr/bin/m4. 9) cd /usr/ports/devel/m4 -> /usr 10) make; make deinstall; make package; no issues. 11) cd /usr/src; make buildworld. Same behavior. 12) ls -sal /usr/bin/m4 -> Panic 13) Reboot 14) zpool status web everything is fine and online. :-) No errors. 15) zpool scrub web 16) scrub continues to over 75% (I wasn't watching for the exact #) and then *panic* level 12 17) I reboot single user. 18) It mounts the web at / 19) At that point, I'm deciding what to do and .... Panic level 12 (I assume ZFS was scrubbing in the background and killed me. 20) Help! How do I recover from this and what additional information does anyone need? I know there's no fsck on ZFS but how do I rollback prior to the writes that caused this? Also, I never enabled snapshots or anything else outside of mirroring. Thank you for the help, Paul