From owner-freebsd-current@FreeBSD.ORG Tue May 26 20:34:17 2009 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 679551065670; Tue, 26 May 2009 20:34:17 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from thebighonker.lerctr.org (thebighonker.lerctr.org [192.147.25.65]) by mx1.freebsd.org (Postfix) with ESMTP id 3FC7E8FC1B; Tue, 26 May 2009 20:34:16 +0000 (UTC) (envelope-from ler@lerctr.org) Received: from 76-205-169-61.lightspeed.austtx.sbcglobal.net ([76.205.169.61]:32231 helo=borg) by thebighonker.lerctr.org with esmtpsa (TLSv1:AES256-SHA:256) (Exim 4.69 (FreeBSD)) (envelope-from ) id 1M93Lj-000K9D-96; Tue, 26 May 2009 15:34:16 -0500 Date: Tue, 26 May 2009 15:34:01 -0500 (CDT) From: Larry Rosenman Sender: ler@borg To: freebsd-current@freebsd.org In-Reply-To: Message-ID: References: <3c1674c90905242253n544c3f0cqb10952f349391ce7@mail.gmail.com> <454b8cc37c60ab7af2663ba70ddbfd59.squirrel@webmail.lerctr.org> <5a9a181a12e9e4ef864d23ae063f7277.squirrel@webmail.lerctr.org> <4A1BE241.5030706@kasimir.com> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Spam-Score: -2.3 (--) X-LERCTR-Spam-Score: -2.3 (--) X-Spam-Report: SpamScore (-2.3/5.0) ALL_TRUSTED=-1.8, BAYES_00=-2.599, SARE_SUB_OBFU_OTHER=0.135, TVD_RCVD_IP=1.931 X-LERCTR-Spam-Report: SpamScore (-2.3/5.0) ALL_TRUSTED=-1.8, BAYES_00=-2.599, SARE_SUB_OBFU_OTHER=0.135, TVD_RCVD_IP=1.931 DomainKey-Status: no signature Cc: kmacy@freebsd.org Subject: Re: ZFS Crash X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 May 2009 20:34:17 -0000 On Tue, 26 May 2009, Larry Rosenman wrote: > I've started running the below script every minute from cron. > > If anyone wants to look at the data let me know (it's on a Resi DSL line, so > I don't want to run an http server). > > I'm willing to give SSH accounts to @FreeBSD.org devs to look around. > > script: > > #!/bin/sh > DATE=`date +%Y%m%d.%H%M%S` > (echo "Uptime:";uptime;echo "vmstat -m:";vmstat -m > echo "vmstat -z:";vmstat -z) >/home/ler/stats/${DATE}.stats > Just to make sure nothing really funky was happening, I blew away my /usr/obj filesystem (zfs delete vault/usr/obj;zfs create vault/usr/obj) and rebuild world/kernel and installed same. During the reboot I turned off cron and moved the stats files to a separate directory, so now my stats directory has a full history (at least as soon as cron comes up) of this boot. I'll see what we get when it crashes next. I'm still very interested in helping to get to the bottom of this and will supply whatever information I can. Please feel free to ask. I want to help. I can give ssh accounts to any @FreeBSD.org dev that wants to look around. LER -- Larry Rosenman http://www.lerctr.org/~ler Phone: +1 512-248-2683 E-Mail: ler@lerctr.org US Mail: 430 Valona Loop, Round Rock, TX 78681-3893