From owner-freebsd-fs@FreeBSD.ORG Mon Nov 20 05:00:20 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 90EA416A412 for ; Mon, 20 Nov 2006 05:00:20 +0000 (UTC) (envelope-from sjr@comcast.net) Received: from alnrmhc12.comcast.net (alnrmhc12.comcast.net [204.127.225.92]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7908C43D5F for ; Mon, 20 Nov 2006 05:00:06 +0000 (GMT) (envelope-from sjr@comcast.net) Received: from istari.comcast.net (c-68-32-119-244.hsd1.md.comcast.net[68.32.119.244](misconfigured sender)) by comcast.net (alnrmhc12) with ESMTP id <20061120050019b1200mt7g4e>; Mon, 20 Nov 2006 05:00:19 +0000 Received: from istari.comcast.net (localhost [127.0.0.1]) by istari.comcast.net (8.13.8/8.13.8) with ESMTP id kAK50BSs031888; Mon, 20 Nov 2006 00:00:15 -0500 (EST) (envelope-from sjr@istari.comcast.net) Message-Id: <200611200500.kAK50BSs031888@istari.comcast.net> Date: Mon, 20 Nov 2006 00:00:11 -0500 (EST) From: "Stephen J. Roznowski" To: lapo@lapo.it In-Reply-To: MIME-Version: 1.0 Content-Type: TEXT/plain; charset=us-ascii Cc: freebsd-fs@freebsd.org Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 20 Nov 2006 05:00:20 -0000 On 13 Nov, Lapo Luchini wrote: > Kostik Belousov gmail.com> writes: > >> > >After some searching, I've found a bug report filed last year that >> > >describes this problem exactly, though the log of that report does >> > >not suggest that anything has been done with it. That report is at >> > >http://www.freebsd.org/cgi/query-pr.cgi?pr=kern/90512 >> >> James, look at the PR/100365. Supposed fix is MFCed. Original reporter >> said that this changed nothing for him. I have not much time lately to >> look at this problem, but would like to get additional data points. As the submitter of 100365, I still don't think that snapshots on amd64 are working correctly. When I (still) run the code attached to the PR, I still see a problem -- the problem is that sometimes the filesystem is busy and mksnap_ffs "errors out" and doesn't create a snapshot. I spent a little bit of time looking at mksnap_ffs to see if I could get it to retry the snapshot if the filesystem is busy to no avail. I've given up on my automated script to do a backup and just generate (and fsck by hand) a snapshot until I get a working one.... Thanks, -SR -- Stephen J. Roznowski (sjr@comcast.net) From owner-freebsd-fs@FreeBSD.ORG Tue Nov 21 02:40:38 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9684216A415 for ; Tue, 21 Nov 2006 02:40:38 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 49A7943D91 for ; Tue, 21 Nov 2006 02:40:06 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id 72A95C2EC; Mon, 20 Nov 2006 21:40:22 -0500 (EST) Received: from zoraida.natserv.net (zoraida.natserv.net [66.114.65.147]) by zoraida.natserv.net (Postfix) with ESMTP id 4EA2BB890; Mon, 20 Nov 2006 21:40:22 -0500 (EST) References: Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Ivan Voras Date: Mon, 20 Nov 2006 21:40:22 -0500 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: what is the safe <2 TB number, precisely ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Nov 2006 02:40:38 -0000 Ivan Voras writes: > As Eric said, the 2 TB issue is not tied to the file system. It's tied > to the fdisk and disklabel. A perfectly valid workaround is not to use > fdisk & disklabel to partition your drive, but to partition it in the > array creation utility (safest) or use gpt (but you can't modify the gpt > table if there are mounted partitions on it). > > Thus, you can do "newfs /dev/da1", "mount /dev/da1 /whatever", etc. Where can I find information about the "array creation utility"? A couple of searches did not return anything. From owner-freebsd-fs@FreeBSD.ORG Tue Nov 21 03:13:20 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8E65016A40F for ; Tue, 21 Nov 2006 03:13:20 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id A12D243D5C for ; Tue, 21 Nov 2006 03:13:00 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [192.168.42.21] (andersonbox1.centtech.com [192.168.42.21]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id kAL3DE5l049348; Mon, 20 Nov 2006 21:13:14 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <45626EC9.5000306@centtech.com> Date: Mon, 20 Nov 2006 21:13:13 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20061015) MIME-Version: 1.0 To: Francisco Reyes References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2209/Mon Nov 20 16:40:59 2006 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: what is the safe <2 TB number, precisely ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 21 Nov 2006 03:13:20 -0000 On 11/20/06 20:40, Francisco Reyes wrote: > Ivan Voras writes: > > >> As Eric said, the 2 TB issue is not tied to the file system. It's tied >> to the fdisk and disklabel. A perfectly valid workaround is not to use >> fdisk & disklabel to partition your drive, but to partition it in the >> array creation utility (safest) or use gpt (but you can't modify the gpt >> table if there are mounted partitions on it). >> >> Thus, you can do "newfs /dev/da1", "mount /dev/da1 /whatever", etc. > > Where can I find information about the "array creation utility"? > > A couple of searches did not return anything. What he meant (presumably) is the utility that came with the hardware array itself, to create logical drives within the array hardware, so it is presented to FreeBSD as a device all of its own. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 01:27:43 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 13DEA16A416 for ; Wed, 22 Nov 2006 01:27:43 +0000 (UTC) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (p65-147.acedsl.com [66.114.65.147]) by mx1.FreeBSD.org (Postfix) with ESMTP id 34D8D43D49 for ; Wed, 22 Nov 2006 01:27:17 +0000 (GMT) (envelope-from lists@stringsutils.com) Received: from zoraida.natserv.net (localhost.natserv.net [127.0.0.1]) by zoraida.natserv.net (Postfix) with ESMTP id B31EEC2EC; Tue, 21 Nov 2006 20:27:38 -0500 (EST) Received: from 35st-server.simplicato.com (static-71-249-233-130.nycmny.east.verizon.net [71.249.233.130]) by zoraida.natserv.net (Postfix) with ESMTP id 5BB91B88A; Tue, 21 Nov 2006 20:27:38 -0500 (EST) References: <45626EC9.5000306@centtech.com> Message-ID: X-Mailer: http://www.courier-mta.org/cone/ From: Francisco Reyes To: Eric Anderson Date: Tue, 21 Nov 2006 20:27:37 -0500 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset="US-ASCII" Content-Disposition: inline Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: what is the safe <2 TB number, precisely ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 01:27:43 -0000 Eric Anderson writes: > What he meant (presumably) is the utility that came with the hardware > array itself, to create logical drives within the array hardware, so it > is presented to FreeBSD as a device all of its own. Ah gotcha. I think I have seen this in the 3ware cards. Will try it in the next 2T+ machine. Anyone has done this in 3ware cards? From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 06:40:06 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 26A1A16A403 for ; Wed, 22 Nov 2006 06:40:06 +0000 (UTC) (envelope-from dundeemt@gmail.com) Received: from nf-out-0910.google.com (nf-out-0910.google.com [64.233.182.187]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7E8D243D5A for ; Wed, 22 Nov 2006 06:39:38 +0000 (GMT) (envelope-from dundeemt@gmail.com) Received: by nf-out-0910.google.com with SMTP id x37so410354nfc for ; Tue, 21 Nov 2006 22:40:03 -0800 (PST) DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=EgV+lVayep7aCqrHZJ8SB4mFfNujN8BOm2aZUhujPM3R996ZBJEDwTzE6nssBzoPYJbQ7Rv+HH04J9Pd0P5ZRiM4CzUZeLzTMOGd8w3kHLH4NVYGkyj3A9JTkpFxwUNMiTevXlp7h3lGCJSv+QUeK4Km2GpF1dPy0db1lV1ZR4Y= Received: by 10.82.152.16 with SMTP id z16mr1176212bud.1164177603590; Tue, 21 Nov 2006 22:40:03 -0800 (PST) Received: by 10.82.108.18 with HTTP; Tue, 21 Nov 2006 22:40:03 -0800 (PST) Message-ID: <5aaed53f0611212240o38e6962brffbaba519a118c6f@mail.gmail.com> Date: Wed, 22 Nov 2006 00:40:03 -0600 From: "Jeff Hinrichs - DM&T" Sender: dundeemt@gmail.com To: "Francisco Reyes" In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline References: <45626EC9.5000306@centtech.com> X-Google-Sender-Auth: 23c4c08b05d768f9 Cc: freebsd-fs@freebsd.org, Ivan Voras Subject: Re: what is the safe <2 TB number, precisely ? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 06:40:06 -0000 On 11/21/06, Francisco Reyes wrote: > Eric Anderson writes: > > > What he meant (presumably) is the utility that came with the hardware > > array itself, to create logical drives within the array hardware, so it > > is presented to FreeBSD as a device all of its own. > > Ah gotcha. I think I have seen this in the 3ware cards. > Will try it in the next 2T+ machine. > > Anyone has done this in 3ware cards? > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" > I've used Highpoint cards at work and home with success. They are doing a much better job at supporting FreeBSD so I figure they should be mentioned. I've got 2TB of RAID5 (4x500 SATA II on the 1740) the OS is sitting on a gmirror pair of IDE's and there is another TB of Firewire external storage. -Jeff From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 12:04:32 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 77AF216A494 for ; Wed, 22 Nov 2006 12:04:32 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id E86E943D9A for ; Wed, 22 Nov 2006 12:00:55 +0000 (GMT) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1Gmqn1-0008Sx-0O for freebsd-fs@freebsd.org; Wed, 22 Nov 2006 13:01:19 +0100 Received: from firewall.andxor.it ([195.223.2.2]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 22 Nov 2006 13:01:18 +0100 Received: from lapo by firewall.andxor.it with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 22 Nov 2006 13:01:18 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Lapo Luchini Date: Wed, 22 Nov 2006 13:01:03 +0100 Lines: 23 Message-ID: References: <854C78DB-2099-4DA5-9E3B-F30D6947C532@jlauser.net> <4512F957.2090205@centtech.com> <20060922041535.GF4842@deviant.kiev.zoral.com.ua> <455890AE.9050807@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: firewall.andxor.it User-Agent: Thunderbird 1.5.0.8 (X11/20061116) In-Reply-To: <455890AE.9050807@centtech.com> X-Enigmail-Version: 0.94.0.0 OpenPGP: Sender: news Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 12:04:32 -0000 Eric Anderson wrote: >> Panic String: snapacct_ufs2: bad block >> I have the dump file, for the latest problem. > Maybe you have a bad disk? You might try swapping the drive out. (just > a wild guess here) Does "snapacct_ufs2: bad block" really mean "bad" as in "unreadable"? RTFS I tought it was just a "logic" inconsistency. Anyway, after having de-activated all snapshots for weeks (and deleted all the old ones) I got this panic again. I'm currently doing a "dd if=/dev/ad0 of=/dev/null bs=1m" as suggested by dd(1) in order to be sure it is not an hardwareissue. And if all is well I will "dd if=/dev/ad0 of=/dev/ad0 bs=1m" too. And then recompile with latest -STABLE just to be sure to have the latest amd64-based snapshot fixes. Hope this is the last time I see that panic... -_- Lapo From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 16:24:39 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AD8A316A550 for ; Wed, 22 Nov 2006 16:24:39 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 3CC2243D70 for ; Wed, 22 Nov 2006 16:24:06 +0000 (GMT) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1GmutQ-00067Q-Vh for freebsd-fs@freebsd.org; Wed, 22 Nov 2006 17:24:13 +0100 Received: from firewall.andxor.it ([195.223.2.2]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 22 Nov 2006 17:24:12 +0100 Received: from lapo by firewall.andxor.it with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Wed, 22 Nov 2006 17:24:12 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Lapo Luchini Date: Wed, 22 Nov 2006 17:23:49 +0100 Lines: 8 Message-ID: References: <854C78DB-2099-4DA5-9E3B-F30D6947C532@jlauser.net> <4512F957.2090205@centtech.com> <20060922041535.GF4842@deviant.kiev.zoral.com.ua> <455890AE.9050807@centtech.com> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: firewall.andxor.it User-Agent: Thunderbird 1.5.0.8 (X11/20061116) In-Reply-To: X-Enigmail-Version: 0.94.0.0 OpenPGP: Sender: news Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 16:24:39 -0000 Lapo Luchini wrote: > And if all is well I will "dd if=/dev/ad0s1f of=/dev/ad0s1f bs=1m" too. ...which reported no error at all. BTW: I have a new dump as well (same "bad block" panic), just in case. Lapo From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 17:12:13 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AFEA716A403 for ; Wed, 22 Nov 2006 17:12:13 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id E41C043E28 for ; Wed, 22 Nov 2006 17:08:58 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id 679731A3C1E; Wed, 22 Nov 2006 09:09:28 -0800 (PST) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id B110C5126C; Wed, 22 Nov 2006 12:09:13 -0500 (EST) Date: Wed, 22 Nov 2006 12:09:13 -0500 From: Kris Kennaway To: Lapo Luchini Message-ID: <20061122170913.GA38255@xor.obsecurity.org> References: <854C78DB-2099-4DA5-9E3B-F30D6947C532@jlauser.net> <4512F957.2090205@centtech.com> <20060922041535.GF4842@deviant.kiev.zoral.com.ua> <455890AE.9050807@centtech.com> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="d6Gm4EdcadzBjdND" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.2i Cc: freebsd-fs@freebsd.org Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 17:12:13 -0000 --d6Gm4EdcadzBjdND Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 22, 2006 at 01:01:03PM +0100, Lapo Luchini wrote: > Eric Anderson wrote: > >> Panic String: snapacct_ufs2: bad block > >> I have the dump file, for the latest problem. > > Maybe you have a bad disk? You might try swapping the drive out. (just > > a wild guess here) >=20 > Does "snapacct_ufs2: bad block" really mean "bad" as in "unreadable"? > RTFS I tought it was just a "logic" inconsistency. >=20 > Anyway, after having de-activated all snapshots for weeks (and deleted > all the old ones) I got this panic again. >=20 > I'm currently doing a "dd if=3D/dev/ad0 of=3D/dev/null bs=3D1m" as sugges= ted > by dd(1) in order to be sure it is not an hardwareissue. >=20 > And if all is well I will "dd if=3D/dev/ad0 of=3D/dev/ad0 bs=3D1m" too. >=20 > And then recompile with latest -STABLE just to be sure to have the > latest amd64-based snapshot fixes. >=20 > Hope this is the last time I see that panic... -_- I've lost context, how are you reproducing the panic? Kris --d6Gm4EdcadzBjdND Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFFZIQ5Wry0BWjoQKURAuzPAKDb5arS5uVct5eHUfMgp8mbsgScfwCeOM9I 1sew/C9nM3fzUZ07EYQ6lkM= =n0F5 -----END PGP SIGNATURE----- --d6Gm4EdcadzBjdND-- From owner-freebsd-fs@FreeBSD.ORG Wed Nov 22 19:29:41 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 38D1816A40F; Wed, 22 Nov 2006 19:29:41 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.FreeBSD.org (Postfix) with ESMTP id 107BA43D55; Wed, 22 Nov 2006 19:29:09 +0000 (GMT) (envelope-from killing@multiplay.co.uk) Received: from vader ([212.135.219.179]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon PRO v9.0.1) with ESMTP id md50003244656.msg; Wed, 22 Nov 2006 19:28:56 +0000 Message-ID: <027b01c70e6c$6c879470$b3db87d4@multiplay.co.uk> From: "Steven Hartland" To: "Kostik Belousov" , "Mike Jakubik" References: <447366AD.30203@rogers.com> <44736E11.6060104@mkproductions.org><20060523203521.GA48061@xor.obsecurity.org><20060524062118.GA766@dimma.mow.oilspace.com><447400BB.9060603@samsco.org> <4485C010.9040402@rogers.com><20060606182234.GB72368@deviant.kiev.zoral.com.ua><44A490E6.1000502@rogers.com><20060630092829.GE1258@deviant.kiev.zoral.com.ua><44A56E0F.1070904@rogers.com> <20060701034922.GA37822@deviant.kiev.zoral.com.ua> Date: Wed, 22 Nov 2006 19:28:37 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2869 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962 X-Spam-Processed: multiplay.co.uk, Wed, 22 Nov 2006 19:28:56 +0000 (not processed: message from valid local sender) X-MDRemoteIP: 212.135.219.179 X-Return-Path: killing@multiplay.co.uk X-MDAV-Processed: multiplay.co.uk, Wed, 22 Nov 2006 19:28:56 +0000 Cc: freebsd-fs@freebsd.org, freebsd-stable@freebsd.org Subject: Re: md deadlocks on wdrain. Was: [Re: quota and snapshots in6.1-RELEASE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Nov 2006 19:29:41 -0000 The patch below fixed this issue for us. We had a jail which when upgrading ( installworld ) from 5.4 to 6.1 would constantly hang the machine with this error. After updating md.c to 1.164 from MAIN and applying the patch below I've managed to run installworld 3 times now without error. Previously including updated to v1.164 this would hang without fail. If this is the correct fix, it would be good to see get committed as it have the capability to knock out any box running a vnode backed jail and is very unpredictable. ----- Original Message ----- From: "Kostik Belousov" On Fri, Jun 30, 2006 at 02:31:43PM -0400, Mike Jakubik wrote: > FYI, -CURRENT passes this test without locking up, so the fix is already > there somewhere. May be. May be not, and other issues just prevent complete exhausting of the buffer run space on CURRENT. Did you test it on CURRENT many times, or only once. The same question for STABLE - does it locks every time your do that ? Please, try this patch, and report the results. ? sys/dev/md/.arch-ids Index: sys/dev/md/md.c =================================================================== RCS file: /usr/local/arch/ncvs/src/sys/dev/md/md.c,v retrieving revision 1.164 diff -u -r1.164 md.c --- sys/dev/md/md.c 28 Mar 2006 21:25:11 -0000 1.164 +++ sys/dev/md/md.c 1 Jul 2006 03:48:41 -0000 @@ -650,6 +650,8 @@ mtx_lock_spin(&sched_lock); sched_prio(curthread, PRIBIO); mtx_unlock_spin(&sched_lock); + if (sc->type == MD_VNODE) + curthread->td_pflags |= TDP_NORUNNINGBUF; for (;;) { mtx_lock(&sc->queue_mtx); ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 09:20:41 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1C8FB16A47B for ; Thu, 23 Nov 2006 09:20:41 +0000 (UTC) (envelope-from freebsd-fs@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7CB3943D5D for ; Thu, 23 Nov 2006 09:20:06 +0000 (GMT) (envelope-from freebsd-fs@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1GnAkx-0002Vx-Vk for freebsd-fs@freebsd.org; Thu, 23 Nov 2006 10:20:31 +0100 Received: from firewall.andxor.it ([195.223.2.2]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 23 Nov 2006 10:20:31 +0100 Received: from lapo by firewall.andxor.it with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 23 Nov 2006 10:20:31 +0100 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-fs@freebsd.org From: Lapo Luchini Date: Thu, 23 Nov 2006 10:20:16 +0100 Lines: 72 Message-ID: References: <854C78DB-2099-4DA5-9E3B-F30D6947C532@jlauser.net> <4512F957.2090205@centtech.com> <20060922041535.GF4842@deviant.kiev.zoral.com.ua> <455890AE.9050807@centtech.com> <20061122170913.GA38255@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 7bit X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: firewall.andxor.it User-Agent: Thunderbird 1.5.0.8 (X11/20061116) In-Reply-To: <20061122170913.GA38255@xor.obsecurity.org> X-Enigmail-Version: 0.94.0.0 OpenPGP: Sender: news Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 09:20:41 -0000 Kris Kennaway wrote: >> Anyway, after having de-activated all snapshots for weeks (and deleted >> all the old ones) I got this panic again. > I've lost context, how are you reproducing the panic? I didn't "reproduce" it, it kinda did just happen... Context: I used snapshots for a couple of months without problems, then got a panic a couple of weeks ago, I deleted all the snaps, I deactivated the periodic snapshot script, and yesterday, 7 in the morning, it just panicked again. The original panic was a few seconds after a snapshot creation, the latest one in the middle of nothing: 7 in the morning the are no users and no tasks scheduled. Parts of /var/log/message: [...] Nov 22 05:56:49 motoko ntpd[668]: kernel time sync enabled 2001 Nov 22 06:30:58 motoko ntpd[668]: kernel time sync enabled 6001 Nov 22 06:48:03 motoko ntpd[668]: kernel time sync enabled 2001 Nov 22 07:22:22 motoko syslogd: kernel boot file is /boot/kernel/kernel Nov 22 07:22:22 motoko kernel: Copyright (c) 1992-2006 The FreeBSD Project. [...] Nov 22 07:22:22 motoko savecore: reboot after panic: page fault Nov 22 07:22:22 motoko savecore: no dump, not enough free space on device (87803 6 available, need 1031746) Nov 22 07:22:22 motoko savecore: unsaved dumps found but not saved [...] Nov 22 07:25:33 motoko kernel: panic: snapacct_ufs2: bad block Nov 22 07:25:33 motoko kernel: Uptime: 3m27s Nov 22 07:25:33 motoko kernel: Dumping 1007 MB (2 chunks) Nov 22 07:25:33 motoko kernel: chunk 0: 1MB (159 pages) ... ok Nov 22 07:25:33 motoko kernel: chunk 1: 1007MB (257776 pages) 991 975 959 943 [...] 31 15 ... ok Nov 22 07:25:33 motoko kernel: Nov 22 07:25:33 motoko kernel: Dump complete Nov 22 07:25:33 motoko kernel: Automatic reboot in 15 seconds - press a key on the console to abort Nov 22 07:25:33 motoko kernel: Copyright (c) 1992-2006 The FreeBSD Project. [...manual fsck in single user...] Nov 22 15:44:51 motoko kernel: Trying to mount root from ufs:/dev/ad0s1a Nov 22 15:44:51 motoko kernel: ffs_snapshot_mount: non-snapshot inode 9 Nov 22 15:44:51 motoko savecore: reboot after panic: snapacct_ufs2: bad block Nov 22 15:44:51 motoko savecore: writing compressed core to vmcore.2.gz ...and this is the dump info (/var/crash/info.2): Dump header from device /dev/ad0s1b Architecture: amd64 Architecture Version: 2 Dump Length: 1056505856B (1007 MB) Blocksize: 512 Dumptime: Wed Nov 22 07:23:54 2006 Hostname: motoko.lapo.it Magic: FreeBSD Kernel Dump Version String: FreeBSD 6.1-STABLE #4: Fri Sep 1 17:02:50 CEST 2006 root@motoko.lapo.it:/usr/obj/usr/src/sys/MOTOKO Panic String: snapacct_ufs2: bad block Dump Parity: 3615879487 Bounds: 2 Dump Status: good This night I updated to 6.2-PRERELEASE, which contains the latest amd64-snapshot commit... hoping for the good. 'Good' as in: - in the short term: no more panics - in the long term: to use the snapshot functionality again Hope this is context enough, or else simply ask and I'll reply. =) From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 10:13:03 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 5C18916A412; Thu, 23 Nov 2006 10:13:03 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from fw.zoral.com.ua (fw.zoral.com.ua [213.186.206.134]) by mx1.FreeBSD.org (Postfix) with ESMTP id BB3EB43D5D; Thu, 23 Nov 2006 10:12:25 +0000 (GMT) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by fw.zoral.com.ua (8.13.4/8.13.4) with ESMTP id kANACoDm026463 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Thu, 23 Nov 2006 12:12:50 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8) with ESMTP id kANACo14046371; Thu, 23 Nov 2006 12:12:50 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8/Submit) id kANACkLV046370; Thu, 23 Nov 2006 12:12:46 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Thu, 23 Nov 2006 12:12:46 +0200 From: Kostik Belousov To: Steven Hartland Message-ID: <20061123101246.GM1841@deviant.kiev.zoral.com.ua> References: <447366AD.30203@rogers.com> <20060701034922.GA37822@deviant.kiev.zoral.com.ua> <027b01c70e6c$6c879470$b3db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="LQv0vi9oZBoYbpa7" Content-Disposition: inline In-Reply-To: <027b01c70e6c$6c879470$b3db87d4@multiplay.co.uk> User-Agent: Mutt/1.4.2.2i X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on fw.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=1.4 required=5.0 tests=SPF_NEUTRAL, UNPARSEABLE_RELAY autolearn=no version=3.1.4 X-Spam-Level: * X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-25) on fw.zoral.com.ua Cc: freebsd-fs@freebsd.org, Mike Jakubik , freebsd-stable@freebsd.org Subject: Re: md deadlocks on wdrain. Was: [Re: quota and snapshots in6.1-RELEASE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 10:13:03 -0000 --LQv0vi9oZBoYbpa7 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Nov 22, 2006 at 07:28:37PM -0000, Steven Hartland wrote: > The patch below fixed this issue for us. We had a jail which > when upgrading ( installworld ) from 5.4 to 6.1 would constantly > hang the machine with this error. >=20 > After updating md.c to 1.164 from MAIN and applying the patch > below I've managed to run installworld 3 times now without error. > Previously including updated to v1.164 this would hang without > fail. >=20 > If this is the correct fix, it would be good to see get committed > as it have the capability to knock out any box running a vnode > backed jail and is very unpredictable. This is not a fix, this is only a way to make the deadlock less frequent (I would not ever call it workaround). I have got a reports of deadlocks with this change applied, and I think that I understand the cause of it. Also, I have an idea of how to fix it, but not got around to even start coding. > ? sys/dev/md/.arch-ids > Index: sys/dev/md/md.c > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > RCS file: /usr/local/arch/ncvs/src/sys/dev/md/md.c,v > retrieving revision 1.164 > diff -u -r1.164 md.c > --- sys/dev/md/md.c 28 Mar 2006 21:25:11 -0000 1.164 > +++ sys/dev/md/md.c 1 Jul 2006 03:48:41 -0000 > @@ -650,6 +650,8 @@ > mtx_lock_spin(&sched_lock); > sched_prio(curthread, PRIBIO); > mtx_unlock_spin(&sched_lock); > + if (sc->type =3D=3D MD_VNODE) > + curthread->td_pflags |=3D TDP_NORUNNINGBUF; >=20 > for (;;) { > mtx_lock(&sc->queue_mtx); --LQv0vi9oZBoYbpa7 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFFZXQdC3+MBN1Mb4gRAumDAJ9rK2AMG6wsyddAUqFGhjpeGah6FgCg9qUr +LWdv4tFahID2t7vBR6vD8I= =gFhp -----END PGP SIGNATURE----- --LQv0vi9oZBoYbpa7-- From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 05:37:23 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4D37816A407 for ; Thu, 23 Nov 2006 05:37:23 +0000 (UTC) (envelope-from dvdhoris@yahoo.com) Received: from web58811.mail.re1.yahoo.com (web58811.mail.re1.yahoo.com [66.196.100.225]) by mx1.FreeBSD.org (Postfix) with SMTP id B3D8343D46 for ; Thu, 23 Nov 2006 05:36:49 +0000 (GMT) (envelope-from dvdhoris@yahoo.com) Received: (qmail 58289 invoked by uid 60001); 23 Nov 2006 05:37:18 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=IxN8eP2Ad9O8LpOF8PvZh0MBgo2KZK8HwrMBFQX52O1vlNGQbrdlRJfYRyga4B8bGUbojJsarV3zqaQ/cf3dR9f4vBa2nEp6aGNefztkij0Mw8RWLFgy+UbEy/0SFDmAVKp6PephwGhbQBw4r4hTUglI3FMhC/bhr1awQSE/r6c=; X-YMail-OSG: nN1gpcUVM1mKFV6VjU7Z1KUs.QYqiqF6L6CLQNcmeH9xBuYs1xc9wfspAXNIEjSBZVjlnhBpJeGdSEZzXyoW5skJEAo.7gQiB54Gmho2BwZ0mY0luoNyl8l3Ue4AOtwRffZGqh4ozPDvPntj5mQY Received: from [68.196.189.103] by web58811.mail.re1.yahoo.com via HTTP; Wed, 22 Nov 2006 21:37:17 PST Date: Wed, 22 Nov 2006 21:37:17 -0800 (PST) From: David Horis To: freebsd-fs@freebsd.org MIME-Version: 1.0 Message-ID: <279761.58126.qm@web58811.mail.re1.yahoo.com> X-Mailman-Approved-At: Thu, 23 Nov 2006 13:29:13 +0000 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Subject: Snap Server filesystem? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 05:37:23 -0000 Hello All, Note: This was originally posted to the freebsd-questions list... A Snap Server 1100 just died on me... (Single drive, FreeBSD-based, I think...) I think it's not HD related as I can't even get into to the hardware/bios reset mode. I called adaptec, but they were of no help.... No even to tell me what kind of filesystem is on the drive. They said that since it's an old product, my only choice is to send the device to an authorized data recovery firm... ~ 4k USD Have you folks ever heard of anyone opening one of these things up and mounting the drive on a regular PC? Since the drive probably has some coruption, due to the MB/OS crash, how would I go about fixing those before I mount the drive and try to copy off the files? I've tried accessing the drive via Knoppix and the GpartEd LiveCD... both see the disk, but report it to empty of partitions. I am unfamiliar with *nix, and am unsure what to try next. If someone could provide guidance on this, it would be greatly appreciated. :) Thank you, David --------------------------------- Cheap Talk? Check out Yahoo! Messenger's low PC-to-Phone call rates. From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 17:15:19 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id DF6B616A47B for ; Thu, 23 Nov 2006 17:15:19 +0000 (UTC) (envelope-from nico-freebsd-fs@schottelius.org) Received: from schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.FreeBSD.org (Postfix) with SMTP id 062C443D67 for ; Thu, 23 Nov 2006 17:14:42 +0000 (GMT) (envelope-from nico-freebsd-fs@schottelius.org) Received: (qmail 13191 invoked by uid 1000); 23 Nov 2006 17:14:45 -0000 Date: Thu, 23 Nov 2006 18:14:44 +0100 From: Nico Schottelius To: freebsd-fs@freebsd.org Message-ID: <20061123171444.GG24205@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="qxfKREH7IwbezJ+T" Content-Disposition: inline User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Linux-Info: http://linux.schottelius.org/ X-Operating-System: Linux 2.6.18.2-hydrogenium Subject: ACL: Problem recalculating the mask X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 17:15:20 -0000 --qxfKREH7IwbezJ+T Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Hello! I did some tests on various freebsd versions and I've always the problem, that it seems that the rights mask is not used for recalculating the new values. I put a log of what I did to http://home.schottelius.org/~nico/freebsd/acl/test-fbsd-6.2-2006-11-23 in this directory are also older (perhaps wrong) test logs to be found. Anyone any hint for me what I could do so that the group 'webseiten' has 'full' permissions on newly created dirs and files? Greetings Nico --qxfKREH7IwbezJ+T Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) iD8DBQFFZdcEuL75KpiFGIwRAsnWAJ9DtiyId1rzJspB34AhrpDiJm+XKQCfacan Xb6XuVvD5uMrwnWDrBalJKk= =4H2u -----END PGP SIGNATURE----- --qxfKREH7IwbezJ+T-- From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 19:31:02 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E530416A412 for ; Thu, 23 Nov 2006 19:31:02 +0000 (UTC) (envelope-from kris@obsecurity.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.FreeBSD.org (Postfix) with ESMTP id 2F0F043DA2 for ; Thu, 23 Nov 2006 19:29:03 +0000 (GMT) (envelope-from kris@obsecurity.org) Received: from obsecurity.dyndns.org (elvis.mu.org [192.203.228.196]) by elvis.mu.org (Postfix) with ESMTP id E008A1A3C1C; Thu, 23 Nov 2006 11:29:38 -0800 (PST) Received: by obsecurity.dyndns.org (Postfix, from userid 1000) id 002C75128A; Thu, 23 Nov 2006 14:29:23 -0500 (EST) Date: Thu, 23 Nov 2006 14:29:23 -0500 From: Kris Kennaway To: Lapo Luchini Message-ID: <20061123192923.GA82035@xor.obsecurity.org> References: <854C78DB-2099-4DA5-9E3B-F30D6947C532@jlauser.net> <4512F957.2090205@centtech.com> <20060922041535.GF4842@deviant.kiev.zoral.com.ua> <455890AE.9050807@centtech.com> <20061122170913.GA38255@xor.obsecurity.org> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="mYCpIKhGyMATD0i+" Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.4.2.2i Cc: freebsd-fs@freebsd.org Subject: Re: Snapshot corruption on 6.1/amd64 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 19:31:03 -0000 --mYCpIKhGyMATD0i+ Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Nov 23, 2006 at 10:20:16AM +0100, Lapo Luchini wrote: > Kris Kennaway wrote: > >> Anyway, after having de-activated all snapshots for weeks (and deleted > >> all the old ones) I got this panic again. > > I've lost context, how are you reproducing the panic? >=20 > I didn't "reproduce" it, it kinda did just happen... > Version String: FreeBSD 6.1-STABLE #4: Fri Sep 1 17:02:50 CEST 2006 > root@motoko.lapo.it:/usr/obj/usr/src/sys/MOTOKO > Panic String: snapacct_ufs2: bad block > Dump Parity: 3615879487 > Bounds: 2 > Dump Status: good >=20 > This night I updated to 6.2-PRERELEASE, which contains the latest > amd64-snapshot commit... hoping for the good. > 'Good' as in: > - in the short term: no more panics > - in the long term: to use the snapshot functionality again >=20 > Hope this is context enough, or else simply ask and I'll reply. =3D) OK, let us know if it happens again, I think Sep 1 was before some possibly relevant fixes were merged. Kris --mYCpIKhGyMATD0i+ Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFFZfaTWry0BWjoQKURAnVEAJ9auzcNnVASLCPeHzibGQ//lv2KOwCgj7vN k1ytWdCmHZm+sEBS0VqgF6s= =urqD -----END PGP SIGNATURE----- --mYCpIKhGyMATD0i+-- From owner-freebsd-fs@FreeBSD.ORG Thu Nov 23 22:37:20 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 187D216A403; Thu, 23 Nov 2006 22:37:20 +0000 (UTC) (envelope-from killing@multiplay.co.uk) Received: from multiplay.co.uk (core6.multiplay.co.uk [85.236.96.23]) by mx1.FreeBSD.org (Postfix) with ESMTP id E42F343D49; Thu, 23 Nov 2006 22:36:41 +0000 (GMT) (envelope-from killing@multiplay.co.uk) Received: from vader ([212.135.219.179]) by multiplay.co.uk (multiplay.co.uk [85.236.96.23]) (MDaemon PRO v9.0.1) with ESMTP id md50003248036.msg; Thu, 23 Nov 2006 22:37:15 +0000 Message-ID: <076f01c70f4f$e6b96050$b3db87d4@multiplay.co.uk> From: "Steven Hartland" To: "Kostik Belousov" References: <447366AD.30203@rogers.com><20060701034922.GA37822@deviant.kiev.zoral.com.ua><027b01c70e6c$6c879470$b3db87d4@multiplay.co.uk> <20061123101246.GM1841@deviant.kiev.zoral.com.ua> Date: Thu, 23 Nov 2006 22:36:57 -0000 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.2869 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.2962 X-Spam-Processed: multiplay.co.uk, Thu, 23 Nov 2006 22:37:15 +0000 (not processed: message from valid local sender) X-MDRemoteIP: 212.135.219.179 X-Return-Path: killing@multiplay.co.uk X-MDAV-Processed: multiplay.co.uk, Thu, 23 Nov 2006 22:37:15 +0000 Cc: freebsd-fs@freebsd.org, Mike Jakubik , freebsd-stable@freebsd.org Subject: Re: md deadlocks on wdrain. Was: [Re: quota and snapshotsin6.1-RELEASE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 23 Nov 2006 22:37:20 -0000 Thanks for that, from our point of view its required as without the machine deadlocks without even trying. One real strange thing was that if I created a copy of the vnode file, this particular task ( installworld ) would succeed but given the nature of the bug ( timing critical ) that seem to make sence. With this still being a potential issue I think we have no choice but to migrate away from using any vnode backed jails. That said I thank you for this as it certainly help us. Steve ----- Original Message ----- From: "Kostik Belousov" This is not a fix, this is only a way to make the deadlock less frequent (I would not ever call it workaround). I have got a reports of deadlocks with this change applied, and I think that I understand the cause of it. Also, I have an idea of how to fix it, but not got around to even start coding. > ? sys/dev/md/.arch-ids > Index: sys/dev/md/md.c > =================================================================== > RCS file: /usr/local/arch/ncvs/src/sys/dev/md/md.c,v > retrieving revision 1.164 > diff -u -r1.164 md.c > --- sys/dev/md/md.c 28 Mar 2006 21:25:11 -0000 1.164 > +++ sys/dev/md/md.c 1 Jul 2006 03:48:41 -0000 > @@ -650,6 +650,8 @@ > mtx_lock_spin(&sched_lock); > sched_prio(curthread, PRIBIO); > mtx_unlock_spin(&sched_lock); > + if (sc->type == MD_VNODE) > + curthread->td_pflags |= TDP_NORUNNINGBUF; > > for (;;) { > mtx_lock(&sc->queue_mtx); ================================================ This e.mail is private and confidential between Multiplay (UK) Ltd. and the person or entity to whom it is addressed. In the event of misdirection, the recipient is prohibited from using, copying, printing or otherwise disseminating it or any information contained in it. In the event of misdirection, illegible or incomplete transmission please telephone +44 845 868 1337 or return the E.mail to postmaster@multiplay.co.uk. From owner-freebsd-fs@FreeBSD.ORG Fri Nov 24 03:22:22 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CFC8B16A40F for ; Fri, 24 Nov 2006 03:22:22 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id CC4CB43D4C for ; Fri, 24 Nov 2006 03:21:43 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [192.168.42.21] (andersonbox1.centtech.com [192.168.42.21]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id kAO3MKZf012475; Thu, 23 Nov 2006 21:22:20 -0600 (CST) (envelope-from anderson@centtech.com) Message-ID: <4566656B.60907@centtech.com> Date: Thu, 23 Nov 2006 21:22:19 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.7 (X11/20061015) MIME-Version: 1.0 To: David Horis References: <279761.58126.qm@web58811.mail.re1.yahoo.com> In-Reply-To: <279761.58126.qm@web58811.mail.re1.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2237/Thu Nov 23 14:06:09 2006 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.5 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: freebsd-fs@freebsd.org Subject: Re: Snap Server filesystem? X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Nov 2006 03:22:22 -0000 On 11/22/06 23:37, David Horis wrote: > Hello All, > > Note: This was originally posted to the freebsd-questions list... > > A Snap Server 1100 just died on me... (Single drive, FreeBSD-based, I think...) > > I think it's not HD related as I can't even get into to the hardware/bios reset mode. > > I called adaptec, but they were of no help.... No even to tell me what kind of filesystem is on the drive. They said that since it's an old product, my only choice is to send the device to an authorized data recovery firm... ~ 4k USD > > Have you folks ever heard of anyone opening one of these things up and mounting the drive on a regular PC? > > Since the drive probably has some coruption, due to the MB/OS crash, how would I go about fixing those before I mount the drive and try to copy off the files? > > I've tried accessing the drive via Knoppix and the GpartEd LiveCD... both see the disk, but report it to empty of partitions. > > I am unfamiliar with *nix, and am unsure what to try next. If someone could provide guidance on this, it would be greatly appreciated. :) I don't know for sure, but I believe they use linux in those boxes. The first part of the drive is the OS, and then the remaining is used as the data partition. You can use testdisk to try to get the partitions back, and it will automatically figure out what goes where for you. Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology An undefined problem has an infinite number of solutions. ------------------------------------------------------------------------ From owner-freebsd-fs@FreeBSD.ORG Fri Nov 24 09:31:26 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8DF6216A417 for ; Fri, 24 Nov 2006 09:31:26 +0000 (UTC) (envelope-from greg@wholemeal.net) Received: from mail9.messagelabs.com (mail9.messagelabs.com [194.205.110.133]) by mx1.FreeBSD.org (Postfix) with SMTP id 7333643D46 for ; Fri, 24 Nov 2006 09:30:44 +0000 (GMT) (envelope-from greg@wholemeal.net) X-VirusChecked: Checked X-Env-Sender: greg@wholemeal.net X-Msg-Ref: server-17.tower-9.messagelabs.com!1164360683!23610816!1 X-StarScan-Version: 5.5.10.7; banners=-,-,- X-Originating-IP: [212.135.210.82] Received: (qmail 21413 invoked from network); 24 Nov 2006 09:31:23 -0000 Received: from dsl-212-135-210-82.dsl.easynet.co.uk (HELO warprecords.com) (212.135.210.82) by server-17.tower-9.messagelabs.com with SMTP; 24 Nov 2006 09:31:23 -0000 Received: from [192.168.100.40] (HELO [192.168.0.10]) by warprecords.com (CommuniGate Pro SMTP 5.0.10) with ESMTPS id 6989443 for freebsd-fs@freebsd.org; Fri, 24 Nov 2006 09:31:23 +0000 Mime-Version: 1.0 (Apple Message framework v752.2) Content-Transfer-Encoding: 7bit Message-Id: <69404A94-8EBC-4978-8EA6-32E3DB1FA6A6@wholemeal.net> Content-Type: text/plain; charset=US-ASCII; delsp=yes; format=flowed To: freebsd-fs@freebsd.org From: Greg Eden Date: Fri, 24 Nov 2006 09:31:28 +0000 X-Mailer: Apple Mail (2.752.2) Subject: fsck crash: bad inode number to nextinode X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Nov 2006 09:31:26 -0000 Hello, I'm try to recover a RAID5 volume which was badly corrupted when a drive was removed during a rebuild. It contained about 1 TB of data and was formatted with default values under FreeBSD 6.0-R. I have used dd to image the drive onto another volume and am mounting it with mdconfig so I can work on that an not cause futher damage. However when I run fsck_ufs on the /dev/md0 partition it eventually crashes out during Phase 1 with UNKNOWN FILE TYPE I=42151497 UNEXPECTED SOFT UPDATE INCONSISTENCY CLEAR? yes fsck_ufs: bad inode number 42158080 to nextinode Is it possible to work around this to get fsck to complete? It is possible to mount the partition and some of the data is there, however most of it is not. Thanks in advance for any help. I have previously posted to freebsd- questions without a response. Greg Eden. From owner-freebsd-fs@FreeBSD.ORG Fri Nov 24 13:53:53 2006 Return-Path: X-Original-To: freebsd-fs@freebsd.org Delivered-To: freebsd-fs@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id AB4C816A40F; Fri, 24 Nov 2006 13:53:53 +0000 (UTC) (envelope-from kostikbel@gmail.com) Received: from fw.zoral.com.ua (fw.zoral.com.ua [213.186.206.134]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7C45743D55; Fri, 24 Nov 2006 13:53:11 +0000 (GMT) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (root@deviant.kiev.zoral.com.ua [10.1.1.148]) by fw.zoral.com.ua (8.13.4/8.13.4) with ESMTP id kAODrkxX071688 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Fri, 24 Nov 2006 15:53:46 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: from deviant.kiev.zoral.com.ua (kostik@localhost [127.0.0.1]) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8) with ESMTP id kAODrkPS078344; Fri, 24 Nov 2006 15:53:46 +0200 (EET) (envelope-from kostikbel@gmail.com) Received: (from kostik@localhost) by deviant.kiev.zoral.com.ua (8.13.8/8.13.8/Submit) id kAODrhdU078343; Fri, 24 Nov 2006 15:53:43 +0200 (EET) (envelope-from kostikbel@gmail.com) X-Authentication-Warning: deviant.kiev.zoral.com.ua: kostik set sender to kostikbel@gmail.com using -f Date: Fri, 24 Nov 2006 15:53:43 +0200 From: Kostik Belousov To: Steven Hartland Message-ID: <20061124135343.GC81940@deviant.kiev.zoral.com.ua> References: <20061123101246.GM1841@deviant.kiev.zoral.com.ua> <076f01c70f4f$e6b96050$b3db87d4@multiplay.co.uk> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="S1BNGpv0yoYahz37" Content-Disposition: inline In-Reply-To: <076f01c70f4f$e6b96050$b3db87d4@multiplay.co.uk> User-Agent: Mutt/1.4.2.2i X-Virus-Scanned: ClamAV version 0.88.4, clamav-milter version 0.88.4 on fw.zoral.com.ua X-Virus-Status: Clean X-Spam-Status: No, score=1.4 required=5.0 tests=SPF_NEUTRAL, UNPARSEABLE_RELAY autolearn=no version=3.1.4 X-Spam-Level: * X-Spam-Checker-Version: SpamAssassin 3.1.4 (2006-07-25) on fw.zoral.com.ua Cc: freebsd-fs@freebsd.org, Mike Jakubik , freebsd-stable@freebsd.org Subject: Re: md deadlocks on wdrain. Was: [Re: quota and snapshotsin6.1-RELEASE] X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Nov 2006 13:53:53 -0000 --S1BNGpv0yoYahz37 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Nov 23, 2006 at 10:36:57PM -0000, Steven Hartland wrote: > Thanks for that, from our point of view its required > as without the machine deadlocks without even trying. >=20 > One real strange thing was that if I created a copy of > the vnode file, this particular task ( installworld ) > would succeed but given the nature of the bug ( timing > critical ) that seem to make sence. >=20 > With this still being a potential issue I think we have > no choice but to migrate away from using any vnode backed > jails. >=20 Ok, I think the following could be the right approach. Index: kern/vfs_bio.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D RCS file: /usr/local/arch/ncvs/src/sys/kern/vfs_bio.c,v retrieving revision 1.513 diff -u -r1.513 vfs_bio.c --- kern/vfs_bio.c 29 Oct 2006 00:04:39 -0000 1.513 +++ kern/vfs_bio.c 24 Nov 2006 11:40:33 -0000 @@ -871,7 +871,8 @@ * or syncer daemon trying to clean up as that can lead * to deadlock. */ - if ((curthread->td_pflags & TDP_NORUNNINGBUF) =3D=3D 0) + if ((curthread->td_pflags & TDP_NORUNNINGBUF) =3D=3D 0 && + (bp->b_vp->v_vflag & VV_MD) =3D=3D 0) waitrunningbufspace(); } =20 Index: sys/vnode.h =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D RCS file: /usr/local/arch/ncvs/src/sys/sys/vnode.h,v retrieving revision 1.318 diff -u -r1.318 vnode.h --- sys/vnode.h 13 Nov 2006 05:51:22 -0000 1.318 +++ sys/vnode.h 24 Nov 2006 11:40:33 -0000 @@ -254,6 +254,7 @@ #define VV_PROCDEP 0x0100 /* vnode is process dependent */ #define VV_NOKNOTE 0x0200 /* don't activate knotes on this vnode */ #define VV_DELETED 0x0400 /* should be removed */ +#define VV_MD 0x0800 /* vnode backs the md device */ =20 /* * Vnode attributes. A field value of VNOVAL represents a field whose val= ue Index: dev/md/md.c =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D RCS file: /usr/local/arch/ncvs/src/sys/dev/md/md.c,v retrieving revision 1.166 diff -u -r1.166 md.c --- dev/md/md.c 1 Nov 2006 18:59:06 -0000 1.166 +++ dev/md/md.c 24 Nov 2006 11:40:33 -0000 @@ -693,6 +693,8 @@ mtx_lock_spin(&sched_lock); sched_prio(curthread, PRIBIO); mtx_unlock_spin(&sched_lock); + if (sc->type =3D=3D MD_VNODE) + curthread->td_pflags |=3D TDP_NORUNNINGBUF; =20 for (;;) { mtx_lock(&sc->queue_mtx); @@ -923,6 +925,7 @@ VFS_UNLOCK_GIANT(vfslocked); return (error ? error : EINVAL); } + nd.ni_vp->v_vflag |=3D VV_MD; VOP_UNLOCK(nd.ni_vp, 0, td); =20 if (mdio->md_fwsectors !=3D 0) @@ -936,6 +939,9 @@ =20 error =3D mdsetcred(sc, td->td_ucred); if (error !=3D 0) { + vn_lock(nd.ni_vp, LK_EXCLUSIVE | LK_RETRY, td); + nd.ni_vp->v_vflag &=3D ~VV_MD; + VOP_UNLOCK(nd.ni_vp, 0, td); (void)vn_close(nd.ni_vp, flags, td->td_ucred, td); VFS_UNLOCK_GIANT(vfslocked); return (error); @@ -966,6 +972,9 @@ mtx_destroy(&sc->queue_mtx); if (sc->vnode !=3D NULL) { vfslocked =3D VFS_LOCK_GIANT(sc->vnode->v_mount); + vn_lock(sc->vnode, LK_EXCLUSIVE | LK_RETRY, td); + sc->vnode->v_vflag &=3D ~VV_MD; + VOP_UNLOCK(sc->vnode, 0, td); (void)vn_close(sc->vnode, sc->flags & MD_READONLY ? FREAD : (FREAD|FWRITE), sc->cred, td); VFS_UNLOCK_GIANT(vfslocked); --S1BNGpv0yoYahz37 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (FreeBSD) iD8DBQFFZvlnC3+MBN1Mb4gRAtoKAKDOuEfly5wPj1YjUdCtvBY/RuSnbwCgw2zB Jn9zULhJdVk5tbPXoWlxjT4= =b5zA -----END PGP SIGNATURE----- --S1BNGpv0yoYahz37--