From owner-freebsd-questions Thu Oct 25 20:53:33 2001 Delivered-To: freebsd-questions@freebsd.org Received: from nitrogen.nexthop.net (nitrogen.nexthop.net [146.115.19.9]) by hub.freebsd.org (Postfix) with ESMTP id A64B537B406; Thu, 25 Oct 2001 20:53:26 -0700 (PDT) Received: (from bene@localhost) by nitrogen.nexthop.net (8.11.6/8.11.6) id f9Q3rNH77723; Thu, 25 Oct 2001 23:53:23 -0400 (EDT) (envelope-from bene) Date: Thu, 25 Oct 2001 23:53:23 -0400 From: Ben Eisenbraun To: Greg Lehey Cc: freebsd-questions@FreeBSD.org Subject: Re: recovery of corrupt vinum plexes? Message-ID: <20011025235323.E64298@nitrogen.nexthop.net> References: <20011023044950.A43848@nitrogen.nexthop.net> <20011023183023.M27668@wantadilla.lemis.com> <20011023055005.A44324@nitrogen.nexthop.net> <20011025103000.A25441@wantadilla.lemis.com> <20011025023359.D64298@nitrogen.nexthop.net> <20011026091455.A4706@wantadilla.lemis.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.2.5i In-Reply-To: <20011026091455.A4706@wantadilla.lemis.com>; from grog@FreeBSD.org on Fri, Oct 26, 2001 at 09:14:55AM +0930 Sender: owner-freebsd-questions@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On Fri, Oct 26, 2001 at 09:14:55AM +0930, Greg Lehey wrote: > On Thursday, 25 October 2001 at 2:33:59 -0400, Ben Eisenbraun wrote: > > > > I think I can reproduce this if I frob with it enough, but this > > kernel wasn't build with debug symbols, and the system sources have > > been recently updated, so I'm not sure if this would be useful. Do > > you have any suggestions? > > I'd need the debug output. I won't find it otherwise. Given the above info, is there a way I can get that? I'm under the impression that the kernel had to be built with either "makeoptions DEBUG=-g" or 'config -g MYKERNEL' in order for a crash dump to be useful. I tend to cvsup and then buildworld/kernel directly afterwards, so I could cvsup with the date for the currently running kernel and try building a debug kernel. From what I gather by reading the Developer's Handbook, this might work provided the sizes of the kernels match. > > For some reason, the drives came back at ad[46]e not ad[46]s1e. > > This is not so good. It suggests that the partition table has > changed. Are you sure you haven't run fdisk or disklabel on these > drives? I've done both a 'disklabel -r /dev/ad[46]s1' and an 'fdisk /dev/ad[46]' to look at the disk layout, but as far as I know, that shouldn't have changed the disklabel. root@whiskey [20:15:44][~]>> ls -l /dev | egrep 'ad[46]$' crw-r----- 1 root operator 116, 0x00010022 Oct 18 02:50 ad4 crw-r----- 1 root operator 116, 0x00010032 Oct 18 02:51 ad6 crw-r----- 1 root operator 116, 0x00010022 Oct 18 02:50 rad4 crw-r----- 1 root operator 116, 0x00010032 Oct 18 02:51 rad6 Those modification times jibe with when I turned up the new swap on those two drives. Okay, here's the 'vinum setstate up' and 'fsck -n' output: vinum -> setstate up stripe-mirror.p0 stripe-mirror.p0.s1 stripe-mirror.p1 strip e-mirror.p1.s1 stripe-mirror.p0.s1 is already up stripe-mirror.p1.s1 is already up root@whiskey [19:56:10][~]>> fsck -n /dev/vinum/plex/stripe-mirror.p0 ** /dev/vinum/plex/stripe-mirror.p0 (NO WRITE) CANNOT READ: BLK 16 CONTINUE? yes THE FOLLOWING DISK SECTORS COULD NOT BE READ: 16, 17, 18, 19, 20, 21, 22, 23, 24 , 25, 26, 27, 28, 29, 30, 31, /dev/vinum/plex/stripe-mirror.p0: INCOMPLETE LABEL: type 4.2BSD fsize 1024, frag 8, cpg 0, size 234450944 root@whiskey [19:56:32][~]>> fsck -n /dev/vinum/plex/stripe-mirror.p1 ** /dev/vinum/plex/stripe-mirror.p1 (NO WRITE) CANNOT READ: BLK 16 CONTINUE? yes THE FOLLOWING DISK SECTORS COULD NOT BE READ: 16, 17, 18, 19, 20, 21, 22, 23, 24 , 25, 26, 27, 28, 29, 30, 31, /dev/vinum/plex/stripe-mirror.p1: INCOMPLETE LABEL: type 4.2BSD fsize 1024, frag 8, cpg 0, size 234450944 And here's a vinum 'list': vinum -> list 14 drives: D max3 State: up Device /dev/ad4s1e Avail: 57239/572 39 MB (100%) D max4 State: up Device /dev/ad6s1e Avail: 57239/572 39 MB (100%) 2 volumes: V stripe-mirror State: up Plexes: 2 Size: 111 GB V var-mirror State: up Plexes: 2 Size: 19 GB 4 plexes: P stripe-mirror.p0 S State: up Subdisks: 2 Size: 111 GB P stripe-mirror.p1 S State: up Subdisks: 2 Size: 111 GB P var-mirror.p0 C State: up Subdisks: 1 Size: 19 GB P var-mirror.p1 C State: up Subdisks: 1 Size: 19 GB 6 subdisks: S stripe-mirror.p0.s0 State: crashed PO: 0 B Size: 55 GB S stripe-mirror.p0.s1 State: up PO: 512 kB Size: 55 GB S stripe-mirror.p1.s0 State: crashed PO: 0 B Size: 55 GB S stripe-mirror.p1.s1 State: up PO: 512 kB Size: 55 GB S var-mirror.p0.s0 State: up PO: 0 B Size: 19 GB S var-mirror.p1.s0 State: up PO: 0 B Size: 19 GB I'll see if I can get a kernel built with debug symbols. -ben To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-questions" in the body of the message