From owner-freebsd-hackers@FreeBSD.ORG Fri May 30 15:22:01 2003 Return-Path: Delivered-To: freebsd-hackers@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 3A9B137B401; Fri, 30 May 2003 15:22:01 -0700 (PDT) Received: from mx2.confluentasp.com (mx2.confluentasp.com [216.26.153.14]) by mx1.FreeBSD.org (Postfix) with ESMTP id 04FC343F75; Fri, 30 May 2003 15:22:00 -0700 (PDT) (envelope-from mikej@confluenttech.com) Received: from neo.confluentasp.local (35.in-addr.arpa.confluentasp.com [216.26.153.35] (may be forged)) by mx2.confluentasp.com (8.11.6/8.11.6) with ESMTP id h4UMLwo81414; Fri, 30 May 2003 18:21:58 -0400 (EDT) X-MimeOLE: Produced By Microsoft Exchange V6.0.6249.0 content-class: urn:content-classes:message MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable Date: Fri, 30 May 2003 18:21:53 -0400 Message-ID: <9D7F0DF3FB16D41184010050DA90E000BF6668@neo.confluentasp.local> X-MS-Has-Attach: X-MS-TNEF-Correlator: Thread-Topic: Vinum / 4.8 / Referenced disk / Recovery Thread-Index: AcMm+d+kARWv6ez9TOupo+g/TUsA4w== From: "Michael G. Jung" To: , Subject: Vinum / 4.8 / Referenced disk / Recovery X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 May 2003 22:22:01 -0000 After a reboot on 4.8 I ended up with a degraded raid 5 partition...=20 The only thing special about my setup is.... 4944 drives spread over 3 = channels, running SMP kernel..... One sub disk was down and the and the drive was referenced... in = scouring the=20 mailing lists I saw where a referenced disk means you have referenced a = non-existent drive - I read this as one vinum didn't think was = defined.. in my=20 case it was drive29 --> /dev/da29s1e I don't know how this got referenced !!! It's been reboot many times = and this has not happened. =20 So I boldly created a config file for vinum and re-created the = drive..... --- config file ---- drive drvie29 device /dev/da29e --- end ---- but I still can not start the sub disk.....=20 (root@jammin) /home/staff/mikej# vinum start raid5-1.p0.s15 Can't start raid5-1.p0.s15: Drive is down (5) (root@jammin) /home/staff/mikej#=20 Here is what vinum thinks...... Do I rm the sub disk and re-create = it????? Will this kill my raid-5 partition ?? Thanks !! (root@jammin) /home/staff/mikej# vinum printconfig # Vinum configuration of jammin.mikej.com, saved at Fri May 30 18:15:48 = 2003 drive drive1 device /dev/da1s1e drive drive2 device /dev/da2s1e drive drive3 device /dev/da3s1e drive d2 device /dev/da15s1e drive drive16 device /dev/da16s1e drive drive17 device /dev/da17s1e drive drive18 device /dev/da18s1e drive drive19 device /dev/da19s1e drive d1 device /dev/da20s1e drive drive21 device /dev/da21s1e drive drive22 device /dev/da22s1e drive drive23 device /dev/da23s1e drive drive24 device /dev/da24s1e drive drive25 device /dev/da25s1e drive drive26 device /dev/da26s1e drive drive27 device /dev/da27s1e drive drive28 device /dev/da28s1e drive drive29 device /dev/da29s1e drive *invalid* device=20 volume mirror1 volume raid5-1 plex name mirror1.p0 org concat vol mirror1=20 plex name mirror1.p1 org concat vol mirror1=20 plex name raid5-1.p0 org raid5 62s vol raid5-1=20 sd name mirror.p0.s0 drive d1 plex mirror1.p0 len 35551232s driveoffset = 265s plexoffset 0s sd name mirror.p1.s0 drive d2 plex mirror1.p1 len 35551232s driveoffset = 265s plexoffset 0s sd name raid5-1.p0.s0 drive drive1 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 0s sd name raid5-1.p0.s1 drive drive2 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 62s sd name raid5-1.p0.s2 drive drive3 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 124s sd name raid5-1.p0.s3 drive drive16 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 186s sd name raid5-1.p0.s4 drive drive17 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 248s sd name raid5-1.p0.s5 drive drive18 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 310s sd name raid5-1.p0.s6 drive drive19 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 372s sd name raid5-1.p0.s7 drive drive21 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 434s sd name raid5-1.p0.s8 drive drive22 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 496s sd name raid5-1.p0.s9 drive drive23 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 558s sd name raid5-1.p0.s10 drive drive24 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 620s sd name raid5-1.p0.s11 drive drive25 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 682s sd name raid5-1.p0.s12 drive drive26 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 744s sd name raid5-1.p0.s13 drive drive27 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 806s sd name raid5-1.p0.s14 drive drive28 plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 868s sd name raid5-1.p0.s15 drive *invalid* plex raid5-1.p0 len 35551172s = driveoffset 265s plexoffset 930s (root@jammin) /etc# vinum l 18 drives: D drive1 State: up Device /dev/da1s1e Avail: = 0/17359 MB (0%) D drive2 State: up Device /dev/da2s1e Avail: = 0/17359 MB (0%) D drive3 State: up Device /dev/da3s1e Avail: = 0/17359 MB (0%) D d2 State: up Device /dev/da15s1e Avail: = 0/17359 MB (0%) D drive16 State: up Device /dev/da16s1e Avail: = 0/17359 MB (0%) D drive17 State: up Device /dev/da17s1e Avail: = 0/17359 MB (0%) D drive18 State: up Device /dev/da18s1e Avail: = 0/17359 MB (0%) D drive19 State: up Device /dev/da19s1e Avail: = 0/17359 MB (0%) D d1 State: up Device /dev/da20s1e Avail: = 0/17359 MB (0%) D drive21 State: up Device /dev/da21s1e Avail: = 0/17359 MB (0%) D drive22 State: up Device /dev/da22s1e Avail: = 0/17359 MB (0%) D drive23 State: up Device /dev/da23s1e Avail: = 0/17359 MB (0%) D drive24 State: up Device /dev/da24s1e Avail: = 0/17359 MB (0%) D drive25 State: up Device /dev/da25s1e Avail: = 0/17359 MB (0%) D drive26 State: up Device /dev/da26s1e Avail: = 0/17359 MB (0%) D drive27 State: up Device /dev/da27s1e Avail: = 0/17359 MB (0%) D drive28 State: up Device /dev/da28s1e Avail: = 0/17359 MB (0%) D drive29 State: up Device /dev/da29s1e Avail: = 17359/17359 MB (100%) D *invalid* State: referenced Device Avail: 0/0 MB 2 volumes: V mirror1 State: up Plexes: 2 Size: 16 = GB V raid5-1 State: up Plexes: 1 Size: 254 = GB 3 plexes: P mirror1.p0 C State: up Subdisks: 1 Size: 16 = GB P mirror1.p1 C State: up Subdisks: 1 Size: 16 = GB P raid5-1.p0 R5 State: degraded Subdisks: 16 Size: 254 = GB 18 subdisks: S mirror.p0.s0 State: up PO: 0 B Size: 16 = GB S mirror.p1.s0 State: up PO: 0 B Size: 16 = GB S raid5-1.p0.s0 State: up PO: 0 B Size: 16 = GB S raid5-1.p0.s1 State: up PO: 31 kB Size: 16 = GB S raid5-1.p0.s2 State: up PO: 62 kB Size: 16 = GB S raid5-1.p0.s3 State: up PO: 93 kB Size: 16 = GB S raid5-1.p0.s4 State: up PO: 124 kB Size: 16 = GB S raid5-1.p0.s5 State: up PO: 155 kB Size: 16 = GB S raid5-1.p0.s6 State: up PO: 186 kB Size: 16 = GB S raid5-1.p0.s7 State: up PO: 217 kB Size: 16 = GB S raid5-1.p0.s8 State: up PO: 248 kB Size: 16 = GB S raid5-1.p0.s9 State: up PO: 279 kB Size: 16 = GB S raid5-1.p0.s10 State: up PO: 310 kB Size: 16 = GB S raid5-1.p0.s11 State: up PO: 341 kB Size: 16 = GB S raid5-1.p0.s12 State: up PO: 372 kB Size: 16 = GB S raid5-1.p0.s13 State: up PO: 403 kB Size: 16 = GB S raid5-1.p0.s14 State: up PO: 434 kB Size: 16 = GB S raid5-1.p0.s15 State: stale PO: 465 kB Size: 16 = GB (root@jammin) /etc#=20