From owner-freebsd-questions@FreeBSD.ORG Mon Dec 6 03:16:08 2004 Return-Path: Delivered-To: freebsd-questions@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6DB1016A4CE for ; Mon, 6 Dec 2004 03:16:08 +0000 (GMT) Received: from web50710.mail.yahoo.com (web50710.mail.yahoo.com [206.190.38.251]) by mx1.FreeBSD.org (Postfix) with SMTP id D791C43D1D for ; Mon, 6 Dec 2004 03:16:07 +0000 (GMT) (envelope-from weyrich_comp@yahoo.com) Received: (qmail 52975 invoked by uid 60001); 6 Dec 2004 03:16:07 -0000 Comment: DomainKeys? See http://antispam.yahoo.com/domainkeys DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; b=jA+4KSnio6B98NICklwTiG9XzVf2Q8uZpJYv+uXc5xn5jL5ItaZPTdgxyckYpNowyyMdycRw3Bis57NIGXaMSYy280h+2qnGrYHoJKVVS5gNDq3t/sbJup0JIvNRjqcqN9BNy5+MQnXpJKhFMnUKwC+plj1VntVCgfzQGB6oBYg= ; Message-ID: <20041206031607.52973.qmail@web50710.mail.yahoo.com> Received: from [64.249.12.251] by web50710.mail.yahoo.com via HTTP; Sun, 05 Dec 2004 19:16:07 PST Date: Sun, 5 Dec 2004 19:16:07 -0800 (PST) From: orville weyrich To: freebsd-questions MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="0-163051839-1102302967=:52366" Subject: VINUM Disaster Recovery X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 06 Dec 2004 03:16:08 -0000 --0-163051839-1102302967=:52366 Content-Type: text/plain; charset=us-ascii Content-Id: Content-Disposition: inline I have a 10 disk VINUM configuration and two of the disks are trashed. In theory there is still enough redundant information to get things working again without data loss. Vinum has detected a configuration error (duh -- two disks are toast, plus in recovery I accidently created two more plexes) and taken upon itself to stop configuration updates to prevent any further corruption (thanks! :-). At this point I have looked at http://www.vinumvm.org/vinum/how-to-debug.html and have run a command like the following: ( dd if=/dev/da9s1e skip=8 count=50 | tr -d '\000-\011\200-\377' ; echo ) > da9s1e.log on all 10 disks to obtain a file containing each disk's on-disk configuration. As hoped, eight of the disks show an output similar to the attached file da1s1e.log (differing only as expected in the first line). See attached flog file for a sample output. PLEASE HELP CONFIRM MY PLAN (FOLLOWING) FOR PROCEEDING -- I DO NOT WANT TO DO ANYTHING DISASTEROUS. My thought is that I need to turn on updates, then delete the two unwanted plexes raid.p2 and raid.p3(which were accidentally created), detach the corrupt sdisks, and then hopefully VINUM will forget about the two disks that are toast (or do I somehow have to tell VINUM to forget the disks?). My plan is as follows: First, selectively start vinum: vinum -> read /dev/da1s1e /dev/da2s1e /dev/da3s1e /dev/da4s1e /dev/da5s1e /dev/da6s1e /dev/da7s1e /dev/da8s1e Second, enable configuration updates: vinum->setdaemon 0 Third, save the configuration: vinum->saveconfig Fourth, stop and remove the two unwanted plexes and all attached subdisks: vinum->stop -f raid.p3 vinum->stop -f raid.p2 vinum->rm -r raid.p3 vinum->rm -r raid.p2 Fifth, stop and detach the corruped subdisks: vinum->stop -f raid.p0.s0 vinum->stop -f raid.p0.s9 vinum->stop -f raid.p1.s4 vinum->stop -f raid.p1.s5 vinum->detach raid.p0.s0 vinum->detach raid.p0.s9 vinum->detach raid.p1.s4 vinum->detach raid.p1.s5 At this point I expect to have a functional volume that can be mounted and backed up, prior to the next step of reinstalling the crashed disks, creating new subdisks, attaching them to the plexes, and resynching. PLEASE CONFIRM MY APPROACH OR TELL ME WHERE I AM WRONG! Thanks orville __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com --0-163051839-1102302967=:52366 Content-Type: application/octet-stream; name="da1s1e.log" Content-Transfer-Encoding: base64 Content-Description: da1s1e.log Content-Disposition: attachment; filename="da1s1e.log" SU4gVklOT2Jhc2hmdWwud2V5cmljaC5jb21haGMwdDAzQSdCDEEsDHZvbHVt ZSByYWlkIHN0YXRlIHVwDQpwbGV4IG5hbWUgcmFpZC5wMCBzdGF0ZSB1cCBv cmcgc3RyaXBlZCAxMDI0cyB2b2wgcmFpZCANCnBsZXggbmFtZSByYWlkLnAx IHN0YXRlIGNvcnJ1cHQgb3JnIHN0cmlwZWQgMTAyNHMgdm9sIHJhaWQgDQpw bGV4IG5hbWUgcmFpZC5wMiBzdGF0ZSBmYXVsdHkgb3JnIHN0cmlwZWQgMTAy NHMgdm9sIHJhaWQgDQpwbGV4IG5hbWUgcmFpZC5wMyBzdGF0ZSBmYXVsdHkg b3JnIHN0cmlwZWQgMTAyNHMgdm9sIHJhaWQgDQpzZCBuYW1lIHJhaWQucDAu czAgZHJpdmUgYWhjMHQwMiBwbGV4IHJhaWQucDAgc3RhdGUgdXAgbGVuIDQ0 MDUyNDhzIGRyaXZlb2Zmc2V0IDI2NXMgcGxleG9mZnNldCAwcw0Kc2QgbmFt ZSByYWlkLnAwLnMxIGRyaXZlIGFoYzB0MDMgcGxleCByYWlkLnAwIHN0YXRl IHVwIGxlbiA0NDA1MjQ4cyBkcml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQg MTAyNHMNCnNkIG5hbWUgcmFpZC5wMC5zMiBkcml2ZSBhaGMwdDA0IHBsZXgg cmFpZC5wMCBzdGF0ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1 cyBwbGV4b2Zmc2V0IDIwNDhzDQpzZCBuYW1lIHJhaWQucDAuczMgZHJpdmUg YWhjMHQwOSBwbGV4IHJhaWQucDAgc3RhdGUgdXAgbGVuIDQ0MDUyNDhzIGRy aXZlb2Zmc2V0IDI2NXMgcGxleG9mZnNldCAzMDcycw0Kc2QgbmFtZSByYWlk LnAwLnM0IGRyaXZlIGFoYzB0MTAgcGxleCByYWlkLnAwIHN0YXRlIHVwIGxl biA0NDA1MjQ4cyBkcml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQgNDA5NnMN CnNkIG5hbWUgcmFpZC5wMC5zNSBkcml2ZSBhaGMwdDExIHBsZXggcmFpZC5w MCBzdGF0ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1cyBwbGV4 b2Zmc2V0IDUxMjBzDQpzZCBuYW1lIHJhaWQucDAuczYgZHJpdmUgYWhjMHQx MiBwbGV4IHJhaWQucDAgc3RhdGUgdXAgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zm c2V0IDI2NXMgcGxleG9mZnNldCA2MTQ0cw0Kc2QgbmFtZSByYWlkLnAwLnM3 IGRyaXZlIGFoYzB0MTMgcGxleCByYWlkLnAwIHN0YXRlIHVwIGxlbiA0NDA1 MjQ4cyBkcml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQgNzE2OHMNCnNkIG5h bWUgcmFpZC5wMC5zOCBkcml2ZSBhaGMwdDE0IHBsZXggcmFpZC5wMCBzdGF0 ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1cyBwbGV4b2Zmc2V0 IDgxOTJzDQpzZCBuYW1lIHJhaWQucDAuczkgZHJpdmUgKmludmFsaWQqIHBs ZXggcmFpZC5wMCBzdGF0ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQg MjY1cyBwbGV4b2Zmc2V0IDkyMTZzDQpzZCBuYW1lIHJhaWQucDEuczAgZHJp dmUgYWhjMHQxMSBwbGV4IHJhaWQucDEgc3RhdGUgdXAgbGVuIDQ0MDUyNDhz IGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQgMHMNCnNkIG5hbWUg cmFpZC5wMS5zMSBkcml2ZSBhaGMwdDEyIHBsZXggcmFpZC5wMSBzdGF0ZSB1 cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgNDQwNTUxM3MgcGxleG9mZnNl dCAxMDI0cw0Kc2QgbmFtZSByYWlkLnAxLnMyIGRyaXZlIGFoYzB0MTMgcGxl eCByYWlkLnAxIHN0YXRlIHVwIGxlbiA0NDA1MjQ4cyBkcml2ZW9mZnNldCA0 NDA1NTEzcyBwbGV4b2Zmc2V0IDIwNDhzDQpzZCBuYW1lIHJhaWQucDEuczMg ZHJpdmUgYWhjMHQxNCBwbGV4IHJhaWQucDEgc3RhdGUgdXAgbGVuIDQ0MDUy NDhzIGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQgMzA3MnMNCnNk IG5hbWUgcmFpZC5wMS5zNCBkcml2ZSAqaW52YWxpZCogcGxleCByYWlkLnAx IHN0YXRlIG9ic29sZXRlIGxlbiA0NDA1MjQ4cyBkcml2ZW9mZnNldCA0NDA1 NTEzcyBwbGV4b2Zmc2V0IDQwOTZzDQpzZCBuYW1lIHJhaWQucDEuczUgZHJp dmUgYWhjMHQwMiBwbGV4IHJhaWQucDEgc3RhdGUgdXAgbGVuIDQ0MDUyNDhz IGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQgNTEyMHMNCnNkIG5h bWUgcmFpZC5wMS5zNiBkcml2ZSBhaGMwdDAzIHBsZXggcmFpZC5wMSBzdGF0 ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgNDQwNTUxM3MgcGxleG9m ZnNldCA2MTQ0cw0Kc2QgbmFtZSByYWlkLnAxLnM3IGRyaXZlIGFoYzB0MDQg cGxleCByYWlkLnAxIHN0YXRlIHVwIGxlbiA0NDA1MjQ4cyBkcml2ZW9mZnNl dCA0NDA1NTEzcyBwbGV4b2Zmc2V0IDcxNjhzDQpzZCBuYW1lIHJhaWQucDEu czggZHJpdmUgYWhjMHQwOSBwbGV4IHJhaWQucDEgc3RhdGUgdXAgbGVuIDQ0 MDUyNDhzIGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQgODE5MnMN CnNkIG5hbWUgcmFpZC5wMS5zOSBkcml2ZSBhaGMwdDEwIHBsZXggcmFpZC5w MSBzdGF0ZSB1cCBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgNDQwNTUxM3Mg cGxleG9mZnNldCA5MjE2cw0Kc2QgbmFtZSByYWlkLnAyLnMwIGRyaXZlIGFo YzB0MDIgcGxleCByYWlkLnAyIHN0YXRlIHN0YWxlIGxlbiA0NDA1MjQ4cyBk cml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQgMHMNCnNkIG5hbWUgcmFpZC5w Mi5zMSBkcml2ZSBhaGMwdDAzIHBsZXggcmFpZC5wMiBzdGF0ZSBzdGFsZSBs ZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1cyBwbGV4b2Zmc2V0IDEwMjRz DQpzZCBuYW1lIHJhaWQucDIuczIgZHJpdmUgYWhjMHQwNCBwbGV4IHJhaWQu cDIgc3RhdGUgc3RhbGUgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDI2NXMg cGxleG9mZnNldCAyMDQ4cw0Kc2QgbmFtZSByYWlkLnAyLnMzIGRyaXZlIGFo YzB0MDkgcGxleCByYWlkLnAyIHN0YXRlIHN0YWxlIGxlbiA0NDA1MjQ4cyBk cml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQgMzA3MnMNCnNkIG5hbWUgcmFp ZC5wMi5zNCBkcml2ZSBhaGMwdDEwIHBsZXggcmFpZC5wMiBzdGF0ZSBzdGFs ZSBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1cyBwbGV4b2Zmc2V0IDQw OTZzDQpzZCBuYW1lIHJhaWQucDIuczUgZHJpdmUgYWhjMHQxMSBwbGV4IHJh aWQucDIgc3RhdGUgc3RhbGUgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDI2 NXMgcGxleG9mZnNldCA1MTIwcw0Kc2QgbmFtZSByYWlkLnAyLnM2IGRyaXZl IGFoYzB0MTIgcGxleCByYWlkLnAyIHN0YXRlIHN0YWxlIGxlbiA0NDA1MjQ4 cyBkcml2ZW9mZnNldCAyNjVzIHBsZXhvZmZzZXQgNjE0NHMNCnNkIG5hbWUg cmFpZC5wMi5zNyBkcml2ZSBhaGMwdDEzIHBsZXggcmFpZC5wMiBzdGF0ZSBz dGFsZSBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgMjY1cyBwbGV4b2Zmc2V0 IDcxNjhzDQpzZCBuYW1lIHJhaWQucDIuczggZHJpdmUgYWhjMHQxNCBwbGV4 IHJhaWQucDIgc3RhdGUgc3RhbGUgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0 IDI2NXMgcGxleG9mZnNldCA4MTkycw0Kc2QgbmFtZSByYWlkLnAyLnM5IGRy aXZlIGFoYzB0MTUgcGxleCByYWlkLnAyIHN0YXRlIHN0YWxlIGxlbiA0NDA1 MjQ4cyBkcml2ZW9mZnNldCAxODQ0Njc0NDA3MzcwOTU1MTYxNXMgcGxleG9m ZnNldCA5MjE2cw0Kc2QgbmFtZSByYWlkLnAzLnMwIGRyaXZlIGFoYzB0MTEg cGxleCByYWlkLnAzIHN0YXRlIHN0YWxlIGxlbiA0NDA1MjQ4cyBkcml2ZW9m ZnNldCA0NDA1NTEzcyBwbGV4b2Zmc2V0IDBzDQpzZCBuYW1lIHJhaWQucDMu czEgZHJpdmUgYWhjMHQxMiBwbGV4IHJhaWQucDMgc3RhdGUgc3RhbGUgbGVu IDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQgMTAy NHMNCnNkIG5hbWUgcmFpZC5wMy5zMiBkcml2ZSBhaGMwdDEzIHBsZXggcmFp ZC5wMyBzdGF0ZSBzdGFsZSBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQgNDQw NTUxM3MgcGxleG9mZnNldCAyMDQ4cw0Kc2QgbmFtZSByYWlkLnAzLnMzIGRy aXZlIGFoYzB0MTQgcGxleCByYWlkLnAzIHN0YXRlIHN0YWxlIGxlbiA0NDA1 MjQ4cyBkcml2ZW9mZnNldCA0NDA1NTEzcyBwbGV4b2Zmc2V0IDMwNzJzDQpz ZCBuYW1lIHJhaWQucDMuczQgZHJpdmUgYWhjMHQxNSBwbGV4IHJhaWQucDMg c3RhdGUgc3RhbGUgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDE4NDQ2NzQ0 MDczNzA5NTUxNjE1cyBwbGV4b2Zmc2V0IDQwOTZzDQpzZCBuYW1lIHJhaWQu cDMuczUgZHJpdmUgYWhjMHQwMiBwbGV4IHJhaWQucDMgc3RhdGUgc3RhbGUg bGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDQ0MDU1MTNzIHBsZXhvZmZzZXQg NTEyMHMNCnNkIG5hbWUgcmFpZC5wMy5zNiBkcml2ZSBhaGMwdDAzIHBsZXgg cmFpZC5wMyBzdGF0ZSBzdGFsZSBsZW4gNDQwNTI0OHMgZHJpdmVvZmZzZXQg NDQwNTUxM3MgcGxleG9mZnNldCA2MTQ0cw0Kc2QgbmFtZSByYWlkLnAzLnM3 IGRyaXZlIGFoYzB0MDQgcGxleCByYWlkLnAzIHN0YXRlIHN0YWxlIGxlbiA0 NDA1MjQ4cyBkcml2ZW9mZnNldCA0NDA1NTEzcyBwbGV4b2Zmc2V0IDcxNjhz DQpzZCBuYW1lIHJhaWQucDMuczggZHJpdmUgYWhjMHQwOSBwbGV4IHJhaWQu cDMgc3RhdGUgc3RhbGUgbGVuIDQ0MDUyNDhzIGRyaXZlb2Zmc2V0IDQ0MDU1 MTNzIHBsZXhvZmZzZXQgODE5MnMNCnNkIG5hbWUgcmFpZC5wMy5zOSBkcml2 ZSBhaGMwdDEwIHBsZXggcmFpZC5wMyBzdGF0ZSBzdGFsZSBsZW4gNDQwNTI0 OHMgZHJpdmVvZmZzZXQgNDQwNTUxM3MgcGxleG9mZnNldCA5MjE2cw0KDQo= --0-163051839-1102302967=:52366--