From owner-freebsd-stable@FreeBSD.ORG Fri Nov 4 21:27:01 2005 Return-Path: X-Original-To: stable@freebsd.org Delivered-To: freebsd-stable@FreeBSD.ORG Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C651016A420; Fri, 4 Nov 2005 21:27:01 +0000 (GMT) (envelope-from Benjamin.Kelly@argonst.com) Received: from timesheets.argoneng.com (nat.argoneng.com [208.247.255.11]) by mx1.FreeBSD.org (Postfix) with SMTP id 7802B43D48; Fri, 4 Nov 2005 21:26:59 +0000 (GMT) (envelope-from Benjamin.Kelly@argonst.com) Received: from tethys.argon.local ([192.168.1.247]) by timesheets.argoneng.com (SMSSMTP 4.0.0.59) with SMTP id M2005110416301709051 ; Fri, 04 Nov 2005 16:30:17 -0500 Received: from lh.argoneng.com ([192.168.2.1]) by tethys.argon.local with Microsoft SMTPSVC(6.0.3790.1830); Fri, 4 Nov 2005 16:26:55 -0500 Received: from cordia.argon.local (cordia.argon.local [192.168.33.101]) by lh.argoneng.com (8.11.6/8.11.0) with ESMTP id jA4LQv602949; Fri, 4 Nov 2005 16:26:58 -0500 From: Ben Kelly To: le@freebsd.org, stable@freebsd.org Date: Fri, 4 Nov 2005 16:26:56 -0500 User-Agent: KMail/1.8.2 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200511041626.57431.Benjamin.Kelly@argonst.com> X-OriginalArrivalTime: 04 Nov 2005 21:26:55.0866 (UTC) FILETIME=[7B31DDA0:01C5E186] Cc: Subject: RELENG_6 gvinum mirror problem X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 04 Nov 2005 21:27:02 -0000 Hello, I just upgraded my RELENG_5 box to RELENG_6. This machine has two drives mirrored using gvinum. Everything was working well under 5.x, but when I booted to 6.x I noticed only one drive was receiving transactions. I see no error messages in my logs. Running 'gvinum list' produces the following strange output: 2 drives: D rootback State: up /dev/ad6s1h A: 92721/152625 MB (60%) D rootmain State: up /dev/ad4s1h A: 152625/152625 MB (100%) 8 volumes: V swap State: up Plexes: 1 Size: 2048 MB V exports State: up Plexes: 1 Size: 10 GB V var State: up Plexes: 1 Size: 2048 MB V usr State: up Plexes: 1 Size: 10 GB V home State: up Plexes: 1 Size: 10 GB V root State: up Plexes: 1 Size: 512 MB V mirror State: up Plexes: 1 Size: 4096 MB V backups State: up Plexes: 1 Size: 20 GB 16 plexes: P swap.p1 C State: up Subdisks: 1 Size: 2048 MB P swap.p0 C State: up Subdisks: 0 Size: 0 B P exports.p1 C State: up Subdisks: 1 Size: 10 GB P exports.p0 C State: up Subdisks: 0 Size: 0 B P var.p1 C State: up Subdisks: 1 Size: 2048 MB P usr.p1 C State: up Subdisks: 1 Size: 10 GB P home.p1 C State: up Subdisks: 1 Size: 10 GB P root.p1 C State: up Subdisks: 1 Size: 512 MB P var.p0 C State: up Subdisks: 0 Size: 0 B P usr.p0 C State: up Subdisks: 0 Size: 0 B P home.p0 C State: up Subdisks: 0 Size: 0 B P root.p0 C State: up Subdisks: 0 Size: 0 B P mirror.p0 C State: up Subdisks: 0 Size: 0 B P mirror.p1 C State: up Subdisks: 1 Size: 4096 MB P backups.p0 C State: up Subdisks: 0 Size: 0 B P backups.p1 C State: up Subdisks: 1 Size: 20 GB 16 subdisks: S swap.p1.s0 State: up D: rootback Size: 2048 MB S swap.p0.s0 State: up D: rootmain Size: 2048 MB S exports.p1.s0 State: up D: rootback Size: 10 GB S exports.p0.s0 State: up D: rootmain Size: 10 GB S var.p1.s0 State: up D: rootback Size: 2048 MB S usr.p1.s0 State: up D: rootback Size: 10 GB S home.p1.s0 State: up D: rootback Size: 10 GB S root.p1.s0 State: up D: rootback Size: 512 MB S var.p0.s0 State: up D: rootmain Size: 2048 MB S usr.p0.s0 State: up D: rootmain Size: 10 GB S home.p0.s0 State: up D: rootmain Size: 10 GB S root.p0.s0 State: up D: rootmain Size: 512 MB S mirror.p0.s0 State: up D: rootmain Size: 4096 MB S mirror.p1.s0 State: up D: rootback Size: 4096 MB S backups.p0.s0 State: up D: rootmain Size: 20 GB S backups.p1.s0 State: up D: rootback Size: 20 GB As you can see the plexes for drive rootmain show zero size and zero subdisks. The subdisks for drive rootmain, however, do show up and claim to have space. I don't know if it matters, but these disks were originally setup with vinum prior to the creation of gvinum. That being said, they have been running with gvinum quite well under 5.x for a while. Anyone have any ideas on whats going on here? Any help would be greatly appreciated. Thanks. - Ben dmesg follows: Syncing disks, vnodes remaining...3 3 3 0 0 0 0 done No buffers busy after final sync Copyright (c) 1992-2005 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD 6.0-STABLE #0: Fri Nov 4 13:54:41 EST 2005 bkelly@vir.in.vadev.org:/usr/obj/usr/src/sys/SERVER Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(TM)Processor (1343.19-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x642 Stepping = 2 Features=0x183f9ff AMD Features=0xc0440800,MMX+,3DNow+,3DNow> real memory = 1342095360 (1279 MB) avail memory = 1305456640 (1244 MB) npx0: [FAST] npx0: on motherboard npx0: INT 16 interface acpi0: on motherboard acpi0: Power Button (fixed) pci_link0: irq 11 on acpi0 pci_link1: on acpi0 pci_link2: on acpi0 pci_link3: on acpi0 pci_link4: irq 10 on acpi0 pci_link5: irq 7 on acpi0 pci_link6: on acpi0 pci_link7: on acpi0 pci_link8: irq 5 on acpi0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0xe408-0xe40b on acpi0 cpu0: on acpi0 acpi_button0: on acpi0 pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 pcib1: at device 1.0 on pci0 pci1: on pcib1 pci1: at device 0.0 (no driver attached) ohci0: mem 0xe5800000-0xe5800fff irq 5 at device 2.0 on pci0 ohci0: [GIANT-LOCKED] usb0: OHCI version 1.0, legacy support usb0: on ohci0 usb0: USB revision 1.0 uhub0: AcerLabs OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 4 ports with 4 removable, self powered atapci0: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xd400-0xd40f at device 4.0 on pci0 atapci0: using PIO transfers above 137GB as workaround for 48bit DMA access bug, expect reduced performance ata0: on atapci0 ata1: on atapci0 ohci1: mem 0xe4800000-0xe4800fff irq 10 at device 6.0 on pci0 ohci1: [GIANT-LOCKED] usb1: OHCI version 1.0, legacy support usb1: on ohci1 usb1: USB revision 1.0 uhub1: AcerLabs OHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered isab0: at device 7.0 on pci0 isa0: on isab0 atapci1: port 0xb800-0xb807,0xb400-0xb403,0xb000-0xb007,0xa800-0xa803,0xa400-0xa40f mem 0xe3800000-0xe38000ff irq 11 at device 12.0 on pci0 ata2: on atapci1 ata3: on atapci1 dc0: port 0xa000-0xa0ff mem 0xe3000000-0xe30000ff irq 7 at device 13.0 on pci0 miibus0: on dc0 dcphy0: on miibus0 dcphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto dc0: Ethernet address: 00:a0:cc:36:04:6d pci0: at device 17.0 (no driver attached) fdc0: port 0x3f2-0x3f5,0x3f7 irq 6 drq 2 on acpi0 fdc0: [FAST] fd0: <1440-KB 3.5" drive> on fdc0 drive 0 sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 sio0: type 16550A sio1: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 on acpi0 sio1: type 16550A atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: failed to get status. psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model Generic PS/2 mouse, device ID 255 pmtimer0 on isa0 orm0: at iomem 0xc0000-0xcffff on isa0 ppc0: parallel port not found. sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 uhid0: APC Back-UPS ES 725 FW:802.n2.D USB FW:n2, rev 1.10/1.06, addr 2, iclass 3/0 Timecounter "TSC" frequency 1343188469 Hz quality 800 Timecounters tick every 10.000 msec acd0: CDROM at ata0-master UDMA33 ad4: 152627MB at ata2-master UDMA100 ad6: 152627MB at ata3-master UDMA100 Trying to mount root from ufs:/dev/gvinum/root dc0: link state changed to UP dc0: TX underrun -- increasing TX threshold