From owner-freebsd-stable@FreeBSD.ORG Wed Sep 6 22:20:42 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 51D7616A4DA for ; Wed, 6 Sep 2006 22:20:42 +0000 (UTC) (envelope-from volker@vwsoft.com) Received: from frontmail.ipactive.de (frontmail.ipactive.de [85.214.39.229]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6108343D9D for ; Wed, 6 Sep 2006 22:17:49 +0000 (GMT) (envelope-from volker@vwsoft.com) Received: from mail.vtec.ipme.de (gprs-pool-1-014.eplus-online.de [212.23.126.14]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by frontmail.ipactive.de (Postfix) with ESMTP id A6C3033D21 for ; Thu, 7 Sep 2006 00:17:41 +0200 (CEST) Received: from [127.0.0.1] (cesar.sz.vwsoft.com [192.168.16.3]) by mail.vtec.ipme.de (Postfix) with ESMTP id 549E12E54D for ; Thu, 7 Sep 2006 00:17:24 +0200 (CEST) Message-ID: <44FF4909.9020108@vwsoft.com> Date: Thu, 07 Sep 2006 00:17:45 +0200 From: Volker User-Agent: Thunderbird 1.5.0.5 (Windows/20060719) MIME-Version: 1.0 To: freebsd-stable@freebsd.org X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-VWSoft-MailScanner: Found to be clean X-MailScanner-From: volker@vwsoft.com X-ipactive-MailScanner-Information: Please contact the ISP for more information X-ipactive-MailScanner: Found to be clean X-ipactive-MailScanner-From: volker@vwsoft.com Subject: gmirror RAID-1: rebuilding freezes machine X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Sep 2006 22:20:42 -0000 Hi folks, running at RELENG_6. I've csup'ed and rebuild kernel + world on 2006-09-03 and again on 2006-09-05 because of some trouble (panics related to altq). Because I've experienced some panics (well... not really me who does panic), my gmirror RAID-1 is causing trouble since the kernel + world build done at 2006-09-05. This issue hasn't been experienced with my 2006-09-03 build. Now the issue: The system panics (not related to this problem). Because of the panic, my gmirror RAID-1 is going out of sync. When the machine comes up again, gmirror tries an automatic syncing of the mirror(s). As soon as this is starting, the machine is blocking (keyboard input is ok as long as I'm not going to do something disk-consuming). `gmirror status' says it's rebuilding but in fact there's no disk activity and the HDD LED is constantly ON. The only way out is sometimes CTRL+ALT+DEL, sometimes I need to break to debugger and hard-reset the system. The only way out of this machine freeze is to startup into su-mode, deactivate/remove some gmirror providers and run in degraded mode all time. The machine also does freeze in su-mode as soon as I'm manually trying to re-sync the mirror. So I think I've made sure it's really a gmirror problem. I've seen there have been some cvs commits between 2006-09-03 and 2006-09-05. Are there any changes to take note of? Any configuration changes which I should have done? I'll now go on and rebuild kernel (already done) + world with freshly csup'ed sources, reboot and test once more if gmirror freezes again (will take an hour). Running gmirror with four slices (gm0s1: ad4s1, ad6s1; gm0s2: ad4s2, ad6s2 etc.). Greetings, Volker `gmirror list': > Geom name: gm0s1 > State: DEGRADED > Components: 2 > Balance: round-robin > Slice: 4096 > Flags: NONE > GenID: 0 > SyncID: 5 > ID: 1809089446 > Providers: > 1. Name: mirror/gm0s1 > Mediasize: 9656445952 (9.0G) > Sectorsize: 512 > Mode: r5w5e5 > Consumers: > 1. Name: ad4s1 > Mediasize: 9656446464 (9.0G) > Sectorsize: 512 > Mode: r1w1e1 > State: ACTIVE > Priority: 0 > Flags: DIRTY > GenID: 0 > SyncID: 5 > ID: 3309288876 > > Geom name: gm0s2 > State: COMPLETE > Components: 1 > Balance: round-robin > Slice: 4096 > Flags: NOAUTOSYNC > GenID: 0 > SyncID: 2 > ID: 1504765676 > Providers: > 1. Name: mirror/gm0s2 > Mediasize: 10733989888 (10G) > Sectorsize: 512 > Mode: r5w5e6 > Consumers: > 1. Name: ad4s2 > Mediasize: 10733990400 (10G) > Sectorsize: 512 > Mode: r1w1e1 > State: ACTIVE > Priority: 0 > Flags: DIRTY > GenID: 0 > SyncID: 2 > ID: 2791311183 > > Geom name: gm0s3 > State: COMPLETE > Components: 1 > Balance: round-robin > Slice: 4096 > Flags: NOAUTOSYNC > GenID: 0 > SyncID: 2 > ID: 2973128024 > Providers: > 1. Name: mirror/gm0s3 > Mediasize: 28985886208 (27G) > Sectorsize: 512 > Mode: r5w5e6 > Consumers: > 1. Name: ad4s3 > Mediasize: 28985886720 (27G) > Sectorsize: 512 > Mode: r1w1e1 > State: ACTIVE > Priority: 0 > Flags: DIRTY > GenID: 0 > SyncID: 2 > ID: 2358433002 > > Geom name: gm0s4 > State: COMPLETE > Components: 1 > Balance: round-robin > Slice: 4096 > Flags: NOAUTOSYNC > GenID: 0 > SyncID: 1 > ID: 3151030525 > Providers: > 1. Name: mirror/gm0s4 > Mediasize: 30647392768 (29G) > Sectorsize: 512 > Mode: r1w1e2 > Consumers: > 1. Name: ad4s4 > Mediasize: 30647393280 (29G) > Sectorsize: 512 > Mode: r1w1e1 > State: ACTIVE > Priority: 0 > Flags: NONE > GenID: 0 > SyncID: 1 > ID: 2328062130 > `dmesg': > Copyright (c) 1992-2006 The FreeBSD Project. > Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 > The Regents of the University of California. All rights reserved. > FreeBSD 6.1-STABLE #6: Tue Sep 5 01:34:11 CEST 2006 > root@bellona.sz.vwsoft.com:/usr/obj/usr/src/sys/BELLONA > WARNING: debug.mpsafenet forced to 0 as i4b_ipr requires Giant > WARNING: MPSAFE network stack disabled, expect reduced performance. > ACPI APIC Table: > Timecounter "i8254" frequency 1193182 Hz quality 0 > CPU: AMD Sempron(tm) 2600+ (1832.75-MHz 686-class CPU) > Origin = "AuthenticAMD" Id = 0x681 Stepping = 1 > Features=0x383fbff OV,PAT,PSE36,MMX,FXSR,SSE> > AMD Features=0xc0480800 > real memory = 536805376 (511 MB) > avail memory = 515743744 (491 MB) > ioapic0 irqs 0-23 on motherboard > wlan: mac acl policy registered > ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) > acpi0: on motherboard > acpi0: Power Button (fixed) > Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 > acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 > cpu0: on acpi0 > acpi_button0: on acpi0 > pcib0: port 0xcf8-0xcff on acpi0 > pci0: on pcib0 > agp0: mem 0xe0000000-0 > xe3ffffff at device 0.0 on pci0 > pcib1: at device 1.0 on pci0 > pci1: on pcib1 > pci1: at device 0.0 (no driver attached) > ath0: mem 0xdffe0000-0xdffeffff irq 18 at device 10.0 on pci0 > ath0: [GIANT-LOCKED] > ath0: Ethernet address: 00:09:5b:89:7d:1f > ath0: mac 5.6 phy 4.1 5ghz radio 1.7 2ghz radio 2.3 > ifpi0: port 0xd400-0xd41f mem 0xdfffbfe0-0xdfffbfff irq 19 > at device 11.0 on pci0 > ifpi0: [GIANT-LOCKED] > ifpi0: ISAC 2085 Version A1/A2 or 2086/2186 Version 1.1 (IOM-2) > ifpi0: passive stack unit 0 > ahc0: port 0xd000-0xd0ff mem 0xdfffa000-0 > xdfffafff irq 16 at device 12.0 on pci0 > ahc0: [GIANT-LOCKED] > aic7892: Ultra160 Wide Channel A, SCSI Id=7, 32/253 SCBs > cbb0: at device 13.0 on pci0 > cardbus0: on cbb0 > pccard0: <16-bit PCCard bus> on cbb0 > atapci0: port 0xec00-0xec07,0xe800-0xe803,0xe400-0 > xe407,0xe000-0xe003,0xdc00-0xdc0f,0xd800-0xd8ff irq 20 at device 15.0 on pci0 > ata2: on atapci0 > ata3: on atapci0 > atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376, > 0xfc00-0xfc0f at device 15.1 on pci0 > ata0: on atapci1 > ata1: on atapci1 > uhci0: port 0xc000-0xc01f irq 21 at device 16.0 on p > ci0 > uhci0: [GIANT-LOCKED] > usb0: on uhci0 > usb0: USB revision 1.0 > uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub0: 2 ports with 2 removable, self powered > uhci1: port 0xc400-0xc41f irq 21 at device 16.1 on p > ci0 > uhci1: [GIANT-LOCKED] > usb1: on uhci1 > usb1: USB revision 1.0 > uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub1: 2 ports with 2 removable, self powered > uhci2: port 0xc800-0xc81f irq 21 at device 16.2 on p > ci0 > uhci2: [GIANT-LOCKED] > usb2: on uhci2 > usb2: USB revision 1.0 > uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub2: 2 ports with 2 removable, self powered > uhci3: port 0xcc00-0xcc1f irq 21 at device 16.3 on p > ci0 > uhci3: [GIANT-LOCKED] > usb3: on uhci3 > usb3: USB revision 1.0 > uhub3: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 > uhub3: 2 ports with 2 removable, self powered > ehci0: mem 0xdfffbd00-0xdfffbdff irq 21 at devic > e 16.4 on pci0 > ehci0: [GIANT-LOCKED] > usb4: EHCI version 1.0 > usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 > usb4: on ehci0 > usb4: USB revision 2.0 > uhub4: VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 > uhub4: 8 ports with 8 removable, self powered > isab0: at device 17.0 on pci0 > isa0: on isab0 > pci0: at device 17.5 (no driver attached) > vr0: port 0xb800-0xb8ff mem 0xdfffbc00-0xdfff > bcff irq 23 at device 18.0 on pci0 > miibus0: on vr0 > ukphy0: on miibus0 > ukphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > vr0: Ethernet address: 00:0b:6a:7d:a9:a2 > vr0: [GIANT-LOCKED] > acpi_button1: on acpi0 > sio0: configured irq 4 not in bitmap of probed irqs 0 > sio0: port may not be enabled > sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0 > sio0: type 16550A > ppc0: port 0x378-0x37f,0x778-0x77b irq 7 drq 0 on ac > pi0 > ppc0: SMC-like chipset (ECP/EPP/PS2/NIBBLE) in COMPATIBLE mode > ppc0: FIFO with 16/16/9 bytes threshold > ppbus0: on ppc0 > lpt0: on ppbus0 > lpt0: Interrupt-driven port > ppi0: on ppbus0 > atkbdc0: port 0x60,0x64 irq 1 on acpi0 > atkbd0: irq 1 on atkbdc0 > kbd0 at atkbd0 > atkbd0: [GIANT-LOCKED] > pmtimer0 on isa0 > orm0: at iomem 0xc0000-0xcafff on isa0 > sc0: at flags 0x100 on isa0 > sc0: VGA <12 virtual consoles, flags=0x300> > vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 > ucom0: Lucent Technologies, Inc. ELSA Modem Board, rev 1.00/1.00, addr 2, iclass > 2/2 > ucom0: data interface 1, has CM over data, has break > ucom0: status change notification available > aue0: ADMtek USB To LAN Converter, rev 1.10/1.01, addr 2 > miibus1: on aue0 > ukphy1: on miibus1 > ukphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto > aue0: Ethernet address: 00:00:4e:11:16:c6 > Timecounter "TSC" frequency 1832745670 Hz quality 800 > Timecounters tick every 1.000 msec > i4bisppp: 1 ISDN SyncPPP device(s) attached > i4b: ISDN call control device attached > i4btel: 2 ISDN telephony interface device(s) attached > i4btrc: 1 ISDN trace device(s) attached > i4bipr: 1 IP over raw HDLC ISDN device(s) attached (VJ header compression) > i4bctl: ISDN system control port attached > i4brbch: 2 raw B channel access device(s) attached > Fast IPsec: Initialized Security Association Processing. > pccard0: Allocation failed for cfe 7 > sio1: at port 0x2f8-0x2ff irq 17 function 0 > config 15 on pccard0 > sio1: type 16550A > sio1: unable to activate interrupt in fast mode - using normal mode > pccard0: Allocation failed for cfe 7 > pccard0: Allocation failed for cfe 15 > sio2: at port 0x2e8-0x2ef irq 17 function 1 > config 23 on pccard0 > sio2: type 16550A > sio2: unable to activate interrupt in fast mode - using normal mode > acd0: CDRW at ata0-master UDMA33 > ad4: 76319MB at ata2-master SATA150 > ad6: 78533MB at ata3-master SATA150 > Waiting 6 seconds for SCSI devices to settle > GEOM_MIRROR: Device gm0s1 created (id=1809089446). > GEOM_MIRROR: Device gm0s1: provider ad4s1 detected. > GEOM_MIRROR: Device gm0s2 created (id=1504765676). > GEOM_MIRROR: Device gm0s2: provider ad4s2 detected. > GEOM_MIRROR: Device gm0s3 created (id=2973128024). > GEOM_MIRROR: Device gm0s3: provider ad4s3 detected. > GEOM_MIRROR: Device gm0s4 created (id=3151030525). > GEOM_MIRROR: Device gm0s4: provider ad4s4 detected. > GEOM_MIRROR: Device gm0s1: provider ad6s1 detected. > GEOM_MIRROR: Device gm0s1: provider ad6s1 activated. > GEOM_MIRROR: Device gm0s1: provider ad4s1 activated. > GEOM_MIRROR: Device gm0s1: provider mirror/gm0s1 launched. > GEOM_MIRROR: Device gm0s2: provider ad6s2 detected. > GEOM_MIRROR: Device gm0s2: provider ad6s2 activated. > GEOM_MIRROR: Device gm0s2: provider ad4s2 activated. > GEOM_MIRROR: Device gm0s2: provider mirror/gm0s2 launched. > GEOM_MIRROR: Device gm0s3: provider ad6s3 detected. > GEOM_MIRROR: Device gm0s3: provider ad6s3 activated. > GEOM_MIRROR: Device gm0s3: provider ad4s3 activated. > GEOM_MIRROR: Device gm0s3: provider mirror/gm0s3 launched. > GEOM_MIRROR: Device gm0s4: provider ad6s4 detected. > GEOM_MIRROR: Device gm0s4: provider ad6s4 activated. > GEOM_MIRROR: Device gm0s4: provider ad4s4 activated. > GEOM_MIRROR: Device gm0s4: provider mirror/gm0s4 launched. > cd0 at ata0 bus 0 target 0 lun 0 > cd0: Removable CD-ROM SCSI-0 device > cd0: 33.000MB/s transfers > cd0: Attempt to query device size failed: NOT READY, Medium not present > Trying to mount root from ufs:/dev/mirror/gm0s1a