From owner-freebsd-geom@FreeBSD.ORG Thu Mar 17 08:33:21 2005 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4728316A4CF for ; Thu, 17 Mar 2005 08:33:21 +0000 (GMT) Received: from gondolin.valar.ws (gondolin.valar.ws [66.216.68.225]) by mx1.FreeBSD.org (Postfix) with SMTP id 7C6F643D1D for ; Thu, 17 Mar 2005 08:33:16 +0000 (GMT) (envelope-from daniel@zepeda.ws) Received: (qmail 85249 invoked by uid 89); 17 Mar 2005 08:33:14 -0000 Received: from nat-vlan0200.sat4.rackspace.com (HELO ?10.6.100.229?) (daniel@zepeda.ws@64.39.0.38) by gondolin.valar.ws with SMTP; 17 Mar 2005 08:33:14 -0000 Message-ID: <423940C4.6010807@zepeda.ws> Date: Thu, 17 Mar 2005 02:33:08 -0600 From: "Daniel P. Zepeda" User-Agent: Mozilla Thunderbird 0.8 (X11/20040913) X-Accept-Language: en-us, en MIME-Version: 1.0 To: "Daniel P. Zepeda" References: <4236A8F3.8090105@hacknslash.org> <42375BB2.2080903@zepeda.ws> In-Reply-To: <42375BB2.2080903@zepeda.ws> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit cc: octavian@hacknslash.org cc: freebsd-geom@freebsd.org Subject: Re: gmirror cannot update metadata on disk da0s1 X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 17 Mar 2005 08:33:21 -0000 Here's a link on osnews detailing my experience: http://www.osnews.com/comment.php?news_id=9378 Daniel P. Zepeda wrote: > What worked for me was the whole disk approach, not on-a-slice, > ensured that 'swapoff="YES" was in /etc/rc.conf, changed the reboot > and halt commands to shell scripts to ensure I always use 'shutdown > - when rebooting, and the final nugget was to add: > > kern.geom.mirror.timeout=0 > > to /boot/loader.conf > > I think that was all, if I remember anything else, I'll let you know. > Hope it helps. > > DZ > > Octavian Hornoiu wrote: > >> I have followed the instructions as per the document at >> http://people.freebsd.org/~rse/mirror/ to setup my geom mirror using >> FreeBSD 5.3-p5 and two 70 gig SCSI maxtor drives of identical size. I >> have tried both the whole partition gm0 and single slice gm0s1 >> alternatives to mirroring the drives and I have tried both hardcoding >> and without hardcoding and I still get cannot update metadata or cannot >> read metadata or cannot write metadata. The drive with metadata >> problems will change depending with the setup so sometimes da0 works >> fine and da1 is broken or vice versa. There does not seem to be a >> pattern to this. I have worked with vinum many times before and I'm not >> inexperience but I have reached the end of the road with gmirror. I've >> tried 8 times to mirror these disks now with different configurations >> and I've failed every time. I have even alternated the sizes of the >> slices and left room at the end of the drive, at the beginning of the >> drive, etc. Here are the appropriate informational dumps: >> >> Copyright (c) 1992-2004 The FreeBSD Project. >> Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 >> The Regents of the University of California. All rights reserved. >> FreeBSD 5.3-RELEASE-p5 #0: Wed Feb 23 16:19:57 PST 2005 >> root@capone.bellevuechristian.org:/usr/obj/usr/src/sys/CAPONE >> Timecounter "i8254" frequency 1193182 Hz quality 0 >> CPU: Intel(R) Xeon(TM) CPU 2.80GHz (2793.19-MHz 686-class CPU) >> Origin = "GenuineIntel" Id = 0xf41 Stepping = 1 >> >> Features=0xbfebfbff >> >> Hyperthreading: 2 logical CPUs >> real memory = 2147221504 (2047 MB) >> avail memory = 2095755264 (1998 MB) >> ACPI APIC Table: >> FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs >> cpu0 (BSP): APIC ID: 0 >> cpu1 (AP): APIC ID: 1 >> cpu2 (AP): APIC ID: 6 >> cpu3 (AP): APIC ID: 7 >> ioapic0: Changing APIC ID to 8 >> ioapic1: Changing APIC ID to 9 >> ioapic1: WARNING: intbase 32 != expected base 24 >> ioapic2: Changing APIC ID to 10 >> ioapic2: WARNING: intbase 64 != expected base 56 >> ioapic0 irqs 0-23 on motherboard >> ioapic1 irqs 32-55 on motherboard >> ioapic2 irqs 64-87 on motherboard >> netsmb_dev: loaded >> npx0: [FAST] >> npx0: on motherboard >> npx0: INT 16 interface >> acpi0: on motherboard >> acpi0: Power Button (fixed) >> Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 >> acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 >> cpu0: on acpi0 >> cpu1: on acpi0 >> cpu2: on acpi0 >> cpu3: on acpi0 >> pcib0: port 0xcf8-0xcff on acpi0 >> pci0: on pcib0 >> pcib1: at device 2.0 on pci0 >> pci1: on pcib1 >> pcib2: at device 0.0 on pci1 >> pci2: on pcib2 >> pcib3: at device 0.2 on pci1 >> pci3: on pcib3 >> mpt0: port 0xec00-0xecff mem >> 0xdfde0000-0xdfdeffff,0xdfdf0000-0xdfdfffff irq 34 at device 5.0 on pci3 >> mpt0: [GIANT-LOCKED] >> em0: port >> 0xe8c0-0xe8ff mem 0xdfdc0000-0xdfddffff irq 39 at device 12.0 on pci3 >> em0: Ethernet address: 00:0e:0c:69:3a:44 >> em0: Speed:N/A Duplex:N/A >> pcib4: at device 4.0 on pci0 >> pci4: on pcib4 >> pcib5: at device 5.0 on pci0 >> pci5: on pcib5 >> pcib6: at device 0.0 on pci5 >> pci6: on pcib6 >> em1: port >> 0xdcc0-0xdcff mem 0xdfae0000-0xdfafffff irq 64 at device 7.0 on pci6 >> em1: Ethernet address: 00:11:43:d7:64:2e >> em1: Speed:N/A Duplex:N/A >> pcib7: at device 0.2 on pci5 >> pci7: on pcib7 >> em2: port >> 0xccc0-0xccff mem 0xdf8e0000-0xdf8fffff irq 65 at device 8.0 on pci7 >> em2: Ethernet address: 00:11:43:d7:64:2f >> em2: Speed:N/A Duplex:N/A >> pcib8: at device 6.0 on pci0 >> pci8: on pcib8 >> uhci0: port 0xace0-0xacff >> irq 16 at device 29.0 on pci0 >> uhci0: [GIANT-LOCKED] >> usb0: on uhci0 >> usb0: USB revision 1.0 >> uhub0: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 >> uhub0: 2 ports with 2 removable, self powered >> uhci1: port 0xacc0-0xacdf >> irq 19 at device 29.1 on pci0 >> uhci1: [GIANT-LOCKED] >> usb1: on uhci1 >> usb1: USB revision 1.0 >> uhub1: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 >> uhub1: 2 ports with 2 removable, self powered >> uhub2: Dell product 0xa001, class 9/0, rev 2.00/0.00, addr 2 >> uhub2: 2 ports with 2 removable, self powered >> uhci2: port 0xaca0-0xacbf >> irq 18 at device 29.2 on pci0 >> uhci2: [GIANT-LOCKED] >> usb2: on uhci2 >> usb2: USB revision 1.0 >> uhub3: Intel UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 >> uhub3: 2 ports with 2 removable, self powered >> ums0: Microsoft Microsoft 5-Button Mouse with IntelliEye(TM), rev >> 1.10/3.00, addr 2, iclass 3/1 >> ums0: 5 buttons and Z dir. >> pci0: at device 29.7 (no driver attached) >> pcib9: at device 30.0 on pci0 >> pci9: on pcib9 >> pci9: at device 13.0 (no driver attached) >> isab0: at device 31.0 on pci0 >> isa0: on isab0 >> atapci0: port >> 0xfc00-0xfc0f,0x376,0x170-0x177,0x3f6,0x1f0-0x1f7 at device 31.1 on pci0 >> ata0: channel #0 on atapci0 >> ata1: channel #1 on atapci0 >> fdc0: port 0x3f7,0x3f0-0x3f5 irq 6 drq 2 on >> acpi0 >> fdc0: [FAST] >> fd0: <1440-KB 3.5" drive> on fdc0 drive 0 >> atkbdc0: port 0x64,0x60 irq 1 on acpi0 >> atkbd0: irq 1 on atkbdc0 >> kbd0 at atkbd0 >> atkbd0: [GIANT-LOCKED] >> sio0: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 flags 0x10 on >> acpi0 >> sio0: type 16550A >> orm0: at iomem >> 0xec000-0xeffff,0xcb000-0xcefff,0xc0000-0xcafff on isa0 >> pmtimer0 on isa0 >> ppc0: parallel port not found. >> sc0: at flags 0x100 on isa0 >> sc0: VGA <16 virtual consoles, flags=0x300> >> sio1: configured irq 3 not in bitmap of probed irqs 0 >> sio1: port may not be enabled >> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on >> isa0 >> Timecounters tick every 10.000 msec >> acd0: CDROM at ata0-master UDMA33 >> Waiting 15 seconds for SCSI devices to settle >> ses0 at mpt0 bus 0 target 6 lun 0 >> ses0: Fixed Processor SCSI-2 device >> ses0: 3.300MB/s transfers >> ses0: SAF-TE Compliant Device >> da0 at mpt0 bus 0 target 0 lun 0 >> da0: Fixed Direct Access SCSI-3 device >> da0: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged >> Queueing Enabled >> da0: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C) >> da1 at mpt0 bus 0 target 1 lun 0 >> da1: Fixed Direct Access SCSI-3 device >> da1: 320.000MB/s transfers (160.000MHz, offset 127, 16bit), Tagged >> Queueing Enabled >> da1: 70007MB (143374650 512 byte sectors: 255H 63S/T 8924C) >> GEOM_MIRROR: Device gm0s1 created (id=1445021139). >> GEOM_MIRROR: Device gm0s1: provider da0s1 detected. >> GEOM_MIRROR: Device gm0s1: provider da1s1 detected. >> GEOM_MIRROR: Device gm0s1: provider da1s1 activated. >> GEOM_MIRROR: Cannot update metadata on disk da0s1 (error=1). >> GEOM_MIRROR: Device gm0s1: provider da0s1 activated. >> GEOM_MIRROR: Device gm0s1: provider mirror/gm0s1 launched. >> GEOM_MIRROR: Cannot update metadata on disk da0s1 (error=1). >> GEOM_MIRROR: Device gm0s1: provider da0s1 disconnected. >> SMP: AP CPU #3 Launched! >> SMP: AP CPU #1 Launched! >> SMP: AP CPU #2 Launched! >> Mounting root from ufs:/dev/mirror/gm0s1a >> em0: Link is up 100 Mbps Full Duplex >> >> >> Metadata on /dev/da1s1: >> magic: GEOM::MIRROR >> version: 1 >> name: gm0s1 >> mid: 1445021139 >> did: 4266048836 >> all: 2 >> syncid: 3 >> priority: 0 >> slice: 4096 >> balance: round-robin >> mediasize: 73402365952 >> sectorsize: 512 >> syncoffset: 0 >> mflags: NONE >> dflags: DIRTY >> hcprovider: da1s1 >> MD5 hash: c082817f594eb795a95ebb547bb20f71 >> >> >> Metadata on /dev/da0s1: >> magic: GEOM::MIRROR >> version: 1 >> name: gm0s1 >> mid: 1445021139 >> did: 1764218562 >> all: 2 >> syncid: 3 >> priority: 0 >> slice: 4096 >> balance: round-robin >> mediasize: 73402365952 >> sectorsize: 512 >> syncoffset: 22164275200 >> mflags: NONE >> dflags: DIRTY SYNCHRONIZING >> hcprovider: da0s1 >> MD5 hash: 74f4f6b2cc14a5624539431c455cab81 >> >> >> Geom name: gm0s1 >> State: DEGRADED >> Components: 2 >> Balance: round-robin >> Slice: 4096 >> Flags: NONE >> SyncID: 5 >> ID: 1445021139 >> Providers: >> 1. Name: mirror/gm0s1 >> Mediasize: 73402365952 (68G) >> Sectorsize: 512 >> Mode: r6w6e1 >> Consumers: >> 1. Name: da1s1 >> Mediasize: 73402366464 (68G) >> Sectorsize: 512 >> Mode: r6w6e2 >> State: ACTIVE >> Priority: 0 >> Flags: DIRTY, HARDCODED >> SyncID: 5 >> ID: 4266048836 >> >> Geom name: gm0s1.sync >> >> >> >> ******* Working on device /dev/da1 ******* >> parameters extracted from in-core disklabel are: >> cylinders=8924 heads=255 sectors/track=63 (16065 blks/cyl) >> >> Figures below won't work with BIOS for partitions not in cyl 1 >> parameters to be used for BIOS calculations are: >> cylinders=8924 heads=255 sectors/track=63 (16065 blks/cyl) >> >> Media sector size is 512 >> Warning: BIOS sector numbering starts with sector 1 >> Information from DOS bootblock is: >> The data for partition 1 is: >> sysid 165 (0xa5),(FreeBSD/NetBSD/386BSD) >> start 63, size 143363997 (70001 Meg), flag 80 (active) >> beg: cyl 0/ head 1/ sector 1; >> end: cyl 1023/ head 254/ sector 63 >> The data for partition 2 is: >> >> The data for partition 3 is: >> >> The data for partition 4 is: >> >> >> >> >> >> # /dev/mirror/gm0s1: >> 8 partitions: >> # size offset fstype [fsize bsize bps/cpg] >> a: 1024000 0 4.2BSD 2048 16384 64008 >> b: 8388608 1024000 swap >> c: 143363996 0 unused 0 0 # "raw" part, >> don't ed$ >> d: 8388608 9412608 4.2BSD 2048 16384 28552 >> e: 4194304 17801216 4.2BSD 2048 16384 28552 >> f: 10240000 21995520 4.2BSD 2048 16384 28552 >> g: 110182400 32235520 4.2BSD 2048 16384 28552 >> >> >> Any help would be greatly appreciated! I am ready to pull my hair out >> and I'm already going bald so that would be bad! >> >> Octavian Hornoiu >> >> >> ------------------------------------------------------------------------ >> >> _______________________________________________ >> freebsd-geom@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-geom >> To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org" >> >> > > _______________________________________________ > freebsd-geom@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-geom > To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org"