From owner-freebsd-geom@FreeBSD.ORG Sun Jun 24 12:50:09 2007 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6513416A469 for ; Sun, 24 Jun 2007 12:50:09 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 3AB6E13C447 for ; Sun, 24 Jun 2007 12:50:09 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5OCo8bY078096 for ; Sun, 24 Jun 2007 12:50:08 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5OCo8RE078095; Sun, 24 Jun 2007 12:50:08 GMT (envelope-from gnats) Date: Sun, 24 Jun 2007 12:50:08 GMT Message-Id: <200706241250.l5OCo8RE078095@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: Yoshisato YANAGISAWA Cc: Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Yoshisato YANAGISAWA List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Jun 2007 12:50:09 -0000 The following reply was made to PR kern/113790; it has been noted by GNATS. From: Yoshisato YANAGISAWA To: FreeBSD-gnats-submit@FreeBSD.org, freebsd-bugs@FreeBSD.org Cc: Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). Date: Sun, 24 Jun 2007 21:33:21 +0900 Since the patch I sent with PR is hard to read, I also put it: http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia.diff From owner-freebsd-geom@FreeBSD.ORG Sun Jun 24 14:04:53 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 48C9116A468 for ; Sun, 24 Jun 2007 14:04:53 +0000 (UTC) (envelope-from k.n.kirov@gmail.com) Received: from py-out-1112.google.com (py-out-1112.google.com [64.233.166.176]) by mx1.freebsd.org (Postfix) with ESMTP id DC0FB13C44B for ; Sun, 24 Jun 2007 14:04:52 +0000 (UTC) (envelope-from k.n.kirov@gmail.com) Received: by py-out-1112.google.com with SMTP id u77so1312060pyb for ; Sun, 24 Jun 2007 07:04:52 -0700 (PDT) DKIM-Signature: a=rsa-sha1; c=relaxed/relaxed; d=gmail.com; s=beta; h=domainkey-signature:received:received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=uSF5s3DZ6ykb3K1ljSz+P4DhCjRVVJ58KQqn0NKxhQz+oMj/MNimGoXsKokxmZn2/rrKlhrNFCRGZytAXmm5vOu2kOOU9RaeATkm9q/SZsCf3NjMA069hp+C3PsaJySke7uRq14vAYuw+B+dU8WCuwN2E0T1f5OxNWGDcKz8jAo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=beta; h=received:message-id:date:from:to:subject:mime-version:content-type:content-transfer-encoding:content-disposition; b=dTk+PcT/EKAagvJPmrPCNhfRUQqWfp2dO/6iwtCJs2l3Q0W6r1Dy1uBdluMIl+tAXH8Yu+KCyMSxPKiONfXVfUdf7/+OQTNiAJ1funvqoopkdkn17kAUsQ8duCH31+FoBFlNnkYUNylqwste1mO0wkqF7AhuAJyk4FhFL9mW+3k= Received: by 10.65.133.8 with SMTP id k8mr7914247qbn.1182692434341; Sun, 24 Jun 2007 06:40:34 -0700 (PDT) Received: by 10.64.179.14 with HTTP; Sun, 24 Jun 2007 06:40:34 -0700 (PDT) Message-ID: <934e87a90706240640k3e85c33eu6608b702ac625d73@mail.gmail.com> Date: Sun, 24 Jun 2007 16:40:34 +0300 From: "Kiril Kirov" To: freebsd-geom@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Content-Disposition: inline Subject: geli not registering keypresses X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Jun 2007 14:04:53 -0000 Hello, I have successfully created GELI encrypted root partition using FreeBSD 6.2 (i386) in the way described here: http://events.ccc.de/congress/2005/fahrplan/attachments/586-paper_Complete_Hard_Disk_Encryption.pdf However, when I boot the kernel from the CD-ROM it refused to accept my passphrase. I was sure that I was typing it correctly so I googled around for the similiar problems. I found the following thread: http://docs.freebsd.org/cgi/getmsg.cgi?fetch=48980+0+archive/2006/freebsd-geom/20060409.freebsd-geom I set the kern.geom.eli.visible_passphrase to 1 and booted the kernel again. I noticed that some of my keypresses not appear on the screen. I tried to circumvent the problem without any success - compiling GELI support in custom kernel, removing kbdmux, booting from CD-ROM, PXE, etc. The problem seems to affect only GELI passphrase prompt. I tried to scroll the console using Scroll Lock and it works as expected, even when the kernel is waiting for the passphrase. I also used my keyboard at the loader prompt to load kernel modules without trouble. However when I start typing the passphrase, I have to press most of the keys for several (up to 10) times to get registered. I'm using standard PS/2 keyboard. Here is my dmesg: Copyright (c) 1992-2007 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 6.2-RELEASE #0: Fri Jan 12 10:40:27 UTC 2007 root@dessler.cse.buffalo.edu:/usr/obj/usr/src/sys/GENERIC WARNING: Network stack Giant-free, but aio requires Giant. Consider adding 'options NET_WITH_GIANT' or setting debug.mpsafenet=0 ACPI APIC Table: Timecounter "i8254" frequency 1193182 Hz quality 0 CPU: AMD Athlon(tm) 64 Processor 3200+ (2002.57-MHz 686-class CPU) Origin = "AuthenticAMD" Id = 0x10ff0 Stepping = 0 Features=0x78bfbff AMD Features=0xe2500800 AMD Features2=0x1 real memory = 1073414144 (1023 MB) avail memory = 1037221888 (989 MB) MADT: Forcing active-low polarity and level trigger for SCI ioapic0 irqs 0-23 on motherboard kbd1 at kbdmux0 kqemu version 0x00010300 kqemu: KQEMU installed, max_locked_mem=517712kB. ath_hal: 0.9.17.2 (AR5210, AR5211, AR5212, RF5111, RF5112, RF2413, RF5413) acpi0: on motherboard acpi0: Power Button (fixed) Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0 cpu0: on acpi0 acpi_perf0: invalid _PSS package pcib0: port 0xcf8-0xcff on acpi0 pci0: on pcib0 agp0: mem 0xd0000000-0xdfffffff at device 0.0 on pci0 pcib1: at device 1.0 on pci0 pci1: on pcib1 drm0: port 0xe000-0xe0ff mem 0xe8000000-0xefffffff,0xfbe00000-0xfbe0ffff irq 16 at device 0.0 on pci1 info: [drm] AGP at 0xd0000000 256MB info: [drm] Initialized radeon 1.24.0 20060225 pci1: at device 0.1 (no driver attached) fwohci0: port 0x8800-0x887f mem 0xfb600000-0xfb6007ff irq 16 at device 7.0 on pci0 fwohci0: OHCI version 1.0 (ROM=1) fwohci0: No. of Isochronous channels is 4. fwohci0: EUI64 00:11:d8:00:00:19:44:5b fwohci0: Phy 1394a available S400, 2 ports. fwohci0: Link S400, max_rec 2048 bytes. firewire0: on fwohci0 fwe0: on firewire0 if_fwe0: Fake Ethernet address: 02:11:d8:19:44:5b fwe0: Ethernet address: 02:11:d8:19:44:5b fwe0: if_start running deferred for Giant sbp0: on firewire0 fwohci0: Initiate bus reset fwohci0: node_id=0xc800ffc0, gen=1, CYCLEMASTER mode firewire0: 1 nodes, maxhop <= 0, cable IRM = 0 (me) firewire0: bus manager 0 (me) atapci0: port 0x9800-0x983f,0x9400-0x940f,0x9000-0x907f mem 0xfb800000-0xfb800fff,0xfb700000-0xfb71ffff irq 18 at device 8.0 on pci0 ata2: on atapci0 ata3: on atapci0 ata4: on atapci0 pcm0: port 0xa000-0xa03f irq 16 at device 9.0 on pci0 pcm0: pcm0: skc0: port 0xa400-0xa4ff mem 0xfba00000-0xfba03fff irq 17 at device 10.0 on pci0 skc0: Marvell Yukon Lite Gigabit Ethernet rev. (0x9) sk0: on skc0 sk0: Ethernet address: 00:11:d8:a4:ba:ef miibus0: on sk0 e1000phy0: on miibus0 e1000phy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseTX-FDX, auto atapci1: port 0xc400-0xc407,0xc000-0xc003,0xb800-0xb807,0xb400-0xb403,0xb000-0xb00f,0xa800-0xa8ff irq 20 at device 15.0 on pci0 ata5: on atapci1 ata6: on atapci1 atapci2: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xfc00-0xfc0f at device 15.1 on pci0 ata0: on atapci2 ata1: on atapci2 uhci0: port 0xc800-0xc81f irq 21 at device 16.0 on pci0 uhci0: [GIANT-LOCKED] usb0: on uhci0 usb0: USB revision 1.0 uhub0: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub0: 2 ports with 2 removable, self powered uhci1: port 0xd000-0xd01f irq 21 at device 16.1 on pci0 uhci1: [GIANT-LOCKED] usb1: on uhci1 usb1: USB revision 1.0 uhub1: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub1: 2 ports with 2 removable, self powered uhci2: port 0xd400-0xd41f irq 21 at device 16.2 on pci0 uhci2: [GIANT-LOCKED] usb2: on uhci2 usb2: USB revision 1.0 uhub2: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub2: 2 ports with 2 removable, self powered uhci3: port 0xd800-0xd81f irq 21 at device 16.3 on pci0 uhci3: [GIANT-LOCKED] usb3: on uhci3 usb3: USB revision 1.0 uhub3: VIA UHCI root hub, class 9/0, rev 1.00/1.00, addr 1 uhub3: 2 ports with 2 removable, self powered ehci0: mem 0xfbc00000-0xfbc000ff irq 21 at device 16.4 on pci0 ehci0: [GIANT-LOCKED] usb4: EHCI version 1.0 usb4: companion controllers, 2 ports each: usb0 usb1 usb2 usb3 usb4: on ehci0 usb4: USB revision 2.0 uhub4: VIA EHCI root hub, class 9/0, rev 2.00/1.00, addr 1 uhub4: 8 ports with 8 removable, self powered isab0: at device 17.0 on pci0 isa0: on isab0 acpi_button0: on acpi0 acpi_button1: on acpi0 atkbdc0: port 0x60,0x64 irq 1 on acpi0 atkbd0: irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse, device ID 3 ppc0: port 0x378-0x37f irq 7 on acpi0 ppc0: Generic chipset (NIBBLE-only) in COMPATIBLE mode ppbus0: on ppc0 plip0: on ppbus0 lpt0: on ppbus0 lpt0: Interrupt-driven port ppi0: on ppbus0 sio0: <16550A-compatible COM port> port 0x2f8-0x2ff irq 3 flags 0x10 on acpi0 sio0: type 16550A sio1: configured irq 4 not in bitmap of probed irqs 0 sio1: port may not be enabled sio1: <16550A-compatible COM port> port 0x3f8-0x3ff irq 4 on acpi0 sio1: type 16550A pmtimer0 on isa0 orm0: at iomem 0xc0000-0xccfff,0xcd000-0xcdfff on isa0 sc0: at flags 0x100 on isa0 sc0: VGA <16 virtual consoles, flags=0x300> vga0: at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0 ubt0: vendor 0x0a12 product 0x0001, rev 1.10/5.25, addr 2 ubt0: vendor 0x0a12 product 0x0001, rev 1.10/5.25, addr 2 ubt0: Interface 0 endpoints: interrupt=0x81, bulk-in=0x82, bulk-out=0x2 ubt0: Interface 1 (alt.config 5) endpoints: isoc-in=0x83, isoc-out=0x3; wMaxPacketSize=49; nframes=6, buffer size=294 Timecounter "TSC" frequency 2002572579 Hz quality 800 Timecounters tick every 1.000 msec ad4: 152627MB at ata2-master SATA150 Enter passphrase for ad4: ad6: 76319MB at ata3-master SATA150 GEOM_ELI: Device ad4.eli created. GEOM_ELI: Encryption: AES-CBC 128 GEOM_ELI: Crypto: software acd0: DVDR at ata5-master SATA150 From owner-freebsd-geom@FreeBSD.ORG Sun Jun 24 14:31:56 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 92E9D16A474 for ; Sun, 24 Jun 2007 14:31:56 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30303.mail.mud.yahoo.com (web30303.mail.mud.yahoo.com [209.191.69.65]) by mx1.freebsd.org (Postfix) with SMTP id 58E5513C4AE for ; Sun, 24 Jun 2007 14:31:56 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 96005 invoked by uid 60001); 24 Jun 2007 14:31:55 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=gCp4BeJ0dW9z/kr/XxYh3p52IDXLOF80lP261FvdBG+jJ1AHYAVz6BQ38wJAHe1dI7U0V+3xijh6K2t2jyIfa8wBSzbhjtDGfOBed3RNqWnBGbp6NqcVoX1mFVYbwCzQInvn+oLbhN4z5FQSdJzJMqT424e3MP0vPyOvTYogWMw=; X-YMail-OSG: n.Wk6ZAVM1k_pp9gEyeCfClUIoIWLq8055zdosRoVoE8U7ea0N8jqf5uiswXSujKHepxgr0LxQBOAPHiiuBv.Kp7MgdCQlAfk_.ofxjOZWxFYrtmeZKiZXMnQhpV9Q-- Received: from [89.53.2.84] by web30303.mail.mud.yahoo.com via HTTP; Sun, 24 Jun 2007 07:31:55 PDT Date: Sun, 24 Jun 2007 07:31:55 -0700 (PDT) From: Arne "Wörner" To: Kiril Kirov , freebsd-geom@freebsd.org In-Reply-To: <934e87a90706240640k3e85c33eu6608b702ac625d73@mail.gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <407300.94902.qm@web30303.mail.mud.yahoo.com> Cc: Subject: Re: geli not registering keypresses X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Jun 2007 14:31:56 -0000 --- Kiril Kirov wrote: > I tried to circumvent the problem without any success - compiling GELI > support in custom kernel, removing kbdmux, booting from CD-ROM, PXE, > etc. The problem seems to affect only GELI passphrase prompt. I tried > to scroll the console using Scroll Lock and it works as expected, even > when the kernel is waiting for the passphrase. I also used my keyboard > at the loader prompt to load kernel modules without trouble. However > when I start typing the passphrase, I have to press most of the keys > for several (up to 10) times to get registered. > Cant u circumvent the prob by not using a passphrase and by removing the little smartcard (or so), that stores the secret, after the reboot? That would make things easier in case of an emergency: U could just give the extortionist the token (smartcard?) without being concerned about ur handwriting. U could keep a copy of that token in a bank-safe for the case that the usual token gets damaged badly... I would like to have a special token (I call it "fun-token"), that makes ur box deleting the data if inserted during reboot, so that any further extortion-attempts r of no use (if and only if there is no backup -- although in that case u would lose ur data, too). -Arne ____________________________________________________________________________________Ready for the edge of your seat? Check out tonight's top picks on Yahoo! TV. http://tv.yahoo.com/ From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 07:48:22 2007 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 6AB1016A41F; Mon, 25 Jun 2007 07:48:22 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 427CF13C457; Mon, 25 Jun 2007 07:48:22 +0000 (UTC) (envelope-from linimon@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5P7mLqb077384; Mon, 25 Jun 2007 07:48:22 GMT (envelope-from linimon@freefall.freebsd.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5P7mLC7077380; Mon, 25 Jun 2007 07:48:21 GMT (envelope-from linimon) Date: Mon, 25 Jun 2007 07:48:21 GMT From: Mark Linimon Message-Id: <200706250748.l5P7mLC7077380@freefall.freebsd.org> To: linimon@FreeBSD.org, freebsd-bugs@FreeBSD.org, freebsd-geom@FreeBSD.org Cc: Subject: Re: kern/113957: [gmirror] gmirror is intermittently reporting a degraded mirror array upon reboot. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 07:48:22 -0000 Synopsis: [gmirror] gmirror is intermittently reporting a degraded mirror array upon reboot. Responsible-Changed-From-To: freebsd-bugs->freebsd-geom Responsible-Changed-By: linimon Responsible-Changed-When: Mon Jun 25 07:48:11 UTC 2007 Responsible-Changed-Why: Over to maintainer(s). http://www.freebsd.org/cgi/query-pr.cgi?pr=113957 From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 08:04:27 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B1B8216A469 for ; Mon, 25 Jun 2007 08:04:27 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30306.mail.mud.yahoo.com (web30306.mail.mud.yahoo.com [209.191.69.68]) by mx1.freebsd.org (Postfix) with SMTP id 60C8B13C45E for ; Mon, 25 Jun 2007 08:04:27 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 41093 invoked by uid 60001); 25 Jun 2007 08:04:24 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=U8himKmUcsWtPRH4l9/osByR19lYKQfH7xMcCMNQhCucICym0dgUS8xgNkj0iH+nKSCE1oMhqFYgFcJE0366zLRnPckIeBErgEgsYeWz76hEIrg2F+OLlae90FzbWaNBapRGqCziunbyTy2ytDDbQ2yPLMjzIy9WKsbTFtv/AUQ=; X-YMail-OSG: wWKs_m8VM1mQeRoZdlZd941dLVsQ8gZVlgMUoXWQqWRo.nfMiYeBEDNJr_GWCYCkJgXDsYwXEr9Pxc.KVcCOz4wzxxaaAi.4EE18sKRetv.XTxvChSNFVrETJAjv4w-- Received: from [89.53.37.83] by web30306.mail.mud.yahoo.com via HTTP; Mon, 25 Jun 2007 01:04:24 PDT Date: Mon, 25 Jun 2007 01:04:24 -0700 (PDT) From: Arne "Wörner" To: bug-followup@FreeBSD.org In-Reply-To: <200706250748.l5P7mLC7077380@freefall.freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <749748.40905.qm@web30306.mail.mud.yahoo.com> Cc: ayochum@pair.com, freebsd-geom@FreeBSD.org Subject: Re: kern/113957: [gmirror] gmirror is intermittently reporting a degraded mirror array upon reboot. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 08:04:27 -0000 How did u reboot? Pulling the power plug? ;-)) I mean: The dmesg shows, that all file systems r dirty, so that I think, that ur reboot procedure is the problem and not gmirror... -Arne ____________________________________________________________________________________ Need a vacation? Get great deals to amazing places on Yahoo! Travel. http://travel.yahoo.com/ From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 08:10:08 2007 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 9ACE816A41F for ; Mon, 25 Jun 2007 08:10:08 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 8ADFD13C43E for ; Mon, 25 Jun 2007 08:10:08 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5P8A8Rx078662 for ; Mon, 25 Jun 2007 08:10:08 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5P8A8Qe078661; Mon, 25 Jun 2007 08:10:08 GMT (envelope-from gnats) Date: Mon, 25 Jun 2007 08:10:08 GMT Message-Id: <200706250810.l5P8A8Qe078661@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: Arne "Wörner" Cc: Subject: Re: kern/113957: [gmirror] gmirror is intermittently reporting a degraded mirror array upon reboot. X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Arne Wörner List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 08:10:08 -0000 The following reply was made to PR kern/113957; it has been noted by GNATS. From: Arne "Wörner" To: bug-followup@FreeBSD.org Cc: ayochum@pair.com, freebsd-geom@FreeBSD.org Subject: Re: kern/113957: [gmirror] gmirror is intermittently reporting a degraded mirror array upon reboot. Date: Mon, 25 Jun 2007 01:04:24 -0700 (PDT) How did u reboot? Pulling the power plug? ;-)) I mean: The dmesg shows, that all file systems r dirty, so that I think, that ur reboot procedure is the problem and not gmirror... -Arne ____________________________________________________________________________________ Need a vacation? Get great deals to amazing places on Yahoo! Travel. http://travel.yahoo.com/ From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 11:08:28 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 10FD716A482 for ; Mon, 25 Jun 2007 11:08:28 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id DC88F13C4AE for ; Mon, 25 Jun 2007 11:08:27 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5PB8RqE098683 for ; Mon, 25 Jun 2007 11:08:27 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5PB8PO8098679 for freebsd-geom@FreeBSD.org; Mon, 25 Jun 2007 11:08:25 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 25 Jun 2007 11:08:25 GMT Message-Id: <200706251108.l5PB8PO8098679@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 11:08:28 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/73177 geom kldload geom_* causes panic due to memory exhaustion o kern/76538 geom [gbde] nfs-write on gbde partition stalls and continue o kern/83464 geom [geom] [patch] Unhandled malloc failures within libgeo o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/89102 geom [geom_vfs] [panic] panic when forced unmount FS from u o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/90582 geom [geom_mirror] [panic] Restore cause panic string (ffs_ o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/113419 geom [geom] geom fox multipathing not failing back o misc/113543 geom [geom] [patch] geom(8) utilities don't work inside the o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad 13 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/78131 geom gbde "destroy" not working. o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/94632 geom [geom] Kernel output resets input while GELI asks for f kern/105390 geom [geli] filesystem on a md backed by sparse file with s o kern/107707 geom [geom] [patch] add new class geom_xbox360 to slice up p bin/110705 geom gmirror control utility does not exit with correct exi o kern/113790 geom [patch] enable the Camellia block cipher on GEOM ELI ( o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113885 geom [geom] [patch] improved gmirror balance algorithm 9 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 20:12:31 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 80EA616A421 for ; Mon, 25 Jun 2007 20:12:31 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 1125B13C457 for ; Mon, 25 Jun 2007 20:12:30 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id DEA29487F3; Mon, 25 Jun 2007 22:12:28 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 96E7845696; Mon, 25 Jun 2007 22:12:22 +0200 (CEST) Date: Mon, 25 Jun 2007 22:12:06 +0200 From: Pawel Jakub Dawidek To: Yoshisato YANAGISAWA Message-ID: <20070625201206.GC12278@garage.freebsd.pl> References: <200706241250.l5OCo8RE078095@freefall.freebsd.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Bu8it7iiRSEf40bY" Content-Disposition: inline In-Reply-To: <200706241250.l5OCo8RE078095@freefall.freebsd.org> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@FreeBSD.org Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 20:12:31 -0000 --Bu8it7iiRSEf40bY Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Jun 24, 2007 at 12:50:08PM +0000, Yoshisato YANAGISAWA wrote: > The following reply was made to PR kern/113790; it has been noted by GNAT= S. >=20 > From: Yoshisato YANAGISAWA > To: FreeBSD-gnats-submit@FreeBSD.org, freebsd-bugs@FreeBSD.org > Cc: =20 > Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM > ELI (geli). > Date: Sun, 24 Jun 2007 21:33:21 +0900 >=20 > Since the patch I sent with PR is hard to read, I also put it: > http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia.diff The patch looks good on first look. I wasn't able to test it yet as I'm very busy at the moment. I'll try to test everything and ask re@ for approval to commit before 7.0-RELEASE. In the mean time, you could add camellia to geli regression tests (src/tools/regression/geom_eli/) and update the patch. Thanks! --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --Bu8it7iiRSEf40bY Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGgCGWForvXbEpPzQRAuvWAJ9hPHVlBjLKvPfg69jn4QeZ5E6PmgCgoov5 NTi4Rf51MCaM+ysOaoIjy/I= =J4mH -----END PGP SIGNATURE----- --Bu8it7iiRSEf40bY-- From owner-freebsd-geom@FreeBSD.ORG Mon Jun 25 22:37:10 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C9E5F16A421 for ; Mon, 25 Jun 2007 22:37:10 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from auriate.fluffles.net (cust.95.160.adsl.cistron.nl [195.64.95.160]) by mx1.freebsd.org (Postfix) with ESMTP id 7BE2513C45B for ; Mon, 25 Jun 2007 22:37:10 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from 195-241-125-45.dsl.ip.tiscali.nl ([195.241.125.45] helo=[10.0.0.18]) by auriate.fluffles.net with esmtpa (Exim 4.66 (FreeBSD)) (envelope-from ) id 1I2xB1-000N6D-DS; Tue, 26 Jun 2007 00:36:55 +0200 Message-ID: <4680438E.9030407@fluffles.net> Date: Tue, 26 Jun 2007 00:37:02 +0200 From: Fluffles User-Agent: Thunderbird 2.0.0.4 (Windows/20070604) MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-15; format=flowed Content-Transfer-Encoding: 7bit Cc: Pawel Jakub Dawidek Subject: gjournal performance issues X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 25 Jun 2007 22:37:10 -0000 Hello list, I'm testing gjournal present in -CURRENT as of 13 June 2007. So far i'm not really impressed with performance, i'm writing to the list for any suggestions and information regarding gjournal. First, my setup: 8 disks in RAID5 using geom_raid5, gjournal on top where both the journal (1GB) and the data is stored on the same consumer. Since gjournal uses both metadata and file/dir for journaling, this means that, theoretically, the write speed of sequential operations is doubled. Unfortunately, it appears to have crashed. My problems: - first, throughput appears to be only 8% of the throughput when not using gjournal at all. Whereas it should be close to 50%. - second, during the 'switch' (writing the journal to its final location and starting a new journal) it appears no read operations are possible to the .journal device. If the .journal is /usr, that means the whole system basically freezes for 3 to 5 seconds. Not really sexy. Why would it block read requests? - when using one consumer for both journal and data, it appears the journal is placed at the end of the device. Why? Normally, the beginning of a disk is the fastest and therefore preferable location for the journal. - when analysing graid5 sysctl statistics, it appears gjournal is causing non-contiguous I/O which causes a lot of 2-phase I/O's (involving both reading and writing for 1 write request), the performance difficulties are most probably related to this issue. Why doesn't gjournal read a chunk of journal (50MB) and then write it? And why doesn't it write contiguously? I've tried: - playing with graid5 tunables, including disabling write-back buffer - playing with journal tunables, including disabling optimization (combining), reducing parallel operations to 1, reducing journal switch time and more - kmem is 500MB, gjournal can use 250MB of kernel memory for it's cache (more than the default) - standard UFS2 using async option and without softupdates, newfs used with -J parameter Anyone has any input? I was hoping for at least 40MB/s throughput and no blocking I/O for read requests. Regards, - Veronica From owner-freebsd-geom@FreeBSD.ORG Tue Jun 26 07:54:58 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CF31416A400 for ; Tue, 26 Jun 2007 07:54:58 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 30B2F13C46A for ; Tue, 26 Jun 2007 07:54:57 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 9429845B26; Tue, 26 Jun 2007 09:54:55 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 5414E45681; Tue, 26 Jun 2007 09:54:50 +0200 (CEST) Date: Tue, 26 Jun 2007 09:54:32 +0200 From: Pawel Jakub Dawidek To: Fluffles Message-ID: <20070626075432.GD12278@garage.freebsd.pl> References: <4680438E.9030407@fluffles.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="hxkXGo8AKqTJ+9QI" Content-Disposition: inline In-Reply-To: <4680438E.9030407@fluffles.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: gjournal performance issues X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2007 07:54:58 -0000 --hxkXGo8AKqTJ+9QI Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Jun 26, 2007 at 12:37:02AM +0200, Fluffles wrote: > Hello list, >=20 > I'm testing gjournal present in -CURRENT as of 13 June 2007. So far i'm n= ot really impressed with performance, i'm writing to the list for any sugge= stions and information=20 > regarding gjournal. >=20 > First, my setup: > 8 disks in RAID5 using geom_raid5, gjournal on top where both the journal= (1GB) and the data is stored on the same consumer. Since gjournal uses bot= h metadata and file/dir=20 > for journaling, this means that, theoretically, the write speed of sequen= tial operations is doubled. Unfortunately, it appears to have crashed. >=20 > My problems: > - first, throughput appears to be only 8% of the throughput when not usin= g gjournal at all. Whereas it should be close to 50%. I had numbers in my presentation somewhere, but for single thread doing sequential write when journal and data are on the same disk (which is worstcase scenario) I recall something between 40%-50% of what you have =66rom regular UFS. > - second, during the 'switch' (writing the journal to its final location = and starting a new journal) it appears no read operations are possible to t= he .journal device. If=20 > the .journal is /usr, that means the whole system basically freezes for 3= to 5 seconds. Not really sexy. Why would it block read requests? On journal switch all operations that use vn_start_write() are blocked. Read operations shouldn't use vn_start_write(), but for example close operation is using it. I've some patches to eliminate it, because it is only needed when we close already deleted file and need to free its blocks, etc. which is quite rare case. > - when using one consumer for both journal and data, it appears the journ= al is placed at the end of the device. Why? Normally, the beginning of a di= sk is the fastest and=20 > therefore preferable location for the journal. To allow to mount file system without gjournal. > - when analysing graid5 sysctl statistics, it appears gjournal is causing= non-contiguous I/O which causes a lot of 2-phase I/O's (involving both rea= ding and writing for 1=20 > write request), the performance difficulties are most probably related to= this issue. Why doesn't gjournal read a chunk of journal (50MB) and then w= rite it? And why doesn't=20 > it write contiguously? Actually gjournal should be much better on this than UFS. It combines contiguous I/Os up to MAXPHYS and eliminates multiple write in the same place. On the other hand graid5 should be able to delay writes a bit to see if it can do full stripe write. > I've tried: > - playing with graid5 tunables, including disabling write-back buffer > - playing with journal tunables, including disabling optimization (combin= ing), reducing parallel operations to 1, reducing journal switch time and m= ore > - kmem is 500MB, gjournal can use 250MB of kernel memory for it's cache (= more than the default) > - standard UFS2 using async option and without softupdates, newfs used wi= th -J parameter >=20 > Anyone has any input? I was hoping for at least 40MB/s throughput and no = blocking I/O for read requests. Have you tried not to use graid5 with gjournal? Could you retest for raw disk and/or gmirror and/or graid3? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --hxkXGo8AKqTJ+9QI Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGgMY4ForvXbEpPzQRAgjRAKCdMSgoxbWivhdbeuB2//+BuDfSAQCdHxAH a9WXNa4FB9SmiAOiKhRLUfA= =vKNo -----END PGP SIGNATURE----- --hxkXGo8AKqTJ+9QI-- From owner-freebsd-geom@FreeBSD.ORG Tue Jun 26 07:56:52 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 73EDF16A46B for ; Tue, 26 Jun 2007 07:56:52 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 2B30F13C480 for ; Tue, 26 Jun 2007 07:56:51 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1I35ul-0000e2-JL for freebsd-geom@freebsd.org; Tue, 26 Jun 2007 09:56:43 +0200 Received: from lara.cc.fer.hr ([161.53.72.113]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 26 Jun 2007 09:56:43 +0200 Received: from ivoras by lara.cc.fer.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Tue, 26 Jun 2007 09:56:43 +0200 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Tue, 26 Jun 2007 09:56:24 +0200 Lines: 34 Message-ID: References: <4680438E.9030407@fluffles.net> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig4A943ECB3DC659CD94F91FD0" X-Complaints-To: usenet@sea.gmane.org X-Gmane-NNTP-Posting-Host: lara.cc.fer.hr User-Agent: Thunderbird 1.5.0.12 (X11/20060911) In-Reply-To: <4680438E.9030407@fluffles.net> X-Enigmail-Version: 0.94.2.0 Sender: news Subject: Re: gjournal performance issues X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2007 07:56:52 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig4A943ECB3DC659CD94F91FD0 Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: quoted-printable Fluffles wrote: > First, my setup: > 8 disks in RAID5 using geom_raid5, gjournal on top where both the=20 > journal (1GB) and the data is stored on the same consumer. Since=20 > gjournal uses both metadata and file/dir for journaling, this means=20 > that, theoretically, the write speed of sequential operations is=20 > doubled. Unfortunately, it appears to have crashed. Just to rule out geom_raid5, can you repeat your tests with geom_raid3? --------------enig4A943ECB3DC659CD94F91FD0 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.5 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iD8DBQFGgMauldnAQVacBcgRAqWaAJ966ZXRcN9Rqid6Ir4q7zgnOfOQ8wCgmuRw 7qy+T9oduIHwGvi6zeD4WjU= =4lkc -----END PGP SIGNATURE----- --------------enig4A943ECB3DC659CD94F91FD0-- From owner-freebsd-geom@FreeBSD.ORG Tue Jun 26 14:54:13 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4FCC116A468 for ; Tue, 26 Jun 2007 14:54:13 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from auriate.fluffles.net (cust.95.160.adsl.cistron.nl [195.64.95.160]) by mx1.freebsd.org (Postfix) with ESMTP id 0738E13C484 for ; Tue, 26 Jun 2007 14:54:12 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from 195-241-125-45.dsl.ip.tiscali.nl ([195.241.125.45] helo=[10.0.0.18]) by auriate.fluffles.net with esmtpa (Exim 4.66 (FreeBSD)) (envelope-from ) id 1I3CQY-000DLk-AR; Tue, 26 Jun 2007 16:53:58 +0200 Message-ID: <4681288D.20804@fluffles.net> Date: Tue, 26 Jun 2007 16:54:05 +0200 From: Fluffles User-Agent: Thunderbird 2.0.0.4 (Windows/20070604) MIME-Version: 1.0 To: Ivan Voras References: <4680438E.9030407@fluffles.net> In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: gjournal performance issues X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2007 14:54:13 -0000 Ivan Voras wrote: > Fluffles wrote: > >> First, my setup: >> 8 disks in RAID5 using geom_raid5, gjournal on top where both the >> journal (1GB) and the data is stored on the same consumer. Since >> gjournal uses both metadata and file/dir for journaling, this means >> that, theoretically, the write speed of sequential operations is >> doubled. Unfortunately, it appears to have crashed. > > Just to rule out geom_raid5, can you repeat your tests with geom_raid3? Sounds logical. But: RAID3 does not have any 2-phase writes, all writes are 1-phase, involving all disks. Thus RAID3 would be less affected by non-contigious writes. I will test with debuglevel or with geom_nop to see the I/O that geom_journal produces, and to see if this I/O is contigious or not. I hope to know more in a day or so. Thanks for your input Ivan and Pawel! More testing is needed... - Veronica From owner-freebsd-geom@FreeBSD.ORG Tue Jun 26 22:13:39 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 412AB16A41F for ; Tue, 26 Jun 2007 22:13:39 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (gw.ptr-62-65-149-149.customer.ch.netstream.com [62.65.149.149]) by mx1.freebsd.org (Postfix) with ESMTP id EF32213C45E for ; Tue, 26 Jun 2007 22:13:38 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 5C16F1859B9; Wed, 27 Jun 2007 00:09:14 +0200 (CEST) Date: Wed, 27 Jun 2007 00:09:14 +0200 From: Nico -telmich- Schottelius To: freebsd-geom@freebsd.org Message-ID: <20070626220914.GA11511@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="2fHTh5uZTiUOsy+g" Content-Disposition: inline User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Subject: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2007 22:13:39 -0000 --2fHTh5uZTiUOsy+g Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello! I cannot delete the gmirror metadata with gmirror clear, I guess the problem is that the partition size changed, because I put the disk into a raid-controller and that the controller changed the disk size, because it added metadate to it, too. Now my question is, how can I clear the metadata block via dd? I think dd skip=3D(size_of_hd_in_512_bytes_blocks-gmirror-size) if=3D/dev/zero of=3D/dev/amrd0 count=3D?? should do the job, but I am not aware how many bytes to clear. A more detailled description can be found on http://home.schottelius.org/~nico/unix/freebsd/gmirror-remove Thanks for any hint, Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --2fHTh5uZTiUOsy+g Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGgY6KuL75KpiFGIwRAvRQAKC3JU2TmPIZ91LOaZWEqyWouGCU/ACgtUDy Rs6LQVwHBsm1bLxIVk6bIB8= =IAzn -----END PGP SIGNATURE----- --2fHTh5uZTiUOsy+g-- From owner-freebsd-geom@FreeBSD.ORG Tue Jun 26 22:30:28 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B709E16A41F for ; Tue, 26 Jun 2007 22:30:28 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (gw.ptr-62-65-149-149.customer.ch.netstream.com [62.65.149.149]) by mx1.freebsd.org (Postfix) with ESMTP id D93A313C468 for ; Tue, 26 Jun 2007 22:30:27 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 1D71813A1A4; Wed, 27 Jun 2007 00:31:08 +0200 (CEST) Date: Wed, 27 Jun 2007 00:31:08 +0200 From: Nico -telmich- Schottelius To: freebsd-geom@freebsd.org Message-ID: <20070626223108.GA19980@schottelius.org> References: <20070626220914.GA11511@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6TrnltStXW4iwmi0" Content-Disposition: inline In-Reply-To: <20070626220914.GA11511@schottelius.org> User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2007 22:30:28 -0000 --6TrnltStXW4iwmi0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Just found that other mail, in which diskinfo was mentioned, which returned the following result to me: ddna045# diskinfo -v /dev/mirror/raid1 /dev/amrd1 /dev/amrd0 /dev/mirror/raid1 512 # sectorsize 146814270976 # mediasize in bytes (137G) 286746623 # mediasize in sectors /dev/amrd1 512 # sectorsize 146814271488 # mediasize in bytes (137G) 286746624 # mediasize in sectors 17849 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. /dev/amrd0 512 # sectorsize 146814271488 # mediasize in bytes (137G) 286746624 # mediasize in sectors 17849 # Cylinders according to firmware. 255 # Heads according to firmware. 63 # Sectors according to firmware. Clearing it with dd does not work: ddna045# dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 count= =3D1 dd: /dev/amrd0: Operation not permitted The same also happens with gmirror not being loaded. The reason why I want to clear it is because the metadata on amrd0 has also a gmirror device named raid1, which is not in use anymore / should be created newly: GEOM_MIRROR: Device raid1 created (id=3D2125903367). GEOM_MIRROR: Device raid1: provider amrd1 detected. GEOM_MIRROR: Device raid1: provider amrd1 activated. GEOM_MIRROR: Device raid1: provider mirror/raid1 launched. GEOM_MIRROR: Device raid1 already configured. If I boot the system with amrd0s1a as /, amrd1 is detected as mirror/raid1. If I boot the system with mirror/raid1sa as /, amrd0 is detected as mirror/raid1. Which leads me to the situation that both times I boot from amrd0. My aim is to bootup the server from amrd1 as mirror/raid1 so I can boot the new system found on that harddisk and after that integrate amrd0 as the second disk into the raid. Perhaps someone has a hint for me a) why the dd is not allowed to work b) how to clear the metadata c) or how to achieve my aim to make amrd1 as mirror/raid1s1a available as / Sincerly Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --6TrnltStXW4iwmi0 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGgZOsuL75KpiFGIwRAgMaAKDpfZHFGPDVxEPfexXxEq3AfsSvaACdEoTh BQ/aReTMLeu7cMvZrObrOO0= =1ovh -----END PGP SIGNATURE----- --6TrnltStXW4iwmi0-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 06:13:59 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id EED0A16A468 for ; Wed, 27 Jun 2007 06:13:59 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30306.mail.mud.yahoo.com (web30306.mail.mud.yahoo.com [209.191.69.68]) by mx1.freebsd.org (Postfix) with SMTP id 6E59813C48A for ; Wed, 27 Jun 2007 06:13:58 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 6998 invoked by uid 60001); 27 Jun 2007 06:13:57 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=hBfEdnX2udcUhYVm+jeMUD9FWmzCi8kRWHARzUDE6dOGpzem4CQo+rBU6yrScEZAmVzT2nYCWIGU0u+u71e7yr6/6fU9Lvp+6KOeSM6obTWrEpxnyWj69pdGLskqDKJDzkJ9TBlTKAvePkdKBhkqjXOAUnxSCfPxTSaaQ5uNuIw=; X-YMail-OSG: 5OVA3p0VM1kajHBYDmE5k7uys5GJ6BFsaB3VHfJUK0qSevUv1uRpx1V3W79rjLGpav8S.BO_SP93n4dAwJYSh.4Zvza41J2i.N3hcn.2lQtQ9cOU_xJDRRXmv6sKdg-- Received: from [89.53.62.140] by web30306.mail.mud.yahoo.com via HTTP; Tue, 26 Jun 2007 23:13:57 PDT Date: Tue, 26 Jun 2007 23:13:57 -0700 (PDT) From: Arne "Wörner" To: Nico -telmich- Schottelius , freebsd-geom@freebsd.org In-Reply-To: <20070626223108.GA19980@schottelius.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <830123.5800.qm@web30306.mail.mud.yahoo.com> Cc: Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 06:14:00 -0000 --- Nico -telmich- Schottelius wrote: > ddna045# dd of=/dev/amrd0 if=/dev/zero bs=512 skip=286746623 count=1 > dd: /dev/amrd0: Operation not permitted > I do not know, why this doesnt work... Is it possible, that amrd0 (or a partition/slice of it) is mounted somewhere? U could try the same dd command with sysctl kern.geom.debugflags set to 16: sysctl kern.geom.debugflags=16 dd of=/dev/amrd0 if=/dev/zero bs=512 skip=286746623 count=1 sysctl kern.geom.debugflags=0 That should clear the unwanted meta data... -Arne ____________________________________________________________________________________ Shape Yahoo! in your own image. Join our Network Research Panel today! http://surveylink.yahoo.com/gmrs/yahoo_panel_invite.asp?a=7 From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 07:12:33 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 36A2B16A400 for ; Wed, 27 Jun 2007 07:12:33 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id C7DF313C4C5 for ; Wed, 27 Jun 2007 07:12:32 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id DAAC4487F7; Wed, 27 Jun 2007 09:12:31 +0200 (CEST) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id A9BA14569A; Wed, 27 Jun 2007 09:12:26 +0200 (CEST) Date: Wed, 27 Jun 2007 09:12:26 +0200 From: Pawel Jakub Dawidek To: Nico -telmich- Schottelius Message-ID: <20070627071225.GD21749@garage.freebsd.pl> References: <20070626220914.GA11511@schottelius.org> <20070626223108.GA19980@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="zbGR4y+acU1DwHSi" Content-Disposition: inline In-Reply-To: <20070626223108.GA19980@schottelius.org> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 07:12:33 -0000 --zbGR4y+acU1DwHSi Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jun 27, 2007 at 12:31:08AM +0200, Nico -telmich- Schottelius wrote: > Just found that other mail, in which diskinfo was mentioned, which > returned the following result to me: >=20 > ddna045# diskinfo -v /dev/mirror/raid1 /dev/amrd1 /dev/amrd0 > /dev/mirror/raid1 > 512 # sectorsize > 146814270976 # mediasize in bytes (137G) > 286746623 # mediasize in sectors >=20 > /dev/amrd1 > 512 # sectorsize > 146814271488 # mediasize in bytes (137G) > 286746624 # mediasize in sectors > 17849 # Cylinders according to firmware. > 255 # Heads according to firmware. > 63 # Sectors according to firmware. >=20 > /dev/amrd0 > 512 # sectorsize > 146814271488 # mediasize in bytes (137G) > 286746624 # mediasize in sectors > 17849 # Cylinders according to firmware. > 255 # Heads according to firmware. > 63 # Sectors according to firmware. >=20 > Clearing it with dd does not work: >=20 > ddna045# dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 coun= t=3D1 > dd: /dev/amrd0: Operation not permitted If you have gmirror configured you first need to stop it with 'gmirror stop raid1' command and then try to write to its components, but you should use 'seek=3D286746623' instead of 'skip=3D286746623'. > The same also happens with gmirror not being loaded. That's strange. 'sysctl -b kern.geom.confxml' can give us a hint who keeps it open. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --zbGR4y+acU1DwHSi Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGgg3ZForvXbEpPzQRAonhAJ92TW3XHLqRcE26fCAr79hLM4M6SwCfWTDd XkZgTbGMhOktgSDWJk6LOs4= =nQu1 -----END PGP SIGNATURE----- --zbGR4y+acU1DwHSi-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 07:52:51 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C76CD16A400 for ; Wed, 27 Jun 2007 07:52:51 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 868A313C455 for ; Wed, 27 Jun 2007 07:52:51 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 7D361104451; Wed, 27 Jun 2007 09:43:38 +0200 (CEST) Date: Wed, 27 Jun 2007 09:43:38 +0200 From: Nico -telmich- Schottelius To: Arne =?utf-8?Q?W=F6rner?= Message-ID: <20070627074338.GC19980@schottelius.org> References: <20070626223108.GA19980@schottelius.org> <830123.5800.qm@web30306.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Izn7cH1Com+I3R9J" Content-Disposition: inline In-Reply-To: <830123.5800.qm@web30306.mail.mud.yahoo.com> User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 07:52:51 -0000 --Izn7cH1Com+I3R9J Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Arne W=EF=BF=BDrner [Tue, Jun 26, 2007 at 11:13:57PM -0700]: > --- Nico -telmich- Schottelius wrote: > > ddna045# dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 co= unt=3D1 > > dd: /dev/amrd0: Operation not permitted > >=20 > I do not know, why this doesnt work... >=20 > Is it possible, that amrd0 (or a partition/slice of it) is mounted somewh= ere? Yes: ddna045# mount /dev/amrd0s1a on / (ufs, local) > [...] > U could try the same dd command with sysctl kern.geom.debugflags set to 1= 6: > sysctl kern.geom.debugflags=3D16 > dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 count=3D1 > [...] I am currently trying that: top reports that dd now uses 99% cpu and it is running for about 3 minutes. I am wondering how long this may run? Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --Izn7cH1Com+I3R9J Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGghUquL75KpiFGIwRAniLAJwMFsHKEVDWHA/grjHBA1WOBmpy0QCdEoT/ jVQJLjvTqF+4MAht7WMZa8o= =bjNt -----END PGP SIGNATURE----- --Izn7cH1Com+I3R9J-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 07:57:47 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 299AB16A41F for ; Wed, 27 Jun 2007 07:57:47 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30315.mail.mud.yahoo.com (web30315.mail.mud.yahoo.com [209.191.69.77]) by mx1.freebsd.org (Postfix) with SMTP id CEF3513C447 for ; Wed, 27 Jun 2007 07:57:46 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 12819 invoked by uid 60001); 27 Jun 2007 07:57:46 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=fo/sgid7JTHeLgpH5PLIJcNdSRklRyKFp64xhVAq4RgfFAtT1Ck73QnXMNsmaohS2g3B1oKf0/C9jA/2HFbMSAiTFJeqdS5yz+RrPORFWiYfBwKtYIFE03GXbYyiijamzCS/4LvHfgq3gIsVDqCXq8K/6Bjk0oPIIlRnzbmSJWI=; X-YMail-OSG: LJ4HBNEVM1mGH_LCG7pnBo2c4ooHdVERSfY842koqjRTIKnGhNjGSUtRbjbDeSobJbhJeoGQeKI3bLttVKL.7VEBXZfgON03hp1Rcb3NF9fS1LRP1otg51WYrVtpbw-- Received: from [89.53.62.140] by web30315.mail.mud.yahoo.com via HTTP; Wed, 27 Jun 2007 00:57:45 PDT Date: Wed, 27 Jun 2007 00:57:45 -0700 (PDT) From: Arne "Wörner" To: Nico -telmich- Schottelius In-Reply-To: <20070627074338.GC19980@schottelius.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <66779.12351.qm@web30315.mail.mud.yahoo.com> Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 07:57:47 -0000 --- Nico -telmich- Schottelius wrote: > > Is it possible, that amrd0 (or a partition/slice of it) is mounted > > somewhere? > > Yes: > > ddna045# mount > /dev/amrd0s1a on / (ufs, local) > Then unmount it... :-) > > sysctl kern.geom.debugflags=16 > > dd of=/dev/amrd0 if=/dev/zero bs=512 skip=286746623 count=1 > > [...] > > I am currently trying that: top reports that dd now uses 99% cpu and it > is running for about 3 minutes. > > I am wondering how long this may run? > Ohoh... It skips block from the input device... But it will not seek in the output device... SO: TERMINATE IT!!! :-)) Or ur first sector on amrd0 will be destroyed FOREVER...! Sorry! -Arne ____________________________________________________________________________________ Now that's room service! Choose from over 150,000 hotels in 45,000 destinations on Yahoo! Travel to find your fit. http://farechase.yahoo.com/promo-generic-14795097 From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 07:57:52 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7F02516A41F; Wed, 27 Jun 2007 07:57:52 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 120B413C4AD; Wed, 27 Jun 2007 07:57:51 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 035971703A6; Wed, 27 Jun 2007 09:39:09 +0200 (CEST) Date: Wed, 27 Jun 2007 09:39:09 +0200 From: Nico -telmich- Schottelius To: David Cecil , Pawel Jakub Dawidek Message-ID: <20070627073909.GB19980@schottelius.org> References: <20070626220914.GA11511@schottelius.org> <20070626223108.GA19980@schottelius.org> <20070627071225.GD21749@garage.freebsd.pl> <20070626220914.GA11511@schottelius.org> <20070626223108.GA19980@schottelius.org> <46819E36.70503@nokia.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="wzJLGUyc3ArbnUjN" Content-Disposition: inline In-Reply-To: <20070627071225.GD21749@garage.freebsd.pl> <46819E36.70503@nokia.com> User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 07:57:52 -0000 --wzJLGUyc3ArbnUjN Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello David, Pawel! I just rebootet the server to have a clean state: David Cecil [Wed, Jun 27, 2007 at 09:16:06AM +1000]: > [...] > What's the output of "gmirror list"? Is your old mirror set listed? If= =20 > so, then you will want to deactivate the providers before you can clear= =20 > them. ddna045# gmirror list Command 'list' not available. ddna045# dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 count= =3D1 dd: /dev/amrd0: Operation not permitted It was clear to me that they need to be deactivated. Pawel Jakub Dawidek [Wed, Jun 27, 2007 at 09:12:26AM +0200]: > On Wed, Jun 27, 2007 at 12:31:08AM +0200, Nico -telmich- Schottelius wrot= e: > [...]=20 > If you have gmirror configured you first need to stop it with > 'gmirror stop raid1' command and then try to write to its components, > but you should use 'seek=3D286746623' instead of 'skip=3D286746623'. >=20 No surprise, just wanted to verify, seek gives the same result: ddna045# dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 seek=3D286746623 count= =3D1 dd: /dev/amrd0: Operation not permitted > > The same also happens with gmirror not being loaded. >=20 > That's strange. 'sysctl -b kern.geom.confxml' can give us a hint who > keeps it open. I put the output of it to http://home.schottelius.org/~nico/unix/freebsd/sysctl-kern.geom.confxml-ddn= a045-2007-06-27 Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --wzJLGUyc3ArbnUjN Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGghQduL75KpiFGIwRAl7MAJ9uFo1CCnDkOVBHQa3kdUOe+lBZnACfc5yU KZ3Ks8itD93yEfPuPREXyUw= =Q48V -----END PGP SIGNATURE----- --wzJLGUyc3ArbnUjN-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 08:04:32 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 474F916A400 for ; Wed, 27 Jun 2007 08:04:32 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 06D9113C46C for ; Wed, 27 Jun 2007 08:04:31 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 9F4E613ED4A; Wed, 27 Jun 2007 10:05:12 +0200 (CEST) Date: Wed, 27 Jun 2007 10:05:12 +0200 From: Nico -telmich- Schottelius To: Arne =?utf-8?Q?W=F6rner?= Message-ID: <20070627080512.GD19980@schottelius.org> References: <20070627074338.GC19980@schottelius.org> <66779.12351.qm@web30315.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="HWvPVVuAAfuRc6SZ" Content-Disposition: inline In-Reply-To: <66779.12351.qm@web30315.mail.mud.yahoo.com> User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 08:04:32 -0000 --HWvPVVuAAfuRc6SZ Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Arne W=EF=BF=BDrner [Wed, Jun 27, 2007 at 12:57:45AM -0700]: > > > sysctl kern.geom.debugflags=3D16 > > > dd of=3D/dev/amrd0 if=3D/dev/zero bs=3D512 skip=3D286746623 count= =3D1 > > > [...] > >=20 > > I am currently trying that: top reports that dd now uses 99% cpu and it > > is running for about 3 minutes. > >=20 > > I am wondering how long this may run? > >=20 > Ohoh... >=20 > It skips block from the input device... > But it will not seek in the output device... Hmpf, that's why seek=3D was mentioned... > SO: TERMINATE IT!!! :-)) Too late. > Or ur first sector on amrd0 will be destroyed FOREVER...! So, any hints on how to recover the first 512 bytes for me? Btw, I just repeated it with the seek=3D and it worked! Now I've just to restore the mbr=20 a) is there somewhere a copy in memory? B) redoing it shouldn't be a big problem, as the layout was written down :-) Nico --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --HWvPVVuAAfuRc6SZ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGgho4uL75KpiFGIwRAtHkAKDkZjCqaTwUg6Zx/1qiiFlnbg3b0gCgif9P 3zJ4symWARPEO/rN9fhqIeE= =SpCA -----END PGP SIGNATURE----- --HWvPVVuAAfuRc6SZ-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 09:20:08 2007 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4B7AE16A46B for ; Wed, 27 Jun 2007 09:20:08 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 32C0513C4DE for ; Wed, 27 Jun 2007 09:20:08 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5R9K7u1035598 for ; Wed, 27 Jun 2007 09:20:07 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5R9K7Dq035597; Wed, 27 Jun 2007 09:20:07 GMT (envelope-from gnats) Date: Wed, 27 Jun 2007 09:20:07 GMT Message-Id: <200706270920.l5R9K7Dq035597@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: Yoshisato YANAGISAWA Cc: Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Yoshisato YANAGISAWA List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 09:20:08 -0000 The following reply was made to PR kern/113790; it has been noted by GNATS. From: Yoshisato YANAGISAWA To: Pawel Jakub Dawidek Cc: freebsd-geom@FreeBSD.org, FreeBSD-gnats-submit@FreeBSD.org Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). Date: Wed, 27 Jun 2007 18:16:37 +0900 On Mon, 25 Jun 2007 22:12:06 +0200 Pawel Jakub Dawidek wrote: > The patch looks good on first look. I wasn't able to test it yet as > I'm very busy at the moment. I'll try to test everything and ask re@ > for approval to commit before 7.0-RELEASE. In the mean time, you Thank you for reading my patch. > could add camellia to geli regression tests > (src/tools/regression/geom_eli/) and update the patch. Thanks! Ok, I wrote regression tests and updated the patch: http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia.diff Then, I did regression tests with "prove -v geom_eli" and it seems good although I saw some warnings. The test log is: http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia_test.txt Thank you in advance. -- ------------------------------------------------------- Yoshisato YANAGISAWA Dept. of Mathematical and Computing Sciences, Graduate School of Information Science and Engineering, Tokyo Institute of Technology. /* If you are an *BSD user, let's join http://bsdstats.org/ */ From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 09:36:52 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C012016A41F; Wed, 27 Jun 2007 09:36:52 +0000 (UTC) (envelope-from yanagisawa@csg.is.titech.ac.jp) Received: from mail.csg.is.titech.ac.jp (mail.csg.is.titech.ac.jp [131.112.40.132]) by mx1.freebsd.org (Postfix) with ESMTP id 8B5A813C46C; Wed, 27 Jun 2007 09:36:52 +0000 (UTC) (envelope-from yanagisawa@csg.is.titech.ac.jp) Received: from mail.csg.is.titech.ac.jp (mail.csg.is.titech.ac.jp [127.0.0.1]) by mail.csg.is.titech.ac.jp (Postfix) with ESMTP id 50D061010CB5; Wed, 27 Jun 2007 18:16:42 +0900 (JST) Received: from mana.csg.is.titech.ac.jp (mana.csg.is.titech.ac.jp [131.112.40.170]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.csg.is.titech.ac.jp (Postfix) with ESMTP id 453941010CB1; Wed, 27 Jun 2007 18:16:42 +0900 (JST) Date: Wed, 27 Jun 2007 18:16:37 +0900 From: Yoshisato YANAGISAWA To: Pawel Jakub Dawidek Message-Id: <20070627181637.587a606f.yanagisawa@csg.is.titech.ac.jp> In-Reply-To: <20070625201206.GC12278@garage.freebsd.pl> References: <200706241250.l5OCo8RE078095@freefall.freebsd.org> <20070625201206.GC12278@garage.freebsd.pl> Organization: Tokyo Institute of Technology. X-Mailer: Sylpheed 2.4.2 (GTK+ 2.10.13; i386-portbld-freebsd6.2) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV using ClamSMTP Cc: FreeBSD-gnats-submit@FreeBSD.org, freebsd-geom@FreeBSD.org Subject: Re: kern/113790: [patch] enable the Camellia block cipher on GEOM ELI (geli). X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 09:36:52 -0000 On Mon, 25 Jun 2007 22:12:06 +0200 Pawel Jakub Dawidek wrote: > The patch looks good on first look. I wasn't able to test it yet as > I'm very busy at the moment. I'll try to test everything and ask re@ > for approval to commit before 7.0-RELEASE. In the mean time, you Thank you for reading my patch. > could add camellia to geli regression tests > (src/tools/regression/geom_eli/) and update the patch. Thanks! Ok, I wrote regression tests and updated the patch: http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia.diff Then, I did regression tests with "prove -v geom_eli" and it seems good although I saw some warnings. The test log is: http://www.csg.is.titech.ac.jp/~yanagisawa/programs/geli_camellia_test.txt Thank you in advance. -- ------------------------------------------------------- Yoshisato YANAGISAWA Dept. of Mathematical and Computing Sciences, Graduate School of Information Science and Engineering, Tokyo Institute of Technology. /* If you are an *BSD user, let's join http://bsdstats.org/ */ From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 10:53:22 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CB05316A46B for ; Wed, 27 Jun 2007 10:53:22 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30301.mail.mud.yahoo.com (web30301.mail.mud.yahoo.com [209.191.69.63]) by mx1.freebsd.org (Postfix) with SMTP id 7B67813C448 for ; Wed, 27 Jun 2007 10:53:22 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 91798 invoked by uid 60001); 27 Jun 2007 10:53:21 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=0hXA5d+hVqasiQnUqytqpu4cfgPKn1piTNGuo1kaGnJkgClFwvzFTIKRq/2NwAEN1PZ8QuBNtoH4cfTN51eisiogHZ7ccwFjIBxJ8h9DbiUjNHsrgpPB6Jy4uxNlIbYPkEuR4S8A4hg5VH+rf7Ld6oLvQYlLVPBHTsXM23xt+a4=; X-YMail-OSG: Qh9Lh9cVM1m6jpMTpH69zCs__MvrWJVe5EjSaClkkSqM_oqZdbksevmul_K7pVxX0w-- Received: from [89.53.62.140] by web30301.mail.mud.yahoo.com via HTTP; Wed, 27 Jun 2007 03:53:21 PDT Date: Wed, 27 Jun 2007 03:53:21 -0700 (PDT) From: Arne "Wörner" To: Nico -telmich- Schottelius In-Reply-To: <20070627074338.GC19980@schottelius.org> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <699482.91717.qm@web30301.mail.mud.yahoo.com> Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 10:53:22 -0000 If u want to restore the MBR u can use boot0cfg or sysinstall I would guess the command line is like this: boot0cfg -B -v /dev/XXX0 -Arne ____________________________________________________________________________________ Pinpoint customers who are looking for what you sell. http://searchmarketing.yahoo.com/ From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 15:04:21 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BC23116A400 for ; Wed, 27 Jun 2007 15:04:21 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id 4CC2B13C458 for ; Wed, 27 Jun 2007 15:04:21 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 45122 invoked by uid 2001); 27 Jun 2007 14:37:40 -0000 Date: Wed, 27 Jun 2007 09:37:40 -0500 From: "Rick C. Petty" To: Nico -telmich- Schottelius Message-ID: <20070627143740.GB44589@keira.kiwi-computer.com> References: <20070626220914.GA11511@schottelius.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070626220914.GA11511@schottelius.org> User-Agent: Mutt/1.4.2.1i Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 15:04:21 -0000 On Wed, Jun 27, 2007 at 12:09:14AM +0200, Nico -telmich- Schottelius wrote: > > Now my question is, how can I clear the metadata block via dd? > I think dd skip=(size_of_hd_in_512_bytes_blocks-gmirror-size) > if=/dev/zero of=/dev/amrd0 count=?? should do the job, but I am not > aware how many bytes to clear. I had a similar problem when using gmirror+gpt and transitioning to using gvinum instead. Turns out if you don't clear the metadata using dd, the kernel panics (in an infinite loop of device name failures) after adding the device to gvinum. To be on the safe side, I did: dd if=/dev/zero of=/dev/adXX bs=1m count=1 dd if=/dev/zero of=/dev/adXX bs=1m count=1 seek=YY Where XX is the disk in question and YY is the disk's size in MB minus 1. Since some GEOM classes write their metadata at the front and others write their metadata at the end, I now do both steps to ensure the metadata is cleared. In your particular case, I don't see how gmirror would taste the disk if the number of blocks changes. I thought it did a seek to end of device minus 512, read the block, and if it doesn't fit the magic the device is skipped. Perhaps another disk in the mirror is still expecting to find this resized disk, in which case you need to use "gmirror forget". -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Wed Jun 27 23:00:13 2007 Return-Path: X-Original-To: freebsd-geom@hub.freebsd.org Delivered-To: freebsd-geom@hub.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 22CE116A41F for ; Wed, 27 Jun 2007 23:00:13 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 1361013C468 for ; Wed, 27 Jun 2007 23:00:13 +0000 (UTC) (envelope-from gnats@FreeBSD.org) Received: from freefall.freebsd.org (gnats@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l5RN0CKs004198 for ; Wed, 27 Jun 2007 23:00:12 GMT (envelope-from gnats@freefall.freebsd.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l5RN0CCN004197; Wed, 27 Jun 2007 23:00:12 GMT (envelope-from gnats) Date: Wed, 27 Jun 2007 23:00:12 GMT Message-Id: <200706272300.l5RN0CCN004197@freefall.freebsd.org> To: freebsd-geom@FreeBSD.org From: "Bernard Steiner" Cc: Subject: Re: kern/113837: [geom] unable to access 1024 sector size storage X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: Bernard Steiner List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 27 Jun 2007 23:00:13 -0000 The following reply was made to PR kern/113837; it has been noted by GNATS. From: "Bernard Steiner" To: bug-followup@FreeBSD.org Cc: Subject: Re: kern/113837: [geom] unable to access 1024 sector size storage Date: Thu, 28 Jun 2007 00:51:15 +0200 Well... that was pretty fast :-( Address validator or Nigeran scammer: > Received: from sun.com (125.84.217.87.dynamic.jazztel.es [87.217.84.125]) > by $CENSORED (Postfix) with SMTP id 872F82A674 > for $MYADDRESS; Wed, 27 Jun 2007 21:01:09 +0200 (CEST) > From: BMW PROMOTION > To: fbsd-send-pr $MYADDRESS > Subject: CONGRATULATIONS YOU HAVE WON THE BMW CAR PROMOTION > X-MSMail-Priority: Normal > Reply-To: BMW PROMOTION I'll toss that address and monitor the PR instead. Damn spammers. Anyway... some Linuxen seems to get a little friendlier with the concept of 1024 byte bocks: $ fdisk -b 1024 /dev/discs/disc4/disc You will not be able to write the partition table. Command (m for help): p Disk /dev/discs/disc4/disc: 2057 MB, 2057830400 bytes 53 heads, 52 sectors/track, 729 cylinders Units = cylinders of 2756 * 1024 = 2822144 bytes Device Boot Start End Blocks Id System /dev/discs/disc4/part1 1 1459 4018957 6 FAT16 Partition 1 has different physical/logical beginnings (non-Linux?): phys=(0, 3, 55) logical=(0, 4, 36) Partition 1 has different physical/logical endings: phys=(996, 52, 52) logical=(1458, 18, 16) I haven't managed to mount the card on the router yet, though. Bernard From owner-freebsd-geom@FreeBSD.ORG Thu Jun 28 12:49:10 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 419BC16A400 for ; Thu, 28 Jun 2007 12:49:10 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 0332813C448 for ; Thu, 28 Jun 2007 12:49:09 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id 4CCC0D7400; Wed, 27 Jun 2007 17:08:36 +0200 (CEST) Date: Wed, 27 Jun 2007 17:08:36 +0200 From: Nico -telmich- Schottelius To: Arne =?utf-8?Q?W=F6rner?= Message-ID: <20070627150836.GA7215@schottelius.org> References: <20070627074338.GC19980@schottelius.org> <699482.91717.qm@web30301.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="HcAYCG3uE/tztfnV" Content-Disposition: inline In-Reply-To: <699482.91717.qm@web30301.mail.mud.yahoo.com> User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Cc: freebsd-geom@freebsd.org Subject: Re: Size of metadate? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 28 Jun 2007 12:49:10 -0000 --HcAYCG3uE/tztfnV Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Thanks Arne! I just "recovered" it with fdisk & bsdlabel :-) Now it boots up correctly! Nico Arne W=EF=BF=BDrner [Wed, Jun 27, 2007 at 03:53:21AM -0700]: > If u want to restore the MBR u can use > boot0cfg > or > sysinstall >=20 > I would guess the command line is like this: > boot0cfg -B -v /dev/XXX0 >=20 > -Arne >=20 >=20 > =20 > _________________________________________________________________________= ___________ > Pinpoint customers who are looking for what you sell.=20 > http://searchmarketing.yahoo.com/ > _______________________________________________ > freebsd-geom@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-geom > To unsubscribe, send any mail to "freebsd-geom-unsubscribe@freebsd.org" --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --HcAYCG3uE/tztfnV Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGgn10uL75KpiFGIwRAmLoAKCet+nTQGBjwvfUKRHzsnZXdG86mgCfSmcq sN06fb154qU5yjVV1GlUQ1I= =DLBN -----END PGP SIGNATURE----- --HcAYCG3uE/tztfnV-- From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 11:25:39 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 11F7116A400 for ; Fri, 29 Jun 2007 11:25:39 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: from denkbrett.schottelius.org (natgw.netstream.ch [62.65.128.28]) by mx1.freebsd.org (Postfix) with ESMTP id 970B913C44B for ; Fri, 29 Jun 2007 11:25:38 +0000 (UTC) (envelope-from nico-freebsd-geom@schottelius.org) Received: by denkbrett.schottelius.org (Postfix, from userid 1000) id D2F7417CE7B; Fri, 29 Jun 2007 13:16:26 +0200 (CEST) Date: Fri, 29 Jun 2007 13:16:26 +0200 From: Nico -telmich- Schottelius To: freebsd-geom@freebsd.org Message-ID: <20070629111626.GF7663@schottelius.org> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="Mjqg7Yu+0hL22rav" Content-Disposition: inline User-Agent: echo $message | gpg -e $sender -s | netcat mailhost 25 X-Unix-Info: http://unix.schottelius.org/ X-Netzseite: http://nico.schottelius.org/ X-System-Info: denkbrett running Linux 2.6.21.3-denkbrett on i686 Subject: heavy gmirror problems X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 11:25:39 -0000 --Mjqg7Yu+0hL22rav Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hello! After some weeks of trying hard to get gmirror working with FreeBSD 6.2 we had to give up today. This mail is thought to be a a) summary so other people with the same problems do not have to go through the same process b) clarification: perhaps we did something really wrong here c) report for FreeBSD-developers, perhaps there are things to be fixed. We started to use gmirror on a Dell SC 1425 with an Adaptec 39320, because we were not able to see the "hardware raid" that the Adaptec provided and because software raid could make us independent of a) the vendor supporting the OS b) the specific raid card c) and even the bus (whether so choose pata/sata/p-scsi/sas) Then we had problems on the Adaptec 39320 with gmirror: a) system was getting slower and slower until it was inaccessable b) not even ssh connect was possible c) not even login in via console was possible Just yesterday we had some controller resets on one of the Dell SC 1425 with the Adaptec 39320. So this controller is dead for us with FreeBSD 6.2. We were recommended to get LSI Logic hardware, because they are well supported in FreeBSD. So we bought a LSI Logic U320-2 and configured that card to provide both disks as raid0, so we can do gmirror on that card. This way we could still change the controller, because it writes its metadata at the end and the harddisks are still readable by other scsi HBAs. Today was the day we migrated to the u320-2+gmirror system and it was *REALLY* slow, we had about 2000 processes running, because the disk i/o was not performing (mostly qmail related processes, qmail-smtpd, qmail-popup or sslserver). So once again we had an unusable (load almost always > 15, ~1500 processes hanging) system. We first thought that the problem was raised by the sync of gmirror, but after the sync finished the problem did not vanish. We even tried to reboot it to have a clean state. But just after some seconds there were more than 1000 processes hanging. Regarding to systat -vmstat or gstat the disk i/o on amrd1 was always >=3D 95%, almost always 100%. What also made us wonder is why amrd0 was just 10-20% busy, although the reading algorithm was specified as round-robin. This morning we removed gmirror load from /boot/loader.conf, rebootet the system with amrd0s1a as / and now it runs fine. We will migrate it to hardware raid1 soon, but gmirror is no choice here anymore. Perhaps we did something really wrong and gmirror maybe a nice tool, but all tries here failed. I am personally very frustrated, because I really thought gmirror would give us a stable software raid solution without any performance problems. For more information about that case have a look at the mails listed below. Nico For reference, the mails regarding this subject were: (only initial mail, follow the thread for full discussion) freebsd-questions: Message-ID: <20070521093931.GD1101@schottelius.org> Message-ID: <20070606134237.GC30443@schottelius.org> freebsd-hackers: Message-ID: <20070521092443.GC1101@schottelius.org> freesbsd-scsi: Message-ID: <20070606143430.GA31380@schottelius.org> Message-ID: <20070606161221.GB31380@schottelius.org> Message-ID: <20070607085611.GC25624@schottelius.org> Message-ID: <20070613072837.GC27749@schottelius.org> freebsd-geom: Message-ID: <20070626220914.GA11511@schottelius.org> --=20 Think about Free and Open Source Software (FOSS). http://nico.schottelius.org/documentations/foss/the-term-foss/ PGP: BFE4 C736 ABE5 406F 8F42 F7CF B8BE F92A 9885 188C --Mjqg7Yu+0hL22rav Content-Type: application/pgp-signature; name="signature.asc" Content-Description: Digital signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (GNU/Linux) iD8DBQFGhOoKuL75KpiFGIwRAsXvAKCqhr5SpuUSuHRUrPoZG+t2nUet+wCfRt5h 2jtfzvxSgi/yoaCWMBeFTqw= =kAcC -----END PGP SIGNATURE----- --Mjqg7Yu+0hL22rav-- From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 14:20:23 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 608FC16A421 for ; Fri, 29 Jun 2007 14:20:23 +0000 (UTC) (envelope-from harry@yewbarrow.net) Received: from vm.yewbarrow.net (vm.yewbarrow.net [80.68.91.52]) by mx1.freebsd.org (Postfix) with ESMTP id 05E1413C448 for ; Fri, 29 Jun 2007 14:20:23 +0000 (UTC) (envelope-from harry@yewbarrow.net) Received: by vm.yewbarrow.net (Postfix, from userid 1000) id 158F6127CD0; Fri, 29 Jun 2007 14:00:01 +0000 (GMT) To: freebsd-geom@freebsd.org From: Harry Newton Organization: GAUDEAMUS X-Op.135: Muss es sein ? Es muss sein X-Attribution: HN Date: Fri, 29 Jun 2007 14:00:01 +0000 Message-ID: <87odiy3lpa.fsf@vm.yewbarrow.net> User-Agent: Gnus/5.1006 (Gnus v5.10.6) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Subject: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 14:20:23 -0000 I've just set up a GEOM gmirror on two slices on two disks, and would very much appreciate it if someone could validate what I've done. General information below and questions at end. This might just be motivated by paranoia on my part ... Many thanks in advance - Harry Background: - FreeBSD 6.2-STABLE - AMD64 & Two (2) 340GB SATA II disks What I want to do: - Create two slices on each disk (20GB + 284GB) - / /usr /usr/src /usr/ports SWAP on first disk (/dev/ad4s1) - /rii /home /usr/obj /usr/local SWAP on second disk (/dev/ad6s1) - use gmirror(8) to use ad4s2 and ad6s2 to provide /dev/mirror/home What I did: - use sysinstall(8) to create the slices: hydra# fdisk -vp ad4 # /dev/ad4 g c620181 h16 s63 p 1 0xa5 63 41929587 a 1 p 2 0xa5 41929650 583207695 - and partition ad4s1 and ad6s1: hydra# bsdlabel ad4s1 # /dev/ad4s1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 2097152 0 4.2BSD 2048 16384 28528 b: 4194304 2097152 swap c: 41929587 0 unused 0 0 # "raw" part, don't edit d: 10485760 6291456 4.2BSD 2048 16384 28528 e: 4194304 16777216 4.2BSD 2048 16384 28528 f: 20958067 20971520 4.2BSD 2048 16384 28528 - and the same for the other disk. Install FreeBSD. - then: gmirror label -v -n home ad4s2 gmirror load bsdlabel -w -B /dev/mirror/home gmirror insert home ad6s2 gmirror rebuild -v home ad6s2 What's concerning me ? - this error message about partition c: hydra# bsdlabel ad6s2 # /dev/ad6s2: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 583207678 16 4.2BSD 2048 16384 28520 c: 583207694 0 unused 0 0 # "raw" part, don't edit bsdlabel: partition c doesn't cover the whole unit! bsdlabel: An incorrect partition c may cause problems for standard system utilities - which I get on ad4s2 but not on the provided mirror: hydra# bsdlabel /dev/mirror/home # /dev/mirror/home: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 583207678 16 4.2BSD 2048 16384 28520 c: 583207694 0 unused 0 0 # "raw" part, don't edit - and this line in /var/log/messages: WARNING: Expected rawoffset 0, found 41929650 So, what am I asking ? - have I set up the mirror etc correctly ? - what is causing the bsdlabel error messages on slice 2 ? From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 14:46:34 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 710FD16A468 for ; Fri, 29 Jun 2007 14:46:34 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30309.mail.mud.yahoo.com (web30309.mail.mud.yahoo.com [209.191.69.71]) by mx1.freebsd.org (Postfix) with SMTP id 3CF1413C483 for ; Fri, 29 Jun 2007 14:46:34 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 15173 invoked by uid 60001); 29 Jun 2007 14:46:33 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=dY5XpgMlNgAWEbcfCjYhI4nMA8JUnQMaw/a4xX+sDeKD7hVKQF0824txwXuhdcGYZe6nUSWVGF0GorZYofQZwJk0URDXst4GeETLp5HdIEDko5jrxNSW+9J/24JFw4LZnGmJWFNwpppQb80bsAsxLHFmyBlngvlS6hvFIh/T1fc=; X-YMail-OSG: Fhb1ReoVM1mslvEYwGgA_gtspsWrtizMdt6Ysk0.typOZ3XPcQQFGUQZTK29U_pl.T0_Y4NqJep63rh2fJecjZ5kayact7uSalSo9MA8bKRPY9KPOclBgEAejdAkY.n9E.kmM99TY5W2luH3 Received: from [89.53.4.193] by web30309.mail.mud.yahoo.com via HTTP; Fri, 29 Jun 2007 07:46:33 PDT Date: Fri, 29 Jun 2007 07:46:33 -0700 (PDT) From: Arne "Wörner" To: Harry Newton , freebsd-geom@freebsd.org In-Reply-To: <87odiy3lpa.fsf@vm.yewbarrow.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <186446.9762.qm@web30309.mail.mud.yahoo.com> Cc: Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 14:46:34 -0000 --- Harry Newton wrote: > done. General information below and questions at end. This might just > be motivated by paranoia on my part ... > error messages and warnings show in most cases, that something isnt right... > p 2 0xa5 41929650 583207695 > note: ...695 > bsdlabel -w -B /dev/mirror/home > why this? U could just make ur fs on mirror/home... I mean: What is the partition table good for? And wasnt partition "a" traditionally for the root fs (/)? :) > - this error message about partition c: > hydra# bsdlabel ad6s2 > # /dev/ad6s2: > c: 583207694 0 unused 0 0 # "raw" part, > bsdlabel: partition c doesn't cover the whole unit! > see: ...694 (one sector less) This is because gmirror uses the last sector of the slice, so that the gmirror device (mirror/home) is one sector shorter than the slice... But the beginning of the slice (ad6s2) and of the gmirror device (mirror/home) is the same... And there bsdlabel finds the partition data... > - which I get on ad4s2 but not on the provided mirror: > Yup... Its mirrored... > hydra# bsdlabel /dev/mirror/home > # /dev/mirror/home: > c: 583207694 0 unused 0 0 # "raw" part, > Yup... Last sector of each slice (ad4s2 and ad6s2) is for the meta data... > - and this line in /var/log/messages: > WARNING: Expected rawoffset 0, found 41929650 > 41929650 == 41929587+63 This is the beginning of slice 2 (see fdisk)... I would guess, that slice 2 ends on the last sector of the disk, so that gmirror is disturbed (it doesnt know if ad4 or ad4s2 (which share both the same last sector) is its underlying disk)... You could solve that 1. by using hard coded disk names in gmirror or 2. by telling fdisk to make slice 2 one sector shorter, so that ad4/ad6 and ad4s2/ad6s2 do not share the last sector... All errors/warnings r not so important possibly... I think ur gmirror device would work fine (but dont trust me without tests)... I wouldnt use a bsdlabel on the gmirror device and I wouldnt share the same last sector for any GEOM entity (disk, slice, partition, device)... -Arne ____________________________________________________________________________________ Need a vacation? Get great deals to amazing places on Yahoo! Travel. http://travel.yahoo.com/ From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 19:34:58 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 856AC16A421 for ; Fri, 29 Jun 2007 19:34:58 +0000 (UTC) (envelope-from harry@yewbarrow.net) Received: from vm.yewbarrow.net (vm.yewbarrow.net [80.68.91.52]) by mx1.freebsd.org (Postfix) with ESMTP id 25F2813C465 for ; Fri, 29 Jun 2007 19:34:58 +0000 (UTC) (envelope-from harry@yewbarrow.net) Received: by vm.yewbarrow.net (Postfix, from userid 1000) id A000D14A3F3; Fri, 29 Jun 2007 19:34:56 +0000 (GMT) To: Arne =?iso-8859-1?q?W=F6rner?= References: <186446.9762.qm@web30309.mail.mud.yahoo.com> Organization: GAUDEAMUS X-Op.135: Muss es sein ? Es muss sein X-Attribution: HN From: Harry Newton Date: Fri, 29 Jun 2007 19:34:56 +0000 In-Reply-To: <186446.9762.qm@web30309.mail.mud.yahoo.com> (arne_woerner@yahoo.com's message of "Fri, 29 Jun 2007 07:46:33 -0700 (PDT)") Message-ID: <87fy4a1rmn.fsf@vm.yewbarrow.net> User-Agent: Gnus/5.1006 (Gnus v5.10.6) Emacs/21.4 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Cc: freebsd-geom@freebsd.org Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 19:34:58 -0000 Arne - many thanks for your help. I've a couple more questions if you don't mind ... [...] >> - this error message about partition c: >> hydra# bsdlabel ad6s2 >> # /dev/ad6s2: >> c: 583207694 0 unused 0 0 # "raw" part, >> bsdlabel: partition c doesn't cover the whole unit! >> > see: ...694 (one sector less) > This is because gmirror uses the last sector of the slice, so that the gmirror > device (mirror/home) is one sector shorter than the slice... [...] I understand this now: gmirror reserves one sector for its metadata (the last sector). I disklabel /dev/mirror/home which is one sector smaller than the underlying disks. When I look at /dev/mirror/home with bsdlabel there is no problem because the disklabel is consistent with the size of the device (/dev/mirror/home). However, when I report on the underlying disks with bsdlabel (which I can do because they start at the same place) it notes the size discrepancy and issues the warning. I don't have to worry about that at all because I should be only accessing through /dev/mirror/home. >> - and this line in /var/log/messages: >> WARNING: Expected rawoffset 0, found 41929650 >> > 41929650 == 41929587+63 > This is the beginning of slice 2 (see fdisk)... > I would guess, that slice 2 ends on the last sector of the disk, so that > gmirror is disturbed (it doesnt know if ad4 or ad4s2 (which share both the same > last sector) is its underlying disk)... I haven't followed this. If I look at the disk with sysinstall: Disk name: ad4 FDISK Partition Editor DISK Geometry: 38913 cyls/255 heads/63 sectors = 625137345 sectors (305242MB) Offset Size(ST) End Name PType Desc Subtype Flags 0 63 62 - 12 unused 0 63 41929587 41929649 ad4s1 8 freebsd 165 41929650 583207695 625137344 ad4s2 8 freebsd 165 625137345 5103 625142447 - 12 unused 0 I see there's space at the end of the disk. The code that produces the message is in geom_bsd.c and is: if (rawoffset != 0 && (off_t)rawoffset != ms->mbroffset) printf("WARNING: Expected rawoffset %jd, found %jd\n", (intmax_t)ms->mbroffset/dl.d_secsize, (intmax_t)rawoffset/dl.d_secsize); But I'm now confused as to what the importance of this message is ? > You could solve that > 1. by using hard coded disk names in gmirror Is this to prevent ad4 and ad4s2 being confused ? Doesn't gmirror know what the components that make up the provider are ? [...] > All errors/warnings r not so important possibly... > I think ur gmirror device would work fine (but dont trust me without > tests)... I think you're probably right, but I'd like to do it right and understand it more. [...] Thanks - Harry From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 20:07:32 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E394116A421 for ; Fri, 29 Jun 2007 20:07:32 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30315.mail.mud.yahoo.com (web30315.mail.mud.yahoo.com [209.191.69.77]) by mx1.freebsd.org (Postfix) with SMTP id A301213C487 for ; Fri, 29 Jun 2007 20:07:32 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 45112 invoked by uid 60001); 29 Jun 2007 20:07:32 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=3b4RNszGnLAfrZ4Vv1+IMbzd60wJN/eYMALojK7YxCH899fRyhnnyaGBEA5qAycTMUfEPHywece0Zx2pxwh5SO4iIpxKZLAELEyHG9uHhWfGQbyDaFmxWSPZD+2tdCTvUqgqS5Y368+hF7gFg+nkdZRuBlxbSBasHCJQzguBNBI=; X-YMail-OSG: T0DV9YYVM1mA5WZtHFcXBS0BfwOeu_SvGW6KUYgbWfg3360eZAbFFGh9DGo4Xk26LS6eBK_FIpkoAUUZZljcgNnEndrPfWsIbS58xfhAiEEBygYP8xl3X5EhaKWxLQ-- Received: from [89.53.4.193] by web30315.mail.mud.yahoo.com via HTTP; Fri, 29 Jun 2007 13:07:31 PDT Date: Fri, 29 Jun 2007 13:07:31 -0700 (PDT) From: Arne "Wörner" To: Harry Newton In-Reply-To: <87fy4a1rmn.fsf@vm.yewbarrow.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <963281.43796.qm@web30315.mail.mud.yahoo.com> Cc: freebsd-geom@freebsd.org Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 20:07:33 -0000 --- Harry Newton wrote: > >> - and this line in /var/log/messages: > >> WARNING: Expected rawoffset 0, found 41929650 > >> > > 41929650 == 41929587+63 > > This is the beginning of slice 2 (see fdisk)... > > I would guess, that slice 2 ends on the last sector of the disk, so that > > gmirror is disturbed (it doesnt know if ad4 or ad4s2 (which share both the > > same last sector) is its underlying disk)... > > I haven't followed this. If I look at the disk with sysinstall: > > Disk name: ad4 FDISK Partition > Editor > DISK Geometry: 38913 cyls/255 heads/63 sectors = 625137345 sectors > (305242MB) > > Offset Size(ST) End Name PType Desc Subtype > Flags > > 0 63 62 - 12 unused 0 > 63 41929587 41929649 ad4s1 8 freebsd 165 > 41929650 583207695 625137344 ad4s2 8 freebsd 165 > > 625137345 5103 625142447 - 12 unused 0 > Ohoh... OK - so ad4 and ad4s2 do not share the last sector... That makes my theory worthless... > I see there's space at the end of the disk. The code that produces the > message is in geom_bsd.c and is: > > if (rawoffset != 0 && (off_t)rawoffset != ms->mbroffset) > printf("WARNING: Expected rawoffset %jd, found %jd\n", > (intmax_t)ms->mbroffset/dl.d_secsize, > (intmax_t)rawoffset/dl.d_secsize); > Hmm... Dont know what that might mean... > But I'm now confused as to what the importance of this message is ? > I would guess, geom_bsd pulls it straight automatically... You could test that by comparing the files tempX and tempY: % dd if=/dev/ad4s2 iseek=0 of=/tmp/tempX count=128 % dd if=/dev/ad4 iseek=41929650 of=/tmp/tempX count=128 % cmp /tmp/temp[XY] > > You could solve that > > 1. by using hard coded disk names in gmirror > > Is this to prevent ad4 and ad4s2 being confused ? Doesn't gmirror know > what the components that make up the provider are ? > Yup... But that seems to be no problem here... So "hardcoded" would make no sense here... What about my idea to not use any bsdlabel on mirror/home? U can just delete it with: % dd if=/dev/zero of=/dev/mirror/home count=16 -Arne ____________________________________________________________________________________ Get the free Yahoo! toolbar and rest assured with the added security of spyware protection. http://new.toolbar.yahoo.com/toolbar/features/norton/index.php From owner-freebsd-geom@FreeBSD.ORG Fri Jun 29 22:06:22 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0FC4516A400 for ; Fri, 29 Jun 2007 22:06:22 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id A8B7A13C45D for ; Fri, 29 Jun 2007 22:06:18 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id C095B487F7; Sat, 30 Jun 2007 00:06:17 +0200 (CEST) Received: from localhost (cvl74.internetdsl.tpnet.pl [83.19.93.74]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BAB80456B1; Sat, 30 Jun 2007 00:06:08 +0200 (CEST) Date: Sat, 30 Jun 2007 00:06:04 +0200 From: Pawel Jakub Dawidek To: Arne =?iso-8859-2?Q?W=F6rner?= Message-ID: <20070629220604.GA28006@garage.freebsd.pl> References: <87odiy3lpa.fsf@vm.yewbarrow.net> <186446.9762.qm@web30309.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="liOOAslEiF7prFVr" Content-Disposition: inline In-Reply-To: <186446.9762.qm@web30309.mail.mud.yahoo.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: Harry Newton , freebsd-geom@freebsd.org Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 29 Jun 2007 22:06:22 -0000 --liOOAslEiF7prFVr Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 29, 2007 at 07:46:33AM -0700, Arne W=F6rner wrote: [...] > I wouldnt use a bsdlabel on the gmirror device Why? It's perfectly safe and useful. > I wouldnt share the same last sector for any GEOM entity (disk, slice, > partition, device)... My GEOM classes knows how to deal with it. If configured properly, each provider has different size and this is enough for them to find the right one. For example ad0s1a is 16 sectors shorter than ad0s1, which i 63 sectors shorter than ad0 (when we have one slice covering entire disk and one partition covering entire slice). --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --liOOAslEiF7prFVr Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGhYJMForvXbEpPzQRAknZAKDcDsmKREofRVSJa49m9EUT04BY9wCdG/H/ cgTcZljIi21B0/7TlHkdPGk= =W2pz -----END PGP SIGNATURE----- --liOOAslEiF7prFVr-- From owner-freebsd-geom@FreeBSD.ORG Sat Jun 30 05:52:37 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 35EAB16A469 for ; Sat, 30 Jun 2007 05:52:37 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30301.mail.mud.yahoo.com (web30301.mail.mud.yahoo.com [209.191.69.63]) by mx1.freebsd.org (Postfix) with SMTP id D950613C46E for ; Sat, 30 Jun 2007 05:52:36 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 46957 invoked by uid 60001); 30 Jun 2007 05:52:36 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=iQHj1HmY+AzTz0TuxybQYd/p3bniHNirZi38AQGj38QxG/wRk3K3ddiqtmmR6LAWpCr2ME8GpDhIfo9T7LAFqNK6bRpmC22SCBHk2ZlhyiJeaV3eD5C+iOep09Q3SWKWqun1eGDHsAvg8SIkqat4UEKBdfR8HS8Mp9/15YkKiLA=; X-YMail-OSG: jIQ.7GYVM1mUD299lA5NGMwy3QCY7eARND7526INV6qOca2zzZCj4VzEjHFC4eqeyMj4gpTR_5lECGqc_503e.rKr9IhO2MEji91Qo99iAeEm0lqQeQrblYB4w-- Received: from [89.53.47.217] by web30301.mail.mud.yahoo.com via HTTP; Fri, 29 Jun 2007 22:52:36 PDT Date: Fri, 29 Jun 2007 22:52:36 -0700 (PDT) From: Arne "Wörner" To: Pawel Jakub Dawidek In-Reply-To: <20070629220604.GA28006@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <99891.46426.qm@web30301.mail.mud.yahoo.com> Cc: Harry Newton , freebsd-geom@freebsd.org Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2007 05:52:37 -0000 --- Pawel Jakub Dawidek wrote: > On Fri, Jun 29, 2007 at 07:46:33AM -0700, Arne Wörner wrote: > [...] > > I wouldnt use a bsdlabel on the gmirror device > > Why? It's perfectly safe and useful. > Because he wants to use the whole device for his "home" file system... So he just introduces a 16 sectors offset... > > I wouldnt share the same last sector for any GEOM entity (disk, slice, > > partition, device)... > > My GEOM classes knows how to deal with it. If configured properly, each > provider has different size and this is enough for them to find the > right one. For example ad0s1a is 16 sectors shorter than ad0s1, which i > 63 sectors shorter than ad0 (when we have one slice covering entire disk > and one partition covering entire slice). > Cool...! -Arne ____________________________________________________________________________________ Luggage? GPS? Comic books? Check out fitting gifts for grads at Yahoo! Search http://search.yahoo.com/search?fr=oni_on_mail&p=graduation+gifts&cs=bz From owner-freebsd-geom@FreeBSD.ORG Sat Jun 30 06:59:30 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 4585916A468 for ; Sat, 30 Jun 2007 06:59:30 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id D13A213C4B8 for ; Sat, 30 Jun 2007 06:59:29 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0482F487F7; Sat, 30 Jun 2007 08:59:28 +0200 (CEST) Received: from localhost (cvl74.internetdsl.tpnet.pl [83.19.93.74]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id F242345683; Sat, 30 Jun 2007 08:59:16 +0200 (CEST) Date: Sat, 30 Jun 2007 08:59:11 +0200 From: Pawel Jakub Dawidek To: Arne =?iso-8859-2?Q?W=F6rner?= Message-ID: <20070630065911.GB28006@garage.freebsd.pl> References: <20070629220604.GA28006@garage.freebsd.pl> <99891.46426.qm@web30301.mail.mud.yahoo.com> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="bCsyhTFzCvuiizWE" Content-Disposition: inline In-Reply-To: <99891.46426.qm@web30301.mail.mud.yahoo.com> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.5 required=3.0 tests=BAYES_00,RCVD_IN_NJABL_DUL autolearn=no version=3.0.4 Cc: Harry Newton , freebsd-geom@freebsd.org Subject: Re: gmirror on a slice uncertainty X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 30 Jun 2007 06:59:30 -0000 --bCsyhTFzCvuiizWE Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Jun 29, 2007 at 10:52:36PM -0700, Arne W=F6rner wrote: > --- Pawel Jakub Dawidek wrote: > > On Fri, Jun 29, 2007 at 07:46:33AM -0700, Arne W=F6rner wrote: > > [...] > > > I wouldnt use a bsdlabel on the gmirror device > >=20 > > Why? It's perfectly safe and useful. > > > Because he wants to use the whole device for his "home" file system... > So he just introduces a 16 sectors offset... Both methods (mirroring entire disks and mirroring only slices/partitions) have pros and cons. Mirroring entire disks: - after a crash/power failure entire disk has to be synchronized, which may take a long time, + when one replaces disk, he doesn't have to configure slices/partitions on new disk, because everything will be synchronized, + after a crash/power failure there will be only one synchronization process running for the disks. Mirroring slices/partitions: + after crash/power failure only those partitions that were actively used will be synchronized (gmirror marks devices as clean where there are no writes in few seconds) - when one replaces disk, slices and partitions need to be configured by hand, and all partitions inserted to existing mirrors, - after a crash/power failure gmirror will synchronize all partitions at once which puts very heavy load on disks - this should be corrected in the future and currently may be worked around. + allows for fancy configurations - I've machine with five disks, that have two 'a' partitions mirrored for root, three 'a' partition in graid3 for /usr/ and five 'd' partitions in ZFS/RAIDZ for /usr/home/. I use both methods depending on my needs. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --bCsyhTFzCvuiizWE Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFGhf8/ForvXbEpPzQRAug9AKCN5fb/xs9J6lT3X8UB0g5886NIsgCgq6t2 K4zg/DSGo/pSUuxEVuKFr+g= =d7tv -----END PGP SIGNATURE----- --bCsyhTFzCvuiizWE--