From owner-freebsd-geom@FreeBSD.ORG Mon May 18 09:36:29 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 862F1106566C; Mon, 18 May 2009 09:36:29 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (host3.dynacom.ondsl.gr [62.103.35.211]) by mx1.freebsd.org (Postfix) with ESMTP id C51DE8FC19; Mon, 18 May 2009 09:36:28 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (localhost [127.0.0.1]) by smadev.internal.net (8.14.2/8.14.2) with ESMTP id n4I90TAK001411; Mon, 18 May 2009 12:00:29 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: from localhost (localhost [[UNIX: localhost]]) by smadev.internal.net (8.14.2/8.14.2/Submit) id n4I90Sto001410; Mon, 18 May 2009 12:00:28 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org Date: Mon, 18 May 2009 12:00:27 +0300 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200905181200.28732.achill@matrix.gatewaynet.com> Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 09:36:30 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios From owner-freebsd-geom@FreeBSD.ORG Mon May 18 09:36:31 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0817B106564A; Mon, 18 May 2009 09:36:31 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (host3.dynacom.ondsl.gr [62.103.35.211]) by mx1.freebsd.org (Postfix) with ESMTP id 4589E8FC15; Mon, 18 May 2009 09:36:30 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (localhost [127.0.0.1]) by smadev.internal.net (8.14.2/8.14.2) with ESMTP id n4I949gi001476; Mon, 18 May 2009 12:04:09 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: from localhost (localhost [[UNIX: localhost]]) by smadev.internal.net (8.14.2/8.14.2/Submit) id n4I949Vk001475; Mon, 18 May 2009 12:04:09 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Disposition: inline Date: Mon, 18 May 2009 12:03:05 +0300 Content-Type: text/plain; charset="iso-8859-7" Content-Transfer-Encoding: 7bit Message-Id: <200905181204.09021.achill@matrix.gatewaynet.com> Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 09:36:32 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios From owner-freebsd-geom@FreeBSD.ORG Mon May 18 09:38:58 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C2D2610656B2 for ; Mon, 18 May 2009 09:38:58 +0000 (UTC) (envelope-from panixgr@yahoo.com) Received: from web31605.mail.mud.yahoo.com (web31605.mail.mud.yahoo.com [68.142.198.151]) by mx1.freebsd.org (Postfix) with SMTP id 890B38FC18 for ; Mon, 18 May 2009 09:38:58 +0000 (UTC) (envelope-from panixgr@yahoo.com) Received: (qmail 58387 invoked by uid 60001); 18 May 2009 09:12:16 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1242637936; bh=47m21miH/JO1DHShHyg5bIoSneZpwtmd2MVTgZ/XiIE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type; b=LrAq5PHcLFn3MF0vwxSvlVDyMKrnu3wtI28HweD4+B7CeiVPbnlw/mnVquZv5qPGV/bAFCdDBuMTAtqP3Y7x3rHRegAjHKgpXl6XMUj3Gtf0oLEgxusw+jvpxoYJcNIbQm3aDpA4lL5vvHTFfTjdn6eROxRFYeH6p9/g6NUADkc= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type; b=vApBK1dcjweswNfv95Fp0PMdCwew9nzpMezlGj+HraDFmaA7rSb7/Qyr2Qu/QUbroPfNaLPmqkH8DdCOzIRlOxRLuuS/AWeSNkRj8ZWbT4WIBA2O9l8Pw8bZ7VmHakHi192jepzh/o92WXfDR83wZ0I+KHZjuQMZo6wb0X8DnzY=; Message-ID: <559547.57332.qm@web31605.mail.mud.yahoo.com> X-YMail-OSG: dIi6IEoVM1mRZ4R.b87PWSGW2fe7vhPW_gBoWtcdqb27feFwuqb32jZfwklKgOgGKgZvnVhoELMNKGA3RDaKqlziSFS9njov50JZBYpFNzIsHqmOXpGO69gyRpsnRIyy0EgPuV.o67N79b3Rpmc23yrtbN7f4gp6PMu2ytgxKcaOVfIzVhPXC1piIFmbDDqT5OkAjA1XXJVgBQ5f0B.hSSku7boZP5EAORN1XBuHstcMasn.mgQajnigu10h.Xi56kvZ.HWf9MJsR5otXJ_12u_fyDIJrAQsiVsKFaCJnlVUy6Gyz0B5uLJ9NfcdXXeeEbf5c2OdA7ZOL7_3SWmb74XcRn26..7EJQ0OpZZkLkeKjHwY.ZzzjKfjdPa_FTc3A67GAYVNWQr5PxoD.vKzvdZDxdIL0Oo5QS5lJYGzNjPN._TDHPSU1pYgCg-- Received: from [62.103.35.211] by web31605.mail.mud.yahoo.com via HTTP; Mon, 18 May 2009 02:12:16 PDT X-Mailer: YahooMailRC/1277.35 YahooMailWebService/0.7.289.10 Date: Mon, 18 May 2009 02:12:16 -0700 (PDT) From: panix panix To: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-geom@freebsd.org Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 09:38:59 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. From owner-freebsd-geom@FreeBSD.ORG Mon May 18 11:06:53 2009 Return-Path: Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 28BE4106564A for ; Mon, 18 May 2009 11:06:53 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2001:4f8:fff6::28]) by mx1.freebsd.org (Postfix) with ESMTP id 14AAA8FC08 for ; Mon, 18 May 2009 11:06:53 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (localhost [127.0.0.1]) by freefall.freebsd.org (8.14.3/8.14.3) with ESMTP id n4IB6qNe075663 for ; Mon, 18 May 2009 11:06:52 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from gnats@localhost) by freefall.freebsd.org (8.14.3/8.14.3/Submit) id n4IB6qCp075659 for freebsd-geom@FreeBSD.org; Mon, 18 May 2009 11:06:52 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 18 May 2009 11:06:52 GMT Message-Id: <200905181106.n4IB6qCp075659@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: gnats set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to freebsd-geom@FreeBSD.org X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 11:06:53 -0000 Note: to view an individual PR, use: http://www.freebsd.org/cgi/query-pr.cgi?pr=(number). The following is a listing of current problems submitted by FreeBSD users. These represent problem reports covering all versions including experimental development code and obsolete releases. S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/134113 geom [geli] Problem setting secondary GELI key o kern/134044 geom [geom] gmirror(8) overwrites fs with stale data from r o kern/133931 geom [geli] [request] intentionally wrong password to destr o bin/132845 geom [geom] [patch] ggated(8) does not close files opened a o kern/132273 geom glabel(8): [patch] failing on journaled partition o kern/132242 geom [gmirror] gmirror.ko fails to fully initialize o kern/131353 geom [geom] gjournal(8) kernel lock o kern/131037 geom [geli] Unable to create disklabel on .eli-Device o kern/130528 geom gjournal fsck during boot o kern/129674 geom [geom] gjournal root did not mount on boot o kern/129645 geom gjournal(8): GEOM_JOURNAL causes system to fail to boo o kern/129245 geom [geom] gcache is more suitable for suffix based provid o bin/128398 geom [patch] glabel(8): teach geom_label to recognise gpt l f kern/128276 geom [gmirror] machine lock up when gmirror module is used o kern/126902 geom [geom] geom_label: kernel panic during install boot o kern/124973 geom [gjournal] [patch] boot order affects geom_journal con o kern/124969 geom gvinum(8): gvinum raid5 plex does not detect missing s o kern/124294 geom [geom] gmirror(8) have inappropriate logic when workin o kern/124130 geom [gmirror] [usb] gmirror fails to start usb devices tha o kern/123962 geom [panic] [gjournal] gjournal (455Gb data, 8Gb journal), o kern/123630 geom [patch] [gmirror] gmirror doesnt allow the original dr o kern/123122 geom [geom] GEOM / gjournal kernel lock f kern/122415 geom [geom] UFS labels are being constantly created and rem o kern/122067 geom [geom] [panic] Geom crashed during boot o kern/121559 geom [patch] [geom] geom label class allows to create inacc o kern/121364 geom [gmirror] Removing all providers create a "zombie" mir o kern/120231 geom [geom] GEOM_CONCAT error adding second drive o kern/120044 geom [msdosfs] [geom] incorrect MSDOSFS label fries adminis o kern/120021 geom [geom] [panic] net-p2p/qbittorrent crashes system when o kern/119743 geom [geom] geom label for cds is keeped after dismount and o kern/115547 geom [geom] [patch] [request] let GEOM Eli get password fro o kern/114532 geom [geom] GEOM_MIRROR shows up in kldstat even if compile o kern/113957 geom [gmirror] gmirror is intermittently reporting a degrad o kern/113837 geom [geom] unable to access 1024 sector size storage o kern/113419 geom [geom] geom fox multipathing not failing back p bin/110705 geom gmirror(8) control utility does not exit with correct o kern/107707 geom [geom] [patch] [request] add new class geom_xbox360 to o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/94632 geom [geom] Kernel output resets input while GELI asks for o kern/90582 geom [geom] [panic] Restore cause panic string (ffs_blkfree o bin/90093 geom fdisk(8) incapable of altering in-core geometry a kern/89660 geom [vinum] [patch] [panic] due to g_malloc returning null o kern/89546 geom [geom] GEOM error s kern/89102 geom [geom] [panic] panic when forced unmount FS from unplu o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/84556 geom [geom] [panic] GBDE-encrypted swap causes panic at shu o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/79035 geom [vinum] gvinum unable to create a striped set of mirro o bin/78131 geom gbde(8) "destroy" not working. s kern/73177 geom kldload geom_* causes panic due to memory exhaustion 51 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon May 18 13:07:36 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 1BA1410656F0; Mon, 18 May 2009 13:07:36 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (mail.sagedata.net [63.214.156.21]) by mx1.freebsd.org (Postfix) with ESMTP id DF1C78FC15; Mon, 18 May 2009 13:07:34 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (localhost [127.0.0.1]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4ICqOIo034481; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root@mail.sagedata.net) Received: (from root@localhost) by mail.sagedata.net (8.14.3/8.14.3/Submit) id n4ICqOjP034480; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root) X-Envelope-Sender: owner-freebsd-questions@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4I9bEZ5005569 for ; Mon, 18 May 2009 04:37:14 -0500 (CDT) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id C2BC7176A82; Mon, 18 May 2009 09:36:45 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 5A2D810656F3; Mon, 18 May 2009 09:36:45 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 862F1106566C; Mon, 18 May 2009 09:36:29 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (host3.dynacom.ondsl.gr [62.103.35.211]) by mx1.freebsd.org (Postfix) with ESMTP id C51DE8FC19; Mon, 18 May 2009 09:36:28 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (localhost [127.0.0.1]) by smadev.internal.net (8.14.2/8.14.2) with ESMTP id n4I90TAK001411; Mon, 18 May 2009 12:00:29 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: from localhost (localhost [[UNIX: localhost]]) by smadev.internal.net (8.14.2/8.14.2/Submit) id n4I90Sto001410; Mon, 18 May 2009 12:00:28 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org Date: Mon, 18 May 2009 12:00:27 +0300 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200905181200.28732.achill@matrix.gatewaynet.com> X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-questions@freebsd.org Errors-To: owner-freebsd-questions@freebsd.org X-Scanned-By: milter-sender/1.16.915 (localhost [0.0.0.0]); Mon, 18 May 2009 07:52:24 -0500 X-Scanned-By: milter-spamc/1.13.385 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:37:20 -0500 X-Scanned-By: milter-sender/1.16.915 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:37:14 -0500 X-Spam-Status: NO, hits=-2.20 required=4.50 X-Spam-Report: Content analysis details: (-2.2 points, 4.5 required) | | pts rule name description | ---- ---------------------- -------------------------------------------------- | 0.3 DK_POLICY_SIGNSOME Domain Keys: policy says domain signs some mails | -6.0 USER_IN_WHITELIST_TO User is listed in 'whitelist_to' | 1.5 BOTNET_SERVERWORDS Hostname contains server-like substrings | [botnet_serverwords, ip=69.147.83.53, rdns=mx2.freebsd.org] | 2.0 BAYES_50 BODY: Bayesian spam probability is 40 to 60p | [score: 0.5000] | Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 13:07:41 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios _______________________________________________ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" From owner-freebsd-geom@FreeBSD.ORG Mon May 18 13:07:41 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 84088106572A; Mon, 18 May 2009 13:07:36 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (mail.sagedata.net [63.214.156.21]) by mx1.freebsd.org (Postfix) with ESMTP id 0D54C8FC33; Mon, 18 May 2009 13:07:34 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (localhost [127.0.0.1]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4ICqO3K034485; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root@mail.sagedata.net) Received: (from root@localhost) by mail.sagedata.net (8.14.3/8.14.3/Submit) id n4ICqO5e034484; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root) X-Envelope-Sender: owner-freebsd-questions@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4I9bTVH005593 for ; Mon, 18 May 2009 04:37:29 -0500 (CDT) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 607B41A552C; Mon, 18 May 2009 09:36:51 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 851AD10656EA; Mon, 18 May 2009 09:36:50 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0817B106564A; Mon, 18 May 2009 09:36:31 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (host3.dynacom.ondsl.gr [62.103.35.211]) by mx1.freebsd.org (Postfix) with ESMTP id 4589E8FC15; Mon, 18 May 2009 09:36:30 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from smadev.internal.net (localhost [127.0.0.1]) by smadev.internal.net (8.14.2/8.14.2) with ESMTP id n4I949gi001476; Mon, 18 May 2009 12:04:09 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: from localhost (localhost [[UNIX: localhost]]) by smadev.internal.net (8.14.2/8.14.2/Submit) id n4I949Vk001475; Mon, 18 May 2009 12:04:09 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Disposition: inline Date: Mon, 18 May 2009 12:03:05 +0300 Content-Type: text/plain; charset="iso-8859-7" Content-Transfer-Encoding: 7bit Message-Id: <200905181204.09021.achill@matrix.gatewaynet.com> X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-questions@freebsd.org Errors-To: owner-freebsd-questions@freebsd.org X-Scanned-By: milter-sender/1.16.915 (localhost [0.0.0.0]); Mon, 18 May 2009 07:52:24 -0500 X-Scanned-By: milter-spamc/1.13.385 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:37:34 -0500 X-Scanned-By: milter-sender/1.16.915 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:37:29 -0500 X-Spam-Status: NO, hits=-2.20 required=4.50 X-Spam-Report: Content analysis details: (-2.2 points, 4.5 required) | | pts rule name description | ---- ---------------------- -------------------------------------------------- | 0.3 DK_POLICY_SIGNSOME Domain Keys: policy says domain signs some mails | -6.0 USER_IN_WHITELIST_TO User is listed in 'whitelist_to' | 1.5 BOTNET_SERVERWORDS Hostname contains server-like substrings | [botnet_serverwords, ip=69.147.83.53, rdns=mx2.freebsd.org] | 2.0 BAYES_50 BODY: Bayesian spam probability is 40 to 60p | [score: 0.5000] | Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 13:07:47 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios _______________________________________________ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" From owner-freebsd-geom@FreeBSD.ORG Mon May 18 13:07:47 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id A91721065738; Mon, 18 May 2009 13:07:36 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (mail.sagedata.net [63.214.156.21]) by mx1.freebsd.org (Postfix) with ESMTP id 8BBF28FC64; Mon, 18 May 2009 13:07:35 +0000 (UTC) (envelope-from root@mail.sagedata.net) Received: from mail.sagedata.net (localhost [127.0.0.1]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4ICqOF6034489; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root@mail.sagedata.net) Received: (from root@localhost) by mail.sagedata.net (8.14.3/8.14.3/Submit) id n4ICqOTa034488; Mon, 18 May 2009 07:52:24 -0500 (CDT) (envelope-from root) X-Envelope-Sender: owner-freebsd-questions@freebsd.org Received: from mx2.freebsd.org (mx2.freebsd.org [69.147.83.53]) by mail.sagedata.net (8.14.3/8.14.3) with ESMTP id n4I9ebNg005828 for ; Mon, 18 May 2009 04:40:37 -0500 (CDT) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (hub.freebsd.org [IPv6:2001:4f8:fff6::36]) by mx2.freebsd.org (Postfix) with ESMTP id 10798152414; Mon, 18 May 2009 09:39:10 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Received: from hub.freebsd.org (localhost [127.0.0.1]) by hub.freebsd.org (Postfix) with ESMTP id 6832B1065782; Mon, 18 May 2009 09:39:08 +0000 (UTC) (envelope-from owner-freebsd-questions@freebsd.org) Delivered-To: freebsd-questions@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C3CFE10656B8 for ; Mon, 18 May 2009 09:38:58 +0000 (UTC) (envelope-from panixgr@yahoo.com) Received: from web31605.mail.mud.yahoo.com (web31605.mail.mud.yahoo.com [68.142.198.151]) by mx1.freebsd.org (Postfix) with SMTP id 8907F8FC17 for ; Mon, 18 May 2009 09:38:58 +0000 (UTC) (envelope-from panixgr@yahoo.com) Received: (qmail 58387 invoked by uid 60001); 18 May 2009 09:12:16 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1242637936; bh=47m21miH/JO1DHShHyg5bIoSneZpwtmd2MVTgZ/XiIE=; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type; b=LrAq5PHcLFn3MF0vwxSvlVDyMKrnu3wtI28HweD4+B7CeiVPbnlw/mnVquZv5qPGV/bAFCdDBuMTAtqP3Y7x3rHRegAjHKgpXl6XMUj3Gtf0oLEgxusw+jvpxoYJcNIbQm3aDpA4lL5vvHTFfTjdn6eROxRFYeH6p9/g6NUADkc= DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:Cc:MIME-Version:Content-Type; b=vApBK1dcjweswNfv95Fp0PMdCwew9nzpMezlGj+HraDFmaA7rSb7/Qyr2Qu/QUbroPfNaLPmqkH8DdCOzIRlOxRLuuS/AWeSNkRj8ZWbT4WIBA2O9l8Pw8bZ7VmHakHi192jepzh/o92WXfDR83wZ0I+KHZjuQMZo6wb0X8DnzY=; Message-ID: <559547.57332.qm@web31605.mail.mud.yahoo.com> X-YMail-OSG: dIi6IEoVM1mRZ4R.b87PWSGW2fe7vhPW_gBoWtcdqb27feFwuqb32jZfwklKgOgGKgZvnVhoELMNKGA3RDaKqlziSFS9njov50JZBYpFNzIsHqmOXpGO69gyRpsnRIyy0EgPuV.o67N79b3Rpmc23yrtbN7f4gp6PMu2ytgxKcaOVfIzVhPXC1piIFmbDDqT5OkAjA1XXJVgBQ5f0B.hSSku7boZP5EAORN1XBuHstcMasn.mgQajnigu10h.Xi56kvZ.HWf9MJsR5otXJ_12u_fyDIJrAQsiVsKFaCJnlVUy6Gyz0B5uLJ9NfcdXXeeEbf5c2OdA7ZOL7_3SWmb74XcRn26..7EJQ0OpZZkLkeKjHwY.ZzzjKfjdPa_FTc3A67GAYVNWQr5PxoD.vKzvdZDxdIL0Oo5QS5lJYGzNjPN._TDHPSU1pYgCg-- Received: from [62.103.35.211] by web31605.mail.mud.yahoo.com via HTTP; Mon, 18 May 2009 02:12:16 PDT X-Mailer: YahooMailRC/1277.35 YahooMailWebService/0.7.289.10 Date: Mon, 18 May 2009 02:12:16 -0700 (PDT) From: panix panix To: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii X-Content-Filtered-By: Mailman/MimeDel 2.1.5 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Sender: owner-freebsd-questions@freebsd.org Errors-To: owner-freebsd-questions@freebsd.org X-Scanned-By: milter-sender/1.16.915 (localhost [0.0.0.0]); Mon, 18 May 2009 07:52:24 -0500 X-Scanned-By: milter-spamc/1.13.385 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:40:43 -0500 X-Scanned-By: milter-sender/1.16.915 (mail.sagedata.net [63.214.156.21]); Mon, 18 May 2009 04:40:37 -0500 X-Spam-Status: NO, hits=-2.20 required=4.50 X-Spam-Report: Content analysis details: (-2.2 points, 4.5 required) | | pts rule name description | ---- ---------------------- -------------------------------------------------- | 0.3 DK_POLICY_SIGNSOME Domain Keys: policy says domain signs some mails | -6.0 USER_IN_WHITELIST_TO User is listed in 'whitelist_to' | 0.0 DK_POLICY_TESTING Domain Keys: policy says domain is testing DK | 1.5 BOTNET_SERVERWORDS Hostname contains server-like substrings | [botnet_serverwords, ip=69.147.83.53, rdns=mx2.freebsd.org] | 0.0 DK_SIGNED Domain Keys: message has a signature | 0.0 DKIM_SIGNED Domain Keys Identified Mail: message has a signature | 2.0 BAYES_50 BODY: Bayesian spam probability is 40 to 60p | [score: 0.5000] | Cc: freebsd-geom@freebsd.org Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 13:07:54 -0000 Hello, in advance sorry for the cross posting, it is just that freebsd-geom didnt seem that populated. I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. _______________________________________________ freebsd-questions@freebsd.org mailing list http://lists.freebsd.org/mailman/listinfo/freebsd-questions To unsubscribe, send any mail to "freebsd-questions-unsubscribe@freebsd.org" From owner-freebsd-geom@FreeBSD.ORG Mon May 18 17:05:02 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 01FD710656C0; Mon, 18 May 2009 17:05:01 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (cpe-77-83-190-59-dsl.netone.gr [77.83.190.59]) by mx1.freebsd.org (Postfix) with ESMTP id 39DA48FC0A; Mon, 18 May 2009 17:05:00 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (localhost [127.0.0.1]) by panix.internal.net (8.14.3/8.14.3) with ESMTP id n4I7KMmj001368; Mon, 18 May 2009 10:20:22 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: by panix.internal.net (8.14.3/8.14.3/Submit) id n4I7KLhM001366; Mon, 18 May 2009 10:20:21 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) X-Authentication-Warning: panix.internal.net: achix set sender to achill@matrix.gatewaynet.com using -f From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: freebsd-geom@freebsd.org, freebsd-questions@freebsd.org Date: Mon, 18 May 2009 10:20:20 +0300 User-Agent: KMail/1.9.7 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200905181020.20621.achill@matrix.gatewaynet.com> Cc: Subject: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 17:05:08 -0000 Hello, I run 7.1-PRERELEASE, its a home server. today morning after a power failure, the rebuild my root gm0 failed on disk ad4. The messages were: May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 May 18 08:02:08 panix kernel: drm0: on vgapci0 May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 May 18 08:02:08 panix kernel: drm0: [ITHREAD] May 18 08:02:08 panix kernel: ad4: FAILURE - device detached May 18 08:02:08 panix kernel: subdisk4: detached May 18 08:02:08 panix kernel: ad4: detached May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ hoping that the rebuld failure was temprary and so i tried to just run # gmirror forget gm0 # gmirror insert gm0 ad4 But the system responded (if i remember correctly) Unknown provider ad4. The system no longer could see ad4 being online. So i rebooted the system many times and had these results: -When having put offline ad4 (disconnected by hardware), the system booted ok. -When having both disks online the system responded consistently with: "GEOM_MIRROR: Cannot add disk ad6 to gm0 (error=22)." Which IMO is not very ok, since gm0 should add ad6 without problem, no matter if ad4 is online or not. -When having only ad4 online, then it simply cannot find gm0 at all. (kind of reasonable) So my only option is to have only ad6 online, with a current gmirror status: panix# gmirror status Name Status Components mirror/gm0 COMPLETE ad6 Anyone has an idea of how should i proceed (besides buying a UPS unit!) Is it meaningfull to go for a new Disk to replace current ad4? Why is the presence of the supposed bad disk ad4, affecting gm0, when having already told gm0 to forget about ad4? Thanx for any suggestions. -- Achilleas Mantzios From owner-freebsd-geom@FreeBSD.ORG Mon May 18 19:22:50 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0C6921065670; Mon, 18 May 2009 19:22:50 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) by mx1.freebsd.org (Postfix) with ESMTP id BD0858FC1F; Mon, 18 May 2009 19:22:49 +0000 (UTC) (envelope-from 000.fbsd@quip.cz) Received: from localhost (localhost.codelab.cz [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id BFAA219E048; Mon, 18 May 2009 21:07:29 +0200 (CEST) Received: from [192.168.1.2] (r5bb235.net.upc.cz [86.49.61.235]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 733DC19E045; Mon, 18 May 2009 21:07:24 +0200 (CEST) Message-ID: <4A11B1EC.3090601@quip.cz> Date: Mon, 18 May 2009 21:07:24 +0200 From: Miroslav Lachman <000.fbsd@quip.cz> User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.7.12) Gecko/20050915 X-Accept-Language: cz, cs, en, en-us MIME-Version: 1.0 To: Achilleas Mantzios References: <200905181020.20621.achill@matrix.gatewaynet.com> In-Reply-To: <200905181020.20621.achill@matrix.gatewaynet.com> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org Subject: Re: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 May 2009 19:22:50 -0000 Achilleas Mantzios wrote: > Hello, > I run 7.1-PRERELEASE, its a home server. > today morning after a power failure, the rebuild my root gm0 failed on disk ad4. > The messages were: > > May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error (retrying request) LBA=268091264 > May 18 08:02:08 panix kernel: drm0: on vgapci0 > May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB > May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 20060119 > May 18 08:02:08 panix kernel: drm0: [ITHREAD] > May 18 08:02:08 panix kernel: ad4: FAILURE - device detached > May 18 08:02:08 panix kernel: subdisk4: detached > May 18 08:02:08 panix kernel: ad4: detached > May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 disconnected. > May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provider ad4 stopped. > > I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-gmirror/ > hoping that the rebuld failure was temprary > and so i tried to just run > # gmirror forget gm0 > # gmirror insert gm0 ad4 The correct order of commands is: atacontrol list gmirror list gmirror forget gm0 gmirror clear -v ad4 gmirror insert -v gm0 ad4 Miroslav Lachman From owner-freebsd-geom@FreeBSD.ORG Tue May 19 10:05:06 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id BD1AC106566C; Tue, 19 May 2009 10:05:06 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (cpe-77-83-190-59-dsl.netone.gr [77.83.190.59]) by mx1.freebsd.org (Postfix) with ESMTP id 2A1A58FC1A; Tue, 19 May 2009 10:05:05 +0000 (UTC) (envelope-from achill@matrix.gatewaynet.com) Received: from panix.internal.net (localhost [127.0.0.1]) by panix.internal.net (8.14.3/8.14.3) with ESMTP id n4JA53U7001447; Tue, 19 May 2009 13:05:03 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) Received: by panix.internal.net (8.14.3/8.14.3/Submit) id n4JA52xA001446; Tue, 19 May 2009 13:05:02 +0300 (EEST) (envelope-from achill@matrix.gatewaynet.com) X-Authentication-Warning: panix.internal.net: achix set sender to achill@matrix.gatewaynet.com using -f From: Achilleas Mantzios Organization: Dynacom Tankers Mgmt To: Miroslav Lachman <000.fbsd@quip.cz> Date: Tue, 19 May 2009 13:05:01 +0300 User-Agent: KMail/1.9.7 References: <200905181020.20621.achill@matrix.gatewaynet.com> <4A11B1EC.3090601@quip.cz> In-Reply-To: <4A11B1EC.3090601@quip.cz> MIME-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: quoted-printable Content-Disposition: inline Message-Id: <200905191305.01618.achill@matrix.gatewaynet.com> Cc: freebsd-questions@freebsd.org, freebsd-geom@freebsd.org Subject: Re: Weird problem with gmirror - cannot add the Good disk when previously failed SATA disk is online X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 May 2009 10:05:07 -0000 =CE=A3=CF=84=CE=B9=CF=82 Monday 18 May 2009 22:07:24 =CE=BF/=CE=B7 Miroslav= Lachman =CE=AD=CE=B3=CF=81=CE=B1=CF=88=CE=B5: > Achilleas Mantzios wrote: > > Hello, > > I run 7.1-PRERELEASE, its a home server. > > today morning after a power failure, the rebuild my root gm0 failed on = disk ad4. > > The messages were: > >=20 > > May 18 08:02:02 panix kernel: ad4: WARNING - WRITE_DMA UDMA ICRC error = (retrying request) LBA=3D268091264 > > May 18 08:02:08 panix kernel: drm0: on vgapci0 > > May 18 08:02:08 panix kernel: info: [drm] AGP at 0xf0000000 128MB > > May 18 08:02:08 panix kernel: info: [drm] Initialized i915 1.5.0 200601= 19 > > May 18 08:02:08 panix kernel: drm0: [ITHREAD] > > May 18 08:02:08 panix kernel: ad4: FAILURE - device detached > > May 18 08:02:08 panix kernel: subdisk4: detached > > May 18 08:02:08 panix kernel: ad4: detached > > May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: provider ad4 dis= connected. > > May 18 08:02:08 panix kernel: GEOM_MIRROR: Device gm0: rebuilding provi= der ad4 stopped. > >=20 > > I read http://www.eztiger.org/2008/08/removing-and-re-adding-a-disk-in-= gmirror/ > > hoping that the rebuld failure was temprary > > and so i tried to just run=20 > > # gmirror forget gm0 > > # gmirror insert gm0 ad4 >=20 > The correct order of commands is: > atacontrol list > gmirror list >=20 > gmirror forget gm0 > gmirror clear -v ad4 > gmirror insert -v gm0 ad4 >=20 Thanx. >=20 > Miroslav Lachman >=20 =2D-=20 Achilleas Mantzios From owner-freebsd-geom@FreeBSD.ORG Thu May 21 17:33:43 2009 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 0E7F61065676 for ; Thu, 21 May 2009 17:33:43 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from ciao.gmane.org (main.gmane.org [80.91.229.2]) by mx1.freebsd.org (Postfix) with ESMTP id 8CB2F8FC1C for ; Thu, 21 May 2009 17:33:42 +0000 (UTC) (envelope-from gcubfg-freebsd-geom@m.gmane.org) Received: from list by ciao.gmane.org with local (Exim 4.43) id 1M7C9D-0003Hg-RK for freebsd-geom@freebsd.org; Thu, 21 May 2009 17:33:39 +0000 Received: from 93-138-127-129.adsl.net.t-com.hr ([93.138.127.129]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 21 May 2009 17:33:39 +0000 Received: from ivoras by 93-138-127-129.adsl.net.t-com.hr with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Thu, 21 May 2009 17:33:39 +0000 X-Injected-Via-Gmane: http://gmane.org/ To: freebsd-geom@freebsd.org From: Ivan Voras Date: Thu, 21 May 2009 19:33:15 +0200 Lines: 73 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig32B150921B8278834934ECCB" X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: 93-138-127-129.adsl.net.t-com.hr User-Agent: Thunderbird 2.0.0.21 (Windows/20090302) In-Reply-To: X-Enigmail-Version: 0.95.7 Sender: news Subject: Re: gjournal+gstripe+gmirror question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 May 2009 17:33:43 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig32B150921B8278834934ECCB Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Alexei Troussov wrote: > Hello All, >=20 > I decided to build multi-terabyte data storage (file server) using 4 x > 1Tb disks. No special raid controller is used, FreeBSD 7.1 is running o= n > another disk, so the disk array is going to be used for file storage on= ly. > So, I tried several combinations of gmirror/gstripe and put gjournal on= it: >=20 > 1) two mirrors and stripe on them This is RAID 10 > 2) two stripes and mirror on them This is RAID 01. It is slightly worse because if one drive fails, no other drive must be allowed to fail. In the RAID10 case, each drive from the mirrored sets can fail. > Both configurations gave excellent I/O speed (around 100Mb/sec), and I You should get better - the total performance should be near or even slightly above 2-drive striped (RAID-0) configuration. Modern drives have sequential performance between 60 MB/s and 80 MB/s so you should be getting between 120 MB/s and 160 MB/s. > chose the first one as it needs less time to resync disks when one of > the mirrors fails. To make picture more complete, I didn't try graid3 > because it seems to load CPU more than configs above, which is not good= > for my barebone :) Correct. > Now when my top-level gstripe gets "gjournal"-ed, I see relatively poor= > write speed around 20-30 Mb/sec. > As far as I understand from man gjournal and some posts here, > performance usually drops about 40-50%, but what I have is much worse..= =2E >=20 > Are there a better way to configure/tune the whole thing? > Thanks in advance! >=20 > PS Here is my current playground config: > Stripesize: 131072 Try a stripe size of 16 kB. --------------enig32B150921B8278834934ECCB Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.9 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iEYEARECAAYFAkoVkGIACgkQldnAQVacBcgBoACg16Xn+MqSpMh0+bbw3CFwseMv wRwAn1Wgd5dB6R+ILxwLtbDtk30rhWPW =EVfG -----END PGP SIGNATURE----- --------------enig32B150921B8278834934ECCB--