From owner-freebsd-geom@FreeBSD.ORG Sun Jan 28 03:13:25 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 859D616A401 for ; Sun, 28 Jan 2007 03:13:25 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from amsfep20-int.chello.nl (amsfep20-int.chello.nl [62.179.120.15]) by mx1.freebsd.org (Postfix) with ESMTP id F2C6413C441 for ; Sun, 28 Jan 2007 03:13:24 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from mail.logic-q.nl ([89.98.181.67]) by amsfep20-int.chello.nl (InterMail vM.6.01.04.04 201-2131-118-104-20050224) with ESMTP id <20070128031323.UHSW14586.amsfep20-int.chello.nl@mail.logic-q.nl>; Sun, 28 Jan 2007 04:13:23 +0100 Received: from localhost (localhost.logic-q.nl [127.0.0.1]) by mail.logic-q.nl (Postfix) with ESMTP id B423E11517; Sun, 28 Jan 2007 04:13:22 +0100 (CET) X-Virus-Scanned: amavisd-new at logic-q.nl Received: from mail.logic-q.nl ([127.0.0.1]) by localhost (mail.logic-q.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id I5YRkukiNje2; Sun, 28 Jan 2007 04:13:21 +0100 (CET) Received: from kotsbak (kotsbak [192.168.0.149]) by mail.logic-q.nl (Postfix) with SMTP id CF438114A6; Sun, 28 Jan 2007 04:13:21 +0100 (CET) From: "Hansa" To: "R. B. Riddick" , "freebsd geom" Date: Sun, 28 Jan 2007 04:13:28 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 In-Reply-To: <20070127230930.96837.qmail@web30305.mail.mud.yahoo.com> Importance: Normal Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jan 2007 03:13:25 -0000 First of all. Sorry for the other messages. I had some problems sending mail to the list. > Van: R. B. Riddick [mailto:arne_woerner@yahoo.com] > > Currently ad4 contains 3 partitions: > > ad4s1 swap, / and /var > > ad4s2 /usr > > ad4s3 /home > > I wan't to mirror ad4s1 and ad4s2. I want to stripe ad4s3. Below is my > > current slice setup. > > > So u have another disk? Yes, forgot to mention. > Or do u want to mirror ad4s1 to ad4s2? That would be not so wise > (performance, > safety)... > > > Offset Size(ST) End Name PType Desc Subtype > > Flags > > > > 0 63 62 - 12 unused 0 > > 63 12578832 12578894 ad4s1 8 freebsd 165 > > 12578895 147814065 160392959 ad4s2 8 freebsd 165 > > 160392960 425706435 586099394 ad4s3 8 freebsd 165 > > 586099395 15309 586114703 - 12 unused 0 > > > > Before I continue setting up the mirror I want to make sure > I've setup my > > slices correctly. > > Reading the gmirror man page it states that the gmirror utility > uses on-disk > > metadata (stored in the provider's last sector) to store all needed > > information. > > Since I'm no expert in understanding disk structures I'm not > sure what the > > above means. > > > gmirror/gstripe use the last sector of its consumers for meta > data, and provide > a device that is one sector shorter than the smalles consumer. > > E. g.: > gmirror(name=X, consumers=(ad99s1(size=1GB), ad77(size=2GB)), > size=1GB-512B) Not sure what you mean by the above. I'm not familiar with the terms you (and gmirror manpage) use. Where do I place the consumer; what is the provider's last sector? Though I speak an read English fairly well, it is not my native language and sometimes it's hard to understand writings in it :) Considder my setup below: [----------------------- ad4 ----------------------] (disk) [--------- s1 ---------][---- s2 ----][---- s3 ----] (slices) [[--a--][--b--][--d--]*][[--- d ---]*][[--- d ---]*] (partitions) I think the metadata is stored at '*' Is it one sector (512Bytes?) smaller than size(a) + size(b) + size(d) (same for s2d and s3d). > > In my case I think I should create the folowing slice setup: > > my last partition on ad4s1 must end at 12578893 instead of 12578894. The > > next partition should begin at 12578895 and end at 160392958 > creating the > > space to store metadata. > > > The problem with an existing installation is, that it is possible > that the last > sector of ad4s1 and ad4s2 and ad4s3 is used by a file system. So > we need to > know the bsdlabel of ad4s1 and ad4s2 and ad4s3 in order to give > useful advice. Here they are: # /dev/ad4s1: 8 partitions: # size offset fstype [fsize bsize bps/cpg] a: 4192256 0 4.2BSD 0 0 0 b: 4192256 4192256 swap c: 12578832 0 unused 0 0 # "raw" part, don't edit d: 4194320 8384512 4.2BSD 0 0 0 # /dev/ad4s2: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 147814065 0 unused 0 0 # "raw" part, don't edit d: 147814065 0 4.2BSD 2048 16384 28552 # /dev/ad4s3: 8 partitions: # size offset fstype [fsize bsize bps/cpg] c: 425706435 0 unused 0 0 # "raw" part, don't edit d: 425706435 0 4.2BSD 2048 16384 28552 > I just wonder why u want to stripe (without any safety) the home fs, which > contains most likely quite important and difficult to restore > data, while u > want to mirror (with disk failure protection) the root-fs (/), > although u can > just put a CD into ur box and restore it... R u sure, that u dont want to > mirror ur home fs, too (or graid3 (e. g. 2disks (data) +1disk > (parity)) or so)? Home is mainly used to store music and movies. I plan to tar other improtant data to the mirror. I'd like to do raid5. But since I currently lack time to install and configure a complete new system I thought this was the quickest way. Also my disks are not the same size and it would be a shame to loose the space left on larger onces :) - Hansa From owner-freebsd-geom@FreeBSD.ORG Sun Jan 28 09:40:07 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E00B816A404 for ; Sun, 28 Jan 2007 09:40:07 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30306.mail.mud.yahoo.com (web30306.mail.mud.yahoo.com [209.191.69.68]) by mx1.freebsd.org (Postfix) with SMTP id 9612713C48D for ; Sun, 28 Jan 2007 09:40:07 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 11800 invoked by uid 60001); 28 Jan 2007 09:40:06 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=c0MM3jUhBy9l5v/SLNVnlSSJgFB0Cy9NDl4GiMAQqKHHr1CsCClDbCUDT35HnqMaoTrafEni8xrVipD4nI14KoS3dnWiZo14J0syvV/VZG/Zu+sCdZVW0e2Pur3phk4LwEdFjxLkllAqAr9wq9V7HjrRmGvauIXDGfzePjjobl4= ; Message-ID: <20070128094006.11798.qmail@web30306.mail.mud.yahoo.com> X-YMail-OSG: rI0E6FoVM1nzL7w48CsHUgXJ1z_yxESttjUmReDxCpbGsKP4o53fwuwqYALgAV4V_2mgmkrpsUi7CKXFluKvAR5AdKb87k7XsJzPLzzz1M2vMqLyTtU- Received: from [213.54.174.136] by web30306.mail.mud.yahoo.com via HTTP; Sun, 28 Jan 2007 01:40:06 PST Date: Sun, 28 Jan 2007 01:40:06 -0800 (PST) From: "R. B. Riddick" To: Hansa , freebsd geom In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jan 2007 09:40:08 -0000 --- Hansa wrote: > > Van: R. B. Riddick [mailto:arne_woerner@yahoo.com] > > > Offset Size(ST) End Name PType Desc Subtype > > > Flags > > > > > > 0 63 62 - 12 unused 0 > > > 63 12578832 12578894 ad4s1 8 freebsd 165 > > > 12578895 147814065 160392959 ad4s2 8 freebsd 165 > > > 160392960 425706435 586099394 ad4s3 8 freebsd 165 > > > 586099395 15309 586114703 - 12 unused 0 > > > > Considder my setup below: > [----------------------- ad4 ----------------------] (disk) > [--------- s1 ---------][---- s2 ----][---- s3 ----] (slices) > [[--a--][--b--][--d--]*][[--- d ---]*][[--- d ---]*] (partitions) > > I think the metadata is stored at '*' > Is it one sector (512Bytes?) smaller than size(a) + size(b) + size(d) (same > for s2d and s3d). > I would say: s1 is one sector larger than size(a)+size(b)+size(d). And s2 is 1 sector (512B most likely; depends on ur disks) larger than size(d). And s3 dito... > # /dev/ad4s1: > 8 partitions: > # size offset fstype [fsize bsize bps/cpg] > a: 4192256 0 4.2BSD 0 0 0 > b: 4192256 4192256 swap > c: 12578832 0 unused 0 0 # "raw" part, don't > edit > d: 4194320 8384512 4.2BSD 0 0 0 > Here we see, that d ends on the last sector of slice 1 (s1). So u need to shrink partition d by one sector. Since UFS might use that sector, u need an all new file system for partition d... Maybe u want to it like this: 1. fdisk ur new disk first 2. then setup the gmirror-s on the new disk (1. gmirror with only one slice per mirror; 2. bsdlabel on the gmirror devices (u can use the full area, because gmirror hides the last sector of the slice)). 3. then copy ad4s3d to some backup media. 4. then setup the gstripe or gconcat. 5. then copy the filesystems ad4s1a, ad4s1d and ad4s2d to the gmirror-ed partitions mirror1a, mirror1d, mirror2d 6. then restore the backup for the gstripe 7. add the slices ad4s1 and ad4s2 to the gmirror 8. ready... :-) -Arne ____________________________________________________________________________________ It's here! Your new message! Get new email alerts with the free Yahoo! Toolbar. http://tools.search.yahoo.com/toolbar/features/mail/ From owner-freebsd-geom@FreeBSD.ORG Sun Jan 28 21:04:39 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id CC56916A403 for ; Sun, 28 Jan 2007 21:04:39 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from amsfep17-int.chello.nl (amsfep17-int.chello.nl [62.179.120.12]) by mx1.freebsd.org (Postfix) with ESMTP id 2C36A13C441 for ; Sun, 28 Jan 2007 21:04:38 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from mail.logic-q.nl ([89.98.181.67]) by amsfep11-int.chello.nl (InterMail vM.6.01.04.04 201-2131-118-104-20050224) with ESMTP id <20070128210259.HKPM1100.amsfep11-int.chello.nl@mail.logic-q.nl>; Sun, 28 Jan 2007 22:02:59 +0100 Received: from localhost (localhost.logic-q.nl [127.0.0.1]) by mail.logic-q.nl (Postfix) with ESMTP id 48CDB1162B; Sun, 28 Jan 2007 22:02:58 +0100 (CET) X-Virus-Scanned: amavisd-new at logic-q.nl Received: from mail.logic-q.nl ([127.0.0.1]) by localhost (mail.logic-q.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id GP1JKNRnuXed; Sun, 28 Jan 2007 22:02:57 +0100 (CET) Received: from kotsbak (kotsbak [192.168.0.149]) by mail.logic-q.nl (Postfix) with SMTP id A4F73115C5; Sun, 28 Jan 2007 22:02:57 +0100 (CET) From: "Hansa" To: "R. B. Riddick" , "freebsd geom" Date: Sun, 28 Jan 2007 22:03:04 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 In-Reply-To: <20070128094006.11798.qmail@web30306.mail.mud.yahoo.com> Importance: Normal Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jan 2007 21:04:39 -0000 > > > Van: R. B. Riddick [mailto:arne_woerner@yahoo.com] > > > > Offset Size(ST) End Name PType Desc Subtype > > > > Flags > > > > > > > > 0 63 62 - 12 unused 0 > > > > 63 12578832 12578894 ad4s1 8 freebsd 165 > > > > 12578895 147814065 160392959 ad4s2 8 freebsd 165 > > > > 160392960 425706435 586099394 ad4s3 8 freebsd 165 > > > > 586099395 15309 586114703 - 12 unused 0 > > > > > > Considder my setup below: > > [----------------------- ad4 ----------------------] (disk) > > [--------- s1 ---------][---- s2 ----][---- s3 ----] (slices) > > [[--a--][--b--][--d--]*][[--- d ---]*][[--- d ---]*] (partitions) > > > > I think the metadata is stored at '*' > > Is it one sector (512Bytes?) smaller than size(a) + size(b) + > size(d) (same > > for s2d and s3d). > > > I would say: s1 is one sector larger than size(a)+size(b)+size(d). > And s2 is 1 sector (512B most likely; depends on ur disks) larger > than size(d). > And s3 dito... Your o so right. Twas late you know :) > > # /dev/ad4s1: > > 8 partitions: > > # size offset fstype [fsize bsize bps/cpg] > > a: 4192256 0 4.2BSD 0 0 0 > > b: 4192256 4192256 swap > > c: 12578832 0 unused 0 0 # "raw" part, don't edit > > d: 4194320 8384512 4.2BSD 0 0 0 > > > Here we see, that d ends on the last sector of slice 1 (s1). > So u need to shrink partition d by one sector. > Since UFS might use that sector, u need an all new file system > for partition > d... How do you determine that it's on the last sector? > Maybe u want to it like this: > 1. fdisk ur new disk first Should I create the the new disk (ad6) slice size exactly as on ad4? > 2. then setup the gmirror-s on the new disk (1. gmirror with only > one slice per > mirror; 2. bsdlabel on the gmirror devices (u can use the full > area, because > gmirror hides the last sector of the slice)). > 3. then copy ad4s3d to some backup media. > 4. then setup the gstripe or gconcat. > 5. then copy the filesystems ad4s1a, ad4s1d and ad4s2d to the gmirror-ed > partitions mirror1a, mirror1d, mirror2d > 6. then restore the backup for the gstripe > 7. add the slices ad4s1 and ad4s2 to the gmirror > 8. ready... :-) Hmm.. I'm already stuck at 1. Since I've never done this before, can you help me on my way by specifying the correct commands? Here's what I've come up with so far: 1. Using fdisk in /stand/sysinstall presuming same slice size as ad4. 2. # gmirror label -v -b round-robin gm0 /dev/ad6s1 # gmirror label -v -b round-robin gm0 /dev/ad6s2 3. # dd if=/dev/ad4s3d of=/mnt/netwshare/ad4s3d.backup 4. Have not dug into that yet. 5. I guess you mean copying ad4s1a, ad4s1b, ad4s1d and ad4s2d to te gmirror-ed. Can I use dd for that? 6. dd or tar the backup on the stripe 7. Eh.. 8. ... Tnx. - Hansa From owner-freebsd-geom@FreeBSD.ORG Sun Jan 28 21:53:56 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 54F9116A506 for ; Sun, 28 Jan 2007 21:53:56 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30305.mail.mud.yahoo.com (web30305.mail.mud.yahoo.com [209.191.69.67]) by mx1.freebsd.org (Postfix) with SMTP id 2762713C478 for ; Sun, 28 Jan 2007 21:53:56 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 25209 invoked by uid 60001); 28 Jan 2007 21:53:55 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=WSC4/QQDKyDI5cg/avg8viWvG8MLydRYSiIGHuV+haSUkMRbmZBx5RS0AOqet2OncZn88EZZqwulz9kl5vCeiO5YDlszgRCaJz1LUQ+xnVLZVbg+vozl3XYpiipJOmOEbbOGWyfim/lWsyIQVyNW7IyrnQOynE9ymkWtdEw4Kxw= ; Message-ID: <20070128215355.25207.qmail@web30305.mail.mud.yahoo.com> X-YMail-OSG: qSM3MwQVM1k_B_axK4bkiwwbpAuNOdo6n7mXnrHvdf6Bub4ZdZ5DfK25jbYbF3vBLGDSNJrxkA_oS.lxHaXamy_oVGvbepAcJRMLb9OAVioQdEc08mY- Received: from [213.54.174.136] by web30305.mail.mud.yahoo.com via HTTP; Sun, 28 Jan 2007 13:53:55 PST Date: Sun, 28 Jan 2007 13:53:55 -0800 (PST) From: "R. B. Riddick" To: Hansa , freebsd geom In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Jan 2007 21:53:56 -0000 before u go on further, I would like to advise u to do a backup ur data... u should try to understand first, what the commands do (try "man cpio" for example)... Then u should do some exercises in a sub directory (like /tmp/blubber) until u feel like u understood it sufficiently... --- Hansa wrote: > > > # /dev/ad4s1: > > > 8 partitions: > > > # size offset fstype [fsize bsize bps/cpg] > > > a: 4192256 0 4.2BSD 0 0 0 > > > b: 4192256 4192256 swap > > > c: 12578832 0 unused 0 0 # "raw" part, > don't edit > > > d: 4194320 8384512 4.2BSD 0 0 0 > > > > > Here we see, that d ends on the last sector of slice 1 (s1). > > So u need to shrink partition d by one sector. > > Since UFS might use that sector, u need an all new file system > > for partition > > d... > How do you determine that it's on the last sector? > 4194320+8384512 = 12578832 ==> d ends on the last sector > > Maybe u want to it like this: > > 1. fdisk ur new disk first > Should I create the the new disk (ad6) slice size exactly as on ad4? > I dont know... If u want to change the file system sizes: Now is the right moment... But if u change it, u have to change it on ad4, too... > Hmm.. I'm already stuck at 1. Since I've never done this before, can you > help me on my way by specifying the correct commands? Here's what I've come > up with so far: > 1. Using fdisk in /stand/sysinstall presuming same slice size as ad4. > OK > 2. # gmirror label -v -b round-robin gm0 /dev/ad6s1 > # gmirror label -v -b round-robin gm0 /dev/ad6s2 > looks good > 3. # dd if=/dev/ad4s3d of=/mnt/netwshare/ad4s3d.backup > looks not good, because: (aa) dd uses a default block size of 512 bytes, so that it does many requests... Better would be bs=1m or so... (bb) u should use "cd /oldhome ; find . | cpio -o > /mnt/netwshare/old-home.cpio" and later "cd /newhome ; cpio -i --preserve-modification-time . < /mnt/netwshare/old-home.cpio" > 4. Have not dug into that yet. > OK - can wait... > 5. I guess you mean copying ad4s1a, ad4s1b, ad4s1d and ad4s2d to te > gmirror-ed. Can I use dd for that? > first u should go to single user mode and mount those old file systems read-only: (aa) single-user (CAVE: 100% service interruption): "kill 1" (bb) mount -r / (cc) mount -r /dev/ad4s1d (dd) mount -r /dev/ad4s2d (ee) u dont need to copy the swap partition... (ff) newfs /dev/mirror/root (gg) mount /dev/mirror/root /mnt (hh) cd / ; find . | egrep -v "^\./(usr|var|mnt)/" | cpio -p --perserve-modification-time /mnt (ii) for /usr and /var(?) similar... > 6. dd or tar the backup on the stripe > i would use cpio > 7. Eh.. > gmirror insert root ad4s1a ... > 8. ... > ;-) -Arne ____________________________________________________________________________________ Need Mail bonding? Go to the Yahoo! Mail Q&A for great tips from Yahoo! Answers users. http://answers.yahoo.com/dir/?link=list&sid=396546091 From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 11:08:29 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 7305616A509 for ; Mon, 29 Jan 2007 11:08:29 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [69.147.83.40]) by mx1.freebsd.org (Postfix) with ESMTP id 5C53713C4A6 for ; Mon, 29 Jan 2007 11:08:29 +0000 (UTC) (envelope-from owner-bugmaster@FreeBSD.org) Received: from freefall.freebsd.org (linimon@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id l0TB8Tnm042040 for ; Mon, 29 Jan 2007 11:08:29 GMT (envelope-from owner-bugmaster@FreeBSD.org) Received: (from linimon@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id l0TB8SBF042036 for freebsd-geom@FreeBSD.org; Mon, 29 Jan 2007 11:08:28 GMT (envelope-from owner-bugmaster@FreeBSD.org) Date: Mon, 29 Jan 2007 11:08:28 GMT Message-Id: <200701291108.l0TB8SBF042036@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: linimon set sender to owner-bugmaster@FreeBSD.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 11:08:29 -0000 Current FreeBSD problem reports Critical problems Serious problems S Tracker Resp. Description -------------------------------------------------------------------------------- o kern/73177 geom kldload geom_* causes panic due to memory exhaustion o kern/76538 geom [gbde] nfs-write on gbde partition stalls and continue o kern/83464 geom [geom] [patch] Unhandled malloc failures within libgeo o kern/84556 geom [geom] GBDE-encrypted swap causes panic at shutdown o kern/87544 geom [gbde] mmaping large files on a gbde filesystem deadlo o kern/89102 geom [geom_vfs] [panic] panic when forced unmount FS from u o bin/90093 geom fdisk(8) incapable of altering in-core geometry o kern/90582 geom [geom_mirror] [panic] Restore cause panic string (ffs_ o kern/98034 geom [geom] dereference of NULL pointer in acd_geom_detach o kern/104389 geom [geom] [patch] sys/geom/geom_dump.c doesn't encode XML 10 problems total. Non-critical problems S Tracker Resp. Description -------------------------------------------------------------------------------- o bin/78131 geom gbde "destroy" not working. o kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o kern/94632 geom [geom] Kernel output resets input while GELI asks for f kern/105390 geom [geli] filesystem on a md backed by sparse file with s o kern/107707 geom [geom] [patch] add new class geom_xbox360 to slice up 5 problems total. From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 12:57:09 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id A29D016A400 for ; Mon, 29 Jan 2007 12:57:09 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from amsfep17-int.chello.nl (amsfep17-int.chello.nl [62.179.120.12]) by mx1.freebsd.org (Postfix) with ESMTP id E30E713C491 for ; Mon, 29 Jan 2007 12:57:08 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from mail.logic-q.nl ([89.98.181.67]) by amsfep19-int.chello.nl (InterMail vM.6.01.04.04 201-2131-118-104-20050224) with ESMTP id <20070129120826.VIUL19932.amsfep19-int.chello.nl@mail.logic-q.nl>; Mon, 29 Jan 2007 13:08:26 +0100 Received: from localhost (localhost.logic-q.nl [127.0.0.1]) by mail.logic-q.nl (Postfix) with ESMTP id 82A2D11684; Mon, 29 Jan 2007 13:08:26 +0100 (CET) X-Virus-Scanned: amavisd-new at logic-q.nl Received: from mail.logic-q.nl ([127.0.0.1]) by localhost (mail.logic-q.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id I1Ft795VneO3; Mon, 29 Jan 2007 13:08:26 +0100 (CET) Received: from kotsbak (kotsbak [192.168.0.149]) by mail.logic-q.nl (Postfix) with SMTP id 01C8F114A6; Mon, 29 Jan 2007 13:08:26 +0100 (CET) From: "Hansa" To: "R. B. Riddick" , "freebsd geom" Date: Mon, 29 Jan 2007 13:08:34 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 In-Reply-To: <20070128215355.25207.qmail@web30305.mail.mud.yahoo.com> Importance: Normal Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 12:57:09 -0000 > Van: R. B. Riddick [mailto:arne_woerner@yahoo.com] > before u go on further, I would like to advise u to do a backup ur data... > > u should try to understand first, what the commands do (try "man cpio" for > example)... Then u should do some exercises in a sub directory (like > /tmp/blubber) until u feel like u understood it sufficiently... Will do... > 4194320+8384512 = 12578832 ==> d ends on the last sector I understand. Since size(d)+offset(d) = size(ad4s1). This means there is no space left to store metadata. Something to keep in mind next time I label a new drive. > > > Maybe u want to it like this: > > > 1. fdisk ur new disk first > > Should I create the the new disk (ad6) slice size exactly as on ad4? > > > I dont know... If u want to change the file system sizes: Now is the right > moment... But if u change it, u have to change it on ad4, too... Ok. One question pops into mind. I'm transfering / which includes my kernel, to a new disk (probably with a different setup). this means the kernel file could be written to a different sector. So I have to tell the bootmgr where it is located. Don't I? > > 2. # gmirror label -v -b round-robin gm0 /dev/ad6s1 > > # gmirror label -v -b round-robin gm0 /dev/ad6s2 > looks good Except for the 2nd command. It should be gm1 instead of gm0. > > 3. # dd if=/dev/ad4s3d of=/mnt/netwshare/ad4s3d.backup > looks not good, because: > ... Will look into that one. > > > 4. then setup the gstripe or gconcat. > > 4. Have not dug into that yet. > > > OK - can wait... I presume gstripe and gconcat like gmirror are using similar ways to store metadata? Which of those is the better choice? > > 5. I guess you mean copying ad4s1a, ad4s1b, ad4s1d and ad4s2d to te > > gmirror-ed. Can I use dd for that? > > > first u should go to single user mode and mount those old file systems > read-only: > (aa) single-user (CAVE: 100% service interruption): "kill 1" > (bb) mount -r / > (cc) mount -r /dev/ad4s1d > (dd) mount -r /dev/ad4s2d > (ee) u dont need to copy the swap partition... > (ff) newfs /dev/mirror/root > (gg) mount /dev/mirror/root /mnt > (hh) cd / ; find . | egrep -v "^\./(usr|var|mnt)/" | cpio -p > --perserve-modification-time /mnt > (ii) for /usr and /var(?) similar... Thanks for your help so far.. Since I've little time this week. I will probably be porting the disks next weekend. I will let you know how things went. Thanks! -Hansa From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 14:48:30 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id BE45216A401 for ; Mon, 29 Jan 2007 14:48:30 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30302.mail.mud.yahoo.com (web30302.mail.mud.yahoo.com [209.191.69.64]) by mx1.freebsd.org (Postfix) with SMTP id 86F6913C47E for ; Mon, 29 Jan 2007 14:48:30 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 12848 invoked by uid 60001); 29 Jan 2007 14:48:30 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID; b=WvCbZ7ouOMWunMyFJToQN+cmViKPokLV00Ww1YTt6a45n2DCSNL5Ol/YzXdl3g5eBR6WSyAEkHZSmKv9KtUIOcO0GvFf5TQH6CV+uceI1fzLmaKMqzBXur781m4MkzK7Emz/onpha7h2SfDQDcAUnb6E16QUO1i/0suGNfMDzHc=; X-YMail-OSG: H4T1H7IVM1mO6NgBBIjpbZSNuD7MVUCRSgvhmunYsszEhsqhNxKm_KCIKpwOygPybnrDq48HiA_F7yKYX36pW3Z0pnTtXEu7M1j1V2AOJiks1pzyr04StqMT7KG76DOD_6D6pZcxdZki.NU- Received: from [213.54.1.88] by web30302.mail.mud.yahoo.com via HTTP; Mon, 29 Jan 2007 06:48:29 PST Date: Mon, 29 Jan 2007 06:48:29 -0800 (PST) From: "R. B. Riddick" To: Hansa , freebsd geom In-Reply-To: MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Message-ID: <901910.12288.qm@web30302.mail.mud.yahoo.com> Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 14:48:30 -0000 --- Hansa wrote: > Ok. One question pops into mind. I'm transfering / which includes my kernel, > to a new disk (probably with a different setup). this means the kernel file > could be written to a different sector. So I have to tell the bootmgr where > it is located. Don't I? > Hmm... I dont think so... There is the first sector of the disk, that is read by the BIOS, then there are 8KB somewhere at a fixed position outside the file system... And I think those 8KB are already able to understand/read UFS... :-) > > > 2. # gmirror label -v -b round-robin gm0 /dev/ad6s1 > > > # gmirror label -v -b round-robin gm0 /dev/ad6s2 > > looks good > Except for the 2nd command. It should be gm1 instead of gm0. > Oh yes... U r right... > I presume gstripe and gconcat like gmirror are using similar ways to store > metadata? > Yup > Which of those is the better choice? > Depends... gstripe has better performance, if it can issue requests for all disks... But gconcat can use the full space of disks of non-equal size (minus one sector per disk for meta data of course)... -Arne ____________________________________________________________________________________ Expecting? Get great news right away with email Auto-Check. Try the Yahoo! Mail Beta. http://advision.webevents.yahoo.com/mailbeta/newmail_tools.html From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 15:29:18 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C755C16A407 for ; Mon, 29 Jan 2007 15:29:18 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from amsfep17-int.chello.nl (amsfep17-int.chello.nl [62.179.120.12]) by mx1.freebsd.org (Postfix) with ESMTP id 0FEAB13C491 for ; Mon, 29 Jan 2007 15:29:17 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from mail.logic-q.nl ([89.98.181.67]) by amsfep14-int.chello.nl (InterMail vM.6.01.04.04 201-2131-118-104-20050224) with ESMTP id <20070129152825.SZKL664.amsfep14-int.chello.nl@mail.logic-q.nl>; Mon, 29 Jan 2007 16:28:25 +0100 Received: from localhost (localhost.logic-q.nl [127.0.0.1]) by mail.logic-q.nl (Postfix) with ESMTP id D27EE116FB; Mon, 29 Jan 2007 16:28:24 +0100 (CET) X-Virus-Scanned: amavisd-new at logic-q.nl Received: from mail.logic-q.nl ([127.0.0.1]) by localhost (mail.logic-q.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tKkI0a48ZYpZ; Mon, 29 Jan 2007 16:28:24 +0100 (CET) Received: from kotsbak (kotsbak [192.168.0.149]) by mail.logic-q.nl (Postfix) with SMTP id 797CB11651; Mon, 29 Jan 2007 16:28:24 +0100 (CET) From: "Hansa" To: "R. B. Riddick" , "freebsd geom" Date: Mon, 29 Jan 2007 16:28:33 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 In-Reply-To: <901910.12288.qm@web30302.mail.mud.yahoo.com> Importance: Normal Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 15:29:18 -0000 > > So I have to tell the bootmgr where it is located. Don't I? > > > Hmm... I dont think so... There is the first sector of the disk, > that is read > by the BIOS, then there are 8KB somewhere at a fixed position > outside the file > system... And I think those 8KB are already able to > understand/read UFS... :-) Thats easy. Cool! > > gstripe or gconcat? Which of those is the better choice? > > > Depends... gstripe has better performance, if it can issue > requests for all > disks... But gconcat can use the full space of disks of non-equal > size (minus > one sector per disk for meta data of course)... I want to use the remainder of the mirrored drives for striping, so I guess gconcat is the better choice. Also since all data on it will be read/written via the network interface (100Mb) performance won't be much of an issue. Thanks again. -Hansa From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 15:31:20 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2C92616A405 for ; Mon, 29 Jan 2007 15:31:20 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3]) by mx1.freebsd.org (Postfix) with SMTP id 90D3513C474 for ; Mon, 29 Jan 2007 15:31:19 +0000 (UTC) (envelope-from rick@kiwi-computer.com) Received: (qmail 36616 invoked by uid 2001); 29 Jan 2007 15:31:16 -0000 Date: Mon, 29 Jan 2007 09:31:15 -0600 From: "Rick C. Petty" To: "R. B. Riddick" Message-ID: <20070129153115.GA36446@keira.kiwi-computer.com> References: <901910.12288.qm@web30302.mail.mud.yahoo.com> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <901910.12288.qm@web30302.mail.mud.yahoo.com> User-Agent: Mutt/1.4.2.1i Cc: Hansa , freebsd geom Subject: Re: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: rick-freebsd@kiwi-computer.com List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 15:31:20 -0000 On Mon, Jan 29, 2007 at 06:48:29AM -0800, R. B. Riddick wrote: > > > Hmm... I dont think so... There is the first sector of the disk, that is read > by the BIOS, then there are 8KB somewhere at a fixed position outside the file > system... And I think those 8KB are already able to understand/read UFS... :-) It's not really outside the file system, it appears at the beginning of the file system. It's 8KB for UFS1 and 64KB for UFS2. Not only that, but that 8K or 64K chunk is open/unused at the front of every superblock, that is: for every cylinder group, IIRC. -- Rick C. Petty From owner-freebsd-geom@FreeBSD.ORG Mon Jan 29 16:28:49 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id C6E7A16A406 for ; Mon, 29 Jan 2007 16:28:44 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from amsfep16-int.chello.nl (amsfep16-int.chello.nl [62.179.120.11]) by mx1.freebsd.org (Postfix) with ESMTP id 0FD1713C4A5 for ; Mon, 29 Jan 2007 16:28:43 +0000 (UTC) (envelope-from mythtv@logic-q.nl) Received: from mail.logic-q.nl ([89.98.181.67]) by amsfep11-int.chello.nl (InterMail vM.6.01.04.04 201-2131-118-104-20050224) with ESMTP id <20070129162830.FRXY1100.amsfep11-int.chello.nl@mail.logic-q.nl>; Mon, 29 Jan 2007 17:28:30 +0100 Received: from localhost (localhost.logic-q.nl [127.0.0.1]) by mail.logic-q.nl (Postfix) with ESMTP id 3387211767; Mon, 29 Jan 2007 17:28:30 +0100 (CET) X-Virus-Scanned: amavisd-new at logic-q.nl Received: from mail.logic-q.nl ([127.0.0.1]) by localhost (mail.logic-q.nl [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id viKvjyzKNzs8; Mon, 29 Jan 2007 17:28:29 +0100 (CET) Received: from kotsbak (kotsbak [192.168.0.149]) by mail.logic-q.nl (Postfix) with SMTP id D0B0611752; Mon, 29 Jan 2007 17:28:29 +0100 (CET) From: "Hansa" To: , "freebsd geom" Date: Mon, 29 Jan 2007 17:28:38 +0100 Message-ID: MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Priority: 3 (Normal) X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook IMO, Build 9.0.2416 (9.0.2910.0) X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3028 In-Reply-To: <20070129153115.GA36446@keira.kiwi-computer.com> Importance: Normal Cc: Subject: RE: How do I gmirror slices? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Jan 2007 16:28:50 -0000 > > Hmm... I dont think so... There is the first sector of the > disk, that is read > > by the BIOS, then there are 8KB somewhere at a fixed position > outside the file > > system... And I think those 8KB are already able to > understand/read UFS... :-) > > It's not really outside the file system, it appears at the > beginning of the > file system. It's 8KB for UFS1 and 64KB for UFS2. Not only > that, but that > 8K or 64K chunk is open/unused at the front of every superblock, that is: > for every cylinder group, IIRC. > Is that why fdisk doesn't touches the first 8/64KB before the first slice? Offset Size(ST) End Name PType Desc Subtype Flags 0 63 62 - 12 unused 0 63 12578832 12578894 ad4s1 8 freebsd 165 Regards, -Hansa From owner-freebsd-geom@FreeBSD.ORG Tue Jan 30 08:51:22 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 55E6316A404 for ; Tue, 30 Jan 2007 08:51:22 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [83.120.8.8]) by mx1.freebsd.org (Postfix) with ESMTP id 920F413C4A6 for ; Tue, 30 Jan 2007 08:51:21 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (ajchob@localhost [127.0.0.1]) by lurza.secnetix.de (8.13.4/8.13.4) with ESMTP id l0U8pEDc005251 for ; Tue, 30 Jan 2007 09:51:19 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.13.4/8.13.1/Submit) id l0U8pEkO005250; Tue, 30 Jan 2007 09:51:14 +0100 (CET) (envelope-from olli) Date: Tue, 30 Jan 2007 09:51:14 +0100 (CET) Message-Id: <200701300851.l0U8pEkO005250@lurza.secnetix.de> From: Oliver Fromme To: freebsd-geom@FreeBSD.ORG, freebsd-geom@FreeBSD.ORG User-Agent: tin/1.8.2-20060425 ("Shillay") (UNIX) (FreeBSD/4.11-STABLE (i386)) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Tue, 30 Jan 2007 09:51:19 +0100 (CET) Cc: Subject: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jan 2007 08:51:22 -0000 Hi, This is strange. gmirror just detached one of its disks for no apparent reason. I've built a mirror consisting of the components ad0 and ad1 (both SATA drives). It has been running fine. This is RELENG_6 from 2006-12-20. Yesterday evening ad1 was detached. There is no other error message logged on console or in the logs (i.e. no I/O error such as a bad sector or anything). There was no particularly high load at that time. In fact, the machine had been under much higher load before, without anything bad happening. This is from the logs: Jan 29 19:10:13 pluto -- MARK -- Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached Jan 29 19:20:26 pluto kernel: subdisk1: detached Jan 29 19:20:26 pluto kernel: ad1: detached Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. Jan 29 19:50:13 pluto -- MARK -- This almost looks like typical Windows problems: Something reports a "failure", but no reason or any other useful information. :-( "atacontrol list" reports for ad1:: Master: no device present After an atacontrol detach/attach cycle, the device is back again: Master: ad1 Serial ATA II I inserted it back into the gmirror, and right now it's synchronizing happily. Can anybody please explain what happened, and -- more importantly -- how to avoid it in the future? As far as I can tell, the disk drives are perfectly OK. Best regards Oliver PS: disk-related stuff from dmesg: atapci0: port 0xe100-0xe107,0xe200-0xe203,0xe300-0xe307,0xe400-0xe403,0xe500-0xe50f,0xe600-0xe6ff irq 20 at device 15.0 on pci0 ata2: on atapci0 ata3: on atapci0 atapci1: port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xe700-0xe70f at device 15.1 on pci0 ata0: on atapci1 ata1: on atapci1 ad0: 152627MB at ata2-master SATA150 ad1: 152627MB at ata3-master SATA150 The PATA controller (ata[01] on atapci1) is not used. I have disabled ATA_STATIC_ID, so the disks are named ad0 and ad1. I've also atapicam in the kernel, but it's not actually used and shouldn't make a difference. This is the SATA-related info from pciconf -lv: atapci0@pci0:15:0: class=0x010400 card=0x70941462 chip=0x31491106 rev=0x80 hdr=0x00 vendor = 'VIA Technologies Inc' device = 'VT8237 VT6410 SATA RAID Controller' class = mass storage subclass = RAID -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, USt-Id: DE204219783 Any opinions expressed in this message are personal to the author and may not necessarily reflect the opinions of secnetix GmbH & Co KG in any way. FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "C++ is the only current language making COBOL look good." -- Bertrand Meyer From owner-freebsd-geom@FreeBSD.ORG Tue Jan 30 09:02:46 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id E4AEC16A408 for ; Tue, 30 Jan 2007 09:02:46 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30315.mail.mud.yahoo.com (web30315.mail.mud.yahoo.com [209.191.69.77]) by mx1.freebsd.org (Postfix) with SMTP id A926A13C4AA for ; Tue, 30 Jan 2007 09:02:46 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: (qmail 42399 invoked by uid 60001); 30 Jan 2007 09:02:46 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:X-YMail-OSG:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=ETGGgnx3oUZecDHBHzOOrSV6SkIL1AqpOluhc2spItopskKNVsob0F/o9pvVO7UxZIUvqS1nAa7H2qfnRLpDNuMIZxQatxsLKidxZBJeMqbK3YB8JInh66CcpfmeuvBwVqOktsZVFFv3pgPkxV5wil1JGuJKf3m4+w3AKL77iyY= ; Message-ID: <20070130090246.42397.qmail@web30315.mail.mud.yahoo.com> X-YMail-OSG: XA4gw5IVM1kaRDmqkHmC6wgmBK7Nnt.Lu8GzQqsTcfYzj4S8920P7WqzjLc4I.eZD7gvTA0mfY5vuRN4x9VY0wkPR5yLtSspj.44gcDZABiMJ7RUiqc- Received: from [85.212.23.3] by web30315.mail.mud.yahoo.com via HTTP; Tue, 30 Jan 2007 01:02:45 PST Date: Tue, 30 Jan 2007 01:02:45 -0800 (PST) From: "R. B. Riddick" To: Oliver Fromme , freebsd-geom@FreeBSD.ORG In-Reply-To: <200701300851.l0U8pEkO005250@lurza.secnetix.de> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jan 2007 09:02:47 -0000 Hi! --- Oliver Fromme wrote: > This is strange. gmirror just detached one of its disks > for no apparent reason. I've built a mirror consisting of > the components ad0 and ad1 (both SATA drives). It has > been running fine. This is RELENG_6 from 2006-12-20. > > Yesterday evening ad1 was detached. There is no other > error message logged on console or in the logs (i.e. no > I/O error such as a bad sector or anything). There was > no particularly high load at that time. In fact, the > machine had been under much higher load before, without > anything bad happening. > > This is from the logs: > > Jan 29 19:10:13 pluto -- MARK -- > Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached > Jan 29 19:20:26 pluto kernel: subdisk1: detached > Jan 29 19:20:26 pluto kernel: ad1: detached > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 > (device=gm0, error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 > (error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 > (error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 > disconnected. > Jan 29 19:50:13 pluto -- MARK -- > My theory is: 1. Ur ad1 disk when to bed like others in ur time zone... 2. Then gmirror tried to write meta data, which woke up the disk 3. BUT: The disk was too slow, so ata_disk.c decided to detach the disk without another try. 4. Then gmirror complained about its unability to write meta data. Remember: Meta data is written from time to time by gmirror, because it likes to mark the mirror clean/dirty depending on the write requests... Remark: I think, etc@fluffles.net reported that some weeks ago... > This almost looks like typical Windows problems: Something > reports a "failure", but no reason or any other useful > information. :-( > Ooch... That was mean... :-) > "atacontrol list" reports for ad1:: > > Master: no device present > This looks like that bug, etc@fluffles.net reported... It helped her box to increase some timeout from 5 sec to 15sec... Maybe this is a mission for sos@ ? > After an atacontrol detach/attach cycle, the device is back > again: > > Master: ad1 Serial ATA II > Lucky u! :) > I inserted it back into the gmirror, and right now it's > synchronizing happily. > :-) -Arne ____________________________________________________________________________________ Don't pick lemons. See all the new 2007 cars at Yahoo! Autos. http://autos.yahoo.com/new_cars.html From owner-freebsd-geom@FreeBSD.ORG Wed Jan 31 20:12:04 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1F37E16A400 for ; Wed, 31 Jan 2007 20:12:04 +0000 (UTC) (envelope-from simon@zaphod.nitro.dk) Received: from mx.nitro.dk (zarniwoop.nitro.dk [83.92.207.38]) by mx1.freebsd.org (Postfix) with ESMTP id CC11513C46B for ; Wed, 31 Jan 2007 20:12:03 +0000 (UTC) (envelope-from simon@zaphod.nitro.dk) Received: from zaphod.nitro.dk (unknown [192.168.3.39]) by mx.nitro.dk (Postfix) with ESMTP id 046402D4951; Wed, 31 Jan 2007 20:11:30 +0000 (UTC) Received: by zaphod.nitro.dk (Postfix, from userid 3000) id 2D5AA11434; Wed, 31 Jan 2007 21:12:02 +0100 (CET) Date: Wed, 31 Jan 2007 21:12:02 +0100 From: "Simon L. Nielsen" To: Oliver Fromme Message-ID: <20070131201201.GB973@zaphod.nitro.dk> References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <200701300851.l0U8pEkO005250@lurza.secnetix.de> User-Agent: Mutt/1.5.11 Cc: freebsd-geom@FreeBSD.ORG Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Jan 2007 20:12:04 -0000 On 2007.01.30 09:51:14 +0100, Oliver Fromme wrote: > This is strange. gmirror just detached one of its disks > for no apparent reason. I've built a mirror consisting of > the components ad0 and ad1 (both SATA drives). It has > been running fine. This is RELENG_6 from 2006-12-20. > > Yesterday evening ad1 was detached. There is no other > error message logged on console or in the logs (i.e. no > I/O error such as a bad sector or anything). There was > no particularly high load at that time. In fact, the > machine had been under much higher load before, without > anything bad happening. > > This is from the logs: > > Jan 29 19:10:13 pluto -- MARK -- > Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached > Jan 29 19:20:26 pluto kernel: subdisk1: detached > Jan 29 19:20:26 pluto kernel: ad1: detached > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. > Jan 29 19:50:13 pluto -- MARK -- I have seen similar problems on my graid3. I think it's simply the disk which stops responding to commands, or at least ata(4) can't talk to the disk anymore... I see it on: ad10: 305245MB at ata5-master SATA150 ad12: 305245MB at ata6-master SATA150 ad14: 305245MB at ata7-master SATA150 After a reboot everything seems fine again and my RAID is rebuilt. I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT BTW. -- Simon L. Nielsen From owner-freebsd-geom@FreeBSD.ORG Wed Jan 31 22:01:02 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 44D6916A402; Wed, 31 Jan 2007 22:01:02 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 90CD613C4A8; Wed, 31 Jan 2007 22:01:01 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 26CD245CDA; Wed, 31 Jan 2007 23:01:00 +0100 (CET) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id BFCF64569A; Wed, 31 Jan 2007 23:00:54 +0100 (CET) Date: Wed, 31 Jan 2007 23:00:04 +0100 From: Pawel Jakub Dawidek To: "Simon L. Nielsen" Message-ID: <20070131220004.GC487@garage.freebsd.pl> References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> <20070131201201.GB973@zaphod.nitro.dk> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="6zdv2QT/q3FMhpsV" Content-Disposition: inline In-Reply-To: <20070131201201.GB973@zaphod.nitro.dk> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: sos@FreeBSD.org, Oliver Fromme , freebsd-geom@FreeBSD.ORG Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Jan 2007 22:01:02 -0000 --6zdv2QT/q3FMhpsV Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jan 31, 2007 at 09:12:02PM +0100, Simon L. Nielsen wrote: > On 2007.01.30 09:51:14 +0100, Oliver Fromme wrote: >=20 > > This is strange. gmirror just detached one of its disks > > for no apparent reason. I've built a mirror consisting of > > the components ad0 and ad1 (both SATA drives). It has > > been running fine. This is RELENG_6 from 2006-12-20. > >=20 > > Yesterday evening ad1 was detached. There is no other > > error message logged on console or in the logs (i.e. no > > I/O error such as a bad sector or anything). There was > > no particularly high load at that time. In fact, the > > machine had been under much higher load before, without > > anything bad happening. > >=20 > > This is from the logs: > >=20 > > Jan 29 19:10:13 pluto -- MARK -- > > Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached > > Jan 29 19:20:26 pluto kernel: subdisk1: detached > > Jan 29 19:20:26 pluto kernel: ad1: detached > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1= (device=3Dgm0, error=3D6). > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on di= sk ad1 (error=3D6). > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on di= sk ad1 (error=3D6). > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 dis= connected. > > Jan 29 19:50:13 pluto -- MARK -- >=20 > I have seen similar problems on my graid3. I think it's simply the > disk which stops responding to commands, or at least ata(4) can't talk > to the disk anymore... >=20 > I see it on: >=20 > ad10: 305245MB at ata5-master SATA150 > ad12: 305245MB at ata6-master SATA150 > ad14: 305245MB at ata7-master SATA150 >=20 > After a reboot everything seems fine again and my RAID is rebuilt. >=20 > I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT > BTW. It seems that when gmirror/graid3 writes to more than one disk at a time, this puts too much load on ata channel or something and ata disconnects the disk. I don't really know how it works exactly, but maybe some timeout should be increased in the ata code? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --6zdv2QT/q3FMhpsV Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFFwRFkForvXbEpPzQRAlMeAKDWwPjha/sx1jFR6XMMA4xJ4iSQtgCeNZ06 wELBJjHfOcMiP1VPUjJVBkU= =/smt -----END PGP SIGNATURE----- --6zdv2QT/q3FMhpsV-- From owner-freebsd-geom@FreeBSD.ORG Wed Jan 31 23:11:38 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1F0FA16A408; Wed, 31 Jan 2007 23:11:38 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from auriate.fluffles.net (cust.95.160.adsl.cistron.nl [195.64.95.160]) by mx1.freebsd.org (Postfix) with ESMTP id BE98D13C4A6; Wed, 31 Jan 2007 23:11:37 +0000 (UTC) (envelope-from etc@fluffles.net) Received: from destiny ([10.0.0.21]) by auriate.fluffles.net with esmtpa (Exim 4.63 (FreeBSD)) (envelope-from ) id 1HCOc0-000Hyn-Qy; Thu, 01 Feb 2007 00:11:32 +0100 Message-ID: <45C12274.7030404@fluffles.net> Date: Thu, 01 Feb 2007 00:12:52 +0100 From: Fluffles User-Agent: Thunderbird 1.5.0.8 (X11/20061114) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> <20070131201201.GB973@zaphod.nitro.dk> <20070131220004.GC487@garage.freebsd.pl> In-Reply-To: <20070131220004.GC487@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-15 Content-Transfer-Encoding: 7bit Cc: freebsd-geom@FreeBSD.ORG, Oliver Fromme , "Simon L. Nielsen" , sos@FreeBSD.org Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 31 Jan 2007 23:11:38 -0000 Pawel Jakub Dawidek wrote: > On Wed, Jan 31, 2007 at 09:12:02PM +0100, Simon L. Nielsen wrote: > >> On 2007.01.30 09:51:14 +0100, Oliver Fromme wrote: >> >> >>> This is strange. gmirror just detached one of its disks >>> for no apparent reason. I've built a mirror consisting of >>> the components ad0 and ad1 (both SATA drives). It has >>> been running fine. This is RELENG_6 from 2006-12-20. >>> >>> Yesterday evening ad1 was detached. There is no other >>> error message logged on console or in the logs (i.e. no >>> I/O error such as a bad sector or anything). There was >>> no particularly high load at that time. In fact, the >>> machine had been under much higher load before, without >>> anything bad happening. >>> >>> This is from the logs: >>> >>> Jan 29 19:10:13 pluto -- MARK -- >>> Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached >>> Jan 29 19:20:26 pluto kernel: subdisk1: detached >>> Jan 29 19:20:26 pluto kernel: ad1: detached >>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). >>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). >>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). >>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. >>> Jan 29 19:50:13 pluto -- MARK -- >>> >> I have seen similar problems on my graid3. I think it's simply the >> disk which stops responding to commands, or at least ata(4) can't talk >> to the disk anymore... >> >> I see it on: >> >> ad10: 305245MB at ata5-master SATA150 >> ad12: 305245MB at ata6-master SATA150 >> ad14: 305245MB at ata7-master SATA150 >> >> After a reboot everything seems fine again and my RAID is rebuilt. >> >> I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT >> BTW. >> > > It seems that when gmirror/graid3 writes to more than one disk at a > time, this puts too much load on ata channel or something and ata > disconnects the disk. I don't really know how it works exactly, but > maybe some timeout should be increased in the ata code? > My experiences are that even a single disk will timeout; 5 seconds is just not enough for the disk to spinup. Most disks will need 10 seconds at least. In ata-disk.c the timeout is set at 5 seconds. When set at 15 seconds; the ataidle-sleep mode works perfectly. I think this should be patched. Right now ataidle is broken on FreeBSD i would say, without patching the sourcecode at least. For those not being able to wait for an official patch; try this: - edit /usr/src/sys/dev/ata/ata-disk.c - search for "timeout" case-insensitive - you will find: request->timeout = 5; - change the value 5 to 15 - save and execute: cd /usr/src; make kernel KERNCONF=GENERIC - after reboot you can test ataidle and it should work perfectly; with any geom raid layer or as 'single disk' - Veronica From owner-freebsd-geom@FreeBSD.ORG Thu Feb 1 13:55:14 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 74D7B16A408; Thu, 1 Feb 2007 13:55:14 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from mh1.centtech.com (moat3.centtech.com [64.129.166.50]) by mx1.freebsd.org (Postfix) with ESMTP id 27F3F13C471; Thu, 1 Feb 2007 13:55:13 +0000 (UTC) (envelope-from anderson@freebsd.org) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh1.centtech.com (8.13.8/8.13.8) with ESMTP id l11Dt8J5049247; Thu, 1 Feb 2007 07:55:08 -0600 (CST) (envelope-from anderson@freebsd.org) Message-ID: <45C1F13C.2020503@freebsd.org> Date: Thu, 01 Feb 2007 07:55:08 -0600 From: Eric Anderson User-Agent: Thunderbird 1.5.0.9 (X11/20070130) MIME-Version: 1.0 To: Fluffles References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> <20070131201201.GB973@zaphod.nitro.dk> <20070131220004.GC487@garage.freebsd.pl> <45C12274.7030404@fluffles.net> In-Reply-To: <45C12274.7030404@fluffles.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.88.4/2510/Thu Feb 1 03:12:06 2007 on mh1.centtech.com X-Virus-Status: Clean X-Spam-Status: No, score=-2.6 required=8.0 tests=AWL,BAYES_00 autolearn=ham version=3.1.6 X-Spam-Checker-Version: SpamAssassin 3.1.6 (2006-10-03) on mh1.centtech.com Cc: Oliver Fromme , sos@freebsd.org, Pawel Jakub Dawidek , "Simon L. Nielsen" , freebsd-geom@freebsd.org Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Feb 2007 13:55:14 -0000 On 01/31/07 17:12, Fluffles wrote: > Pawel Jakub Dawidek wrote: >> On Wed, Jan 31, 2007 at 09:12:02PM +0100, Simon L. Nielsen wrote: >> >>> On 2007.01.30 09:51:14 +0100, Oliver Fromme wrote: >>> >>> >>>> This is strange. gmirror just detached one of its disks >>>> for no apparent reason. I've built a mirror consisting of >>>> the components ad0 and ad1 (both SATA drives). It has >>>> been running fine. This is RELENG_6 from 2006-12-20. >>>> >>>> Yesterday evening ad1 was detached. There is no other >>>> error message logged on console or in the logs (i.e. no >>>> I/O error such as a bad sector or anything). There was >>>> no particularly high load at that time. In fact, the >>>> machine had been under much higher load before, without >>>> anything bad happening. >>>> >>>> This is from the logs: >>>> >>>> Jan 29 19:10:13 pluto -- MARK -- >>>> Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached >>>> Jan 29 19:20:26 pluto kernel: subdisk1: detached >>>> Jan 29 19:20:26 pluto kernel: ad1: detached >>>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). >>>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). >>>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). >>>> Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. >>>> Jan 29 19:50:13 pluto -- MARK -- >>>> >>> I have seen similar problems on my graid3. I think it's simply the >>> disk which stops responding to commands, or at least ata(4) can't talk >>> to the disk anymore... >>> >>> I see it on: >>> >>> ad10: 305245MB at ata5-master SATA150 >>> ad12: 305245MB at ata6-master SATA150 >>> ad14: 305245MB at ata7-master SATA150 >>> >>> After a reboot everything seems fine again and my RAID is rebuilt. >>> >>> I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT >>> BTW. >>> >> It seems that when gmirror/graid3 writes to more than one disk at a >> time, this puts too much load on ata channel or something and ata >> disconnects the disk. I don't really know how it works exactly, but >> maybe some timeout should be increased in the ata code? >> > > My experiences are that even a single disk will timeout; 5 seconds is > just not enough for the disk to spinup. Most disks will need 10 seconds > at least. > In ata-disk.c the timeout is set at 5 seconds. When set at 15 seconds; > the ataidle-sleep mode works perfectly. I think this should be patched. > Right now ataidle is broken on FreeBSD i would say, without patching the > sourcecode at least. > > For those not being able to wait for an official patch; try this: > - edit /usr/src/sys/dev/ata/ata-disk.c > - search for "timeout" case-insensitive > - you will find: request->timeout = 5; > - change the value 5 to 15 > - save and execute: cd /usr/src; make kernel KERNCONF=GENERIC > - after reboot you can test ataidle and it should work perfectly; with > any geom raid layer or as 'single disk' Is there any reason the sleep and idle pieces of ataidle could not be added to atacontrol? Eric From owner-freebsd-geom@FreeBSD.ORG Thu Feb 1 15:55:08 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1FB9916A400; Thu, 1 Feb 2007 15:55:08 +0000 (UTC) (envelope-from sos@deepcore.dk) Received: from spider.deepcore.dk (cpe.atm2-0-53484.0x50a6c9a6.abnxx9.customer.tele.dk [80.166.201.166]) by mx1.freebsd.org (Postfix) with ESMTP id 9BD0013C4B2; Thu, 1 Feb 2007 15:55:07 +0000 (UTC) (envelope-from sos@deepcore.dk) Received: from [194.192.25.137] (ws.deepcore.dk [194.192.25.137]) by spider.deepcore.dk (8.13.8/8.13.8) with ESMTP id l11FsxiI045277; Thu, 1 Feb 2007 16:54:59 +0100 (CET) (envelope-from sos@deepcore.dk) Message-ID: <45C20D52.20000@deepcore.dk> Date: Thu, 01 Feb 2007 16:54:58 +0100 From: =?ISO-8859-1?Q?S=F8ren_Schmidt?= User-Agent: Thunderbird 1.5.0.9 (Macintosh/20061207) MIME-Version: 1.0 To: Eric Anderson References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> <20070131201201.GB973@zaphod.nitro.dk> <20070131220004.GC487@garage.freebsd.pl> <45C12274.7030404@fluffles.net> <45C1F13C.2020503@freebsd.org> In-Reply-To: <45C1F13C.2020503@freebsd.org> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 8bit Cc: Pawel Jakub Dawidek , Fluffles , "Simon L. Nielsen" , Oliver Fromme , freebsd-geom@FreeBSD.ORG Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Feb 2007 15:55:08 -0000 Eric Anderson wrote: > > Is there any reason the sleep and idle pieces of ataidle could not be > added to atacontrol? > Yes, it is a dirty hack solution until the idle/sleep thing is implemented correctly in the ATA driver framework as just sending the command(s) to the devices doesn't quite cut it without tinkering with the timeouts which leaves fx server users with suboptimal delays on failures. Anyhow I now have a full time disk server here that could save quite some power when doing this, so it just might level up on my TODO list :) -Søren From owner-freebsd-geom@FreeBSD.ORG Thu Feb 1 22:07:01 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.ORG Delivered-To: freebsd-geom@FreeBSD.ORG Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1EAC316A401; Thu, 1 Feb 2007 22:07:01 +0000 (UTC) (envelope-from simon@zaphod.nitro.dk) Received: from mx.nitro.dk (zarniwoop.nitro.dk [83.92.207.38]) by mx1.freebsd.org (Postfix) with ESMTP id C1E9113C4B4; Thu, 1 Feb 2007 22:06:56 +0000 (UTC) (envelope-from simon@zaphod.nitro.dk) Received: from zaphod.nitro.dk (unknown [192.168.3.39]) by mx.nitro.dk (Postfix) with ESMTP id A450C2D4A9E; Thu, 1 Feb 2007 22:06:22 +0000 (UTC) Received: by zaphod.nitro.dk (Postfix, from userid 3000) id 001BD1141D; Thu, 1 Feb 2007 23:06:54 +0100 (CET) Date: Thu, 1 Feb 2007 23:06:54 +0100 From: "Simon L. Nielsen" To: Pawel Jakub Dawidek Message-ID: <20070201220653.GA974@zaphod.nitro.dk> References: <200701300851.l0U8pEkO005250@lurza.secnetix.de> <20070131201201.GB973@zaphod.nitro.dk> <20070131220004.GC487@garage.freebsd.pl> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20070131220004.GC487@garage.freebsd.pl> User-Agent: Mutt/1.5.11 Cc: freebsd-geom@FreeBSD.ORG, Oliver Fromme , sos@FreeBSD.org Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 01 Feb 2007 22:07:01 -0000 On 2007.01.31 23:00:04 +0100, Pawel Jakub Dawidek wrote: > On Wed, Jan 31, 2007 at 09:12:02PM +0100, Simon L. Nielsen wrote: > > On 2007.01.30 09:51:14 +0100, Oliver Fromme wrote: > > [...] > > > Jan 29 19:10:13 pluto -- MARK -- > > > Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached > > > Jan 29 19:20:26 pluto kernel: subdisk1: detached > > > Jan 29 19:20:26 pluto kernel: ad1: detached > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. > > > Jan 29 19:50:13 pluto -- MARK -- > > > > I have seen similar problems on my graid3. I think it's simply the > > disk which stops responding to commands, or at least ata(4) can't talk > > to the disk anymore... > > > > I see it on: > > > > ad10: 305245MB at ata5-master SATA150 > > ad12: 305245MB at ata6-master SATA150 > > ad14: 305245MB at ata7-master SATA150 > > > > After a reboot everything seems fine again and my RAID is rebuilt. > > > > I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT > > BTW. > > It seems that when gmirror/graid3 writes to more than one disk at a > time, this puts too much load on ata channel or something and ata > disconnects the disk. I don't really know how it works exactly, but > maybe some timeout should be increased in the ata code? I mainly see problems when there is high IO load, e.g. if fsck or raid rebuild is running I far more often see problems. I will try to play with timeout values this weekend and see if I can provoke problems. Just for the record, I don't use ataidle or similar to spin my disks down, they should run all the time. -- Simon L. Nielsen From owner-freebsd-geom@FreeBSD.ORG Fri Feb 2 12:29:43 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2DAD316A400; Fri, 2 Feb 2007 12:29:43 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from smtp.utwente.nl (smtp2.utsp.utwente.nl [130.89.2.9]) by mx1.freebsd.org (Postfix) with ESMTP id 9543613C48E; Fri, 2 Feb 2007 12:29:42 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from nox.student.utwente.nl (nox.student.utwente.nl [130.89.165.91]) by smtp.utwente.nl (8.12.10/SuSE Linux 0.7) with ESMTP id l12CBAox012615; Fri, 2 Feb 2007 13:11:15 +0100 From: Pieter de Goeje To: freebsd-current@freebsd.org Date: Fri, 2 Feb 2007 13:11:10 +0100 User-Agent: KMail/1.9.5 References: In-Reply-To: MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_epywF30SSJkq3Nj" Message-Id: <200702021311.10339.pieter@degoeje.nl> X-UTwente-MailScanner-Information: Scanned by MailScanner. Contact helpdesk@ITBE.utwente.nl for more information. X-UTwente-MailScanner: Found to be clean X-UTwente-MailScanner-From: pieter@degoeje.nl X-Spam-Status: No X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: Ivan Voras , freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Feb 2007 12:29:43 -0000 --Boundary-00=_epywF30SSJkq3Nj Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline Hi, I tried the beta3a version from the wiki on an amd64 -CURRENT machine. I made some changes (attached) to g_virstor.c and geom_virstor.c to let them compile cleanly on AMD64. Both files contained instances of some printf variant with format "%u" while the parameter was a size_t, so I changed the format to "%zu". Also, I needed to add -fPIC to the gcc command line to build geom_virstor.so. For some reason, it wasnt able to find "path.h" so I included that one in the search path. After successfully building gvirstor (and loading it), I tried to use it: # ./gvirstor label -s 10000 test /dev/ad0s3b Assertion failed: (G_OPT_TYPE(opt) != 0), function parse_arguments, file /usr/src/sbin/geom/core/geom.c, line 272. Abort (core dumped) Basically I'm stuck here. Regards, Pieter de Goeje PS. How do I download the latest sources from the p4 repository? --Boundary-00=_epywF30SSJkq3Nj-- From owner-freebsd-geom@FreeBSD.ORG Fri Feb 2 13:27:46 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 353F716A409; Fri, 2 Feb 2007 13:27:46 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from lara.cc.fer.hr (lara.cc.fer.hr [161.53.72.113]) by mx1.freebsd.org (Postfix) with ESMTP id B1B3813C4BB; Fri, 2 Feb 2007 13:27:45 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from [127.0.0.1] (localhost.cc.fer.hr [127.0.0.1]) by lara.cc.fer.hr (8.13.8/8.13.8) with ESMTP id l12D4NEX036717; Fri, 2 Feb 2007 14:04:23 +0100 (CET) (envelope-from ivoras@fer.hr) Message-ID: <45C336D7.2060109@fer.hr> Date: Fri, 02 Feb 2007 14:04:23 +0100 From: Ivan Voras User-Agent: Thunderbird 1.5.0.9 (X11/20070110) MIME-Version: 1.0 To: Pieter de Goeje References: <200702021311.10339.pieter@degoeje.nl> In-Reply-To: <200702021311.10339.pieter@degoeje.nl> X-Enigmail-Version: 0.94.0.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit Cc: freebsd-current@freebsd.org, freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Feb 2007 13:27:46 -0000 Pieter de Goeje wrote: > Hi, I tried the beta3a version from the wiki on an amd64 -CURRENT machine. > I made some changes (attached) to g_virstor.c and geom_virstor.c to let them > compile cleanly on AMD64. Both files contained instances of some printf > variant with format "%u" while the parameter was a size_t, so I changed the > format to "%zu". > > Also, I needed to add -fPIC to the gcc command line to build geom_virstor.so. > For some reason, it wasnt able to find "path.h" so I included that one in the > search path. Yes, I forgot to mention this - no testing was done on anything but i386. Thanks for the patches! > After successfully building gvirstor (and loading it), I tried to use it: > # ./gvirstor label -s 10000 test /dev/ad0s3b > Assertion failed: (G_OPT_TYPE(opt) != 0), function parse_arguments, > file /usr/src/sbin/geom/core/geom.c, line 272. > Abort (core dumped) > > Basically I'm stuck here. Interesting. It seems that the geom main() couldn't parse command line arguments. I don't know what to make of it. > Regards, > Pieter de Goeje > > PS. > How do I download the latest sources from the p4 repository? > They are the same as in the tarball. I don't really know if you can access p4 by an anonymous account. From owner-freebsd-geom@FreeBSD.ORG Fri Feb 2 13:31:59 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 0D2F016A401 for ; Fri, 2 Feb 2007 13:31:59 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 5AF3213C49D for ; Fri, 2 Feb 2007 13:31:56 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 27EE148803; Fri, 2 Feb 2007 14:31:53 +0100 (CET) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 5E3C945683; Fri, 2 Feb 2007 14:31:45 +0100 (CET) Date: Fri, 2 Feb 2007 14:30:56 +0100 From: Pawel Jakub Dawidek To: Ivan Voras Message-ID: <20070202133055.GB21290@garage.freebsd.pl> References: <200702021311.10339.pieter@degoeje.nl> <45C336D7.2060109@fer.hr> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="/NkBOFFp2J2Af1nK" Content-Disposition: inline In-Reply-To: <45C336D7.2060109@fer.hr> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: Pieter de Goeje , freebsd-current@freebsd.org, freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Feb 2007 13:31:59 -0000 --/NkBOFFp2J2Af1nK Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Fri, Feb 02, 2007 at 02:04:23PM +0100, Ivan Voras wrote: > Pieter de Goeje wrote: > > Hi, I tried the beta3a version from the wiki on an amd64 -CURRENT machi= ne. > > I made some changes (attached) to g_virstor.c and geom_virstor.c to let= them=20 > > compile cleanly on AMD64. Both files contained instances of some printf= =20 > > variant with format "%u" while the parameter was a size_t, so I changed= the=20 > > format to "%zu". > >=20 > > Also, I needed to add -fPIC to the gcc command line to build geom_virst= or.so.=20 > > For some reason, it wasnt able to find "path.h" so I included that one = in the=20 > > search path. >=20 > Yes, I forgot to mention this - no testing was done on anything but i386. >=20 > Thanks for the patches! >=20 > > After successfully building gvirstor (and loading it), I tried to use i= t: > > # ./gvirstor label -s 10000 test /dev/ad0s3b > > Assertion failed: (G_OPT_TYPE(opt) !=3D 0), function parse_arguments,= =20 > > file /usr/src/sbin/geom/core/geom.c, line 272. > > Abort (core dumped) > >=20 > > Basically I'm stuck here. >=20 > Interesting. It seems that the geom main() couldn't parse command line > arguments. I don't know what to make of it. The API for geom(8) command have changed at some point. Where you used G_TYPE_NONE, you should now use G_TYPE_BOOL. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --/NkBOFFp2J2Af1nK Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFFwz0PForvXbEpPzQRAkQgAKCOuqN9+pHrkkDTXMNZLZ5yR/wcZgCdGchk E1y5L02HLJi4smEHVltN67Q= =1UQ7 -----END PGP SIGNATURE----- --/NkBOFFp2J2Af1nK-- From owner-freebsd-geom@FreeBSD.ORG Fri Feb 2 20:20:00 2007 Return-Path: X-Original-To: freebsd-geom@FreeBSD.org Delivered-To: freebsd-geom@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id B258B16A407; Fri, 2 Feb 2007 20:20:00 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (lurza.secnetix.de [83.120.8.8]) by mx1.freebsd.org (Postfix) with ESMTP id 24B3E13C467; Fri, 2 Feb 2007 20:19:59 +0000 (UTC) (envelope-from olli@lurza.secnetix.de) Received: from lurza.secnetix.de (ividqf@localhost [127.0.0.1]) by lurza.secnetix.de (8.13.4/8.13.4) with ESMTP id l12KJqPZ018233; Fri, 2 Feb 2007 21:19:57 +0100 (CET) (envelope-from oliver.fromme@secnetix.de) Received: (from olli@localhost) by lurza.secnetix.de (8.13.4/8.13.1/Submit) id l12KJpcD018232; Fri, 2 Feb 2007 21:19:51 +0100 (CET) (envelope-from olli) From: Oliver Fromme Message-Id: <200702022019.l12KJpcD018232@lurza.secnetix.de> To: etc@fluffles.net (Fluffles) Date: Fri, 2 Feb 2007 21:19:51 +0100 (CET) In-Reply-To: <45C12274.7030404@fluffles.net> X-Mailer: ELM [version 2.5 PL8] MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-2.1.2 (lurza.secnetix.de [127.0.0.1]); Fri, 02 Feb 2007 21:19:57 +0100 (CET) Cc: freebsd-geom@FreeBSD.org, Pawel Jakub Dawidek , "Simon L. Nielsen" , sos@FreeBSD.org Subject: Re: gmirror or ata problem X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 02 Feb 2007 20:20:00 -0000 Fluffles wrote: > Pawel Jakub Dawidek wrote: > > Simon L. Nielsen wrote: > > > Oliver Fromme wrote: > > > > This is strange. gmirror just detached one of its disks > > > > for no apparent reason. I've built a mirror consisting of > > > > the components ad0 and ad1 (both SATA drives). It has > > > > been running fine. This is RELENG_6 from 2006-12-20. > > > > > > > > Yesterday evening ad1 was detached. There is no other > > > > error message logged on console or in the logs (i.e. no > > > > I/O error such as a bad sector or anything). There was > > > > no particularly high load at that time. In fact, the > > > > machine had been under much higher load before, without > > > > anything bad happening. > > > > > > > > This is from the logs: > > > > > > > > Jan 29 19:10:13 pluto -- MARK -- > > > > Jan 29 19:20:26 pluto kernel: ad1: FAILURE - device detached > > > > Jan 29 19:20:26 pluto kernel: subdisk1: detached > > > > Jan 29 19:20:26 pluto kernel: ad1: detached > > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot write metadata on ad1 (device=gm0, error=6). > > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Cannot update metadata on disk ad1 (error=6). > > > > Jan 29 19:20:26 pluto kernel: GEOM_MIRROR: Device gm0: provider ad1 disconnected. > > > > Jan 29 19:50:13 pluto -- MARK -- > > > > > > > I have seen similar problems on my graid3. I think it's simply the > > > disk which stops responding to commands, or at least ata(4) can't talk > > > to the disk anymore... > > > > > > I see it on: > > > > > > ad10: 305245MB at ata5-master SATA150 > > > ad12: 305245MB at ata6-master SATA150 > > > ad14: 305245MB at ata7-master SATA150 > > > > > > After a reboot everything seems fine again and my RAID is rebuilt. > > > > > > I don't know why it happens, but it sucks :-/. I'm running 7-CURRENT > > > BTW. > > > > It seems that when gmirror/graid3 writes to more than one disk at a > > time, this puts too much load on ata channel or something and ata > > disconnects the disk. I don't really know how it works exactly, but > > maybe some timeout should be increased in the ata code? > > My experiences are that even a single disk will timeout; 5 seconds is > just not enough for the disk to spinup. Most disks will need 10 seconds > at least. In my case it has nothing to do with spin up / spin down. I do not use ataidle, and the disks are running all the time. They don't have to spin up. So it must be something else causing the problems. Best regards Oliver -- Oliver Fromme, secnetix GmbH & Co. KG, Marktplatz 29, 85567 Grafing b. M. Handelsregister: Registergericht Muenchen, HRA 74606, USt-Id: DE204219783 Any opinions expressed in this message are personal to the author and may not necessarily reflect the opinions of secnetix GmbH & Co KG in any way. FreeBSD-Dienstleistungen, -Produkte und mehr: http://www.secnetix.de/bsd "C++ is over-complicated nonsense. And Bjorn Shoestrap's book a danger to public health. I tried reading it once, I was in recovery for months." -- Cliff Sarginson From owner-freebsd-geom@FreeBSD.ORG Sat Feb 3 11:39:03 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 2240216A403; Sat, 3 Feb 2007 11:39:03 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from smtp.utwente.nl (smtp1.utsp.utwente.nl [130.89.2.8]) by mx1.freebsd.org (Postfix) with ESMTP id 9AB4913C4A8; Sat, 3 Feb 2007 11:39:02 +0000 (UTC) (envelope-from pieter@degoeje.nl) Received: from nox.student.utwente.nl (nox.student.utwente.nl [130.89.165.91]) by smtp.utwente.nl (8.12.10/SuSE Linux 0.7) with ESMTP id l13BcrLr019859; Sat, 3 Feb 2007 12:38:53 +0100 From: Pieter de Goeje To: Pawel Jakub Dawidek Date: Sat, 3 Feb 2007 12:38:52 +0100 User-Agent: KMail/1.9.5 References: <45C336D7.2060109@fer.hr> <20070202133055.GB21290@garage.freebsd.pl> In-Reply-To: <20070202133055.GB21290@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: Multipart/Mixed; boundary="Boundary-00=_MRHxFtMRijoJiS8" Message-Id: <200702031238.52771.pieter@degoeje.nl> X-UTwente-MailScanner-Information: Scanned by MailScanner. Contact helpdesk@ITBE.utwente.nl for more information. X-UTwente-MailScanner: Found to be clean X-UTwente-MailScanner-From: pieter@degoeje.nl X-Spam-Status: No X-Content-Filtered-By: Mailman/MimeDel 2.1.5 Cc: freebsd-current@freebsd.org, Ivan Voras , freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Feb 2007 11:39:03 -0000 --Boundary-00=_MRHxFtMRijoJiS8 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: 7bit Content-Disposition: inline On Friday 02 February 2007 14:30, Pawel Jakub Dawidek wrote: > The API for geom(8) command have changed at some point. Where you used > G_TYPE_NONE, you should now use G_TYPE_BOOL. Ok, with this little change it worked. (patch attached) I created a 10GB virtual storage on two 2GB partitions. Copying around the freebsd source tree on it worked great and performance was as expected. Also as expected it issued a warning when starting to use the second component. However, when I tried to overflow the filesystem, it went wrong: GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test g_vfs_done():virstor/test[WRITE(offset=101842944, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=101974016, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102105088, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102236160, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102367232, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102498304, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102760448, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=102891520, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=103022592, length=131072)]error = 28 GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test GEOM_VIRSTOR[1]: All physical space allocated for test GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test g_vfs_done():virstor/test[WRITE(offset=103153664, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=103284736, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=103415808, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=103546880, length=131072)]error = 28 g_vfs_done():virstor/test[WRITE(offset=103677952, length=131072)]error = 28 It spitted out these messages in a tight loop (100% sys load). I was unable to recover the system from this situation. Steps I did to recreate this situation: # gvirstor label -s 10000 test /dev/ad0s3b /dev/ad1s1b (total physical storage is 4GB) # newfs -U /dev/virstor/test # mount /dev/virstor/test /mnt # dd if=/dev/zero of=/mnt/testfile bs=64k Also, no warning was issued when it aproached 0% free physical space. I would expect the system to simply abort the write operation (possibly needing a background fsck after adding another component to make more space). Regards, Pieter de Goeje --Boundary-00=_MRHxFtMRijoJiS8-- From owner-freebsd-geom@FreeBSD.ORG Sat Feb 3 12:35:09 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 8491F16A405; Sat, 3 Feb 2007 12:35:09 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls405.t-com.hr (ls405.t-com.hr [195.29.150.135]) by mx1.freebsd.org (Postfix) with ESMTP id 0867B13C481; Sat, 3 Feb 2007 12:35:08 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls248.t-com.hr (ls248.t-com.hr [195.29.150.237]) by ls405.t-com.hr (Postfix) with ESMTP id 4E517144449; Sat, 3 Feb 2007 13:35:06 +0100 (CET) Received: from ls248.t-com.hr (localhost.localdomain [127.0.0.1]) by ls248.t-com.hr (Qmlai) with ESMTP id 317905D82A8; Sat, 3 Feb 2007 13:35:06 +0100 (CET) Received: from ls248.t-com.hr (localhost.localdomain [127.0.0.1]) by ls248.t-com.hr (Qmlai) with ESMTP id 0B50C5D827E; Sat, 3 Feb 2007 13:35:05 +0100 (CET) X-Envelope-Sender-Info: PPNxY8En3dcmVUp3NnTfFz0sO21BKZWqwM/sq9n6Fs5AdcXuvHY/9pt47skoogJP X-Envelope-Sender: ivoras@fer.hr Received: from [10.0.0.101] (89-172-45-56.adsl.net.t-com.hr [89.172.45.56]) by ls248.t-com.hr (Qmali) with ESMTP id 74E1D2007B; Sat, 3 Feb 2007 13:35:03 +0100 (CET) Message-ID: <45C48175.5060704@fer.hr> Date: Sat, 03 Feb 2007 13:35:01 +0100 From: Ivan Voras User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: Pieter de Goeje References: <45C336D7.2060109@fer.hr> <20070202133055.GB21290@garage.freebsd.pl> <200702031238.52771.pieter@degoeje.nl> In-Reply-To: <200702031238.52771.pieter@degoeje.nl> X-Enigmail-Version: 0.94.1.2 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8C7E44CD954588796B742E31" Cc: freebsd-current@freebsd.org, Pawel Jakub Dawidek , freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Feb 2007 12:35:09 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8C7E44CD954588796B742E31 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Pieter de Goeje wrote: > GEOM_VIRSTOR[1]: All physical space allocated for test > GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test > g_vfs_done():virstor/test[WRITE(offset=3D103153664, length=3D131072)]er= ror =3D 28 > It spitted out these messages in a tight loop (100% sys load). I was un= able to=20 Yes, it turns out the file system gets confused if the device reports a certain size and then returns ENOSPC (error 28) when it shouldn't. Unfortunately, yanking the device from under the file system would panic the kernel. Returning EIO could either panic it or "just" end up with a corrupted file system. Any ideas from the more VFS-savvy? The "tight loop" seems to be VFS retrying, inserting the requests to GEOM layer over and over... > Also, no warning was issued when it aproached 0% free physical space. > I would expect the system to simply abort the write operation (possibly= =20 > needing a background fsck after adding another component to make more s= pace). It should - are you sure the message didn't get lost/overflown in the log= ? --------------enig8C7E44CD954588796B742E31 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFFxIF1ldnAQVacBcgRAkBWAJ4ya8upiFMd5Np+y5l6Gk6YSp9HkQCeI0qT 4JO8juuu/dfD5WTjEEJsGNg= =7B2D -----END PGP SIGNATURE----- --------------enig8C7E44CD954588796B742E31-- From owner-freebsd-geom@FreeBSD.ORG Sat Feb 3 13:18:43 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 67F9F16A501; Sat, 3 Feb 2007 13:18:43 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.freebsd.org (Postfix) with ESMTP id 55D0C13C4A3; Sat, 3 Feb 2007 13:18:42 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id AD5C648806; Sat, 3 Feb 2007 14:18:39 +0100 (CET) Received: from localhost (154.81.datacomsa.pl [195.34.81.154]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 3BD5048802; Sat, 3 Feb 2007 14:18:33 +0100 (CET) Date: Sat, 3 Feb 2007 14:17:43 +0100 From: Pawel Jakub Dawidek To: Ivan Voras Message-ID: <20070203131743.GC64874@garage.freebsd.pl> References: <45C336D7.2060109@fer.hr> <20070202133055.GB21290@garage.freebsd.pl> <200702031238.52771.pieter@degoeje.nl> <45C48175.5060704@fer.hr> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="rQ2U398070+RC21q" Content-Disposition: inline In-Reply-To: <45C48175.5060704@fer.hr> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=BAYES_00 autolearn=ham version=3.0.4 Cc: Pieter de Goeje , freebsd-current@freebsd.org, freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Feb 2007 13:18:43 -0000 --rQ2U398070+RC21q Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sat, Feb 03, 2007 at 01:35:01PM +0100, Ivan Voras wrote: > Pieter de Goeje wrote: >=20 > > GEOM_VIRSTOR[1]: All physical space allocated for test > > GEOM_VIRSTOR[5]: Failed to allocate physical chunk for virstor/test > > g_vfs_done():virstor/test[WRITE(offset=3D103153664, length=3D131072)]er= ror =3D 28 >=20 > > It spitted out these messages in a tight loop (100% sys load). I was un= able to=20 >=20 > Yes, it turns out the file system gets confused if the device reports a > certain size and then returns ENOSPC (error 28) when it shouldn't. > Unfortunately, yanking the device from under the file system would panic > the kernel. Returning EIO could either panic it or "just" end up with a > corrupted file system. Any ideas from the more VFS-savvy? >=20 > The "tight loop" seems to be VFS retrying, inserting the requests to > GEOM layer over and over... I don't think so. ENOSPC should be just returned to the application. What was pasted seems to confirm my thinking: g_vfs_done():virstor/test[WRITE(offset=3D101842944, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D101974016, length=3D131072)]error = =3D 28 =20 g_vfs_done():virstor/test[WRITE(offset=3D102105088, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D102236160, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D102367232, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D102498304, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D102760448, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D102891520, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103022592, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103153664, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103284736, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103415808, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103546880, length=3D131072)]error = =3D 28 g_vfs_done():virstor/test[WRITE(offset=3D103677952, length=3D131072)]error = =3D 28 As you can see the offset increases, so this is not the same I/O request. I'd suggest turning off gvirstor debugging and retry. We should probably also rate-limit errors from g_vfs_done(). --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --rQ2U398070+RC21q Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFFxIt3ForvXbEpPzQRAq9fAJ0RoJieB0/Nw7IKLZy5m4dR3EngtACgr5du AgHzJiDWRCU0FEV5hzA1tD8= =43XW -----END PGP SIGNATURE----- --rQ2U398070+RC21q-- From owner-freebsd-geom@FreeBSD.ORG Sat Feb 3 18:28:07 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 1E51816A400 for ; Sat, 3 Feb 2007 18:28:07 +0000 (UTC) (envelope-from bashr@comcast.net) Received: from alnrmhc13.comcast.net (alnrmhc13.comcast.net [206.18.177.53]) by mx1.freebsd.org (Postfix) with ESMTP id EA80913C4B5 for ; Sat, 3 Feb 2007 18:28:06 +0000 (UTC) (envelope-from bashr@comcast.net) Received: from [149.28.227.65] (unknown[149.28.227.65]) by comcast.net (alnrmhc13) with ESMTP id <20070203182806b1300cup7me>; Sat, 3 Feb 2007 18:28:06 +0000 Message-ID: <45C4D435.4050307@comcast.net> Date: Sat, 03 Feb 2007 13:28:05 -0500 From: bashr User-Agent: Thunderbird 1.5.0.9 (X11/20061228) MIME-Version: 1.0 To: Fluffles References: <20070113004728.GQ2616@obiwan.tataz.chchile.org> <45A85F40.7050703@centtech.com> <45A8B722.7020302@fluffles.net> <45B0EAA7.7020609@comcast.net> <45B169AB.3070103@fluffles.net> In-Reply-To: <45B169AB.3070103@fluffles.net> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: What is gstripe ? -- benchmarks X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list Reply-To: bashr@comcast.net List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Feb 2007 18:28:07 -0000 Fluffles wrote: > > Overall i sugest using a stripesize of 128KB of bigger. This way you can > be sure that a single I/O request (maximum of 128KB on FreeBSD; MAXPHYS) > will 'fit' into one stripeblock and thus can be handled by one disk in > the RAID array. If you use 64KB stripesize and you read 65KB or 100KB, > two physical disks must be used to handle the request; this will degrade > performance. > > Misalignment, often caused by using default partitioning, can also > degrade performance. To counteract this, use manual disklabeling with > the same offset (or multiple) as the stripesize, use Dangerously > Dedicated mode, or simply select a stripesize of 256KB or even bigger. > Thank you, that is very helpful. Here is what happened: A gmirror volume, gm0s2, consisted of two gstripe volumes, st0s1 and st1s1. The stripe st0s1 consisted of ad6s3 and ad8s3 while st1s1 consisted of ad2s3 and ad4s3. Disk ad2 is UDMA133. The others are SATA150. Both stripes were configure with a stripe size of 4k and an offset of 16. I took st1s1 out of the gmirror and reconfigured it with an offset and stripesize of 131072. Then ran iozone for file and record sizes up to 32M to compare st0s1 and st1s1. The numbers below are the ratios of the throughput for 128k stripe size to throughput for 4k stripesize. Writing 64k files with 4k records: 1.08 16M w/ 4k: 3.22 32M w/ 16M: 3.72 Reading 64k files 4k records: 1.02 16M w/ 4k: 1.03 32M w/ 16M: 1.01 Then I reconfigured st0s1 with 128k offset and stripesize as well, and put both gstripe volumes in a gmirror. The numbers below are the ratios of throughput for the mirrored gstripe volumes to the throughput for unmirrored -- both with 128k offset and stripesize. Writing 64k files with 4k records: 0.98 16M w/ 4k: 0.55 32M w/ 16M: 0.5 Reading 64k files with 4k records: 0.97 16M w/ 4k: 1.01 32M w/ 16M: 1.07 From owner-freebsd-geom@FreeBSD.ORG Sat Feb 3 18:43:50 2007 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 51A0316A402; Sat, 3 Feb 2007 18:43:50 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls405.t-com.hr (ls405.t-com.hr [195.29.150.135]) by mx1.freebsd.org (Postfix) with ESMTP id C334F13C442; Sat, 3 Feb 2007 18:43:49 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from ls248.t-com.hr (ls248.t-com.hr [195.29.150.237]) by ls405.t-com.hr (Postfix) with ESMTP id 1D28C144DBD; Sat, 3 Feb 2007 19:43:48 +0100 (CET) Received: from ls248.t-com.hr (localhost.localdomain [127.0.0.1]) by ls248.t-com.hr (Qmlai) with ESMTP id EB51C5D82AE; Sat, 3 Feb 2007 19:43:47 +0100 (CET) Received: from ls248.t-com.hr (localhost.localdomain [127.0.0.1]) by ls248.t-com.hr (Qmlai) with ESMTP id C06C35D827E; Sat, 3 Feb 2007 19:43:47 +0100 (CET) X-Envelope-Sender-Info: PPNxY8En3dcmVUp3NnTfFz0sO21BKZWqwM/sq9n6Fs5AdcXuvHY/9pt47skoogJP X-Envelope-Sender: ivoras@fer.hr Received: from [10.0.0.101] (89-172-45-56.adsl.net.t-com.hr [89.172.45.56]) by ls248.t-com.hr (Qmali) with ESMTP id E57472007B; Sat, 3 Feb 2007 19:43:42 +0100 (CET) Message-ID: <45C4D7DD.2010801@fer.hr> Date: Sat, 03 Feb 2007 19:43:41 +0100 From: Ivan Voras User-Agent: Thunderbird 1.5.0.9 (Windows/20061207) MIME-Version: 1.0 To: Pieter de Goeje References: <45C336D7.2060109@fer.hr> <20070202133055.GB21290@garage.freebsd.pl> <200702031238.52771.pieter@degoeje.nl> In-Reply-To: <200702031238.52771.pieter@degoeje.nl> X-Enigmail-Version: 0.94.1.2 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig8045F4DF6A5797AE154B1854" Cc: freebsd-current@freebsd.org, Pawel Jakub Dawidek , freebsd-geom@freebsd.org Subject: Re: First steps towards importing gvirstor into -current X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 03 Feb 2007 18:43:50 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig8045F4DF6A5797AE154B1854 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Pieter de Goeje wrote: > On Friday 02 February 2007 14:30, Pawel Jakub Dawidek wrote: >> The API for geom(8) command have changed at some point. Where you used= >> G_TYPE_NONE, you should now use G_TYPE_BOOL. > Ok, with this little change it worked. (patch attached) I've made the discussed changes and added support for BIO_DELETE. New version is available from the usual places (p4 and http://wiki.freebsd.org/gvirstor). I can't get to a machine with 7-CURRENT at least until monday but this should work ok. (The ENOSPC problem is still not touched.) --------------enig8045F4DF6A5797AE154B1854 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.4 (MingW32) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org iD8DBQFFxNfdldnAQVacBcgRAmkzAJ0T3Cb0MtlM8HctBoRtE1QSqAkOmgCgtuax GOnoK+siqzUS544jkI0YRRQ= =4D7Z -----END PGP SIGNATURE----- --------------enig8045F4DF6A5797AE154B1854--