From owner-freebsd-geom@FreeBSD.ORG Mon Jun 26 11:02:55 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6601616A4CA for ; Mon, 26 Jun 2006 11:02:55 +0000 (UTC) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (freefall.freebsd.org [216.136.204.21]) by mx1.FreeBSD.org (Postfix) with ESMTP id AB12743D5F for ; Mon, 26 Jun 2006 11:02:49 +0000 (GMT) (envelope-from owner-bugmaster@freebsd.org) Received: from freefall.freebsd.org (peter@localhost [127.0.0.1]) by freefall.freebsd.org (8.13.4/8.13.4) with ESMTP id k5QB2nEE042361 for ; Mon, 26 Jun 2006 11:02:49 GMT (envelope-from owner-bugmaster@freebsd.org) Received: (from peter@localhost) by freefall.freebsd.org (8.13.4/8.13.4/Submit) id k5QB2mQA042357 for freebsd-geom@freebsd.org; Mon, 26 Jun 2006 11:02:48 GMT (envelope-from owner-bugmaster@freebsd.org) Date: Mon, 26 Jun 2006 11:02:48 GMT Message-Id: <200606261102.k5QB2mQA042357@freefall.freebsd.org> X-Authentication-Warning: freefall.freebsd.org: peter set sender to owner-bugmaster@freebsd.org using -f From: FreeBSD bugmaster To: freebsd-geom@FreeBSD.org Cc: Subject: Current problem reports assigned to you X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 26 Jun 2006 11:02:55 -0000 Current FreeBSD problem reports Critical problems Serious problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/01/21] kern/76538 geom [gbde] nfs-write on gbde partition stalls o [2005/08/04] kern/84556 geom [geom] GBDE-encrypted swap causes panic a o [2005/10/16] kern/87544 geom [gbde] mmaping large files on a gbde file o [2005/11/16] kern/89102 geom [geom_vfs] [panic] panic when forced unmo o [2005/12/08] bin/90093 geom fdisk(8) incapable of altering in-core ge o [2005/12/18] kern/90582 geom [geom_mirror] [panic] Restore cause panic o [2006/04/15] kern/95771 geom [geom] geom mirror provider destroyed (ma o [2006/05/27] kern/98034 geom [geom] dereference of NULL pointer in acd o [2006/05/29] kern/98093 geom [geli] Detaching gmirror/geli leads to pa o [2006/06/09] kern/98742 geom [geli] IO errors while using geli o [2006/06/21] kern/99256 geom [geli] kernel panic/freeze with geli and 11 problems total. Non-critical problems S Submitted Tracker Resp. Description ------------------------------------------------------------------------------- o [2005/02/26] bin/78131 geom gbde "destroy" not working. o [2005/03/26] kern/79251 geom [2TB] newfs fails on 2.6TB gbde device o [2006/03/18] kern/94632 geom [geom] Kernel output resets input while G o [2006/06/05] kern/98538 geom [geom] Kernel panic on ggate destroy 4 problems total. From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 08:25:55 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8244316A410 for ; Tue, 27 Jun 2006 08:25:55 +0000 (UTC) (envelope-from jhitt25@charter.net) Received: from mxsf38.cluster1.charter.net (mxsf38.cluster1.charter.net [209.225.28.165]) by mx1.FreeBSD.org (Postfix) with ESMTP id 8CD55441A8 for ; Tue, 27 Jun 2006 03:55:20 +0000 (GMT) (envelope-from jhitt25@charter.net) Received: from mxip07a.cluster1.charter.net (mxip07a.cluster1.charter.net [209.225.28.137]) by mxsf38.cluster1.charter.net (8.12.11/8.12.11) with ESMTP id k5R3tIVH016757 for ; Mon, 26 Jun 2006 23:55:19 -0400 Received: from 71-81-201-206.dhcp.stls.mo.charter.com (HELO [192.168.4.101]) ([71.81.201.206]) by mxip07a.cluster1.charter.net with ESMTP; 26 Jun 2006 23:55:19 -0400 X-IronPort-AV: i="4.06,178,1149480000"; d="scan'208"; a="334060209:sNHT21078064" Message-ID: <44A0AC24.1070106@charter.net> Date: Mon, 26 Jun 2006 22:55:16 -0500 From: Jason Hitt User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 08:25:55 -0000 I'm running into a big problem with a new 4 disk array im attempting to configure. I'm using an SIIG 3114 PCI SATA controller with four WD3200SD 320 gig disks attached to it. This is only going to be bulk storage, not a system disk. The disks appear in the system as ad{4,6,8,10}. My test is to configure my geom provider and then dump/restore a 100 gig mount from a separate provider. Setup: apply "dd if=/dev/zero of=/dev/%1 bs=512 count=79" ad4 ad6 ad8 ad10 apply "fdisk -v -B -I /dev/%1" ad4 ad6 ad8 ad10 I then go back in with "fdisk -v -f- -i /dev/ad?" and reduce the size of the slices by 1 so the consumers will be ad?s1, not ad?. From this point i can successully use gmirror to mirror 2 disks and run my test, or i can use gstripe to stripe 2 disks and run my test (presumably a stripe across all 4 would work as well, but this is untested). The failure comes when i do this: gmirror label storage0 ad4s1 ad6s1 gmirror label storage1 ad8s1 ad10s1 gstripe label storage mirror/storage0 mirror/storage1 newfs /dev/stripe/storage At this point i mount /dev/stripe/storage and attempt to copy data to it using dump/restore (a large cp suffices as well). After a random amount of time (typically < 60 seconds), the system will completely hang. There is no panic, there is no crash. The system is completely hung. With no crash dump or panic, it's quite difficult to pinpoint the problem. I also cannot find any solid resources to use as a "how-to" for a geom raid10 setup, so i'm not sure if im approaching it correctlly or not. Anyone familiar with this that can lend a hand? Jason Hitt From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 08:59:37 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CF01D16A405 for ; Tue, 27 Jun 2006 08:59:37 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30301.mail.mud.yahoo.com (web30301.mail.mud.yahoo.com [68.142.200.94]) by mx1.FreeBSD.org (Postfix) with SMTP id ECD6043D55 for ; Tue, 27 Jun 2006 08:59:35 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 52840 invoked by uid 60001); 27 Jun 2006 08:59:35 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=OSo4ow1w9t+r0fFxfivHF0MOJ0oBTspdBPlgRE8L9xDQwb0kl2p5sKepnf5M20M56tUcd6wJuTBzJpwa3dmFN7oDx5WYx7sJ86p/hhnehypQiM4dYJrtC1xZwiX5POSmv4VA3oV1UcQCnLEvlLMb5buJClV47qsybTlQhVfTJoM= ; Message-ID: <20060627085935.52838.qmail@web30301.mail.mud.yahoo.com> Received: from [213.54.88.121] by web30301.mail.mud.yahoo.com via HTTP; Tue, 27 Jun 2006 01:59:35 PDT Date: Tue, 27 Jun 2006 01:59:35 -0700 (PDT) From: "R. B. Riddick" To: Jason Hitt , freebsd-geom@freebsd.org In-Reply-To: <44A0AC24.1070106@charter.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 08:59:37 -0000 --- Jason Hitt wrote: > untested). The failure comes when i do this: > gmirror label storage0 ad4s1 ad6s1 > gmirror label storage1 ad8s1 ad10s1 > gstripe label storage mirror/storage0 mirror/storage1 > newfs /dev/stripe/storage > > Anyone familiar with this that can lend a hand? > I did the following first, because ur report frightend me... :-) I would say, that it worked fine... For several minutes, that I started another test. faako# kldload geom_mirror faako# kldload geom_stripe faako# cd /tmp/ faako# dd if=/dev/zero of=a bs=1m count=8 8+0 records in 8+0 records out 8388608 bytes transferred in 4.021925 secs (2085720 bytes/sec) faako# cp a b faako# cp b c faako# cp c d faako# mdconfig -a -f a md0 faako# mdconfig -a -f b md1 faako# mdconfig -a -f c md2 faako# mdconfig -a -f d md3 faako# gstripe label fook md0 md1 faako# gstripe label fuuk md2 md3 faako# gmirror label fuok stripe/fook stripe/fuuk faako# ls /dev/mirror/ fuok faako# newfs /dev/mirror/fuok /dev/mirror/fuok: 16.0MB (32748 sectors) block size 16384, fragment size 2048 using 4 cylinder groups of 4.00MB, 256 blks, 512 inodes. super-block backups (for fsck -b #) at: date 160, 8352, 16544, 24736 faako# date Tue Jun 27 09:39:18 UTC 2006 faako# sleep 100 ; date mount /dev/mirror/fuok /mnt Tue Jun 27 09:41:07 UTC 2006 faako# mount /dev/mirror/fuok /mnt faako# dp /dev/zero /mnt/faak dp: Command not found. faako# cp /dev/zero /mnt/faak /mnt: write failed, filesystem is full cp: /mnt/faak: No space left on device faako# date Tue Jun 27 09:46:38 UTC 2006 faako# TEST #2: This test's results were ok, too: faako# gmirror label fook md0 md1 faako# gmirror label fuuk md2 md3 faako# gstripe label fouk mirror/fook mirror fuuk faako# gstripe status faako# gstripe label fouk mirror/fook mirror/fuuk faako# date Tue Jun 27 09:49:04 UTC 2006 faako# sleep 100 ; date Tue Jun 27 09:50:47 UTC 2006 faako# newfs /dev/stripe/fouk /dev/stripe/fouk: 16.0MB (32752 sectors) block size 16384, fragment size 2048 using 4 cylinder groups of 4.00MB, 256 blks, 512 inodes. super-block backups (for fsck -b #) at: 160, 8352, 16544, 24736 faako# mount /dev/stripe/fouk /mnt faako# cp /dev/zero /mnt/faak ^C faako# sync faako# df Filesystem 1K-blocks Used Avail Capacity Mounted on /dev/ad0s2a 546094 283492 218916 56% / devfs 1 1 0 100% /dev /dev/stripe/fouk 15654 2708 11694 19% /mnt faako# Maybe it is your hard disc driver, who becomes upset, when the traffic increases? Did you try four simultaneos dd processes to all four discs? -Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 11:41:35 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 2DADA16A59D for ; Tue, 27 Jun 2006 11:41:35 +0000 (UTC) (envelope-from jhitt25@charter.net) Received: from mxsf24.cluster1.charter.net (mxsf24.cluster1.charter.net [209.225.28.224]) by mx1.FreeBSD.org (Postfix) with ESMTP id CDCF843D70 for ; Tue, 27 Jun 2006 11:41:17 +0000 (GMT) (envelope-from jhitt25@charter.net) Received: from mxip35a.cluster1.charter.net (mxip35a.cluster1.charter.net [209.225.28.250]) by mxsf24.cluster1.charter.net (8.12.11/8.12.11) with ESMTP id k5RBfFr7010683 for ; Tue, 27 Jun 2006 07:41:16 -0400 Received: from 71-81-201-206.dhcp.stls.mo.charter.com (HELO [192.168.4.101]) ([71.81.201.206]) by mxip35a.cluster1.charter.net with ESMTP; 27 Jun 2006 07:41:16 -0400 Message-ID: <44A1195A.20204@charter.net> Date: Tue, 27 Jun 2006 06:41:14 -0500 From: Jason Hitt User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: "R. B. Riddick" References: <20060627085935.52838.qmail@web30301.mail.mud.yahoo.com> In-Reply-To: <20060627085935.52838.qmail@web30301.mail.mud.yahoo.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 11:41:35 -0000 R. B. Riddick wrote: > --- Jason Hitt wrote: > >> untested). The failure comes when i do this: >> gmirror label storage0 ad4s1 ad6s1 >> gmirror label storage1 ad8s1 ad10s1 >> gstripe label storage mirror/storage0 mirror/storage1 >> newfs /dev/stripe/storage >> >> Anyone familiar with this that can lend a hand? >> >> > > Maybe it is your hard disc driver, who becomes upset, when the traffic > increases? > Did you try four simultaneos dd processes to all four discs? > > -Arne > Another of my tests involved creating a 2 disk mirror and a 2 disk stripe, copying 100 gigs of data to the mirror, then copying from there to the stripe. This test was successful as well. A bit more info on the system that i realize i left out: These tests have been run on 6.1-RELEASE and 6.1-STABLE (which is what im currently running), updated as of June 25th). The hardware is an AsRock K7VT4A Pro motherboard with an Athlon XP Mobile 1900+. 512 megs of ddr ram, only add-on cards are the SIIG card i mentioned previously and an old AGP video card. Jason From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 11:50:30 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 4D08216A4CC for ; Tue, 27 Jun 2006 11:50:30 +0000 (UTC) (envelope-from arne_woerner@yahoo.com) Received: from web30302.mail.mud.yahoo.com (web30302.mail.mud.yahoo.com [68.142.200.95]) by mx1.FreeBSD.org (Postfix) with SMTP id 1578A43D78 for ; Tue, 27 Jun 2006 11:50:28 +0000 (GMT) (envelope-from arne_woerner@yahoo.com) Received: (qmail 37994 invoked by uid 60001); 27 Jun 2006 11:50:27 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com; h=Message-ID:Received:Date:From:Subject:To:Cc:In-Reply-To:MIME-Version:Content-Type:Content-Transfer-Encoding; b=KEArnQhZZs/IXyxCJn5uWRWLCA1LbHY0LaHYyCzBaiyV9IZ8DPtvHhl5TMs8EV5h5iaYYWfnyzAe5xzdYRtbpoVZnu2JhHUYsN8RWNho680qb1DyBKZZ9zUqnnpQLgUXBKoPnghv32dd79xSZvtPv4BgjzDmC5VsoxeosEEZMZI= ; Message-ID: <20060627115027.37992.qmail@web30302.mail.mud.yahoo.com> Received: from [213.54.88.121] by web30302.mail.mud.yahoo.com via HTTP; Tue, 27 Jun 2006 04:50:27 PDT Date: Tue, 27 Jun 2006 04:50:27 -0700 (PDT) From: "R. B. Riddick" To: Jason Hitt In-Reply-To: <44A1195A.20204@charter.net> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Transfer-Encoding: 8bit Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 11:50:30 -0000 --- Jason Hitt wrote: > untested). The failure comes when i do this: > gmirror label storage0 ad4s1 ad6s1 > gmirror label storage1 ad8s1 ad10s1 > gstripe label storage mirror/storage0 mirror/storage1 > newfs /dev/stripe/storage > I just saw something else: Why do u use that s1 thing and not just ad4? I mean: fdisk -I covers nearly the whole disc anyway... -Arne __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 12:22:57 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6EC9416A400 for ; Tue, 27 Jun 2006 12:22:57 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 71F0C43D78 for ; Tue, 27 Jun 2006 12:22:47 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id CD99D51339; Tue, 27 Jun 2006 14:22:45 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 0B10751845; Tue, 27 Jun 2006 14:22:41 +0200 (CEST) Date: Tue, 27 Jun 2006 14:19:51 +0200 From: Pawel Jakub Dawidek To: Jason Hitt Message-ID: <20060627121951.GF21661@garage.freebsd.pl> References: <44A0AC24.1070106@charter.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="MZf7D3rAEoQgPanC" Content-Disposition: inline In-Reply-To: <44A0AC24.1070106@charter.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 12:22:57 -0000 --MZf7D3rAEoQgPanC Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jun 26, 2006 at 10:55:16PM -0500, Jason Hitt wrote: > I'm running into a big problem with a new 4 disk array im attempting to c= onfigure. >=20 > I'm using an SIIG 3114 PCI SATA controller with four WD3200SD 320 gig dis= ks attached to it. This is only going to be bulk storage, not a system dis= k. The disks appear in=20 > the system as ad{4,6,8,10}. My test is to configure my geom provider and= then dump/restore a 100 gig mount from a separate provider. >=20 > Setup: >=20 > apply "dd if=3D/dev/zero of=3D/dev/%1 bs=3D512 count=3D79" ad4 ad6 ad8 ad= 10 > apply "fdisk -v -B -I /dev/%1" ad4 ad6 ad8 ad10 > I then go back in with "fdisk -v -f- -i /dev/ad?" and reduce the size of = the slices by 1 so the consumers will be ad?s1, not ad?. >=20 > From this point i can successully use gmirror to mirror 2 disks and run m= y test, or i can use gstripe to stripe 2 disks and run my test (presumably = a stripe across all 4=20 > would work as well, but this is untested). The failure comes when i do t= his: > gmirror label storage0 ad4s1 ad6s1 > gmirror label storage1 ad8s1 ad10s1 > gstripe label storage mirror/storage0 mirror/storage1 > newfs /dev/stripe/storage >=20 > At this point i mount /dev/stripe/storage and attempt to copy data to it = using dump/restore (a large cp suffices as well). After a random amount of= time (typically < 60=20 > seconds), the system will completely hang. There is no panic, there is n= o crash. The system is completely hung. With no crash dump or panic, it's= quite difficult to=20 > pinpoint the problem. I also cannot find any solid resources to use as a= "how-to" for a geom raid10 setup, so i'm not sure if im approaching it cor= rectlly or not. >=20 > Anyone familiar with this that can lend a hand? I was trying to reproduce it, but no luck so far. I've a very simlar environment: # gmirror status Name Status Components mirror/storage0 COMPLETE ad5s1 ad6s1 mirror/storage1 COMPLETE ad8s1 ad9s1 # gstripe status Name Status Components stripe/storage UP mirror/storage0 mirror/storage1 # egrep '^ad[5689]' /var/run/dmesg.boot ad5: 305245MB at ata5-master SATA150 ad6: 305245MB at ata6-master SATA150 ad8: 305245MB at ata8-master SATA150 ad9: 305245MB at ata9-master SATA150 # egrep '^ata[5689]' /var/run/dmesg.boot ata5: on atapci1 ata6: on atapci1 ata8: on atapci3 ata9: on atapci3 # egrep '^atapci[13]' /var/run/dmesg.boot atapci1: port 0xa400-0xa407,0xa000-0xa003,0x9= c00-0x9c07,0x9800-0x9803,0x9400-0x940f mem 0xff8dec00-0xff8defff irq 10 at = device 4.0 on pci2 atapci3: port 0xe800-0xe807,0xe400-0xe403,0= xe000-0xe007,0xdc00-0xdc03,0xd800-0xd80f irq 10 at device 31.2 on pci0 As you can see, not all the disks used are connected to Silicon Image controler. From what I know those are the worst controllers ever (3112 beeing the really worst one). Will you be able to try to reproduce it with a different controller? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --MZf7D3rAEoQgPanC Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFEoSJnForvXbEpPzQRAl5JAJ9PH4eMLkikEE4DA/REloCMaKRQgACfYfOh cIWG9qEV2p+xDe/r+XzZGdM= =8+Cv -----END PGP SIGNATURE----- --MZf7D3rAEoQgPanC-- From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 12:24:09 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CD6FC16A400 for ; Tue, 27 Jun 2006 12:24:09 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5D2D243D67 for ; Tue, 27 Jun 2006 12:23:59 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 119C551391; Tue, 27 Jun 2006 14:23:58 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 8A39D51307; Tue, 27 Jun 2006 14:23:54 +0200 (CEST) Date: Tue, 27 Jun 2006 14:21:05 +0200 From: Pawel Jakub Dawidek To: Jason Hitt Message-ID: <20060627122105.GG21661@garage.freebsd.pl> References: <44A0AC24.1070106@charter.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="MiFvc8Vo6wRSORdP" Content-Disposition: inline In-Reply-To: <44A0AC24.1070106@charter.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 12:24:09 -0000 --MiFvc8Vo6wRSORdP Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jun 26, 2006 at 10:55:16PM -0500, Jason Hitt wrote: > I then go back in with "fdisk -v -f- -i /dev/ad?" and reduce the size of = the slices by 1 so the consumers will be ad?s1, not ad?. BTW. You don't need this step anymore. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --MiFvc8Vo6wRSORdP Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFEoSKxForvXbEpPzQRAh2HAJoDqaTaCLS69RVSdPhFw0wPrvvW/QCgi1lU 58lExIfyr7FmCZsCFsMAAJk= =mpsc -----END PGP SIGNATURE----- --MiFvc8Vo6wRSORdP-- From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 13:31:42 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7F32A16A403; Tue, 27 Jun 2006 13:31:42 +0000 (UTC) (envelope-from jhitt25@charter.net) Received: from mxsf12.cluster1.charter.net (mxsf12.cluster1.charter.net [209.225.28.212]) by mx1.FreeBSD.org (Postfix) with ESMTP id CDCE443D5F; Tue, 27 Jun 2006 13:31:41 +0000 (GMT) (envelope-from jhitt25@charter.net) Received: from mxip26a.cluster1.charter.net (mxip26a.cluster1.charter.net [209.225.28.181]) by mxsf12.cluster1.charter.net (8.12.11/8.12.11) with ESMTP id k5RDVeYx006782; Tue, 27 Jun 2006 09:31:40 -0400 Received: from 71-81-201-206.dhcp.stls.mo.charter.com (HELO [192.168.4.101]) ([71.81.201.206]) by mxip26a.cluster1.charter.net with ESMTP; 27 Jun 2006 09:31:40 -0400 X-IronPort-AV: i="4.06,180,1149480000"; d="scan'208"; a="1317593825:sNHT213098482" Message-ID: <44A13339.5010401@charter.net> Date: Tue, 27 Jun 2006 08:31:37 -0500 From: Jason Hitt User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <44A0AC24.1070106@charter.net> <20060627121951.GF21661@garage.freebsd.pl> In-Reply-To: <20060627121951.GF21661@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 13:31:42 -0000 Pawel Jakub Dawidek wrote: > On Mon, Jun 26, 2006 at 10:55:16PM -0500, Jason Hitt wrote: > >> I'm running into a big problem with a new 4 disk array im attempting to configure. >> >> I'm using an SIIG 3114 PCI SATA controller with four WD3200SD 320 gig disks attached to it. This is only going to be bulk storage, not a system disk. The disks appear in >> the system as ad{4,6,8,10}. My test is to configure my geom provider and then dump/restore a 100 gig mount from a separate provider. >> >> Setup: >> >> apply "dd if=/dev/zero of=/dev/%1 bs=512 count=79" ad4 ad6 ad8 ad10 >> apply "fdisk -v -B -I /dev/%1" ad4 ad6 ad8 ad10 >> I then go back in with "fdisk -v -f- -i /dev/ad?" and reduce the size of the slices by 1 so the consumers will be ad?s1, not ad?. >> >> From this point i can successully use gmirror to mirror 2 disks and run my test, or i can use gstripe to stripe 2 disks and run my test (presumably a stripe across all 4 >> would work as well, but this is untested). The failure comes when i do this: >> gmirror label storage0 ad4s1 ad6s1 >> gmirror label storage1 ad8s1 ad10s1 >> gstripe label storage mirror/storage0 mirror/storage1 >> newfs /dev/stripe/storage >> >> At this point i mount /dev/stripe/storage and attempt to copy data to it using dump/restore (a large cp suffices as well). After a random amount of time (typically < 60 >> seconds), the system will completely hang. There is no panic, there is no crash. The system is completely hung. With no crash dump or panic, it's quite difficult to >> pinpoint the problem. I also cannot find any solid resources to use as a "how-to" for a geom raid10 setup, so i'm not sure if im approaching it correctlly or not. >> >> Anyone familiar with this that can lend a hand? >> > > I was trying to reproduce it, but no luck so far. > I've a very simlar environment: > > # gmirror status > Name Status Components > mirror/storage0 COMPLETE ad5s1 > ad6s1 > mirror/storage1 COMPLETE ad8s1 > ad9s1 > > # gstripe status > Name Status Components > stripe/storage UP mirror/storage0 > mirror/storage1 > > # egrep '^ad[5689]' /var/run/dmesg.boot > ad5: 305245MB at ata5-master SATA150 > ad6: 305245MB at ata6-master SATA150 > ad8: 305245MB at ata8-master SATA150 > ad9: 305245MB at ata9-master SATA150 > > # egrep '^ata[5689]' /var/run/dmesg.boot > ata5: on atapci1 > ata6: on atapci1 > ata8: on atapci3 > ata9: on atapci3 > > # egrep '^atapci[13]' /var/run/dmesg.boot > atapci1: port 0xa400-0xa407,0xa000-0xa003,0x9c00-0x9c07,0x9800-0x9803,0x9400-0x940f mem 0xff8dec00-0xff8defff irq 10 at device 4.0 on pci2 > atapci3: port 0xe800-0xe807,0xe400-0xe403,0xe000-0xe007,0xdc00-0xdc03,0xd800-0xd80f irq 10 at device 31.2 on pci0 > > As you can see, not all the disks used are connected to Silicon Image > controler. From what I know those are the worst controllers ever (3112 > beeing the really worst one). Will you be able to try to reproduce it > with a different controller? > > Would you have a recommendation for a different controller? My only requirement is that it be moderately inexpensive (no $100+ hardware raid controllers...im using geom after all!), control at least 4 drives, and be PCI. Other than that, im open for suggestions. From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 16:45:56 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 7C2C616A52D for ; Tue, 27 Jun 2006 16:45:56 +0000 (UTC) (envelope-from ivoras@fer.hr) Received: from lara.cc.fer.hr (lara.cc.fer.hr [161.53.72.113]) by mx1.FreeBSD.org (Postfix) with ESMTP id D0BBE4494A for ; Tue, 27 Jun 2006 15:39:32 +0000 (GMT) (envelope-from ivoras@fer.hr) Received: from [127.0.0.1] (localhost.cc.fer.hr [127.0.0.1]) by lara.cc.fer.hr (8.13.6/8.13.4) with ESMTP id k5RFdL8w086034; Tue, 27 Jun 2006 17:39:24 +0200 (CEST) (envelope-from ivoras@fer.hr) Message-ID: <44A15124.4010503@fer.hr> Date: Tue, 27 Jun 2006 17:39:16 +0200 From: Ivan Voras User-Agent: Mozilla Thunderbird 1.0.6 (X11/20050921) X-Accept-Language: en-us, en MIME-Version: 1.0 To: Geoff Buckingham References: <8753F8EA457BFF4A9707CADA143C8F68012609D2__8496.21567545018$1151053555$gmane$org@LONSMSXM04.emea.ime.reuters.com> In-Reply-To: <8753F8EA457BFF4A9707CADA143C8F68012609D2__8496.21567545018$1151053555$gmane$org@LONSMSXM04.emea.ime.reuters.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: Strange boot delay on Proliant hardware. (RELENG_6_1) X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 16:45:56 -0000 Geoff Buckingham wrote: > In RELENG_6_1 I am seeing a strange delay of around thirty seconds when > booting on Proliant Servers. I do not see the delay on other servers > with the same kernel. I suspect some disagreement between GEOM and the > ciss driver/controller. I don't know what it is, but I see the same delay on similar Proliant hardware. From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 00:34:20 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6AC7516A47E for ; Wed, 28 Jun 2006 00:34:20 +0000 (UTC) (envelope-from elessar@bsdforen.de) Received: from postfix.bsdforen.de (bsdforen.de [212.204.60.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 47E5943D66 for ; Wed, 28 Jun 2006 00:34:10 +0000 (GMT) (envelope-from elessar@bsdforen.de) Received: by postfix.bsdforen.de (Postfix, from userid 20000) id 6748A684A26; Wed, 28 Jun 2006 02:34:09 +0200 (CEST) Received: from localhost (postfix [127.0.0.3]) by postfix.bsdforen.de (Postfix) with ESMTP id B8D49684A24 for ; Wed, 28 Jun 2006 02:34:08 +0200 (CEST) Received: from postfix.bsdforen.de ([127.0.0.3]) by localhost (postfix.bsdforen.de [127.0.0.3]) (amavisd-new, port 10024) with LMTP id 58223-04 for ; Wed, 28 Jun 2006 02:34:08 +0200 (CEST) Received: from loki.starkstrom.lan (p549CE59D.dip.t-dialin.net [84.156.229.157]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by postfix.bsdforen.de (Postfix) with ESMTP id BF7B2684A1F for ; Wed, 28 Jun 2006 02:34:07 +0200 (CEST) Date: Wed, 28 Jun 2006 02:33:57 +0200 From: Joerg Pernfuss To: freebsd-geom@freebsd.org Message-ID: <20060628023357.5a09bd95@loki.starkstrom.lan> In-Reply-To: <44A0AC24.1070106@charter.net> References: <44A0AC24.1070106@charter.net> X-Mailer: Sylpheed-Claws 2.2.3 (GTK+ 2.8.9; i386-portbld-freebsd6.1) Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_ZgZWKiyKBIVUMR/pIk__PV."; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Virus-Scanned: amavisd-new at bsdforen.de X-DSPAM-Result: Innocent X-DSPAM-Confidence: 0.9997 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 44a1ce81633261064316363 X-DSPAM-User: global Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 00:34:20 -0000 --Sig_ZgZWKiyKBIVUMR/pIk__PV. Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Hi, could it be that you are running FreeBSD 6.0-RELEASE? I had that dump/restore issue on 6.0 too. At that time I updated to the latest RELENG_6 (tagged 6.1-RC) and had no issues since. There were quite a few bugfixes that got merged into RELENG_6 between 6.0 and 6.1 (no idea if they made it as erratas into RELENG_6_0). Here is the system configuration that I'm running now: ~> uname -srm FreeBSD 6.1-RC amd64 ~> gmirror status Name Status Components mirror/root COMPLETE ad4s1a ad6s1a ad10s1a ad12s1a mirror/usr1 COMPLETE ad4s1f ad12s1f mirror/jail1 COMPLETE ad4s1g ad10s1g mirror/home1 COMPLETE ad4s1h ad10s1h mirror/usr2 COMPLETE ad6s1f ad10s1f mirror/jail2 COMPLETE ad6s1g ad12s1g mirror/home2 COMPLETE ad6s1h ad12s1h ~> gstripe status Name Status Components stripe/swap UP ad4s1b ad6s1b ad10s1b ad12s1b stripe/tmp UP ad4s1e ad6s1e ad10s1e ad12s1e stripe/usr UP mirror/usr2 mirror/usr1 stripe/jails UP mirror/jail1 mirror/jail2 stripe/home UP mirror/home1 mirror/home2 ~> geli status Name Status Components stripe/swap.eli N/A stripe/swap ~> graid3 status Name Status Components raid3/var COMPLETE ad4s1d ad10s1d ad12s1d --=20 | /"\ ASCII ribbon | GnuPG Key ID | e86d b753 3deb e749 6c3a | | \ / campaign against | 0xbbcaad24 | 5706 1f7d 6cfd bbca ad24 | | X HTML in email | .the next sentence is true. | | / \ and news | .the previous sentence was a lie. | --Sig_ZgZWKiyKBIVUMR/pIk__PV. Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (FreeBSD) iD8DBQFEoc59H31s/bvKrSQRAuKSAJoCznvCuwcEigMOHwU7IcHZM1yfTQCcC8iv 6fc/IF2Bn2aX7gUvMGM8eG4= =aAWn -----END PGP SIGNATURE----- --Sig_ZgZWKiyKBIVUMR/pIk__PV.-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 00:47:04 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id CFC7A16A400 for ; Wed, 28 Jun 2006 00:47:04 +0000 (UTC) (envelope-from jhitt25@charter.net) Received: from mxsf26.cluster1.charter.net (mxsf26.cluster1.charter.net [209.225.28.226]) by mx1.FreeBSD.org (Postfix) with ESMTP id 03F1C43D45 for ; Wed, 28 Jun 2006 00:46:59 +0000 (GMT) (envelope-from jhitt25@charter.net) Received: from mxip33a.cluster1.charter.net (mxip33a.cluster1.charter.net [209.225.28.248]) by mxsf26.cluster1.charter.net (8.12.11/8.12.11) with ESMTP id k5S0kwLn031225 for ; Tue, 27 Jun 2006 20:46:58 -0400 Received: from 71-81-201-206.dhcp.stls.mo.charter.com (HELO [192.168.4.101]) ([71.81.201.206]) by mxip33a.cluster1.charter.net with ESMTP; 27 Jun 2006 20:46:58 -0400 Message-ID: <44A1D182.5000609@charter.net> Date: Tue, 27 Jun 2006 19:46:58 -0500 From: Jason Hitt User-Agent: Thunderbird 1.5.0.4 (Windows/20060516) MIME-Version: 1.0 To: freebsd-geom@freebsd.org References: <44A0AC24.1070106@charter.net> <20060628023357.5a09bd95@loki.starkstrom.lan> In-Reply-To: <20060628023357.5a09bd95@loki.starkstrom.lan> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 00:47:04 -0000 I tested on 6.1 RELEASE and 6.1 STABLE with identical results. While my primary form of testing is dump/restore, the problem occurs if i attempt a cp -R as well. Joerg Pernfuss wrote: > Hi, > > could it be that you are running FreeBSD 6.0-RELEASE? > > I had that dump/restore issue on 6.0 too. At that time I updated to > the latest RELENG_6 (tagged 6.1-RC) and had no issues since. > There were quite a few bugfixes that got merged into RELENG_6 between > 6.0 and 6.1 (no idea if they made it as erratas into RELENG_6_0). > > Here is the system configuration that I'm running now: > > ~> uname -srm > FreeBSD 6.1-RC amd64 > ~> gmirror status > Name Status Components > mirror/root COMPLETE ad4s1a > ad6s1a > ad10s1a > ad12s1a > mirror/usr1 COMPLETE ad4s1f > ad12s1f > mirror/jail1 COMPLETE ad4s1g > ad10s1g > mirror/home1 COMPLETE ad4s1h > ad10s1h > mirror/usr2 COMPLETE ad6s1f > ad10s1f > mirror/jail2 COMPLETE ad6s1g > ad12s1g > mirror/home2 COMPLETE ad6s1h > ad12s1h > ~> gstripe status > Name Status Components > stripe/swap UP ad4s1b > ad6s1b > ad10s1b > ad12s1b > stripe/tmp UP ad4s1e > ad6s1e > ad10s1e > ad12s1e > stripe/usr UP mirror/usr2 > mirror/usr1 > stripe/jails UP mirror/jail1 > mirror/jail2 > stripe/home UP mirror/home1 > mirror/home2 > ~> geli status > Name Status Components > stripe/swap.eli N/A stripe/swap > ~> graid3 status > Name Status Components > raid3/var COMPLETE ad4s1d > ad10s1d > ad12s1d > > From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 13:04:27 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 71BCA16A4DE for ; Wed, 28 Jun 2006 13:04:27 +0000 (UTC) (envelope-from nvass@teledomenet.gr) Received: from matrix.teledomenet.gr (dns1.teledomenet.gr [213.142.128.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id 5E36A44925 for ; Wed, 28 Jun 2006 12:31:33 +0000 (GMT) (envelope-from nvass@teledomenet.gr) Received: from iris ([192.168.1.71]) by matrix.teledomenet.gr (8.12.10/8.12.10) with ESMTP id k5SCVVEY002292 for ; Wed, 28 Jun 2006 15:31:31 +0300 From: Nikos Vassiliadis To: freebsd-geom@freebsd.org Date: Wed, 28 Jun 2006 15:29:27 +0300 User-Agent: KMail/1.9.1 MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200606281529.28083.nvass@teledomenet.gr> Subject: graid3 not using gnop provider X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 13:04:27 -0000 Hi all, I am trying to use|test graid3 on a gnop provider(with 1% faillure probability) root:0:~/test/2# graid3 label -v pari /dev/md0.nop /dev/md1 /dev/md2 Metadata value stored on /dev/md0.nop. Metadata value stored on /dev/md1. Metadata value stored on /dev/md2. Done. so far, so good root:0:~/test/2# graid3 list Geom name: pari State: COMPLETE [snip] Consumers: 1. Name: md0 [snip] It's not using md0.nop, as I thought it would. Am I missing something? I'm using 6.1-STABLE. Please CC me, I'm not subscribed to geom@ Nikos From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 14:50:25 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 129D916A4CA; Wed, 28 Jun 2006 14:50:25 +0000 (UTC) (envelope-from nvass@teledomenet.gr) Received: from matrix.teledomenet.gr (dns1.teledomenet.gr [213.142.128.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id 6FAC543D7E; Wed, 28 Jun 2006 14:50:23 +0000 (GMT) (envelope-from nvass@teledomenet.gr) Received: from iris ([192.168.1.71]) by matrix.teledomenet.gr (8.12.10/8.12.10) with ESMTP id k5SEoMEY004527; Wed, 28 Jun 2006 17:50:22 +0300 From: Nikos Vassiliadis To: Pawel Jakub Dawidek Date: Wed, 28 Jun 2006 17:48:18 +0300 User-Agent: KMail/1.9.1 References: <200606281529.28083.nvass@teledomenet.gr> <20060628143227.GA2347@garage.freebsd.pl> In-Reply-To: <20060628143227.GA2347@garage.freebsd.pl> MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-7" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200606281748.18963.nvass@teledomenet.gr> Cc: freebsd-geom@freebsd.org Subject: Re: graid3 not using gnop provider X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 14:50:25 -0000 On Wednesday 28 June 2006 17:32, Pawel Jakub Dawidek wrote: > On Wed, Jun 28, 2006 at 03:29:27PM +0300, Nikos Vassiliadis wrote: > > Hi all, > > > > I am trying to use|test graid3 on a gnop provider(with 1% faillure > > probability) > > > > root:0:~/test/2# graid3 label -v pari /dev/md0.nop /dev/md1 /dev/md2 > > Metadata value stored on /dev/md0.nop. > > Metadata value stored on /dev/md1. > > Metadata value stored on /dev/md2. > > Done. > > > > so far, so good > > > > root:0:~/test/2# graid3 list > > Geom name: pari > > State: COMPLETE > > [snip] > > Consumers: > > 1. Name: md0 > > [snip] > > > > It's not using md0.nop, as I thought it would. Am I missing something? > > I'm using 6.1-STABLE. > > Because it first find the metadata on md0. > Add '-h' option to 'graid3 label' command, which will tell graid3(8) to > store provider's name in the metadata. That did it. A thousand thanks for your hard work on FreeBSD, Pawel. From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 14:59:36 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 8E9F716A4A7 for ; Wed, 28 Jun 2006 14:59:36 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 89AA9444C7 for ; Wed, 28 Jun 2006 14:35:24 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id 0707251884; Wed, 28 Jun 2006 16:35:23 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id AE3BF51859; Wed, 28 Jun 2006 16:35:16 +0200 (CEST) Date: Wed, 28 Jun 2006 16:32:27 +0200 From: Pawel Jakub Dawidek To: Nikos Vassiliadis Message-ID: <20060628143227.GA2347@garage.freebsd.pl> References: <200606281529.28083.nvass@teledomenet.gr> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="1yeeQ81UyVL57Vl7" Content-Disposition: inline In-Reply-To: <200606281529.28083.nvass@teledomenet.gr> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: graid3 not using gnop provider X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 14:59:36 -0000 --1yeeQ81UyVL57Vl7 Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Wed, Jun 28, 2006 at 03:29:27PM +0300, Nikos Vassiliadis wrote: > Hi all, >=20 > I am trying to use|test graid3 on a gnop provider(with 1% faillure > probability) >=20 > root:0:~/test/2# graid3 label -v pari /dev/md0.nop /dev/md1 /dev/md2=20 > Metadata value stored on /dev/md0.nop. > Metadata value stored on /dev/md1. > Metadata value stored on /dev/md2. > Done. >=20 > so far, so good >=20 > root:0:~/test/2# graid3 list > Geom name: pari > State: COMPLETE > [snip] > Consumers: > 1. Name: md0 > [snip] >=20 > It's not using md0.nop, as I thought it would. Am I missing something? > I'm using 6.1-STABLE. Because it first find the metadata on md0. Add '-h' option to 'graid3 label' command, which will tell graid3(8) to store provider's name in the metadata. --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --1yeeQ81UyVL57Vl7 Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFEopL7ForvXbEpPzQRAkbbAKDRh8aEI35kYMELaSnze+mu+GNeOgCggfzO /esy0I5NI4QBcQeL39qEwz4= =VWpY -----END PGP SIGNATURE----- --1yeeQ81UyVL57Vl7-- From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 18:58:20 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 92A3716A408 for ; Wed, 28 Jun 2006 18:58:20 +0000 (UTC) (envelope-from anderson@centtech.com) Received: from mh2.centtech.com (moat3.centtech.com [207.200.51.50]) by mx1.FreeBSD.org (Postfix) with ESMTP id BB72B43EC7 for ; Wed, 28 Jun 2006 18:58:18 +0000 (GMT) (envelope-from anderson@centtech.com) Received: from [10.177.171.220] (neutrino.centtech.com [10.177.171.220]) by mh2.centtech.com (8.13.1/8.13.1) with ESMTP id k5SIwDIH024512 for ; Wed, 28 Jun 2006 13:58:15 -0500 (CDT) (envelope-from anderson@centtech.com) Message-ID: <44A2D144.2060606@centtech.com> Date: Wed, 28 Jun 2006 13:58:12 -0500 From: Eric Anderson User-Agent: Thunderbird 1.5.0.4 (X11/20060612) MIME-Version: 1.0 To: freebsd-geom@freebsd.org Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-Virus-Scanned: ClamAV 0.87.1/1572/Wed Jun 28 09:49:41 2006 on mh2.centtech.com X-Virus-Status: Clean Subject: GEOM_LABEL: ufs labels coming/going? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 18:58:20 -0000 I just set up some ufs labels (using tunefs -L) for all my partitions, including root (/). When booting, I see something like: [..snip..] Jun 28 10:08:31 neutrino kernel: ad0: 95396MB at ata0-master UDMA33 Jun 28 10:08:31 neutrino kernel: ad0: 195371568 sectors [193821C/16H/63S] 16 sectors/interrupt 1 depth queue Jun 28 10:08:31 neutrino kernel: GEOM: new disk ad0[..snip..] Jun 28 10:08:31 neutrino kernel: ata1-master: pio=PIO4 wdma=WDMA2 udma=UDMA33 cable=40 wire [..snip..] Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label for provider ad0s2a is ufs/root. Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label for provider ad0s2d is ufs/home. Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label for provider ad0s2e is ufs/alt. [..snip..] Jun 28 10:08:31 neutrino kernel: Trying to mount root from ufs:/dev/ad0s2a Jun 28 10:08:31 neutrino kernel: start_init: trying /sbin/init Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label ufs/root removed. Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label for provider ad0s2a is ufs/root. Jun 28 10:08:31 neutrino kernel: GEOM_LABEL: Label ufs/root removed. And a listing of /dev/ufs/: $ ls -al /dev/ufs/ total 1 dr-xr-xr-x 2 root wheel 512 Dec 31 1969 . dr-xr-xr-x 6 root wheel 512 Dec 31 1969 .. crw-r----- 1 root operator 0, 106 Jun 28 05:08 alt crw-r----- 1 root operator 0, 105 Jun 28 05:08 home The label is still there: tunefs -p ad0s2a tunefs: ACLs: (-a) disabled tunefs: MAC multilabel: (-l) disabled tunefs: soft updates: (-n) disabled tunefs: maximum blocks per file in a cylinder group: (-e) 2048 tunefs: average file size: (-f) 16384 tunefs: average number of files in a directory: (-s) 64 tunefs: minimum percentage of free space: (-m) 8% tunefs: optimization preference: (-o) time tunefs: volume label: (-L) root What am I missing? Eric -- ------------------------------------------------------------------------ Eric Anderson Sr. Systems Administrator Centaur Technology Anything that works is better than anything that doesn't. ------------------------------------------------------------------------ From owner-freebsd-geom@FreeBSD.ORG Wed Jun 28 20:50:54 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id C385F16A407 for ; Wed, 28 Jun 2006 20:50:54 +0000 (UTC) (envelope-from elessar@bsdforen.de) Received: from postfix.bsdforen.de (bsdforen.de [212.204.60.79]) by mx1.FreeBSD.org (Postfix) with ESMTP id 4248744CC9 for ; Wed, 28 Jun 2006 20:50:54 +0000 (GMT) (envelope-from elessar@bsdforen.de) Received: by postfix.bsdforen.de (Postfix, from userid 20000) id 597E86844BA; Wed, 28 Jun 2006 22:50:53 +0200 (CEST) Received: from localhost (postfix [127.0.0.3]) by postfix.bsdforen.de (Postfix) with ESMTP id 08F726844B7 for ; Wed, 28 Jun 2006 22:50:52 +0200 (CEST) Received: from postfix.bsdforen.de ([127.0.0.3]) by localhost (postfix.bsdforen.de [127.0.0.3]) (amavisd-new, port 10024) with LMTP id 11607-11 for ; Wed, 28 Jun 2006 22:50:52 +0200 (CEST) Received: from loki.starkstrom.lan (p549CDC1D.dip.t-dialin.net [84.156.220.29]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by postfix.bsdforen.de (Postfix) with ESMTP id 39A3E6844B6 for ; Wed, 28 Jun 2006 22:50:51 +0200 (CEST) Date: Wed, 28 Jun 2006 22:50:49 +0200 From: Joerg Pernfuss To: freebsd-geom@freebsd.org Message-ID: <20060628225049.458bf695@loki.starkstrom.lan> In-Reply-To: <44A2D144.2060606@centtech.com> References: <44A2D144.2060606@centtech.com> X-Mailer: Sylpheed-Claws 2.2.3 (GTK+ 2.8.9; i386-portbld-freebsd6.1) Mime-Version: 1.0 Content-Type: multipart/signed; boundary=Sig_X3nc3ChbfyCx4YzVeui4JM0; protocol="application/pgp-signature"; micalg=PGP-SHA1 X-Virus-Scanned: amavisd-new at bsdforen.de Subject: Re: GEOM_LABEL: ufs labels coming/going? X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 28 Jun 2006 20:50:54 -0000 --Sig_X3nc3ChbfyCx4YzVeui4JM0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable On Wed, 28 Jun 2006 13:58:12 -0500 Eric Anderson wrote: > What am I missing? >=20 > Eric The label is removed when you mount the partition the normal way and recreated when you unmount it. It only stays when you mount the partition via the label, for example, in your fstab: /dev/ufs/root / ufs rw 1 1 and so on Joerg --=20 | /"\ ASCII ribbon | GnuPG Key ID | e86d b753 3deb e749 6c3a | | \ / campaign against | 0xbbcaad24 | 5706 1f7d 6cfd bbca ad24 | | X HTML in email | .the next sentence is true. | | / \ and news | .the previous sentence was a lie. | --Sig_X3nc3ChbfyCx4YzVeui4JM0 Content-Type: application/pgp-signature; name=signature.asc Content-Disposition: attachment; filename=signature.asc -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2.2 (FreeBSD) iD8DBQFEouupH31s/bvKrSQRApDYAJ44ExmJcAHqq6kFx8G786SI2WvZOACcCOl4 qJax7Y7rH7KOjRSnxi1tS5Y= =gbd0 -----END PGP SIGNATURE----- --Sig_X3nc3ChbfyCx4YzVeui4JM0-- From owner-freebsd-geom@FreeBSD.ORG Fri Jun 30 11:56:03 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0F37A16A403 for ; Fri, 30 Jun 2006 11:56:03 +0000 (UTC) (envelope-from nvass@teledomenet.gr) Received: from matrix.teledomenet.gr (dns1.teledomenet.gr [213.142.128.1]) by mx1.FreeBSD.org (Postfix) with ESMTP id 421044465E for ; Fri, 30 Jun 2006 11:56:01 +0000 (GMT) (envelope-from nvass@teledomenet.gr) Received: from iris ([192.168.1.71]) by matrix.teledomenet.gr (8.12.10/8.12.10) with ESMTP id k5UBtxEY031435 for ; Fri, 30 Jun 2006 14:55:59 +0300 From: Nikos Vassiliadis To: freebsd-geom@freebsd.org Date: Fri, 30 Jun 2006 14:53:46 +0300 User-Agent: KMail/1.9.1 MIME-Version: 1.0 Content-Type: text/plain; charset="iso-8859-7" Content-Transfer-Encoding: 7bit Content-Disposition: inline Message-Id: <200606301453.46881.nvass@teledomenet.gr> Subject: vnode disk on smbfs can not survive temporary network failure X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 30 Jun 2006 11:56:03 -0000 Hi all, A vnode disk on smbfs cannot survive a temporary failure. Every subsequent read/write operation returns "Bad file descriptor" which must likely will result in a panic if a filesystem is mounted (not tested, just an assumption). This is not case with nfs, where everything is fine after recovery. smbfs also works fine after reco- very. Everything is OK, but the vnode disk. Should I file a PR? Is it a GEOM issue? Thanks in advance, Nikos