From owner-freebsd-geom@FreeBSD.ORG Tue Jun 27 12:22:57 2006 Return-Path: X-Original-To: freebsd-geom@freebsd.org Delivered-To: freebsd-geom@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6EC9416A400 for ; Tue, 27 Jun 2006 12:22:57 +0000 (UTC) (envelope-from pjd@garage.freebsd.pl) Received: from mail.garage.freebsd.pl (arm132.internetdsl.tpnet.pl [83.17.198.132]) by mx1.FreeBSD.org (Postfix) with ESMTP id 71F0C43D78 for ; Tue, 27 Jun 2006 12:22:47 +0000 (GMT) (envelope-from pjd@garage.freebsd.pl) Received: by mail.garage.freebsd.pl (Postfix, from userid 65534) id CD99D51339; Tue, 27 Jun 2006 14:22:45 +0200 (CEST) Received: from localhost (pjd.wheel.pl [10.0.1.1]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) by mail.garage.freebsd.pl (Postfix) with ESMTP id 0B10751845; Tue, 27 Jun 2006 14:22:41 +0200 (CEST) Date: Tue, 27 Jun 2006 14:19:51 +0200 From: Pawel Jakub Dawidek To: Jason Hitt Message-ID: <20060627121951.GF21661@garage.freebsd.pl> References: <44A0AC24.1070106@charter.net> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="MZf7D3rAEoQgPanC" Content-Disposition: inline In-Reply-To: <44A0AC24.1070106@charter.net> X-PGP-Key-URL: http://people.freebsd.org/~pjd/pjd.asc X-OS: FreeBSD 7.0-CURRENT i386 User-Agent: mutt-ng/devel-r804 (FreeBSD) X-Spam-Checker-Version: SpamAssassin 3.0.4 (2005-06-05) on mail.garage.freebsd.pl X-Spam-Level: X-Spam-Status: No, score=-5.9 required=3.0 tests=ALL_TRUSTED,BAYES_00 autolearn=ham version=3.0.4 Cc: freebsd-geom@freebsd.org Subject: Re: Problem with stripe across mirrors X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 27 Jun 2006 12:22:57 -0000 --MZf7D3rAEoQgPanC Content-Type: text/plain; charset=iso-8859-2 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jun 26, 2006 at 10:55:16PM -0500, Jason Hitt wrote: > I'm running into a big problem with a new 4 disk array im attempting to c= onfigure. >=20 > I'm using an SIIG 3114 PCI SATA controller with four WD3200SD 320 gig dis= ks attached to it. This is only going to be bulk storage, not a system dis= k. The disks appear in=20 > the system as ad{4,6,8,10}. My test is to configure my geom provider and= then dump/restore a 100 gig mount from a separate provider. >=20 > Setup: >=20 > apply "dd if=3D/dev/zero of=3D/dev/%1 bs=3D512 count=3D79" ad4 ad6 ad8 ad= 10 > apply "fdisk -v -B -I /dev/%1" ad4 ad6 ad8 ad10 > I then go back in with "fdisk -v -f- -i /dev/ad?" and reduce the size of = the slices by 1 so the consumers will be ad?s1, not ad?. >=20 > From this point i can successully use gmirror to mirror 2 disks and run m= y test, or i can use gstripe to stripe 2 disks and run my test (presumably = a stripe across all 4=20 > would work as well, but this is untested). The failure comes when i do t= his: > gmirror label storage0 ad4s1 ad6s1 > gmirror label storage1 ad8s1 ad10s1 > gstripe label storage mirror/storage0 mirror/storage1 > newfs /dev/stripe/storage >=20 > At this point i mount /dev/stripe/storage and attempt to copy data to it = using dump/restore (a large cp suffices as well). After a random amount of= time (typically < 60=20 > seconds), the system will completely hang. There is no panic, there is n= o crash. The system is completely hung. With no crash dump or panic, it's= quite difficult to=20 > pinpoint the problem. I also cannot find any solid resources to use as a= "how-to" for a geom raid10 setup, so i'm not sure if im approaching it cor= rectlly or not. >=20 > Anyone familiar with this that can lend a hand? I was trying to reproduce it, but no luck so far. I've a very simlar environment: # gmirror status Name Status Components mirror/storage0 COMPLETE ad5s1 ad6s1 mirror/storage1 COMPLETE ad8s1 ad9s1 # gstripe status Name Status Components stripe/storage UP mirror/storage0 mirror/storage1 # egrep '^ad[5689]' /var/run/dmesg.boot ad5: 305245MB at ata5-master SATA150 ad6: 305245MB at ata6-master SATA150 ad8: 305245MB at ata8-master SATA150 ad9: 305245MB at ata9-master SATA150 # egrep '^ata[5689]' /var/run/dmesg.boot ata5: on atapci1 ata6: on atapci1 ata8: on atapci3 ata9: on atapci3 # egrep '^atapci[13]' /var/run/dmesg.boot atapci1: port 0xa400-0xa407,0xa000-0xa003,0x9= c00-0x9c07,0x9800-0x9803,0x9400-0x940f mem 0xff8dec00-0xff8defff irq 10 at = device 4.0 on pci2 atapci3: port 0xe800-0xe807,0xe400-0xe403,0= xe000-0xe007,0xdc00-0xdc03,0xd800-0xd80f irq 10 at device 31.2 on pci0 As you can see, not all the disks used are connected to Silicon Image controler. From what I know those are the worst controllers ever (3112 beeing the really worst one). Will you be able to try to reproduce it with a different controller? --=20 Pawel Jakub Dawidek http://www.wheel.pl pjd@FreeBSD.org http://www.FreeBSD.org FreeBSD committer Am I Evil? Yes, I Am! --MZf7D3rAEoQgPanC Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.2 (FreeBSD) iD8DBQFEoSJnForvXbEpPzQRAl5JAJ9PH4eMLkikEE4DA/REloCMaKRQgACfYfOh cIWG9qEV2p+xDe/r+XzZGdM= =8+Cv -----END PGP SIGNATURE----- --MZf7D3rAEoQgPanC--