From owner-freebsd-geom@FreeBSD.ORG Sat Jul 21 12:31:16 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 277FF16A41A for ; Sat, 21 Jul 2007 12:31:16 +0000 (UTC) (envelope-from tony@crosswinds.net) Received: from out-mx1.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by mx1.freebsd.org (Postfix) with ESMTP id 068BC13C457 for ; Sat, 21 Jul 2007 12:31:16 +0000 (UTC) (envelope-from tony@crosswinds.net) Received: from admin.crosswinds.net (out-mx1.crosswinds.net [216.18.117.38]) by out-mx1.crosswinds.net (Postfix) with ESMTP id A50B12B6F7 for ; Sat, 21 Jul 2007 08:12:40 -0400 (EDT) Received: by admin.crosswinds.net (Postfix, from userid 1001) id 6ECC4403D; Sat, 21 Jul 2007 08:12:40 -0400 (EDT) Date: Sat, 21 Jul 2007 08:12:40 -0400 From: Tony Holmes To: freebsd-geom@freebsd.org Message-ID: <20070721121240.GA45291@crosswinds.net> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.4.2.1i Subject: Geom striped mirrors questions X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jul 2007 12:31:16 -0000 I am trying to set up a RAID 10 data array using 12 identical 33gb scsi disks. 2 are being kept for spares First I set up a single slice on each disk using: fdisk -I -1 /dev/da{0,1,2,3,4,5,6,7,8,9,10,11,12,13} Then I set up the mirrors: gmirror label -v -b round-robin dm0 /dev/da0 /dev/da7 gmirror label -v -b round-robin dm1 /dev/da1 /dev/da8 gmirror label -v -b round-robin dm2 /dev/da2 /dev/da9 gmirror label -v -b round-robin dm3 /dev/da3 /dev/da10 gmirror label -v -b round-robin dm4 /dev/da4 /dev/da11 gmirror label -v -b round-robin dm5 /dev/da5 /dev/da12 And finally the stripe: gstripe label -s 524288 ds0 /dev/mirror/dm0 /dev/mirror/dm1 /dev/mirror/dm2 /dev/mirror/dm3 /dev/mirror/dm4 /dev/mirror/dm5 The gstatus is fine: and the array is usable/mountable/newfs'able but I am concered by the warnings in /var/log/messages: Jul 21 08:03:56 db kernel: GEOM_MIRROR: Device mirror/dm0 launched (2/2). Jul 21 08:04:06 db kernel: GEOM_MIRROR: Device mirror/dm1 launched (2/2). Jul 21 08:04:14 db kernel: GEOM_MIRROR: Device mirror/dm2 launched (2/2). Jul 21 08:04:21 db kernel: GEOM_MIRROR: Device mirror/dm3 launched (2/2). Jul 21 08:04:27 db kernel: GEOM_MIRROR: Device mirror/dm4 launched (2/2). Jul 21 08:04:34 db kernel: GEOM_MIRROR: Device mirror/dm5 launched (2/2). Jul 21 08:05:47 db kernel: GEOM_STRIPE: Device /dev/mirror/dm0 created (id=3520310645). Jul 21 08:06:57 db kernel: GEOM_STRIPE: Device ds0 created (id=2180637358). Jul 21 08:06:57 db kernel: GEOM_STRIPE: Disk mirror/dm0 attached to ds0. Jul 21 08:06:57 db kernel: GEOM_STRIPE: Cannot add disk mirror/dm0c to ds0 (error=17). Jul 21 08:06:57 db kernel: GEOM_STRIPE: Disk mirror/dm1 attached to ds0. Jul 21 08:06:57 db kernel: GEOM_STRIPE: Disk mirror/dm2 attached to ds0. Jul 21 08:06:58 db kernel: GEOM_STRIPE: Cannot add disk mirror/dm2c to ds0 (error=17). Jul 21 08:06:58 db kernel: GEOM_STRIPE: Disk mirror/dm3 attached to ds0. Jul 21 08:06:58 db kernel: GEOM_STRIPE: Cannot add disk mirror/dm3c to ds0 (error=17). Jul 21 08:06:58 db kernel: GEOM_STRIPE: Disk mirror/dm4 attached to ds0. Jul 21 08:06:58 db kernel: GEOM_STRIPE: Cannot add disk mirror/dm4c to ds0 (error=17). Jul 21 08:06:58 db kernel: GEOM_STRIPE: Disk mirror/dm5 attached to ds0. Jul 21 08:06:58 db kernel: GEOM_STRIPE: Device ds0 activated. Jul 21 08:06:58 db kernel: GEOM_STRIPE: Cannot add disk mirror/dm5c to ds0 (error=17). And it's odd that I do not get it for device dm1 (da1/da8). So, what am I doing wrong? This is on 7.0-CURRENT amd64. Athlon X2 3600, 2GB ram -- Tony Holmes Ph: (416) 993-1219 Founder and Senior Systems Architect Crosswinds Internet Communications Inc.