From owner-freebsd-current@FreeBSD.ORG Fri Aug 6 18:37:07 2010 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7C842106566C for ; Fri, 6 Aug 2010 18:37:07 +0000 (UTC) (envelope-from ianf@clue.co.za) Received: from inbound01.jnb1.gp-online.net (inbound01.jnb1.gp-online.net [41.161.16.135]) by mx1.freebsd.org (Postfix) with ESMTP id C0E018FC0A for ; Fri, 6 Aug 2010 18:37:06 +0000 (UTC) Received: from [41.154.88.19] (helo=clue.co.za) by inbound01.jnb1.gp-online.net with esmtpsa (TLS-1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.63) (envelope-from ) id 1OhRmy-0007JH-8V; Fri, 06 Aug 2010 20:37:04 +0200 Received: from localhost ([127.0.0.1] helo=clue.co.za) by clue.co.za with esmtp (Exim 4.69 (FreeBSD)) (envelope-from ) id 1OhRmw-0000YC-DB; Fri, 06 Aug 2010 20:37:02 +0200 To: Gary Palmer From: Ian FREISLICH In-Reply-To: <20100806174516.GA86366@in-addr.com> References: <20100806174516.GA86366@in-addr.com> <201008061053.26465.jhb@freebsd.org> X-Attribution: BOFH Date: Fri, 06 Aug 2010 20:37:02 +0200 Message-Id: Cc: freebsd-current@freebsd.org Subject: Re: problem with mfiutil X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Aug 2010 18:37:07 -0000 Gary Palmer wrote: > On Fri, Aug 06, 2010 at 06:58:29PM +0200, Ian FREISLICH wrote: > > John Baldwin wrote: > > > On Friday, August 06, 2010 7:32:00 am Ian FREISLICH wrote: > > > > Hi > > > > > > > > I'm unable to make a raid10 on my servers with 6 disks in each > > > > stripe. I tried a few ways: > > > > > > > > ~ # mfiutil -u1 create raid10 -s1M e1:s0,e1:s1,e1:s2,e1:s3,e1:s4,e1:s5 > > > e1:s6,e1:s7,e1:s8,e1:s9,e1:s10,e1:s11 > > > > mfiutil: Command failed: Invalid parameter > > > > mfiutil: Failed to add volume: Input/output error > > > > > > > > ~ # mfiutil -u1 create raid10 -s1M 19,29,18,26,22,20 31,30,21,27,28,32 > > > > mfiutil: Command failed: Invalid parameter > > > > mfiutil: Failed to add volume: Input/output error > > > > > > > > It does however work with 2 disks in each stripe: > > > > ~ # mfiutil -u1 create raid10 -s1M 19,29 31,30 > > > > > > > > any ideas? > > > > > > Yes, you have it inverted. You are creating a stripe across a bunch of > > > RAID-1's and you need to list all the RAID-1's, so something like this: > > > > > > mfiutil -u 1 create raid10 -s 1M 19,31 29,39 18,21 26,27 22,28 20,32 > > > > Hmm. I'll give that a try, but it's not the way the controler > > configured it fyrom the BIOS utility. It was definitely a mirror > > of 2 6 disk stripes. The controller is a Perc 6/E. > > What you described is RAID 0+1, not RAID 10. Typically in RAID 0+1 you > make two stripes, each with half the disks, and then mirror them. RAID > 10 you make lots of mirrored drive pairs and then stripe across all the > mirrors. RAID 10 has higher redundancy and lower rebuild times than 0+1 Understood and I'm not saying it isn't, it's just what the controller reported as its config which led me to what I originally posted. I managed to get the controller to delete the volume it showed wierdly by adding another volume and then deleting the two. I then created the RAID10. I'd love to know what my colleague did to get the previous config because it's apparently not supported by this controller. This is what it looked like before: mfi1 Configuration: 7 arrays, 2 volumes, 1 spares array 0 of 2 drives: drive 23 ( 419G) ONLINE SAS enclosure 1, slot 14 drive 24 ( 419G) ONLINE SAS enclosure 1, slot 13 array 1 of 6 drives: drive 19 ( 419G) ONLINE SAS enclosure 1, slot 0 drive 31 ( 419G) ONLINE SAS enclosure 1, slot 6 drive 18 ( 419G) ONLINE SAS enclosure 1, slot 2 drive 26 ( 419G) ONLINE SAS enclosure 1, slot 3 drive 22 ( 419G) ONLINE SAS enclosure 1, slot 4 drive 20 ( 419G) ONLINE SAS enclosure 1, slot 5 array 2 of 6 drives: drive 29 ( 419G) ONLINE SAS enclosure 1, slot 1 drive 30 ( 419G) ONLINE SAS enclosure 1, slot 7 drive 21 ( 419G) ONLINE SAS enclosure 1, slot 8 drive 27 ( 419G) ONLINE SAS enclosure 1, slot 9 drive 28 ( 419G) ONLINE SAS enclosure 1, slot 10 drive 32 ( 419G) ONLINE SAS enclosure 1, slot 11 volume mfid2 (419G) RAID-1 1M OPTIMAL spans: array 0 volume mfid1 (2512G) RAID-10 1M OPTIMAL spans: array 1 array 2 global spare 25 ( 419G) HOT SPARE SAS enclosure 1, slot 12 This is what the config looks like now: mfi1 Configuration: 7 arrays, 2 volumes, 1 spares array 0 of 2 drives: drive 23 ( 419G) ONLINE SAS enclosure 1, slot 14 drive 24 ( 419G) ONLINE SAS enclosure 1, slot 13 array 1 of 2 drives: drive 19 ( 419G) ONLINE SAS enclosure 1, slot 0 drive 31 ( 419G) ONLINE SAS enclosure 1, slot 6 array 2 of 2 drives: drive 29 ( 419G) ONLINE SAS enclosure 1, slot 1 drive 30 ( 419G) ONLINE SAS enclosure 1, slot 7 array 3 of 2 drives: drive 18 ( 419G) ONLINE SAS enclosure 1, slot 2 drive 21 ( 419G) ONLINE SAS enclosure 1, slot 8 array 4 of 2 drives: drive 26 ( 419G) ONLINE SAS enclosure 1, slot 3 drive 27 ( 419G) ONLINE SAS enclosure 1, slot 9 array 5 of 2 drives: drive 22 ( 419G) ONLINE SAS enclosure 1, slot 4 drive 28 ( 419G) ONLINE SAS enclosure 1, slot 10 array 6 of 2 drives: drive 20 ( 419G) ONLINE SAS drive 32 ( 419G) ONLINE SAS enclosure 1, slot 11 volume mfid2 (419G) RAID-1 1M OPTIMAL spans: array 0 volume mfid1 (2512G) RAID-10 1M OPTIMAL spans: array 1 array 2 array 3 array 4 array 5 array 6 global spare 25 ( 419G) HOT SPARE SAS enclosure 1, slot 12 Ian -- Ian Freislich