From owner-freebsd-geom@FreeBSD.ORG  Fri Dec 12 04:01:38 2008
Return-Path: <owner-freebsd-geom@FreeBSD.ORG>
Delivered-To: freebsd-geom@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 5A6E51065672
	for <freebsd-geom@freebsd.org>; Fri, 12 Dec 2008 04:01:38 +0000 (UTC)
	(envelope-from rick@kiwi-computer.com)
Received: from kiwi-computer.com (keira.kiwi-computer.com [63.224.10.3])
	by mx1.freebsd.org (Postfix) with SMTP id E48868FC17
	for <freebsd-geom@freebsd.org>; Fri, 12 Dec 2008 04:01:37 +0000 (UTC)
	(envelope-from rick@kiwi-computer.com)
Received: (qmail 76503 invoked by uid 2001); 12 Dec 2008 04:01:37 -0000
Date: Thu, 11 Dec 2008 22:01:37 -0600
From: "Rick C. Petty" <rick-freebsd2008@kiwi-computer.com>
To: oxy <oxy@field.hu>
Message-ID: <20081212040137.GA76422@keira.kiwi-computer.com>
References: <4940FF0F.2020404@field.hu>
	<20081211205659.GA72478@keira.kiwi-computer.com>
	<49419680.4010003@field.hu>
Mime-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <49419680.4010003@field.hu>
User-Agent: Mutt/1.4.2.3i
Cc: freebsd-geom@freebsd.org
Subject: Re: Encrypting raid5 volume with geli
X-BeenThere: freebsd-geom@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
Reply-To: rick-freebsd2008@kiwi-computer.com
List-Id: GEOM-specific discussions and implementations
	<freebsd-geom.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-geom>,
	<mailto:freebsd-geom-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-geom>
List-Post: <mailto:freebsd-geom@freebsd.org>
List-Help: <mailto:freebsd-geom-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-geom>,
	<mailto:freebsd-geom-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 12 Dec 2008 04:01:38 -0000

On Thu, Dec 11, 2008 at 11:38:56PM +0100, oxy wrote:
> here it is:
> 
> [root@test /]# gvinum l
> 4 drives:
> D disk_2                State: up       /dev/ad9        A: 0/238475 MB (0%)
> D disk_1                State: up       /dev/ad8        A: 0/238475 MB (0%)
> D disk_4                State: up       /dev/ad5        A: 0/238475 MB (0%)
> D disk_3                State: up       /dev/ad4        A: 0/238475 MB (0%)
> 
> 1 volume:
> V raid5                 State: down     Plexes:       1 Size:        698 GB
> 
> 1 plex:
> P raid5.p0           R5 State: down     Subdisks:     4 Size:        698 GB
> 
> 4 subdisks:
> S raid5.p0.s0           State: stale    D: disk_1       Size:        232 GB
> S raid5.p0.s1           State: stale    D: disk_2       Size:        232 GB
> S raid5.p0.s2           State: stale    D: disk_3       Size:        232 GB
> S raid5.p0.s3           State: stale    D: disk_4       Size:        232 GB
> 
> [root@test /]# geli init -P -K /root/raid5.key /dev/gvinum/raid5
> geli: Cannot store metadata on /dev/gvinum/raid5: Device not configured.

The error message is quite accurate-- the raid5 volume is down because the
plex is stale.  You need to run a "gvinum start raid5.p0" and let it
complete before the volume will be "up".  This operation will sync the four
plexes and write out the parity info.

There are a set of patches that lulf@ has which I believe put the volume in
"up" state initially instead of "down", but maybe it only works for
mirrors.  The code in current and RELENG_7 does initially put the volume in
"down" state.

-- Rick C. Petty