From owner-freebsd-stable@FreeBSD.ORG  Fri Feb 19 00:36:57 2010
Return-Path: <owner-freebsd-stable@FreeBSD.ORG>
Delivered-To: freebsd-stable@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 84E891065672;
	Fri, 19 Feb 2010 00:36:57 +0000 (UTC)
	(envelope-from dan.naumov@gmail.com)
Received: from mail-gx0-f219.google.com (mail-gx0-f219.google.com
	[209.85.217.219])
	by mx1.freebsd.org (Postfix) with ESMTP id 291628FC19;
	Fri, 19 Feb 2010 00:36:56 +0000 (UTC)
Received: by gxk19 with SMTP id 19so2780922gxk.3
	for <multiple recipients>; Thu, 18 Feb 2010 16:36:56 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma;
	h=domainkey-signature:mime-version:received:in-reply-to:references
	:date:message-id:subject:from:to:cc:content-type
	:content-transfer-encoding;
	bh=KLStzow1hhfLq6Y61nz/S+RKCc2kfu9F842S72U3BU0=;
	b=KtmfRvXFiKlqueHxHQtKmCzCjPZSu4oz4enprjGguZqLHUJi2ORnBrkx6piEKc7iiu
	oQdectZYEBbAi2XNMhZqAxsEktVuKMKWON2IPg2LA1HQzFpI5UPZsjNdj/u3XxMUL7zv
	DcaP+8hkAflnbfmNJXMLln9jNCE2yyMkCWtA4=
DomainKey-Signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma;
	h=mime-version:in-reply-to:references:date:message-id:subject:from:to
	:cc:content-type:content-transfer-encoding;
	b=J0Vtil+X91xMDt8yL32Zvd4a1bI1jdQ7SvNiozbIQncAp7ZJN1oWo7AVYPD1RyBvWj
	7boAjoV6XDT71lt/88Fv9W+sOaNzJholR7bYZ20Me6MAODRRKjGFjoy+fMsmv4OmSRHM
	Tr+bwGB+z9VM3uYKHZVECML1nVCKF2TgJ7IRk=
MIME-Version: 1.0
Received: by 10.101.167.16 with SMTP id u16mr10647892ano.170.1266539816326; 
	Thu, 18 Feb 2010 16:36:56 -0800 (PST)
In-Reply-To: <f383264b1002181503q74d1fc95y470f11be49c11d2f@mail.gmail.com>
References: <cf9b1ee01002160038o25e17bc8sd54e66be7c67f859@mail.gmail.com>
	<f383264b1002181057y48e56cebv1c8bbb1c0fe9d1d2@mail.gmail.com>
	<f383264b1002181503q74d1fc95y470f11be49c11d2f@mail.gmail.com>
Date: Fri, 19 Feb 2010 02:36:56 +0200
Message-ID: <cf9b1ee01002181636y5776968cn1e8c49deae7e8311@mail.gmail.com>
From: Dan Naumov <dan.naumov@gmail.com>
To: Matt Reimer <mattjreimer@gmail.com>
Content-Type: text/plain; charset=ISO-8859-1
Content-Transfer-Encoding: quoted-printable
Cc: FreeBSD-STABLE Mailing List <freebsd-stable@freebsd.org>,
	rnoland@freebsd.org
Subject: Re: booting off a ZFS pool consisting of multiple striped mirror 
	vdevs
X-BeenThere: freebsd-stable@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Production branch of FreeBSD source code <freebsd-stable.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>, 
	<mailto:freebsd-stable-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-stable>
List-Post: <mailto:freebsd-stable@freebsd.org>
List-Help: <mailto:freebsd-stable-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-stable>,
	<mailto:freebsd-stable-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Fri, 19 Feb 2010 00:36:57 -0000

On Fri, Feb 19, 2010 at 1:03 AM, Matt Reimer <mattjreimer@gmail.com> wrote:
> On Thu, Feb 18, 2010 at 10:57 AM, Matt Reimer <mattjreimer@gmail.com> wro=
te:
>>
>> On Tue, Feb 16, 2010 at 12:38 AM, Dan Naumov <dan.naumov@gmail.com> wrot=
e:
>>>
>>> > I don't know, but I plan to test that scenario in a few days.
>>> >
>>> > Matt
>>>
>>> Please share the results when you're done, I am really curious :)
>>
>> Booting from a stripe of two raidz vdevs works:
>> FreeBSD/i386 boot
>> Default: doom:/boot/zfsloader
>> boot: status
>> pool: doom
>> config:
>> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0NAME =A0 =A0 =A0STATE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0doom =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0raidz1 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-0 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-1 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-2 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0raidz1 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-3 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-4 =A0 =A0 ONLINE
>> =A0=A0 =A0 =A0 =A0 =A0 =A0label/doom-5 =A0 =A0 ONLINE
>> I'd guess a stripe of mirrors would work fine too. If I get a chance I'l=
l
>> test that combo.
>
> A stripe of three-way mirrors works:
> FreeBSD/i386 boot
> Default: mithril:/boot/zfsloader
> boot: status
> pool: mithril
> config:
> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0NAME =A0 =A0 =A0STATE
> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 mithril =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0mirror =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-0 =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-1 =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-2 =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0mirror =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-3 =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-4 =A0 =A0 ONLINE
> =A0=A0 =A0 =A0 =A0 =A0 =A0label/mithril-5 =A0 =A0 ONLINE
> Matt

A stripe of 3-way mirrors, whoa. Out of curiosity, what is the system
used for? I am not doubting that there exist some uses/workloads for a
system that uses 6 disks with 2 disks worth of usable space, but
that's a bit of an unusual configuration. What are your system/disc
specs and what kind of performance are you seeing from the pool?

- Sincerely,
Dan Naumov