From owner-freebsd-stable@FreeBSD.ORG Thu Oct 21 12:01:41 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 16F1610656A3 for ; Thu, 21 Oct 2010 12:01:41 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3fd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 657B48FC18 for ; Thu, 21 Oct 2010 12:01:40 +0000 (UTC) Received: from russet.local (reflex.squiz.co.uk [83.217.109.164]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.4/8.14.4) with ESMTP id o9LC1FHh069118 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Thu, 21 Oct 2010 13:01:35 +0100 (BST) (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: Sendmail DKIM Filter v2.8.3 smtp.infracaninophile.co.uk o9LC1FHh069118 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1287662495; bh=LTsSDBSviXM89eXLVyLPk/iunHelLrFaZzlhZi6Wuno=; h=Message-ID:Date:From:MIME-Version:To:Subject:Content-Type:Cc: Content-Type:Date:From:In-Reply-To:Message-ID:Mime-Version: References:To; z=Message-ID:=20<4CC02B85.1050604@infracaninophile.co.uk>|Date:=20T hu,=2021=20Oct=202010=2013:01:09=20+0100|From:=20Matthew=20Seaman= 20|User-Agent:=20Mozilla/5.0=20(M acintosh=3B=20U=3B=20Intel=20Mac=20OS=20X=2010.6=3B=20en-US=3B=20r v:1.9.2.11)=20Gecko/20101013=20Thunderbird/3.1.5|MIME-Version:=201 .0|To:=20freebsd-stable@freebsd.org|Subject:=20BIOS=20limitations= 20on=20size=20of=20bootable=20zpool?|X-Enigmail-Version:=201.1.1|C ontent-Type:=20multipart/signed=3B=20micalg=3Dpgp-sha1=3B=0D=0A=20 protocol=3D"application/pgp-signature"=3B=0D=0A=20boundary=3D"---- --------enigA8451D190525B3BEBD4AD15C"; b=Th/wEm7XpJVYopmayKMmsr2TMX6MmCi/cqdxILpUrNnvo0vE/aDFxJzdV+JK7kQnK hTzzgDi8jigAtTR08BCe2+CbNw8krqpPpT8HTRNKFafNFdOmvhrHfPZAKNEhQkW2e+ CyX4vANFu+ETSUSkTD6GNySLF9eAaiYKRPEDbMtA= X-Authentication-Warning: lucid-nonsense.infracaninophile.co.uk: Host reflex.squiz.co.uk [83.217.109.164] claimed to be russet.local Message-ID: <4CC02B85.1050604@infracaninophile.co.uk> Date: Thu, 21 Oct 2010 13:01:09 +0100 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10.6; en-US; rv:1.9.2.11) Gecko/20101013 Thunderbird/3.1.5 MIME-Version: 1.0 To: freebsd-stable@freebsd.org X-Enigmail-Version: 1.1.1 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enigA8451D190525B3BEBD4AD15C" X-Virus-Scanned: clamav-milter 0.96.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-0.1 required=5.0 tests=BAYES_40,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,SPF_FAIL autolearn=no version=3.3.1 X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on lucid-nonsense.infracaninophile.co.uk Subject: BIOS limitations on size of bootable zpool? X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Oct 2010 12:01:41 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enigA8451D190525B3BEBD4AD15C Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Dear all, I'm happy that gptzfsloader will work with just about any zpool configuration you could imagine, but... We have an HP DL185 G5 with a P400 raid array, fully populated with 12 drives. Since there's no JBOD mode (or at least, not one you can get to from the BIOS configuration screens), the array is configured as 12 single disk RAID0 arrays. As I posted about previously, we had FreeBSD 8.1-STABLE installed on a 6 disk raidz1, and everything was happy. However, we were having some difficulty adding a second vdev -- another raidz1 using the other 6 drives. Well, to cut a long story short: eventually we did this by hot-plugging disks 7 -- 12 after FreeBSD was up and running. Everything was cool and dandy, and we had the server running on all drives after setting up gpt partition tables and doing a 'zpool add'. Until we tested rebooting. On attempted reboot, the loader reported 8 drives, and subsequently ZFS flailed with the dreaded "ZFS: i/o error - all block copies unavailable" error. Now, we've had a poke through FreeBSD sources, and as far as we can tell, FreeBSD will work with up to 31 devices being reported from the BIOS. Is this correct, and the limitation is in what the hardware is reporting to the loader at the early stages of booting? Any good tricks for getting round this sort of limitation? Our current plan is to set up a USB memstick with /boot on it, by adapting the instructions here: http://wiki.freebsd.org/RootOnZFS/UFSBoot -- which isn't ideal as the memstick will be a single point of failure. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enigA8451D190525B3BEBD4AD15C Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.14 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAkzAK4sACgkQ8Mjk52CukIzsWACfUQxROivaVkiCyAAFxhjesDdQ zhUAnR1JIP9teR7JCiuWXLdas8+oWiUI =GIzX -----END PGP SIGNATURE----- --------------enigA8451D190525B3BEBD4AD15C--