From owner-freebsd-stable@FreeBSD.ORG Mon Jan 23 18:40:24 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 88ECB1065674 for ; Mon, 23 Jan 2012 18:40:24 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 17A428FC17 for ; Mon, 23 Jan 2012 18:40:23 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [IPv6:2001:8b0:151:1:fa1e:dfff:feda:c0bb]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.5/8.14.5) with ESMTP id q0NIeHrg011043 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO) for ; Mon, 23 Jan 2012 18:40:17 GMT (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: OpenDKIM Filter v2.4.2 smtp.infracaninophile.co.uk q0NIeHrg011043 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1327344017; bh=6dwaPhYtRiHcQeQ3VQsdeJ650NJgx6Y62uet1RJxArk=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Cc; b=yvlocgggEZn/Tpdid9Rq7pJvWPmVzBTkZNjOSUTA1U8yI1CJ17H/ytYWcuS2DjmOh VlT0rLj11t+v59Gh6mL0eiZeyE+Pddl3SjRgrubivXUbEhW0x6upNLA0c7SFFciWLo JiZen1tEta7eyJ5Xe1Zbk1pu3jG5+mWjabXITZ2g= Message-ID: <4F1DA991.1060601@infracaninophile.co.uk> Date: Mon, 23 Jan 2012 18:40:17 +0000 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0) Gecko/20111222 Thunderbird/9.0.1 MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <520B9285BCC0498286196195933D67E9@multiplay.co.uk> In-Reply-To: X-Enigmail-Version: 1.3.4 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig20E882F3DCD15B4FEC0F94EE" X-Virus-Scanned: clamav-milter 0.97.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-2.7 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU autolearn=ham version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on lucid-nonsense.infracaninophile.co.uk Subject: Re: ZFS: i/o error - all block copies unavailable on large disk number machines X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2012 18:40:24 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig20E882F3DCD15B4FEC0F94EE Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 23/01/2012 18:06, Chuck Swiger wrote: > On Jan 23, 2012, at 9:04 AM, Steven Hartland wrote: >> After some digging we discovered that this was likely due to the >> fact that the BIOS only enumerates the first 12 disks and this >> machine has more than that in the root zpool which was a striped >> raidz2 volume. This in turn means that the bootcode can't complete >> and hence the machine can't boot. >=20 > As far as I can tell, ZFS best practices guides recommend no more > than nine drives in a group/pool. Putting more than that into a > pool, much less something you are trying to boot from, seems like a > fine experiment to make but is not something which I would rely > upon... Even if you do split up your pool into vdevs using 8 drives, you will still run into the problem with zfs being unable to assemble the pool unless it sees all of the drives in it. Interesting that this only appeared as part of a minor kernel update. I ran into this myself with 8-STABLE, no indication that there was a fix possible by juggling kernels. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enig20E882F3DCD15B4FEC0F94EE Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk8dqZEACgkQ8Mjk52CukIyRaACfdxt6Yeps/crY8Lrh4ldEBGP8 lJMAn00A+7wbgHSfu8JS+Z+qDS8esyjr =Q17E -----END PGP SIGNATURE----- --------------enig20E882F3DCD15B4FEC0F94EE--