From owner-freebsd-stable@FreeBSD.ORG Mon Jan 23 19:51:50 2012 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id F13581065672 for ; Mon, 23 Jan 2012 19:51:49 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp6.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) by mx1.freebsd.org (Postfix) with ESMTP id 7C4448FC0A for ; Mon, 23 Jan 2012 19:51:49 +0000 (UTC) Received: from seedling.black-earth.co.uk (seedling.black-earth.co.uk [IPv6:2001:8b0:151:1:fa1e:dfff:feda:c0bb]) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.14.5/8.14.5) with ESMTP id q0NJpfcj012333 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Mon, 23 Jan 2012 19:51:41 GMT (envelope-from m.seaman@infracaninophile.co.uk) X-DKIM: OpenDKIM Filter v2.4.2 smtp.infracaninophile.co.uk q0NJpfcj012333 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1327348301; bh=Iegsmk6EXGvR3l7jwgtnnrbeuvpm342FjtMk0z5vGpM=; h=Message-ID:Date:From:MIME-Version:To:CC:Subject:References: In-Reply-To:Content-Type; b=U5VfpeCDOqhhyZNhjn2d79A3L0sALR/xpTQffURXFLFKu7UFq60HyUYVWmkukIQXa 2fQeofPDZk41PkHGm27pf5mg1TR/OYy+BJVouHGoien1Mkv30i6aFl/62f7Utsgixg ZnOpxQyb8E0NyyZVtwrcxGFtN5HagJcnM7m+FE0U= Message-ID: <4F1DBA47.8080504@infracaninophile.co.uk> Date: Mon, 23 Jan 2012 19:51:35 +0000 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.6; rv:9.0) Gecko/20111222 Thunderbird/9.0.1 MIME-Version: 1.0 To: Steven Hartland References: <520B9285BCC0498286196195933D67E9@multiplay.co.uk> <4F1DA991.1060601@infracaninophile.co.uk> <7F1E17105173440B8C52DB9AAFA7A400@multiplay.co.uk> In-Reply-To: <7F1E17105173440B8C52DB9AAFA7A400@multiplay.co.uk> X-Enigmail-Version: 1.3.4 OpenPGP: id=60AE908C Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="------------enig88EDF986C89155EF28BD1E94" X-Virus-Scanned: clamav-milter 0.97.3 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-2.7 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU autolearn=ham version=3.3.2 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on lucid-nonsense.infracaninophile.co.uk Cc: freebsd-stable@freebsd.org Subject: Re: ZFS: i/o error - all block copies unavailable on large disk number machines X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jan 2012 19:51:50 -0000 This is an OpenPGP/MIME signed message (RFC 2440 and 3156) --------------enig88EDF986C89155EF28BD1E94 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable On 23/01/2012 19:29, Steven Hartland wrote: > Initially the zpool was just the first raidz2. Only after install > was the second raidz2 added to increase capacity. >=20 > So what I believe has happened is the new kernel when installed > happens to have data be located on the second raidz2 which > consists of disks not available to the BIOS and hence results in > "all block copies unavailable" from the boot code. Exactly what happened to me. You can run into this in a nasty way -- insert the drives, and expand the zpool on-line, and everything will carry on quite happily. Until you next reboot, when it just won't come back. And you can't undo the expansion of the pool: due to the copy-on-write behaviour of ZFS even overwriting a file in-place stands a 50% chance of being written to the new vdev. In my case, I fixed it by having a separate /boot on some USB sticks -- this was only ever accessed to read the kernel, kernel modules and bootloader at boot time, so no worries over performance. Cheers, Matthew --=20 Dr Matthew J Seaman MA, D.Phil. 7 Priory Courtyard Flat 3 PGP: http://www.infracaninophile.co.uk/pgpkey Ramsgate JID: matthew@infracaninophile.co.uk Kent, CT11 9PW --------------enig88EDF986C89155EF28BD1E94 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG/MacGPG2 v2.0.16 (Darwin) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk8duk0ACgkQ8Mjk52CukIzv9gCfbP0Lqr8fVBVsOuHnaFk9YrHE KjAAniRpSjDIjhKIlr7+3ch4krMMvDix =kC9P -----END PGP SIGNATURE----- --------------enig88EDF986C89155EF28BD1E94--