From owner-freebsd-questions@freebsd.org Wed Feb 24 00:10:23 2016 Return-Path: Delivered-To: freebsd-questions@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 43EA7AB2E1A for ; Wed, 24 Feb 2016 00:10:23 +0000 (UTC) (envelope-from dan@langille.org) Received: from clavin2.langille.org (clavin2.langille.org [199.233.228.197]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "clavin.langille.org", Issuer "StartCom Class 2 Primary Intermediate Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 030D81A92 for ; Wed, 24 Feb 2016 00:10:22 +0000 (UTC) (envelope-from dan@langille.org) Received: from (clavin2.int.langille.org (clavin2.int.unixathome.org [10.4.7.7]) (Authenticated sender: hidden) with ESMTPSA id 55F2CA30D ; Wed, 24 Feb 2016 00:10:21 +0000 (UTC) Subject: Re: ZFS: i/o error - all block copies unavailable Mime-Version: 1.0 (Mac OS X Mail 9.2 \(3112\)) Content-Type: multipart/signed; boundary="Apple-Mail=_135255AB-6420-451E-8825-E4ECCFF984F4"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail 2.6b2 From: Dan Langille In-Reply-To: <56CB53D5.1030709@sentex.net> Date: Tue, 23 Feb 2016 19:10:20 -0500 Cc: freebsd-questions@freebsd.org Message-Id: <49CF108E-BF95-4213-827C-C17A812AD958@langille.org> References: <5C208714-5117-4089-A872-85A6375856B7@langille.org> <56CB53D5.1030709@sentex.net> To: Mike Tancsa X-Mailer: Apple Mail (2.3112) X-Content-Filtered-By: Mailman/MimeDel 2.1.20 X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Feb 2016 00:10:23 -0000 --Apple-Mail=_135255AB-6420-451E-8825-E4ECCFF984F4 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Feb 22, 2016, at 1:30 PM, Mike Tancsa wrote: >=20 > On 2/22/2016 12:41 PM, Dan Langille wrote: >> I have a FreeBSD 10.2 (with freebsd-update applied) system at home >> which cannot boot. The message is: ZFS: i/o error - all block >> copies unavailable ZFS: can't read MOS of pool system gptzfsboot: >> failed to mount default pool system >>=20 >> I booted the box via mfsBSD thumb drive, and was able to import >> the zpool: https://gist.github.com/dlangille/6da065e309301196b9cd >> >>=20 >> I have also run: "gpart bootcode -b /boot/pmbr -p /boot/gptzfsboot >> -i 1 XXX" against each drive. I did with the the files provided >> with mfsBSD and with the files from my local 10.2 system. Neither >> solution changed the booting problem. >=20 > This is a longshot, but I ran into an odd situation like this as well = a > few weeks ago. >=20 > It seems on the motherboard I was using, when the "DUAL" boot option > is enabled in the BIOS, present all the disks to the loader early in > the boot process. >=20 > So, when you escape to the loader prompt, and do >=20 >=20 > OK lsdev > cd devices: > disk devices: > disk0:BIOS drive C: > disk1:BIOS drive D: > disk2:BIOS drive E: > disk3:BIOS drive F: > pxe devices: > zfs devices: > zfs:zroot > OK >=20 >=20 > In this case, 4 of the disks that are normally part of the zroot were > not there resulting in >=20 > ZFS: i/o error - all block copies unavailable >=20 > Disabling the "DUAL" option in the BIOS and going back to legacy and > listing all the drives as possible boot drives, then presents to the > zfsloader all the disks, so we see the familiar > BIOS drive C: is disk0 > BIOS drive D: is disk1 > BIOS drive E: is disk2 > BIOS drive F: is disk3 > BIOS drive G: is disk4 > BIOS drive H: is disk5 > BIOS drive I: is disk6 > BIOS drive J: is disk7 >=20 > This is a Supermicro SYS-7048R-C1RT4+ X10DRC-T4+ (BIOS 01/29/2015) >=20 > Prior to the reboot, the other drives were not used by the zfs pool, = but > were added. Since the old pool didnt need them, it didnt matter. >=20 > Its a longshot that this is your problem, but I will takes the chances > today :) Since we last posted: - a drive partition issue was identified and fixed. glabel status = output disagreed with gpart output. (thanks to Josh Paetzel) - the drive was repartitioned and a resilvering occurred overnight. - the system would not boot this morning: ### ZFS: i/o error - all block copies unavailable ZFS: can't read MOS object directory ZFS: can't find root filesystem gptzfsboot: failed to mount default pool system FreeBBSD/x86 boot ZFS: i/o error - all block copies unavailable ZFS: can't find dataset u Default: system/<0x0>: boot: ### - While booting into mfsBSD to issue zpool set cachefile, I noticed that = I saw only three drives while booting. I looked in BIOS but didn't find what I was looking for, but I did find = it in the LSI card setting. During the debugging of the original problem, I changed the Boot Support setting on = the LSI card from BIOS & OS to OS Only. It did not help, but the debugging change was never reverted. - I made that change, rebooted the server, and it's back. see also: https://forums.freebsd.org/threads/55227/#post-312830 = Thank you. Mike: You were right. :) -- Dan Langille - BSDCan / PGCon dan@langille.org --Apple-Mail=_135255AB-6420-451E-8825-E4ECCFF984F4 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - http://gpgtools.org iQJ8BAEBCgBmBQJWzPTsXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQ1MTE2RjM0ODIzRDdERDM4OTY0OUJBNzdF QjIxNTlERUU5NzI3MzlGAAoJEOshWd7pcnOfq5sP/RvyIPeHO6upFXdqNJtuPn6s 0XFl+aiYoiPYL4qdIyabyykxp5UXSyCqek58ghfpa0/zFNMNYgnTw6SijpQ2EtrE ypKnqjIjW80xpodb2Qq8Hu3pOs6rkDUCy5JzHyInPuMHSqYiVJX/V3tYLZuulz4o 5A95ngSGavm5Z2H8qTl+jCOHFAwy27fL1iRJGjiHEXBKDPEQXHKeRtpXq9Hp6DOU ZtcakwmSMu+7GxWblDYHSGePSxsMrVFtek96Z6VGMneP3cIFpGa5v1eUFnTNEdXO suXl9E2GsCjRzaGgrZwTziFjv8LCZDruaBeGOLiERnZ+6/l+6yPfeNSy9g3p/qPf Y6sL2GMu8+25InL+Ioekp8li+gYlu84+m3xbmPap6A0CAb7TXRBrJr74roJybrsw LUtLkAsNFdcT6AqZHepzVK2qUCP0I6lDz59Y9AI89Tqc/H6g5KsZJHaSHfhhlrWw quTH7R2Dy40uSuLE4ibGYt59M/kqtmsPMSH1ySdy8+Ry/6PPZYpyoliUEURwDGZc Fv3dTmMakN74MYMepftA6YTgCXHGpJGJVB2VQtk38JRVTCZoa6p4vcXJfFvOWHtC edN8wzfXoGzr8/LuTjz5btDI4YZmt2aETWv9dO5M9b3JutlfsYESNAllhgvtI7en 9l8UVymsBtNtuntGtPn5 =WEzJ -----END PGP SIGNATURE----- --Apple-Mail=_135255AB-6420-451E-8825-E4ECCFF984F4--