From owner-freebsd-stable@freebsd.org Thu Sep 13 20:58:35 2018 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id BAE0C1099174 for ; Thu, 13 Sep 2018 20:58:35 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from hz.grosbein.net (hz.grosbein.net [IPv6:2a01:4f8:d12:604::2]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "hz.grosbein.net", Issuer "hz.grosbein.net" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 31D408265D for ; Thu, 13 Sep 2018 20:58:34 +0000 (UTC) (envelope-from eugen@grosbein.net) Received: from eg.sd.rdtc.ru (eg.sd.rdtc.ru [IPv6:2a03:3100:c:13:0:0:0:5]) by hz.grosbein.net (8.15.2/8.15.2) with ESMTPS id w8DKwPXt080343 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 13 Sep 2018 22:58:26 +0200 (CEST) (envelope-from eugen@grosbein.net) X-Envelope-From: eugen@grosbein.net X-Envelope-To: mike@sentex.net Received: from [10.58.0.4] ([10.58.0.4]) by eg.sd.rdtc.ru (8.15.2/8.15.2) with ESMTPS id w8DKwHq8028526 (version=TLSv1.2 cipher=DHE-RSA-AES128-SHA bits=128 verify=NOT); Fri, 14 Sep 2018 03:58:17 +0700 (+07) (envelope-from eugen@grosbein.net) Subject: Re: ZFS: i/o error - all block copies unavailable To: Mike Tancsa , FreeBSD-STABLE Mailing List References: <2fc1f80f-c92d-4b9a-18a5-88718b076ac5@sentex.net> From: Eugene Grosbein Message-ID: <28d33017-bc79-171b-08bc-04fe6dc9804a@grosbein.net> Date: Fri, 14 Sep 2018 03:58:13 +0700 User-Agent: Mozilla/5.0 (Windows NT 6.3; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <2fc1f80f-c92d-4b9a-18a5-88718b076ac5@sentex.net> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=0.3 required=5.0 tests=BAYES_00,LOCAL_FROM,SPF_PASS autolearn=no autolearn_force=no version=3.4.1 X-Spam-Report: * -0.0 SPF_PASS SPF: sender matches SPF record * -2.3 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 2.6 LOCAL_FROM From my domains X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on hz.grosbein.net X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 13 Sep 2018 20:58:35 -0000 14.09.2018 3:42, Mike Tancsa wrote: > I have been getting the above error at boot time (I think) for some time > even though the box boots just fine. The server boots from a pair of > SSDs in mirror and then a number of other pools off different > controllers get mounted. All the pools show fine but I am curious if > this error will come to something worse in the future. Googling around > seems to point to different issues and goes back to RELENG8 days. The > box is AMD64, RELENG_11 r338656 > > drive R: is disk15 \ > BIOS drive S: is disk16 > \ > BIOS drive T: is disk17 > \ > BIOS drive U: is disk18 > \ > ZFS: i/o error - all block copies unavailable > \ > ZFS: i/o error - all block copies unavailable > > BIOS 603kB/1915980kB available memory > - > > \ > FreeBSD/x86 ZFS enabled bootstrap loader, Revision 1.1 > - > \ > Loading /boot/defaults/loader.conf > - > > ... normal boot after that > > > pool: zroot > state: ONLINE > scan: resilvered 38.6G in 0h2m with 0 errors on Tue Sep 4 14:06:40 2018 > config: > > NAME STATE READ WRITE CKSUM > zroot ONLINE 0 0 0 > mirror-0 ONLINE 0 0 0 > gpt/zfs0 ONLINE 0 0 0 > ada1p3 ONLINE 0 0 0 > > errors: No known data errors > > ada1 was replaced recently as its wear level was reaching 0, but the > errors were there prior to replacement Do you use MBR or GPT for boot mirror? If that is MBR, the error seems to come from zfsboot(8) that has small stripped-down read-only implementation of ZFS that may lack support for some of zpool-features(7), so you will not see any problems checking boot pool after kernel has loaded full-blown ZFS code.