From owner-freebsd-questions@freebsd.org Thu Aug 29 05:59:34 2019 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 62CB1CACCC for ; Thu, 29 Aug 2019 05:59:34 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) Received: from admin.sibptus.ru (admin.sibptus.ru [IPv6:2001:19f0:5001:21dc::10]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46JsPx1y1pz4FW4 for ; Thu, 29 Aug 2019 05:59:32 +0000 (UTC) (envelope-from vas@mpeks.tomsk.su) DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=sibptus.ru; s=20181118; h=In-Reply-To:Message-ID:Subject:To:From:Date; bh=YAXSgEM36LxgGV7hVgh0v0GjUrbq7VcvlroXvy+3aQg=; b=UalNGi6XmqB3g4n8bY6vBqxYkt 5ZFBci3KhdZVEHu7D1kGQvaD/DtVhFL9dzQAVcIYEQo8Th/Z8SCuNAdcvYUiL5vT0b8heKlKTndaF N5aJvsXTn5u5TSUa/eDplctUOcWr72WKI/xqCRnihkgz0eZUd3mb5NOEWjQpycKo0Gl0=; Received: from vas by admin.sibptus.ru with local (Exim 4.92.1 (FreeBSD)) (envelope-from ) id 1i3DSu-00099n-Qm for freebsd-questions@freebsd.org; Thu, 29 Aug 2019 12:59:24 +0700 Date: Thu, 29 Aug 2019 12:59:24 +0700 From: Victor Sudakov To: freebsd-questions@freebsd.org Subject: Re: Kernel panic and ZFS corruption on 11.3-RELEASE Message-ID: <20190829055924.GA34810@admin.sibptus.ru> References: <20190828025728.GA1441@admin.sibptus.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="M9NhX3UHpAaciwkO" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://admin.sibptus.ru/~vas/ X-PGP-Fingerprint: 10E3 1171 1273 E007 C2E9 3532 0DA4 F259 9B5E C634 User-Agent: Mutt/1.12.1 (2019-06-15) Sender: Victor Sudakov X-Rspamd-Queue-Id: 46JsPx1y1pz4FW4 X-Spamd-Bar: -------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=sibptus.ru header.s=20181118 header.b=UalNGi6X; dmarc=none; spf=pass (mx1.freebsd.org: domain of vas@mpeks.tomsk.su designates 2001:19f0:5001:21dc::10 as permitted sender) smtp.mailfrom=vas@mpeks.tomsk.su X-Spamd-Result: default: False [-8.45 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[sibptus.ru:s=20181118]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; TO_DN_NONE(0.00)[]; DMARC_NA(0.00)[tomsk.su]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; IP_SCORE(-2.86)[ip: (-9.12), ipnet: 2001:19f0:5000::/38(-4.56), asn: 20473(-0.58), country: US(-0.05)]; DKIM_TRACE(0.00)[sibptus.ru:+]; NEURAL_HAM_SHORT(-0.99)[-0.992,0]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:20473, ipnet:2001:19f0:5000::/38, country:US]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 29 Aug 2019 05:59:34 -0000 --M9NhX3UHpAaciwkO Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable David Christensen wrote: >=20 > > after which the ZFS pool became corrupt: > >=20 > > pool: d02 > > state: FAULTED > > status: The pool metadata is corrupted and the pool cannot be opened. > > action: Recovery is possible, but will result in some data loss. > > Returning the pool to its state as of =D0=B2=D1=82=D0=BE=D1=80=D0=BD= =D0=B8=D0=BA, 27 =D0=B0=D0=B2=D0=B3=D1=83=D1=81=D1=82=D0=B0 2019 =D0=B3. 23= :51:20 > > should correct the problem. Approximately 9 minutes of data > > must be discarded, irreversibly. Recovery can be attempted > > by executing 'zpool clear -F d02'. A scrub of the pool > > is strongly recommended after recovery. > > see: http://illumos.org/msg/ZFS-8000-72 > > scan: resilvered 423K in 0 days 00:00:05 with 0 errors on Sat Sep 30= 04:12:20 2017 > > config: > >=20 > > NAME STATE READ WRITE CKSUM > > d02 FAULTED 0 0 2 > > ada2.eli ONLINE 0 0 12 > >=20 > > However, "zpool clear -F d02" results in error: > > cannot clear errors for d02: I/O error > >=20 > > Do you know if there is a way to recover the data, or should I say fare= well to several hundred Gb of anime? >=20 > >=20 >=20 > I would: >=20 > 1. Take a binary image of the raw disk (e.g. backup). The data is not worth the trouble. >=20 > 2. Move the disk to an 11.2 system and work on it. Or alternatively,=20 > remove the 11.3 system disk and install an 11.2 system disk. Fortunately, I have an 11.2 guest in bhyve. I exported the pool from the host system, made the physical device with the problematic pool available to the guest, and voila: https://termbin.com/6kh8 My pool is up and running. Thank you! I'm only wondering now, if I did an export/import on a 11.3 system, would it have made any difference? --=20 Victor Sudakov, VAS4-RIPE, VAS47-RIPN 2:5005/49@fidonet http://vas.tomsk.ru/ --M9NhX3UHpAaciwkO Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEcBAEBAgAGBQJdZ2m8AAoJEA2k8lmbXsY0s1cH/1bndThgYuQNTdeNknIoEnjb 2GRJwggs/0f8QwvWiziVGvN1PhhDJYnDivgaljFVKJwecc9tobh/D+G57fjm2JKN pNTSIWDQ5VmPCPpb8a6ezGBrYHaY9zJVrZ2YjAV2E68Ghh3VHnpwXxs3Il2OasPw HFVm/37miIl6gH+1OngLs1S+A5/q8sq3596qRfbrNaBT2z4rve5gI5Y85xq8Gn7V 4/N6JY9kO9K88cAwKv7qPv4etqoJlsR/tQ41+GqhEENz2iziyi/Ogw0PWWnHS6q3 1O5dVSENddFvj5XHHBy3WJbgeHuDlkmt9c4kkrM3s57CbcK09mAZolAd+gM29Wg= =9jf/ -----END PGP SIGNATURE----- --M9NhX3UHpAaciwkO--