From owner-freebsd-fs@freebsd.org Tue Mar 19 21:49:34 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1A8D1153D2D3 for ; Tue, 19 Mar 2019 21:49:34 +0000 (UTC) (envelope-from michelle@sorbs.net) Received: from hades.sorbs.net (hades.sorbs.net [72.12.213.40]) by mx1.freebsd.org (Postfix) with ESMTP id 51A0170BC9 for ; Tue, 19 Mar 2019 21:49:32 +0000 (UTC) (envelope-from michelle@sorbs.net) MIME-version: 1.0 Received: from [10.10.0.230] (gate.mhix.org [203.206.128.220]) by hades.sorbs.net (Oracle Communications Messaging Server 7.0.5.29.0 64bit (built Jul 9 2013)) with ESMTPSA id <0POM001O9VWUUY10@hades.sorbs.net> for freebsd-fs@freebsd.org; Tue, 19 Mar 2019 15:02:58 -0700 (PDT) Subject: Re: zfs corruption (again) due to interupted resilver and power faults. From: Michelle Sullivan X-Mailer: iPad Mail (16A404) In-reply-to: Date: Wed, 20 Mar 2019 08:49:26 +1100 Cc: "freebsd-fs@freebsd.org" Message-id: <21433606-416E-4BB9-9D17-01339F53E3B4@sorbs.net> References: To: Xin LI X-Rspamd-Queue-Id: 51A0170BC9 X-Spamd-Bar: - Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of michelle@sorbs.net designates 72.12.213.40 as permitted sender) smtp.mailfrom=michelle@sorbs.net X-Spamd-Result: default: False [-1.86 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:hades.sorbs.net]; NEURAL_HAM_LONG(-0.99)[-0.993,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[sorbs.net]; NEURAL_HAM_MEDIUM(-0.90)[-0.902,0]; NEURAL_SPAM_SHORT(0.26)[0.255,0]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: battlestar.sorbs.net]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[40.213.12.72.list.dnswl.org : 127.0.10.0]; IP_SCORE(-0.01)[country: US(-0.07)]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_NO_TLS_LAST(0.10)[]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; ASN(0.00)[asn:11114, ipnet:72.12.192.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 21:49:34 -0000 Trying now thanks (and no I hadn=E2=80=99t - wasn=E2=80=99t aware of the sys= ctl) Michelle Sullivan http://www.mhix.org/ Sent from my iPad > On 20 Mar 2019, at 05:21, Xin LI wrote: >=20 > 0x7a is 122, which is ECKSUM, it seems that your space map is corrupt. >=20 > Have you tried importing with vfs.zfs.recover=3D1 set in loader and import= the pool with -o readonly? >=20 > Cheers, >=20 >> On Tue, Mar 19, 2019 at 6:15 AM Michelle Sullivan wr= ote: >> So lost my pool again... this time looks more hopeless, but for simpler=20= >> reasons. >>=20 >> Basically a significant power issue occurred whilst in a resilver=20 >> process which I am lucky no-one was killed - though if I find the idiot=20= >> there is still time... >>=20 >> anyhoo, to the issue at hand... >>=20 >> FreeBSD 12 (memstick boot) >>=20 >> Can't import the pool 'storage' >>=20 >> All devices are now online (one wasn't but that issue has been resolved=20= >> by byte copying the drive to a new drive and inserting) >>=20 >> Its a zraid2 set... only the one drive had failed and was in the middle=20= >> of the resilver when the power issue occurred. >>=20 >> Pool refuses to import (even with -FfX) >>=20 >> zdb reports 4 metdata errors and no (zero) data errors... see:=20 >> http://flashback.sorbs.net/packages/zfs/image4.jpeg >>=20 >> 'zdb -bcd' asserts out in space_map_load (123 of 163) see:=20 >> http://flashback.sorbs.net/packages/zfs/image5.jpeg >>=20 >> Thoughts on how I might recover this? >>=20 >> (Really need to as was in the middle of blowing away the original=20 >> (backup) server for a rebuild and new backup.. so I have quite literally=20= >> no backups, and every photo I have taken are in that zvol on the pool -=20= >> there should be no reason why it's corrupt as with the exception of the=20= >> resilver - there was no active writing to the pool.) >>=20 >> Yours hopefully, >>=20 >> Michelle >>=20 >> --=20 >> Michelle Sullivan >> http://www.mhix.org/ >>=20 >> _______________________________________________ >> freebsd-fs@freebsd.org mailing list >> https://lists.freebsd.org/mailman/listinfo/freebsd-fs >> To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org"