From owner-freebsd-fs@freebsd.org Tue Mar 19 18:22:08 2019 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id ACCE01530233 for ; Tue, 19 Mar 2019 18:22:08 +0000 (UTC) (envelope-from delphij@gmail.com) Received: from mail-it1-x135.google.com (mail-it1-x135.google.com [IPv6:2607:f8b0:4864:20::135]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 9A70469DDD for ; Tue, 19 Mar 2019 18:22:07 +0000 (UTC) (envelope-from delphij@gmail.com) Received: by mail-it1-x135.google.com with SMTP id g17so27519283ita.2 for ; Tue, 19 Mar 2019 11:22:07 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=P6yn/WfkAaRrv6UeQnmN/4k0hhdxlluEp2wlJa/Aa6U=; b=mSOCtYmxGdMlE9iOs10tp569jQDVX2Pcf9DpIMhE2N0bqzfXOBOgjcdGIUnhBMKrrl 1VB25yJcFW7jFJUscYwJHKEaJe4vApVxWkOyfC1u8Cm4lghzHgCAMPG/hObrpzV8lANH yNltsA8DVkypqxiKkmmxgvxW4rZZQaqcW4het/PJh38DvGc0JlRJt+vZKvv/bHahoIJF +9ZKT5MAxobgOjXb1sbJ2xWzjj3dUXAVxeQgvrg8F1Kb91PwRmOREIZwoK01WaSUB7iG XlgkpBSiHfzm81YNvKYVNdv1jdbSF0pZwlzgrKya4zKJnUH6KSc3OTTn1aYCuFB88lIO ahNQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=P6yn/WfkAaRrv6UeQnmN/4k0hhdxlluEp2wlJa/Aa6U=; b=hz+lXjGHNTeaMaQu23VbiJP1KOJb6pAvLHGddIg+RgJrDIgGZ0eFVXHpRPLAaCFHpe 1p0ZHejbsbiiejlSH+FUGIYgBqlGb+RqSv/0r15CRjIeQmMeFWZnWHEEdhhC6+NpyGHq nPSuNaoeIRqqq0gu0df1GtAzci0RNG96kPChqyRhtN+b4ZapipNeqzMvQNyCobFIlLUv JaOMCu5V+udCZO1pRqZ0hh4l8hxQWJXcXm7Ti987Ut6F8YwXiOda6qTvLhgQnpKwBGSl Lccjo2r1F9hhtjE1cU4BXMhID/b8KzyIaXEUu+pOItXXNi9ZtDGPRsgYtxi7UsuIMRHQ AlZw== X-Gm-Message-State: APjAAAXGsLsHwC6zVBe0AtElFhhHS57ErpXrecVDymbQikqb9X66x+bB t+IslrH1kF29KoId60+9fC4eJUy7tOgzqmCB8rcKKaxfOdY= X-Google-Smtp-Source: APXvYqwc48WQIU+98QB3RrRJ4dYy76121xvPe59e8Qk1g9YCqHIpg/GAYBGSIBydZhvgcTK7G1lqOrh6/0sX3jrHfIc= X-Received: by 2002:a24:3554:: with SMTP id k81mr1957932ita.41.1553019726563; Tue, 19 Mar 2019 11:22:06 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Xin LI Date: Tue, 19 Mar 2019 11:21:54 -0700 Message-ID: Subject: Re: zfs corruption (again) due to interupted resilver and power faults. To: Michelle Sullivan Cc: "freebsd-fs@freebsd.org" X-Rspamd-Queue-Id: 9A70469DDD X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=mSOCtYmx; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of delphij@gmail.com designates 2607:f8b0:4864:20::135 as permitted sender) smtp.mailfrom=delphij@gmail.com X-Spamd-Result: default: False [-6.61 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; FREEMAIL_FROM(0.00)[gmail.com]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.96)[-0.957,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-fs@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[5.3.1.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.64)[ip: (-8.26), ipnet: 2607:f8b0::/32(-2.78), asn: 15169(-2.11), country: US(-0.07)]; RCVD_COUNT_TWO(0.00)[2] Content-Type: text/plain; charset="UTF-8" X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Mar 2019 18:22:08 -0000 0x7a is 122, which is ECKSUM, it seems that your space map is corrupt. Have you tried importing with vfs.zfs.recover=1 set in loader and import the pool with -o readonly? Cheers, On Tue, Mar 19, 2019 at 6:15 AM Michelle Sullivan wrote: > So lost my pool again... this time looks more hopeless, but for simpler > reasons. > > Basically a significant power issue occurred whilst in a resilver > process which I am lucky no-one was killed - though if I find the idiot > there is still time... > > anyhoo, to the issue at hand... > > FreeBSD 12 (memstick boot) > > Can't import the pool 'storage' > > All devices are now online (one wasn't but that issue has been resolved > by byte copying the drive to a new drive and inserting) > > Its a zraid2 set... only the one drive had failed and was in the middle > of the resilver when the power issue occurred. > > Pool refuses to import (even with -FfX) > > zdb reports 4 metdata errors and no (zero) data errors... see: > http://flashback.sorbs.net/packages/zfs/image4.jpeg > > 'zdb -bcd' asserts out in space_map_load (123 of 163) see: > http://flashback.sorbs.net/packages/zfs/image5.jpeg > > Thoughts on how I might recover this? > > (Really need to as was in the middle of blowing away the original > (backup) server for a rebuild and new backup.. so I have quite literally > no backups, and every photo I have taken are in that zvol on the pool - > there should be no reason why it's corrupt as with the exception of the > resilver - there was no active writing to the pool.) > > Yours hopefully, > > Michelle > > -- > Michelle Sullivan > http://www.mhix.org/ > > _______________________________________________ > freebsd-fs@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-fs > To unsubscribe, send any mail to "freebsd-fs-unsubscribe@freebsd.org" >