From owner-freebsd-stable@freebsd.org Fri Jun 7 11:03:57 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6F0FA15A92FB for ; Fri, 7 Jun 2019 11:03:57 +0000 (UTC) (envelope-from SRS0=hBCs=UG=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (elsa.codelab.cz [94.124.105.4]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id D94086EE59 for ; Fri, 7 Jun 2019 11:03:56 +0000 (UTC) (envelope-from SRS0=hBCs=UG=quip.cz=000.fbsd@elsa.codelab.cz) Received: from elsa.codelab.cz (localhost [127.0.0.1]) by elsa.codelab.cz (Postfix) with ESMTP id 9B15A28416; Fri, 7 Jun 2019 13:03:46 +0200 (CEST) Received: from illbsd.quip.test (ip-62-24-92-232.net.upcbroadband.cz [62.24.92.232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by elsa.codelab.cz (Postfix) with ESMTPSA id 356432840C; Fri, 7 Jun 2019 13:03:45 +0200 (CEST) Subject: Re: ZFS... To: Michelle Sullivan , Steven Hartland Cc: freebsd-stable References: <30506b3d-64fb-b327-94ae-d9da522f3a48@sorbs.net> <70C87D93-D1F9-458E-9723-19F9777E6F12@sorbs.net> <5ED8BADE-7B2C-4B73-93BC-70739911C5E3@sorbs.net> <2e4941bf-999a-7f16-f4fe-1a520f2187c0@sorbs.net> <34539589-162B-4891-A68F-88F879B59650@sorbs.net> <576857a5-a5ab-eeb8-2391-992159d9c4f2@denninger.net> <7DBA7907-BE8F-4944-9A71-86E5AC1B85CA@gromit.dlib.vt.edu> <5c458075-351f-6eb6-44aa-1bd268398343@sorbs.net> <289FE04E-1692-4763-96B3-91E8C1BBBBD6@sorbs.net> <70d5e0d3-c188-7f06-cf53-702d565fd481@sorbs.net> From: Miroslav Lachman <000.fbsd@quip.cz> Message-ID: <8da1cee9-1f2a-3865-c51c-3cd8e905755b@quip.cz> Date: Fri, 7 Jun 2019 13:03:45 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Firefox/52.0 SeaMonkey/2.49.3 MIME-Version: 1.0 In-Reply-To: <70d5e0d3-c188-7f06-cf53-702d565fd481@sorbs.net> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Rspamd-Queue-Id: D94086EE59 X-Spamd-Bar: +++++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [5.46 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_SPAM_SHORT(0.87)[0.875,0]; IP_SCORE(0.95)[ip: (0.57), ipnet: 94.124.104.0/21(0.29), asn: 42000(3.84), country: CZ(0.08)]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[quip.cz]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.99)[0.992,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: elsa.codelab.cz]; NEURAL_SPAM_LONG(1.00)[1.000,0]; RCVD_IN_DNSWL_NONE(0.00)[4.105.124.94.list.dnswl.org : 127.0.10.0]; SUBJ_ALL_CAPS(0.45)[6]; R_SPF_NA(0.00)[]; FORGED_SENDER(0.30)[000.fbsd@quip.cz,SRS0=hBCs=UG=quip.cz=000.fbsd@elsa.codelab.cz]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:42000, ipnet:94.124.104.0/21, country:CZ]; FROM_NEQ_ENVFROM(0.00)[000.fbsd@quip.cz,SRS0=hBCs=UG=quip.cz=000.fbsd@elsa.codelab.cz]; MID_RHS_MATCH_FROM(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 07 Jun 2019 11:03:57 -0000 Michelle Sullivan wrote on 2019/06/07 01:49: >>> Yes but you seem to have done this with ZFS too, just not in this >>> particularly bad case. >>> >> There is no r-studio for zfs or I would have turned to it as soon as >> this issue hit. >> >> >> > So as an update, this Company: http://www.klennet.com/ produce a ZFS > recovery tool: https://www.klennet.com/zfs-recovery/default.aspx and > following several code changes due to my case being an 'edge case' the > entire volume (including the zvol - which I previously recovered as it > wasn't suffering from the metadata corruption) and all 34 million files > is being recovered intact with the entire directory structure.  Its only > drawback is it's a windows only tool, so I built 'windows on a stick' > and it's running from that.  The only thing I had to do was physically > pull the 'spare' out as the spare already had data on it from being > previously swapped in and it confused the hell out of the algorithm that > detects the drive order. It's really good to know there exists some tool which can recover files from broken ZFS. Thank you for sharing your very long story and I am glad you recovered all your data. It would be very nice to have similar tool running on FreeBSD... maybe it is good topic for next google summer of code project. Miroslav Lachman