From owner-freebsd-hackers@freebsd.org Wed Jul 10 17:23:56 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF92315DDA40 for ; Wed, 10 Jul 2019 17:23:55 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7234D96D1B for ; Wed, 10 Jul 2019 17:23:55 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (Seawolf.HML3.ScaleEngine.net [209.51.186.28]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 5B7541CE37 for ; Wed, 10 Jul 2019 17:23:54 +0000 (UTC) Subject: Re: zpool errors To: freebsd-hackers@freebsd.org References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> From: Allan Jude Openpgp: preference=signencrypt Autocrypt: addr=allanjude@freebsd.org; prefer-encrypt=mutual; keydata= mQINBFVwZcYBEADwrZDH0xe0ZVjc9ORCc6PcBLwS/RTXA6NkvpD6ea02pZ8lPOVgteuuugFc D34LdDbiWr+479vfrKBh+Y38GL0oZ0/13j10tIlDMHSa5BU0y6ACtnhupFvVlQ57+XaJAb/q 7qkfSiuxVwQ3FY3PL3cl1RrIP5eGHLA9hu4eVbu+FOX/q/XVKz49HaeIaxzo2Q54572VzIo6 C28McX9m65UL5fXMUGJDDLCItLmehZlHsQQ+uBxvODLFpVV2lUgDR/0rDa0B9zHZX8jY8qQ7 ZdCSy7CwClXI054CkXZCaBzgxYh/CotdI8ezmaw7NLs5vWNTxaDEFXaFMQtMVhvqQBpHkfOD 7rjjOmFw00nJL4FuPE5Yut0CPyx8vLjVmNJSt/Y8WxxmhutsqJYFgYfWl/vaWkrFLur/Zcmz IklwLw35HLsCZytCN5A3rGKdRbQjD6QPXOTJu0JPrJF6t2xFkWAT7oxnSV0ELhl2g+JfMMz2 Z1PDmS3NRnyEdqEm7NoRGXJJ7bgxDbN+9SXTyOletqGNXj/bSrBvhvZ0RQrzdHAPwQUfVSU2 qBhQEi2apSZstgVNMan0GUPqCdbE2zpysg+zT7Yhvf9EUQbzPL4LpdK1llT9fZbrdMzEXvEF oSvwJFdV3sqKmZc7b+E3PuxK6GTsKqaukd/3Cj8aLHG1T1im1QARAQABtCJBbGxhbiBKdWRl IDxhbGxhbmp1ZGVAZnJlZWJzZC5vcmc+iQI/BBMBAgApBQJVcGXGAhsjBQkSzAMABwsJCAcD AgEGFQgCCQoLBBYCAwECHgECF4AACgkQGZU1PhKYC34Muw/+JOKpSfhhysWFYiRXynGRDe07 Z6pVsn7DzrPUMRNZfHu8Uujmmy3p2nx9FelIY9yjd2UKHhug+whM54MiIFs90eCRVa4XEsPR 4FFAm0DAWrrb7qhZFcE/GhHdRWpZ341WAElWf6Puj2devtRjfYbikvj5+1V1QmDbju7cEw5D mEET44pTuD2VMRJpu2yZZzkM0i+wKFuPxlhqreufA1VNkZXI/rIfkYWK+nkXd9Efw3YdCyCQ zUgTUCb88ttSqcyhik/li1CDbXBpkzDCKI6I/8fAb7jjOC9LAtrZJrdgONywcVFoyK9ZN7EN AVA+xvYCmuYhR/3zHWH1g4hAm1v1+gIsufhajhfo8/wY1SetlzPaYkSkVQLqD8T6zZyhf+AN bC7ci44UsiKGAplB3phAXrtSPUEqM86kbnHg3fSx37kWKUiYNOnx4AC2VXvEiKsOBlpyt3dw WQbOtOYM+vkfbBwDtoGOOPYAKxc4LOIt9r+J8aD+gTooi9Eo5tvphATf9WkCpl9+aaGbSixB tUpvQMRnSMqTqq4Z7DeiG6VMRQIjsXDSLJEUqcfhnLFo0Ko/RiaHd5xyAQ4DhQ9QpkyQjjNf /3f/dYG7JAtoD30txaQ5V8uHrz210/77DRRX+HJjEj6xCxWUGvQgvEZf5XXyxeePvqZ+zQyT DX61bYw6w6a5Ag0EVXBlxgEQAMy7YVnCCLN4oAOBVLZ5nUbVPvpUhsdA94/0/P+uqCIh28Cz ar56OCX0X19N/nAWecxL4H32zFbIRyDB2V/MEh4p9Qvyu/j4i1r3Ex5GhOT2hnit43Ng46z5 29Es4TijrHJP4/l/rB2VOqMKBS7Cq8zk1cWqaI9XZ59imxDNjtLLPPM+zQ1yE3OAMb475QwN UgWxTMw8rkA7CEaqeIn4sqpTSD5C7kT1Bh26+rbgJDZ77D6Uv1LaCZZOaW52okW3bFbdozV8 yM2u+xz2Qs8bHz67p+s+BlygryiOyYytpkiK6Iy4N7FTolyj5EIwCuqzfk0SaRHeOKX2ZRjC qatkgoD/t13PNT38V9tw3qZVOJDS0W6WM8VSg+F+bkM9LgJ8CmKV+Hj0k3pfGfYPOZJ/v18i +SmZmL/Uw2RghnwDWGAsPCKu4uZR777iw7n9Io6Vfxndw2dcS0e9klvFYoaGS6H2F13Asygr WBzFNGFQscN4mUW+ZYBzpTOcHkdT7w8WS55BmXYLna+dYer9/HaAuUrONjujukN4SPS1fMJ2 /CS/idAUKyyVVX5vozoNK2JVC1h1zUAVsdnmhEzNPsvBoqcVNfyqBFROEVLIPwq+lQMGNVjH ekLTKRWf59MEhUC2ztjSKkGmwdg73d6xSXMuq45EgIJV2wPvOgWQonoHH/kxABEBAAGJAiUE GAECAA8FAlVwZcYCGwwFCRLMAwAACgkQGZU1PhKYC34w5A//YViBtZyDV5O+SJT9FFO3lb9x Zdxf0trA3ooCt7gdBkdnBM6T5EmjgVZ3KYYyFfwXZVkteuCCycMF/zVw5eE9FL1+zz9gg663 nY9q2F77TZTKXVWOLlOV2bY+xaK94U4ytogOGhh9b4UnQ/Ct3+6aviCF78Go608BXbmF/GVT 7uhddemk7ItxM1gE5Hscx3saxGKlayaOsdPKeGTVJCDEtHDuOc7/+jGh5Zxpk/Hpi+DUt1ot 8e6hPYLIQa4uVx4f1xxxV858PQ7QysSLr9pTV7FAQ18JclCaMc7JWIa3homZQL/MNKOfST0S 2e+msuRwQo7AnnfFKBUtb02KwpA4GhWryhkjUh/kbVc1wmGxaU3DgXYQ5GV5+Zf4kk/wqr/7 KG0dkTz6NLCVLyDlmAzuFhf66DJ3zzz4yIo3pbDYi3HB/BwJXVSKB3Ko0oUo+6/qMrOIS02L s++QE/z7K12CCcs7WwOjfCYHK7VtE0Sr/PfybBdTbuDncOuAyAIeIKxdI2nmQHzl035hhvQX s4CSghsP319jAOQiIolCeSbTMD4QWMK8RL/Pe1FI1jC3Nw9s+jq8Dudtbcj2UwAP/STUEbJ9 5rznzuuhPjE0e++EU/RpWmcaIMK/z1zZDMN+ce2v1qzgV936ZhJ3iaVzyqbEE81gDxg3P+IM kiYh4ZtPB4Q= Message-ID: <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> Date: Wed, 10 Jul 2019 13:23:48 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.7.2 MIME-Version: 1.0 In-Reply-To: <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn" X-Rspamd-Queue-Id: 7234D96D1B X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [-2.98 / 15.00]; local_wl_from(0.00)[freebsd.org]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; NEURAL_HAM_SHORT(-0.98)[-0.981,0]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; ASN(0.00)[asn:6939, ipnet:209.51.160.0/19, country:US] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 10 Jul 2019 17:23:56 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn Content-Type: multipart/mixed; boundary="3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59"; protected-headers="v1" From: Allan Jude To: freebsd-hackers@freebsd.org Message-ID: <70f1be10-e37a-de20-e188-6155fda2d06a@freebsd.org> Subject: Re: zpool errors References: <52CE32B1-7E01-4C35-A2AB-84D3D5BD4E2F@cs.huji.ac.il> <27c3e59a-07ea-5df3-9de2-302d5290a477@freebsd.org> <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> In-Reply-To: <831204B6-3F3B-4736-89FA-1207C4C46A7E@cs.huji.ac.il> --3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59 Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 2019-07-10 11:37, Daniel Braniss wrote: >=20 >=20 >> On 10 Jul 2019, at 18:24, Allan Jude wrote: >> >> On 2019-07-10 10:48, Daniel Braniss wrote: >>> hi, >>> i got a degraded pool, but can=E2=80=99t make sense of the file name= : >>> >>> protonew-2# zpool status -vx >>> pool: h >>> state: ONLINE >>> status: One or more devices has experienced an error resulting in dat= a >>> corruption. Applications may be affected. >>> action: Restore the file in question if possible. Otherwise restore = the >>> entire pool from backup. >>> see: http://illumos.org/msg/ZFS-8000-8A >>> scan: scrub repaired 6.50K in 17h30m with 0 errors on Wed Jul 10 12:0= 6:14 2019 >>> config: >>> >>> NAME STATE READ WRITE CKSUM >>> h ONLINE 0 0 14.4M >>> gpt/r5/zfs ONLINE 0 0 57.5M >>> >>> errors: Permanent errors have been detected in the following files: >>> >>> <0x102>:<0x30723> >>> <0x102>:<0x30726> >>> <0x102>:<0x3062a> >>> =E2=80=A6 >>> <0x281>:<0x0> >>> <0x6aa>:<0x305cd> >>> <0xffffffffffffffff>:<0x305cd> >>> >>> >>> any hints as how I can identify third files? >>> >>> thanks, >>> danny >>> >>> _______________________________________________ >>> freebsd-hackers@freebsd.org mailing list >>> https://lists.freebsd.org/mailman/listinfo/freebsd-hackers >>> To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd= =2Eorg" >>> >> >> Once a file has been deleted, ZFS can have a hard time determining its= >> filename. >> >> It is inode 198186 (0x3062a) on dataset 0x102. The file has been >> deleted, but still exists in at least one snapshot. >> >> Although, 57 million checksum errors seems like there may be some othe= r >> problem. You might look for and resolve the problem with what appears = to >> be a raid5 you have built your ZFS pool on top of it? Then do 'zpool >> clear' to reset the counters to zero, and 'zpool scrub' to try to read= >> everything again. >> >> --=20 >> Allan Jude >> > I don=E2=80=99t know when the first error was detected, and this host h= as been up for 367 days! > I did a scrub but no change. > i will remove old snapshots and see if it helps. >=20 > is it possible to know at least which volume? >=20 > thanks, > danny >=20 >=20 > _______________________________________________ > freebsd-hackers@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-hackers > To unsubscribe, send any mail to "freebsd-hackers-unsubscribe@freebsd.o= rg" >=20 zdb -ddddd h 0x102 Should tell you about which dataset that is --=20 Allan Jude --3juXn4CmZuvoQmL2WPzxjRyfJ3EUVwj59-- --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJdJh8nAAoJEBmVNT4SmAt+tbgP/2YayvOpt7aNMPTUB20KkiOl nzU/KngyHy/ruLT5+SRx3dzTKDXoEbsaVS2wbczHlBaTwfaD8fjzNoMCC1XRe0uF cbO4/MI+B2QSSfFGcPfW5U/gltJ2hbhsZu8uKvZwzWd8tsBjWwLypRY2TO2/J+V0 ri1+Y79hqaiJWxjFTdjS+FsDXy4JRUP3T4tnS0i+llC70BGfSbymqEHr+I2yNCNR Xz4D5CCzzzLH8eiq6TUL/dj5K58jSow45WDBc7wTYqWil1IStHdS1AIKGiGohtOg 5JoAoTpH1pIUO88ndzdq8MHcroIs7uG/yxmM8wQCF7OS9ClH3bVczaMJUuyM+nJc Nr331AmraDqUfAckWMX1+hysI3/aLuGEpcyR3ycnmpt0jPk7KMWpu1OhG09423Tw g/h8jnma72nVQdBLPdLUyBEXQGG1RbeivnFX7bANJ5i8/PcWg86L3kXPn39/LSj8 FXUay81UnFFIj0aAAMGhMQ9Bf5UeT6ImalRthBM4CStBbyS7ucTsDZOCSj5RhNVy jO1OzMXjtloWuWkA9VzY85UmCuQpWBGVabY0YmUO3cD9mLBJ3pPoF/HN/PjxxZ3e 4ywxs0M2yNQoDt5LC702gLvTBLTMHc4yVCk3Qom9CJdReUYfdcm+Z/mw1Bg+OTK8 HVykq0IlJlWlFPAkIa/o =c3Wj -----END PGP SIGNATURE----- --cSLVop16jjz4EyS98zY5lSArhI0tAd7Gn--