From owner-freebsd-questions@freebsd.org Mon Feb 15 18:12:11 2021 Return-Path: Delivered-To: freebsd-questions@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id C22FE534D29 for ; Mon, 15 Feb 2021 18:12:11 +0000 (UTC) (envelope-from web@3dresearch.com) Received: from smtpg.telissant.net (smtpg.telissant.net [104.225.1.73]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DfXHt6Dnjz4srk for ; Mon, 15 Feb 2021 18:12:10 +0000 (UTC) (envelope-from web@3dresearch.com) Received: from sacada.3dresearch.com (localhost [127.0.0.1]) by smtpg.telissant.net (Postfix) with ESMTP id 4DfXHm5hygz2D1r6 for ; Mon, 15 Feb 2021 13:12:04 -0500 (EST) X-Virus-Scanned: amavisd-new at telissant.net Received: from smtpg.telissant.net ([127.0.0.1]) by sacada.3dresearch.com (sacada.3dresearch.com [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id HSII9l4JaVcY for ; Mon, 15 Feb 2021 13:12:04 -0500 (EST) Received: from bufftemp.3dresearch.com (unknown [71.112.244.15]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: bufftemp@sacada.3dresearch.com) by smtpg.telissant.net (Postfix) with ESMTPSA id 4DfXHm0mytz2D1r8 for ; Mon, 15 Feb 2021 13:12:04 -0500 (EST) Received: from bufftemp.3dresearch.com (localhost [127.0.0.1]) by bufftemp.3dresearch.com (Postfix) with SMTP id 707105DFF6 for ; Mon, 15 Feb 2021 13:12:03 -0500 (EST) Date: Mon, 15 Feb 2021 13:11:39 -0500 From: Janos Dohanics To: FreeBSD Questions Subject: zpool CKSUM 0 --> 1 while resilvering Message-Id: <20210215131139.c3ad9f9c9f907ee5b058fd37@3dresearch.com> X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.32; amd64-portbld-freebsd12.1) Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4DfXHt6Dnjz4srk X-Spamd-Bar: + Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of web@3dresearch.com designates 104.225.1.73 as permitted sender) smtp.mailfrom=web@3dresearch.com X-Spamd-Result: default: False [1.20 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; ENVFROM_SERVICE_ACCT(1.00)[]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+a:smtpg.telissant.net]; TO_DN_ALL(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[71.112.244.15:received]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[104.225.1.73:from]; MID_RHS_MATCH_FROM(0.00)[]; ASN(0.00)[asn:36236, ipnet:104.225.1.0/24, country:US]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; RCVD_COUNT_FIVE(0.00)[5]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-questions@freebsd.org]; DMARC_NA(0.00)[3dresearch.com]; RCPT_COUNT_ONE(0.00)[1]; SPAMHAUS_ZRD(0.00)[104.225.1.73:from:127.0.2.255]; NEURAL_SPAM_SHORT(1.00)[1.000]; FROM_SERVICE_ACCT(1.00)[]; MAILMAN_DEST(0.00)[freebsd-questions] X-BeenThere: freebsd-questions@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: User questions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 15 Feb 2021 18:12:11 -0000 Hello, I had to replace a hard drive which has failed a smart test. As the replacement hard drive was being resilvered, I have peridically checked the progress. Initially, everything looked fine: # zpool status pool: zroot state: ONLINE status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Sun Feb 14 20:44:20 2021 1.77T scanned at 291M/s, 179G issued at 28.7M/s, 1.97T total 179G resilvered, 8.88% done, 0 days 18:12:23 to go config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 replacing-1 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 ada3p3 ONLINE 0 0 0 ada2p3 ONLINE 0 0 0 errors: No known data errors But a little later CKSUM changed from 0 to 1: # zpool status pool: zroot state: ONLINE status: One or more devices is currently being resilvered. The pool will continue to function, possibly in a degraded state. action: Wait for the resilver to complete. scan: resilver in progress since Sun Feb 14 20:44:20 2021 1.84T scanned at 249M/s, 275G issued at 36.5M/s, 1.97T total 275G resilvered, 13.65% done, 0 days 13:35:00 to go config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 replacing-1 ONLINE 0 0 0 ada1p3 ONLINE 0 0 0 ada3p3 ONLINE 0 0 1 ada2p3 ONLINE 0 0 0 errors: No known data errors After resilvering has finished: # zpool status pool: zroot state: ONLINE status: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected. action: Determine if the device needs to be replaced, and clear the errors using 'zpool clear' or replace the device with 'zpool replace'. see: http://illumos.org/msg/ZFS-8000-9P scan: resilvered 1.97T in 0 days 08:25:27 with 0 errors on Mon Feb 15 05:09:47 2021 config: NAME STATE READ WRITE CKSUM zroot ONLINE 0 0 0 mirror-0 ONLINE 0 0 0 ada0p3 ONLINE 0 0 0 ada3p3 ONLINE 0 0 1 ada2p3 ONLINE 0 0 0 errors: No known data errors No errors reported by smartctl(8) for /dev/ada3. Can I consider this a harmless error and should I just run "zpool clear ada3p3'? Please advise. -- Janos Dohanics