From nobody Mon Jul 17 12:43:36 2023 X-Original-To: freebsd-fs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4R4MFl3JSqz4n5Mc for ; Mon, 17 Jul 2023 12:43:39 +0000 (UTC) (envelope-from SRS0=ASLf=DD=perdition.city=julien@bebif.be) Received: from orval.bbpf.belspo.be (orval.bbpf.belspo.be [193.191.208.90]) by mx1.freebsd.org (Postfix) with ESMTP id 4R4MFl2XwJz40TB for ; Mon, 17 Jul 2023 12:43:39 +0000 (UTC) (envelope-from SRS0=ASLf=DD=perdition.city=julien@bebif.be) Authentication-Results: mx1.freebsd.org; none Received: from x1 (unknown [212.233.36.45]) by orval.bbpf.belspo.be (Postfix) with ESMTPSA id DD08A1C5BC; Mon, 17 Jul 2023 14:43:38 +0200 (CEST) Date: Mon, 17 Jul 2023 14:43:36 +0200 From: Julien Cigar To: Willem Jan Withagen Cc: FreeBSD Filesystems Subject: Re: Having a disk double listes in a zraid3 pool Message-ID: References: <82861471-8c7d-a1e0-14aa-9a4e57901af0@digiware.nl> <15b852ec-cf95-9203-4a5f-763d1c2b9ba1@digiware.nl> List-Id: Filesystems List-Archive: https://lists.freebsd.org/archives/freebsd-fs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-fs@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="eszeibxw3z75no55" Content-Disposition: inline In-Reply-To: <15b852ec-cf95-9203-4a5f-763d1c2b9ba1@digiware.nl> X-Rspamd-Queue-Id: 4R4MFl2XwJz40TB X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:2611, ipnet:193.191.192.0/19, country:BE] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N --eszeibxw3z75no55 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Mon, Jul 17, 2023 at 02:31:35PM +0200, Willem Jan Withagen wrote: > On 17-7-2023 14:10, Julien Cigar wrote: > > On Mon, Jul 17, 2023 at 01:59:32PM +0200, Willem Jan Withagen wrote: > > > Hi, > > >=20 > > > I admit it is on Linux, but still hope to find the answer here... > > >=20 > > > When Replacing a broken disk I ended up with 2 times the same disk > > How did you replace the broken disk? > >=20 > > The correct way is to issue 1) zpool offline, 2) replace physical disk = and > > 3) gpart backup good_disk|gpart restore -F new_disk 4) zpool replace > >=20 > > Also, don't forget to boot code on the EFI partition > It was a bit more convoluted since it is a disk on an LSI 3108 in jbod mo= de. > So I needed to set JBOD on the disk and reboot. What do you mean by "set JBOD on the disk"..? > But yes, I first offlined the disk. > And after reboot replaced the disk. After replacing the physical disk did you issued zpool replace? It looks like you used zpool online instead of zpool replace >=20 > --WjW >=20 > >=20 > > > and thus the zraid is in DEGRADED state: > > > pool: zfs-data > > > state: DEGRADED > > > status: One or more devices has experienced an unrecoverable error. = An > > > attempt was made to correct the error. Applications are una= ffected. > > > action: Determine if the device needs to be replaced, and clear the e= rrors > > > using 'zpool clear' or replace the device with 'zpool replac= e'. > > > see: https://openzfs.github.io/openzfs-docs/msg/ZFS-8000-9P > > > scan: resilvered 1.09G in 00:01:10 with 0 errors on Mon Jul 17 13:= 36:10 > > > 2023 > > > config: > > >=20 > > > NAME STATE READ WRITE CKSUM > > > zfs-data DEGRADED 0 0 0 > > > raidz3-0 DEGRADED 0 0 0 > > > sdb ONLINE 0 0 0 > > > sdd ONLINE 0 0 0 > > > sde ONLINE 0 0 0 > > > sdf ONLINE 0 0 0 > > > sdg ONLINE 0 0 0 > > > sdh ONLINE 0 0 0 > > > sdi ONLINE 0 0 0 > > > sdj ONLINE 0 0 0 > > > sdk ONLINE 0 0 0 > > > sdl OFFLINE 0 0 0 > > > sdl ONLINE 0 0 0 > > > raidz3-1 ONLINE 0 0 0 > > > sdm ONLINE 0 0 0 > > > sdn ONLINE 0 0 0 > > > sdo ONLINE 0 0 0 > > > sdq ONLINE 0 0 5 > > > sdp ONLINE 0 0 5 > > > sdr ONLINE 0 0 0 > > > sds ONLINE 0 0 0 > > > sdt ONLINE 0 0 0 > > > sdu ONLINE 0 0 0 > > > sdv ONLINE 0 0 0 > > > sdw ONLINE 0 0 0 > > > sdx ONLINE 0 0 0 > > >=20 > > > errors: No known data errors > > >=20 > > > Any idea how to fix this? > > >=20 > > > Regards, > > > --WjW > > >=20 >=20 --=20 Julien Cigar Belgian Biodiversity Platform (http://www.biodiversity.be) PGP fingerprint: EEF9 F697 4B68 D275 7B11 6A25 B2BB 3710 A204 23C0 No trees were killed in the creation of this message. However, many electrons were terribly inconvenienced. --eszeibxw3z75no55 Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEEnF27CBNtOraRNmgqCLYqJMpBHmkFAmS1N3QACgkQCLYqJMpB Hmk8+w//b6IHJJv4W2mi1PzSk3nrL92z+LQj4YK4U0TQvKawubAzTaZvKcdD77LK mQzowAKBuqexb+t2XZKD7ZQdPmzYybhKpujI1bFl9wqyetXmTY0TMV/fR0CcBBg8 VNh4RAcoYc2JqTGk7Ixh56p7XnLWeG3ZQ9Ktmq5Zz5sIkRdv+ywoi2wVdcDiyXWP CubZmaisBHWZsGlAeg9AYqGPEBFMOYM4saxyMc1KnePSMQNkwYBbd5+gRQIIllB4 /ea9hXQ30B871cTx9AWXGOiSfJcIi/6oYKzjGPd9IVbmxXQW+Uux5lfb8mOSJgCA EOMK7Zd25+IqucslxlZEKH4eXOPJ8zuFTsM5oe3owWsa81nCrOJA+HXmI1BTqz0F lIqbMnBzOG93+TOVqCGRgIHRK2RSVK0TCxDkRuagdtGYBHbpPfc4xbB49hs/NfCT ePdetjPmL9opUrnzN8Pr3ekwhrqyADdlBpYHABj/nFGYd7Lqn21FIiqgoLAKW4lr zCwk1YIMboM6WPulw3VFmR4emQKlZHFkGFxRlRPQzvovHIhhmQiWQ/DjVhMz6QBh clHaYzsNRKESPJIAuzv5PFuUQhP3az40JbMQJDlQMesc3tQq8yI2BaJuh9EaVoLj GVFggyrIe5Q//SoYQHSMfzCySBUL4PYm0y6Tja3G6v7oYiNdtz4= =NHJ5 -----END PGP SIGNATURE----- --eszeibxw3z75no55--