From owner-freebsd-fs@freebsd.org Wed Jul 8 16:54:29 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4065F996074 for ; Wed, 8 Jul 2015 16:54:29 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "infracaninophile.co.uk" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D59AD15DF for ; Wed, 8 Jul 2015 16:54:28 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from ox-dell39.ox.adestra.com (no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged)) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.15.1/8.15.1) with ESMTPSA id t68GsHwT065943 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Wed, 8 Jul 2015 17:54:17 +0100 (BST) (envelope-from m.seaman@infracaninophile.co.uk) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none header.from=infracaninophile.co.uk DKIM-Filter: OpenDKIM Filter v2.9.2 smtp.infracaninophile.co.uk t68GsHwT065943 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1436374458; bh=sg6aKJ/eL4Jwr1dOKMRZQ+de+JwWTCXeo8e17okTkZQ=; h=Date:From:To:Subject:References:In-Reply-To; z=Date:=20Wed,=2008=20Jul=202015=2017:54:10=20+0100|From:=20Matthew =20Seaman=20|To:=20freebsd-fs@fre ebsd.org|Subject:=20Re:=20Speeding=20up=20resilvering|References:= 20<559D2AB6.5070007@FreeBSD.org>=20<559D2C7C.6060201@denninger.net >=20<559D3167.1000705@infracaninophile.co.uk>=20<559D3236.1060102@ denninger.net>=20<559D3380.8050703@sentex.net>=20<559D4DD3.10903@i nfracaninophile.co.uk>=20<559D51B5.3050709@denninger.net>|In-Reply -To:=20<559D51B5.3050709@denninger.net>; b=WfmmxVH3kUqb7GKellqkp62uwX4V/GVPOKG8U49j5o8E4i6hIdK2l8xvkHtx6+jus dyHP4USBTVVgh/WgTThqIcNFqiCAXa+UeE1YfAR6jjhGIBj6M4ZDc5BoLMPYiC5KOu ufL8puwLvjj0DfB2QZyd5iY6BZLS8oRus73cF7uI= X-Authentication-Warning: lucid-nonsense.infracaninophile.co.uk: Host no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged) claimed to be ox-dell39.ox.adestra.com Message-ID: <559D55B2.3010607@infracaninophile.co.uk> Date: Wed, 08 Jul 2015 17:54:10 +0100 From: Matthew Seaman User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Re: Speeding up resilvering References: <559D2AB6.5070007@FreeBSD.org> <559D2C7C.6060201@denninger.net> <559D3167.1000705@infracaninophile.co.uk> <559D3236.1060102@denninger.net> <559D3380.8050703@sentex.net> <559D4DD3.10903@infracaninophile.co.uk> <559D51B5.3050709@denninger.net> In-Reply-To: <559D51B5.3050709@denninger.net> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="9dcXhIptaMNTSJ1xpS9EbFKokD1psgkg6" X-Virus-Scanned: clamav-milter 0.98.7 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-1.5 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on lucid-nonsense.infracaninophile.co.uk X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jul 2015 16:54:29 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --9dcXhIptaMNTSJ1xpS9EbFKokD1psgkg6 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 07/08/15 17:37, Karl Denninger wrote: > Be aware that when a resilver /starts /it does a number of very small > and diverse I/O operations. Throughput during that time _*stinks*_, an= d > as a result in the first few minutes to half-hour or so (with a very > large vdev) you will see utterly ridiculous projections of completion t= ime. >=20 > Once that part of the process completes (usually within a few minutes o= n > modest to moderate size vdevs, but it will be longer on very large ones= ) > the performance level of the resilver will go up a lot and the projecte= d > completion time will become far more reasonable. Yeah. This resilver has been running for over a day already, and it is refusing to project what the finishing time will be, mostly because I had to yank it out of the DC in order to substitute another machine to do what this one should have been doing. (So it spent a night powered down in he middle of the resilver operation.) The VDEV is about 20TB which I suppose is pretty big, but possibly not what some ZFS practicioners would call "very large..." 6 x 4TB drives in a RAIDZ Cheers, Matthew --9dcXhIptaMNTSJ1xpS9EbFKokD1psgkg6 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- iQIcBAEBCgAGBQJVnVWyAAoJEABRPxDgqeTnn98QALaFPeYM3UAqDvgmNmDGVvcc XFfxcVZ55TQvxnNeG6za2qkcWwgnnRUyjPPq+F89bKsnTcng0BujoYBIbZ6HIGum GjOh5i6k/yZ+AEvuFd0BnXP9LwoEnXXhKJp+bCGrCmfHOPoettRZr+meYNpv+2eJ YbKmXrYpyEziuSLz8yU48rxXjlsQqUxFKscciKM/1J1vFx7UEkpI9bHY5DYgzGsc g2dxXhizlWtShVvB+TjJKD+NdGvKI9xPd6Hkr/d3cspm9nEg6yF2qLm7OToxzgoi Dsc4Awr6kfrGp2QFS7rP4EH29CQWiRoXoP8Qyk5nrVhUzz6N36T61CMLu84VI54J KeQohL7rkZwgEx2vswl+qrs/HCIHrJAKMc8Gw3SOm7itSw+JbWvX3pWShYEcc50p ivnmFHn+B1OLI4gK+Wg314qDH4KNGBaJqTyKMWKqdxc6Tp/gFrrh71qFau/v74av zV37fZXcN1QfYqqyrhibO9xkMeXV37sPabrgELoOkUpZmiIbpWCAQ5X9J+zSoZPJ bNGbBYswPunZGGAl8OP+lObubc9yry9OV06tGrjnzCqnIqhACqvyk7rSEJBqFdgd 1A1hf79Hb0YCWCNbrTMsKUXduyPJIrdU2qqCorLo9DaG+X3DFwjev9UOehxJwWvU 3WEJL6rrDXbvB99RwQFo =0Wk2 -----END PGP SIGNATURE----- --9dcXhIptaMNTSJ1xpS9EbFKokD1psgkg6--