From owner-freebsd-fs@freebsd.org Wed Jul 8 13:51:06 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 48CEF995CF3 for ; Wed, 8 Jul 2015 13:51:06 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "infracaninophile.co.uk" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id C8B721902 for ; Wed, 8 Jul 2015 13:51:05 +0000 (UTC) (envelope-from matthew@FreeBSD.org) Received: from zero-gravitas.local (no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged)) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.15.1/8.15.1) with ESMTPSA id t68Dosnm062574 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Wed, 8 Jul 2015 14:50:55 +0100 (BST) (envelope-from matthew@FreeBSD.org) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none header.from=FreeBSD.org DKIM-Filter: OpenDKIM Filter v2.9.2 smtp.infracaninophile.co.uk t68Dosnm062574 Authentication-Results: smtp.infracaninophile.co.uk/t68Dosnm062574; dkim=none reason="no signature"; dkim-adsp=none; dkim-atps=neutral X-Authentication-Warning: lucid-nonsense.infracaninophile.co.uk: Host no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged) claimed to be zero-gravitas.local Message-ID: <559D2AB6.5070007@FreeBSD.org> Date: Wed, 08 Jul 2015 14:50:46 +0100 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Speeding up resilvering Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="K4lg1kdEEpMeN4clwKawFbeEhR1CVa3EQ" X-Virus-Scanned: clamav-milter 0.98.7 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-2.8 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00 autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on lucid-nonsense.infracaninophile.co.uk X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jul 2015 13:51:06 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --K4lg1kdEEpMeN4clwKawFbeEhR1CVa3EQ Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, I've a zpool which is taking an inordinately long time to resilver and replace a device. It had only got to about 8% completion after a day, implying over a week to resilver about 6TB data. Now, I've applied the resilver performance tuning sysctls from https://wiki.freebsd.org/ZFSTuningGuide: vfs.zfs.scrub_delay=3D0 vfs.zfs.top_maxinflight=3D128 vfs.zfs.resilver_min_time_ms=3D5000 vfs.zfs.resilver_delay=3D0 but it doesn't seem to have made a great deal of difference. Most of the benefit there would apparently come from reducing scrub_delay or resilver_delay -- but this system is only booted to single user mode, so the drives are otherwise idle and the resilver should have automatically switched to running full throttle anyhow. Given the machine is not going to be doing anything else other than resilvering for the time being, is there any more aggressive tuning or tricks to get it to go faster that people would recommend? Cheers, Matthew --K4lg1kdEEpMeN4clwKawFbeEhR1CVa3EQ Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQJ8BAEBCgBmBQJVnSq+XxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQxOUYxNTRFQ0JGMTEyRTUwNTQ0RTNGMzAw MDUxM0YxMEUwQTlFNEU3AAoJEABRPxDgqeTnb1cP/ihNpXV54l9h8YCVD3El/2vu ew6Ju5WZIhGwdHY4G+Omj5kefiiW8gVBkh1MzZR6tQIqjJw7iUm1IrgQ8xFmZoxg TRYA0+V67tSYTGQS73QnKfBHhaa4mwQuQSsdyz3LWFqKt+P7c4cY4j3Wxny4FgDH /ptTrv0aeeyVIWVqo+DvgK7RIgH857YuxkXsUGRve3EjRKQtWBfLTSmL0B8KXPSn ojyplk9e9hVgPX+il9kB3m9x5qj9H9w8/84rgd0z8w4pCdub40MCNYAz6rCuZSbW C136Vp44zNwv6u4tMFgTbBZcr4qVC20HvQuXOhttSHXX3yV6qUpCKu1WQp3jcLwE We+3WnnWG9ISon/Zi+l2vLlP0dF3e7uW6j55theRORy99ZgWC03MPIibW98aX7fm cqVuY2HFzumNtb9eyUwh3Yo1TQ73CYOp6lik4djXxACwp/lfN+wkWaG9mjAn/JJD Bt8AnwZRn5Um7p32cwmZVgLGXXSazLJPbUoVmmbmbn9UFGmeqb4Bo4Qdt7aC+eoi EgqAC0T4erVYQ+Yvcq4LiZCb0kvO9qzSMrc1CbQPPuB8fZELFycniOlJSIu5f7Hh 6QYKryQXPR56YS9RDu2qQmTUU5QTRh4J2/Ri7IUTotGk1sK/Jip1501Nt4tk8zyg JadP++tZGqfEVfw/JXnS =hNKJ -----END PGP SIGNATURE----- --K4lg1kdEEpMeN4clwKawFbeEhR1CVa3EQ--