From owner-freebsd-fs@freebsd.org Wed Jul 8 14:19:40 2015 Return-Path: Delivered-To: freebsd-fs@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3929D996312 for ; Wed, 8 Jul 2015 14:19:40 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from smtp.infracaninophile.co.uk (smtp.infracaninophile.co.uk [IPv6:2001:8b0:151:1:3cd3:cd67:fafa:3d78]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.infracaninophile.co.uk", Issuer "infracaninophile.co.uk" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id D1B861A51 for ; Wed, 8 Jul 2015 14:19:39 +0000 (UTC) (envelope-from m.seaman@infracaninophile.co.uk) Received: from zero-gravitas.local (no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged)) (authenticated bits=0) by smtp.infracaninophile.co.uk (8.15.1/8.15.1) with ESMTPSA id t68EJSUe063085 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO) for ; Wed, 8 Jul 2015 15:19:29 +0100 (BST) (envelope-from m.seaman@infracaninophile.co.uk) Authentication-Results: smtp.infracaninophile.co.uk; dmarc=none header.from=infracaninophile.co.uk DKIM-Filter: OpenDKIM Filter v2.9.2 smtp.infracaninophile.co.uk t68EJSUe063085 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=infracaninophile.co.uk; s=201001-infracaninophile; t=1436365169; bh=IENb1z9AtQvAkCOSfo4dXBcPHJAY2lKrhp5piImxFG8=; h=Date:From:To:Subject:References:In-Reply-To; z=Date:=20Wed,=2008=20Jul=202015=2015:19:19=20+0100|From:=20Matthew =20Seaman=20|To:=20freebsd-fs@fre ebsd.org|Subject:=20Re:=20Speeding=20up=20resilvering|References:= 20<559D2AB6.5070007@FreeBSD.org>=20<559D2C7C.6060201@denninger.net >|In-Reply-To:=20<559D2C7C.6060201@denninger.net>; b=v9SA5nSJ9yMpj5mNEndU0O5TnjYfoaBO2GGJ9MVtyog7pwyWdZl1HvJ5vBgp1i0CX 3JwvJJKTfIHlpwWi4ETjOAh6CdwwGxxWmGbCtnTQtDJzbwWWFSIHU2BnHEzwsyppXz jPCOOI9hn9jzQovXP2UStr3T4ptkFeae0GTRSC/Y= X-Authentication-Warning: lucid-nonsense.infracaninophile.co.uk: Host no-reverse-dns.metronet-uk.com [85.199.232.226] (may be forged) claimed to be zero-gravitas.local Message-ID: <559D3167.1000705@infracaninophile.co.uk> Date: Wed, 08 Jul 2015 15:19:19 +0100 From: Matthew Seaman User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.10; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: freebsd-fs@freebsd.org Subject: Re: Speeding up resilvering References: <559D2AB6.5070007@FreeBSD.org> <559D2C7C.6060201@denninger.net> In-Reply-To: <559D2C7C.6060201@denninger.net> Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="0vIn11cr7atgHNNdPN6Dr7L5Aol8EfJva" X-Virus-Scanned: clamav-milter 0.98.7 at lucid-nonsense.infracaninophile.co.uk X-Virus-Status: Clean X-Spam-Status: No, score=-1.5 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU autolearn=ham autolearn_force=no version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on lucid-nonsense.infracaninophile.co.uk X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 08 Jul 2015 14:19:40 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --0vIn11cr7atgHNNdPN6Dr7L5Aol8EfJva Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On 2015/07/08 14:58, Karl Denninger wrote: > On 7/8/2015 08:50, Matthew Seaman wrote: >> Hi, >> >> I've a zpool which is taking an inordinately long time to resilver and= >> replace a device. It had only got to about 8% completion after a day,= >> implying over a week to resilver about 6TB data. >> >> Now, I've applied the resilver performance tuning sysctls from >> https://wiki.freebsd.org/ZFSTuningGuide: >> >> vfs.zfs.scrub_delay=3D0 >> vfs.zfs.top_maxinflight=3D128 >> vfs.zfs.resilver_min_time_ms=3D5000 >> vfs.zfs.resilver_delay=3D0 >> >> but it doesn't seem to have made a great deal of difference. Most of >> the benefit there would apparently come from reducing scrub_delay or >> resilver_delay -- but this system is only booted to single user mode, = so >> the drives are otherwise idle and the resilver should have automatical= ly >> switched to running full throttle anyhow. >> >> Given the machine is not going to be doing anything else other than >> resilvering for the time being, is there any more aggressive tuning or= >> tricks to get it to go faster that people would recommend? >> >> Cheers, >> >> Matthew >> >=20 > What OS version? >=20 10.1-RELEASE-p10 Cheers, Matthew --0vIn11cr7atgHNNdPN6Dr7L5Aol8EfJva Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQJ8BAEBCgBmBQJVnTFvXxSAAAAAAC4AKGlzc3Vlci1mcHJAbm90YXRpb25zLm9w ZW5wZ3AuZmlmdGhob3JzZW1hbi5uZXQxOUYxNTRFQ0JGMTEyRTUwNTQ0RTNGMzAw MDUxM0YxMEUwQTlFNEU3AAoJEABRPxDgqeTnDRIP/iMrFSeTk8KOIit94mvlLrOD suQz5ZL65QSDRyrBtRsD1PSVCLgkpG+DPTIOFeWd0ES6qhZrsXKj4saaJoIsR9LN sTZhXcUxZHIhK7IItZYlo+8jVJtgsg8fiPaMU76sjPH1lc2VS9LsD71Zs0FujU80 fFvtkn0jreC9A48X/5e3e/ueh8Ny1kLxr5dUkFDnvLaoo+CUBe4GqdBXvCaAlBsS KPBeztNypJD0FCVa79XYb0RCFhD2LquzkfOmm4bhbjTJqYEeqzPOZeZcjtu1Rm5c r8mnRMEeGbnPVJQFejHxz4MO4JcTmNpKAiejHSM5WM2KrXFE8orp3dJ9xhA+2wpO WfvTMJ0W4BWnjBC+AjFE9AlV8yKsiSPlj6ntcU3QrVMoZVIvZB3mHST2g3t9rap+ SXNK3wovTb0XSTFrNFGyzFyJjJZdGw9JdDqLjaG6+IkvYUqJlE0dhskPeQDYLdRc zNQYre5cFqLr5fcSe2+SR059fI2p/CkJOvIQ5ONzL4o6JXMULxR96jK9ib8ZSsUd ENKE+1qkFtDKWv7sX4Ns6yIaRck8hibrVSsmBvJGfugBcLIubPKMr7f+dTlCe2mf iWyK+7qzZftGbJPBeVYAWHQjrsT4z+1dfaJ0jv1qfJGCRV1C8KSXF0IBR1tKf69C X5/9cBczGduqox4acfoT =oEf/ -----END PGP SIGNATURE----- --0vIn11cr7atgHNNdPN6Dr7L5Aol8EfJva--