From owner-freebsd-current@freebsd.org Wed Mar 22 23:58:39 2017 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 67EF4D188BB for ; Wed, 22 Mar 2017 23:58:39 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from mx1.scaleengine.net (mx1.scaleengine.net [209.51.186.6]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 2FF1A1045 for ; Wed, 22 Mar 2017 23:58:38 +0000 (UTC) (envelope-from allanjude@freebsd.org) Received: from [10.1.1.2] (unknown [10.1.1.2]) (Authenticated sender: allanjude.freebsd@scaleengine.com) by mx1.scaleengine.net (Postfix) with ESMTPSA id 986EC1392F for ; Wed, 22 Mar 2017 23:58:32 +0000 (UTC) Subject: Re: CURRENT: slow like crap! ZFS scrubbing and ports update > 25 min To: freebsd-current@freebsd.org References: <20170322210225.511da375@thor.intern.walstatt.dynvpn.de> From: Allan Jude Message-ID: <4876fd2f-6dd4-16cc-4e27-b52f5cde0fa6@freebsd.org> Date: Wed, 22 Mar 2017 19:58:28 -0400 User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:45.0) Gecko/20100101 Thunderbird/45.8.0 MIME-Version: 1.0 In-Reply-To: <20170322210225.511da375@thor.intern.walstatt.dynvpn.de> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="8dibRCHGBO52CELPi8eC21xOCut8HwWGo" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 22 Mar 2017 23:58:39 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --8dibRCHGBO52CELPi8eC21xOCut8HwWGo Content-Type: multipart/mixed; boundary="9sEaRw3b9Ntff5hH2K6Js4Eeq038mL33w"; protected-headers="v1" From: Allan Jude To: freebsd-current@freebsd.org Message-ID: <4876fd2f-6dd4-16cc-4e27-b52f5cde0fa6@freebsd.org> Subject: Re: CURRENT: slow like crap! ZFS scrubbing and ports update > 25 min References: <20170322210225.511da375@thor.intern.walstatt.dynvpn.de> In-Reply-To: <20170322210225.511da375@thor.intern.walstatt.dynvpn.de> --9sEaRw3b9Ntff5hH2K6Js4Eeq038mL33w Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 2017-03-22 16:02, O. Hartmann wrote: > CURRENT (FreeBSD 12.0-CURRENT #82 r315720: Wed Mar 22 18:49:28 CET 2017= amd64) is > annoyingly slow! While scrubbing is working on my 12 GB ZFS volume, upd= ating /usr/ports > takes >25 min(!). That is an absolute record now. >=20 > I do an almost daily update of world and ports tree and have periodic = scrubbing ZFS > volumes every 35 days, as it is defined in /etc/defaults. Prts tree has= n't grown much, > the content of the ZFS volume hasn't changed much (~ 100 GB, its fill i= s about 4 TB now) > and this is now for ~ 2 years constant.=20 >=20 > I've experienced before that while scrubbing the ZFS volume, some opera= tions, even the > update of /usr/ports which resides on that ZFS RAIDZ volume, takes a bi= t longer than > usual - but never that long like now! >=20 > Another box is quite unusable while it is scrubbing and it has been usa= ble times before. > The change is dramatic ... >=20 > Regards, >=20 > Oliver >=20 Due to differences in the kern.hz setting between IllumOS and FreeBSD, the result is FreeBSD doesn't de-prioritize scrub I/O as much as IllumOS does. try: sysctl vfs.zfs.scrub_delay=3D40 This will speed for 40 ticks (40ms on FreeBSD), between each scrub I/O, allowing your ports update to proceed more quickly. 'zpool list' will show how fragmented your pool is, and how full it is, these may also provide insight. If you run 'top -S' while it is performing badly, what is the CPU load li= ke? Is your /usr/ports dataset compressed? --=20 Allan Jude --9sEaRw3b9Ntff5hH2K6Js4Eeq038mL33w-- --8dibRCHGBO52CELPi8eC21xOCut8HwWGo Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.22 (MingW32) iQIcBAEBAgAGBQJY0w+nAAoJEBmVNT4SmAt+ttIQAJGJOZZ55vDRWWPEtiuyen7A OKHd34kcNhZIz1ebPfuxUewJURFKt8nfdbv7BsccJ+fReEIVb1W2mhBqteF/95Sx wjp6Uvf1D0tQMrHNhScdy4LROjj6QhoaqtSBjJURG1N9hg4o/G5M0bBTTJS7B8y8 m8tkQfVHXcE7xubIH8lNy/+ZIg2aImPYEsb4AJh35TIhH/GHNZGdUwMfvlY30eue 9n0asBrAwC3Inawc2S1D6Vl2jRrLBMVHtfksBgFCFFtGaoCnEuQLDwzzf+gsyMq/ 630tr5MIqJEauL3DsswUhGTaAzNGvKkR7tS83HIfhY0fw/92tqD8xTCQB8A3QzQs qRqOqBrsJ6yoUNlhrKiaUpaNehZedxnjDOzq5NUokHxEUF6eWTOfbVdnAJ15pbsj FEvqKdjdlGNXXN26Zx6i/0V5PLlu7wZXmbARNdGECihDAV05cBbTbasduIi4H72d k2SGQuIoBkqNCAVVr+Dj01UhhBuvIjoP9xrQKZ/nHVvuiK/xGlKDrWEmOSBRQ5I3 jc3hJKNxwiq9WGJSyOW5kc7LCjrn17/LUem8V1XX1GaTuQernGgIwPofo5bxCmhX /cppQ4WHpWymKwlsdKjYYx5cDVHwhckioJLY0A1Os1iBk1HEIcXjARdcI1kBt1Hw tfc6hbELeQ+VNxgee7F6 =y73s -----END PGP SIGNATURE----- --8dibRCHGBO52CELPi8eC21xOCut8HwWGo--