From owner-freebsd-current@freebsd.org Wed Sep 9 06:46:12 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6F1883E6863; Wed, 9 Sep 2020 06:46:12 +0000 (UTC) (envelope-from se@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4BmXbm2MSgz3YxY; Wed, 9 Sep 2020 06:46:12 +0000 (UTC) (envelope-from se@freebsd.org) Received: from Stefans-MacBook-Pro-449.fritz.box (p200300cd5f236a00615dc138489ae2a2.dip0.t-ipconnect.de [IPv6:2003:cd:5f23:6a00:615d:c138:489a:e2a2]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) (Authenticated sender: se/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 6D05B2C490; Wed, 9 Sep 2020 06:46:11 +0000 (UTC) (envelope-from se@freebsd.org) To: FreeBSD CURRENT , freebsd-fs@freebsd.org Cc: Matthew Macy , Allan Jude , Graham Perrin References: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> From: Stefan Esser Subject: Re: OpenZFS and L2ARC Message-ID: Date: Wed, 9 Sep 2020 08:46:07 +0200 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.16; rv:78.0) Gecko/20100101 Thunderbird/78.2.1 MIME-Version: 1.0 In-Reply-To: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC" X-Content-Filtered-By: Mailman/MimeDel 2.1.33 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 09 Sep 2020 06:46:12 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC Content-Type: multipart/mixed; boundary="QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb"; protected-headers="v1" From: Stefan Esser To: FreeBSD CURRENT , freebsd-fs@freebsd.org Cc: Matthew Macy , Allan Jude , Graham Perrin Message-ID: Subject: Re: OpenZFS and L2ARC References: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> In-Reply-To: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> --QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb Content-Type: multipart/mixed; boundary="------------251E0D5F4C0D1E7299068885" Content-Language: de-DE This is a multi-part message in MIME format. --------------251E0D5F4C0D1E7299068885 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: quoted-printable Am 09.09.20 um 00:45 schrieb Graham Perrin: > On 08/09/2020 08:43, Stefan Esser wrote: >> OpenZFS seems to work quite well for me, in general, but I have=20 >> questions regarding the L2ARC statistics. >> > =85 >=20 >> The sysutils/zfs-stats port reports the following values for >> this system, BTW: >> >> ----------------------------------------------------------------------= -- >> ZFS Subsystem Report=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 Tue = Sep=A0 8 09:02:46 2020 >> ----------------------------------------------------------------------= -- >> > =85 >=20 >> >> Quite a number of sysctl variable names have changed, and the port >> needs to be adapted to the new names (therefore there are lots of 0 >> values in the -L output). >> >> The following names used by zfs-stats do not exist in OpenZFS: >> >> kstat.zfs.misc.arcstats.recycle_miss >> kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned >> kstat.zfs.misc.arcstats.l2_write_buffer_iter >> kstat.zfs.misc.arcstats.l2_write_buffer_list_iter >> kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter >> kstat.zfs.misc.arcstats.l2_write_full >> kstat.zfs.misc.arcstats.l2_write_in_l2 >> kstat.zfs.misc.arcstats.l2_write_io_in_progress >> kstat.zfs.misc.arcstats.l2_write_not_cacheable >> kstat.zfs.misc.arcstats.l2_write_passed_headroom >> kstat.zfs.misc.arcstats.l2_write_pios >> kstat.zfs.misc.arcstats.l2_write_spa_mismatch >> kstat.zfs.misc.arcstats.l2_write_trylock_fail >> kstat.zfs.misc.arcstats.l2_writes_hdr_miss >> vfs.zfs.vdev.cache.size >> >> The existence of vfs.zfs.vdev.cache.size vs vfs.zfs.vdev.cache_size >> can be used to detect OpenZFS, and is easily fixed. >> >> But the above listed L2ARC values seem to have been removed from or >> have never existed in OpenZFS, and I did not find any substitutes. >> >> Are there any plans to re-create them in OpenZFS on FreeBSD or are >> they gone for good? >=20 > Recalling=20 > ,=20 > on 28/03/2020 15:17,28/03/2020 15:17, Allan Jude wrote: >=20 > >> =85 > >> > >> Basically 'arc' was converted to a subtree. > >> > >> We should add some backwards compat sysctls to cover some of > >> these renames etc so configs and scripts don't break etc. This is not possible for quite a number of sysctls, since there is no simple 1:1 mapping for many of them. And there is an annoyance that I had noticed before but now have tracked down: $ time sysctl kstat.zfs.misc.dbufs | wc 55327 2047031 16333472 real 0m16,446s user 0m0,055s sys 0m16,397s Somebody decided to put a complete list of dbufs under this sysctl and thus querying "kstat.zfs.misc" takes that long (16 seconds to generate 16 MB of output on my system), even if only a few other values in "kstat.zfs.misc" are needed. I do not know whether there is any chance to get that debug output moved out of the "misc", e.g. into a new "debug" sub-tree. I'm afraid, that on Linux there are scripts that expect it under this name. If it is not acceptable to the upstream, we should locally modify the sysctl tree to move that variable out of "misc", IMHO. (While not taking much time, "kstat.zfs.misc.dbgmsg" should also be relocted to a "debug" sub-tree, IMHO ...) zfs-stats needs tens of values from "misc", and if they are not all added individually to the Kstat array, this will limit the response time to any zfs-stats invocation. It is not too hard to add the new variables in zfs-stats and to adapt the calculations to derive meaningful values to display. But if it always takes 16 seconds to generate any output, I'm not likely to use it too often ... Regards, STefan --------------251E0D5F4C0D1E7299068885-- --QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb-- --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAl9Yei8FAwAAAAAACgkQR+u171r99USZ UQgAthKKr1z5b3fQKi8LSvDREnf5W2r7QIbwb57u9jljbeD79jxAmJXcC950wyUbbQMMqQrqWSsi MRzo5Cnv8TyfsLMf2yPWXG6zLaYzztKAKr2mbpzoMhCLOsJhhe1cxRXB0WnosbZLg/FH/wYGwPZa /uCoGdomGJcr51AIbbdF8IvpQq3k5RdiONqVt1wXx7Z5XfF+P5eH5ju8lHEBDO8T/odmUQL+7D4W MaqCebR2q+Hy+I6RF8jn5W2LVzl6o5RLLp33ItemuvIghOuHuIkx/z3qfatTB/FvUdwA+scfw3us dQ3IR2tUhaCt06+kmlJ2vH/7it66AyQT2KviiU+ONQ== =DLIq -----END PGP SIGNATURE----- --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC--