Date: Wed, 9 Sep 2020 08:46:07 +0200 From: Stefan Esser <se@freebsd.org> To: FreeBSD CURRENT <freebsd-current@freebsd.org>, freebsd-fs@freebsd.org Cc: Matthew Macy <mmacy@freebsd.org>, Allan Jude <allanjude@freebsd.org>, Graham Perrin <grahamperrin@gmail.com> Subject: Re: OpenZFS and L2ARC Message-ID: <fb112996-d713-f7e0-45e3-451d6bc02102@freebsd.org> In-Reply-To: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> References: <b8f63e55-4c7e-8be0-7c52-5d8e6cb333f4@freebsd.org> <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC Content-Type: multipart/mixed; boundary="QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb"; protected-headers="v1" From: Stefan Esser <se@freebsd.org> To: FreeBSD CURRENT <freebsd-current@freebsd.org>, freebsd-fs@freebsd.org Cc: Matthew Macy <mmacy@freebsd.org>, Allan Jude <allanjude@freebsd.org>, Graham Perrin <grahamperrin@gmail.com> Message-ID: <fb112996-d713-f7e0-45e3-451d6bc02102@freebsd.org> Subject: Re: OpenZFS and L2ARC References: <b8f63e55-4c7e-8be0-7c52-5d8e6cb333f4@freebsd.org> <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> In-Reply-To: <7d54dc30-b8b1-a127-ec39-9fb759c8a55d@gmail.com> --QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb Content-Type: multipart/mixed; boundary="------------251E0D5F4C0D1E7299068885" Content-Language: de-DE This is a multi-part message in MIME format. --------------251E0D5F4C0D1E7299068885 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: quoted-printable Am 09.09.20 um 00:45 schrieb Graham Perrin: > On 08/09/2020 08:43, Stefan Esser wrote: >> OpenZFS seems to work quite well for me, in general, but I have=20 >> questions regarding the L2ARC statistics. >> > =85 >=20 >> The sysutils/zfs-stats port reports the following values for >> this system, BTW: >> >> ----------------------------------------------------------------------= -- >> ZFS Subsystem Report=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0 Tue = Sep=A0 8 09:02:46 2020 >> ----------------------------------------------------------------------= -- >> > =85 >=20 >> >> Quite a number of sysctl variable names have changed, and the port >> needs to be adapted to the new names (therefore there are lots of 0 >> values in the -L output). >> >> The following names used by zfs-stats do not exist in OpenZFS: >> >> kstat.zfs.misc.arcstats.recycle_miss >> kstat.zfs.misc.arcstats.l2_write_buffer_bytes_scanned >> kstat.zfs.misc.arcstats.l2_write_buffer_iter >> kstat.zfs.misc.arcstats.l2_write_buffer_list_iter >> kstat.zfs.misc.arcstats.l2_write_buffer_list_null_iter >> kstat.zfs.misc.arcstats.l2_write_full >> kstat.zfs.misc.arcstats.l2_write_in_l2 >> kstat.zfs.misc.arcstats.l2_write_io_in_progress >> kstat.zfs.misc.arcstats.l2_write_not_cacheable >> kstat.zfs.misc.arcstats.l2_write_passed_headroom >> kstat.zfs.misc.arcstats.l2_write_pios >> kstat.zfs.misc.arcstats.l2_write_spa_mismatch >> kstat.zfs.misc.arcstats.l2_write_trylock_fail >> kstat.zfs.misc.arcstats.l2_writes_hdr_miss >> vfs.zfs.vdev.cache.size >> >> The existence of vfs.zfs.vdev.cache.size vs vfs.zfs.vdev.cache_size >> can be used to detect OpenZFS, and is easily fixed. >> >> But the above listed L2ARC values seem to have been removed from or >> have never existed in OpenZFS, and I did not find any substitutes. >> >> Are there any plans to re-create them in OpenZFS on FreeBSD or are >> they gone for good? >=20 > Recalling=20 > <https://lists.freebsd.org/pipermail/freebsd-current/2020-March/075661.= html>,=20 > on 28/03/2020 15:17,28/03/2020 15:17, Allan Jude wrote: >=20 > >> =85 > >> > >> Basically 'arc' was converted to a subtree. > >> > >> We should add some backwards compat sysctls to cover some of > >> these renames etc so configs and scripts don't break etc. This is not possible for quite a number of sysctls, since there is no simple 1:1 mapping for many of them. And there is an annoyance that I had noticed before but now have tracked down: $ time sysctl kstat.zfs.misc.dbufs | wc 55327 2047031 16333472 real 0m16,446s user 0m0,055s sys 0m16,397s Somebody decided to put a complete list of dbufs under this sysctl and thus querying "kstat.zfs.misc" takes that long (16 seconds to generate 16 MB of output on my system), even if only a few other values in "kstat.zfs.misc" are needed. I do not know whether there is any chance to get that debug output moved out of the "misc", e.g. into a new "debug" sub-tree. I'm afraid, that on Linux there are scripts that expect it under this name. If it is not acceptable to the upstream, we should locally modify the sysctl tree to move that variable out of "misc", IMHO. (While not taking much time, "kstat.zfs.misc.dbgmsg" should also be relocted to a "debug" sub-tree, IMHO ...) zfs-stats needs tens of values from "misc", and if they are not all added individually to the Kstat array, this will limit the response time to any zfs-stats invocation. It is not too hard to add the new variables in zfs-stats and to adapt the calculations to derive meaningful values to display. But if it always takes 16 seconds to generate any output, I'm not likely to use it too often ... Regards, STefan --------------251E0D5F4C0D1E7299068885-- --QLWn3nEBcMkqHZ3Q91QTkhW669IrrfHWb-- --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEo3HqZZwL7MgrcVMTR+u171r99UQFAl9Yei8FAwAAAAAACgkQR+u171r99USZ UQgAthKKr1z5b3fQKi8LSvDREnf5W2r7QIbwb57u9jljbeD79jxAmJXcC950wyUbbQMMqQrqWSsi MRzo5Cnv8TyfsLMf2yPWXG6zLaYzztKAKr2mbpzoMhCLOsJhhe1cxRXB0WnosbZLg/FH/wYGwPZa /uCoGdomGJcr51AIbbdF8IvpQq3k5RdiONqVt1wXx7Z5XfF+P5eH5ju8lHEBDO8T/odmUQL+7D4W MaqCebR2q+Hy+I6RF8jn5W2LVzl6o5RLLp33ItemuvIghOuHuIkx/z3qfatTB/FvUdwA+scfw3us dQ3IR2tUhaCt06+kmlJ2vH/7it66AyQT2KviiU+ONQ== =DLIq -----END PGP SIGNATURE----- --ARtKBvQ3PD8ZctsHDZ0dtbb5dRgH8eFbC--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?fb112996-d713-f7e0-45e3-451d6bc02102>