Date: Tue, 15 Aug 2023 14:03:17 -0700 From: joe mcguckin <joe@via.net> To: Alexander Leidinger <Alexander@Leidinger.net> Cc: Mateusz Guzik <mjguzik@gmail.com>, current@freebsd.org Subject: Re: Speed improvements in ZFS Message-ID: <20BA3146-9448-4B34-9B2A-ED591664B68F@via.net> In-Reply-To: <ed1f82dd26d3cc9ec9cc16505109ec40@Leidinger.net> References: <61ca9df1b15c0e5477ff51196d0ec073@Leidinger.net> <CAGudoHG5Fgg4184SsXhzqYRR7VPaBXZoirGvyRyJX5ihX5YG-A@mail.gmail.com> <ed1f82dd26d3cc9ec9cc16505109ec40@Leidinger.net>
next in thread | previous in thread | raw e-mail | index | archive | help
--Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii When I watch the activity leds of the disks on one of our ZFS servers, I = notice there will be a burst of activity for 3 or 4 seconds, then no = activity for a couple of seconds, then it repeats. Is that normal? Thanks, joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax > On Aug 15, 2023, at 12:33 PM, Alexander Leidinger = <Alexander@Leidinger.net> wrote: >=20 > Am 2023-08-15 14:41, schrieb Mateusz Guzik: >=20 >> With this in mind can you provide: sysctl kern.maxvnodes >> vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes >> vfs.recycles_free vfs.recycles >=20 > After a reboot: > kern.maxvnodes: 10485760 > vfs.wantfreevnodes: 2621440 > vfs.freevnodes: 24696 > vfs.vnodes_created: 1658162 > vfs.numvnodes: 173937 > vfs.recycles_free: 0 > vfs.recycles: 0 >=20 >> Meanwhile if there is tons of recycles, you can damage control by >> bumping kern.maxvnodes. >=20 > Looks like there are not much free directly after the reboot. I will = check the values tomorrow after the periodic run again and maybe = increase by 10 or 100 so see if it makes a difference. >=20 >> If this is not the problem you can use dtrace to figure it out. >=20 > dtrace-count on vnlru_read_freevnodes() and vnlru_free_locked()? Or = something else? >=20 > Bye, > Alexander. >=20 > --=20 > http://www.Leidinger.net Alexander@Leidinger.net: PGP = 0x8F31830F9F2772BF > http://www.FreeBSD.org netchild@FreeBSD.org : PGP = 0x8F31830F9F2772BF --Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii <html><head><meta http-equiv=3D"Content-Type" content=3D"text/html; = charset=3Dus-ascii"></head><body style=3D"word-wrap: break-word; = -webkit-nbsp-mode: space; line-break: after-white-space;" class=3D"">When = I watch the activity leds of the disks on one of our ZFS servers, I = notice there will be a burst of activity for 3 or 4 seconds, then no = activity for a couple of seconds, then it repeats.<div class=3D"">Is = that normal?</div><div class=3D""><br class=3D""></div><div = class=3D"">Thanks,</div><div class=3D""><br class=3D""></div><div = class=3D"">joe</div><div class=3D""><div class=3D""> <span class=3D"Apple-style-span" style=3D"border-collapse: separate; = border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; = font-size: 12px; font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; text-align: auto; = -khtml-text-decorations-in-effect: none; text-indent: 0px; = -apple-text-size-adjust: auto; text-transform: none; orphans: 2; = white-space: normal; widows: 2; word-spacing: 0px; "><span = class=3D"Apple-style-span" style=3D"border-collapse: separate; = border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; = font-size: 12px; font-style: normal; font-variant: normal; font-weight: = normal; letter-spacing: normal; line-height: normal; text-align: auto; = -khtml-text-decorations-in-effect: none; text-indent: 0px; = -apple-text-size-adjust: auto; text-transform: none; orphans: 2; = white-space: normal; widows: 2; word-spacing: 0px; "><div class=3D""><br = class=3D"khtml-block-placeholder"></div><div class=3D""><br = class=3D"khtml-block-placeholder"></div><div class=3D"">Joe = McGuckin</div><div class=3D"">ViaNet Communications</div><div = class=3D""><br class=3D"khtml-block-placeholder"></div><div class=3D""><a = href=3D"mailto:joe@via.net" class=3D"">joe@via.net</a></div><div = class=3D"">650-207-0372 cell</div><div class=3D"">650-213-1302 = office</div><div class=3D"">650-969-2124 fax</div><div class=3D""><br = class=3D"khtml-block-placeholder"></div><br = class=3D"Apple-interchange-newline"></span></span> </div> <div><br class=3D""><blockquote type=3D"cite" class=3D""><div = class=3D"">On Aug 15, 2023, at 12:33 PM, Alexander Leidinger <<a = href=3D"mailto:Alexander@Leidinger.net" = class=3D"">Alexander@Leidinger.net</a>> wrote:</div><br = class=3D"Apple-interchange-newline"><div class=3D""><div class=3D"">Am = 2023-08-15 14:41, schrieb Mateusz Guzik:<br class=3D""><br = class=3D""><blockquote type=3D"cite" class=3D"">With this in mind can = you provide: sysctl kern.maxvnodes<br class=3D"">vfs.wantfreevnodes = vfs.freevnodes vfs.vnodes_created vfs.numvnodes<br = class=3D"">vfs.recycles_free vfs.recycles<br class=3D""></blockquote><br = class=3D"">After a reboot:<br class=3D"">kern.maxvnodes: 10485760<br = class=3D"">vfs.wantfreevnodes: 2621440<br class=3D"">vfs.freevnodes: = 24696<br class=3D"">vfs.vnodes_created: 1658162<br = class=3D"">vfs.numvnodes: 173937<br class=3D"">vfs.recycles_free: 0<br = class=3D"">vfs.recycles: 0<br class=3D""><br class=3D""><blockquote = type=3D"cite" class=3D"">Meanwhile if there is tons of recycles, you can = damage control by<br class=3D"">bumping kern.maxvnodes.<br = class=3D""></blockquote><br class=3D"">Looks like there are not much = free directly after the reboot. I will check the values tomorrow after = the periodic run again and maybe increase by 10 or 100 so see if it = makes a difference.<br class=3D""><br class=3D""><blockquote type=3D"cite"= class=3D"">If this is not the problem you can use dtrace to figure it = out.<br class=3D""></blockquote><br class=3D"">dtrace-count on = vnlru_read_freevnodes() and vnlru_free_locked()? Or something else?<br = class=3D""><br class=3D"">Bye,<br class=3D"">Alexander.<br class=3D""><br = class=3D"">-- <br class=3D""><a href=3D"http://www.Leidinger.net" = class=3D"">http://www.Leidinger.net</a>; <a = href=3D"mailto:Alexander@Leidinger.net" = class=3D"">Alexander@Leidinger.net</a>: PGP 0x8F31830F9F2772BF<br = class=3D""><a href=3D"http://www.FreeBSD.org" = class=3D"">http://www.FreeBSD.org</a>; <a = href=3D"mailto:netchild@FreeBSD.org" class=3D"">netchild@FreeBSD.org</a> = : PGP 0x8F31830F9F2772BF<br = class=3D""></div></div></blockquote></div><br = class=3D""></div></body></html>= --Apple-Mail=_4232FA49-C650-4C57-B92E-09FD76B590F5--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20BA3146-9448-4B34-9B2A-ED591664B68F>