Date: Tue, 15 Aug 2023 14:03:17 -0700 From: joe mcguckin <joe@via.net> To: Alexander Leidinger <Alexander@Leidinger.net> Cc: Mateusz Guzik <mjguzik@gmail.com>, current@freebsd.org Subject: Re: Speed improvements in ZFS Message-ID: <20BA3146-9448-4B34-9B2A-ED591664B68F@via.net> In-Reply-To: <ed1f82dd26d3cc9ec9cc16505109ec40@Leidinger.net> References: <61ca9df1b15c0e5477ff51196d0ec073@Leidinger.net> <CAGudoHG5Fgg4184SsXhzqYRR7VPaBXZoirGvyRyJX5ihX5YG-A@mail.gmail.com> <ed1f82dd26d3cc9ec9cc16505109ec40@Leidinger.net>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] When I watch the activity leds of the disks on one of our ZFS servers, I notice there will be a burst of activity for 3 or 4 seconds, then no activity for a couple of seconds, then it repeats. Is that normal? Thanks, joe Joe McGuckin ViaNet Communications joe@via.net 650-207-0372 cell 650-213-1302 office 650-969-2124 fax > On Aug 15, 2023, at 12:33 PM, Alexander Leidinger <Alexander@Leidinger.net> wrote: > > Am 2023-08-15 14:41, schrieb Mateusz Guzik: > >> With this in mind can you provide: sysctl kern.maxvnodes >> vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes >> vfs.recycles_free vfs.recycles > > After a reboot: > kern.maxvnodes: 10485760 > vfs.wantfreevnodes: 2621440 > vfs.freevnodes: 24696 > vfs.vnodes_created: 1658162 > vfs.numvnodes: 173937 > vfs.recycles_free: 0 > vfs.recycles: 0 > >> Meanwhile if there is tons of recycles, you can damage control by >> bumping kern.maxvnodes. > > Looks like there are not much free directly after the reboot. I will check the values tomorrow after the periodic run again and maybe increase by 10 or 100 so see if it makes a difference. > >> If this is not the problem you can use dtrace to figure it out. > > dtrace-count on vnlru_read_freevnodes() and vnlru_free_locked()? Or something else? > > Bye, > Alexander. > > -- > http://www.Leidinger.net Alexander@Leidinger.net: PGP 0x8F31830F9F2772BF > http://www.FreeBSD.org netchild@FreeBSD.org : PGP 0x8F31830F9F2772BF [-- Attachment #2 --] <html><head><meta http-equiv="Content-Type" content="text/html; charset=us-ascii"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">When I watch the activity leds of the disks on one of our ZFS servers, I notice there will be a burst of activity for 3 or 4 seconds, then no activity for a couple of seconds, then it repeats.<div class="">Is that normal?</div><div class=""><br class=""></div><div class="">Thanks,</div><div class=""><br class=""></div><div class="">joe</div><div class=""><div class=""> <span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><span class="Apple-style-span" style="border-collapse: separate; border-spacing: 0px 0px; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 12px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; text-align: auto; -khtml-text-decorations-in-effect: none; text-indent: 0px; -apple-text-size-adjust: auto; text-transform: none; orphans: 2; white-space: normal; widows: 2; word-spacing: 0px; "><div class=""><br class="khtml-block-placeholder"></div><div class=""><br class="khtml-block-placeholder"></div><div class="">Joe McGuckin</div><div class="">ViaNet Communications</div><div class=""><br class="khtml-block-placeholder"></div><div class=""><a href="mailto:joe@via.net" class="">joe@via.net</a></div><div class="">650-207-0372 cell</div><div class="">650-213-1302 office</div><div class="">650-969-2124 fax</div><div class=""><br class="khtml-block-placeholder"></div><br class="Apple-interchange-newline"></span></span> </div> <div><br class=""><blockquote type="cite" class=""><div class="">On Aug 15, 2023, at 12:33 PM, Alexander Leidinger <<a href="mailto:Alexander@Leidinger.net" class="">Alexander@Leidinger.net</a>> wrote:</div><br class="Apple-interchange-newline"><div class=""><div class="">Am 2023-08-15 14:41, schrieb Mateusz Guzik:<br class=""><br class=""><blockquote type="cite" class="">With this in mind can you provide: sysctl kern.maxvnodes<br class="">vfs.wantfreevnodes vfs.freevnodes vfs.vnodes_created vfs.numvnodes<br class="">vfs.recycles_free vfs.recycles<br class=""></blockquote><br class="">After a reboot:<br class="">kern.maxvnodes: 10485760<br class="">vfs.wantfreevnodes: 2621440<br class="">vfs.freevnodes: 24696<br class="">vfs.vnodes_created: 1658162<br class="">vfs.numvnodes: 173937<br class="">vfs.recycles_free: 0<br class="">vfs.recycles: 0<br class=""><br class=""><blockquote type="cite" class="">Meanwhile if there is tons of recycles, you can damage control by<br class="">bumping kern.maxvnodes.<br class=""></blockquote><br class="">Looks like there are not much free directly after the reboot. I will check the values tomorrow after the periodic run again and maybe increase by 10 or 100 so see if it makes a difference.<br class=""><br class=""><blockquote type="cite" class="">If this is not the problem you can use dtrace to figure it out.<br class=""></blockquote><br class="">dtrace-count on vnlru_read_freevnodes() and vnlru_free_locked()? Or something else?<br class=""><br class="">Bye,<br class="">Alexander.<br class=""><br class="">-- <br class=""><a href="http://www.Leidinger.net" class="">http://www.Leidinger.net</a>; <a href="mailto:Alexander@Leidinger.net" class="">Alexander@Leidinger.net</a>: PGP 0x8F31830F9F2772BF<br class=""><a href="http://www.FreeBSD.org" class="">http://www.FreeBSD.org</a>; <a href="mailto:netchild@FreeBSD.org" class="">netchild@FreeBSD.org</a> : PGP 0x8F31830F9F2772BF<br class=""></div></div></blockquote></div><br class=""></div></body></html>help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20BA3146-9448-4B34-9B2A-ED591664B68F>