Date: Tue, 8 May 2012 17:42:13 -0500 (CDT) From: Bob Friesenhahn <bfriesen@simple.dallas.tx.us> To: Michael Gmelin <freebsd@grem.de> Cc: freebsd-fs@freebsd.org Subject: Re: ZFS resilvering strangles IO Message-ID: <alpine.GSO.2.01.1205081732090.9406@freddy.simplesystems.org> In-Reply-To: <44759017-6FAC-4982-B382-CE17DED83262@grem.de> References: <73F8D020-04F3-44B2-97D4-F08E3B253C32@grem.de> <CAFHbX1K0--P-Sh0QdLszEs0V1ocWoe6Jp_SY9H%2BVJd1AQw2XKA@mail.gmail.com> <180B72CE-B285-4702-B16D-0714AA07022C@grem.de> <alpine.GSO.2.01.1205081625470.9406@freddy.simplesystems.org> <CAOjFWZ7ik_sUmUaw4im729dc-2Toq2j_z_oxiqUpzc4x_TOujQ@mail.gmail.com> <CAFqOu6hxww5a1CLwYOZZcZNkJVhwH2eUXmtJKNwm6ohNmcqP0Q@mail.gmail.com> <44759017-6FAC-4982-B382-CE17DED83262@grem.de>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, 9 May 2012, Michael Gmelin wrote: >>> >>> Setting vfs.zfs.vdev_max_pending="4" in /boot/loader.conf (or whatever >>> value you want). The default is 10. > > Do you think this will actually make a difference. As far as I > understand my primary problem is not latency but throughput. Simple > example is dd if=/dev/zero of=filename bs=1m, which gave me 500kb/s. > Latency might be an additional problem (or am I mislead and a shorter > queue would raise the processes chance to get data through?). The effect may be observed in real-time on a running system. Latency and throughput go hand in hand. The 'dd' command is not threaded and is sequential. It waits for the current I/O to return before it starts the next one. If the wait is shorter (fewer pending requests in line), then throughput does increase. System total throughput (which includes the resilver operations) may not increase but the throughput observed by an individual waiter may increase. The default for vdev_max_pending on Solaris was/is 32. If FreeBSD uses a default of 10 then reducing from the default may be less dramatic. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?alpine.GSO.2.01.1205081732090.9406>