From owner-freebsd-fs@FreeBSD.ORG Tue May 8 22:42:15 2012 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 81B72106566C for ; Tue, 8 May 2012 22:42:15 +0000 (UTC) (envelope-from bfriesen@simple.dallas.tx.us) Received: from blade.simplesystems.org (blade.simplesystems.org [65.66.246.74]) by mx1.freebsd.org (Postfix) with ESMTP id 326548FC0C for ; Tue, 8 May 2012 22:42:15 +0000 (UTC) Received: from freddy.simplesystems.org (freddy.simplesystems.org [65.66.246.65]) by blade.simplesystems.org (8.14.4+Sun/8.14.4) with ESMTP id q48MgDL5028777; Tue, 8 May 2012 17:42:14 -0500 (CDT) Date: Tue, 8 May 2012 17:42:13 -0500 (CDT) From: Bob Friesenhahn X-X-Sender: bfriesen@freddy.simplesystems.org To: Michael Gmelin In-Reply-To: <44759017-6FAC-4982-B382-CE17DED83262@grem.de> Message-ID: References: <73F8D020-04F3-44B2-97D4-F08E3B253C32@grem.de> <180B72CE-B285-4702-B16D-0714AA07022C@grem.de> <44759017-6FAC-4982-B382-CE17DED83262@grem.de> User-Agent: Alpine 2.01 (GSO 1266 2009-07-14) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.2.2 (blade.simplesystems.org [65.66.246.90]); Tue, 08 May 2012 17:42:14 -0500 (CDT) Cc: freebsd-fs@freebsd.org Subject: Re: ZFS resilvering strangles IO X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 May 2012 22:42:15 -0000 On Wed, 9 May 2012, Michael Gmelin wrote: >>> >>> Setting vfs.zfs.vdev_max_pending="4" in /boot/loader.conf (or whatever >>> value you want). The default is 10. > > Do you think this will actually make a difference. As far as I > understand my primary problem is not latency but throughput. Simple > example is dd if=/dev/zero of=filename bs=1m, which gave me 500kb/s. > Latency might be an additional problem (or am I mislead and a shorter > queue would raise the processes chance to get data through?). The effect may be observed in real-time on a running system. Latency and throughput go hand in hand. The 'dd' command is not threaded and is sequential. It waits for the current I/O to return before it starts the next one. If the wait is shorter (fewer pending requests in line), then throughput does increase. System total throughput (which includes the resilver operations) may not increase but the throughput observed by an individual waiter may increase. The default for vdev_max_pending on Solaris was/is 32. If FreeBSD uses a default of 10 then reducing from the default may be less dramatic. Bob -- Bob Friesenhahn bfriesen@simple.dallas.tx.us, http://www.simplesystems.org/users/bfriesen/ GraphicsMagick Maintainer, http://www.GraphicsMagick.org/