Date: Wed, 3 Jul 2013 22:03:26 -0700 From: Peter Wemm <peter@wemm.org> To: Lawrence Stewart <lstewart@freebsd.org> Cc: Outback Dingo <outbackdingo@gmail.com>, net@freebsd.org, Steven Hartland <killing@multiplay.co.uk>, Kevin Oberman <rkoberman@gmail.com> Subject: Re: Terrible ix performance Message-ID: <CAGE5yCpojnENZW%2B6SN9WyeE5RUzpUickE8dB8r0zGrJGBJ2Wqg@mail.gmail.com> In-Reply-To: <51D4EECE.4010808@freebsd.org> References: <CAKYr3zyV74DPLsJRuDoRiYsYdAXs=EoqJ6%2B_k4hJiSnwq5zhUQ@mail.gmail.com> <51D3E5BC.1000604@freebsd.org> <CAKYr3zyWzQsFOrQ-MrGTdTzJzhP1kXNac%2BHu8NXfC_J6YJcOsg@mail.gmail.com> <51D42976.9020206@freebsd.org> <CAKYr3zyFF%2BA-OHsEL7t6rdv6Jc4c2ByvvRhV-Fv%2BPXt9Y-sXwg@mail.gmail.com> <E97FF575ED6A405FB13872854191BF3B@multiplay.co.uk> <CAN6yY1vg=KAAaJhG0p8pO6vRwL%2BypHXUfV2Uth70DYNNy04-Uw@mail.gmail.com> <51D4D77B.60804@freebsd.org> <CAKYr3zyzj=AFcGu62Je3gkZy%2BQP1aDZanYTQp%2BjsMgoWWjrnWA@mail.gmail.com> <51D4EECE.4010808@freebsd.org>
next in thread | previous in thread | raw e-mail | index | archive | help
On Wed, Jul 3, 2013 at 8:41 PM, Lawrence Stewart <lstewart@freebsd.org> wrote: > - I recall some advice that zpool's should not have more than about 8 or > 10 disks in them, and you should instead create multiple zpools if you > have more disks. Perhaps investigate the source of that rumour and if > it's true, try create 2 x 8 disk zpools in Box A and 3 x 8 disk zpools > in box B and see if that changes things at all. http://nex7.blogspot.com/2013/03/readme1st.html Item #1: "1. Virtual Devices Determine IOPS IOPS (I/O per second) are mostly a factor of the number of virtual devices (vdevs) in a zpool. They are not a factor of the raw number of disks in the zpool. This is probably the single most important thing to realize and understand, and is commonly not. ZFS stripes writes across vdevs (not individual disks). A vdev is typically IOPS bound to the speed of the slowest disk within it. So if you have one vdev of 100 disks, your zpool's raw IOPS potential is effectively only a single disk, not 100. " -- end quote I made this mistake myself a number of times before I found out. -- Peter Wemm - peter@wemm.org; peter@FreeBSD.org; peter@yahoo-inc.com; KI6FJV UTF-8: So you can \342\200\231 .. for when a ' just won't do
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGE5yCpojnENZW%2B6SN9WyeE5RUzpUickE8dB8r0zGrJGBJ2Wqg>