From owner-freebsd-stable@FreeBSD.ORG Wed Oct 20 17:26:29 2010 Return-Path: Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id C02F6106566C for ; Wed, 20 Oct 2010 17:26:29 +0000 (UTC) (envelope-from scaron@umich.edu) Received: from webrelay-aldf.mr.itd.umich.edu (webrelay-aldf.mr.itd.umich.edu [141.211.14.43]) by mx1.freebsd.org (Postfix) with ESMTP id 672E88FC08 for ; Wed, 20 Oct 2010 17:26:28 +0000 (UTC) Received: FROM taxidriver-trpl.mail.umich.edu (taxidriver-trpl.mail.umich.edu [141.211.12.56]) By webrelay-aldf.mr.itd.umich.edu ID 4CBF2644.1EFD5.2151 ; 20 Oct 2010 13:26:28 EDT Received: (from www@localhost) by taxidriver-trpl.mail.umich.edu () id o9KHQRgX018047; Wed, 20 Oct 2010 13:26:27 -0400 Received: from host8-99.sph.umich.edu (host8-99.sph.umich.edu [141.211.8.99]) by web.mail.umich.edu (Horde Framework) with HTTP; Wed, 20 Oct 2010 13:26:27 -0400 Message-ID: <20101020132627.20874pa6yfreu6io@web.mail.umich.edu> Date: Wed, 20 Oct 2010 13:26:27 -0400 From: Sean Thomas Caron To: Lawrence Farr References: <20101020112738.12467cvfvvh4zb0g@web.mail.umich.edu> <038301cb706f$cf5a6640$6e0f32c0$@co.uk> In-Reply-To: <038301cb706f$cf5a6640$6e0f32c0$@co.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1; DelSp="Yes"; format="flowed" Content-Disposition: inline Content-Transfer-Encoding: 7bit User-Agent: Internet Messaging Program (IMP) H3 (4.3.5) X-Remote-Browser: Opera/9.80 (Macintosh; Intel Mac OS X; U; en) Presto/2.6.30 Version/10.61 X-IMP-Server: 192.168.221.56 (taxidriver-trpl) X-Originating-IP: 141.211.8.99 X-Originating-User: scaron Cc: scaron@umich.edu, freebsd-stable@freebsd.org Subject: RE: Spurious reboot in 8.1-RELEASE when reading from ZFS pool with > 9 disks X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 20 Oct 2010 17:26:29 -0000 Hi Lawrence, Interesting; have you tried this for raidz2 as well? I just created a raidz2 pool with 5 disks and then added another 5 disk raidz2 to it, so, total of 10 disks in the pool (though this is ultimately a losing strategy unless the number of disks is >> 9 because two drives are lost for parity in each sub-raid in the pool). It (seemed) just slightly more stable than creating a single raidz2 pool with > 9 disks but it still crashes. I guess this does allow me to say its more an issue of number of devices in the pool versus capacity of the pool because with the parity drives taken out, the pool with two 5-disk raidz2s has less total capacity than a pool with a single 9-disk raidz2. Just out of idle curiousity, I also tried it with raidz1 on my system. Again, I created a 5-disk pool, raidz1 this time, then added another 5-disk raidz1 to the pool for, again, total of 10 disks. Again, a bit of a losing strategy versus creating one great big raidz unless the number of disks is >> 9 because of losing a disk in each sub-raidz1 in the pool for parity but less so of course than raidz2. This seemed to crash too, same behavior. Are you using 8.1-RELEASE or STABLE or ...? Best, -Sean > > I have a 16 disk pool, if you create it with > > zpool create poolname raidz disk1 disk2 disk3 etc > > then > > zpool add poolname raidz disk8 disk9 disk10 etc > > You get the full size pool and no issues. > > pool: tank > state: ONLINE > scan: scrub repaired 0 in 0h0m with 0 errors on Wed Oct 20 14:54:08 2010 > config: > > NAME STATE READ WRITE CKSUM > tank ONLINE 0 0 0 > raidz1-0 ONLINE 0 0 0 > da0 ONLINE 0 0 0 > da1 ONLINE 0 0 0 > da2 ONLINE 0 0 0 > da3 ONLINE 0 0 0 > da4 ONLINE 0 0 0 > da5 ONLINE 0 0 0 > da6 ONLINE 0 0 0 > da7 ONLINE 0 0 0 > raidz1-1 ONLINE 0 0 0 > da8 ONLINE 0 0 0 > da9 ONLINE 0 0 0 > da10 ONLINE 0 0 0 > da11 ONLINE 0 0 0 > da12 ONLINE 0 0 0 > da13 ONLINE 0 0 0 > da14 ONLINE 0 0 0 > da15 ONLINE 0 0 0 > > errors: No known data errors >