From owner-freebsd-fs@FreeBSD.ORG Thu Jul 4 00:04:21 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id E4230315 for ; Thu, 4 Jul 2013 00:04:21 +0000 (UTC) (envelope-from jdc@koitsu.org) Received: from relay5-d.mail.gandi.net (relay5-d.mail.gandi.net [217.70.183.197]) by mx1.freebsd.org (Postfix) with ESMTP id A0AFC1FCA for ; Thu, 4 Jul 2013 00:04:21 +0000 (UTC) Received: from mfilter5-d.gandi.net (mfilter5-d.gandi.net [217.70.178.132]) by relay5-d.mail.gandi.net (Postfix) with ESMTP id 67E0441C06D; Thu, 4 Jul 2013 02:04:10 +0200 (CEST) X-Virus-Scanned: Debian amavisd-new at mfilter5-d.gandi.net Received: from relay5-d.mail.gandi.net ([217.70.183.197]) by mfilter5-d.gandi.net (mfilter5-d.gandi.net [10.0.15.180]) (amavisd-new, port 10024) with ESMTP id b1QZSAl7SnQn; Thu, 4 Jul 2013 02:04:08 +0200 (CEST) X-Originating-IP: 76.102.14.35 Received: from jdc.koitsu.org (c-76-102-14-35.hsd1.ca.comcast.net [76.102.14.35]) (Authenticated sender: jdc@koitsu.org) by relay5-d.mail.gandi.net (Postfix) with ESMTPSA id 9388A41C062; Thu, 4 Jul 2013 02:04:07 +0200 (CEST) Received: by icarus.home.lan (Postfix, from userid 1000) id DCB6473A1D; Wed, 3 Jul 2013 17:04:05 -0700 (PDT) Date: Wed, 3 Jul 2013 17:04:05 -0700 From: Jeremy Chadwick To: mxb Subject: Re: Slow resilvering with mirrored ZIL Message-ID: <20130704000405.GA75529@icarus.home.lan> References: <51D42107.1050107@digsys.bg> <2EF46A8C-6908-4160-BF99-EC610B3EA771@alumni.chalmers.se> <51D437E2.4060101@digsys.bg> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 04 Jul 2013 00:04:22 -0000 On Wed, Jul 03, 2013 at 05:12:17PM +0200, mxb wrote: > > Not sure if new are 4k. Done nothing about that. > But the SECOND drive, resilvering is SLOW. Not the first one. > > As stated below. Those changes are introduced to the system. > ALL new driver ARE identical, except S/N of cause :) > > On 3 jul 2013, at 16:55, Steven Hartland wrote: > > > > > ----- Original Message ----- From: "Daniel Kalchev" > > To: "mxb" > > Cc: > > Sent: Wednesday, July 03, 2013 3:40 PM > > Subject: Re: Slow resilvering with mirrored ZIL > > > > > >> On 03.07.13 16:36, mxb wrote: > >>> Well, then my question persists - why I get so significant drop of speed while resilvering second drive. > >>> The only changes to the system are: > >>> > >>> 1. Second partition for ZIL to create a mirror > >>> 2. New disks are 7200rpm. old ones are 5400rpm. > >>> > > > > Its not something like the old disks are 512byte sectors > > where as the new ones are 4k? > > > > It this is the case having already replaced one disk you've > > killed performance as its having to do lots more work reading > > none 4k aligned data? Not enough hard information to diagnose. What's needed is below; you can XXX out system names if you want, but please do not XXX out anything else. - Output from: dmesg - Output from: zpool status - Output from: zpool get all - Output from: zfs get all - Output from: "gpart show -p" for every disk on the system - Output from: cat /etc/sysctl.conf - Output from: cat /boot/loader.conf - Output from: "smartctl -a" for every disk that's used by ZFS (please use smartmontools 6.1 or newer in this case; install ports/sysutils/smartmontools) I can think of one tunable related to resilvering that may/might help with your problem, but I'm not going to mention it until the above can be provided. -- | Jeremy Chadwick jdc@koitsu.org | | UNIX Systems Administrator http://jdc.koitsu.org/ | | Making life hard for others since 1977. PGP 4BD6C0CB |