From owner-freebsd-fs@FreeBSD.ORG Wed Jul 3 14:40:39 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 08115F75 for ; Wed, 3 Jul 2013 14:40:39 +0000 (UTC) (envelope-from daniel@digsys.bg) Received: from smtp-sofia.digsys.bg (smtp-sofia.digsys.bg [193.68.21.123]) by mx1.freebsd.org (Postfix) with ESMTP id 83A8A103C for ; Wed, 3 Jul 2013 14:40:37 +0000 (UTC) Received: from dcave.digsys.bg (dcave.digsys.bg [193.68.6.1]) (authenticated bits=0) by smtp-sofia.digsys.bg (8.14.6/8.14.6) with ESMTP id r63EeY2S059208 (version=TLSv1/SSLv3 cipher=DHE-RSA-CAMELLIA256-SHA bits=256 verify=NO); Wed, 3 Jul 2013 17:40:34 +0300 (EEST) (envelope-from daniel@digsys.bg) Message-ID: <51D437E2.4060101@digsys.bg> Date: Wed, 03 Jul 2013 17:40:34 +0300 From: Daniel Kalchev User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:17.0) Gecko/20130627 Thunderbird/17.0.7 MIME-Version: 1.0 To: mxb Subject: Re: Slow resilvering with mirrored ZIL References: <51D42107.1050107@digsys.bg> <2EF46A8C-6908-4160-BF99-EC610B3EA771@alumni.chalmers.se> In-Reply-To: <2EF46A8C-6908-4160-BF99-EC610B3EA771@alumni.chalmers.se> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2013 14:40:39 -0000 On 03.07.13 16:36, mxb wrote: > Well, then my question persists - why I get so significant drop of speed while resilvering second drive. > The only changes to the system are: > > 1. Second partition for ZIL to create a mirror > 2. New disks are 7200rpm. old ones are 5400rpm. > I can't see how the ZIL can be involved in resilvering. The ZIL is only used when you write synchronous data to the pool, which is not happening during resilver. As mentioned already, you do not need ZIL during the resilver and you can zpool remove the ZIL drives from your pool to verify. What is happening during resilver is reading from the other drives in the vdev and writing to the new drive. You mention four drives so I assume this is an raidz? Is it possible that the old drives and the zpool vdev(s) are 512byte sector size and the new drive is 4k sector size? If so, you might experience severe slowdown. The only way to fix this situation is to recreate the zpool -- copy data out of the pool, create the pool with 4k alignment for vdevs and copy data back. You can check the ashift property in the output of zdb. If ashift=9 you have 512 byte sector vdev(s). If ashift=12 you have an 4k sector vdev(s). In any case, you can easily rule out the effects of ZIL on your pool by just removing the log devices. Daniel