From owner-freebsd-fs@FreeBSD.ORG Wed Jul 3 12:46:20 2013 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 6C464E33 for ; Wed, 3 Jul 2013 12:46:20 +0000 (UTC) (envelope-from mxb@unixconn.com) Received: from mail-lb0-f171.google.com (mail-lb0-f171.google.com [209.85.217.171]) by mx1.freebsd.org (Postfix) with ESMTP id EB56C19DE for ; Wed, 3 Jul 2013 12:46:19 +0000 (UTC) Received: by mail-lb0-f171.google.com with SMTP id 13so178966lba.16 for ; Wed, 03 Jul 2013 05:46:12 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=from:content-type:content-transfer-encoding:subject:message-id:date :to:mime-version:x-mailer:x-gm-message-state; bh=n0yME+Us0qRM2wRmMuXjUrPHZgMMmjWwoGPdAuGtXl0=; b=XX/DIDeA7T2uXFEyZkW07aTWivnfgvWK5/zT/vo/kqCSeyzKltY/jXjUniJFsLxJRU xTcfTL1ga0feBFtw5T0o3Oxl+JyxWIA6JEaldU8055DfhNfLZpoqgmoTT3+48kM8BTAD eJwp06ix4X29e5ijL18gbWPFmjHZJ7WeNf9+7CwZRTbMjaxiYXl9d/v5pICqwQBYbDFu EoJUjEu5H+lQyEhY8XXUtmCHQYgknsqoq9jhhxKdJ/uwbKQHfGyZPNMpLnjXZDGA6Dcj 7Wrh8t8RmNyoFV9XEzDdQ7lIqIhCHXV/HLth8WnqxGyxvI+StmRIbqlA0QFJ2XSfbZSo H/bg== X-Received: by 10.152.6.4 with SMTP id w4mr434808law.14.1372855571925; Wed, 03 Jul 2013 05:46:11 -0700 (PDT) Received: from grey.home.unixconn.com (h-74-23.a183.priv.bahnhof.se. [46.59.74.23]) by mx.google.com with ESMTPSA id 8sm9862885lbn.9.2013.07.03.05.46.10 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Wed, 03 Jul 2013 05:46:11 -0700 (PDT) From: Maxim Bourmistrov Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Slow resilvering with mirrored ZIL Message-Id: Date: Wed, 3 Jul 2013 14:46:09 +0200 To: "freebsd-fs@freebsd.org" Mime-Version: 1.0 (Mac OS X Mail 6.5 \(1508\)) X-Mailer: Apple Mail (2.1508) X-Gm-Message-State: ALoCoQkoO9Scg1yF0w0teCZdSV6KlOY0KSQ8WW/KbLaJfFR00azDFRWI33Yu0OtReiLCA8r7uVuF X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Jul 2013 12:46:20 -0000 Hello list@, I'm in the middle of replacing my old hard drives with new ones on my = ZFS NAS. There are at least two ways to accomplish this.=20 I'm however, doing resilvering of new ones. While doing a resilvering of one of possible four drivers I had 40-60 = MB/s resilvering speed. ZIL is located on a 10G partition on an Intel SLC SSD. It toke about 24h to resilver about 1.5T. Then I decided to create a 10G partition on another SSD(OCZ AGILITY 3 , = MLC) and created a mirror of ZIL. Done that, I continued to resilver the second drive out of four and = noted significant speed drop of resilvering. 5MB/s as of now. I understand that doing a ZIL mirror will result in performance penalty, = but not that much?! Box is slightly loaded and I tried to completely shutdown all services = and disconnect it from LAN in order to isolate it, without any = improvements in speed. Any ideas? Am I completely wrong in assuming that ZIL is involved in resilvering = process? P.S. SSDs: ada4: ATA-7 SATA 2.x device ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada4: Command Queueing enabled ada4: 19087MB (39091248 512 byte sectors: 16H 63S/T 16383C) ada4: Previously was known as ad12 ada5 at ahcich5 bus 0 scbus5 target 0 lun 0 ada5: ATA-8 SATA 3.x device ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes) ada5: Command Queueing enabled ada5: 57241MB (117231408 512 byte sectors: 16H 63S/T 16383C) ada5: Previously was known as ad14