From owner-freebsd-fs@FreeBSD.ORG  Thu Feb 24 19:28:57 2011
Return-Path: <owner-freebsd-fs@FreeBSD.ORG>
Delivered-To: freebsd-fs@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id BD6CB1065673
	for <freebsd-fs@freebsd.org>; Thu, 24 Feb 2011 19:28:57 +0000 (UTC)
	(envelope-from piotr.kucharski@42.pl)
Received: from mail-ww0-f50.google.com (mail-ww0-f50.google.com [74.125.82.50])
	by mx1.freebsd.org (Postfix) with ESMTP id 5E0AA8FC18
	for <freebsd-fs@freebsd.org>; Thu, 24 Feb 2011 19:28:56 +0000 (UTC)
Received: by wwb31 with SMTP id 31so1166978wwb.31
	for <freebsd-fs@freebsd.org>; Thu, 24 Feb 2011 11:28:56 -0800 (PST)
Received: by 10.216.81.69 with SMTP id l47mr1204591wee.56.1298575736099; Thu,
	24 Feb 2011 11:28:56 -0800 (PST)
MIME-Version: 1.0
Received: by 10.216.5.74 with HTTP; Thu, 24 Feb 2011 11:28:16 -0800 (PST)
X-Originating-IP: [172.28.208.100]
In-Reply-To: <AANLkTimDqcdNv0DqyScEQU3Fw=t9xtOaAZqy2BfWNhpw@mail.gmail.com>
References: <AANLkTim6z5KiceXQE-DHt51TBs+SO8NNLpi7fYBTwXpE@mail.gmail.com>
	<AANLkTimDqcdNv0DqyScEQU3Fw=t9xtOaAZqy2BfWNhpw@mail.gmail.com>
From: Piotr Kucharski <piotr.kucharski@42.pl>
Date: Thu, 24 Feb 2011 20:28:16 +0100
Message-ID: <AANLkTik+UhMSfGgNPr=qd_Rfwb-12aXHWGAJnNGQH2j=@mail.gmail.com>
To: freebsd-fs@freebsd.org
Content-Type: text/plain; charset=UTF-8
Subject: Re: very slow zfs scrub
X-BeenThere: freebsd-fs@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Filesystems <freebsd-fs.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-fs>
List-Post: <mailto:freebsd-fs@freebsd.org>
List-Help: <mailto:freebsd-fs-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-fs>,
	<mailto:freebsd-fs-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Thu, 24 Feb 2011 19:28:57 -0000

I've eliminated GELI from the picture and simplified the setup to one
ggate disk.

# ggatec create -u 13 x.x.x.x /dev/zvol/storage/zvol/temp
# zpool create testink /dev/ggate13
: copied some files onto it, 10G took 40 min, but it was from one
network drive to another, I'll let it slide
# dd if=/testink/file of=/dev/null bs=64k
128712704 bytes transferred in 2.256507 secs (57040687 bytes/sec)
: reading is as I expected to be, fine
# zpool scrub testink
: wait a little for the command to finish
# zpool status testink
  pool: testink
 state: ONLINE
 scan: scrub in progress since Thu Feb 24 17:45:27 2011
    227M scanned out of 9.97G at 27.9K/s, 101h52m to go
    0 repaired, 2.22% done
config:

        NAME        STATE     READ WRITE CKSUM
        testink     ONLINE       0     0     0
          ggate13   ONLINE       0     0     0

Wow! What does scrub do that it slows ggate drive almost to halt?

What can I do to fix it?