From owner-freebsd-fs@FreeBSD.ORG Sun Aug 8 15:17:15 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2A7F4106568D for ; Sun, 8 Aug 2010 15:17:15 +0000 (UTC) (envelope-from thomas@gibfest.dk) Received: from mail.tyknet.dk (mail.tyknet.dk [213.150.42.155]) by mx1.freebsd.org (Postfix) with ESMTP id D78698FC19 for ; Sun, 8 Aug 2010 15:17:14 +0000 (UTC) Received: from [10.10.1.200] (1503026959.dong.dbnet.dk [89.150.95.15]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.tyknet.dk (Postfix) with ESMTPSA id E5302638DFC for ; Sun, 8 Aug 2010 17:17:13 +0200 (CEST) X-DKIM: OpenDKIM Filter v1.1.2 mail.tyknet.dk E5302638DFC DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=gibfest.dk; s=default; t=1281280633; bh=InoxNyR6aGbVCiBzhkg91/AQF5hyNAUY0ZxDprXe23M=; h=Message-ID:Date:From:MIME-Version:To:Subject:References: In-Reply-To:Content-Type:Content-Transfer-Encoding; b=orcO+0+vfWygp41h1H/4YIvxqKxXj7VSixhc1PVcnOkGSbcijys2zyemR36A7J0Vx K+BWxeaeFKOaOSGmO81Hy63ERcM4Ldm9+IKXQRm3Nj83EJw6Jr2dCy2apb3gBaRjO9 hqytArgK9j7maWofE9UC9qodeU/IPhQZPY5OcLSA= Message-ID: <4C5ECA78.6010803@gibfest.dk> Date: Sun, 08 Aug 2010 17:17:12 +0200 From: Thomas Steen Rasmussen User-Agent: Mozilla/5.0 (Windows; U; Windows NT 6.1; en-GB; rv:1.9.1.11) Gecko/20100711 Lightning/1.0b1 Thunderbird/3.0.6 MIME-Version: 1.0 To: freebsd-fs@freebsd.org References: <4C57E20E.2030908@gibfest.dk> <20100806135001.GF1710@garage.freebsd.pl> In-Reply-To: <20100806135001.GF1710@garage.freebsd.pl> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: HAST initial sync speed X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 08 Aug 2010 15:17:15 -0000 On 06-08-2010 15:50, Pawel Jakub Dawidek wrote: > On Tue, Aug 03, 2010 at 11:31:58AM +0200, Thomas Rasmussen wrote: > >> Hello list, >> >> I finally got my ZFS/HAST setup up and running, or trying to at least. >> I am wondering how fast the initial HAST sync normally is - I created >> these 4 HAST providers yesterday on 4 146 gig drives, and they still each >> have over 90 gigabytes 'dirty' today. The machines are powerful (dell >> r710) and are otherwise idle, and they are connected to the same gigabit >> switch. >> >> I can supply details about any part of the configuration if needed, but I >> just wanted to ask if you guys believe something is wrong here. I can't help >> but think, if the initial sync takes 24+ hours, then if I ever need to >> replace one of the servers, I will be without redundancy until the new >> server reaches 0 'dirty' bytes, correct ? >> > Correct, but synchronizartion should take much, much less time. > Is dirty count actually decreasing? > > Hello, Yes it was decreasing steadily but very slowly. It finished between thursday evening and friday morning, and the dirty count is now 0. All in all it took over 72 hours. It was transferring around 20mbits while doing this. However, if I copied a large file to the primary HAST node, it would use up a lot more bandwidth. It is like HAST was synchronizing the "empty space" with lower priority or something. Does that make any sense ? The servers are not in production so I can perform any testing needed. Thank you for your reply. Regards Thomas Steen Rasmussen