From owner-freebsd-fs@FreeBSD.ORG Wed Aug 18 11:26:20 2010 Return-Path: Delivered-To: freebsd-fs@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 7E3181065670; Wed, 18 Aug 2010 11:26:20 +0000 (UTC) (envelope-from thomas@gibfest.dk) Received: from mail.tyknet.dk (mail.tyknet.dk [213.150.42.155]) by mx1.freebsd.org (Postfix) with ESMTP id 3A0D28FC13; Wed, 18 Aug 2010 11:26:20 +0000 (UTC) Received: from [10.32.67.66] (fw.int.webpartner.dk [213.150.34.98]) (using TLSv1 with cipher DHE-RSA-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mail.tyknet.dk (Postfix) with ESMTPSA id 7420863A827; Wed, 18 Aug 2010 13:26:19 +0200 (CEST) X-DKIM: OpenDKIM Filter v2.1.3 mail.tyknet.dk 7420863A827 Authentication-Results: mail.tyknet.dk; dkim=none (no signature); dkim-adsp=none Message-ID: <4C6BC35B.9040000@gibfest.dk> Date: Wed, 18 Aug 2010 13:26:19 +0200 From: Thomas Steen Rasmussen User-Agent: Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.9.1.11) Gecko/20100711 Lightning/1.0b1 Thunderbird/3.0.6 MIME-Version: 1.0 To: Pawel Jakub Dawidek References: <4C57E20E.2030908@gibfest.dk> <20100806135001.GF1710@garage.freebsd.pl> <4C5ECA78.6010803@gibfest.dk> <20100810075528.GA1754@garage.freebsd.pl> <4C61CF4D.4060009@gibfest.dk> <4C651B7E.5000805@gibfest.dk> <20100816221059.GE2611@garage.freebsd.pl> <4C6B08BD.9080206@gibfest.dk> <20100818110655.GA2177@garage.freebsd.pl> <4C6BC0BA.9030303@gibfest.dk> In-Reply-To: <4C6BC0BA.9030303@gibfest.dk> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-fs@freebsd.org Subject: Re: HAST initial sync speed X-BeenThere: freebsd-fs@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Filesystems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Aug 2010 11:26:20 -0000 On 18-08-2010 13:15, Thomas Steen Rasmussen wrote: > On 18-08-2010 13:06, Pawel Jakub Dawidek wrote: >> On Wed, Aug 18, 2010 at 12:10:05AM +0200, Thomas Steen Rasmussen wrote: >>> I performed the tests with md devices like you asked. It seems like >>> using >>> memory disks doesn't make any difference. It is still running at >>> 2-300kBps >>> according to gstat. The network is plenty fast, like I mentioned in an >>> earlier mail, once the initial sync is done, I can reach almost wire >>> speed, >>> over 100 megabytes per second. >> Could you edit sbin/hastd/proto_common.c and change MAX_SEND_SIZE at the >> begining of the file from 131072 to 32768? >> >> Then do the following: >> >> # cd /usr/src >> # make buildenv >> # cd sbin/hastd >> # make&& make install >> ^D >> >> And please rerun the test with md(4) devices. >> > Woop! > > That certaintly did something, it is currently synching the md > device at almost 80 megabytes/sec according to gstat! > Hello again, Sorry for responding to my own post. I recreated the HAST setup with the four harddrives and it is now saturating the gigabit link, it is synching at a steady rate of 112 megabytes per second, meaning that each of the disks are reading/writing at just under 30 megabytes per second. It would probably be even faster if the network wasn't limiting it. I built ZFS on top of it and everything seems to be working as expected. Thank you again for looking at this. Thomas Steen Rasmussen