Date: Wed, 18 Aug 2010 13:26:19 +0200 From: Thomas Steen Rasmussen <thomas@gibfest.dk> To: Pawel Jakub Dawidek <pjd@FreeBSD.org> Cc: freebsd-fs@freebsd.org Subject: Re: HAST initial sync speed Message-ID: <4C6BC35B.9040000@gibfest.dk> In-Reply-To: <4C6BC0BA.9030303@gibfest.dk> References: <4C57E20E.2030908@gibfest.dk> <20100806135001.GF1710@garage.freebsd.pl> <4C5ECA78.6010803@gibfest.dk> <20100810075528.GA1754@garage.freebsd.pl> <4C61CF4D.4060009@gibfest.dk> <4C651B7E.5000805@gibfest.dk> <20100816221059.GE2611@garage.freebsd.pl> <4C6B08BD.9080206@gibfest.dk> <20100818110655.GA2177@garage.freebsd.pl> <4C6BC0BA.9030303@gibfest.dk>
next in thread | previous in thread | raw e-mail | index | archive | help
On 18-08-2010 13:15, Thomas Steen Rasmussen wrote: > On 18-08-2010 13:06, Pawel Jakub Dawidek wrote: >> On Wed, Aug 18, 2010 at 12:10:05AM +0200, Thomas Steen Rasmussen wrote: >>> I performed the tests with md devices like you asked. It seems like >>> using >>> memory disks doesn't make any difference. It is still running at >>> 2-300kBps >>> according to gstat. The network is plenty fast, like I mentioned in an >>> earlier mail, once the initial sync is done, I can reach almost wire >>> speed, >>> over 100 megabytes per second. >> Could you edit sbin/hastd/proto_common.c and change MAX_SEND_SIZE at the >> begining of the file from 131072 to 32768? >> >> Then do the following: >> >> # cd /usr/src >> # make buildenv >> # cd sbin/hastd >> # make&& make install >> ^D >> >> And please rerun the test with md(4) devices. >> > Woop! > > That certaintly did something, it is currently synching the md > device at almost 80 megabytes/sec according to gstat! > Hello again, Sorry for responding to my own post. I recreated the HAST setup with the four harddrives and it is now saturating the gigabit link, it is synching at a steady rate of 112 megabytes per second, meaning that each of the disks are reading/writing at just under 30 megabytes per second. It would probably be even faster if the network wasn't limiting it. I built ZFS on top of it and everything seems to be working as expected. Thank you again for looking at this. Thomas Steen Rasmussen
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4C6BC35B.9040000>