From owner-freebsd-stable@FreeBSD.ORG Thu Apr 5 16:38:19 2007 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [69.147.83.52]) by hub.freebsd.org (Postfix) with ESMTP id 45B8416A402 for ; Thu, 5 Apr 2007 16:38:19 +0000 (UTC) (envelope-from tom@tomjudge.com) Received: from s200aog11.obsmtp.com (s200aog11.obsmtp.com [207.126.144.125]) by mx1.freebsd.org (Postfix) with SMTP id 97EDD13C448 for ; Thu, 5 Apr 2007 16:38:18 +0000 (UTC) (envelope-from tom@tomjudge.com) Received: from source ([217.206.187.80]) by eu1sys200aob011.postini.com ([207.126.147.11]) with SMTP; Thu, 05 Apr 2007 16:38:17 UTC Received: from [10.0.0.89] (bill.mintel.co.uk [10.0.0.89]) by rodney.mintel.co.uk (Postfix) with ESMTP id 1D42218141C for ; Thu, 5 Apr 2007 17:38:17 +0100 (BST) Message-ID: <46152615.1040602@tomjudge.com> Date: Thu, 05 Apr 2007 17:38:45 +0100 From: Tom Judge User-Agent: Thunderbird 1.5.0.10 (X11/20070306) MIME-Version: 1.0 To: freebsd-stable@freebsd.org References: <1175785136.8280.10.camel@lanshark.dmv.com> <20070405160313.GE1230@dkirhlarov.mow.oilspace.com> In-Reply-To: <20070405160313.GE1230@dkirhlarov.mow.oilspace.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: ggate + gmirror write performance woes X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Apr 2007 16:38:19 -0000 Dmitriy Kirhlarov wrote: > On Thu, Apr 05, 2007 at 10:58:56AM -0400, Sven Willenberger wrote: >> I am trying to set up a HA type system involving two identical boxes and >> have gone through the following to set up the systems: >> >> Slave server: >> ggated -R 196608 -S 196608 >> (exporting /dev/amrd1 ) >> net.inet.tcp.sendspace: 65536 >> net.inet.tcp.recvspace: 131072 > > Try > net.local.stream.recvspace=65535 > net.local.stream.sendspace=65535 > > Also, try increase this sysctls with > net.inet.tcp.rfc1323=1 > > I use it on FreeBSD 5.x with: > net.inet.tcp.sendspace=131072 > net.inet.tcp.recvspace=131072 > net.local.stream.recvspace=65535 > net.local.stream.sendspace=65535 > > ggated -R 1048576 -S 1048576 > ggatec -R 1048576 -S 1048576 > > WBR. > Dmitriy > _______________________________________________ > freebsd-stable@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-stable > To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freebsd.org" I have seen sustained writes of 30Mb/s using the following configuration: cat /boot/loader.conf kern.ipc.nmbclusters="32768" cat /etc/sysctl.conf net.inet.tcp.sendspace=1048576 net.inet.tcp.recvspace=1048576 Server: /sbin/ggated -S 1310720 -R 1310720 -a 172.31.0.18 /etc/gg.exports Client: /sbin/ggatec create -q 2048 -t 5 -S 1310720 -R 1310720 172.31.0.18 /dev/amrd0s2 The raid array is a RAID 1 volume on a dell PERC4 (Dell PE1850) with adaptive read ahead and write back caching. Tom