From owner-freebsd-geom@FreeBSD.ORG Wed Oct 17 19:28:22 2007 Return-Path: Delivered-To: freebsd-geom@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 36FC116A46B for ; Wed, 17 Oct 2007 19:28:22 +0000 (UTC) (envelope-from eksffa@freebsdbrasil.com.br) Received: from capeta.freebsdbrasil.com.br (vrrp.freebsdbrasil.com.br [200.210.70.30]) by mx1.freebsd.org (Postfix) with SMTP id 4FCA713C4AC for ; Wed, 17 Oct 2007 19:28:20 +0000 (UTC) (envelope-from eksffa@freebsdbrasil.com.br) Received: (qmail 60926 invoked from network); 17 Oct 2007 17:01:35 -0200 Received: from unknown (HELO claire.bh.freebsdbrasil.com.br) (201.78.125.207) by capeta.freebsdbrasil.com.br with SMTP; 17 Oct 2007 17:01:35 -0200 Message-ID: <47165C0B.7080707@freebsdbrasil.com.br> Date: Wed, 17 Oct 2007 17:01:31 -0200 From: Patrick Tracanelli Organization: FreeBSD Brasil LTDA User-Agent: Thunderbird 2.0.0.0 (X11/20070612) MIME-Version: 1.0 To: kurtseel References: <471650AA.30903@primetime.com> In-Reply-To: <471650AA.30903@primetime.com> Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit Cc: freebsd-geom@freebsd.org Subject: Re: gmirror + ggated question X-BeenThere: freebsd-geom@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: GEOM-specific discussions and implementations List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Oct 2007 19:28:22 -0000 kurtseel escreveu: > > I built a mirror of a local drive and a ggated backed device. I ran > iozone on it > and it runs along fine until a certain point when it slows down to a > near stand > still. It doesn't break the mirror or crash the system, but it does slow > the system > down to a near stop. > I kill the iozone, and a short time later I can login and then : > > # df > Filesystem 1K-blocks Used Avail Capacity Mounted on > /dev/mirror/thinkcs1a 1012974 155780 776158 17% / > devfs 1 1 0 100% /dev > /dev/mirror/thinkcs1e 85469448 1163474 77468420 1% /usr > /dev/mirror/thinkcs1d 4058062 40426 3692992 1% /var > [root@ ~/temp]# gmirror status > Name Status Components > mirror/thinkc COMPLETE ad0 > ggate0 > > And all seems normal again. Seems like it has to do with big files ... > This is the same configuration I used in : > http://bsdtips.utcorp.net/mediawiki/index.php/Mirroring_over_network > This is where the iozone gets stuck : Did you try raising send and receive buffers on ggated? I found myself confortable with -S and -R around 512k-780k. I didnt, however, did an iozone stress test, just a production test (real load) before going production. Try raising the buffer and let us know about your tests. TCP_NODELAY is also worth trying. -- Patrick Tracanelli FreeBSD Brasil LTDA. (31) 3281-9633 / 3281-3547 316601@sip.freebsdbrasil.com.br http://www.freebsdbrasil.com.br "Long live Hanin Elias, Kim Deal!"