From owner-freebsd-stable@FreeBSD.ORG Tue Oct 30 12:58:01 2007 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 14B1416A46C for ; Tue, 30 Oct 2007 12:58:01 +0000 (UTC) (envelope-from jdc@parodius.com) Received: from mx01.sc1.parodius.com (mx01.sc1.parodius.com [72.20.106.3]) by mx1.freebsd.org (Postfix) with ESMTP id 0116413C4BE for ; Tue, 30 Oct 2007 12:58:00 +0000 (UTC) (envelope-from jdc@parodius.com) Received: by mx01.sc1.parodius.com (Postfix, from userid 1000) id 2BC141CC076; Tue, 30 Oct 2007 05:58:00 -0700 (PDT) Date: Tue, 30 Oct 2007 05:58:00 -0700 From: Jeremy Chadwick To: Dmitry Morozovsky Message-ID: <20071030125800.GA83333@eos.sc1.parodius.com> References: <20071029111235.E69594@woozle.rinet.ru> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20071029111235.E69594@woozle.rinet.ru> User-Agent: Mutt/1.5.16 (2007-06-09) Cc: stable@FreeBSD.org Subject: Re: rrdtool performance tuning (fwd) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2007 12:58:01 -0000 On Mon, Oct 29, 2007 at 11:13:09AM +0300, Dmitry Morozovsky wrote: > any hints to tune rrdtool with ~30k rrd files (approx 2k target devices)? > > machine is mostly IO-bound, showing 100% disk load with 8 or sometimes even 3 > mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror) Ideas: 1) Stop using rrdtool? This comment is somewhat in jest -- sometimes you can't avoid using it because it's part of something like cricket, cacti, etc., but simultaneously, rrdtool is quite atrocious as far as softwares go. I think it's popular because MRTG has a long-standing track record, thus Tobi's software is well-known. 2) Consider alternative software such as: * http://torrus.org/ * http://www.dynw.com/iog/ * A suite/library on Sourceforge somewhere which I cannot remember the name of, but acted as a data-over-time storage/graphing/plotting alternative to RRDtool. The name of the program was 3 letters, and we used to have a port for it, and may still, if I could remember the name of it. * Write your own (consider using SVG-based data, which you hand a web browser, and let the browser render the results) 3) Consider load balancing the polling (distributing the polling tasks across 2-4 boxes, then store the results on an NFS share) -- | Jeremy Chadwick jdc at parodius.com | | Parodius Networking http://www.parodius.com/ | | UNIX Systems Administrator Mountain View, CA, USA | | Making life hard for others since 1977. PGP: 4BD6C0CB |