From owner-freebsd-stable@FreeBSD.ORG Tue Oct 30 17:06:23 2007 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 40D2E16A417; Tue, 30 Oct 2007 17:06:23 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (grnl-static-02-0046.dsl.iowatelecom.net [69.66.56.110]) by mx1.freebsd.org (Postfix) with ESMTP id B288E13C480; Tue, 30 Oct 2007 17:06:18 +0000 (UTC) (envelope-from brooks@lor.one-eyed-alien.net) Received: from lor.one-eyed-alien.net (localhost [127.0.0.1]) by lor.one-eyed-alien.net (8.13.8/8.13.8) with ESMTP id l9UH6I0H044780; Tue, 30 Oct 2007 12:06:18 -0500 (CDT) (envelope-from brooks@lor.one-eyed-alien.net) Received: (from brooks@localhost) by lor.one-eyed-alien.net (8.14.1/8.13.8/Submit) id l9UH6HAt044764; Tue, 30 Oct 2007 12:06:17 -0500 (CDT) (envelope-from brooks) Date: Tue, 30 Oct 2007 12:06:17 -0500 From: Brooks Davis To: Dmitry Morozovsky Message-ID: <20071030170617.GA31835@lor.one-eyed-alien.net> References: <20071029111235.E69594@woozle.rinet.ru> <20071029195033.GA87137@lor.one-eyed-alien.net> <20071030123100.K39332@woozle.rinet.ru> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="ZGiS0Q5IWpPtfppv" Content-Disposition: inline In-Reply-To: <20071030123100.K39332@woozle.rinet.ru> User-Agent: Mutt/1.5.16 (2007-06-09) X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (lor.one-eyed-alien.net [127.0.0.1]); Tue, 30 Oct 2007 12:06:18 -0500 (CDT) Cc: stable@freebsd.org, Brooks Davis Subject: Re: rrdtool performance tuning (fwd) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2007 17:06:23 -0000 --ZGiS0Q5IWpPtfppv Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Tue, Oct 30, 2007 at 12:32:42PM +0300, Dmitry Morozovsky wrote: > On Mon, 29 Oct 2007, Brooks Davis wrote: >=20 > BD> On Mon, Oct 29, 2007 at 11:13:09AM +0300, Dmitry Morozovsky wrote: > BD> >=20 > BD> > [hmm, after thinking a bit I decided it would be more appropriate h= ere, in=20 > BD> > stable@] > BD> >=20 > BD> > Dear colleagues, > BD> >=20 > BD> > any hints to tune rrdtool with ~30k rrd files (approx 2k target dev= ices)? > BD> >=20 > BD> > machine is mostly IO-bound, showing 100% disk load with 8 or someti= mes even 3=20 > BD> > mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror) > BD>=20 > BD> Store it on a memory file system and take periodic snapshots. The fo= rmat is > BD> hopeless for large numbers of updates. The ganglia port's startup sc= ripts show > BD> an example of doing this. >=20 > I thought about this, but total size of these files is already more than= =20 > memory, and I'm not sure md would be suitable for this. FWIW, this is the only work around ganglia users have found. You might consider a solid state disk or one of the battery backed RAM cards out there if adding more memory and switching to a 64-bit OS isn't an option. -- Brooks --ZGiS0Q5IWpPtfppv Content-Type: application/pgp-signature Content-Disposition: inline -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.6 (FreeBSD) iD8DBQFHJ2SIXY6L6fI4GtQRArbOAKDZWFb+zjd/fd2lM2mZL11H6JbtCACfblq0 WnUOe9cdw2NK10UDWKvcdOY= =06OA -----END PGP SIGNATURE----- --ZGiS0Q5IWpPtfppv--