From owner-freebsd-stable@FreeBSD.ORG Tue Oct 30 09:30:48 2007 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 2FCF516A418; Tue, 30 Oct 2007 09:30:48 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from woozle.rinet.ru (woozle.rinet.ru [195.54.192.68]) by mx1.freebsd.org (Postfix) with ESMTP id AABE113C4BC; Tue, 30 Oct 2007 09:30:47 +0000 (UTC) (envelope-from marck@rinet.ru) Received: from localhost (localhost [127.0.0.1]) by woozle.rinet.ru (8.14.1/8.14.1) with ESMTP id l9U9UbhW046023; Tue, 30 Oct 2007 12:30:37 +0300 (MSK) (envelope-from marck@rinet.ru) Date: Tue, 30 Oct 2007 12:30:37 +0300 (MSK) From: Dmitry Morozovsky To: Alfred Perlstein In-Reply-To: <20071029232403.GE33488@elvis.mu.org> Message-ID: <20071030122816.U39332@woozle.rinet.ru> References: <20071029111235.E69594@woozle.rinet.ru> <20071029232403.GE33488@elvis.mu.org> X-NCC-RegID: ru.rinet X-OpenPGP-Key-ID: 6B691B03 MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-3.0 (woozle.rinet.ru [0.0.0.0]); Tue, 30 Oct 2007 12:30:38 +0300 (MSK) Cc: stable@freebsd.org Subject: Re: rrdtool performance tuning (fwd) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2007 09:30:48 -0000 On Mon, 29 Oct 2007, Alfred Perlstein wrote: AP> * Dmitry Morozovsky [071029 12:44] wrote: AP> > AP> > [hmm, after thinking a bit I decided it would be more appropriate here, in AP> > stable@] AP> > AP> > Dear colleagues, AP> > AP> > any hints to tune rrdtool with ~30k rrd files (approx 2k target devices)? AP> > AP> > machine is mostly IO-bound, showing 100% disk load with 8 or sometimes even 3 AP> > mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror) AP> AP> More ram? Already 2G, mostly inactive/free. AP> AP> Turn off atime? For sure, and even tried to move rrd data to smaller UFS2 - same result. AP> Hash the data files into multiple directories to avoid having 2k files AP> in one dir. Hmm, I thought 2k is not so much, especially where UFSDIRHASH is in place... AP> Not sure how rrd tool works internally, but it might make sense AP> to see if you can use some layering library to force it to cache AP> some open files per process or something. It seems it using a lot of mmap... Sincerely, D.Marck [DM5020, MCK-RIPE, DM3-RIPN] [ FreeBSD committer: marck@FreeBSD.org ] ------------------------------------------------------------------------ *** Dmitry Morozovsky --- D.Marck --- Wild Woozle --- marck@rinet.ru *** ------------------------------------------------------------------------