From owner-freebsd-stable@FreeBSD.ORG Mon Oct 29 23:46:24 2007 Return-Path: Delivered-To: stable@FreeBSD.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 8ED0516A469 for ; Mon, 29 Oct 2007 23:46:24 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: from elvis.mu.org (elvis.mu.org [192.203.228.196]) by mx1.freebsd.org (Postfix) with ESMTP id 837B013C481 for ; Mon, 29 Oct 2007 23:46:24 +0000 (UTC) (envelope-from bright@elvis.mu.org) Received: by elvis.mu.org (Postfix, from userid 1192) id 1D4471A4D87; Mon, 29 Oct 2007 16:24:03 -0700 (PDT) Date: Mon, 29 Oct 2007 16:24:03 -0700 From: Alfred Perlstein To: Dmitry Morozovsky Message-ID: <20071029232403.GE33488@elvis.mu.org> References: <20071029111235.E69594@woozle.rinet.ru> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20071029111235.E69594@woozle.rinet.ru> User-Agent: Mutt/1.4.2.3i Cc: stable@FreeBSD.org Subject: Re: rrdtool performance tuning (fwd) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 29 Oct 2007 23:46:24 -0000 * Dmitry Morozovsky [071029 12:44] wrote: > > [hmm, after thinking a bit I decided it would be more appropriate here, in > stable@] > > Dear colleagues, > > any hints to tune rrdtool with ~30k rrd files (approx 2k target devices)? > > machine is mostly IO-bound, showing 100% disk load with 8 or sometimes even 3 > mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror) More ram? Turn off atime? Hash the data files into multiple directories to avoid having 2k files in one dir. Not sure how rrd tool works internally, but it might make sense to see if you can use some layering library to force it to cache some open files per process or something. giving a better synopsis on how rrd records data could help us help you. -Alfred