From owner-freebsd-stable@FreeBSD.ORG Tue Oct 30 01:04:04 2007 Return-Path: Delivered-To: stable@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 9BD0816A474 for ; Tue, 30 Oct 2007 01:04:04 +0000 (UTC) (envelope-from oleg@vsi.ru) Received: from serv4.vsi.ru (serv4.vsi.ru [80.82.32.19]) by mx1.freebsd.org (Postfix) with ESMTP id 2778D13C49D for ; Tue, 30 Oct 2007 01:04:03 +0000 (UTC) (envelope-from oleg@vsi.ru) Received: from OODAMDXP (ws3.oood.vsi.ru [88.83.197.238]) by serv4.vsi.ru (8.13.8+Sun/8.13.8) with SMTP id l9TLGY2g003843; Tue, 30 Oct 2007 00:16:39 +0300 (MSK) Message-ID: <004b01c81a70$f9fcc210$eec55358@OODAMDXP> From: "Oleg Derevenetz" To: "Dmitry Morozovsky" References: <20071029111235.E69594@woozle.rinet.ru> Date: Tue, 30 Oct 2007 00:16:25 +0300 MIME-Version: 1.0 Content-Type: text/plain; format=flowed; charset="iso-8859-1"; reply-type=original Content-Transfer-Encoding: 7bit X-Priority: 3 X-MSMail-Priority: Normal X-Mailer: Microsoft Outlook Express 6.00.2900.3138 X-MimeOLE: Produced By Microsoft MimeOLE V6.00.2900.3198 Cc: stable@freebsd.org Subject: Re: rrdtool performance tuning (fwd) X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Oct 2007 01:04:04 -0000 > [hmm, after thinking a bit I decided it would be more appropriate here, in > stable@] > > Dear colleagues, > > any hints to tune rrdtool with ~30k rrd files (approx 2k target devices)? > > machine is mostly IO-bound, showing 100% disk load with 8 or sometimes > even 3 > mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror) For example, update algorythm can be changed. Try to not update RRD files simultaneously, queue update data instead (with timestamps), for example, in memory, and periodically do a "bulk update" using a single rrdupdate call for all queue items related to single RRD file. This saves I/O a lot, for example, in my NMS (TclMon) I use simular scheme, and now it updates >50K RRD files with 5-10 variables each. I/O load is 100-150 tps with 1-1.5MB/s throughput. -- Oleg Derevenetz OOD3-RIPE Phone: +7 4732 539880 Fax: +7 4732 531415 http://www.vsi.ru CenterTelecom Voronezh ISP http://isp.vsi.ru