Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 30 Oct 2007 00:16:25 +0300
From:      "Oleg Derevenetz" <oleg@vsi.ru>
To:        "Dmitry Morozovsky" <marck@rinet.ru>
Cc:        stable@freebsd.org
Subject:   Re: rrdtool performance tuning (fwd)
Message-ID:  <004b01c81a70$f9fcc210$eec55358@OODAMDXP>
References:  <20071029111235.E69594@woozle.rinet.ru>

next in thread | previous in thread | raw e-mail | index | archive | help
> [hmm, after thinking a bit I decided it would be more appropriate here, in
> stable@]
>
> Dear colleagues,
>
> any hints to tune rrdtool with ~30k rrd files (approx 2k target devices)?
>
> machine is mostly IO-bound, showing 100% disk load with 8 or sometimes 
> even 3
> mB/s, 300-400 tps (it's 2 SATA300 disks in gmirror)

For example, update algorythm can be changed. Try to not update RRD files 
simultaneously, queue update data instead (with timestamps), for example, in 
memory, and periodically do a "bulk update" using a single rrdupdate call 
for all queue items related to single RRD file. This saves I/O a lot, for 
example, in my NMS (TclMon) I use simular scheme, and now it updates >50K 
RRD files with 5-10 variables each. I/O load is 100-150 tps with 1-1.5MB/s 
throughput.

--
Oleg Derevenetz <oleg@vsi.ru> OOD3-RIPE
Phone: +7 4732 539880
Fax:   +7 4732 531415         http://www.vsi.ru
CenterTelecom Voronezh ISP    http://isp.vsi.ru




Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?004b01c81a70$f9fcc210$eec55358>