Date: Wed, 23 Jan 2008 22:16:04 +0100 From: Erik Cederstrand <erik@cederstrand.dk> To: Kris Kennaway <kris@FreeBSD.org> Cc: performance@FreeBSD.org, Robert Watson <rwatson@FreeBSD.org> Subject: Re: Performance Tracker project update Message-ID: <4797AE94.6090502@cederstrand.dk> In-Reply-To: <4797A802.8060509@FreeBSD.org> References: <4796C717.9000507@cederstrand.dk> <20080123193400.N63024@fledge.watson.org> <4797A245.7080202@cederstrand.dk> <20080123202433.E63024@fledge.watson.org> <4797A802.8060509@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
Kris Kennaway wrote: > Robert Watson wrote: >> >> Yes -- I was mostly thinking about backdating in order to play >> "catchup" when a new benchmark is introduced. > > One thing I am looking at is how to best create a library of world > tarballs that can be used to populate a nfsroot (or hybrid of periodic > tarballs + binary diffs to save space). Then you could provide your > benchmark in a standardized format (start/end/cleanup scripts, etc) and > tell a machine "go and run this benchmark on every daily snapshot for > the last year and give me the numbers". That's basically what my server does. It creates world/kernel tarballs (around 90MB), dumps them in an NFS exported folder and adds them to a queue for the slave to consume. The slave installs the tarball on the local disk (via PXE) in less than 2 mins and runs whatever benchmarks it was told. I can pretty easily add more benchmarks later and let the slave collect the data using the tarballs I already created. Currently the benchmark script is contained within the tarball, so each tarball would need to be opened and closed to replace the script. I'd like to change that. It gets a bit complicated when the benchmark depends on another application (e.g. super-smack and mysql). Currently I compile mysql from scratch on every new world using whichever version was the latest in the ports tree at the time. This has some disadvantages. Erik
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?4797AE94.6090502>