Date: Tue, 7 Jan 2014 12:33:25 -0700 From: Alan Somers <asomers@freebsd.org> To: Ivan Voras <ivoras@freebsd.org> Cc: Julio Merino <julio@meroh.net>, "freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org> Subject: Re: Continual benchmarking / regression testing? Message-ID: <CAOtMX2jQ8igSirZH%2Bxsdzo%2BuUaptcsHiFvd7DS8sJ9ZSWKUDjg@mail.gmail.com> In-Reply-To: <CAF-QHFWRAmBSTCoOWRus4OGdqe4xXeoq2%2B5SRQBTNKdR6OjBww@mail.gmail.com> References: <lah8s3$8ur$1@ger.gmane.org> <CADyfeQUwmGnNVjExJGTwzTaTh9VgDgzcX0JNUvOcnpkZ7RK5gg@mail.gmail.com> <CAOtMX2iPTrdWvHA3-GTbGUnBw17BDe6qNi2YfZJKcfLa%2BL7tqg@mail.gmail.com> <CAF-QHFWRAmBSTCoOWRus4OGdqe4xXeoq2%2B5SRQBTNKdR6OjBww@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Jan 7, 2014 at 10:49 AM, Ivan Voras <ivoras@freebsd.org> wrote: > On 7 January 2014 18:01, Alan Somers <asomers@freebsd.org> wrote: >> Unfortunately, my framework is extremely incomplete. It's not even >> good enough for internal use, much less a wider audience. And I fear >> that my bosses won't give me any more time to work on it. It's also >> written in Ruby and uses STAF to command slave nodes, which the >> FreeBSD community might not be excited about. However, if there is >> any interest, I can ask for permission to share my design as a >> starting point for a more general framework. > > I don't think I have the time+spare brainpower to learn Ruby (I'm a > Pythonista) but it would be interested to see the design you've > created. > > I've looked at STAF before and I'm curious why you picked it? It > seemed a combination of being antiquated and an overkill to me... I picked Ruby and STAF for the same reason: we're already using them at $JOB. In the case of STAF, we were already using it as part of our continuous install and test system. We aren't using very many of its capabilities, though. In particular, we've long since switched from STAX to ATF/Kyua. Basically, we only use STAF to execute commands on a remote machine. It offers a little more control than using SSH. We also use the STAF semaphore service to ensure exclusive access to both test machines and network slaves.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAOtMX2jQ8igSirZH%2Bxsdzo%2BuUaptcsHiFvd7DS8sJ9ZSWKUDjg>