Date: Tue, 8 Jul 2014 01:56:14 -0700 From: Garrett Cooper <yanegomi@gmail.com> To: Craig Rodrigues <rodrigc@FreeBSD.org> Cc: "freebsd-testing@freebsd.org" <testing@freebsd.org>, net@freebsd.org Subject: Re: A new way to test systems in multiple machine scenarios... Message-ID: <154F5C90-B0A5-41AD-ABBC-C7ECE1281D7D@gmail.com> In-Reply-To: <CAG=rPVfREbmv7W465B68HoU8_ig=Y2f_w9_-PL7f2T_bzeAyiQ@mail.gmail.com> References: <B8265086-6875-46A3-BE90-E286CD5066E2@neville-neil.com> <CAG=rPVfREbmv7W465B68HoU8_ig=Y2f_w9_-PL7f2T_bzeAyiQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Jul 6, 2014, at 9:06 PM, Craig Rodrigues <rodrigc@FreeBSD.org> wrote: > On Sat, Jul 5, 2014 at 8:04 PM, George Neville-Neil = <gnn@neville-neil.com> > wrote: >=20 >> Hi, >>=20 >> I've coded up a system to allow you to control multiple other systems = for >> use in testing. >>=20 >> https://github.com/gvnn3/conductor >>=20 >>=20 > Cool! The architecture you have is similar to that of the SPECsfs > benchmark test ( http://www.spec.org/sfs2008/ ) > which involves a "coordinator node" and multiple "client nodes" which > direct NFS network > traffic towards a System Under Test (SUT). Garrett Cooper actually = set up > the original testbed > that I am using now at iXsystems. :) >=20 > It would be cool to put together tools like Jenkins, Kyua, and = conductor to > do more advanced testing > of FreeBSD before the project puts out releases. Agreed. The only thing that I have some concern about is the reinventing = of the wheel in python. multiprocessing Managers are one viable option = that=92s existed since python 2.6; there=92s a learning curve though, = and you=92ll run into problems with pickling some objects because the = pickle protocol is far from complete (example: = http://stackoverflow.com/questions/1816958/cant-pickle-type-instancemethod= -when-using-pythons-multiprocessing-pool-ma ); you might run into this = problems regardless because you=92re serializing objects using pickle = instead of using dill (or using a simpler serialization method like = JSON). Fabric has a framework that=92s nice to use if you have ssh = capability. There are other frameworks that use twisted conch I think = too (another library that implements ssh access). Isilon has a framework they use, but it=92s very customized to their = infrastructure and product assumptions and it=92s in need of an overhaul = :(. -Garrett=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?154F5C90-B0A5-41AD-ABBC-C7ECE1281D7D>