From owner-freebsd-net@FreeBSD.ORG Tue Jul 8 11:34:17 2014 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8AAA7C86; Tue, 8 Jul 2014 11:34:17 +0000 (UTC) Received: from mail-vc0-x230.google.com (mail-vc0-x230.google.com [IPv6:2607:f8b0:400c:c03::230]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 23BF62838; Tue, 8 Jul 2014 11:34:17 +0000 (UTC) Received: by mail-vc0-f176.google.com with SMTP id ik5so5235448vcb.35 for ; Tue, 08 Jul 2014 04:34:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type:content-transfer-encoding; bh=Cpgqfvy+eOW1xWLY6vvVz9fRr+x12KuzlqB9lucwcfM=; b=ejb/EZcYS/789HJPDdsyx/wdPEypEYdInI1hNNlrtf+ta0YEyKhiKDWqO3nq/3U+CS 5+ZaRkanOcM8Coexu7bBKRclBS3BXiJuP1HFIDRMtueJjoACPJlFQMGa8o3GSSSTzbn0 Wuoy4vJbuPT++pT58jcuOed7cc86KWP1iNiAUwZ7KOmcQscpPpCc7HpX6XeySLYt9lAq oXrW8KdWylFt2OqM0OUMcFHJ2r6IExQ6yW6ej1Uoqf2Xuxxwy8if2hGu7hksZVqvdqHU t3BlvfAK1rAtBqDihOiR+jJSK89La9xO2n4jeyAsyomTtDhlnCTL4LN86Ma1kL8HYDIQ HUyw== MIME-Version: 1.0 X-Received: by 10.53.7.204 with SMTP id de12mr963062vdd.41.1404819256010; Tue, 08 Jul 2014 04:34:16 -0700 (PDT) Sender: ndenev@gmail.com Received: by 10.220.136.79 with HTTP; Tue, 8 Jul 2014 04:34:15 -0700 (PDT) In-Reply-To: <154F5C90-B0A5-41AD-ABBC-C7ECE1281D7D@gmail.com> References: <154F5C90-B0A5-41AD-ABBC-C7ECE1281D7D@gmail.com> Date: Tue, 8 Jul 2014 12:34:15 +0100 X-Google-Sender-Auth: wcy4yYOB7tkSY-fVuFm9HWkVvhI Message-ID: Subject: Re: A new way to test systems in multiple machine scenarios... From: Nikolay Denev To: Garrett Cooper Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Craig Rodrigues , "freebsd-testing@freebsd.org" , "freebsd-net@freebsd.org" X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Jul 2014 11:34:17 -0000 On Tue, Jul 8, 2014 at 9:56 AM, Garrett Cooper wrote: > On Jul 6, 2014, at 9:06 PM, Craig Rodrigues wrote: > >> On Sat, Jul 5, 2014 at 8:04 PM, George Neville-Neil >> wrote: >> >>> Hi, >>> >>> I've coded up a system to allow you to control multiple other systems f= or >>> use in testing. >>> >>> https://github.com/gvnn3/conductor >>> >>> >> Cool! The architecture you have is similar to that of the SPECsfs >> benchmark test ( http://www.spec.org/sfs2008/ ) >> which involves a "coordinator node" and multiple "client nodes" which >> direct NFS network >> traffic towards a System Under Test (SUT). Garrett Cooper actually set = up >> the original testbed >> that I am using now at iXsystems. :) >> >> It would be cool to put together tools like Jenkins, Kyua, and conductor= to >> do more advanced testing >> of FreeBSD before the project puts out releases. > > Agreed. The only thing that I have some concern about is the reinventing = of the wheel in python. multiprocessing Managers are one viable option that= =E2=80=99s existed since python 2.6; there=E2=80=99s a learning curve thoug= h, and you=E2=80=99ll run into problems with pickling some objects because = the pickle protocol is far from complete (example: http://stackoverflow.com= /questions/1816958/cant-pickle-type-instancemethod-when-using-pythons-multi= processing-pool-ma ); you might run into this problems regardless because y= ou=E2=80=99re serializing objects using pickle instead of using dill (or us= ing a simpler serialization method like JSON). Fabric has a framework that= =E2=80=99s nice to use if you have ssh capability. There are other framewor= ks that use twisted conch I think too (another library that implements ssh = access). > > Isilon has a framework they use, but it=E2=80=99s very customized to thei= r infrastructure and product assumptions and it=E2=80=99s in need of an ove= rhaul :(. > > -Garrett > _______________________________________________ > freebsd-net@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-net > To unsubscribe, send any mail to "freebsd-net-unsubscribe@freebsd.org" This also looks as an interesting option : https://codespeak.net/execnet/ I haven't used personally, but judging from py-test (it's the same author) it should be good :) --Nikolay