From owner-freebsd-net@FreeBSD.ORG Tue Jul 8 08:56:17 2014 Return-Path: Delivered-To: net@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 60FD1172; Tue, 8 Jul 2014 08:56:17 +0000 (UTC) Received: from mail-pd0-x234.google.com (mail-pd0-x234.google.com [IPv6:2607:f8b0:400e:c02::234]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 28FCA2B14; Tue, 8 Jul 2014 08:56:17 +0000 (UTC) Received: by mail-pd0-f180.google.com with SMTP id fp1so6864087pdb.11 for ; Tue, 08 Jul 2014 01:56:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:content-type:mime-version:subject:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to; bh=Q4k3NbEB1g6W2YFBRhljXgOqAWhtzsVqsntre7gfKJ0=; b=FjiX53SKVpKO/SBJ6b3CkRxoE86+M6LP/w50jVjVvUCia38CpJPgESbZJtkWgc6gvb 5MtUZuwbsWHcgz/Nj474py5fG6/nCJY5LzZ23Z6V33gXgziYyW2QZiWiR8KvDrVlj9Xd 56AOKeELEw5qL5hbpPtHH0U1aB57OpOS1cOP4H+xxTMmEMsEx+rAww5R+ToOavRumOVX mzGoMHhQ7Ww7SLeSnVyoMIVm5FGKThlXscm0pEwLpUsRWUznwbvzkM9cM79n5WviH0fm BMCsR3SAQfDw05s3K1YgenesRYdZ8vPKhdbxnp63xGcMTNgYIbH9mTsWEYSuQ32NTapf hbfg== X-Received: by 10.66.119.39 with SMTP id kr7mr1984020pab.131.1404809776724; Tue, 08 Jul 2014 01:56:16 -0700 (PDT) Received: from ?IPv6:2601:8:ab80:7d6:8045:a94a:de:b331? ([2601:8:ab80:7d6:8045:a94a:de:b331]) by mx.google.com with ESMTPSA id w16sm23469180pdl.36.2014.07.08.01.56.15 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 08 Jul 2014 01:56:15 -0700 (PDT) From: Garrett Cooper X-Google-Original-From: Garrett Cooper Content-Type: text/plain; charset=windows-1252 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.2\)) Subject: Re: A new way to test systems in multiple machine scenarios... In-Reply-To: Date: Tue, 8 Jul 2014 01:56:14 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <154F5C90-B0A5-41AD-ABBC-C7ECE1281D7D@gmail.com> References: To: Craig Rodrigues X-Mailer: Apple Mail (2.1878.2) Cc: "freebsd-testing@freebsd.org" , net@freebsd.org X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 08 Jul 2014 08:56:17 -0000 On Jul 6, 2014, at 9:06 PM, Craig Rodrigues wrote: > On Sat, Jul 5, 2014 at 8:04 PM, George Neville-Neil = > wrote: >=20 >> Hi, >>=20 >> I've coded up a system to allow you to control multiple other systems = for >> use in testing. >>=20 >> https://github.com/gvnn3/conductor >>=20 >>=20 > Cool! The architecture you have is similar to that of the SPECsfs > benchmark test ( http://www.spec.org/sfs2008/ ) > which involves a "coordinator node" and multiple "client nodes" which > direct NFS network > traffic towards a System Under Test (SUT). Garrett Cooper actually = set up > the original testbed > that I am using now at iXsystems. :) >=20 > It would be cool to put together tools like Jenkins, Kyua, and = conductor to > do more advanced testing > of FreeBSD before the project puts out releases. Agreed. The only thing that I have some concern about is the reinventing = of the wheel in python. multiprocessing Managers are one viable option = that=92s existed since python 2.6; there=92s a learning curve though, = and you=92ll run into problems with pickling some objects because the = pickle protocol is far from complete (example: = http://stackoverflow.com/questions/1816958/cant-pickle-type-instancemethod= -when-using-pythons-multiprocessing-pool-ma ); you might run into this = problems regardless because you=92re serializing objects using pickle = instead of using dill (or using a simpler serialization method like = JSON). Fabric has a framework that=92s nice to use if you have ssh = capability. There are other frameworks that use twisted conch I think = too (another library that implements ssh access). Isilon has a framework they use, but it=92s very customized to their = infrastructure and product assumptions and it=92s in need of an overhaul = :(. -Garrett=