From owner-freebsd-virtualization@FreeBSD.ORG Mon Oct 27 23:43:03 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 4F469138; Mon, 27 Oct 2014 23:43:03 +0000 (UTC) Received: from mail-lb0-x232.google.com (mail-lb0-x232.google.com [IPv6:2a00:1450:4010:c04::232]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 5E90C839; Mon, 27 Oct 2014 23:43:02 +0000 (UTC) Received: by mail-lb0-f178.google.com with SMTP id f15so3035039lbj.23 for ; Mon, 27 Oct 2014 16:42:59 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=jLxlJImGK/mdvrc4s9ZJgf2hzd0Z2XnjfAWa86+8krc=; b=gIPoI9aFxNzvmlJVRB6hHK2bTw7kF0QKYkB0K7f5c/NpOG9KNvsvdfju45yMabQhtf iKCxTd4d+KqYWQjSuS2fDufNU0mvb1/DQW4DOWKhd5wr33Q795leBGPSCiEAcT1ZsMKe sGmsklN0QdIzpsXpOVBAIb28qfT3MhofkzjUqZw8GV5zZWSJzIIOpM++4u1M0EH89j6e gov2o2ftHn8ZQInXE+OzDoNybkbmnaeSq81098ZnCrOuh+oK+juryxFiUl6k0BdAeuod BkLozhE+lxO9B2y/SS5dYlrvOqV5X3b+ovoLOJALQ2ilWWteB8OGlhMyr7cZFSbOSSRL sPFQ== MIME-Version: 1.0 X-Received: by 10.112.225.225 with SMTP id rn1mr6640441lbc.98.1414453379125; Mon, 27 Oct 2014 16:42:59 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.84.197 with HTTP; Mon, 27 Oct 2014 16:42:58 -0700 (PDT) In-Reply-To: <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com> References: <5449C81B.8080008@freebsd.org> <5449DB7C.9080107@xinuos.com> <06ec01cfef62$3776a6b0$a663f410$@Xinuos.com> <886660362.1106176.1414183052149.JavaMail.zimbra@xinuos.com> Date: Mon, 27 Oct 2014 16:42:58 -0700 X-Google-Sender-Auth: on84ll1GpO2p1hbmo-9AeDvZW3E Message-ID: Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins From: Craig Rodrigues To: Susan Stanziano Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: John Wolfe , "freebsd-virtualization@freebsd.org" , "freebsd-testing@freebsd.org" , Eric@xinuos.com, Allan Jude , Cheryl Blain , Andy Nagle X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Oct 2014 23:43:03 -0000 Susan, In addition to the slides which I previously mentioned, you and your colleagues at Xinuos may wish to take a quick read of this document which I wrote, the "Kyua Quickstart Guide": https://github.com/rodrigc/kyua/wiki/Quickstart-Guide kyua is the test harness that is used to run the tests in the /usr/tests directory in FreeBSD. That doc is a very quick guide on how to run tests under kyua, and also how to write tests which can be run under kyua. Getting any feedback on this would be very useful. Does that doc make sense to a newcomer? Are there typos? I want the FreeBSD project to get to the point where: (1) anybody can download the FreeBSD tests (2) anybody can run the tests (3) people can easily figure out how to write new tests and contribute them back (if they wish) to FreeBSD Better documentation will hopefully help with this. Thanks. -- Craig On Fri, Oct 24, 2014 at 1:37 PM, Susan Stanziano wrote: > Hello Craig, > > I have been reading through your slides and your website announcement, as > requested, and have a few questions. (I have also subscribed to the > mailing list as suggested). > > (1) The slides indicate that with a FreeBSD10 and lower OS, I should be > able to build tests already included with FreeBSD. I have created a VM on > FreeBSD10.0 but do not have the /etc/make.conf file necessary to build and > install the tests. This may be that I am missing some set-up steps > required but not covered in the slide presentation. > > (2) Does the test build require the use of the "Build Flow Plugin" or can > the tests be run independent of the "continuous build" model? > > (3) Can the tests only be run under Bhyve as described in the announcement? > > I would be happy to exchange emails with you or skype as I investigate > this work further. > > Regards, > > Susan > > ------------------------------ > *From: *"Craig Rodrigues" > *To: *Eric@xinuos.com > *Cc: *"Allan Jude" , "John Wolfe" , > freebsd-virtualization@freebsd.org, freebsd-testing@freebsd.org, "Susan > Stanziano" , "Cheryl Blain" < > cheryl.blain@xinuos.com>, "Andy Nagle" > *Sent: *Friday, October 24, 2014 7:09:04 AM > *Subject: *Re: Re: Automatically running /usr/tests on stable/10 branch > under Jenkins > > > > > On Fri, Oct 24, 2014 at 1:11 AM, Eric le Blan wrote: > >> Allan, >> >> >> >> Always happy to discuss testing. I believe that Susan Stanziono of Xinuos >> system test team already spoke to some of you. Please do not hesitate to >> reach her for any specific needs. Also, Cheryl Blain - Xinuos VP of >> operations - will be at the MeetBSD vendor summit on Nov 3-4 and can reach >> to Craig. > > > > It would be helpful if someone (or some people) from Xinuous could do the > following: > > (1) Subscribe to freebsd-testing@freebsd.org at > https://lists.freebsd.org/mailman/listinfo/freebsd-testing to start > monitoring the discussions on that list. > > (2) Review this announcement: > http://jenkins-ci.org/content/freebsd-project-use-jenkins-os-testing > > (3) Review these slides: > http://www.slideshare.net/CraigRodrigues1/kyua-jenkins > > (4) Talk to me at MeetBSD Vendor Summit > > I have not been given a long timeslot to give a presentation, so reviewing > those links before MeetBSD would > be helpful. Long term, any testing of FreeBSD will only succeed if there > is > an ecosystem of people working together and sharing common scripts and > information for testing FreeBSD. > > Any help that Xinuous (or any other company) can provide would be welcome. > > -- > Craig > >