From owner-freebsd-virtualization@FreeBSD.ORG Fri Oct 24 05:36:43 2014 Return-Path: Delivered-To: freebsd-virtualization@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 564D6DCC; Fri, 24 Oct 2014 05:36:43 +0000 (UTC) Received: from mail-wi0-x22a.google.com (mail-wi0-x22a.google.com [IPv6:2a00:1450:400c:c05::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 70D01932; Fri, 24 Oct 2014 05:36:42 +0000 (UTC) Received: by mail-wi0-f170.google.com with SMTP id n3so332698wiv.1 for ; Thu, 23 Oct 2014 22:36:40 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:message-id:references:mime-version :content-type:content-disposition:in-reply-to:user-agent; bh=7+pxbGFZibruIx59JPm4doCZlK817jtqLwwip/wT9QM=; b=tcMuKDzTsWFWq8GbT08dE3SKrXwylP37kShX6LyB9CrHeMXbQ/6y6oA3cW2gv81SSu Kr131k/7p5qxekmI9fofwbDdpJtKEiva/fvVAUppqLVf3CDfWYigNvXgph0VTw+ur3mB b3souRl9t78ke8NVcIa/UpCtrBfm7IcALsvP6dlcQPID9pIgKlrd63vulsSTtF+oyAIC O0ZsYsnO/O9RAeP0t0yNhAdXSm87O7XLZw4rvIJnmeeHPQ2jRdCBVXZqSGzJFYD1dSjY gwGxvDF3o0LuFJytvalSVxRJtk5bCoaKZvNwsr07GsyhIAtN70Y3qE3zH5DJQGF3K103 dX8g== X-Received: by 10.180.205.162 with SMTP id lh2mr1688937wic.14.1414129000784; Thu, 23 Oct 2014 22:36:40 -0700 (PDT) Received: from dft-labs.eu (n1x0n-1-pt.tunnel.tserv5.lon1.ipv6.he.net. [2001:470:1f08:1f7::2]) by mx.google.com with ESMTPSA id hg14sm735728wib.24.2014.10.23.22.36.39 for (version=TLSv1.2 cipher=RC4-SHA bits=128/128); Thu, 23 Oct 2014 22:36:39 -0700 (PDT) Date: Fri, 24 Oct 2014 07:36:36 +0200 From: Mateusz Guzik To: Craig Rodrigues Subject: Re: Automatically running /usr/tests on stable/10 branch under Jenkins Message-ID: <20141024053636.GH11222@dft-labs.eu> References: MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "freebsd-testing@freebsd.org" , FreeBSD stable , "freebsd-virtualization@freebsd.org" X-BeenThere: freebsd-virtualization@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: "Discussion of various virtualization techniques FreeBSD supports." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Oct 2014 05:36:43 -0000 On Sun, Oct 12, 2014 at 11:14:45PM -0700, Craig Rodrigues wrote: > Hi, > > I have created this Jenkins job, which you can see a graphical > representation of: > > https://jenkins.freebsd.org/jenkins/view/FreeBSD_src_stable/job/FreeBSD_stable_10/848/BuildGraph/ > It is noted below stuff is being done this for current as well and in that light: > (1) does a buildworld/buildkernel on amd64 when someone checks new > code into the stable/10 branch Is not this excessive? I would suggest every N commits or M hours if there were not enough commits to reach given threshold. Of course no work in there were no commits whatsoever, but then do the work after the first which gets in. > (2) Creates a bootable UFS image with makefs any chance zfs will be used as well? > (3) Boots the image under bhyve > (4) Runs these commands inside the bhyve VM: > > cd /usr/tests > kyua test > kyua report-junit --output=test-output.xml would be nice to run some kind of stress testing. buildworld with a high -j is an example of a general purpose test. This could be done with different frequency than regular tests. > > (5) Shuts down the bhyve VM Do you have crashdumps configured in case stuff goes wrong? > (6) imports test-output.xml into Jenkins. > > You can see a full test report here: > > https://jenkins.freebsd.org/jenkins/job/FreeBSD_stable_10-tests/4/testReport/ > > We already do the same thing for CURRENT. > > Hopefully by running the tests regularly, we can help improve the quality > of FreeBSD. > > > -- > Craig > _______________________________________________ > freebsd-virtualization@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-virtualization > To unsubscribe, send any mail to "freebsd-virtualization-unsubscribe@freebsd.org" -- Mateusz Guzik