From owner-freebsd-testing@FreeBSD.ORG Wed Jun 11 03:44:33 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 32F7FE98; Wed, 11 Jun 2014 03:44:33 +0000 (UTC) Received: from mail-wg0-x22f.google.com (mail-wg0-x22f.google.com [IPv6:2a00:1450:400c:c00::22f]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 77F1E229F; Wed, 11 Jun 2014 03:44:32 +0000 (UTC) Received: by mail-wg0-f47.google.com with SMTP id k14so7289288wgh.6 for ; Tue, 10 Jun 2014 20:44:30 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=fPZEVqa6XF5mni4SmEPCPmRYtm3KelAWAV62uDkDswY=; b=KIYg0I2tkkQKq13Rllg6z3HJmTBiAPTpF5GfPWHGdsAwGTQWfSdOoZ5P6vjzIODMIt St0dr334F4k32FmaE+jM8zHQbeg+0Oa2TcNJsP0UvPBndzaXUpPEq8oey1TJqHMyMieF IE+W307F65vW1ULUraxopVnee4ytPFMIT5Lg2P9CBiKNqoGY6UTm93svPXIyS9R4KAB/ 2fMrsC3l9oRWzeityOUQpF1YbmiQD6bt8kgUVw15UEH9DSYOYX5ZyAZyyyFKgEMY5Dkj fiGFSm/TU6rccINX7E8uQOKPOgq9/oxFKka+w7EZmVJPzd+kDQ+of2W3O/1j+hIkUi3j mx4g== MIME-Version: 1.0 X-Received: by 10.180.101.98 with SMTP id ff2mr43803610wib.40.1402458270721; Tue, 10 Jun 2014 20:44:30 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.194.168.202 with HTTP; Tue, 10 Jun 2014 20:44:30 -0700 (PDT) In-Reply-To: References: Date: Tue, 10 Jun 2014 21:44:30 -0600 X-Google-Sender-Auth: ApBQkKp4sReFzqK4Qjtw95DbvH8 Message-ID: Subject: Re: Kyua + Jenkins integration From: Alan Somers To: Craig Rodrigues Content-Type: text/plain; charset=UTF-8 Cc: "freebsd-testing@freebsd.org" , "jenkins-admin@freebsd.org" X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jun 2014 03:44:33 -0000 On Tue, Jun 10, 2014 at 7:49 PM, Craig Rodrigues wrote: > Hi, > > At BSDCan 2014, I met with Julio Merino, > and we discussed how we could better integrate Kyua and Jenkins. > > To summarize, Julio modified Kyua, so that someone can do: > > kyua test (runs the tests) > kyua report-junit (creates test output in JUnit XML format) > > The JUnit XML can be directly imported into Jenkins, > which has a UI for reporting the status of tests. > > I ran the Kyua tests in the /usr/tests directory in FreeBSD > and imported the output into Jenkins here: > > https://jenkins.freebsd.org/jenkins/job/Kyua_Integration/5/testReport/ > > > This is a significant milestone! > We will definitely build on this moving forward > > Thanks to Julio for working on the code, and blogging about it here: > > http://julipedia.meroh.net/2014/05/refocusing-kyua-maybe.html > > -- > Craig > _______________________________________________ > freebsd-testing@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-testing > To unsubscribe, send any mail to "freebsd-testing-unsubscribe@freebsd.org" Nice! Also, the "diff" columns will be very useful, if they do what I think they do. But I do see one problem: there's no message for why a test was skipped. Plain "kyua report" will give an explanation like "skipped: required configuration variable Foo was undefined". But that doesn't show up in the Jenkins output. -Alan