From owner-freebsd-testing@FreeBSD.ORG  Mon Feb 24 23:07:15 2014
Return-Path: <owner-freebsd-testing@FreeBSD.ORG>
Delivered-To: freebsd-testing@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 9BCD755C;
 Mon, 24 Feb 2014 23:07:15 +0000 (UTC)
Received: from mail-wi0-x22c.google.com (mail-wi0-x22c.google.com
 [IPv6:2a00:1450:400c:c05::22c])
 (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits))
 (No client certificate requested)
 by mx1.freebsd.org (Postfix) with ESMTPS id DEC91128E;
 Mon, 24 Feb 2014 23:07:14 +0000 (UTC)
Received: by mail-wi0-f172.google.com with SMTP id e4so3737734wiv.5
 for <multiple recipients>; Mon, 24 Feb 2014 15:07:13 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113;
 h=mime-version:sender:in-reply-to:references:date:message-id:subject
 :from:to:cc:content-type;
 bh=XtaNqonDs+BSoKIU/kWW3dOCkUB4FFp6HcNjUVu4kcU=;
 b=r7R6o7OdAWUIpa6dT49C79j5qc0YemY8VZAoq40xJRktU6QxSWjH7CGbJdVZxhovNJ
 7XeffXQIkrKADiGGO/XNlT/8z/LF4ez4lPkfp6FZ/isj7m1+kmZD1MKDID35uomxi+Do
 F5HPKzCVQxPGyZYFHyyu+B2CMW+mKf2LsTpRxUYUEinbp5dXJkOG4DOJqVHBMdordYsn
 f7wN3zBv0zL95bELNL1Ti6G1W2ekhDUj4pyJFV/h5pte8HdHR6KK6GUKUP56UbOHiPRf
 24iWIPxmngCAXIHk41gLII/7K45C+IAeM5dTxks2/8lOMokvu4Wxg6GcTkZ+9urN7l8a
 EQww==
MIME-Version: 1.0
X-Received: by 10.180.187.237 with SMTP id fv13mr16504274wic.26.1393283233340; 
 Mon, 24 Feb 2014 15:07:13 -0800 (PST)
Sender: asomers@gmail.com
Received: by 10.194.168.197 with HTTP; Mon, 24 Feb 2014 15:07:13 -0800 (PST)
In-Reply-To: <CAG=rPVd_32sXvZnx_btys=GgjNrxTmC8NAnkwd4U-hRu7eCx=A@mail.gmail.com>
References: <CAG=rPVd_32sXvZnx_btys=GgjNrxTmC8NAnkwd4U-hRu7eCx=A@mail.gmail.com>
Date: Mon, 24 Feb 2014 16:07:13 -0700
X-Google-Sender-Auth: oRDbMQMy59c9jPUDFfdlodStBxM
Message-ID: <CAOtMX2jU3DbxeX3CDJzmWkBAL4CsQK=zs5Vmp8uCFYFze1g+nw@mail.gmail.com>
Subject: Re: Generating Kyua test result output in JUnit XML format for
 Jenkins integration?
From: Alan Somers <asomers@freebsd.org>
To: Craig Rodrigues <rodrigc@freebsd.org>
Content-Type: text/plain; charset=ISO-8859-1
Cc: "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>,
 jenkins-admin@freebsd.org
X-BeenThere: freebsd-testing@freebsd.org
X-Mailman-Version: 2.1.17
Precedence: list
List-Id: Testing on FreeBSD <freebsd-testing.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-testing>, 
 <mailto:freebsd-testing-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-testing/>
List-Post: <mailto:freebsd-testing@freebsd.org>
List-Help: <mailto:freebsd-testing-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-testing>, 
 <mailto:freebsd-testing-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 24 Feb 2014 23:07:15 -0000

On Mon, Feb 24, 2014 at 2:11 PM, Craig Rodrigues <rodrigc@freebsd.org> wrote:
> Hi,
>
> Some Continuous Integration systems like Jenkins
> and Atlassian Bamboo can natively parse
> a test result format called JUnit XML.
>
> How hard would it be to add some code
> to Kyua to optionally be able to generate test result output
> in JUnit XML?
>
> Here is some example Junit XML output:
>
> http://nose2.readthedocs.org/en/latest/plugins/junitxml.html
>
> It would be super cool if by BSDCan we could demo:
>
>  * start Kyua tests in Jenkins
>  * have Kyua run the tests and generate the JUnit XML test output
>  * have the tests results visible in the Jenkins web UI, something like:
>         http://zbyhoo.files.wordpress.com/2011/05/jenkins-tests.png
>
>
> How hard would this be to do?
>
> Is there anyone available who is interested in working on this?

This is a very awesome idea.  Kyua's report-html command is only 286
SLOC long, so this probably won't be very hard.  Do you have a link to
the format specification?  I'm afraid that I can't do the work,
however.  I have extremely limited free time ATM.

-Alan