From owner-freebsd-testing@FreeBSD.ORG  Sat Oct  4 02:53:30 2014
Return-Path: <owner-freebsd-testing@FreeBSD.ORG>
Delivered-To: freebsd-testing@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115])
 (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by hub.freebsd.org (Postfix) with ESMTPS id 2C4C6CC5;
 Sat,  4 Oct 2014 02:53:30 +0000 (UTC)
Received: from mouf.net (mouf.net [IPv6:2607:fc50:0:4400:216:3eff:fe69:33b3])
 (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "mouf.net", Issuer "mouf.net" (not verified))
 by mx1.freebsd.org (Postfix) with ESMTPS id E0D5AFBB;
 Sat,  4 Oct 2014 02:53:29 +0000 (UTC)
Received: from mouf.net (swills@mouf [199.48.129.64])
 by mouf.net (8.14.5/8.14.5) with ESMTP id s942rM19030466
 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NOT);
 Sat, 4 Oct 2014 02:53:27 GMT (envelope-from swills@mouf.net)
Received: (from swills@localhost)
 by mouf.net (8.14.5/8.14.5/Submit) id s942rMmg030465;
 Sat, 4 Oct 2014 02:53:22 GMT (envelope-from swills)
Date: Sat, 4 Oct 2014 02:53:22 +0000
From: Steve Wills <swills@freebsd.org>
To: Craig Rodrigues <rodrigc@freebsd.org>
Subject: Re: Integrating pkg test results into Jenkins
Message-ID: <20141004025319.GF10488@mouf.net>
References: <CAG=rPVeydri19EgdTaAP1t+VFKRG4UN8jpkN8Trx9LG_sCmxug@mail.gmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <CAG=rPVeydri19EgdTaAP1t+VFKRG4UN8jpkN8Trx9LG_sCmxug@mail.gmail.com>
User-Agent: Mutt/1.5.23 (2014-03-12)
X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.4.3
 (mouf.net [199.48.129.64]); Sat, 04 Oct 2014 02:53:27 +0000 (UTC)
X-Spam-Status: No, score=0.0 required=4.5 tests=HEADER_FROM_DIFFERENT_DOMAINS
 autolearn=unavailable autolearn_force=no version=3.4.0
X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on mouf.net
X-Virus-Scanned: clamav-milter 0.98.3 at mouf.net
X-Virus-Status: Clean
Cc: "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>,
 freebsd-pkg@freebsd.org
X-BeenThere: freebsd-testing@freebsd.org
X-Mailman-Version: 2.1.18-1
Precedence: list
List-Id: Testing on FreeBSD <freebsd-testing.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-testing>, 
 <mailto:freebsd-testing-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-testing/>
List-Post: <mailto:freebsd-testing@freebsd.org>
List-Help: <mailto:freebsd-testing-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-testing>, 
 <mailto:freebsd-testing-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 04 Oct 2014 02:53:30 -0000

On Thu, Oct 02, 2014 at 01:22:55AM -0700, Craig Rodrigues wrote:
> Hi,
> 
> I notice that at http://jenkins.mouf.net/job/pkg/ you are using kyua to
> test pkg.
> 
> Instead of producing an HTML page of the test results, you may wish
> to integrate the output of the tests directly into Jenkins.
> 
> You can do this by:
> 
> (1)  In your Jenkins job's Build section, add this to the end:
> 
> set +e
> # You don't want the job to abort here if kyua returns
> # non-zero status due to any test failurs
> kyua test
> kyua_status=$?
> set -e
> 
> kyua report-junit --output=$WORKSPACE/test-report.xml
> exit $kyua_status
> 
> (2)  In your Jenkins job's Post-Build Actions, add:
> 
>      "Publish JUnit test result report"
> 
>      "Test Report XMLs"  -> test-report.xml
> 
> 
> The end result is quite nice, and looks like this:
> 
> https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/8/testReport/

Thanks for the suggestion, results are here:

http://jenkins.mouf.net/job/pkg/lastCompletedBuild/testReport/

Steve