From owner-freebsd-testing@FreeBSD.ORG Tue Feb 25 03:12:01 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 41380D40 for ; Tue, 25 Feb 2014 03:12:01 +0000 (UTC) Received: from mail-qc0-f174.google.com (mail-qc0-f174.google.com [209.85.216.174]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id F0D8517F0 for ; Tue, 25 Feb 2014 03:12:00 +0000 (UTC) Received: by mail-qc0-f174.google.com with SMTP id e16so3087819qcx.19 for ; Mon, 24 Feb 2014 19:12:00 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:sender:in-reply-to:references:from :date:message-id:subject:to:cc:content-type; bh=OtuB9onctmS5tnQ3VDRoIiQfgjVqoH+SjosEcyNZfIg=; b=kEwl3MAxtc0aknKvwLBroPngfRThs8cfvkwC4i5MIvalw9oXcmeLblEdltc9WwKkrO Tv2ucuaV6VibSZ4tfmgpwSv+nA1PGdSXy6Jub2sx7/rqHP3bK/UEA+bFrMpTyYC4q1ee L7wwRpElzGxazbGanVoTTeDSO0vTjOnid3VrzKsmY2aMUQFjGkg2rOprkX1Zg9adJy7I 2YV7aQJmCii1iemWS2/u/X5mDb/zNrygUswlE+ClCIjgSdc2bqpRisRPuUMY86J3DXxa LlgXpQqnR6sYgfW4J7vuEy4/e4PHPylDUYtvu1e0HS1RA2y6C+eG2ddmmCmuzRXM9f8S gp9g== X-Gm-Message-State: ALoCoQkNpWCCnfjenNQKpoqP3rFBxNhzhhIcm5Ndo0KCW7XWqj9jWxMfrfaGYCkZZIL8wMx93YsV X-Received: by 10.224.157.7 with SMTP id z7mr34924222qaw.37.1393297460237; Mon, 24 Feb 2014 19:04:20 -0800 (PST) MIME-Version: 1.0 Sender: jmmv@meroh.net Received: by 10.96.83.102 with HTTP; Mon, 24 Feb 2014 19:04:00 -0800 (PST) X-Originating-IP: [108.176.158.82] In-Reply-To: References: From: Julio Merino Date: Mon, 24 Feb 2014 22:04:00 -0500 X-Google-Sender-Auth: IVAVoSrHWjC4PsjBOMP4_PwEB54 Message-ID: Subject: Re: Generating Kyua test result output in JUnit XML format for Jenkins integration? To: Craig Rodrigues Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-testing@freebsd.org, jenkins-admin@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 25 Feb 2014 03:12:01 -0000 On Mon, Feb 24, 2014 at 4:11 PM, Craig Rodrigues wrote: > > Hi, > How hard would it be to add some code > to Kyua to optionally be able to generate test result output > in JUnit XML? (For changes to Kyua itself, please don't forget to include the kyua-discuss (at googlegroups.com) mailing list.) > It would be super cool if by BSDCan we could demo: Certainly. I should have some decent amount of time in a couple of weeks to work on this. Improving reports is the highest priority thing that I have to focus on to improve the face of the test suite. > How hard would this be to do? > > > Is there anyone available who is interested in working on this? It's not hard: the report generation code is self-contained as you can see in cmd_report.cpp and cmd_report_html.cpp. And I think adding JUnit XML output would be a nice addition. In the mid-to-long term, I have some ideas on how to redo the whole report generation code to make it easier to extend and customize. (Well, basically just some ideas I wanna toy with -- which involve rewriting this whole thing in Lua so that adding new backends can be done without rebuilding Kyua.) But these changes will take some time. A first strategical step separate from that and that would make your proposal simpler is to remove the special-cased report-html and instead make the "report" command be able to spit out various formats based on a flag (e.g. --output=junit:/my/file.xml, --output=html:/my/file.html). I have to do this anyway to resolve some "show-stopper" issues in NetBSD land, and with this done plugging a JUnit backend would be trivial and mostly a copy/paste of the HTML backend.