Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 27 Nov 2013 08:37:02 -0500
From:      Julio Merino <julio@meroh.net>
To:        Alan Somers <asomers@freebsd.org>
Cc:        "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>
Subject:   Re: Adding new "test interfaces" to work with Kyua?
Message-ID:  <CADyfeQU7Az-J8EmxmWmGcTgZg6O3u=oPYUhuMS04TVh=6wM88A@mail.gmail.com>
In-Reply-To: <CAOtMX2hHL-d5S_tAv9MurdKUeDsQKmR7meYs0pDMO5B517i_1w@mail.gmail.com>
References:  <82E5F5E2-EA2C-46D2-9068-C419A834686C@gmail.com> <CADyfeQUaX4J1ycPhc=79P1fnfQh8E-UO349OzSL50KCJZtbOFw@mail.gmail.com> <751B8D9F-9A1B-46B5-80F8-CB9E44F98BFC@gmail.com> <CADyfeQWO=VVDzSVRoaocWz2sV4PQAiXoESo2_KbDExyTQ1Ztyw@mail.gmail.com> <CADyfeQXOLLtWcbxHa6GzzPGx9epOHq69DXo0Nwo6PzkZc5EvUg@mail.gmail.com> <CAOtMX2hHL-d5S_tAv9MurdKUeDsQKmR7meYs0pDMO5B517i_1w@mail.gmail.com>

next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Nov 26, 2013 at 11:21 PM, Alan Somers <asomers@freebsd.org> wrote:
> It looks like you're interfacing to TAP through its command-line
> interface.  Unfortunately, as your man page notes, that means that
> "kyua list" can't list bundled tests, and thus it will treat them as a
> single unit.
>
> Within FreeBSD, most if not all of the TAP-based tests use Perl's
> Prove module.  Have you considered writing a Prove backend for Kyua
> instead of a TAP backend?  If you write it in Perl, it could have much
> more intimate access to the tests.  Instead of interfacing through the
> CLI, it could dynamically load the tests and interrogate them
> directly.

I hadn't considered that, but it is a good idea. However, having
separate TAP and Prove backends are not mutually exclusive goals.

That said, I don't find the Prove backend a pressing need nor I think
it's as useful as a TAP backend, at least for the time being: what I'd
like is a simple way to transition existing tests to the new layout,
and the TAP backend works for that -- with the added benefit that it
works also for non-Perl tests! Later on, if people want to keep the
Perl-based tests and make them more versatile within Kyua, we can do
that pretty easily.

(And of course, if anyone wants to start writing a more versatile
backend explicitly for Perl tests anyway, please do!)

-- 
Julio Merino / @jmmv



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CADyfeQU7Az-J8EmxmWmGcTgZg6O3u=oPYUhuMS04TVh=6wM88A>