Date: Thu, 11 Apr 2019 08:21:17 -0700 From: Enji Cooper <yaneurabeya@gmail.com> To: Susan Stanziano <susan.stanziano@xinuos.com> Cc: asomers@freebsd.org, freebsd-testing <freebsd-testing@freebsd.org> Subject: Re: Kyua reporting tool question Message-ID: <F293164E-7BDC-42F5-A5E0-DADECACE0B09@gmail.com> In-Reply-To: <989313104.2320168.1554995363573.JavaMail.zimbra@xinuos.com> References: <555587672.2279585.1554935416410.JavaMail.zimbra@xinuos.com> <80FAC842-ECCB-438F-BBC4-0995A7C1D7B1@gmail.com> <359307252.2304183.1554948627748.JavaMail.zimbra@xinuos.com> <0BD361D0-3B1F-4B3D-AD65-A85153E745AA@gmail.com> <1433014530.2305640.1554952181864.JavaMail.zimbra@xinuos.com> <989313104.2320168.1554995363573.JavaMail.zimbra@xinuos.com>
next in thread | previous in thread | raw e-mail | index | archive | help
> On Apr 11, 2019, at 08:09, Susan Stanziano <susan.stanziano@xinuos.com> wr=
ote:
>=20
>=20
> Just to update this, I tried the report tool on a FreeBSD12 VM this mornin=
g
>=20
> with kyua version 0.13_4,3 (a later version than I had before) and it work=
ed as expected.
>=20
> I could get just the failed testcases reported with:
>=20
> "kyua report --results-filter=3Dfailed" or even with "kyua report --result=
s-filter failed"=20
>=20
> Alan - should I still report this as a bug on the earlier version?
Hi Susan,
Could you please create a bug on bugs.freebsd.org and CC dim@? There are=
a number of kyua integration tests that fail on 10.x and 11.x. I wonder if t=
he issue is a part of the root cause.
Thank you!
-Enji
> Thanks,
> Susan
>=20
> From: "Susan Stanziano" <susan.stanziano@xinuos.com>
> To: "NGie Cooper" <yaneurabeya@gmail.com>
> Cc: "freebsd-testing" <freebsd-testing@freebsd.org>
> Sent: Wednesday, April 10, 2019 11:09:41 PM
> Subject: Re: Kyua reporting tool question
>=20
>=20
> kyua-0.13_2,3
> Name: kyua
> Version: 0.13_2,3
> Installed on: Wed Dec 19 08:45:14 2018 EST
> Origin: devel/kyua
> Architecture: FreeBSD:10:amd64
> Prefix: /usr/local
> Categories: devel
> Liceses: BSD3CLAUSE
> Maintainer: jmmv@FreeBSD.org
> WWW: https://github.com/jmmv/kyua/
>=20
> This is installed on an OpenServer10 (based on FreeBSD10.3) VM.
> I don't believe that modifications would have been made to kyua in the Xin=
uos repository,
> but I will ask about that.
>=20
> Tomorrow I will install a FreeBSD12 VM and try running kyua there.
>=20
> Thanks,
> Susan
> From: "NGie Cooper" <yaneurabeya@gmail.com>
> To: "Susan Stanziano" <susan.stanziano@xinuos.com>
> Cc: "freebsd-testing" <freebsd-testing@freebsd.org>
> Sent: Wednesday, April 10, 2019 10:12:26 PM
> Subject: Re: Kyua reporting tool question
>=20
> This doesn=E2=80=99t make sense=E2=80=A6 Could you share some more d=
etails, e.g., what version of kyua are you using, where did you obtain it fr=
om, and does the version of kyua you=E2=80=99re using have any local modific=
ations?
> Thank you!
> -Enji
>=20
> On Apr 10, 2019, at 7:10 PM, Susan Stanziano <susan.stanziano@xinuos.com> w=
rote:
>=20
> Hi NGie,
>=20
> Thanks for the response. I tried this again with:
>=20
> #kyua report --results-filter=3Dfailed --output=3Dtest-output.xml
>=20
> and I still see "passed" test results in the output file.
>=20
> If this is the correct syntax for creating an output file with only failed=
test results,
> then I'm beginning to wonder if somehow my script is wrong somewhere else a=
nd
> I will spend some time taking it apart step by step.
>=20
> Susan
>=20
> From: "NGie Cooper" <yaneurabeya@gmail.com>
> To: "Susan Stanziano" <susan.stanziano@xinuos.com>
> Cc: "freebsd-testing" <freebsd-testing@freebsd.org>
> Sent: Wednesday, April 10, 2019 6:34:55 PM
> Subject: Re: Kyua reporting tool question
>=20
> > On Apr 10, 2019, at 3:30 PM, Susan Stanziano <susan.stanziano@xinuos.com=
> wrote:
> >=20
> > Hi all,=20
> >=20
> > A question on the kyua reporting tool:=20
> >=20
> > kyua report --results-filter=20
> >=20
> > should not include passed tests if used without an argument.=20
> >=20
> > But, when I run it this way I get all results including passed.=20
> >=20
> > And if I run it with an argument (failed), I still get all results:=20
> >=20
> > kyua report --results-filter failed=20
> >=20
> > --results-filter types Comma-separated list of the test result types to i=
nclude in the
> > report. The ordering of the values is respected so that you can=
> > determine how you want the list of tests to be shown.
> >=20
> > The valid values are: =E2=80=98broken=E2=80=99, =E2=80=98failed=E2=
=80=99, =E2=80=98passed=E2=80=99, =E2=80=98skipped=E2=80=99 and
> > =E2=80=98xfail=E2=80=99. If the parameter supplied to the optio=
n is empty, filtering
> > is suppressed and all result types are shown in the report.
> >=20
> > The default value for this flag includes all the test results ex=
cept
> > the passed tests. Showing the passed tests by default clutters t=
he
> > report with too much information, so only abnormal conditions ar=
e=20
> >=20
> > Any insight is appreciated.=20
>=20
>=20
> Hi Susan!
> What happens if you use `kyua report =E2=80=94results-filter=3Dfai=
led` (note the `=3D`)?
> -Enji
>=20
>=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?F293164E-7BDC-42F5-A5E0-DADECACE0B09>