Date: Thu, 11 Apr 2019 11:09:23 -0400 (EDT) From: Susan Stanziano <susan.stanziano@xinuos.com> To: NGie Cooper <yaneurabeya@gmail.com>, asomers@freebsd.org Cc: freebsd-testing <freebsd-testing@freebsd.org> Subject: Re: Kyua reporting tool question Message-ID: <989313104.2320168.1554995363573.JavaMail.zimbra@xinuos.com> In-Reply-To: <1433014530.2305640.1554952181864.JavaMail.zimbra@xinuos.com> References: <555587672.2279585.1554935416410.JavaMail.zimbra@xinuos.com> <80FAC842-ECCB-438F-BBC4-0995A7C1D7B1@gmail.com> <359307252.2304183.1554948627748.JavaMail.zimbra@xinuos.com> <0BD361D0-3B1F-4B3D-AD65-A85153E745AA@gmail.com> <1433014530.2305640.1554952181864.JavaMail.zimbra@xinuos.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Just to update this, I tried the report tool on a FreeBSD12 VM this morning= =20 with kyua version 0.13_4,3 (a later version than I had before) and it worke= d as expected.=20 I could get just the failed testcases reported with:=20 "kyua report --results-filter=3Dfailed" or even with "kyua report --results= -filter failed"=20 Alan - should I still report this as a bug on the earlier version?=20 Thanks,=20 Susan=20 From: "Susan Stanziano" <susan.stanziano@xinuos.com>=20 To: "NGie Cooper" <yaneurabeya@gmail.com>=20 Cc: "freebsd-testing" <freebsd-testing@freebsd.org>=20 Sent: Wednesday, April 10, 2019 11:09:41 PM=20 Subject: Re: Kyua reporting tool question=20 kyua-0.13_2,3=20 Name: kyua=20 Version: 0.13_2,3=20 Installed on: Wed Dec 19 08:45:14 2018 EST=20 Origin: devel/kyua=20 Architecture: FreeBSD:10:amd64=20 Prefix: /usr/local=20 Categories: devel=20 Liceses: BSD3CLAUSE=20 Maintainer: jmmv@FreeBSD.org=20 WWW: https://github.com/jmmv/kyua/=20 This is installed on an OpenServer10 (based on FreeBSD10.3) VM.=20 I don't believe that modifications would have been made to kyua in the Xinu= os repository,=20 but I will ask about that.=20 Tomorrow I will install a FreeBSD12 VM and try running kyua there.=20 Thanks,=20 Susan=20 From: "NGie Cooper" <yaneurabeya@gmail.com>=20 To: "Susan Stanziano" <susan.stanziano@xinuos.com>=20 Cc: "freebsd-testing" <freebsd-testing@freebsd.org>=20 Sent: Wednesday, April 10, 2019 10:12:26 PM=20 Subject: Re: Kyua reporting tool question=20 This doesn=E2=80=99t make sense=E2=80=A6 Could you share some more details,= e.g., what version of kyua are you using, where did you obtain it from, an= d does the version of kyua you=E2=80=99re using have any local modification= s?=20 Thank you!=20 -Enji=20 On Apr 10, 2019, at 7:10 PM, Susan Stanziano < susan.stanziano@xinuos.com >= wrote:=20 Hi NGie,=20 Thanks for the response. I tried this again with:=20 #kyua report --results-filter=3Dfailed --output=3Dtest-output.xml=20 and I still see "passed" test results in the output file.=20 If this is the correct syntax for creating an output file with only failed = test results,=20 then I'm beginning to wonder if somehow my script is wrong somewhere else a= nd=20 I will spend some time taking it apart step by step.=20 Susan=20 From: "NGie Cooper" < yaneurabeya@gmail.com >=20 To: "Susan Stanziano" < susan.stanziano@xinuos.com >=20 Cc: "freebsd-testing" < freebsd-testing@freebsd.org >=20 Sent: Wednesday, April 10, 2019 6:34:55 PM=20 Subject: Re: Kyua reporting tool question=20 > On Apr 10, 2019, at 3:30 PM, Susan Stanziano < susan.stanziano@xinuos.com= > wrote:=20 >=20 > Hi all,=20 >=20 > A question on the kyua reporting tool:=20 >=20 > kyua report --results-filter=20 >=20 > should not include passed tests if used without an argument.=20 >=20 > But, when I run it this way I get all results including passed.=20 >=20 > And if I run it with an argument (failed), I still get all results:=20 >=20 > kyua report --results-filter failed=20 >=20 > --results-filter types Comma-separated list of the test result types to i= nclude in the=20 > report. The ordering of the values is respected so that you can=20 > determine how you want the list of tests to be shown.=20 >=20 > The valid values are: =E2=80=98broken=E2=80=99, =E2=80=98failed=E2=80=99,= =E2=80=98passed=E2=80=99, =E2=80=98skipped=E2=80=99 and=20 > =E2=80=98xfail=E2=80=99. If the parameter supplied to the option is empty= , filtering=20 > is suppressed and all result types are shown in the report.=20 >=20 > The default value for this flag includes all the test results except=20 > the passed tests. Showing the passed tests by default clutters the=20 > report with too much information, so only abnormal conditions are=20 >=20 > Any insight is appreciated.=20 Hi Susan!=20 What happens if you use `kyua report =E2=80=94results-filter=3Dfailed` (not= e the `=3D`)?=20 -Enji=20
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?989313104.2320168.1554995363573.JavaMail.zimbra>