From owner-freebsd-testing@freebsd.org Thu Apr 11 02:10:30 2019 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 287211574B6C for ; Thu, 11 Apr 2019 02:10:30 +0000 (UTC) (envelope-from susan.stanziano@xinuos.com) Received: from zhost.uxsglobal.com (zhost.xinuos.com [144.202.236.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id AB4AF6F595 for ; Thu, 11 Apr 2019 02:10:28 +0000 (UTC) (envelope-from susan.stanziano@xinuos.com) Received: from zhost.uxsglobal.com (localhost [127.0.0.1]) by zhost.uxsglobal.com (Postfix) with ESMTPS id E2D2F880417; Wed, 10 Apr 2019 22:10:27 -0400 (EDT) Received: from zhost.uxsglobal.com (localhost [127.0.0.1]) by zhost.uxsglobal.com (Postfix) with ESMTPS id C9544880676; Wed, 10 Apr 2019 22:10:27 -0400 (EDT) DKIM-Filter: OpenDKIM Filter v2.9.2 zhost.uxsglobal.com C9544880676 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xinuos.com; s=710E410E-A6C0-11E6-9C55-A8275FB0EC07; t=1554948627; bh=m1eITmNISp3U6Uq/B5mvItCsnMLDMuL8rdlDHD9WUps=; h=Date:From:To:Message-ID:Subject:MIME-Version:Content-Type; b=hgAeiBq02Qa+tdOCDoxN6AeTjeUE98IMSbRrTTdwG4l1cF1AIqAKxKfUiL3WpKLnp O9vAVgfwy/3L6Vxae8f3qMOkw+EsiP896aW2FKziy6t3R5Ap2r6BSjmLEUmxpAk2c8 wDxNR8oOjV4DZxHC2/fJqM5oGW3VbWbzVQKLnOek= Received: from zhost.uxsglobalhost.com (localhost [127.0.0.1]) by zhost.uxsglobal.com (Postfix) with ESMTP id C1359880417; Wed, 10 Apr 2019 22:10:27 -0400 (EDT) Date: Wed, 10 Apr 2019 22:10:27 -0400 (EDT) From: Susan Stanziano To: NGie Cooper Cc: freebsd-testing Message-ID: <359307252.2304183.1554948627748.JavaMail.zimbra@xinuos.com> In-Reply-To: <80FAC842-ECCB-438F-BBC4-0995A7C1D7B1@gmail.com> References: <555587672.2279585.1554935416410.JavaMail.zimbra@xinuos.com> <80FAC842-ECCB-438F-BBC4-0995A7C1D7B1@gmail.com> Subject: Re: Kyua reporting tool question MIME-Version: 1.0 X-Originating-IP: [71.251.34.187] X-Mailer: Zimbra 8.6.0_GA_1153 (ZimbraWebClient - GC73 (Win)/8.6.0_GA_1153) Thread-Topic: Kyua reporting tool question Thread-Index: V3Fza6niN3RBXAkyrokODElh+pB61g== X-Rspamd-Queue-Id: AB4AF6F595 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=xinuos.com header.s=710E410E-A6C0-11E6-9C55-A8275FB0EC07 header.b=hgAeiBq0; spf=pass (mx1.freebsd.org: domain of susan.stanziano@xinuos.com designates 144.202.236.63 as permitted sender) smtp.mailfrom=susan.stanziano@xinuos.com X-Spamd-Result: default: False [-3.94 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[xinuos.com:s=710E410E-A6C0-11E6-9C55-A8275FB0EC07]; HAS_XOIP(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:144.202.236.60/30]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_NA(0.00)[xinuos.com]; RCVD_COUNT_THREE(0.00)[4]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; MX_GOOD(-0.01)[cached: mx1-us2.ppe-hosted.com]; DKIM_TRACE(0.00)[xinuos.com:+]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.78)[-0.776,0]; IP_SCORE(-0.65)[asn: 26094(-3.20), country: US(-0.06)]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:26094, ipnet:144.202.224.0/19, country:US]; MID_RHS_MATCH_FROM(0.00)[] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Apr 2019 02:10:30 -0000 Hi NGie,=20 Thanks for the response. I tried this again with:=20 #kyua report --results-filter=3Dfailed --output=3Dtest-output.xml=20 and I still see "passed" test results in the output file.=20 If this is the correct syntax for creating an output file with only failed = test results,=20 then I'm beginning to wonder if somehow my script is wrong somewhere else a= nd=20 I will spend some time taking it apart step by step.=20 Susan=20 From: "NGie Cooper" =20 To: "Susan Stanziano" =20 Cc: "freebsd-testing" =20 Sent: Wednesday, April 10, 2019 6:34:55 PM=20 Subject: Re: Kyua reporting tool question=20 > On Apr 10, 2019, at 3:30 PM, Susan Stanziano = wrote:=20 >=20 > Hi all,=20 >=20 > A question on the kyua reporting tool:=20 >=20 > kyua report --results-filter=20 >=20 > should not include passed tests if used without an argument.=20 >=20 > But, when I run it this way I get all results including passed.=20 >=20 > And if I run it with an argument (failed), I still get all results:=20 >=20 > kyua report --results-filter failed=20 >=20 > --results-filter types Comma-separated list of the test result types to i= nclude in the=20 > report. The ordering of the values is respected so that you can=20 > determine how you want the list of tests to be shown.=20 >=20 > The valid values are: =E2=80=98broken=E2=80=99, =E2=80=98failed=E2=80=99,= =E2=80=98passed=E2=80=99, =E2=80=98skipped=E2=80=99 and=20 > =E2=80=98xfail=E2=80=99. If the parameter supplied to the option is empty= , filtering=20 > is suppressed and all result types are shown in the report.=20 >=20 > The default value for this flag includes all the test results except=20 > the passed tests. Showing the passed tests by default clutters the=20 > report with too much information, so only abnormal conditions are=20 >=20 > Any insight is appreciated.=20 Hi Susan!=20 What happens if you use `kyua report =E2=80=94results-filter=3Dfailed` (not= e the `=3D`)?=20 -Enji=20