From owner-freebsd-testing@freebsd.org Thu Apr 11 02:12:30 2019 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 00BA71574CDC for ; Thu, 11 Apr 2019 02:12:30 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pl1-x629.google.com (mail-pl1-x629.google.com [IPv6:2607:f8b0:4864:20::629]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 193BB6F82E for ; Thu, 11 Apr 2019 02:12:29 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pl1-x629.google.com with SMTP id t16so2566923plo.0 for ; Wed, 10 Apr 2019 19:12:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:message-id:mime-version:subject:date:in-reply-to:cc:to :references; bh=hs1aVDrmz3OTOE5jrCgfxAmOOZcNzq2VUnQEPv/PBAQ=; b=bLb0HgBg5eql8PJaiwv8OFTTaYhmKQwdYAGuquIQAoGRp+lzHmLE6EMmcgTC1RZ7ai 7qNe/KfDtOV2B7/V6QXfi4lXWqH/S8QZplHRouswFSvXbcfH/QbHNeDioKGpkaOaEWRJ 3uTlVejTjgrQKNNVNS08mMedRDcnsksYKqf+aHpWM9NjaPFP53M/8fzel8X0vNxIFHPY Uu6z1H9x88YLTt3JesG8724JK4psFvE+aPRodxbH1mPqInMZckbolhDF2xP04+vcNXOv cFzaHMJnGeXYWVmfUXnM+RQ7iATomb9ORetiO1Ms+yJ6pJnSPi5Ns52V1sQaN/B6MSn6 JweQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:message-id:mime-version:subject:date :in-reply-to:cc:to:references; bh=hs1aVDrmz3OTOE5jrCgfxAmOOZcNzq2VUnQEPv/PBAQ=; b=LIGpx2V/ZFXeFYWcErPp0jRI032DhKCym3/pWK3v+2MFrAFft49VZGG+bPK9m8oEIm 6bwcn/JGE5as1N9JfUhH7Pn/yVyv5q7cZJIScz9QZ78CTYTz42z926DadwQpaGLJdL6h mCKS30aae7oUErnG/f7HICBV8tag2s8+eMYLBfU3ujo3Ytyxp7xEnNlMb+EzjTlV5d47 gWyAoNCNvs6PXXoTWSuu2rxbgwFYpPvRyVRIFo39KR9G1aC5FjUDanl9bfD7r2uqudTG 2q/ZXDS/H8gZDj/ntCZyA/2eDgW3Gj3Jee8vnbLUHKLqlVQWSzdOwBJ/dUmfwiDDuoRX o/2A== X-Gm-Message-State: APjAAAWIc/t5huokqdGrFfgXvm3z3vb1zzIMzCVh0DPxmnyJAaGUDizI 0+SCdCf1wta8NeUlClpqkJeG82nxX6ungg== X-Google-Smtp-Source: APXvYqwg2EEJYMtTmne62waTf8bCtC18wVeDD4fcIEEs+GvCW5y6jzb02vC1XiSc7ssYF6TF3bQX0w== X-Received: by 2002:a17:902:4a0c:: with SMTP id w12mr18926548pld.52.1554948747905; Wed, 10 Apr 2019 19:12:27 -0700 (PDT) Received: from [192.168.20.7] (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id j14sm39462455pfa.57.2019.04.10.19.12.26 (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Wed, 10 Apr 2019 19:12:27 -0700 (PDT) From: Enji Cooper Message-Id: <0BD361D0-3B1F-4B3D-AD65-A85153E745AA@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: Kyua reporting tool question Date: Wed, 10 Apr 2019 19:12:26 -0700 In-Reply-To: <359307252.2304183.1554948627748.JavaMail.zimbra@xinuos.com> Cc: freebsd-testing To: Susan Stanziano References: <555587672.2279585.1554935416410.JavaMail.zimbra@xinuos.com> <80FAC842-ECCB-438F-BBC4-0995A7C1D7B1@gmail.com> <359307252.2304183.1554948627748.JavaMail.zimbra@xinuos.com> X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 193BB6F82E X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20161025 header.b=bLb0HgBg; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::629 as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com X-Spamd-Result: default: False [-6.41 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4000::/36]; MV_CASE(0.50)[]; RCVD_COUNT_THREE(0.00)[3]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; NEURAL_HAM_SHORT(-0.98)[-0.978,0]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+,1:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20161025]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-testing@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[9.2.6.0.0.0.0.0.0.0.0.0.0.0.0.0.0.2.0.0.4.6.8.4.0.b.8.f.7.0.6.2.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.92)[ip: (-9.39), ipnet: 2607:f8b0::/32(-2.96), asn: 15169(-2.19), country: US(-0.06)] Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.29 X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Apr 2019 02:12:30 -0000 This doesn=E2=80=99t make sense=E2=80=A6 Could you share some = more details, e.g., what version of kyua are you using, where did you = obtain it from, and does the version of kyua you=E2=80=99re using have = any local modifications? Thank you! -Enji > On Apr 10, 2019, at 7:10 PM, Susan Stanziano = wrote: >=20 > Hi NGie, >=20 > Thanks for the response. I tried this again with: >=20 > #kyua report --results-filter=3Dfailed --output=3Dtest-output.xml >=20 > and I still see "passed" test results in the output file. >=20 > If this is the correct syntax for creating an output file with only = failed test results, > then I'm beginning to wonder if somehow my script is wrong somewhere = else and > I will spend some time taking it apart step by step. >=20 > Susan >=20 > From: "NGie Cooper" > To: "Susan Stanziano" > Cc: "freebsd-testing" > Sent: Wednesday, April 10, 2019 6:34:55 PM > Subject: Re: Kyua reporting tool question >=20 > > On Apr 10, 2019, at 3:30 PM, Susan Stanziano = wrote: > >=20 > > Hi all,=20 > >=20 > > A question on the kyua reporting tool:=20 > >=20 > > kyua report --results-filter=20 > >=20 > > should not include passed tests if used without an argument.=20 > >=20 > > But, when I run it this way I get all results including passed.=20 > >=20 > > And if I run it with an argument (failed), I still get all results:=20= > >=20 > > kyua report --results-filter failed=20 > >=20 > > --results-filter types Comma-separated list of the test result types = to include in the > > report. The ordering of the values is respected so that you = can > > determine how you want the list of tests to be shown. > >=20 > > The valid values are: =E2=80=98broken=E2=80=99, = =E2=80=98failed=E2=80=99, =E2=80=98passed=E2=80=99, =E2=80=98skipped=E2=80= =99 and > > =E2=80=98xfail=E2=80=99. If the parameter supplied to the = option is empty, filtering > > is suppressed and all result types are shown in the report. > >=20 > > The default value for this flag includes all the test = results except > > the passed tests. Showing the passed tests by default = clutters the > > report with too much information, so only abnormal = conditions are=20 > >=20 > > Any insight is appreciated.=20 >=20 >=20 > Hi Susan! > What happens if you use `kyua report =E2=80=94results-filter=3Df= ailed` (note the `=3D`)? > -Enji