Skip site navigation (1)Skip section navigation (2) 
Date:      Tue, 9 Sep 2014 10:29:52 -0700
From:      yaneurabeya@gmail.com
To:        Alan Somers <asomers@freebsd.org>
Cc:        FreeBSD CURRENT <freebsd-current@freebsd.org>, Allan Jude <allanjude@freebsd.org>
Subject:   Re: Need help fixing tests in CURRENT
Message-ID:  <A4F02434-B367-49A4-9B35-BC6CEFD6550D@gmail.com>
In-Reply-To: <CAOtMX2gGYnh_yV-hNsYJC3bJRxeFKqjqctzN-z3rn-2UgBUy9g@mail.gmail.com>
References:  <CAG=rPVd_On9HnPBcr8Hv_kBT1ekQ7kZViB0tOYQJqT-N=m%2BWMg@mail.gmail.com> <540F34B1.7040103@freebsd.org> <0D9BBC19-3139-4E66-B9E3-263ACB1C056B@gmail.com> <CAOtMX2gGYnh_yV-hNsYJC3bJRxeFKqjqctzN-z3rn-2UgBUy9g@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help 

--Apple-Mail=_EC0D02CB-CBA7-4703-8A7D-C3B3234E3705
Content-Transfer-Encoding: quoted-printable
Content-Type: text/plain;
	charset=windows-1252

On Sep 9, 2014, at 10:17, Alan Somers <asomers@freebsd.org> wrote:

> On Tue, Sep 9, 2014 at 11:13 AM,  <yaneurabeya@gmail.com> wrote:
>> On Sep 9, 2014, at 10:11, Allan Jude <allanjude@freebsd.org> wrote:
>>=20
>>> On 2014-09-09 13:05, Craig Rodrigues wrote:
>>>> Hi,
>>>>=20
>>>> I did a buildworld/installworld of current in a bhyve VM, and then =
did the
>>>> following.
>>>>=20
>>>> pkg install devel/kyua
>>>> cd /usr/tests
>>>> kyua test
>>>> kyua report
>>>> kyua report-html
>>>> kyua report-junit
>>>>=20
>>>> I then published the results in Jenkins:
>>>>=20
>>>> The results are here:
>>>>=20
>>>> =
https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedB=
uild/testReport/
>>>>=20
>>>> There seem to be 31 test failures.  Can folks look into those
>>>> and see if the tests need to be fixed
>>>>=20
>>>> Right now I ran these steps manually, but hopefully over time
>>>> we can automate more of this stuff.
>>>=20
>>> Most of the errors (jot, m4, sed, etc) seems to be:
>>>=20
>>> kyua-tap-tester: Configuration variables not supported; ignoring
>>> 'has.cleanup=3Dfalse'
>>> kyua-tap-tester: Configuration variables not supported; ignoring
>>> 'unprivileged-user=3Dtests=92
>>=20
>> Not quite=85
>>=20
>>> while everything else about the test was successful.
>>=20
>> Hi Craig,
>>        Taking a stab at the issues, most of the problems are because =
of https://github.com/jmmv/kyua/issues/103 . The other issues with atf ( =
https://github.com/jmmv/atf/issues/8 ) and kyua ( =
https://github.com/jmmv/kyua/issues/109 ) are known (I=92m sure about =
ATF, not 100% sure about kyua, but my gut instinct says yes).
>> Thanks!
>> -Garrett
>=20
> There are still a few genuine failures.  usr.bin.yacc.yacc_tests.main
> is failing for reasons that have nothing to do with ATF or Kyua.  So
> are bin.pkill.pkill-j_test.main and bin.pkill.pgrep-j_test.main.

	Ugh=85 the pgrep/pkill -j issue is back ( =
https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D191019 )=85 it was =
fixed for a few weeks, so I suspect it=92s related to the changes that =
kib@ and others have been making to how the proc bits in the kernel are =
handled.
	The yacc issue is new ( =
https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedB=
uild/testReport/usr.bin.yacc/yacc_tests/main/ ). It passes on my =
CURRENT/i386 VM, but it=92s a bit out of date (2 weeks old). I=92ve =
filed https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D193499 to =
track the issue.
Thanks!
-Garrett

$ (cd /usr/tests/usr.bin/yacc/; sudo kyua debug yacc_tests:main)
...
...ok ./yacc/ok_syntax1.tab.c
...ok ./yacc/ok_syntax1.tab.h
** testing ./pure_calc.y
...ok ./yacc/pure_calc.error
...ok ./yacc/pure_calc.output
...ok ./yacc/pure_calc.tab.c
...ok ./yacc/pure_calc.tab.h
** testing ./pure_error.y
...ok ./yacc/pure_error.error
...ok ./yacc/pure_error.output
...ok ./yacc/pure_error.tab.c
...ok ./yacc/pure_error.tab.h
** testing ./quote_calc.y
...ok ./yacc/quote_calc.error
...ok ./yacc/quote_calc.output
...ok ./yacc/quote_calc.tab.c
...ok ./yacc/quote_calc.tab.h
...ok ./yacc/quote_calc-s.error
...ok ./yacc/quote_calc-s.output
...ok ./yacc/quote_calc-s.tab.c
...ok ./yacc/quote_calc-s.tab.h
** testing ./quote_calc2.y
...ok ./yacc/quote_calc2.error
...ok ./yacc/quote_calc2.output
...ok ./yacc/quote_calc2.tab.c
...ok ./yacc/quote_calc2.tab.h
...ok ./yacc/quote_calc2-s.error
...ok ./yacc/quote_calc2-s.output
...ok ./yacc/quote_calc2-s.tab.c
...ok ./yacc/quote_calc2-s.tab.h
** testing ./quote_calc3.y
...ok ./yacc/quote_calc3.error
...ok ./yacc/quote_calc3.output
...ok ./yacc/quote_calc3.tab.c
...ok ./yacc/quote_calc3.tab.h
...ok ./yacc/quote_calc3-s.error
...ok ./yacc/quote_calc3-s.output
...ok ./yacc/quote_calc3-s.tab.c
...ok ./yacc/quote_calc3-s.tab.h
** testing ./quote_calc4.y
...ok ./yacc/quote_calc4.error
...ok ./yacc/quote_calc4.output
...ok ./yacc/quote_calc4.tab.c
...ok ./yacc/quote_calc4.tab.h
...ok ./yacc/quote_calc4-s.error
...ok ./yacc/quote_calc4-s.output
...ok ./yacc/quote_calc4-s.tab.c
...ok ./yacc/quote_calc4-s.tab.h
** testing ./varsyntax_calc1.y
...ok ./yacc/varsyntax_calc1.error
...ok ./yacc/varsyntax_calc1.output
...ok ./yacc/varsyntax_calc1.tab.c
...ok ./yacc/varsyntax_calc1.tab.h
yacc_tests:main  ->  passed
$ uname -a
FreeBSD isilon-fuji-current.local 11.0-CURRENT FreeBSD 11.0-CURRENT #7 =
r270227+e6e86c2(isilon-atf)-dirty: Sat Aug 23 02:26:59 PDT 2014     =
ngie@isilon-fuji-current.local:/usr/obj/usr/src/sys/FUJI  i386

--Apple-Mail=_EC0D02CB-CBA7-4703-8A7D-C3B3234E3705
Content-Transfer-Encoding: 7bit
Content-Disposition: attachment;
	filename=signature.asc
Content-Type: application/pgp-signature;
	name=signature.asc
Content-Description: Message signed with OpenPGP using GPGMail

-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQEcBAEBCgAGBQJUDzkQAAoJEMZr5QU6S73eXRQIAIILHF6brN+KVSSjUa+5fqH+
0TeivLxmouvwrcxhrTrU/Yev2V1NIRe5zjJ7QvvgsVFudFzzJcl/NZE61Vqq9jm9
yJ31XDknBAOubRSVKjAmb6HeSvuHLRbhM7iSpi/IHYRBb5pDp29SlmjjVRC7GnF1
OoMUmVRH+IwDGlQym0U2R/TJ/5GbLp2IJDFcJXNIQ56IsPss6izLNmymxY0tu4M9
mujG/t1e2z+KW/TRRy3gA9SBa/hR7syWw2U+2zujnlPIVmq0QTLvswEyRJG5Njes
CXnEjwtL3RRJKnuYHBRxb/Ov7CiDzGFHCa650RIQod+3UCLbhHaPho2wVqRP5rg=
=YSg4
-----END PGP SIGNATURE-----

--Apple-Mail=_EC0D02CB-CBA7-4703-8A7D-C3B3234E3705--

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?A4F02434-B367-49A4-9B35-BC6CEFD6550D>