Date: Fri, 24 Jun 2016 21:50:31 -0700 From: Mark Millard <markmi@dsl-only.net> To: Alan Somers <asomers@freebsd.org> Cc: Ian Lepore <ian@freebsd.org>, "Conrad E. Meyer" <cem@freebsd.org>, freebsd-arm <freebsd-arm@freebsd.org>, FreeBSD Current <freebsd-current@freebsd.org> Subject: Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists Message-ID: <6727481C-8BD2-4F00-A6F6-3BEE3CC7F2FA@dsl-only.net> In-Reply-To: <CAOtMX2hSZn4g411_Mgp_TrKYF7neavbc1BDnfpsECsUDVPuudw@mail.gmail.com> References: <F86BEFBC-9A3D-48A5-A389-2C97267ADE37@dsl-only.net> <CAOtMX2geyMO1wk9r4iusQ8uS=07DQZWYKFnidY7kCtjjAckymg@mail.gmail.com> <CAG6CVpUWuC2ys0cpfRnfV91MPpNOFU4%2BfMLRLCLkESmm=Nohyw@mail.gmail.com> <1465862808.1188.129.camel@freebsd.org> <CAOtMX2hSZn4g411_Mgp_TrKYF7neavbc1BDnfpsECsUDVPuudw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On 2016-Jun-24, at 2:50 PM, Alan Somers <asomers@freebsd.org> wrote:
> As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring
> tests should all be fixed. I opened PR 210329 for the
> usr.bin/lastcomm test. I haven't investigated the others.
>=20
> -Alan
I updated to -r302180 and ran kyua again. It confirms the rpcbind, acl,
and bitstring items are gone from the broken and failed lists.
This time the totals were 15 broken (down from 24) and 41 failed (down
from 59).
My results this time were. . .
# kyua report --results-filter broken --results-file /usr/tests | more
=3D=3D=3D> Broken tests
lib/msun/cexp_test:main -> broken: Received signal 6 [1.094s]
lib/msun/ctrig_test:main -> broken: Received signal 6 [1.097s]
lib/msun/exponential_test:main -> broken: Received signal 6 [1.097s]
lib/msun/fenv_test:main -> broken: Received signal 6 [1.099s]
lib/msun/fma_test:main -> broken: Received signal 6 [1.114s]
lib/msun/invctrig_test:main -> broken: Received signal 6 [1.118s]
lib/msun/invtrig_test:main -> broken: Received signal 6 [1.114s]
lib/msun/logarithm_test:main -> broken: Received signal 6 [1.096s]
lib/msun/lrint_test:main -> broken: Received signal 6 [1.096s]
lib/msun/nearbyint_test:main -> broken: Received signal 6 [1.096s]
lib/msun/rem_test:main -> broken: Received signal 6 [1.091s]
lib/msun/trig_test:main -> broken: Received signal 6 [1.094s]
sbin/growfs/legacy_test:main -> broken: Reported plan differs from =
actual executed tests [0.479s]
sys/geom/class/eli/integrity_copy_test:main -> broken: Test case timed =
out [1200.089s]
sys/geom/class/eli/onetime_a_test:main -> broken: Test case timed out =
[600.041s]
=3D=3D=3D> Summary
Results read from =
/root/.kyua/store/results.usr_tests.20160625-012941-048472.db
Test cases: 5700 total, 54 skipped, 20 expected failures, 15 broken, 41 =
failed
Total time: 9093.092s
# kyua report --results-filter failed --results-file /usr/tests | more
=3D=3D=3D> Failed tests
lib/libc/c063/fstatat_test:fstatat_fd -> failed: =
/usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(&st1, =
&st2, sizeof(st1)) =3D=3D 0 not met [0.028s]
lib/libc/ssp/ssp_test:fgets -> failed: Test case body returned a =
non-ok exit code, but this is not allowed [0.159s]
lib/libc/ssp/ssp_test:gets -> failed: Test case body returned a non-ok =
exit code, but this is not allowed [0.152s]
lib/libc/ssp/ssp_test:memcpy -> failed: atf-check failed; see the =
output of the test for details [0.150s]
lib/libc/ssp/ssp_test:memmove -> failed: atf-check failed; see the =
output of the test for details [0.149s]
lib/libc/ssp/ssp_test:memset -> failed: atf-check failed; see the =
output of the test for details [0.152s]
lib/libc/ssp/ssp_test:read -> failed: Test case body returned a non-ok =
exit code, but this is not allowed [0.159s]
lib/libc/ssp/ssp_test:readlink -> failed: atf-check failed; see the =
output of the test for details [0.161s]
lib/libc/ssp/ssp_test:snprintf -> failed: atf-check failed; see the =
output of the test for details [0.143s]
lib/libc/ssp/ssp_test:sprintf -> failed: atf-check failed; see the =
output of the test for details [0.143s]
lib/libc/ssp/ssp_test:stpcpy -> failed: atf-check failed; see the =
output of the test for details [0.146s]
lib/libc/ssp/ssp_test:stpncpy -> failed: atf-check failed; see the =
output of the test for details [0.149s]
lib/libc/ssp/ssp_test:strcat -> failed: atf-check failed; see the =
output of the test for details [0.148s]
lib/libc/ssp/ssp_test:strcpy -> failed: atf-check failed; see the =
output of the test for details [0.152s]
lib/libc/ssp/ssp_test:strncat -> failed: atf-check failed; see the =
output of the test for details [0.143s]
lib/libc/ssp/ssp_test:strncpy -> failed: atf-check failed; see the =
output of the test for details [0.147s]
lib/libc/ssp/ssp_test:vsnprintf -> failed: atf-check failed; see the =
output of the test for details [0.145s]
lib/libc/ssp/ssp_test:vsprintf -> failed: atf-check failed; see the =
output of the test for details [0.146s]
lib/libc/stdio/printbasic_test:int_within_limits -> failed: =
printf("%tu", (size_t)-1) =3D=3D> [18446744073709551615], expected =
[4294967295]<<NEWLINE>> [0.029s]
lib/libc/stdio/scanfloat_test:infinities_and_nans -> failed: =
/usr/src/lib/libc/tests/stdio/scanfloat_test.c:191: =
fetestexcept(FE_INVALID) =3D=3D 0 not met [0.032
s]
lib/libc/sys/mincore_test:mincore_resid -> failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:225: =
check_residency(addr, npgs) =3D=3D 0 not met [0.04
1s]
lib/libc/sys/mincore_test:mincore_shmseg -> failed: =
/usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:298: =
check_residency(addr, npgs) =3D=3D 0 not met [0.0
32s]
lib/libc/tls/tls_dynamic_test:t_tls_dynamic -> failed: 15 checks =
failed; see output for more details [0.037s]
lib/libproc/proc_test:symbol_lookup -> failed: =
/usr/src/lib/libproc/tests/proc_test.c:116: state !=3D PS_STOP: process =
has state 4 [0.180s]
lib/libxo/functional_test:test_02__E -> failed: atf-check failed; see =
the output of the test for details [0.165s]
lib/libxo/functional_test:test_02__H -> failed: atf-check failed; see =
the output of the test for details [0.169s]
lib/libxo/functional_test:test_02__HIPx -> failed: atf-check failed; =
see the output of the test for details [0.174s]
lib/libxo/functional_test:test_02__HP -> failed: atf-check failed; see =
the output of the test for details [0.168s]
lib/libxo/functional_test:test_02__J -> failed: atf-check failed; see =
the output of the test for details [0.168s]
lib/libxo/functional_test:test_02__JP -> failed: atf-check failed; see =
the output of the test for details [0.165s]
lib/libxo/functional_test:test_02__T -> failed: atf-check failed; see =
the output of the test for details [0.169s]
lib/libxo/functional_test:test_02__X -> failed: atf-check failed; see =
the output of the test for details [0.165s]
lib/libxo/functional_test:test_02__XP -> failed: atf-check failed; see =
the output of the test for details [0.170s]
lib/msun/conj_test:main -> failed: 9 tests of 42 failed [0.034s]
lib/msun/ldexp_test:ldexp_denormal -> failed: 4 checks failed; see =
output for more details [0.032s]
local/kyua/model/metadata_test:override_all_with_set_string -> failed: =
Line 253: disk_space !=3D md.required_disk_space() (16777216.00T !=3D =
2.00G) [0.045s]
local/kyua/testers/tap_parser_test:try_parse_plan__insane -> failed: =
testers/tap_parser_test.c:135: 'too long' not matched in 'Plan line =
includes out of range
numbers' [0.034s]
sys/geom/class/eli/resize_test:main -> failed: 15 tests of 27 failed =
[1.094s]
sys/kern/pipe/pipe_fstat_bug_test:main -> failed: Returned non-success =
exit status 1 [0.038s]
usr.bin/lastcomm/legacy_test:main -> failed: 4 tests of 6 failed =
[0.139s]
usr.sbin/sa/legacy_test:main -> failed: 12 tests of 13 failed =
[0.330s]
=3D=3D=3D> Summary
Results read from =
/root/.kyua/store/results.usr_tests.20160625-012941-048472.db
Test cases: 5700 total, 54 skipped, 20 expected failures, 15 broken, 41 =
failed
Total time: 9093.092s
=3D=3D=3D
Mark Millard
markmi@dsl-only.net
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?6727481C-8BD2-4F00-A6F6-3BEE3CC7F2FA>