From owner-freebsd-current@freebsd.org Sat Jun 25 04:50:41 2016 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C408FB73F9C for ; Sat, 25 Jun 2016 04:50:41 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-211-154.reflexion.net [208.70.211.154]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 8794A21EF for ; Sat, 25 Jun 2016 04:50:41 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 18086 invoked from network); 25 Jun 2016 04:51:10 -0000 Received: from unknown (HELO mail-cs-02.app.dca.reflexion.local) (10.81.19.2) by 0 (rfx-qmail) with SMTP; 25 Jun 2016 04:51:10 -0000 Received: by mail-cs-02.app.dca.reflexion.local (Reflexion email security v7.90.3) with SMTP; Sat, 25 Jun 2016 00:50:30 -0400 (EDT) Received: (qmail 15732 invoked from network); 25 Jun 2016 04:50:30 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 25 Jun 2016 04:50:30 -0000 X-No-Relay: not in my network X-No-Relay: not in my network X-No-Relay: not in my network X-No-Relay: not in my network X-No-Relay: not in my network Received: from [192.168.0.105] (ip70-189-131-151.lv.lv.cox.net [70.189.131.151]) by iron2.pdx.net (Postfix) with ESMTPSA id CC8DF1C4079; Fri, 24 Jun 2016 21:50:26 -0700 (PDT) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Subject: Re: 11.0 -r301815 "kyua test -k /usr/tests/Kyuafile" on rpi2 [armv7-a/cortex-a7]: broken (24) and failing (59) lists From: Mark Millard In-Reply-To: Date: Fri, 24 Jun 2016 21:50:31 -0700 Cc: Ian Lepore , "Conrad E. Meyer" , freebsd-arm , FreeBSD Current Content-Transfer-Encoding: quoted-printable Message-Id: <6727481C-8BD2-4F00-A6F6-3BEE3CC7F2FA@dsl-only.net> References: <1465862808.1188.129.camel@freebsd.org> To: Alan Somers X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 25 Jun 2016 04:50:41 -0000 On 2016-Jun-24, at 2:50 PM, Alan Somers wrote: > As of r302180., the usr.sbin/rpcbind, sys/acl, and sys/sys/bitstring > tests should all be fixed. I opened PR 210329 for the > usr.bin/lastcomm test. I haven't investigated the others. >=20 > -Alan I updated to -r302180 and ran kyua again. It confirms the rpcbind, acl, and bitstring items are gone from the broken and failed lists. This time the totals were 15 broken (down from 24) and 41 failed (down from 59). My results this time were. . . # kyua report --results-filter broken --results-file /usr/tests | more =3D=3D=3D> Broken tests lib/msun/cexp_test:main -> broken: Received signal 6 [1.094s] lib/msun/ctrig_test:main -> broken: Received signal 6 [1.097s] lib/msun/exponential_test:main -> broken: Received signal 6 [1.097s] lib/msun/fenv_test:main -> broken: Received signal 6 [1.099s] lib/msun/fma_test:main -> broken: Received signal 6 [1.114s] lib/msun/invctrig_test:main -> broken: Received signal 6 [1.118s] lib/msun/invtrig_test:main -> broken: Received signal 6 [1.114s] lib/msun/logarithm_test:main -> broken: Received signal 6 [1.096s] lib/msun/lrint_test:main -> broken: Received signal 6 [1.096s] lib/msun/nearbyint_test:main -> broken: Received signal 6 [1.096s] lib/msun/rem_test:main -> broken: Received signal 6 [1.091s] lib/msun/trig_test:main -> broken: Received signal 6 [1.094s] sbin/growfs/legacy_test:main -> broken: Reported plan differs from = actual executed tests [0.479s] sys/geom/class/eli/integrity_copy_test:main -> broken: Test case timed = out [1200.089s] sys/geom/class/eli/onetime_a_test:main -> broken: Test case timed out = [600.041s] =3D=3D=3D> Summary Results read from = /root/.kyua/store/results.usr_tests.20160625-012941-048472.db Test cases: 5700 total, 54 skipped, 20 expected failures, 15 broken, 41 = failed Total time: 9093.092s # kyua report --results-filter failed --results-file /usr/tests | more =3D=3D=3D> Failed tests lib/libc/c063/fstatat_test:fstatat_fd -> failed: = /usr/src/contrib/netbsd-tests/lib/libc/c063/t_fstatat.c:74: memcmp(&st1, = &st2, sizeof(st1)) =3D=3D 0 not met [0.028s] lib/libc/ssp/ssp_test:fgets -> failed: Test case body returned a = non-ok exit code, but this is not allowed [0.159s] lib/libc/ssp/ssp_test:gets -> failed: Test case body returned a non-ok = exit code, but this is not allowed [0.152s] lib/libc/ssp/ssp_test:memcpy -> failed: atf-check failed; see the = output of the test for details [0.150s] lib/libc/ssp/ssp_test:memmove -> failed: atf-check failed; see the = output of the test for details [0.149s] lib/libc/ssp/ssp_test:memset -> failed: atf-check failed; see the = output of the test for details [0.152s] lib/libc/ssp/ssp_test:read -> failed: Test case body returned a non-ok = exit code, but this is not allowed [0.159s] lib/libc/ssp/ssp_test:readlink -> failed: atf-check failed; see the = output of the test for details [0.161s] lib/libc/ssp/ssp_test:snprintf -> failed: atf-check failed; see the = output of the test for details [0.143s] lib/libc/ssp/ssp_test:sprintf -> failed: atf-check failed; see the = output of the test for details [0.143s] lib/libc/ssp/ssp_test:stpcpy -> failed: atf-check failed; see the = output of the test for details [0.146s] lib/libc/ssp/ssp_test:stpncpy -> failed: atf-check failed; see the = output of the test for details [0.149s] lib/libc/ssp/ssp_test:strcat -> failed: atf-check failed; see the = output of the test for details [0.148s] lib/libc/ssp/ssp_test:strcpy -> failed: atf-check failed; see the = output of the test for details [0.152s] lib/libc/ssp/ssp_test:strncat -> failed: atf-check failed; see the = output of the test for details [0.143s] lib/libc/ssp/ssp_test:strncpy -> failed: atf-check failed; see the = output of the test for details [0.147s] lib/libc/ssp/ssp_test:vsnprintf -> failed: atf-check failed; see the = output of the test for details [0.145s] lib/libc/ssp/ssp_test:vsprintf -> failed: atf-check failed; see the = output of the test for details [0.146s] lib/libc/stdio/printbasic_test:int_within_limits -> failed: = printf("%tu", (size_t)-1) =3D=3D> [18446744073709551615], expected = [4294967295]<> [0.029s] lib/libc/stdio/scanfloat_test:infinities_and_nans -> failed: = /usr/src/lib/libc/tests/stdio/scanfloat_test.c:191: = fetestexcept(FE_INVALID) =3D=3D 0 not met [0.032 s] lib/libc/sys/mincore_test:mincore_resid -> failed: = /usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:225: = check_residency(addr, npgs) =3D=3D 0 not met [0.04 1s] lib/libc/sys/mincore_test:mincore_shmseg -> failed: = /usr/src/contrib/netbsd-tests/lib/libc/sys/t_mincore.c:298: = check_residency(addr, npgs) =3D=3D 0 not met [0.0 32s] lib/libc/tls/tls_dynamic_test:t_tls_dynamic -> failed: 15 checks = failed; see output for more details [0.037s] lib/libproc/proc_test:symbol_lookup -> failed: = /usr/src/lib/libproc/tests/proc_test.c:116: state !=3D PS_STOP: process = has state 4 [0.180s] lib/libxo/functional_test:test_02__E -> failed: atf-check failed; see = the output of the test for details [0.165s] lib/libxo/functional_test:test_02__H -> failed: atf-check failed; see = the output of the test for details [0.169s] lib/libxo/functional_test:test_02__HIPx -> failed: atf-check failed; = see the output of the test for details [0.174s] lib/libxo/functional_test:test_02__HP -> failed: atf-check failed; see = the output of the test for details [0.168s] lib/libxo/functional_test:test_02__J -> failed: atf-check failed; see = the output of the test for details [0.168s] lib/libxo/functional_test:test_02__JP -> failed: atf-check failed; see = the output of the test for details [0.165s] lib/libxo/functional_test:test_02__T -> failed: atf-check failed; see = the output of the test for details [0.169s] lib/libxo/functional_test:test_02__X -> failed: atf-check failed; see = the output of the test for details [0.165s] lib/libxo/functional_test:test_02__XP -> failed: atf-check failed; see = the output of the test for details [0.170s] lib/msun/conj_test:main -> failed: 9 tests of 42 failed [0.034s] lib/msun/ldexp_test:ldexp_denormal -> failed: 4 checks failed; see = output for more details [0.032s] local/kyua/model/metadata_test:override_all_with_set_string -> failed: = Line 253: disk_space !=3D md.required_disk_space() (16777216.00T !=3D = 2.00G) [0.045s] local/kyua/testers/tap_parser_test:try_parse_plan__insane -> failed: = testers/tap_parser_test.c:135: 'too long' not matched in 'Plan line = includes out of range numbers' [0.034s] sys/geom/class/eli/resize_test:main -> failed: 15 tests of 27 failed = [1.094s] sys/kern/pipe/pipe_fstat_bug_test:main -> failed: Returned non-success = exit status 1 [0.038s] usr.bin/lastcomm/legacy_test:main -> failed: 4 tests of 6 failed = [0.139s] usr.sbin/sa/legacy_test:main -> failed: 12 tests of 13 failed = [0.330s] =3D=3D=3D> Summary Results read from = /root/.kyua/store/results.usr_tests.20160625-012941-048472.db Test cases: 5700 total, 54 skipped, 20 expected failures, 15 broken, 41 = failed Total time: 9093.092s =3D=3D=3D Mark Millard markmi@dsl-only.net