From owner-cvs-all@FreeBSD.ORG Thu Nov 11 19:47:56 2004 Return-Path: Delivered-To: cvs-all@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 6F1A216A4EA; Thu, 11 Nov 2004 19:47:56 +0000 (GMT) Received: from repoman.freebsd.org (repoman.freebsd.org [216.136.204.115]) by mx1.FreeBSD.org (Postfix) with ESMTP id 0400A43D45; Thu, 11 Nov 2004 19:47:56 +0000 (GMT) (envelope-from nik@FreeBSD.org) Received: from repoman.freebsd.org (localhost [127.0.0.1]) by repoman.freebsd.org (8.12.11/8.12.11) with ESMTP id iABJlt34034089; Thu, 11 Nov 2004 19:47:55 GMT (envelope-from nik@repoman.freebsd.org) Received: (from nik@localhost) by repoman.freebsd.org (8.12.11/8.12.11/Submit) id iABJlt3N034088; Thu, 11 Nov 2004 19:47:55 GMT (envelope-from nik) Message-Id: <200411111947.iABJlt3N034088@repoman.freebsd.org> From: Nik Clayton Date: Thu, 11 Nov 2004 19:47:55 +0000 (UTC) To: src-committers@FreeBSD.org, cvs-src@FreeBSD.org, cvs-all@FreeBSD.org X-FreeBSD-CVS-Branch: HEAD Subject: cvs commit: src/tools/regression README TODO src/tools/regression/geom_concat test-1.t test-2.t src/tools/regression/geom_gate test-1.t test-2.t test-3.t src/tools/regression/include/tgmath tgmath.c tgmath.t ... X-BeenThere: cvs-all@freebsd.org X-Mailman-Version: 2.1.1 Precedence: list List-Id: CVS commit messages for the entire tree List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Nov 2004 19:47:56 -0000 nik 2004-11-11 19:47:55 UTC FreeBSD src repository Modified files: tools/regression README tools/regression/include/tgmath tgmath.c tools/regression/lib/libc/locale test-btowc.c test-iswctype.c test-mblen.c test-mbrlen.c test-mbrtowc.c test-mbsnrtowcs.c test-mbsrtowcs.c test-mbstowcs.c test-mbtowc.c test-sgetrune.c test-sputrune.c test-towctrans.c test-wcrtomb.c test-wcsnrtombs.c test-wcsrtombs.c test-wcstombs.c test-wctomb.c tools/regression/lib/libc/net test-eui64_aton.c test-eui64_line.c test-eui64_ntoa.c tools/regression/lib/libc/stdio test-perror.c test-printfloat.c test-scanfloat.c tools/regression/lib/libc/stdlib test-heapsort.c test-mergesort.c test-qsort.c tools/regression/lib/libc/string test-strerror.c tools/regression/lib/msun test-fenv.c test-ilogb.c tools/regression/netinet/ipsockopt ipsockopt.c tools/regression/pipe bigpipetest.c tools/regression/sockets/accept_fd_leak accept_fd_leak.c tools/regression/sockets/accf_data_attach accf_data_attach.c tools/regression/sockets/kqueue kqueue.c tools/regression/usr.bin regress.m4 tools/regression/usr.bin/file2c regress.sh tools/regression/usr.bin/join regress.sh tools/regression/usr.bin/jot regress.sh tools/regression/usr.bin/m4 regress.sh tools/regression/usr.bin/make Makefile tools/regression/usr.bin/sed regress.sh tools/regression/usr.bin/uudecode regress.sh tools/regression/usr.bin/uuencode regress.sh tools/regression/usr.bin/xargs regress.sh Added files: tools/regression TODO tools/regression/geom RunTest.t tools/regression/geom_concat test-1.t test-2.t tools/regression/geom_gate test-1.t test-2.t test-3.t tools/regression/include/tgmath tgmath.t tools/regression/lib/libc/locale test-btowc.t test-iswctype.t test-mblen.t test-mbrlen.t test-mbrtowc.t test-mbsnrtowcs.t test-mbsrtowcs.t test-mbstowcs.t test-mbtowc.t test-sgetrune.t test-sputrune.t test-towctrans.t test-wcrtomb.t test-wcsnrtombs.t test-wcsrtombs.t test-wcstombs.t test-wctomb.t tools/regression/lib/libc/net test-eui64_aton.t test-eui64_line.t test-eui64_ntoa.t tools/regression/lib/libc/stdio test-perror.t test-printfloat.t test-scanfloat.t tools/regression/lib/libc/stdlib test-heapsort.t test-mergesort.t test-qsort.t tools/regression/lib/libc/string test-strerror.t tools/regression/lib/msun test-fenv.t test-ilogb.t tools/regression/netinet/ipsockopt ipsockopt.t tools/regression/pipe bigpipetest.t tools/regression/sockets/accept_fd_leak accept_fd_leak.t tools/regression/sockets/accf_data_attach accf_data_attach.t tools/regression/sockets/kqueue kqueue.t tools/regression/usr.bin/file2c regress.t tools/regression/usr.bin/join regress.t tools/regression/usr.bin/jot regress.t tools/regression/usr.bin/m4 regress.t tools/regression/usr.bin/make regress.t tools/regression/usr.bin/sed regress.t tools/regression/usr.bin/uudecode regress.t tools/regression/usr.bin/uuencode regress.t tools/regression/usr.bin/xargs regress.t Log: Switch over to a different, more flexible test output protocol that's understood by Perl's Test::Harness module and prove(1) commands. Update README to describe the new protocol. The work's broken down into two main sets of changes. First, update the existing test programs (shell scripts and C programs) to produce output in the ok/not ok format, and to, where possible, also produce a header describing the number of tests that are expected to be run. Second, provide the .t files that actually run the tests. In some cases these are copies of, or very similar too, scripts that already existed. I've kept the old scripts around so that it's possible to verify that behaviour under this new system (in terms of whether or not a test fails) is identical to the behaviour under the old system. Add a TODO file. Revision Changes Path 1.12 +52 -5 src/tools/regression/README 1.1 +38 -0 src/tools/regression/TODO (new) 1.1 +50 -0 src/tools/regression/geom/RunTest.t (new) 1.1 +29 -0 src/tools/regression/geom_concat/test-1.t (new) 1.1 +34 -0 src/tools/regression/geom_concat/test-2.t (new) 1.1 +40 -0 src/tools/regression/geom_gate/test-1.t (new) 1.1 +31 -0 src/tools/regression/geom_gate/test-2.t (new) 1.1 +34 -0 src/tools/regression/geom_gate/test-3.t (new) 1.2 +7 -3 src/tools/regression/include/tgmath/tgmath.c 1.1 +10 -0 src/tools/regression/include/tgmath/tgmath.t (new) 1.4 +4 -2 src/tools/regression/lib/libc/locale/test-btowc.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-btowc.t (new) 1.2 +4 -2 src/tools/regression/lib/libc/locale/test-iswctype.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-iswctype.t (new) 1.3 +3 -1 src/tools/regression/lib/libc/locale/test-mblen.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mblen.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-mbrlen.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbrlen.t (new) 1.5 +3 -1 src/tools/regression/lib/libc/locale/test-mbrtowc.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbrtowc.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-mbsnrtowcs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbsnrtowcs.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-mbsrtowcs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbsrtowcs.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-mbstowcs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbstowcs.t (new) 1.3 +3 -1 src/tools/regression/lib/libc/locale/test-mbtowc.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-mbtowc.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-sgetrune.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-sgetrune.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-sputrune.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-sputrune.t (new) 1.3 +4 -2 src/tools/regression/lib/libc/locale/test-towctrans.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-towctrans.t (new) 1.4 +3 -1 src/tools/regression/lib/libc/locale/test-wcrtomb.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-wcrtomb.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-wcsnrtombs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-wcsnrtombs.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-wcsrtombs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-wcsrtombs.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/locale/test-wcstombs.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-wcstombs.t (new) 1.3 +3 -1 src/tools/regression/lib/libc/locale/test-wctomb.c 1.1 +10 -0 src/tools/regression/lib/libc/locale/test-wctomb.t (new) 1.3 +8 -3 src/tools/regression/lib/libc/net/test-eui64_aton.c 1.1 +10 -0 src/tools/regression/lib/libc/net/test-eui64_aton.t (new) 1.3 +9 -4 src/tools/regression/lib/libc/net/test-eui64_line.c 1.1 +10 -0 src/tools/regression/lib/libc/net/test-eui64_line.t (new) 1.3 +5 -3 src/tools/regression/lib/libc/net/test-eui64_ntoa.c 1.1 +10 -0 src/tools/regression/lib/libc/net/test-eui64_ntoa.t (new) 1.2 +3 -1 src/tools/regression/lib/libc/stdio/test-perror.c 1.1 +10 -0 src/tools/regression/lib/libc/stdio/test-perror.t (new) 1.8 +2 -1 src/tools/regression/lib/libc/stdio/test-printfloat.c 1.1 +10 -0 src/tools/regression/lib/libc/stdio/test-printfloat.t (new) 1.4 +3 -1 src/tools/regression/lib/libc/stdio/test-scanfloat.c 1.1 +10 -0 src/tools/regression/lib/libc/stdio/test-scanfloat.t (new) 1.2 +2 -1 src/tools/regression/lib/libc/stdlib/test-heapsort.c 1.1 +10 -0 src/tools/regression/lib/libc/stdlib/test-heapsort.t (new) 1.2 +2 -1 src/tools/regression/lib/libc/stdlib/test-mergesort.c 1.1 +10 -0 src/tools/regression/lib/libc/stdlib/test-mergesort.t (new) 1.2 +2 -1 src/tools/regression/lib/libc/stdlib/test-qsort.c 1.1 +10 -0 src/tools/regression/lib/libc/stdlib/test-qsort.t (new) 1.2 +4 -2 src/tools/regression/lib/libc/string/test-strerror.c 1.1 +10 -0 src/tools/regression/lib/libc/string/test-strerror.t (new) 1.3 +2 -1 src/tools/regression/lib/msun/test-fenv.c 1.1 +10 -0 src/tools/regression/lib/msun/test-fenv.t (new) 1.2 +4 -3 src/tools/regression/lib/msun/test-ilogb.c 1.1 +10 -0 src/tools/regression/lib/msun/test-ilogb.t (new) 1.4 +2 -1 src/tools/regression/netinet/ipsockopt/ipsockopt.c 1.1 +10 -0 src/tools/regression/netinet/ipsockopt/ipsockopt.t (new) 1.3 +3 -0 src/tools/regression/pipe/bigpipetest.c 1.1 +10 -0 src/tools/regression/pipe/bigpipetest.t (new) 1.5 +4 -2 src/tools/regression/sockets/accept_fd_leak/accept_fd_leak.c 1.1 +10 -0 src/tools/regression/sockets/accept_fd_leak/accept_fd_leak.t (new) 1.3 +26 -16 src/tools/regression/sockets/accf_data_attach/accf_data_attach.c 1.1 +10 -0 src/tools/regression/sockets/accf_data_attach/accf_data_attach.t (new) 1.3 +52 -9 src/tools/regression/sockets/kqueue/kqueue.c 1.1 +10 -0 src/tools/regression/sockets/kqueue/kqueue.t (new) 1.4 +2 -0 src/tools/regression/usr.bin/file2c/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/file2c/regress.t (new) 1.4 +2 -0 src/tools/regression/usr.bin/join/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/join/regress.t (new) 1.4 +2 -0 src/tools/regression/usr.bin/jot/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/jot/regress.t (new) 1.4 +4 -3 src/tools/regression/usr.bin/m4/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/m4/regress.t (new) 1.22 +16 -29 src/tools/regression/usr.bin/make/Makefile 1.1 +5 -0 src/tools/regression/usr.bin/make/regress.t (new) 1.5 +3 -5 src/tools/regression/usr.bin/regress.m4 1.9 +2 -0 src/tools/regression/usr.bin/sed/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/sed/regress.t (new) 1.5 +2 -0 src/tools/regression/usr.bin/uudecode/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/uudecode/regress.t (new) 1.7 +2 -0 src/tools/regression/usr.bin/uuencode/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/uuencode/regress.t (new) 1.6 +2 -0 src/tools/regression/usr.bin/xargs/regress.sh 1.1 +6 -0 src/tools/regression/usr.bin/xargs/regress.t (new)