Date: Fri, 1 Apr 2016 12:03:10 +0200 From: Fabian Keil <freebsd-listen@fabiankeil.de> To: Alex Denisov <1101.debian@gmail.com> Cc: freebsd-testing@freebsd.org Subject: Re: Available Tests Message-ID: <20160401120310.3be9446a@fabiankeil.de> In-Reply-To: <CF2BEABA-E000-45CF-92AF-6A61ADFB3697@gmail.com>
index | next in thread | previous in thread | raw e-mail
[-- Attachment #1 --] Alex Denisov <1101.debian@gmail.com> wrote: > I just built FreeBSD 10 using “WITH_TESTS=1”, and run tests from ‘/usr/tests’ using ‘root' user. > > I have found that there are ~3,5k test results, which makes me curious: are there other tests? Yes. If you take a closer look at /usr/src you'll find various other tests that aren't integrated into the kyua/atf tool chain (yet). I also believe that your ~3,5k test results represent more that ~3,5k individual tests due to suboptimal integration of other test suites. Various external test frameworks are also potentially relevant for FreeBSD, but have too much dependencies to integrate. As an example, a TCP/IP regression was found through Privoxy-Regression-Test: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=173309 Obviously the regression could have been found with a FreeBSD-specific test as well, but somebody would have to spent the time to write such a test first. > I’m asking because, for instance, LLVM test suite has ~17k tests > (unit, regression, and performance tests). Some of these tests are probably also run on FreeBSD systems to test the clang integration ... > FreeBSD seems to be bigger, but has less tests. Unlike LLVM, FreeBSD contains a lot of old code from a time where automated testing was less common. Comparing it with other operating systems might make more sense. Fabian [-- Attachment #2 --] -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlb+R18ACgkQBYqIVf93VJ1b+QCfekCLHuzlGVJvcZqYCWIBQczI MgoAoKmbdX59jTqZFJNngl0HxrECGWEN =eFle -----END PGP SIGNATURE-----home | help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20160401120310.3be9446a>