Date: Fri, 1 Apr 2016 12:03:10 +0200 From: Fabian Keil <freebsd-listen@fabiankeil.de> To: Alex Denisov <1101.debian@gmail.com> Cc: freebsd-testing@freebsd.org Subject: Re: Available Tests Message-ID: <20160401120310.3be9446a@fabiankeil.de> In-Reply-To: <CF2BEABA-E000-45CF-92AF-6A61ADFB3697@gmail.com> References: <CF2BEABA-E000-45CF-92AF-6A61ADFB3697@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
--Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_ Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Alex Denisov <1101.debian@gmail.com> wrote: > I just built FreeBSD 10 using =E2=80=9CWITH_TESTS=3D1=E2=80=9D, and run t= ests from =E2=80=98/usr/tests=E2=80=99 using =E2=80=98root' user. >=20 > I have found that there are ~3,5k test results, which makes me curious: a= re there other tests? Yes. If you take a closer look at /usr/src you'll find various other tests that aren't integrated into the kyua/atf tool chain (yet). I also believe that your ~3,5k test results represent more that ~3,5k individual tests due to suboptimal integration of other test suites. Various external test frameworks are also potentially relevant for FreeBSD, but have too much dependencies to integrate. As an example, a TCP/IP regression was found through Privoxy-Regression-Tes= t: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D173309 Obviously the regression could have been found with a FreeBSD-specific test as well, but somebody would have to spent the time to write such a test first. > I=E2=80=99m asking because, for instance, LLVM test suite has ~17k tests > (unit, regression, and performance tests). Some of these tests are probably also run on FreeBSD systems to test the clang integration ... > FreeBSD seems to be bigger, but has less tests. Unlike LLVM, FreeBSD contains a lot of old code from a time where automated testing was less common. Comparing it with other operating systems might make more sense. Fabian --Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_ Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iEYEARECAAYFAlb+R18ACgkQBYqIVf93VJ1b+QCfekCLHuzlGVJvcZqYCWIBQczI MgoAoKmbdX59jTqZFJNngl0HxrECGWEN =eFle -----END PGP SIGNATURE----- --Sig_/cEFAIs2MDhGqM+6AZ.X4SJ_--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20160401120310.3be9446a>