Date: Mon, 19 Nov 2012 08:09:41 +0000 From: "Poul-Henning Kamp" <phk@phk.freebsd.dk> To: Marcel Moolenaar <marcel@xcllnt.net> Cc: Garrett Cooper <yanegomi@gmail.com>, George Neville-Neil <gnn@freebsd.org>, "freebsd-arch@FreeBSD.org Arch" <freebsd-arch@freebsd.org>, Matthew Fleming <mdf@freebsd.org> Subject: Re: [RFC] test layout/standardization for FreeBSD Message-ID: <31881.1353312581@critter.freebsd.dk> In-Reply-To: <F3302426-CA5D-4B61-8F3A-081395B393D9@xcllnt.net> References: <CAGH67wSoU08N8=40RE3j0na4B6-VhZFwhMdkw-6CYhoxKKHumg@mail.gmail.com> <7099.1352886181@critter.freebsd.dk> <F3302426-CA5D-4B61-8F3A-081395B393D9@xcllnt.net>
next in thread | previous in thread | raw e-mail | index | archive | help
-------- In message <F3302426-CA5D-4B61-8F3A-081395B393D9@xcllnt.net>, Marcel Moolenaar writes: >For example: If a test is not reliable on a heavily loaded machine, >then the test is ipso facto not 100% deterministic. So, B implies >A. How is this different from a meta data perspective? If we test >a RNG, are we ever going to be 100% deterministic? Some tests are not 100% deterministic no matter what. That is an important distinction. >Also, the estimated duration for tests is very platform specific. Only if CPU or I/O bound. Tests for things like dynamic route-expiry, and other timeout driven parts of the system will have long realtime clock, but short cpu-clock. For a comprehensive nightly test-run, you want such test-cases, for a quick sanitycheck on your kernel rewrite, you probably don't. I fully agree with your "crawl before we run" approach, but testing is a quite mature, if underappreciated, discipline, and we would do well to learn from others mistakes. All I'm asking at this point, is that we make a space for storing this metadata in a machine-readable format. -- Poul-Henning Kamp | UNIX since Zilog Zeus 3.20 phk@FreeBSD.ORG | TCP/IP since RFC 956 FreeBSD committer | BSD since 4.3-tahoe Never attribute to malice what can adequately be explained by incompetence.
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?31881.1353312581>