Date: Mon, 27 May 2013 19:01:12 -0700 From: Garrett Cooper <yanegomi@gmail.com> To: Ryan Stone <rysto32@gmail.com> Cc: svn-src-head@freebsd.org, David Schultz <das@freebsd.org>, src-committers@freebsd.org, svn-src-all@freebsd.org, Steve Kargl <sgk@troutmask.apl.washington.edu> Subject: Re: svn commit: r251024 - in head: lib/msun lib/msun/ld128 lib/msun/ld80 lib/msun/src tools/regression/lib/msun Message-ID: <13D68565-6ED3-44F2-82A9-E94F53C6C95A@gmail.com> In-Reply-To: <CAFMmRNzYVVA4qtH3Dvwe1bnTmP7rVxu7SijG0XtUqcDVqm7Twg@mail.gmail.com> References: <201305270850.r4R8oA6g008947@svn.freebsd.org> <20130527140722.GA43583@troutmask.apl.washington.edu> <20130527172326.GA6461@zim.MIT.EDU> <CAFMmRNzYVVA4qtH3Dvwe1bnTmP7rVxu7SijG0XtUqcDVqm7Twg@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On May 27, 2013, at 12:58 PM, Ryan Stone wrote: > On Mon, May 27, 2013 at 1:23 PM, David Schultz <das@freebsd.org> = wrote: >=20 >> If someone were to write or import a good test framework, >> get all the tests to use it, and put together a test tinderbox, that >> would have a lot of impact. >>=20 >>=20 > People are working on bringing ATF into FreeBSD: >=20 > https://wiki.freebsd.org/TestingFreeBSD Thanks for the plug! Yes, ATF is in (it's a bit outdated so I'll have to submit a patch for = ATF 0.17), build infrastructure's on its way, and the best news of all = is that I've already ported a large chunk of the msun testcases from = NetBSD to FreeBSD. They work with little hacking for the most part. = Example: # cd /usr/src/lib/msun/tests/ # make obj depend all check Summary for 19 test programs: 295 passed test cases. 0 failed test cases. 0 expected failed test cases. 5 skipped test cases. *** The verbatim output of atf-run has been saved to = /usr/obj/usr/src/lib/msun/tests/atf-run.log # Why isn't this in FreeBSD yet (along with some of the other testsuites = from NetBSD)? Well, a couple of reasons: 1. The test build infrastructure changes haven't been fully pushed in = (Marcel's helping me out with the latest set of patches). 2. There are issues with porting stuff over from NetBSD because some of = the macros needed to minimize porting divergence don't have a happy home = yet. I gently poked several people from FreeBSD, NetBSD, and OpenBSD = about getting some degree of solidarity and agreement on macros, but I = haven't heard back from anyone I emailed for several weeks. So I figure = that FreeBSD needs to bend by adding some [compat] macros to strategic = locations in sys/sys, and then we can work on standardizing things = later. I really don't want to hack all of the tests to use libnetbsd = because while it works for nmtree and nmakefs, it doesn't make sense for = testcases as the volume of required changes wouldn't make sense from a = porting perspective. 3. I really REALLY need help porting over changes we've added that can = be contributed back to NetBSD, and FreeBSD specific tests need to be = cordoned off properly. As far as the test image stuff is concerned and test tinderbox stuff is = concerned, yes, it's on my radar.. I'm working on installing tests via = .iso images and USB images; once that's done we can work on making the = other testing stuff work on a cron basis via tinderbox or another = similar mechanism. So, what say ye to making things work better and helping me in this = process :)? Thanks! -Garrett=
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?13D68565-6ED3-44F2-82A9-E94F53C6C95A>