From owner-svn-src-all@FreeBSD.ORG Tue May 28 02:01:24 2013 Return-Path: Delivered-To: svn-src-all@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 4B6454CB; Tue, 28 May 2013 02:01:24 +0000 (UTC) (envelope-from yanegomi@gmail.com) Received: from mail-pa0-f45.google.com (mail-pa0-f45.google.com [209.85.220.45]) by mx1.freebsd.org (Postfix) with ESMTP id 152F7E24; Tue, 28 May 2013 02:01:23 +0000 (UTC) Received: by mail-pa0-f45.google.com with SMTP id tj12so2396630pac.18 for ; Mon, 27 May 2013 19:01:16 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:mime-version:content-type:from:in-reply-to:date:cc :content-transfer-encoding:message-id:references:to:x-mailer; bh=rtu7KhvG2zqRnUaiWcsfV9RfRdGY3Kfab7DcJhMouZQ=; b=ob193KOiOde8iobEAkFyFHTCX2SpRFedp14l2jZAcG43Ut4dsJKdsIRk71NGp/fsbE GgHAXHHM3DTRkUxDlBfViW1ciSV741tJ19aSFMyHDLGUT+vPBQm6EzFfaNfceUoJQMF8 k2PW+Sfi1wJJTddnqzyy/GIVWC94tGhioit5gh/8f0ClCyg49gMhnqcId42b4Due4ov/ ZuFfHto9WoYo4meV6SVgpv4+mqgq6G7KtO2wsIuM9g6JNagF6Apce9Tnrkn/4y8cgU3F VqrdMP12YsEZjU+tyIVFiu7A4Bf0BXA5YWIGZVoF6TCyPA/ZL5h/FADwGhW4RDGhESLL 1OZQ== X-Received: by 10.68.180.4 with SMTP id dk4mr31569006pbc.104.1369706476396; Mon, 27 May 2013 19:01:16 -0700 (PDT) Received: from [192.168.20.5] (c-98-203-241-95.hsd1.wa.comcast.net. [98.203.241.95]) by mx.google.com with ESMTPSA id lq4sm32825690pab.19.2013.05.27.19.01.13 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 27 May 2013 19:01:14 -0700 (PDT) Subject: Re: svn commit: r251024 - in head: lib/msun lib/msun/ld128 lib/msun/ld80 lib/msun/src tools/regression/lib/msun Mime-Version: 1.0 (Apple Message framework v1283) Content-Type: text/plain; charset=us-ascii From: Garrett Cooper In-Reply-To: Date: Mon, 27 May 2013 19:01:12 -0700 Content-Transfer-Encoding: quoted-printable Message-Id: <13D68565-6ED3-44F2-82A9-E94F53C6C95A@gmail.com> References: <201305270850.r4R8oA6g008947@svn.freebsd.org> <20130527140722.GA43583@troutmask.apl.washington.edu> <20130527172326.GA6461@zim.MIT.EDU> To: Ryan Stone X-Mailer: Apple Mail (2.1283) Cc: svn-src-head@freebsd.org, David Schultz , src-committers@freebsd.org, svn-src-all@freebsd.org, Steve Kargl X-BeenThere: svn-src-all@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "SVN commit messages for the entire src tree \(except for " user" and " projects" \)" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 28 May 2013 02:01:24 -0000 On May 27, 2013, at 12:58 PM, Ryan Stone wrote: > On Mon, May 27, 2013 at 1:23 PM, David Schultz = wrote: >=20 >> If someone were to write or import a good test framework, >> get all the tests to use it, and put together a test tinderbox, that >> would have a lot of impact. >>=20 >>=20 > People are working on bringing ATF into FreeBSD: >=20 > https://wiki.freebsd.org/TestingFreeBSD Thanks for the plug! Yes, ATF is in (it's a bit outdated so I'll have to submit a patch for = ATF 0.17), build infrastructure's on its way, and the best news of all = is that I've already ported a large chunk of the msun testcases from = NetBSD to FreeBSD. They work with little hacking for the most part. = Example: # cd /usr/src/lib/msun/tests/ # make obj depend all check Summary for 19 test programs: 295 passed test cases. 0 failed test cases. 0 expected failed test cases. 5 skipped test cases. *** The verbatim output of atf-run has been saved to = /usr/obj/usr/src/lib/msun/tests/atf-run.log # Why isn't this in FreeBSD yet (along with some of the other testsuites = from NetBSD)? Well, a couple of reasons: 1. The test build infrastructure changes haven't been fully pushed in = (Marcel's helping me out with the latest set of patches). 2. There are issues with porting stuff over from NetBSD because some of = the macros needed to minimize porting divergence don't have a happy home = yet. I gently poked several people from FreeBSD, NetBSD, and OpenBSD = about getting some degree of solidarity and agreement on macros, but I = haven't heard back from anyone I emailed for several weeks. So I figure = that FreeBSD needs to bend by adding some [compat] macros to strategic = locations in sys/sys, and then we can work on standardizing things = later. I really don't want to hack all of the tests to use libnetbsd = because while it works for nmtree and nmakefs, it doesn't make sense for = testcases as the volume of required changes wouldn't make sense from a = porting perspective. 3. I really REALLY need help porting over changes we've added that can = be contributed back to NetBSD, and FreeBSD specific tests need to be = cordoned off properly. As far as the test image stuff is concerned and test tinderbox stuff is = concerned, yes, it's on my radar.. I'm working on installing tests via = .iso images and USB images; once that's done we can work on making the = other testing stuff work on a cron basis via tinderbox or another = similar mechanism. So, what say ye to making things work better and helping me in this = process :)? Thanks! -Garrett=