From owner-freebsd-current@FreeBSD.ORG Sat Jun 7 18:31:04 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 50BFEBAC; Sat, 7 Jun 2014 18:31:04 +0000 (UTC) Received: from mail-wi0-x22b.google.com (mail-wi0-x22b.google.com [IPv6:2a00:1450:400c:c05::22b]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id BC3A4253B; Sat, 7 Jun 2014 18:31:03 +0000 (UTC) Received: by mail-wi0-f171.google.com with SMTP id cc10so2465023wib.10 for ; Sat, 07 Jun 2014 11:31:02 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=5n+ZLDCOglMTNW/+tR0qGQKn4Qq379arC8JgOusT3SE=; b=ZEdNXnzRIAhiTPwCZR6CQ4xk7be8BqoPdrUpA6AZMRoZf71Qy9tZlr1kl5Ue+3/w6q 7Znhwu8IooI5mVK8yBg3ZmbYCvA0nsUCVODcZxl8iYPL+MNFQ2qOf+S079jMEjqWBeBs L4QkCL99FhsXgsNmrn+KvWx4QCkcGKpUPZNFLwYd14mOfRhBvCvuQDEZUezsv8ADZZv8 DnGLTwwUNOVRpg7TfSkI++J7fkHVQIt8vwBcFP+tW7eQXGSvEGk6u0L9Vhv2+BbDR4Fh qAcJ9BlLCs/Pm1dIA8iK/QBzRypIC9H64mqZq7UMw6to38GgGJge5YtQInmiHRJMpOCJ cp1w== MIME-Version: 1.0 X-Received: by 10.180.94.163 with SMTP id dd3mr15349035wib.26.1402165862045; Sat, 07 Jun 2014 11:31:02 -0700 (PDT) Sender: asomers@gmail.com Received: by 10.194.168.202 with HTTP; Sat, 7 Jun 2014 11:31:01 -0700 (PDT) In-Reply-To: <20140607033334.GO3991@kib.kiev.ua> References: <20140607033334.GO3991@kib.kiev.ua> Date: Sat, 7 Jun 2014 12:31:01 -0600 X-Google-Sender-Auth: AD7SDMEEx7izbwmOXdZhY0PiVXc Message-ID: Subject: Re: Turning TESTS on by default From: Alan Somers To: Konstantin Belousov Content-Type: text/plain; charset=UTF-8 Cc: Julio Merino , FreeBSD CURRENT X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jun 2014 18:31:04 -0000 On Fri, Jun 6, 2014 at 9:33 PM, Konstantin Belousov wrote: > On Fri, Jun 06, 2014 at 03:14:52PM -0400, Julio Merino wrote: >> Hello all, >> >> >> TL;DR >> ----- >> >> I plan to turn the TESTS src.conf knob ON by default on Tuesday once I >> have been able to perform enough sanity-checks of the build and all of >> them pass. >> >> The impact of this is that the FreeBSD Test Suite (see tests(7)) will >> be built and installed by default under /usr/tests/ along with the >> private atf libraries and binaries. There should be no other changes >> and this should be transparent to everyone. >> >> If this happens to break the world in any way, we can trivially roll >> the change back to fix the fallout. >> >> >> Some details >> ------------ >> >> TESTS was never intended to be disabled by default. However, the >> original patches that were committed months ago related to this >> feature broke the build and the easiest way out (instead of reverting >> the commits) was to set the knob to disabled. Unfortunately, it stayed >> that way even after the discovered problems were fixed. >> >> I am confident enough now that we have ironed out all major issues >> that this might introduce, so it is about time to enable TESTS by >> default again in HEAD. >> >> The benefits of this are that 1) we allow end users (especially >> consumers of binary releases!) to run the tests out of the box, as it >> has always been intended; and 2) we will be able to run the official >> release builds through testing via Jenkins, instead of having to issue >> custom builds. > This is very weird and unprobable. Users cannot care less about running > the test suite, they use OS to run applications. IMO enabling installation > of the stuff that bloats the system but have no practical use for the > system consumer should not be allowed by default. I disagree. Sure, some users won't care. Probably even most users won't care. But some of our users are active supporters of FreeBSD. They evangelize, they file PRs, and they help other users on the forums. Those users will run the tests. Some of them will find bugs that we didn't, because they'll be using different hardware and different configurations. Plus, shipping a test suite exudes an aura of quality (if the tests pass, that is). So I think that we should install the tests, but in a separate installation set, just like games. -Alan > > It is the same as the debugging kernel. The INVARIANTS, WITNESS, DEBUG > and DIAGNOSTIC options are not enabled for the user consumption. There > was a similar argument to disable compiling the profiling static > libraries, which probably should be reconsidered since lib*_p.a is > absolutely useless on current toolchain and hardware. > >> >> Actual change: https://phabric.freebsd.org/D188 >> >> >> I will update this thread when the change is committed and/or with any updates. >> >> Please let me know if I'm missing anything. >> >> Cheers >> _______________________________________________ >> freebsd-current@freebsd.org mailing list >> http://lists.freebsd.org/mailman/listinfo/freebsd-current >> To unsubscribe, send any mail to "freebsd-current-unsubscribe@freebsd.org"