From owner-freebsd-current@FreeBSD.ORG Tue Sep 22 12:01:35 2009 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34]) by hub.freebsd.org (Postfix) with ESMTP id 50DBE1065672 for ; Tue, 22 Sep 2009 12:01:35 +0000 (UTC) (envelope-from rwatson@FreeBSD.org) Received: from cyrus.watson.org (cyrus.watson.org [65.122.17.42]) by mx1.freebsd.org (Postfix) with ESMTP id 296D48FC1C for ; Tue, 22 Sep 2009 12:01:35 +0000 (UTC) Received: from fledge.watson.org (fledge.watson.org [65.122.17.41]) by cyrus.watson.org (Postfix) with ESMTPS id A927E46B03; Tue, 22 Sep 2009 08:01:34 -0400 (EDT) Date: Tue, 22 Sep 2009 13:01:34 +0100 (BST) From: Robert Watson X-X-Sender: robert@fledge.watson.org To: Bruce Cran In-Reply-To: <20090922123647.000078e5@unknown> Message-ID: References: <20090922123647.000078e5@unknown> User-Agent: Alpine 2.00 (BSF 1167 2008-08-23) MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed Cc: "Arno J. Klaassen" , current@freebsd.org Subject: Re: Call for regression and performance testing - 8.0 X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 22 Sep 2009 12:01:35 -0000 On Tue, 22 Sep 2009, Bruce Cran wrote: >> Resurfacing after organising conferences, and discovered I had missed this >> e-mail. I'm not aware of any such efforts, and it would be really good to >> do. Making it easy to do "runtests" would vastly improve the ease of >> testing during the release process. Right now the output of the tests is >> fairly inconsistent, and this is probably to a large extent my fault. It >> would be nice to have a "test template" program that people can start with >> when writing new regression tests -- I know I would find that valuable. > > There's already a limited template available: src/tools/regression/README > specifies the format to use, and many of the regression tests do use it. You > can run all the tests which use the specified format by running "prove -r" > (after installing devel/p5-Test-Harness), but there are currently quite a > few failures. > > Some tests don't use the template for good reason - for example > src/tools/regression/redzone9 depends on the DEBUG_REDZONE kernel option to > be present. However, others don't do it for a good reason -- perhaps mostly my tests? :-) If people want to convert them over that would be excellent. Robert