From owner-svn-doc-head@FreeBSD.ORG Fri Dec 20 20:14:38 2013 Return-Path: Delivered-To: svn-doc-head@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 81D8F399; Fri, 20 Dec 2013 20:14:38 +0000 (UTC) Received: from svn.freebsd.org (svn.freebsd.org [IPv6:2001:1900:2254:2068::e6a:0]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 6D8B816A5; Fri, 20 Dec 2013 20:14:38 +0000 (UTC) Received: from svn.freebsd.org ([127.0.1.70]) by svn.freebsd.org (8.14.7/8.14.7) with ESMTP id rBKKEcXI022733; Fri, 20 Dec 2013 20:14:38 GMT (envelope-from pgj@svn.freebsd.org) Received: (from pgj@localhost) by svn.freebsd.org (8.14.7/8.14.7/Submit) id rBKKEcdD022731; Fri, 20 Dec 2013 20:14:38 GMT (envelope-from pgj@svn.freebsd.org) Message-Id: <201312202014.rBKKEcdD022731@svn.freebsd.org> From: Gabor Pali Date: Fri, 20 Dec 2013 20:14:38 +0000 (UTC) To: doc-committers@freebsd.org, svn-doc-all@freebsd.org, svn-doc-head@freebsd.org Subject: svn commit: r43359 - head/en_US.ISO8859-1/htdocs/news/status X-SVN-Group: doc-head MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-BeenThere: svn-doc-head@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: SVN commit messages for the doc tree for head List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Dec 2013 20:14:38 -0000 Author: pgj Date: Fri Dec 20 20:14:37 2013 New Revision: 43359 URL: http://svnweb.freebsd.org/changeset/doc/43359 Log: - Add an entry on the testing suite work to the 2013Q4 report Submitted by: jmmv Modified: head/en_US.ISO8859-1/htdocs/news/status/report-2013-10-2013-12.xml Modified: head/en_US.ISO8859-1/htdocs/news/status/report-2013-10-2013-12.xml ============================================================================== --- head/en_US.ISO8859-1/htdocs/news/status/report-2013-10-2013-12.xml Fri Dec 20 17:47:41 2013 (r43358) +++ head/en_US.ISO8859-1/htdocs/news/status/report-2013-10-2013-12.xml Fri Dec 20 20:14:37 2013 (r43359) @@ -19,7 +19,7 @@

Thanks to all the reporters for the excellent work! This report - contains 1 entry and we hope you enjoy reading it.

+ contains 2 entries and we hope you enjoy reading it.

The deadline for submissions covering between January and March 2014 is April 7th, 2014.

@@ -64,4 +64,77 @@ documentation. + + + &os; Test Suite + + + + + Julio + Merino + + jmmv@FreeBSD.org + + + + + Project page + + + +

The &os; Test Suite project aims to equip &os; with a + comprehensive test suite that is easy to run out of the box and + during the development of the system. The test suite is + installed into /usr/tests/ and the kyua(1) + command-line tool (devel/kyua in the Ports Collection) + is used to run them.

+ +

The benefits of having a test suite that is easy to use and + continuously run are obvious: regressions can be caught sooner + rather than later and the Release Engineering Team can better + assess the quality of the tree before deciding to cut a release. + Additionally, and because we choose to install the tests, we + also allow any end user to perform sanity checks on new + installations of the system on his or her particular hardware + configuration — a very attractive thing to do when + deploying production servers.

+ +

During the last few months, we have added the necessary pieces to + the build system to support building and installing test programs of + various kinds. To demonstrate the functionality of these, some test + programs were added and others were migrated from the old testing tree + in tools/regression/ to the new layout for tests.

+ +

The current test suite should be seen as a proof of concept at this + point: it is only composed of a small set of test programs and the goal + is to get the infrastructure in place before mass-migrating existing + test code and/or importing external tests.

+ +

As part of this work, two new releases of Kyua were published. + Of special interest is the addition of a TAP-compliant backend so + that existing tests from tools/regression/ can be + plugged into the test suite with minimum effort.

+ + + + We have got three machines in which to set up a continuous + testing system. This work is in progress. Once done, periodic + test reports will be available online. + + Related to the above, the Kyua reporting engine needs + significant tuning to make the reports nice and clean. These + changes will come after the basic infrastructure is in + place. + + A tutorial on writing tests for &os; has been proposed for + AsiaBSDCon 2014. The outcome of the proposal is still + unknown, but stay tuned! + + Port, port, and port more tests to the new test suite. A + test suite is worthless if it does not validate stuff! Stay tuned + for a request for help when we have put all basic pieces in + place and have streamlined the migration process. + +