From owner-freebsd-stable@FreeBSD.ORG Fri Sep 15 06:58:41 2006 Return-Path: X-Original-To: freebsd-stable@freebsd.org Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id DDA0C16A407 for ; Fri, 15 Sep 2006 06:58:41 +0000 (UTC) (envelope-from maxim@macomnet.ru) Received: from mp2.macomnet.net (mp2.macomnet.net [195.128.64.6]) by mx1.FreeBSD.org (Postfix) with ESMTP id 404EC43D4C for ; Fri, 15 Sep 2006 06:58:38 +0000 (GMT) (envelope-from maxim@macomnet.ru) Received: from localhost (localhost.int.ru [127.0.0.1] (may be forged)) by mp2.macomnet.net (8.13.7/8.13.3) with ESMTP id k8F6wb50064427; Fri, 15 Sep 2006 10:58:37 +0400 (MSD) (envelope-from maxim@macomnet.ru) Date: Fri, 15 Sep 2006 10:58:37 +0400 (MSD) From: Maxim Konovalov To: David Malone In-Reply-To: <20060915064237.GA89843@walton.maths.tcd.ie> Message-ID: <20060915104954.I64240@mp2.macomnet.net> References: <20060914224333.P1031@ganymede.hub.org> <20060915064237.GA89843@walton.maths.tcd.ie> MIME-Version: 1.0 Content-Type: TEXT/PLAIN; charset=US-ASCII Cc: freebsd-stable@freebsd.org, "Marc G. Fournier" Subject: Re: Regression Tests ... X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 15 Sep 2006 06:58:41 -0000 On Fri, 15 Sep 2006, 07:42+0100, David Malone wrote: > On Thu, Sep 14, 2006 at 10:53:27PM -0300, Marc G. Fournier wrote: > > For the PostgreSQL Project, we have a 'build farm' ... something that I > > think is similar to the tinderboxes ... but, their point isn't to just > > build the source tree, but to run its regression tests, and report when > > something fails: > > > > http://www.pgbuildfarm.org/cgi-bin/show_status.pl > > We do have something similar - Peter Holm's Stress: > > http://people.freebsd.org/~pho/stress/ > > He has a presentation at: > > http://www.linuxforum.dk/2006/slides/peterholm-lf06.pdf Actually, stress & perfomance tests are a different class of the tests. What we have in tools/regression are regression tests but the main problem we still don't have a unified way to write them and no infrastructure to run and report results. E.g. at the moment you can't cd /usr/src/tools/regression/ && make. Perhaps we just need to steal NetBSD's bits until we invent something better. Btw, there is an item in the project ideas list: http://www.freebsd.org/projects/ideas/#p-regression -- Maxim Konovalov