From owner-freebsd-stable Tue Oct 22 7: 0:23 2002 Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id 0143937B401 for ; Tue, 22 Oct 2002 07:00:21 -0700 (PDT) Received: from clever.eusc.inter.net (clever.eusc.inter.net [213.73.101.4]) by mx1.FreeBSD.org (Postfix) with ESMTP id C02C643E6A for ; Tue, 22 Oct 2002 07:00:19 -0700 (PDT) (envelope-from plexus@snafu.de) Received: from cerberus.publity.de ([213.61.128.135] helo=snafu.de) by clever.eusc.inter.net with asmtp (Exim 3.36 #4) id 183zZt-0000g5-00; Tue, 22 Oct 2002 16:00:13 +0200 Message-ID: <3DB559CF.2050605@snafu.de> Date: Tue, 22 Oct 2002 15:59:43 +0200 From: "Fischer, Oliver" User-Agent: Mozilla/5.0 (X11; U; FreeBSD i386; en-US; rv:1.1) Gecko/20021015 X-Accept-Language: de, en-us, en MIME-Version: 1.0 To: Mike Hoskins Cc: Matthew Whelan , Chris BeHanna , FreeBSD-Stable Subject: Re: freebsd test matrix References: <20021021184726.Q47993-100000@fubar.adept.org> Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-freebsd-stable@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG Mike Hoskins wrote: > I've been tracking progress of this thread, and posting general > conclusions/decissions here: http://bsd.adept.org God that you have written a summery of this topic. I think it is the time for it. Here are my thoughts on this project: o If I am not mistaken, I see can see 2 steps: 1. Creating a small x86 build results database and setting it up. Posting of the results should be easy. May be via mail or web. Better both. 2. Developing an more well-elaborated testing system as the second step. I will call this system SYSTEM II. I think this is a god start. [Next points are related to the 2. step...] o The schema behind SYSTEM II must be very flexibel enough to handle different kinds of test on different plattforms. o The result database and the report of the test results to central repository should be independend of the test framework. It should be possible to change the test suite or to implement tests with different testsuites. o Do we need our own framework for it? o Such a project needs volunteers? o Such a project needs documentation! o Such a project needs a home for its resources? (SourceForge, own, FreeBSD?) o What should be tested? Does it make sense to test the stuff in src/contributed? o What kind of test do we have? functional tests? lasttests? (does some one know the correct english term for this german word?) tests for standard specifications? o Should we / How to integrated hardware dependend tests like fs performance? My notebook will report different results than my PC. o We need a good name! OK, thats all. BYe Oliver -- Oliver Fischer - plexus[AT]snafu[DOT]de [de] Das Internet stammt aus dem letzten Jahrtausend! To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-stable" in the body of the message