From owner-freebsd-stable Wed Oct 16 17:58:18 2002 Delivered-To: freebsd-stable@freebsd.org Received: from mx1.FreeBSD.org (mx1.freebsd.org [216.136.204.125]) by hub.freebsd.org (Postfix) with ESMTP id EE70D37B401 for ; Wed, 16 Oct 2002 17:58:16 -0700 (PDT) Received: from mail3.panix.com (mail3.panix.com [166.84.1.74]) by mx1.FreeBSD.org (Postfix) with ESMTP id 7A1B043E6E for ; Wed, 16 Oct 2002 17:58:16 -0700 (PDT) (envelope-from kleiner@panix.com) Received: from panix5.panix.com (panix5.panix.com [166.84.1.5]) by mail3.panix.com (Postfix) with ESMTP id 6BCE5981B8; Wed, 16 Oct 2002 20:58:15 -0400 (EDT) Received: (from kleiner@localhost) by panix5.panix.com (8.11.6/8.8.8/PanixN1.0) id g9H0wFg04607; Wed, 16 Oct 2002 20:58:15 -0400 (EDT) Date: Wed, 16 Oct 2002 20:58:15 -0400 From: David Kleiner To: "Fischer, Oliver" Cc: stable@freebsd.org Subject: Re: freebsd test matrix Message-ID: <20021017005815.GA27918@panix.com> References: <20021016131517.C4295-100000@fubar.adept.org> <3DADD419.5080104@snafu.de> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <3DADD419.5080104@snafu.de> User-Agent: Mutt/1.4i Sender: owner-freebsd-stable@FreeBSD.ORG Precedence: bulk List-ID: List-Archive: (Web Archive) List-Help: (List Instructions) List-Subscribe: List-Unsubscribe: X-Loop: FreeBSD.ORG On Wed, Oct 16, 2002 at 11:03:21PM +0200, Fischer, Oliver wrote: > Mike Hoskins wrote: > >Hmm, I wonder if something similar is used or was developed for internal > >QA? Anyone? It seems like there should at least be a "best practice" for > >testing systems... How do we currently make a -RELEASE with confidence? > >Of course you can't verify a given release builds on every platform, but > >is there an automated means of verifying system compoents work and > >interoperate properly on a given test system or set of systems? > > > http://martinfowler.com/articles/continuousIntegration.html > > > > Hi, In a commercial world, there is a lot of pre-integration QA testing going on - question is, where do you start? What test harness you want to use? Which test suites? Are you interested in standards (posix and such), ABI, stress testing, library testing, fs testing, interoperability and so on? Just my 2 cents, David To Unsubscribe: send mail to majordomo@FreeBSD.org with "unsubscribe freebsd-stable" in the body of the message