From owner-freebsd-current@FreeBSD.ORG Sun Feb 24 17:25:42 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.FreeBSD.org [8.8.178.115]) by hub.freebsd.org (Postfix) with ESMTP id 72573DDF for ; Sun, 24 Feb 2013 17:25:42 +0000 (UTC) (envelope-from gkeramidas@gmail.com) Received: from mail-wg0-f45.google.com (mail-wg0-f45.google.com [74.125.82.45]) by mx1.freebsd.org (Postfix) with ESMTP id 0F3CEA69 for ; Sun, 24 Feb 2013 17:25:41 +0000 (UTC) Received: by mail-wg0-f45.google.com with SMTP id dq12so1854713wgb.24 for ; Sun, 24 Feb 2013 09:25:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=x-received:sender:date:from:to:cc:subject:message-id:references :mime-version:content-type:content-disposition:in-reply-to; bh=8n14xs6QnNJr2ShmwMwJPVlxYzh6F8IHJH194rV6sYQ=; b=q49Pet1ZlvSvVysOD+HM2UyRmzVEZ8Q4sB+fafi7VkIRGaz7x8Q8yZ7i8pUSJfmWeN ljlsYo6OiZP2ZlO3OmbO1MMibHm8f/x76n76vSVhAm9NOWwpql613rDz54NAcyE4u9yY mPmIkmQoU8FU4pxIXPsf3ZtbFDXwnpODgA8C2sxWy8Ct60TsiJwYms/5X6ZF9wSHrhLV NjYEzF9RjMRqF4oLq+v9zZxweqRG+6Eb2vTcQu87Z7Op2XhXiOVbtyB6JDD1NlEtufQ5 dUp7RFyEZYkRA8mgubZjsW5/jfTlxghTyE/vWttjt2VLcd+doyuiUjbkwY4AB3Dt+2md kfKA== X-Received: by 10.180.14.233 with SMTP id s9mr7552806wic.25.1361726740893; Sun, 24 Feb 2013 09:25:40 -0800 (PST) Received: from saturn (217-162-217-29.dynamic.hispeed.ch. [217.162.217.29]) by mx.google.com with ESMTPS id n2sm10096127wiy.6.2013.02.24.09.25.38 (version=TLSv1.2 cipher=RC4-SHA bits=128/128); Sun, 24 Feb 2013 09:25:39 -0800 (PST) Sender: Giorgos Keramidas Date: Sun, 24 Feb 2013 18:25:34 +0100 From: Giorgos Keramidas To: Mehmet Erol Sanliturk Subject: Re: FreeBSD Testing Facility Message-ID: <20130224172524.GA24919@saturn> References: <51263782.3020205@freebsd.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <51263782.3020205@freebsd.org> Cc: freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 24 Feb 2013 17:25:42 -0000 On 2013-02-21 07:04, Matthew Jacob wrote: > On 2/21/2013 5:04 AM, Mehmet Erol Sanliturk wrote: > >Dear All , > > > >During development of FreeBSD , testing is very vital . > >... > > This in general is a good suggestion. Most companies do such > automated testing as a matter of course. > > Note however that this is a volunteer effort. Were you volunteering > to set up such an automated, possibly testzilla driven, facility? It > would certainly help the quality, although as others have noted > snapshots are often likely to be broken. To the OP: Like Matthew has said, this is a volunteer effort. So if you have experience with setting up testing automation, and you are willing to help us set up something like this, please go ahead :-) I've worked in places where the following types of tests are used: - Presubmit tests that check specific parts of functionality. - Commit-related tests that run asynchronously in the background, and report back later (e.g. through email). - Test systems that cache previous results and report a simple 'green' vs. 'red' status for _every_ single commit. - System tests that check for particular functionality, health criteria, etc. - some times fully automated, some other times requiring a token amount of manual support. So here are two important questions, regarding the tests you mentioned: When you speak about 'testing FreeBSD', which type of tests are you interested in seeing? Are you willing to help us set up something that runs the type of tests that you want to see?