From owner-freebsd-current@FreeBSD.ORG Thu Feb 21 17:49:08 2013 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 3AD12A7C for ; Thu, 21 Feb 2013 17:49:08 +0000 (UTC) (envelope-from decke@bluelife.at) Received: from mail-ob0-f176.google.com (mail-ob0-f176.google.com [209.85.214.176]) by mx1.freebsd.org (Postfix) with ESMTP id 02ABAA8E for ; Thu, 21 Feb 2013 17:49:07 +0000 (UTC) Received: by mail-ob0-f176.google.com with SMTP id v19so9032286obq.21 for ; Thu, 21 Feb 2013 09:49:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bluelife.at; s=google; h=mime-version:x-received:sender:x-originating-ip:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type; bh=HWdix2hH2cQ7i8m7e9NukAW14ST6om4cW/OVYMo0c8s=; b=Fvhra+evnfGDi5cFZKdRtdtAPCzF6eBxwbbPWpFfMyEplIIkFPiCX7k6E7axG0K+2V Qa0uSVWG7Nt4zWGiPteN/ktms2gQ38gWlBzBUqARqP49oKBsIhx4pRQu1FV5wtukRfCw wpO/xLc8x3ERk8eei0kqPW821ZKT33u10HBP8= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20120113; h=mime-version:x-received:sender:x-originating-ip:in-reply-to :references:date:x-google-sender-auth:message-id:subject:from:to:cc :content-type:x-gm-message-state; bh=HWdix2hH2cQ7i8m7e9NukAW14ST6om4cW/OVYMo0c8s=; b=ZtyfiZ6ThjlZw6qHcaDBw6F4f0ZzJ3DPHpTzZurlo0VZrdoFjkYcW60erdFiqDD/G6 /lL5p4HixXty0xSX/gXZRUEQmjzX3NXoYy+jAE0HeGpvmWNb54pMhBh6Yu3TwLaz6v7P arbdQBB1VG+Q05qb8dcT2E/B0TBrqUW3pQeGxZhIkjzeY3y+WuLWMTcvE5tNjYasXQPU D2DjZqQOI6wbfdgT6jCn2yU4jliY2AOwQdtyplg81IXjr8vFFmCOI+2ETZkjkF5NG4vA PgaqOPx1ZV6Y/SGuoLVCaUveZYt2pwDbsP8nrJimkQhFy6hkCFp9U4IfCkVtRAK6OW68 oAyQ== MIME-Version: 1.0 X-Received: by 10.60.170.20 with SMTP id ai20mr11566684oec.33.1361468947211; Thu, 21 Feb 2013 09:49:07 -0800 (PST) Sender: decke@bluelife.at Received: by 10.76.136.237 with HTTP; Thu, 21 Feb 2013 09:49:06 -0800 (PST) X-Originating-IP: [2001:470:9bf5:200:21c:23ff:fe94:8591] In-Reply-To: References: <51263782.3020205@freebsd.org> Date: Thu, 21 Feb 2013 18:49:07 +0100 X-Google-Sender-Auth: JgDpINHExu02L3StUb3hqB-TdXA Message-ID: Subject: Re: FreeBSD Testing Facility From: =?ISO-8859-1?Q?Bernhard_Fr=F6hlich?= To: Mehmet Erol Sanliturk Content-Type: text/plain; charset=ISO-8859-1 X-Gm-Message-State: ALoCoQnGl9E29vyHlRpNCJ7w3G/wkkL+5S9nAGf1zBXziayowlmaobrYGeANEDvpNgTm+AzS2FK0 Cc: Alexander Yerenkow , mjacob@freebsd.org, freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Feb 2013 17:49:08 -0000 On Thu, Feb 21, 2013 at 4:43 PM, Mehmet Erol Sanliturk wrote: > On Thu, Feb 21, 2013 at 7:32 AM, Alexander Yerenkow wrote: > >> Decent testing system is a pretty complex system to be. >> I spent some time in this area, and gave it up, at least till better times >> :) >> >> But anyway, at least booting/working network stack/firewall could be >> easily tested with VMs. >> There just need to be a person dedicated to this, which is lacking now. >> >> >> -- >> Regards, >> Alexander Yerenkow > > > > With "BOINC" , people are trying to solve very complex problems by > contributing as much as what they can do to solve its parts . > > A similar structure may be established for FreeBSD . > > As an example , booting in virtual machine may be possible , but in a real > machine may not work . > Some main boards may work , but others may not work . > > The FreeBSD project can not establish a very large testing farm . > > People wanting to participate may contribute very much . > > Every one will not test every thing . We certainly want to have a system that allows to perform tests in an automated fashion. Both compile and runtime tests but I don't see us running a huge lab of desktop or even worse laptop class hardware to verify that everything works. So the only way to go is limited testing if a new snapshot runs at all and then perform a few runtime tests and probably some benchmarks to find major regressions. Running a BOINC kind of system sounds like out of reach and not worth the work. BOINC works because it's cool to find aliens or prove that Einstein was wrong but testing software is not cool. In your special case it looks like you hit some bug so please file a PR and provide as much details as possible to track down what is causing this. -- Bernhard Froehlich http://www.bluelife.at/