From owner-freebsd-testing@FreeBSD.ORG Tue Oct 7 23:38:35 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id DD9301E9; Tue, 7 Oct 2014 23:38:35 +0000 (UTC) Received: from mail-la0-x231.google.com (mail-la0-x231.google.com [IPv6:2a00:1450:4010:c03::231]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 3610C17B; Tue, 7 Oct 2014 23:38:35 +0000 (UTC) Received: by mail-la0-f49.google.com with SMTP id q1so7427523lam.36 for ; Tue, 07 Oct 2014 16:38:31 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:in-reply-to:references:date:message-id:subject :from:to:cc:content-type; bh=GbcZFKSaxD4ANs16a34lErjvVYghx1Pm/sogFysLXsE=; b=Jt6CQ9Um7mFeTYA+cT+ltRdySTYf67+/x/ab4rcilJb7rwMQi5bNe1K+y3vEl3rfP4 KUcvBqgFHX77X500lI2EB7yKySuHQwzIKunI8Xsrv4XqipsFSTKOHHDcjosMAJRO7xby m/d5zeBZn9aE1uRD5aUJbwo4FhZagxRbZxAsIo6dw6iigR3flPq6bfY9YRcpJzcZeLMw Yo05wHdu91O1h5YuYEeeyL3i6ALT01deKyoiVw3F/sloW7RjofR+pNOoZ3FvZ2eU9e5z BWlssrKf1XZzKQiOqN0Iy45b2YOTSIcmHtmRZRcnTNqmAE117p0qaXJp1cOIN4MtK3Qo Sl6w== MIME-Version: 1.0 X-Received: by 10.112.14.34 with SMTP id m2mr7063785lbc.74.1412725111922; Tue, 07 Oct 2014 16:38:31 -0700 (PDT) Sender: crodr001@gmail.com Received: by 10.112.131.66 with HTTP; Tue, 7 Oct 2014 16:38:31 -0700 (PDT) In-Reply-To: References: Date: Tue, 7 Oct 2014 16:38:31 -0700 X-Google-Sender-Auth: Tu6isQQF0ivpfLTaxTY9BGJouYw Message-ID: Subject: Re: Need help fixing tests in CURRENT From: Craig Rodrigues To: NGie Cooper Content-Type: text/plain; charset=ISO-8859-1 X-Content-Filtered-By: Mailman/MimeDel 2.1.18-1 Cc: "freebsd-testing@freebsd.org" , freebsd-current Current X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 07 Oct 2014 23:38:36 -0000 On Tue, Oct 7, 2014 at 4:30 PM, NGie Cooper wrote: > On Tue, Oct 7, 2014 at 2:04 PM, Craig Rodrigues > wrote: > > Hi, > > > > After committing this fix to yacc in HEAD ( > > https://lists.freebsd.org/pipermail/svn-src-all/2014-October/092553.html > ) > > I've been able to do: "cd /usr/tests; kyua test" > > > > and get 0 test failures: > > > > > https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/16/testReport/ > > Awesome -- hopefully this will be sustained for several runs (this > is part of the reason why I haven't integrated all of the NetBSD tests > yet). > Thank you for all your work in getting us to green! > > For any type of test framework, if the tests aren't run regularly and reported in an easy to understand manner, then the tests will bitrot and people will ignore them. I've seen this happen in multiple companies I have worked at. Hopefully we can do better with FreeBSD, and foster a community of people who are actively updating the tests, and taking test failures seriously. If we don't do this, then people will just ignore the tests. -- Craig