From owner-freebsd-ports@FreeBSD.ORG  Wed Jun 18 19:43:59 2008
Return-Path: <owner-freebsd-ports@FreeBSD.ORG>
Delivered-To: freebsd-ports@freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:4f8:fff6::34])
	by hub.freebsd.org (Postfix) with ESMTP id 530C61065674
	for <freebsd-ports@freebsd.org>; Wed, 18 Jun 2008 19:43:59 +0000 (UTC)
	(envelope-from wxs@atarininja.org)
Received: from syn.atarininja.org (syn.csh.rit.edu [129.21.60.158])
	by mx1.freebsd.org (Postfix) with ESMTP id 272468FC0C
	for <freebsd-ports@freebsd.org>; Wed, 18 Jun 2008 19:43:59 +0000 (UTC)
	(envelope-from wxs@atarininja.org)
Received: by syn.atarininja.org (Postfix, from userid 1001)
	id 9A71A5C2E; Wed, 18 Jun 2008 15:47:05 -0400 (EDT)
Date: Wed, 18 Jun 2008 15:47:05 -0400
From: Wesley Shields <wxs@FreeBSD.org>
To: Christian Weisgerber <naddy@mips.inka.de>
Message-ID: <20080618194705.GB92928@atarininja.org>
References: <g3bff6$16eb$1@kemoauc.mips.inka.de>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <g3bff6$16eb$1@kemoauc.mips.inka.de>
User-Agent: Mutt/1.5.18 (2008-05-17)
Cc: freebsd-ports@freebsd.org
Subject: Re: regression-test
X-BeenThere: freebsd-ports@freebsd.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: Porting software to FreeBSD <freebsd-ports.freebsd.org>
List-Unsubscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-ports>,
	<mailto:freebsd-ports-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-ports>
List-Post: <mailto:freebsd-ports@freebsd.org>
List-Help: <mailto:freebsd-ports-request@freebsd.org?subject=help>
List-Subscribe: <http://lists.freebsd.org/mailman/listinfo/freebsd-ports>,
	<mailto:freebsd-ports-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 18 Jun 2008 19:43:59 -0000

On Wed, Jun 18, 2008 at 05:08:54PM +0000, Christian Weisgerber wrote:
> So I just learned that pointyhat tries to run a target regression-test
> as part of the build.  (Somebody asked me to use that target in a
> port.)
> 
> Is this documented somewhere?

Not anywhere I know of, and it may be something specific to pointyhat as
I see no mention of it in Mk/*.  I have seen similar behavior in a
tinderbox so I'm guessing it's specific to those environments.

> In particular, running tests of what duration would be considered
> appropriate?  E.g., building audio/flac takes a minute here, running
> the tests sixteen, which I suspect would be excessive.

Obviously build times should be kept to a minimum.  If the tests are not
mandatory I'd suggest wrapping the regression-test stuff in a check for
MAINTAINER_MODE being defined.  This way you, or anyone else who wants
to, can run the regression tests but pointyhat won't pick them up.

-- WXS