Date: Sun, 22 Jun 2008 15:47:45 +0000 (UTC) From: naddy@mips.inka.de (Christian Weisgerber) To: freebsd-ports@freebsd.org Subject: Re: regression-test Message-ID: <g3ls71$l4h$1@kemoauc.mips.inka.de> References: <676047.76296.qm@web32706.mail.mud.yahoo.com> <20080619163501.GB12160@atarininja.org> <485A921C.80602@FreeBSD.org>
next in thread | previous in thread | raw e-mail | index | archive | help
Kris Kennaway <kris@freebsd.org> wrote: > Our experience has shown that it is very common for tests to succeed > when run by the maintainer, but to fail in the package cluster > environment because of differences in the environment, configuration, > default assumptions, etc. i.e. the regression tests found bugs, which > is the entire point. In my experience from OpenBSD, where "make regress" has been a standard part of the bsd.port.mk framework for a long time, a failing regression test is not infrequently a problem in the test itself rather than in the tested functionality. I do agree that running the included regression tests is a good idea, but the details can be tricky. -- Christian "naddy" Weisgerber naddy@mips.inka.de
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?g3ls71$l4h$1>