Date: Tue, 7 Oct 2014 16:40:25 -0700 From: NGie Cooper <yaneurabeya@gmail.com> To: Craig Rodrigues <rodrigc@freebsd.org> Cc: "freebsd-testing@freebsd.org" <freebsd-testing@freebsd.org>, freebsd-current Current <freebsd-current@freebsd.org> Subject: Re: Need help fixing tests in CURRENT Message-ID: <CAGHfRMDmEKUWTKbvivtY-X1AV=1bBkZ2YZrk8ejhYZz0djJ5OA@mail.gmail.com> In-Reply-To: <CAG=rPVdfhThgFcFy4_uzKS6030KWsNVccOORjKmdr5wc=ff2%2Bw@mail.gmail.com> References: <CAG=rPVd73q7fPrhJ3VOtjzXjVe-9BRoBCcZFzLELW4DFY7zW8A@mail.gmail.com> <CAG=rPVe0onSPkBneL9CgOSr6vN3YQ6-CeMJcQ9hAwscFqZBSfA@mail.gmail.com> <CAGHfRMBt=qtFEk2WMr7-Z65dug6L9U-a=wYFdLy4VquN2geSLQ@mail.gmail.com> <CAG=rPVdfhThgFcFy4_uzKS6030KWsNVccOORjKmdr5wc=ff2%2Bw@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Tue, Oct 7, 2014 at 4:38 PM, Craig Rodrigues <rodrigc@freebsd.org> wrote: > > On Tue, Oct 7, 2014 at 4:30 PM, NGie Cooper <yaneurabeya@gmail.com> wrote: >> >> On Tue, Oct 7, 2014 at 2:04 PM, Craig Rodrigues <rodrigc@freebsd.org> >> wrote: >> > Hi, >> > >> > After committing this fix to yacc in HEAD ( >> > https://lists.freebsd.org/pipermail/svn-src-all/2014-October/092553.html >> > ) >> > I've been able to do: "cd /usr/tests; kyua test" >> > >> > and get 0 test failures: >> > >> > >> > https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/16/testReport/ >> >> Awesome -- hopefully this will be sustained for several runs (this >> is part of the reason why I haven't integrated all of the NetBSD tests >> yet). >> Thank you for all your work in getting us to green! >> > > For any type of test framework, if the tests aren't run regularly > and reported in an easy to understand manner, > then the tests will bitrot and people will ignore them. > > I've seen this happen in multiple companies I have worked at. > > Hopefully we can do better with FreeBSD, and foster a community > of people who are actively updating the tests, and taking test failures > seriously. > > If we don't do this, then people will just ignore the tests. Agreed. The problem with the NetBSD testcases and some of the bits in tools/regression is that there are a certain batch which are non-deterministic and blur the lines between functional and unittest. Thanks!
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAGHfRMDmEKUWTKbvivtY-X1AV=1bBkZ2YZrk8ejhYZz0djJ5OA>