Date: Fri, 24 Jan 2014 17:27:59 +0100 From: Jilles Tjoelker <jilles@stack.nl> To: Garrett Cooper <yaneurabeya@gmail.com> Cc: freebsd-testing@FreeBSD.org Subject: Re: [PATCH] convert /bin/sh tests over to ATF Message-ID: <20140124162759.GB90996@stack.nl> In-Reply-To: <B5290C1B-F262-479C-8D4F-A5D8B3CE5A52@gmail.com> References: <B5290C1B-F262-479C-8D4F-A5D8B3CE5A52@gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Mon, Jan 20, 2014 at 08:44:58AM -0800, Garrett Cooper wrote: > Also, I added some functionality so the tests expect failures on > certain versions of FreeBSD due to missing functionality or > conformance modifications (see the .valid_osreldate files). I think this part is a bit too simplistic and inflexible. I have always dealt with changes affecting the tests by MFCing the changes to the tests along with the changes to sh itself, and this has worked well enough. On the other hand, I also run -current's sh and tests on my -stable machine, without installing the tests (and often also without installing the new sh). Therefore, the osreldate of the machine does not imply that the sh is also of that version. There are also changes like r222684 that need an adjustment to the tests which are hard to handle properly using a .valid_osreldate file. There may be some point in marking tests that are supposed to work on any POSIX-compliant sh and ones that are inherently FreeBSD-specific, or possibly more granular. However, this would be most useful when someone who cares about another sh implementation works on it. -- Jilles Tjoelker
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20140124162759.GB90996>