From owner-freebsd-testing@FreeBSD.ORG Fri Jan 24 23:42:05 2014 Return-Path: Delivered-To: freebsd-testing@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id ED10BE9 for ; Fri, 24 Jan 2014 23:42:05 +0000 (UTC) Received: from mail-lb0-f170.google.com (mail-lb0-f170.google.com [209.85.217.170]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (No client certificate requested) by mx1.freebsd.org (Postfix) with ESMTPS id 762A2154D for ; Fri, 24 Jan 2014 23:42:04 +0000 (UTC) Received: by mail-lb0-f170.google.com with SMTP id u14so3054204lbd.15 for ; Fri, 24 Jan 2014 15:41:57 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to:cc:content-type; bh=1leV5VRbJO8OKMyV6bbDc2A8Wd8gVJXLvjXURQCz7L8=; b=CW7vwTA3eHZAs/+VknQFwzY9uSTGTCfHBKziL9eQBaRhN0MSVgDSbclOLpeT8Ida2h JLe/9X6g6LUeCRc2B8op6DGCSYHZzLDW7tFlMWpLqTduMdbFNn9HNBHB2TPPtjrxj0I4 4WJxVziDDxxS8RUhzL6siYDfy7SeNIF4S6VmUwr0RFAxza+fbGtZxB2k+qY4/X9WWo0G yEIhf0LmwwtEER3bLeZGGRGdwN8zSIFvRb2dNM+acGCPFdukHmrsgyOGJNgHNMnG8v0Q G9q/BVk97bvDaFvv8TT0Kz8CEAf7+Ugw5eF4R+OaMgounqKFcXB1AI85xqPivS03xlGn V3Tw== X-Gm-Message-State: ALoCoQmAjVvFB6fp+dUyZNlqYzUQFd63GgR9lNna8jb/2MaA0qo9nS1CDHuKqJyhdRA2g+iIBdWB X-Received: by 10.112.78.4 with SMTP id x4mr17784lbw.81.1390606433423; Fri, 24 Jan 2014 15:33:53 -0800 (PST) MIME-Version: 1.0 Received: by 10.112.129.101 with HTTP; Fri, 24 Jan 2014 15:33:33 -0800 (PST) X-Originating-IP: [2620:0:1003:100e:15ba:18e2:3e40:cdd2] In-Reply-To: <20140124162759.GB90996@stack.nl> References: <20140124162759.GB90996@stack.nl> From: Julio Merino Date: Fri, 24 Jan 2014 18:33:33 -0500 Message-ID: Subject: Re: [PATCH] convert /bin/sh tests over to ATF To: Jilles Tjoelker Content-Type: text/plain; charset=ISO-8859-1 Cc: freebsd-testing@freebsd.org X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.17 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 24 Jan 2014 23:42:06 -0000 On Fri, Jan 24, 2014 at 11:27 AM, Jilles Tjoelker wrote: > > There may be some point in marking tests that are supposed to work on > any POSIX-compliant sh and ones that are inherently FreeBSD-specific, or > possibly more granular. However, this would be most useful when someone > who cares about another sh implementation works on it. That's a worthy goal, but only if the test suite was an "external component" that you shipped outside of FreeBSD and was easily applicable to other systems. As it is now, the test suite lives in the FreeBSD tree and therefore it can be considered to be FreeBSD-specific. Special-casing things out as only applying to FreeBSD will be difficult to maintain and make little sense in the current context. Now... all this can (and should) easily turn into the more generic discussion of: how to define tests that can be shared across the various BSDs and how to better maintain them? I currently have no answer for that, but it's a pretty large topic to cover. -- Julio Merino / @jmmv