From owner-svn-src-head@freebsd.org  Mon Jul 17 18:20:55 2017
Return-Path: <owner-svn-src-head@freebsd.org>
Delivered-To: svn-src-head@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org
 [IPv6:2001:1900:2254:206a::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id A48C1D9D0D7;
 Mon, 17 Jul 2017 18:20:55 +0000 (UTC)
 (envelope-from ngie@FreeBSD.org)
Received: from repo.freebsd.org (repo.freebsd.org
 [IPv6:2610:1c1:1:6068::e6a:0])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mx1.freebsd.org (Postfix) with ESMTPS id 72E456B1F8;
 Mon, 17 Jul 2017 18:20:55 +0000 (UTC)
 (envelope-from ngie@FreeBSD.org)
Received: from repo.freebsd.org ([127.0.1.37])
 by repo.freebsd.org (8.15.2/8.15.2) with ESMTP id v6HIKsiB082378;
 Mon, 17 Jul 2017 18:20:54 GMT (envelope-from ngie@FreeBSD.org)
Received: (from ngie@localhost)
 by repo.freebsd.org (8.15.2/8.15.2/Submit) id v6HIKsla082377;
 Mon, 17 Jul 2017 18:20:54 GMT (envelope-from ngie@FreeBSD.org)
Message-Id: <201707171820.v6HIKsla082377@repo.freebsd.org>
X-Authentication-Warning: repo.freebsd.org: ngie set sender to
 ngie@FreeBSD.org using -f
From: Ngie Cooper <ngie@FreeBSD.org>
Date: Mon, 17 Jul 2017 18:20:54 +0000 (UTC)
To: src-committers@freebsd.org, svn-src-all@freebsd.org,
 svn-src-head@freebsd.org
Subject: svn commit: r321081 - head/share/mk
X-SVN-Group: head
X-SVN-Commit-Author: ngie
X-SVN-Commit-Paths: head/share/mk
X-SVN-Commit-Revision: 321081
X-SVN-Commit-Repository: base
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: 8bit
X-BeenThere: svn-src-head@freebsd.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: SVN commit messages for the src tree for head/-current
 <svn-src-head.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/svn-src-head>,
 <mailto:svn-src-head-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/svn-src-head/>
List-Post: <mailto:svn-src-head@freebsd.org>
List-Help: <mailto:svn-src-head-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/svn-src-head>,
 <mailto:svn-src-head-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Mon, 17 Jul 2017 18:20:55 -0000

Author: ngie
Date: Mon Jul 17 18:20:54 2017
New Revision: 321081
URL: https://svnweb.freebsd.org/changeset/base/321081

Log:
  Sort the tests alphabetically before adding them to the Kyuafiles
  
  This is being done to aid in debugging test runs, in the event the
  output shifts due to refactored Makefiles, added tests, etc.
  
  MFC after:	1 month

Modified:
  head/share/mk/bsd.test.mk

Modified: head/share/mk/bsd.test.mk
==============================================================================
--- head/share/mk/bsd.test.mk	Mon Jul 17 18:12:08 2017	(r321080)
+++ head/share/mk/bsd.test.mk	Mon Jul 17 18:20:54 2017	(r321081)
@@ -66,6 +66,10 @@ _TESTS=
 .include <plain.test.mk>
 .include <tap.test.mk>
 
+# Sort the tests alphabetically, so the results are deterministically formed
+# across runs.
+_TESTS:=	${_TESTS:O}
+
 # kyua automatically descends directories; only run make check on the
 # top-level directory
 .if !make(check)