From owner-freebsd-current@FreeBSD.ORG Tue Sep 9 17:13:05 2014 Return-Path: Delivered-To: freebsd-current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [8.8.178.115]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 2333ED3E; Tue, 9 Sep 2014 17:13:05 +0000 (UTC) Received: from mail-pa0-x22a.google.com (mail-pa0-x22a.google.com [IPv6:2607:f8b0:400e:c03::22a]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id E1720A28; Tue, 9 Sep 2014 17:13:04 +0000 (UTC) Received: by mail-pa0-f42.google.com with SMTP id lj1so4538763pab.29 for ; Tue, 09 Sep 2014 10:13:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=content-type:mime-version:subject:from:in-reply-to:date:cc :message-id:references:to; bh=9l/p0k6LSbnznnI2dQWI1vK++d1EG08KiOQrb9O+Q2w=; b=1Iai84xmV5nee8Llfs+0SlFXgX/oEddxx0Z8R5rU5fl9Vw4tyjx9/MQfRfKLxEfWv6 SxbKHroeqyMRIGrL/TdJABJGLYcj6DdhwB6fqo+prXCwu3TEl/4OoMuYBhDhg4tO5pFG T6kch+GKvwaOTuQEanRn0s0Wl844WuR8SNIyiK1y9BT7ucD/ZSSU5L4CPgZnMure9cpS hNKkynDrtpM4uBsiLgzqEVjCzp2uXm6U1hsCADBYubbx3euuTcWDQHk9W7ptz8ikuoID ymSH6AbfCYbL0qkdNdLAedl5dhlq7MfZOZhSuOigoEBxDtX1u9YmtbxFtQV1CuDqFOqI YDew== X-Received: by 10.70.47.2 with SMTP id z2mr60450171pdm.38.1410282784318; Tue, 09 Sep 2014 10:13:04 -0700 (PDT) Received: from ?IPv6:2601:8:ab80:7d6:8dc3:2f93:9a63:ed06? ([2601:8:ab80:7d6:8dc3:2f93:9a63:ed06]) by mx.google.com with ESMTPSA id aj3sm12116633pbc.92.2014.09.09.10.13.03 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 09 Sep 2014 10:13:03 -0700 (PDT) Content-Type: multipart/signed; boundary="Apple-Mail=_7CEFCC33-E217-406B-9D1E-9D706E2C59CB"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.3 \(1878.6\)) Subject: Re: Need help fixing tests in CURRENT From: yaneurabeya@gmail.com In-Reply-To: <540F34B1.7040103@freebsd.org> Date: Tue, 9 Sep 2014 10:13:02 -0700 Message-Id: <0D9BBC19-3139-4E66-B9E3-263ACB1C056B@gmail.com> References: <540F34B1.7040103@freebsd.org> To: Allan Jude X-Mailer: Apple Mail (2.1878.6) Cc: freebsd-current@freebsd.org X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 09 Sep 2014 17:13:05 -0000 --Apple-Mail=_7CEFCC33-E217-406B-9D1E-9D706E2C59CB Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 On Sep 9, 2014, at 10:11, Allan Jude wrote: > On 2014-09-09 13:05, Craig Rodrigues wrote: >> Hi, >>=20 >> I did a buildworld/installworld of current in a bhyve VM, and then = did the >> following. >>=20 >> pkg install devel/kyua >> cd /usr/tests >> kyua test >> kyua report >> kyua report-html >> kyua report-junit >>=20 >> I then published the results in Jenkins: >>=20 >> The results are here: >>=20 >> = https://jenkins.freebsd.org/jenkins/job/FreeBSD_HEAD-tests2/lastCompletedB= uild/testReport/ >>=20 >> There seem to be 31 test failures. Can folks look into those >> and see if the tests need to be fixed >>=20 >> Right now I ran these steps manually, but hopefully over time >> we can automate more of this stuff. >=20 > Most of the errors (jot, m4, sed, etc) seems to be: >=20 > kyua-tap-tester: Configuration variables not supported; ignoring > 'has.cleanup=3Dfalse' > kyua-tap-tester: Configuration variables not supported; ignoring > 'unprivileged-user=3Dtests=92 Not quite=85 > while everything else about the test was successful. Hi Craig, Taking a stab at the issues, most of the problems are because of = https://github.com/jmmv/kyua/issues/103 . The other issues with atf ( = https://github.com/jmmv/atf/issues/8 ) and kyua ( = https://github.com/jmmv/kyua/issues/109 ) are known (I=92m sure about = ATF, not 100% sure about kyua, but my gut instinct says yes). Thanks! -Garrett --Apple-Mail=_7CEFCC33-E217-406B-9D1E-9D706E2C59CB Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQEcBAEBCgAGBQJUDzUeAAoJEMZr5QU6S73e91QH/1SGZmvhoiJgXNaPbBzO+u38 SVAQiRvh5dFcE1WTXbTDHAEv93liaDF5VWESn+mRhytMSOO8iUsERPqJkkQ6cyCF r4tj3akhdJQAws0dTi873IBGu6j6vrc4KoDJRDEG125PYXUT2dz2pextVC06xIzB dmRgJjx6KOXs37Ruo/uf8BnU5kGYgZ9xvIugikqYc8fEyZg6qf/vr8Myvw9tGtW6 Ak/lGbsJ5oXDu0bSQiJRSKGtQG3ZYDlEBK1zpkq4DW5Lgt6BoQ52cx6GTkshwuaQ fE77M6uaKpcaJxcFvjVVvmXDMHRl7JQeRbRMYy3Vi8COFxSep7TlZWxetf6KLo0= =Ic8H -----END PGP SIGNATURE----- --Apple-Mail=_7CEFCC33-E217-406B-9D1E-9D706E2C59CB--