From owner-freebsd-testing@freebsd.org Wed Jan 18 06:47:34 2017 Return-Path: Delivered-To: freebsd-testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 64117CB45D0 for ; Wed, 18 Jan 2017 06:47:34 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mailman.ysv.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 3BBB2162F for ; Wed, 18 Jan 2017 06:47:34 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mailman.ysv.freebsd.org (Postfix) id 36AAECB45CE; Wed, 18 Jan 2017 06:47:34 +0000 (UTC) Delivered-To: testing@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 34A65CB45CC for ; Wed, 18 Jan 2017 06:47:34 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pf0-x232.google.com (mail-pf0-x232.google.com [IPv6:2607:f8b0:400e:c00::232]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id EAC75162E; Wed, 18 Jan 2017 06:47:33 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: by mail-pf0-x232.google.com with SMTP id e4so1933658pfg.1; Tue, 17 Jan 2017 22:47:33 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:mime-version:from:in-reply-to:date:cc:message-id:references :to; bh=Vu2hEzJdF1f0zEhh8p7mGRxavXf5no9NMbW6pA47PXk=; b=aFNNg/cvgCbt2ymLca/Z4DWAkvGfq6KHmOTvPgB14uF+IS8MPwJKqBr4dV7UYD+xpD dZ/3UJNDZXW7V9o2NT2v/iqp5GFf1bod69JZHO6U103gJcGwpyDo8G6+K4MYblbvMSfT KVDsa8ZoORER0We6mHsbHpk5J2NYOrRbXdM8fJb8x5YSbnq9TwSNvoqGWEptIfoyyPSL EB8o/LwWWVao4ISpnj7Rd9NFrk/PzhcYseKDVJddggA7jhDhMOohqrgWTmrZzxs5ZSiW vOv/FGfZThTKx1KMUPdPg+V9jn8YhjXpb8Y7W4mfdCB0EQYeK6Zk7AfV4sSN9PwaOgEi 4SoA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:mime-version:from:in-reply-to:date:cc :message-id:references:to; bh=Vu2hEzJdF1f0zEhh8p7mGRxavXf5no9NMbW6pA47PXk=; b=tzps87HNFu6faD30XmgkVH8KfCn2kqTftfpGuJ2Dl9GkV3nhDLp/XQqWHfT9UFlAL1 kzJ6EWeeMbOOXti3fWrdGGsoyh6/eVshwpi304LJl4mwHIlAoQmcw12iGhWOSF3FzUon zBJe9qsq4wNa/0jLu7sdIDLwJvEdahs/kp01qAeFXfmxIQD0SC20ShmPuq/XSW4HNqwU QRATr/yy4s/4gWaDGWxoKwldFj4MyqTCVWOGGcO5GeUK5uWX3fs6QgtV37+31qQstRh1 MtnI31izgkqsH63tPikQ1IhyqpBvQDZelxg9MmZ4KAotiZWqUW8thxAtpMwAOaxcoOI9 veMw== X-Gm-Message-State: AIkVDXL+ZRKfIZH/Fw86huE0FyhuhiZx3RZqkl/fG2rCJdG+Erv6QrP3Kj/SOQZl5OvwMA== X-Received: by 10.98.15.143 with SMTP id 15mr2059652pfp.100.1484722053345; Tue, 17 Jan 2017 22:47:33 -0800 (PST) Received: from pinklady.local (c-73-19-52-228.hsd1.wa.comcast.net. [73.19.52.228]) by smtp.gmail.com with ESMTPSA id h4sm46050296pfk.96.2017.01.17.22.47.32 (version=TLS1 cipher=ECDHE-RSA-AES128-SHA bits=128/128); Tue, 17 Jan 2017 22:47:32 -0800 (PST) Subject: Re: Looking at replacing ATF/Kyua (in a limited fashion) with Google Test/shunit2 Mime-Version: 1.0 (Mac OS X Mail 9.3 \(3124\)) Content-Type: multipart/signed; boundary="Apple-Mail=_2FE8D42A-9796-4BB0-BA51-C0384D8B84D5"; protocol="application/pgp-signature"; micalg=pgp-sha512 X-Pgp-Agent: GPGMail From: "Ngie Cooper (yaneurabeya)" In-Reply-To: Date: Tue, 17 Jan 2017 22:47:31 -0800 Cc: "freebsd-testing@freebsd.org" Message-Id: <901D465A-9F32-4BBC-9FF6-7EB5AFAF6858@gmail.com> References: <45D23581-C780-4C55-80CF-19A81813D672@gmail.com> To: Alan Somers X-Mailer: Apple Mail (2.3124) X-BeenThere: freebsd-testing@freebsd.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Testing on FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Jan 2017 06:47:34 -0000 --Apple-Mail=_2FE8D42A-9796-4BB0-BA51-C0384D8B84D5 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 > On Jan 17, 2017, at 15:11, Alan Somers wrote: =E2=80=A6 > Before you get to far, you should ask yourself how much test case > isolation you desire. Googletest is great, but I think it'll be hard > to get the strong isolation between testcases provided by ATF. > Perhaps it'll be find if GoogleTest tests provide no per-testcase > isolation; most C/C++ programmers don't expect it anyway. But many of > FreeBSD's atf-sh tests depend on it. A lot of programmers don=E2=80=99t desire this at all, until they = realize how their tests might be affected by system state if/when there = are files/directories/other inputs infecting their results on the test = system. > Also, how are you planning to hook up GoogleTest and shunit2 to Kyua? It=E2=80=99s early enough on in the process of trying to figure out how = things work that I cannot definitively say, other than it may end up = being something like: kyua <-> googletest <-> atf or something more like: kyua <-> googletest_atf_compat and just mimic the output of ATF, while hiding the implementation = details of the test suites. If that turns out to be a pain, then I=E2=80=99= ll just implement another hook into kyua for googletest which will = implement the features we need, potentially as a patch to the port, = because =E2=80=9Clegal reasons=E2=80=9D (contributor agreements = shouldn=E2=80=99t be impediments, but because I signed an individual CLA = vs corporate CLA and they aren=E2=80=99t equivalent) are blocking me = from giving code back to Google as a Dell EMC employee (things may = change, but when I fought for a corporate CLA, it got stuck in the = bureaucratic quagmire that is my company=E2=80=99s legal/business dept). Thanks, -Ngie --Apple-Mail=_2FE8D42A-9796-4BB0-BA51-C0384D8B84D5 Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJYfw+DAAoJEPWDqSZpMIYVDbIP+QGKN2zl18xSgWsohE4rkbfS uRHPddu+qhkOEMn5SSuroZbWTdzMC9fqPq03TKAvafS2gkvWGVduwU/sG8v1uR5O simKs8uj65bDKj9tOSPqvLPlE7+lHt7gve8C3YTmSjp86hdk1sMCFmCa0pdUJmhg EuWG/cUUgKV/EsDvDFIasOw1jgqMMVjMV53rzWhxo6mSPVyq0Q1I+swZUkhhACa1 JDCBeYDcF2vZdCUNCo/e9K1s47ZlRjGPtnKU60i7p2LK2KZ5ekqVS//0PD5+0cfi lTazIIVJQdQy3/OqS3FYO0QXlWmTZOet/csS9qZaADF3SXZKoQ9U6AbZ5Ptp4lym yHlow8casju1T158ghfvSflzFS9o6zx4MJwRgKc+Q0dmRuA7EDGMMewuWdBy5M/H 2iI4ZkxS2Xc2Y918krIiWHZcpdkapSUI5nFW1xm1WN42FZ+qaIOWgnFmcH3qB500 EPJxrhVqb5tCoKaw40gv6rATgzGk6JI2cqKUV1TZekXnsEDb2jzfpxpny5dGZh0J a0yI7WvrgUhGDkzwiygTRh8SP7FttZ/l4d5svWXk4lkbOkHKR96BtPr4RSm2O3Xx Je8QYb8ir97Levltn9aFN3cjth9AFnLCAUo0prC1d2Nitme9UxML7X0rBJE9Jhqa Syc2NiuRYPLM8lb74hTi =eyRn -----END PGP SIGNATURE----- --Apple-Mail=_2FE8D42A-9796-4BB0-BA51-C0384D8B84D5--