From owner-freebsd-python@freebsd.org  Sat Sep 22 09:54:09 2018
Return-Path: <owner-freebsd-python@freebsd.org>
Delivered-To: freebsd-python@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id F32B71092261
 for <freebsd-python@mailman.ysv.freebsd.org>;
 Sat, 22 Sep 2018 09:54:08 +0000 (UTC)
 (envelope-from bugzilla-noreply@freebsd.org)
Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org
 [IPv6:2001:1900:2254:206a::50:5])
 by mx1.freebsd.org (Postfix) with ESMTP id 8FAB08C1A0
 for <freebsd-python@freebsd.org>; Sat, 22 Sep 2018 09:54:08 +0000 (UTC)
 (envelope-from bugzilla-noreply@freebsd.org)
Received: by mailman.ysv.freebsd.org (Postfix)
 id 51A7F1092260; Sat, 22 Sep 2018 09:54:08 +0000 (UTC)
Delivered-To: python@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
 by mailman.ysv.freebsd.org (Postfix) with ESMTP id 2FB8A109225F
 for <python@mailman.ysv.freebsd.org>; Sat, 22 Sep 2018 09:54:08 +0000 (UTC)
 (envelope-from bugzilla-noreply@freebsd.org)
Received: from mxrelay.ysv.freebsd.org (mxrelay.ysv.freebsd.org
 [IPv6:2001:1900:2254:206a::19:3])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client CN "mxrelay.ysv.freebsd.org",
 Issuer "Let's Encrypt Authority X3" (verified OK))
 by mx1.freebsd.org (Postfix) with ESMTPS id C55158C19A
 for <python@FreeBSD.org>; Sat, 22 Sep 2018 09:54:07 +0000 (UTC)
 (envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org (kenobi.freebsd.org
 [IPv6:2001:1900:2254:206a::16:76])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (Client did not present a certificate)
 by mxrelay.ysv.freebsd.org (Postfix) with ESMTPS id 1F7084A42
 for <python@FreeBSD.org>; Sat, 22 Sep 2018 09:54:07 +0000 (UTC)
 (envelope-from bugzilla-noreply@freebsd.org)
Received: from kenobi.freebsd.org ([127.0.1.118])
 by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id w8M9s6OP015233
 for <python@FreeBSD.org>; Sat, 22 Sep 2018 09:54:06 GMT
 (envelope-from bugzilla-noreply@freebsd.org)
Received: (from www@localhost)
 by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id w8M9s6oa015232
 for python@FreeBSD.org; Sat, 22 Sep 2018 09:54:06 GMT
 (envelope-from bugzilla-noreply@freebsd.org)
X-Authentication-Warning: kenobi.freebsd.org: www set sender to
 bugzilla-noreply@freebsd.org using -f
From: bugzilla-noreply@freebsd.org
To: python@FreeBSD.org
Subject: [Bug 231555] Mk/Uses/python.mk: Add USE_PYTHON=pytest
Date: Sat, 22 Sep 2018 09:54:07 +0000
X-Bugzilla-Reason: CC
X-Bugzilla-Type: changed
X-Bugzilla-Watch-Reason: None
X-Bugzilla-Product: Ports & Packages
X-Bugzilla-Component: Ports Framework
X-Bugzilla-Version: Latest
X-Bugzilla-Keywords: feature
X-Bugzilla-Severity: Affects Only Me
X-Bugzilla-Who: koobs@FreeBSD.org
X-Bugzilla-Status: New
X-Bugzilla-Resolution: 
X-Bugzilla-Priority: ---
X-Bugzilla-Assigned-To: portmgr@FreeBSD.org
X-Bugzilla-Flags: maintainer-feedback?
X-Bugzilla-Changed-Fields: keywords
Message-ID: <bug-231555-21822-Mz34X13L0T@https.bugs.freebsd.org/bugzilla/>
In-Reply-To: <bug-231555-21822@https.bugs.freebsd.org/bugzilla/>
References: <bug-231555-21822@https.bugs.freebsd.org/bugzilla/>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/
Auto-Submitted: auto-generated
MIME-Version: 1.0
X-BeenThere: freebsd-python@freebsd.org
X-Mailman-Version: 2.1.27
Precedence: list
List-Id: FreeBSD-specific Python issues <freebsd-python.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-python>, 
 <mailto:freebsd-python-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-python/>
List-Post: <mailto:freebsd-python@freebsd.org>
List-Help: <mailto:freebsd-python-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-python>,
 <mailto:freebsd-python-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Sat, 22 Sep 2018 09:54:09 -0000

https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D231555

Kubilay Kocak <koobs@FreeBSD.org> changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
           Keywords|                            |feature

--- Comment #3 from Kubilay Kocak <koobs@FreeBSD.org> ---
I'd like to see something like this leverage/extend the test framework bits=
 if
necessary to achieve what we want, to make it usable for cases other than j=
ust
pytest (nosetests, unittest, whatever). python.mk could then setup/wrap pyt=
hon
specific test scenarios, using generic TEST_* (TEST_COMMAND/TEST_CMD_ARGS, =
etc)
variables wherever possible.

I see most of the value created in leveraging/extending the test framework,
than is obtained from removing the need for TEST_DEPENDS and not needing to
specify a test target.

Test invocations are *notoriously* non-standard in the Python world (grante=
d,
python -m pytest 'is' a common one), with various permutations of a
env/commands/args combination necessary to get it just right.

Further, its very commonly the case that pytest along is not a
standalone/sufficient dependency by itself, and having them split implicitl=
y in
the framework and explicitly in the port is not particularly desirable.

This idea has been an open task [1] for the Python team for a while, looking
for at least a *minimally* considered/designed schema to support a pluralit=
y of
test execution needs, rather than just added on an adhoc basic, and hopeful=
ly
one that could be leveraged to the benefit of other softwares/language stac=
ks
in the ports tree.

Perhaps a good place to start would be to take stock of the existing test
methods for existing python ports and see what scheme we can come up with to
support the 'major classes' of test execution methods.

--=20
You are receiving this mail because:
You are on the CC list for the bug.=