From nobody Fri Feb 23 16:30:21 2024
X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ThFqM2DhFz5B3kQ
	for <freebsd-hackers@mlmmj.nyi.freebsd.org>; Fri, 23 Feb 2024 16:30:23 +0000 (UTC)
	(envelope-from brooks@spindle.one-eyed-alien.net)
Received: from spindle.one-eyed-alien.net (spindle.one-eyed-alien.net [199.48.129.229])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256)
	(Client did not present a certificate)
	by mx1.freebsd.org (Postfix) with ESMTPS id 4ThFqL6tL0z4VfJ
	for <freebsd-hackers@freebsd.org>; Fri, 23 Feb 2024 16:30:22 +0000 (UTC)
	(envelope-from brooks@spindle.one-eyed-alien.net)
Authentication-Results: mx1.freebsd.org;
	none
Received: by spindle.one-eyed-alien.net (Postfix, from userid 3001)
	id C7CAD3C019A; Fri, 23 Feb 2024 16:30:21 +0000 (UTC)
Date: Fri, 23 Feb 2024 16:30:21 +0000
From: Brooks Davis <brooks@freebsd.org>
To: igor.ostapenko@pm.me
Cc: "freebsd-hackers@freebsd.org" <freebsd-hackers@freebsd.org>
Subject: Re: Add jail execution environment support to the FreeBSD test suite
Message-ID: <ZdjIHZFy8rF-PDxB@spindle.one-eyed-alien.net>
References: <2bjQNp1msrv-_AqyamMun6kY-SCqbgPm3Q7DqVQHAYlqvFkiE1i85svfIT-QQdUG1cg3cKippyTyv8Z-5nbLu4WaMutgZQ7KT-YYo_5Pbro=@pm.me>
List-Id: Technical discussions relating to FreeBSD <freebsd-hackers.freebsd.org>
List-Archive: https://lists.freebsd.org/archives/freebsd-hackers
List-Help: <mailto:freebsd-hackers+help@freebsd.org>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Subscribe: <mailto:freebsd-hackers+subscribe@freebsd.org>
List-Unsubscribe: <mailto:freebsd-hackers+unsubscribe@freebsd.org>
Sender: owner-freebsd-hackers@freebsd.org
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
In-Reply-To: <2bjQNp1msrv-_AqyamMun6kY-SCqbgPm3Q7DqVQHAYlqvFkiE1i85svfIT-QQdUG1cg3cKippyTyv8Z-5nbLu4WaMutgZQ7KT-YYo_5Pbro=@pm.me>
X-Spamd-Bar: ----
X-Rspamd-Pre-Result: action=no action;
	module=replies;
	Message is reply to one we originated
X-Spamd-Result: default: False [-4.00 / 15.00];
	REPLY(-4.00)[];
	ASN(0.00)[asn:36236, ipnet:199.48.128.0/22, country:US]
X-Rspamd-Queue-Id: 4ThFqL6tL0z4VfJ

On Thu, Feb 22, 2024 at 08:57:54PM +0000, igor.ostapenko@pm.me wrote:
> 2 The Idea
> 
> The idea is not new. A test could be running in a jail -- it provides the
> required isolation with minimum or zero effort from a test.

This generally sounds good.  One minor concern I have is how this would
interact with the ability to run the test suite in a jail.  This is
imperfectly supported today (IIRC ~350 failures on amd64), but it's
quite userful for testing sweeping userspace-only tests like libsys and
I'd love to see support expanded and improved (failures fixed or tests
skipped, poudriere jail support, etc).

Thanks,
Brooks