From nobody Wed Nov  6 20:13:39 2024
X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
	by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XkGcb711rz1GwgX;
	Wed, 06 Nov 2024 20:13:51 +0000 (UTC)
	(envelope-from olivier@freebsd.org)
Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (4096 bits) client-digest SHA256)
	(Client CN "smtp.freebsd.org", Issuer "R10" (verified OK))
	by mx1.freebsd.org (Postfix) with ESMTPS id 4XkGcb4nClz3xw9;
	Wed,  6 Nov 2024 20:13:51 +0000 (UTC)
	(envelope-from olivier@freebsd.org)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim;
	t=1730924031;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=qpHcKTFtaypvTFON8uJkl25LXjvemteJD+pM3e+foH4=;
	b=u2RyTrppAZYxkRUyv6Z4roFeWfrLJqv16Gi7NqRfMxb4va0r5CjTeVwDhhAi5sephACmns
	S+PtqPF9Z5uuAuj9eTcijNV3o7aO8tEGhSBUsCUQ+UMWuRsfWlAaiLfZd2UyEnCjULbMA7
	VPQWxGSnGoJymmvNnv/YfwKBPdsukL3tMULjWKdAqe72wygerFujZBQtjKt2dnISHRQUvg
	ioSZvMGwk6nEpLsbbMPzW7Fopm8bZSunzb6SOCEUen8XbL3OUqZg9kAiHM2U00OGkKhYeH
	LZawjxxm6VybQo8OVO9EXVX1Kb6rO00ZWX5v9t1hMOBsJjy1amtlY8jMyHnbJA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org;
	s=dkim; t=1730924031;
	h=from:from:reply-to:subject:subject:date:date:message-id:message-id:
	 to:to:cc:cc:mime-version:mime-version:content-type:content-type:
	 in-reply-to:in-reply-to:references:references;
	bh=qpHcKTFtaypvTFON8uJkl25LXjvemteJD+pM3e+foH4=;
	b=BJvn/n22TbgXP7LcR5us995/Kmq/FyA7rpgGlr/Xxsu1U8fZxPyzTR97IlCZX3qu0hdadU
	L3Vs3XMA6EwZQxr48Z/7kYIMT2lMDCfntAInqn/IrJARIAoQP9zyTj30FBCTgdwvhRBZst
	SmTxU1TP5PTp2rAhk9yefiY9rTraL/ISkl55yPcLRNqMDZitEr2nqwqa+pKcdWdr5ipUBx
	7lR8WvHK8/AR2CdRZVgXB8CO7CaBsSIlm6TuMDieRtoKljjf/wVTbbfa6futYix/uo/GKL
	G5P3jsvVFfG8iKuZ4JXKcgEW97p8FgJddePliGQh8JqP2I7CerDNHauKJACEKw==
ARC-Authentication-Results: i=1;
	mx1.freebsd.org;
	none
ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730924031; a=rsa-sha256; cv=none;
	b=b2ODGZO4EcmR+VjvFkU9p4W/h7rjh7yIoEsWU8aLT5LecLp0SZEfoeFV4rOO22GvygxBXQ
	ONospw8ezzNtk7BDpvzEu8uBCtr7vzOjthWwtXye8PSVrHGXbkzVVt/brTKvyqg+6/JG8M
	hyM4vM3X1khRBi3BVlB4YWYtSqDWB6TtfsqI1GGrjCrUu64kmII310ZXjg4dXGOUbyh7UM
	frLk/Sf2W9UF2CwnqrF/GWtpXmdCsEFioWgMhOc32j+R2FspzX4Vt/4Ul8K6mhi6OWCi1A
	59liURhjY4DbYJ/L/8U7FkosyDc9aOgULxqVmDaaR09IF9VFet/N6Y3FiAstig==
Received: from mail-qk1-f180.google.com (mail-qk1-f180.google.com [209.85.222.180])
	(using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits)
	 key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256
	 client-signature RSA-PSS (2048 bits) client-digest SHA256)
	(Client CN "smtp.gmail.com", Issuer "WR4" (verified OK))
	(Authenticated sender: olivier/mail)
	by smtp.freebsd.org (Postfix) with ESMTPSA id 4XkGcb4GRVz121J;
	Wed,  6 Nov 2024 20:13:51 +0000 (UTC)
	(envelope-from olivier@freebsd.org)
Received: by mail-qk1-f180.google.com with SMTP id af79cd13be357-7b152a23e9aso14857285a.0;
        Wed, 06 Nov 2024 12:13:51 -0800 (PST)
X-Forwarded-Encrypted: i=1; AJvYcCUZU/S6zX6jKZ5AZvqrOP3Y3lVZneZUhJrRzQe+eg06phdZKdUC1pb4pQnXVXwKkLZMYGhZ9d7lPD5hBu4HN40=@freebsd.org
X-Gm-Message-State: AOJu0Yyl406sP32y5aJn0FqnyzHXX+RPZZ8woJmJRdXxLG7M8uzp/XsJ
	BlirXWcFDo4ZprmSCRbArnh6bPOfGSd605OkWvQ1oROIzYTPO4oBAPwauReC5tTONhUW4EvMQ2k
	U3+Pv9XFNublBOJrVTvxTH6fD9xk=
X-Google-Smtp-Source: AGHT+IGOZ1Jh835ckCMc4Fhn2hJYaDryyX/ntdHeVIK9f5eCmzXgPBhiF+ZDHqK4d3SSTOjHJ3mOCOkiG2FpJE1fpus=
X-Received: by 2002:a05:6214:4b11:b0:6cb:eaba:ed5a with SMTP id
 6a1803df08f44-6d1856fb306mr481676526d6.29.1730924031211; Wed, 06 Nov 2024
 12:13:51 -0800 (PST)
List-Id: Technical discussions relating to FreeBSD <freebsd-hackers.freebsd.org>
List-Archive: https://lists.freebsd.org/archives/freebsd-hackers
List-Help: <mailto:freebsd-hackers+help@freebsd.org>
List-Post: <mailto:freebsd-hackers@freebsd.org>
List-Subscribe: <mailto:freebsd-hackers+subscribe@freebsd.org>
List-Unsubscribe: <mailto:freebsd-hackers+unsubscribe@freebsd.org>
Sender: owner-freebsd-hackers@FreeBSD.org
MIME-Version: 1.0
References: <9fc6fc72-4c2c-4b09-bdb5-122a49b45295@FreeBSD.org>
In-Reply-To: <9fc6fc72-4c2c-4b09-bdb5-122a49b45295@FreeBSD.org>
From: =?UTF-8?Q?Olivier_Cochard=2DLabb=C3=A9?= <olivier@freebsd.org>
Date: Wed, 6 Nov 2024 21:13:39 +0100
X-Gmail-Original-Message-ID: <CA+q+TcpLeVqHhtL7VHvWsijQO9sxewY5opeUQ895G43EC24qgg@mail.gmail.com>
Message-ID: <CA+q+TcpLeVqHhtL7VHvWsijQO9sxewY5opeUQ895G43EC24qgg@mail.gmail.com>
Subject: Re: RFC: Add required_klds metadata to Kyua
To: Igor Ostapenko <igoro@freebsd.org>
Cc: freebsd-testing@freebsd.org, freebsd-hackers@freebsd.org
Content-Type: multipart/alternative; boundary="000000000000038e8f0626442893"

--000000000000038e8f0626442893
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

On Wed, Nov 6, 2024 at 7:12=E2=80=AFPM Igor Ostapenko <igoro@freebsd.org> w=
rote:

>
>
> The problem to solve here is a well-known one: typically we invoke "kyua
> test" and get a lot of "Skipped" due to many kernel module requirements.
> And
> the pain is to know which ones need loading, especially if we target a
> sub-tree of /usr/tests. Also, the FreeBSD CI needs periodic sync if a new
> test is added with new module requirements. And other related issues.
>
>
> Hello Igor,

Thanks again for working on this topic
And there are even more challenging cases: what about tests that assess the
behavior of different modules and need to unload them as well?
For example, sys/netipsec/tunnel/* or sys/opencrypto/, which involve
loading and unloading modules between tests."

Regards,
Olivier

--000000000000038e8f0626442893
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div dir=3D"ltr"><div class=3D"gmail_default" style=3D"fon=
t-family:&quot;courier new&quot;,monospace"><br></div></div><div class=3D"g=
mail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Wed, Nov 6, 2024 at 7:=
12=E2=80=AFPM Igor Ostapenko &lt;<a href=3D"mailto:igoro@freebsd.org">igoro=
@freebsd.org</a>&gt; wrote:<br></div><blockquote class=3D"gmail_quote" styl=
e=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);paddin=
g-left:1ex"><br>
<br>
The problem to solve here is a well-known one: typically we invoke &quot;ky=
ua<br>
test&quot; and get a lot of &quot;Skipped&quot; due to many kernel module r=
equirements. And<br>
the pain is to know which ones need loading, especially if we target a<br>
sub-tree of /usr/tests. Also, the FreeBSD CI needs periodic sync if a new<b=
r>
test is added with new module requirements. And other related issues.<br>
<br><br></blockquote>Hello Igor,<br><br>Thanks again for working on this to=
pic<br>And there are even more challenging cases: what about tests that ass=
ess the behavior of different modules and need to unload them as well?<br>F=
or example, sys/netipsec/tunnel/* or sys/opencrypto/, which involve loading=
 and unloading modules between tests.&quot;<br><br>Regards,<br>Olivier</div=
></div>

--000000000000038e8f0626442893--