From nobody Sun May 3 01:37:21 2026 X-Original-To: dev-commits-src-main@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4g7S7s0YPRz6ccd7 for ; Sun, 03 May 2026 01:37:29 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Received: from mail-pj1-x102f.google.com (mail-pj1-x102f.google.com [IPv6:2607:f8b0:4864:20::102f]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4g7S7r1qs5z3ZNB for ; Sun, 03 May 2026 01:37:28 +0000 (UTC) (envelope-from yaneurabeya@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20251104 header.b=Sr71zKXX; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of yaneurabeya@gmail.com designates 2607:f8b0:4864:20::102f as permitted sender) smtp.mailfrom=yaneurabeya@gmail.com Received: by mail-pj1-x102f.google.com with SMTP id 98e67ed59e1d1-35f9ab079bdso2306690a91.2 for ; Sat, 02 May 2026 18:37:28 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20251104; t=1777772245; x=1778377045; darn=freebsd.org; h=content-transfer-encoding:mime-version:message-id:references :in-reply-to:user-agent:subject:to:from:date:from:to:cc:subject:date :message-id:reply-to; bh=rH+dHbW7iQs8qaMv7oqp6jUhF/NLmX6NnOyuhuxphEI=; b=Sr71zKXXhIEeP/pkCL180/Fr16QjnFDlSG5cpYaCRWEBrX6cdEngWQBRKUOlKfB18Z o2a7FRQ/Vm/J6rYaZtYb82NeVQJDbwFrGjqtWFN1g4T4hwE755BWxmfDNJh8cSAIIvaF xTQjJ6gviTCLz1zjVVTLxrVU9Ptnf5+HAf4tC/msWDEE8DjqBC8GW4mdtqzkhcegw0V6 1t89mv1bSQQn6AvJ46QKT110L7W2joWzFUdC6CT6PzAkZbOMW7dJ0/r16XiUr0IMkWPS kS8WyDR15Sfj/Q8yMZmk3dIbG8179Ff0gH+fCye4LuvjU2AxbTjjgp5Jo3oFKkEvpGbL rFpA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1777772245; x=1778377045; h=content-transfer-encoding:mime-version:message-id:references :in-reply-to:user-agent:subject:to:from:date:x-gm-gg :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=rH+dHbW7iQs8qaMv7oqp6jUhF/NLmX6NnOyuhuxphEI=; b=aT+c5QkxMAS4raqQhAdOPDobgzaWx5zzh9DeSrmbvUacjbklLXIlI+Ba/J09XsYMEi ovyXKmncdLzum24MBliiOB2rdEn2kDI7eto7p6zjQRcp2Araz0u7IBrd5BDWzNhg4ZZP /cMpCGNaQpJpZLE8qpmtUZBv2RpqYzZTjdwzyvj20JpWq99wHoQ3szqBQxQupvvI0+FI T17Q6mWieOFhtB5+9RFY9GA1qMPhX20F6W0ySnKyb84K5ehV7QEC9Y5DuFOE50YjE4oN 1nvKiJsIZuE28UpYHvpsUr7UKSFGfa7R6AQNNTmZqpnu6+rDMKF42NxlHq24oO+mIW2U WtSA== X-Gm-Message-State: AOJu0YzVmbs51OjdnyIlVzmVg7ws/g/bqJs6kG6/LoyP/lXmVZ45lDKH OZwA46s8CIuP3dcDfCDf5CAXf84N5ElEDrKGwFu0NnsKZLkHFpiKzqqNLJKRmRru X-Gm-Gg: AeBDieuaQtDHtV+qqgeONfJMGIsDZdXmuQNvnYKD0lFXJ9cAxO16mQAjnbJEN0+2+/C 2DAobf9C2qskRtCJftbDHeZARWMSQzChVkTqDuxuKL2h1aNGgEzHP08yQiSFE2Nhh2X4Q5TEFZJ hX/eiqOzhvjLyCjpfKRnrhRhAipERnhxcsGv3rygr2b1IS3HLQ4p03GYxIxZygIxuCduV2yW5zl 52m1PF73JQGPwzVXHSSDShiGykQZUGsuRW2HaFRDnR1YxVQt/+a7JzIizDFCaE0shmn6YqRE9LU YhZo+kyo4pOcmE8eMCrEzzf5EIm70Xh6und2r560vNKcmv0nhQm+YwJtXRcn0l/a3nGRQZejCQB qKC3eO1CBGynD31qC+4amuznLTJPjji3sWCxE/e4wsi/THSnKy7Av0dNfqh7OnePEAUebzuXyZo QGuvFmAHdKn5bkc0T2SCdmiloU2EZOgXOT70h7OoptSdrK5HI= X-Received: by 2002:a17:902:ea0e:b0:2b0:445a:8c7b with SMTP id d9443c01a7336-2b9f259e04cmr47779875ad.15.1777772245468; Sat, 02 May 2026 18:37:25 -0700 (PDT) Received: from ehlo.thunderbird.net ([185.153.179.237]) by smtp.gmail.com with ESMTPSA id d9443c01a7336-2b9caaba933sm60130085ad.28.2026.05.02.18.37.24 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Sat, 02 May 2026 18:37:24 -0700 (PDT) Date: Sat, 02 May 2026 18:37:21 -0700 From: Enji Cooper To: dev-commits-src-main@freebsd.org Subject: =?US-ASCII?Q?Re=3A_git=3A_3e845b109056_-_main_-_ping=3A_fix_li?= =?US-ASCII?Q?sting_test_cases_when_scapy_is_not_installed?= User-Agent: Thunderbird for Android In-Reply-To: <865x55yfe7.fsf@ltc.des.dev> References: <69f61649.1c022.73b2a773@gitrepo.freebsd.org> <865x55yfe7.fsf@ltc.des.dev> Message-ID: List-Id: Commit messages for the main branch of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-main List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: dev-commits-src-main@freebsd.org Sender: owner-dev-commits-src-main@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Result: default: False [-0.25 / 15.00]; FORGED_MUA_THUNDERBIRD_MSGID_UNKNOWN(2.50)[]; SUBJ_EXCESS_QP(1.20)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.96)[-0.959]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20251104]; R_SPF_ALLOW(-0.20)[+ip6:2607:f8b0:4864::/56:c]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; FROM_HAS_DN(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2607:f8b0:4864:20::102f:from]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[dev-commits-src-main@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[dev-commits-src-main@freebsd.org]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim] X-Spamd-Bar: / X-Rspamd-Queue-Id: 4g7S7r1qs5z3ZNB On May 2, 2026 8:56:00 AM PDT, "Dag-Erling Sm=C3=B8rgrav" wrote: >Gleb Smirnoff writes: >> I don't think Kyua expects a test program to be able to list the test >> cases, but then fail to run them=2E > >Yes it does=2E We have literally hundreds of cases like that=2E See >require=2E* in atf-test-case(4) for more information=2E > >DES +1 to what asomers and des said=2E If a test fails when listing testcases with a nonzero exit code or if no t= ests are listed when requested, the list operation will be marked broken by= kyua=2E If you really want to go this route with pure pytest, pytest=2Eimportorski= p is the best way to go (generally) as it doesn't completely hide the impor= t issue, but skips one or more testcases or tests suites at whichever level= failed to import the targeted module=2E I don't know if this route would w= ork through with our mutant ATF/pytest integration though; making module-le= vel skipping work would require making pytest a first class citizen like pu= re ATF, TAP, googletest, etc test suites are today [1]=2E Cheers, -Enji 1=2E Doing this isn't hard; it's just tedious and there's already a fairly= large delta between what's in freebsd :main vs kyua :master (it boils down= to me not having the time to resolve some issues with atf :master since st= uff is so tightly coupled in earlier versions=2E I untangled it in later ve= rsions, but the latest release of atf still has "memory leaks" which need r= esolving=2E=2E I might just throw the problem at Claude and see if it comes= up with any reasonable suggestions=2E=2E=2E