From nobody Fri Mar 31 00:05:59 2023 X-Original-To: dev-commits-src-all@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4PngYR64zRz42ZBK; Fri, 31 Mar 2023 00:06:03 +0000 (UTC) (envelope-from markjdb@gmail.com) Received: from mail-yw1-x112e.google.com (mail-yw1-x112e.google.com [IPv6:2607:f8b0:4864:20::112e]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4PngYR3CNwz3F6Q; Fri, 31 Mar 2023 00:06:03 +0000 (UTC) (envelope-from markjdb@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112e.google.com with SMTP id 00721157ae682-544f7c176easo385569307b3.9; Thu, 30 Mar 2023 17:06:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; t=1680221162; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :from:to:cc:subject:date:message-id:reply-to; bh=icJJxEJBQNygIwihlq+XiG1IFGlTXZcTzrAf4SPxpME=; b=oZwdkdasJqExgaleyUMoz/GLpHXxvK4Qop0o+g50HTDlMztR2mtZTRq6wv7xS7MiVm x4Vv02jBUOjwJQVKN2kq8qFeS2Bul0S9UWXskQ/QqV68RvAL+f0xZ+g9JbeG71vozeE7 T3RYOtAaWJ5lqKcIIe7je/NYqWt6AVGHiCwcFUB45qJEn4fIdtI9/hIuiRCR5aufoFPz 87K89WVotMvlrVOZs1Tt6gyorAK0JILXr9rVoZUKLXIACzryPOxahyIHlaMjh2xHAuF0 TXa3I7vJgOBQ730zorpw4IhxI0GUROU/BJtliCiFxoBronGRXp2B025SP1o5okYa1Kw6 AqGw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; t=1680221162; h=in-reply-to:content-transfer-encoding:content-disposition :mime-version:references:message-id:subject:cc:to:from:date:sender :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=icJJxEJBQNygIwihlq+XiG1IFGlTXZcTzrAf4SPxpME=; b=fSS+c1ccCtrFOTg3djArFs2WFtXMiFM+pEwffmDC3+jPp1NhL8e9XR4zZ5+5ZIiQ02 RdnVOCQE/LzKkwHcjoFLYjnHu0TNFm7OKY5imvXWkr54t1+58kgtYFESNKb6mSLZgLH4 zHB9O1q2E7/3jPw1TI/snrVYUaTfFKUlihVz/MEKjGKwU+PwUgiAQnG58TVWY9GIWPqk lQ2Za85NVv/vuqMPvPGzF30gvvSRRryu0m6pl1+zytb4Pw60aeWxFz/hKmtkoQSFgt3k mwjNNdUBv7HnoOWm1WRvMSuyOjFFt3gOjPMscLHKRVQyR8xAY7mZyoHH6F9u2+c8kjf3 iThA== X-Gm-Message-State: AAQBX9d5IWUz+AxxuXBLw/uem9UrRRm4k4UqfsR39x09IUF/WMyf8zAx hriUQ0jiaFb4IxPtFjDgyKdMsl4LNao= X-Google-Smtp-Source: AKy350YMvucRLyenkBEegUeSgG0fqLm6pZVlOBKdJHyEK3+YVrzd2x8zz7Qq/pJBG+fuYcM8lsCTcg== X-Received: by 2002:a81:fd12:0:b0:533:9fa7:bbe9 with SMTP id g18-20020a81fd12000000b005339fa7bbe9mr24975886ywn.8.1680221162037; Thu, 30 Mar 2023 17:06:02 -0700 (PDT) Received: from nuc (192-0-220-237.cpe.teksavvy.com. [192.0.220.237]) by smtp.gmail.com with ESMTPSA id 125-20020a810d83000000b00545a08184c9sm169090ywn.89.2023.03.30.17.06.01 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Thu, 30 Mar 2023 17:06:01 -0700 (PDT) Date: Thu, 30 Mar 2023 20:05:59 -0400 From: Mark Johnston To: Kristof Provost Cc: src-committers@freebsd.org, dev-commits-src-all@freebsd.org, dev-commits-src-main@freebsd.org Subject: Re: git: b60600ceeb68 - main - pf tests: Serialize Message-ID: References: <202303302336.32UNatba067594@gitrepo.freebsd.org> <3A26AB82-357F-421F-853E-07320387ACBE@FreeBSD.org> List-Id: Commit messages for all branches of the src repository List-Archive: https://lists.freebsd.org/archives/dev-commits-src-all List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-commits-src-all@freebsd.org X-BeenThere: dev-commits-src-all@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <3A26AB82-357F-421F-853E-07320387ACBE@FreeBSD.org> X-Rspamd-Queue-Id: 4PngYR3CNwz3F6Q X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On Fri, Mar 31, 2023 at 08:56:56AM +0900, Kristof Provost wrote: > On 31 Mar 2023, at 8:36, Mark Johnston wrote: > > The branch main has been updated by markj: > > > > URL: https://cgit.FreeBSD.org/src/commit/?id=b60600ceeb68d1001d61222830e0be3441ef0885 > > > > commit b60600ceeb68d1001d61222830e0be3441ef0885 > > Author: Mark Johnston > > AuthorDate: 2023-03-25 12:55:41 +0000 > > Commit: Mark Johnston > > CommitDate: 2023-03-30 23:35:59 +0000 > > > > pf tests: Serialize > > > > These tests reuse jail names and cannot run in parallel. Until this is > > fixed - which is desirable since these takes take a while to run - tell > > kyua to serialize them. > > > > The tests also recycle IP ranges, so merely changing the jail names is insufficient. Could you please give an example? I looked at some of the tests but can only see cases where addresses are assigned within the vnet jail(s) created by the tests, in which case I'd expect no problems. > Realistically the easiest way to get these to run in parallel would be to run each test in its own vnet so both overlapping IP ranges and name conflicts don’t matter. Yeah, I was wondering whether it'd be possible to have kyua handle the creation and teardown of a per-test jail, if only to avoid having to go through all of the tests which use static jail names. Though at the moment I'm more focused on getting the test suite to run cleanly with parallelism enabled before I try to make it run faster.