From nobody Fri Feb 23 08:30:13 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Th39Q6RVMz5C2TQ for ; Fri, 23 Feb 2024 08:30:18 +0000 (UTC) (envelope-from paulf2718@gmail.com) Received: from mail-wr1-x42a.google.com (mail-wr1-x42a.google.com [IPv6:2a00:1450:4864:20::42a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Th39Q0WQ5z4CRT for ; Fri, 23 Feb 2024 08:30:18 +0000 (UTC) (envelope-from paulf2718@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=RAA63UNj; spf=pass (mx1.freebsd.org: domain of paulf2718@gmail.com designates 2a00:1450:4864:20::42a as permitted sender) smtp.mailfrom=paulf2718@gmail.com; dmarc=pass (policy=none) header.from=gmail.com Received: by mail-wr1-x42a.google.com with SMTP id ffacd0b85a97d-33d118a181fso406068f8f.1 for ; Fri, 23 Feb 2024 00:30:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1708677015; x=1709281815; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id:from :to:cc:subject:date:message-id:reply-to; bh=NFN77XElfQ4DhAfwPVPZNd85gXBb4rg3xinNbVQNxWw=; b=RAA63UNjhFS3L4nhs97Yt67haO4RQNxrN8cwqktL+/3VC/UYzI7VONpSP1UgogW7/1 r9GCuR+zQQVd0hmh1UuOD+2s7KFs+b77mC42SZtPMZev/1VlHNl1vj9AykZ45lwqYke7 mP3qDh1xEp7PW6hlomoP6YztFm5PsPyrW7OfFBEs5AiuV5PyHLa1D4CuOfHNvjJMDQfh J58yBfRfSJod+zcfSE6tCQ0fmHZjiehsZW2JEbXzE2w/no/PCk/7woSLYHyl9rVblpx/ jeAwCUYVsABG3Iz/taA7u756S6fwGqUcfgCk+JCL0yZ8eiBo3pw+NQz7SdeZqChRDb21 yZFg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708677015; x=1709281815; h=content-transfer-encoding:in-reply-to:from:content-language :references:to:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=NFN77XElfQ4DhAfwPVPZNd85gXBb4rg3xinNbVQNxWw=; b=tsyhCdAobzVJTTWwPe6iCQ2Sizkt1T/zJUvXCLrkU0qoIQn/uLRvlQCxnRXttKhhih U6jrbVnt2xb3XiJ62M4se3qroSm9N5Km+zt05kIGLPUGBe9p1WPbiF0sYBqiEVaj8TnH ctcOrdHQLwuTRFq371Wcr5//Wq9xGULYjCNAGRcBjdevzH3g4QX9KKbRcubO5k3SPJFR WB0zOOjoqpv/goOrhbc8fECsb3C7AhJmAgWwSbUpRd+QARTskmswLFSIHnUjhMvfPWYD 1KWd40jQkP2SWPY4ZQylGky4XSMDPIipbCC2PNxQVyY1mPaJ8ZNrCZ91aorFK9w4cYcf yzGg== X-Gm-Message-State: AOJu0Yzf4hQceG4lXMqJacOWAQmtV3mZ+ZbD8/O7TygXSFRag45CsU/p FzKUWzV6IBwyqWH0Vkuhi/2cERxuJCrAwmuiCIeVoZMJLboemLqwehi+ewIL X-Google-Smtp-Source: AGHT+IHpFpI+laUjG8zgKNh2xIs4+C4fwqvWBv3my0KNe1Cmnr+j7AGdelN9bFe1vFS1V+kqFoLErg== X-Received: by 2002:adf:face:0:b0:33d:3abc:8a4a with SMTP id a14-20020adfface000000b0033d3abc8a4amr981475wrs.62.1708677015160; Fri, 23 Feb 2024 00:30:15 -0800 (PST) Received: from ?IPV6:2a01:cb15:8010:2f00:1aa9:5ff:fe16:2efb? ([2a01:cb15:8010:2f00:1aa9:5ff:fe16:2efb]) by smtp.gmail.com with ESMTPSA id by4-20020a056000098400b0033daa63807fsm1325944wrb.24.2024.02.23.00.30.14 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 23 Feb 2024 00:30:14 -0800 (PST) Message-ID: <188b3537-11b1-4169-aae2-070d349b6016@gmail.com> Date: Fri, 23 Feb 2024 09:30:13 +0100 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Add jail execution environment support to the FreeBSD test suite To: freebsd-hackers@freebsd.org References: <2bjQNp1msrv-_AqyamMun6kY-SCqbgPm3Q7DqVQHAYlqvFkiE1i85svfIT-QQdUG1cg3cKippyTyv8Z-5nbLu4WaMutgZQ7KT-YYo_5Pbro=@pm.me> Content-Language: en-US From: Paul Floyd In-Reply-To: <2bjQNp1msrv-_AqyamMun6kY-SCqbgPm3Q7DqVQHAYlqvFkiE1i85svfIT-QQdUG1cg3cKippyTyv8Z-5nbLu4WaMutgZQ7KT-YYo_5Pbro=@pm.me> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 4Th39Q0WQ5z4CRT X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.46 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; NEURAL_HAM_SHORT(-0.47)[-0.470]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::42a:from] On 22-02-24 21:57, igor.ostapenko@pm.me wrote: > Hi FreeBSD developers, > > There is a proposal to improve the FreeBSD test suite. > I hope that this proposal is found valuable for the project. If so, any help > is appreciated. Hi Will there be an option to turn this off globally? I sometimes run test suits with Valgrind. I'm not aware of any option to do that cleanly so I just do it with brute force: run kyua and all children under Valgrind. valgrind --trace-children=yes -q kyua test -k Kyuafile Adding jails into the mix is likely to give worse results. I did try using an x86 jail as an alternative to VirtualBox but I gave up as I got too many test failures. A+ Paul