From nobody Fri Feb 23 17:57:12 2024 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4ThHlc655Sz5BCF0 for ; Fri, 23 Feb 2024 17:57:16 +0000 (UTC) (envelope-from paulf2718@gmail.com) Received: from mail-wm1-x336.google.com (mail-wm1-x336.google.com [IPv6:2a00:1450:4864:20::336]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1D4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4ThHlc074Qz4nPc for ; Fri, 23 Feb 2024 17:57:16 +0000 (UTC) (envelope-from paulf2718@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=U8e1TSIm; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of paulf2718@gmail.com designates 2a00:1450:4864:20::336 as permitted sender) smtp.mailfrom=paulf2718@gmail.com Received: by mail-wm1-x336.google.com with SMTP id 5b1f17b1804b1-412985ba473so1381625e9.3 for ; Fri, 23 Feb 2024 09:57:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1708711033; x=1709315833; darn=freebsd.org; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :from:to:cc:subject:date:message-id:reply-to; bh=WG9RRwkkcM9McB3M72PX8TLrFyFyGS9JfV5PEcqB0s4=; b=U8e1TSIm9L/zt4XdGDLZsq/W+nUYHHLV7nxIp3j1rGkyxSPGrz/R8mc8v1RCC+WEIq S0RFZbEkAjdSSWkFqRZZBsYubF6gKjdupOBXppDpmgyzUOJrH5N49DdF5l1T4vUgcof8 A643di3TaQ0e9tLXZf3WjFTu+2oj+TvRHC2IDdhx4qrKzbYFzkqBgkiCmvQs294uie5A SPzzpPHPDr7/2thKaw2wF/jFoJIMfx0hNdVOr32mi1s1O0Cian/g3j0PGzwkd7ApjmGu nffUHHwHSHSQsPNhAM9KA7zD9H4Wo+m1yf7W9rFdVHsVH84PnD/nietEbYzoY0B1eEuv wsMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1708711033; x=1709315833; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=WG9RRwkkcM9McB3M72PX8TLrFyFyGS9JfV5PEcqB0s4=; b=AdBc//Hslt5T+HHVWNc01os7qPNuy2uy6zWvkTwkKDkiY8Zx8c5YE7odtTvQ1mjiDA XwA6SaO/sTqCtmZHAEoB11qGCyH6rmSzilgAUcSLDT8OgZAVMpThDffPlxl5YkCEQkAw rhROgbMR2xkdHGHrOUtrnLMelQUZQzPcPiUC6bGJLmyhslEaNphG7esJ3kKgQDUdhPO5 xBqiA3l2jasXDQGl3fjNHn2NtCWq/PjJc/t+Z4MKBpgw1RxGutCd8MMVFM0dCGu10WAV wlPvZE7D8KG91adkA85hk3qLJlfT/lou1mKdYSCXC8hTfORNssbNPlKgM6suP06li7dW wiAg== X-Gm-Message-State: AOJu0YxGbHKuyhbuEj6AYCadUFDNNrqlsoQi6g3HN8NyRl7nwDvOxlDT gxTcbdwJfRZKv8Ny0KZXP88bUkMJ4DTIxwKmyDBUftMN7axATZSl1/n8fXC2 X-Google-Smtp-Source: AGHT+IG9u6H8oPgLvXH+nbU0svq6BUoxPTwr+6K6Vm5qElR+D5y+OuH1G/xr5zsZd0zStQZX5UM9AA== X-Received: by 2002:a05:600c:1d07:b0:412:6015:3dc5 with SMTP id l7-20020a05600c1d0700b0041260153dc5mr314032wms.14.1708711033407; Fri, 23 Feb 2024 09:57:13 -0800 (PST) Received: from ?IPV6:2a01:cb15:8010:2f00:1aa9:5ff:fe16:2efb? ([2a01:cb15:8010:2f00:1aa9:5ff:fe16:2efb]) by smtp.gmail.com with ESMTPSA id h6-20020a05600c314600b00411d3a414c6sm3191436wmo.47.2024.02.23.09.57.12 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 23 Feb 2024 09:57:13 -0800 (PST) Message-ID: Date: Fri, 23 Feb 2024 18:57:12 +0100 List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Add jail execution environment support to the FreeBSD test suite Content-Language: en-US To: freebsd-hackers@freebsd.org References: <2bjQNp1msrv-_AqyamMun6kY-SCqbgPm3Q7DqVQHAYlqvFkiE1i85svfIT-QQdUG1cg3cKippyTyv8Z-5nbLu4WaMutgZQ7KT-YYo_5Pbro=@pm.me> <188b3537-11b1-4169-aae2-070d349b6016@gmail.com> <5XGsuxCWojiK7f1wBuoC73PWMtjVB3oCvsy1vHQtNr5UHC_2LN8zNGczKwpQEs4Pcc8g1G3Rir4uIrQ9iUxKbWmonsEu5f_mHzldy4vuYk4=@pm.me> From: Paul Floyd In-Reply-To: <5XGsuxCWojiK7f1wBuoC73PWMtjVB3oCvsy1vHQtNr5UHC_2LN8zNGczKwpQEs4Pcc8g1G3Rir4uIrQ9iUxKbWmonsEu5f_mHzldy4vuYk4=@pm.me> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.99 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FREEMAIL_FROM(0.00)[gmail.com]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; TO_DN_NONE(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-hackers@freebsd.org]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::336:from] X-Rspamd-Queue-Id: 4ThHlc074Qz4nPc On 23-02-24 16:08, Igor Ostapenko wrote: > On Friday, February 23rd, 2024 at 10:30 AM, Paul Floyd wrote: >> >> Will there be an option to turn this off globally? >> >> I sometimes run test suits with Valgrind. I'm not aware of any option to >> do that cleanly so I just do it with brute force: run kyua and all >> children under Valgrind. >> >> valgrind --trace-children=yes -q kyua test -k Kyuafile >> >> Adding jails into the mix is likely to give worse results. I did try >> using an x86 jail as an alternative to VirtualBox but I gave up as I got >> too many test failures. >> > > Thanks for your attention and mention of your use case. > > I've added this point to my TODO. I guess it could look as the following: > > valgrind --trace-children=yes -q kyua -v execenv=host test -k Kyuafile Sounds good, but I'd need to test in order to make sure. I don't run that kind of test very often. > > Does it look like something that would cover your production needs? It's not to test FreeBSD for prod, it's to test Valgrind is working with all those tests (any FreeBSD errors picked up are a bonus). A+ Paul