From owner-freebsd-hackers@freebsd.org Wed Mar 18 02:19:30 2020 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 54C1E279C2C for ; Wed, 18 Mar 2020 02:19:30 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mailman.nyi.freebsd.org (unknown [127.0.1.3]) by mx1.freebsd.org (Postfix) with ESMTP id 48htyn75Trz4WSP for ; Wed, 18 Mar 2020 02:19:29 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id EEB86279C2B; Wed, 18 Mar 2020 02:19:29 +0000 (UTC) Delivered-To: hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id EE79F279C2A for ; Wed, 18 Mar 2020 02:19:29 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 48htyn3mJZz4WRD; Wed, 18 Mar 2020 02:19:29 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: from mail-qt1-f176.google.com (mail-qt1-f176.google.com [209.85.160.176]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) (Authenticated sender: kevans) by smtp.freebsd.org (Postfix) with ESMTPSA id 3688164FB; Wed, 18 Mar 2020 02:19:29 +0000 (UTC) (envelope-from kevans@freebsd.org) Received: by mail-qt1-f176.google.com with SMTP id h16so19450280qtr.11; Tue, 17 Mar 2020 19:19:29 -0700 (PDT) X-Gm-Message-State: ANhLgQ0iTYMt9vzY1YqbduEME21BW1URU2IZvFXhP0ReWq8q25wXMob/ E09FDximAQ1OLvdbiffzSY8ozUZiFRV4NzEKABs= X-Google-Smtp-Source: ADFU+vvWwXhf0ClRrtBSVpr/6iLsbfBu8/xrSKl0xFPHOuhOBZkJESaNTFor68rIbp/baApKsMlQFlrARa/KJKEczgA= X-Received: by 2002:ac8:564e:: with SMTP id 14mr2290250qtt.53.1584497968590; Tue, 17 Mar 2020 19:19:28 -0700 (PDT) MIME-Version: 1.0 References: <20200317164829.GB83983@spindle.one-eyed-alien.net> <0963a2f8e3cfad5639264e694e56e28d@udns.ultimatedns.net> In-Reply-To: <0963a2f8e3cfad5639264e694e56e28d@udns.ultimatedns.net> From: Kyle Evans Date: Tue, 17 Mar 2020 21:19:17 -0500 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: HEADS UP: importing kyua into the base system To: bsd-lists@bsdforge.com Cc: Brooks Davis , hackers@freebsd.org Content-Type: text/plain; charset="UTF-8" X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 18 Mar 2020 02:19:30 -0000 On Tue, Mar 17, 2020 at 9:14 PM Chris wrote: > > On Tue, 17 Mar 2020 16:48:29 +0000 Brooks Davis brooks@freebsd.org said > > > I'll be importing kyua and it's dependency lutok into the base system > > this week. Integrating it into the FreeBSD build system will make it > > available by default which is especially valuable on emerging > > architectures were we aren't building packages yet (e.g. riscv). > > > From the wiki (https://github.com/jmmv/kyua/wiki/About) > > Use cases: New system installation: > ... > When setting up a new server with brand-new hardware, it's very desirable > to ensure a minimum stability of the operating system that runs on top and > how it interacts with the hardware. > erm... *minimum* stability of the operating system?! > If this is as mistaken as it appears. Someone(tm) might want to run kyua > against the wiki. ;) > I believe the point it's trying to make it is that tests aren't all-inclusive; they will miss things or induce little stress, but they're a great smoketest to rule out most of the basic issues. You can't really make much stronger claims than this about the stability of the system based on running a test suite, unless we're talking stress2 style suites.