From owner-freebsd-stable@freebsd.org Tue Jun 18 14:28:10 2019 Return-Path: Delivered-To: freebsd-stable@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 1838615BE6A4 for ; Tue, 18 Jun 2019 14:28:10 +0000 (UTC) (envelope-from asomers@gmail.com) Received: from mail-lj1-f195.google.com (mail-lj1-f195.google.com [209.85.208.195]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 0427977B19 for ; Tue, 18 Jun 2019 14:28:08 +0000 (UTC) (envelope-from asomers@gmail.com) Received: by mail-lj1-f195.google.com with SMTP id i21so13372449ljj.3 for ; Tue, 18 Jun 2019 07:28:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=sfTMdOaVtRztWUZdcquhRKeqiAnAZrjrwwi4oCx/d9c=; b=Z9cL+ddoHdKha4fcLopTTY8HNqpQLMOn17Bdr/I+nUrXjW1XXq/ehOqZrHImwUU0ZK 2GMRLuXIFzsneGd43X6OYHFkjHp21K01QBeeaX1+TYYRsfYMHNAe1IrCPix0lTD22X7f GGlIerH5LHDJovbxCBOurqFOSw+qoMxsR6nutHaeY+DaUFWJH9VNPUM3NbZ6jHfK17+G nzN9z0qu1BsR8d8i7jT5zhVLztC/0l49KSNQJS9uZynLt53ptb7/GsF3WlQRfH0OJKrq UxAV7k7bRrek05IVB32FrYUQmiami6e/qt4B+YX/PboYSbdKfVQMmCYT2oMlnSaNVFh0 8i3w== X-Gm-Message-State: APjAAAWEwjQXNKCdzq1JIUd1ZaiEyjBQo73+Gz5/mhNHI2wr3t9D2g9Y REKYvzZo/NVa2qmVKmbgElTyI4wRBXPX5Z+p1/rS7g== X-Google-Smtp-Source: APXvYqxfM6JA3Fs+x/W1tKd658qrXMwULP9uKMbguQNmHG0fWRMAkTinLUchznvNcHxYYhaztaPYdxBsP/A8BEgLxUc= X-Received: by 2002:a2e:6e0c:: with SMTP id j12mr40195440ljc.123.1560866682154; Tue, 18 Jun 2019 07:04:42 -0700 (PDT) MIME-Version: 1.0 References: In-Reply-To: From: Alan Somers Date: Tue, 18 Jun 2019 08:04:30 -0600 Message-ID: Subject: Re: Failing tests To: Lorenzo Salvadore Cc: "freebsd-stable@freebsd.org" Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 0427977B19 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of asomers@gmail.com designates 209.85.208.195 as permitted sender) smtp.mailfrom=asomers@gmail.com X-Spamd-Result: default: False [-4.23 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-stable@freebsd.org]; DMARC_NA(0.00)[freebsd.org]; MIME_TRACE(0.00)[0:+]; TO_MATCH_ENVRCPT_SOME(0.00)[]; MX_GOOD(-0.01)[cached: alt3.gmail-smtp-in.l.google.com]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[195.208.85.209.list.dnswl.org : 127.0.5.0]; NEURAL_HAM_SHORT(-0.99)[-0.987,0]; RCVD_TLS_LAST(0.00)[]; FORGED_SENDER(0.30)[asomers@freebsd.org,asomers@gmail.com]; RWL_MAILSPIKE_POSSIBLE(0.00)[195.208.85.209.rep.mailspike.net : 127.0.0.17]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[asomers@freebsd.org,asomers@gmail.com]; IP_SCORE(-1.23)[ip: (-0.34), ipnet: 209.85.128.0/17(-3.44), asn: 15169(-2.32), country: US(-0.06)]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 18 Jun 2019 14:28:10 -0000 On Tue, Jun 18, 2019 at 4:46 AM Lorenzo Salvadore via freebsd-stable wrote: > > Hello. > > I run 12.0-STABLE r349104 and I tried to run the tests suit in /usr/tests. > I got plenty of tests failing. > Here is the output of "kyua report": http://termbin.com/r3tid > > I guess this information could also be helpful: > - the custom kernel I am running: http://termbin.com/73cw2 > - my make.conf: http://termbin.com/wixu > - my src.conf: http://termbin.com/8787 > > I guess someone could be surprised that I define MACHINE_CPU in my > make.conf. I do not think it has anything to do with the tests, but if > someone needs to know why I do that, I wrote a wiki article about it: > https://wiki.freebsd.org/LorenzoSalvadore/CPUTYPE > > Let me know if I can help by giving more information. > > Thanks. > > Lorenzo Salvadore. Looks like you found some tests that weren't properly feature gated. The sys/aio test failures, for example, happened because your kernel doesn't include md(4). The sys/audit tests failed because your kernel doesn't include audit(4) etc. All tests are supposed to check that their required features are present, but you found some that didn't. If you want to help, you can try repeating your experiment using the MINIMAL kernel, which should have most of the same failures. Then open a PR and assign to freebsd-testing. Thanks for your QA -Alan