From owner-freebsd-hackers@freebsd.org Sat Aug 31 18:55:47 2019 Return-Path: Delivered-To: freebsd-hackers@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 91142D90AE; Sat, 31 Aug 2019 18:55:47 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: from mail-io1-f45.google.com (mail-io1-f45.google.com [209.85.166.45]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) server-signature RSA-PSS (4096 bits) client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "GTS CA 1O1" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 46LQXf4txGz3HfJ; Sat, 31 Aug 2019 18:55:46 +0000 (UTC) (envelope-from carpeddiem@gmail.com) Received: by mail-io1-f45.google.com with SMTP id b10so21038519ioj.2; Sat, 31 Aug 2019 11:55:46 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=3CYs+2ssJzGmNRUbeoLJuS8bh7nRG2o7LCTK6RFQZyM=; b=bOhwMQMEFGsPaEfzGRvMKNtLktHheveFQ76N792lDMksoBV9IpWLooakEBFOUrgQb7 aYjYEdRGzqSI4X0b67kdF+gcFONUNZTB6qfXUzYhJXySakjVJLmSZlqqzRrV6Uzv0cL0 jx+J2QmGEPhkW2PfevSkcTKzNfTGvCJ1hO48VuA6LJ+YGRU1ddM7er0kzvXBjtBx9A8B SAaEiuZ+4ZyGPTgwQ/D8UVzJQjhoJtZzcL4F6iyM+BvW1HvoYDYvRz3hNpD40TmQg8Gx CcnGGsyUZtzkpOM0ouPG6s7IRxc5V/qH1VnA+KIszA9XoP+SGMRO+4Wx80apgIYxMnH7 dJWg== X-Gm-Message-State: APjAAAUDWK5lvMHveCO6PmjH+w8LVZ1bGwXcA4ikSJzHIM0ZgvbLVHGY LwZmEgRVaY8vuRCNHchqu30FoVT3wxoHiPmvZHm/fw== X-Google-Smtp-Source: APXvYqyymnvBEk/A2JM1h+b1SaNbL9HrtJWnBgeyXWCQNI8ov1Xngnd7lCV2WQYBBhB1nuDWwbnFbyU1qrb2yXVLcqM= X-Received: by 2002:a05:6638:73d:: with SMTP id j29mr19655895jad.21.1567277744950; Sat, 31 Aug 2019 11:55:44 -0700 (PDT) MIME-Version: 1.0 References: <20190829114057.GZ71821@kib.kiev.ua> <20190830065534.GC71821@kib.kiev.ua> <73111.1567263258@kaos.jnpr.net> In-Reply-To: From: Ed Maste Date: Sat, 31 Aug 2019 14:55:25 -0400 Message-ID: Subject: Re: FCP 20190401-ci_policy: CI policy To: Warner Losh Cc: FreeBSD Hackers , Li-Wen Hsu , fcp@freebsd.org Content-Type: text/plain; charset="UTF-8" X-Rspamd-Queue-Id: 46LQXf4txGz3HfJ X-Spamd-Bar: ----- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of carpeddiem@gmail.com designates 209.85.166.45 as permitted sender) smtp.mailfrom=carpeddiem@gmail.com X-Spamd-Result: default: False [-5.25 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17:c]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; MIME_TRACE(0.00)[0:+]; DMARC_NA(0.00)[freebsd.org]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_SHORT(-0.99)[-0.991,0]; RCVD_IN_DNSWL_NONE(0.00)[45.166.85.209.list.dnswl.org : 127.0.5.0]; IP_SCORE(-2.26)[ip: (-5.59), ipnet: 209.85.128.0/17(-3.34), asn: 15169(-2.31), country: US(-0.05)]; FORGED_SENDER(0.30)[emaste@freebsd.org,carpeddiem@gmail.com]; R_DKIM_NA(0.00)[]; FREEMAIL_ENVFROM(0.00)[gmail.com]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FROM_NEQ_ENVFROM(0.00)[emaste@freebsd.org,carpeddiem@gmail.com]; RCVD_TLS_ALL(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-hackers@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Technical Discussions relating to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 31 Aug 2019 18:55:47 -0000 On Sat, 31 Aug 2019 at 13:01, Warner Losh wrote: > > (7) Breaking tests is a problem, but our tests need to evolve because we > have too high a rate of false positives. I'm not sure there's consensus on false positives. In particular, Li-Wen has spent an incredible amount of time over more than six months tracking down test failures and submitting PRs. Flaky tests and false positives have generally been addressed by now (by submitting a PR and disabling or xfailing the test).