Date: Sat, 31 Aug 2019 13:09:38 -0600 From: Warner Losh <imp@bsdimp.com> To: Ed Maste <emaste@freebsd.org> Cc: FreeBSD Hackers <freebsd-hackers@freebsd.org>, Li-Wen Hsu <lwhsu@freebsd.org>, fcp@freebsd.org Subject: Re: FCP 20190401-ci_policy: CI policy Message-ID: <CANCZdfoWAuSCKqFwWsnXTmznyuazHfy0tAfgZEv1m92MeSHAEg@mail.gmail.com> In-Reply-To: <CAPyFy2CdddbDZYNod1ze1Z2iMyggSPP5kQV6ePeKSRQntezZEQ@mail.gmail.com> References: <CAKBkRUwKKPKwRvUs00ja0%2BG9vCBB1pKhv6zBS-F-hb=pqMzSxQ@mail.gmail.com> <20190829114057.GZ71821@kib.kiev.ua> <CAPyFy2BNrFfZ1PHaLesW%2Bu7YmbhC7mtiZ%2BBsYrqYE0J7KdagaA@mail.gmail.com> <20190830065534.GC71821@kib.kiev.ua> <CAPyFy2CXVMEXZx0u9b0p_CVaD_gu8Gyzvud3KwEDciq83a2_8A@mail.gmail.com> <73111.1567263258@kaos.jnpr.net> <CANCZdfqJzpxj7-P7XN7GEsECEA%2BLaUq6yQJ98OQUp_gXX9FF9Q@mail.gmail.com> <CAPyFy2CdddbDZYNod1ze1Z2iMyggSPP5kQV6ePeKSRQntezZEQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
On Sat, Aug 31, 2019, 12:55 PM Ed Maste <emaste@freebsd.org> wrote: > On Sat, 31 Aug 2019 at 13:01, Warner Losh <imp@bsdimp.com> wrote: > > > > (7) Breaking tests is a problem, but our tests need to evolve because we > > have too high a rate of false positives. > > I'm not sure there's consensus on false positives. In particular, > Li-Wen has spent an incredible amount of time over more than six > months tracking down test failures and submitting PRs. Flaky tests and > false positives have generally been addressed by now (by submitting a > PR and disabling or xfailing the test). > Fair enough. Do we have recent data that can distinguish between false positives or bad perception? Warner >
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CANCZdfoWAuSCKqFwWsnXTmznyuazHfy0tAfgZEv1m92MeSHAEg>