From nobody Tue Jan 17 06:38:56 2023 X-Original-To: dev-ci@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Nwzkl1GmDz2pR4x for ; Tue, 17 Jan 2023 06:39:11 +0000 (UTC) (envelope-from gshapiro@freebsd.org) Received: from zim.gshapiro.net (zim.gshapiro.net [IPv6:2001:bc8:2e97:100::100]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.gshapiro.net", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Nwzkk5dzKz3Gjm; Tue, 17 Jan 2023 06:39:10 +0000 (UTC) (envelope-from gshapiro@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from thornystick.local ([98.51.131.164]) (authenticated bits=0) by zim.gshapiro.net (8.17.0.4/8.17.1) with ESMTPSA id 30H6cuvI068123 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Tue, 17 Jan 2023 06:39:00 GMT Date: Mon, 16 Jan 2023 22:38:56 -0800 From: Gregory Shapiro To: jenkins-admin@freebsd.org Cc: dev-ci@freebsd.org Subject: Re: FreeBSD-main-amd64-test - Build #22804 - Still Unstable Message-ID: <20230117063856.ykolmuxguoa6bgwj@thornystick.local> References: <25215041.7867.1673929037302@jenkins.ci.freebsd.org> <674569943.7871.1673934544369@jenkins.ci.freebsd.org> List-Id: Continuous Integration Build and Test Results List-Archive: https://lists.freebsd.org/archives/dev-ci List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-dev-ci@freebsd.org X-BeenThere: dev-ci@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <674569943.7871.1673934544369@jenkins.ci.freebsd.org> X-Rspamd-Queue-Id: 4Nwzkk5dzKz3Gjm X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:12876, ipnet:2001:bc8::/32, country:FR] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N These same 6 tests have been failing for a while now and are completely unrelated to my changes. It looks like Jenkins is mailing committers on each build for these same 6 tests -- can these tests be disabled or fixed to stop the false positives? On Tue, Jan 17, 2023 at 05:49:03AM +0000, jenkins-admin@FreeBSD.org wrote: > FreeBSD-main-amd64-test - Build #22804 (f97a19ecb98541455c6c940f4bab2dc7dc425468) - Still Unstable > > Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/ > Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/changes > Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/22804/console > > Status explanation: > "Unstable" - some tests are suspected being broken by the following changes > "Still Unstable" - the failing test cases have not been fixed by these > following changes and this is a notification to note that > these changes have not been fully tested by the CI system > > Change summaries: > (Those commits are likely but not certainly responsible) > > 0694dcb04b81dfbd70ffe7384816863170a48b3e by gshapiro: > Bring in fix from upstream that allows libsm to compile against FreeBSD > > 28fbd2825d216dafca4d991ad96d05b312f4f9a3 by gshapiro: > Import sendmail 8.17.1 > > d89513ed20502ddb320474a721d872ef32b31402 by gshapiro: > Update for new library files in sendmail 8.17.1 > > 3413ee88c39dbfedfa7d00db536a8e8dc073a562 by gshapiro: > Add -DSTARTTLS CFLAG in order to enable DANE in sendmail builds > > f97a19ecb98541455c6c940f4bab2dc7dc425468 by gshapiro: > sendmail 8.17.1 included this fix, though in a different location so > > > > The failed test cases: > > 6 tests failed. > FAILED: lib.libc.time.mktime_test.timegm_epoch > > Error Message: > /usr/src/contrib/netbsd-tests/lib/libc/time/t_mktime.c:98: Expected errno 0, got 84, in t == (time_t)0 > > FAILED: sys.net.if_tun_test.235704 > > Error Message: > atf-check failed; see the output of the test for details > > FAILED: usr.sbin.etcupdate.preworld_test.main > > Error Message: > Returned non-success exit status 1 > > FAILED: sys.aio.aio_test.aio_socket_blocking_short_write > > Error Message: > Test case body timed out > > FAILED: sys.aio.aio_test.aio_socket_blocking_short_write_vectored > > Error Message: > Test case body timed out > > FAILED: sys.aio.aio_test.aio_socket_short_write_cancel > > Error Message: > /usr/src/tests/sys/aio/aio_test.c:1396: aio_error(&iocb) == EINPROGRESS not met