From nobody Wed Apr 8 15:23:22 2026 X-Original-To: dev-ci@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4frRfM398Nz6YJCR for ; Wed, 08 Apr 2026 15:23:23 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R12" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4frRfM01ryz42k3; Wed, 08 Apr 2026 15:23:23 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1775661803; a=rsa-sha256; cv=none; b=M53NyYkYaqqR8YadCtmk3y3OAM68zgPBqPyBOmH8gdaUvdZkEKMT9Bm89jpKNQlgFCdSi3 dAWhiwQbSqopnrv7Q5w8nryWuBjAi4o2oPBjd4+dSiF7raxJvjCJiPf4Q9sCdVso6LmrAE rXx5GqargJvNd18xgsDgKPiqFFg57NHtIYdpaSP+dCyZizEvqY5WB1AC+gADQb1mg2w+4I k6IYta0zPI9zicVitdW+b/XJtYFkbr1oYULvFMpQIcjt1kDwLPqeIiWn0Yu6DT3Uh91yJg 7yzVVCRbqezq5yzFbiF+RPOfcqxwjekHlsZdy6xdEu+rKLp91FAjwIJFXXukZA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1775661803; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:list-id; bh=YdYmpImXMQ67aPNer+S1JnYLxy1KYdxMC3LTCfRBotw=; b=VXcVqqbbKfIWYAim6czV/nK9BjpF3vZGz8e/jb+q/3do3ZmLkTRdG3os+tta2R+NEDDRtP nQ7l3VuOzFgITWfnjMvX4cCVFtcEH5dyyEyYr668sB72j46aCUMyC2en0yANoMFAhP4GJZ g48GHxyaAtnr1mOKuq2X8/PefzMkdnKCPBD4HSCH6ezDEvmr9SHVWxstNRltD9eXzMOtd8 XkM5t3PeaNOw8uIkG90E8D0NrZJ3yJOwPw2e/isTW2ossbgupMCB0CX1wSHKrOM17DZ0/u 5z1Pt+p9JFDvBk7ZrVBRnuPAZTNu8DKIUtT/8ZnMXnxqows5ob6ZPQDzTC6Kvw== Received: from jenkins.ci.freebsd.org (jenkins.ci.freebsd.org [IPv6:2610:1c1:1:607c::16:16]) by mxrelay.nyi.freebsd.org (Postfix) with ESMTP id 4frRfL6cgQzY7P; Wed, 08 Apr 2026 15:23:22 +0000 (UTC) (envelope-from jenkins-admin@FreeBSD.org) Date: Wed, 8 Apr 2026 15:23:22 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: bnovkov@FreeBSD.org, dev-ci@FreeBSD.org Cc: jenkins-admin@FreeBSD.org Message-ID: <263984972.75.1775661802934@jenkins.ci.freebsd.org> In-Reply-To: <70009382.47.1775640264483@jenkins.ci.freebsd.org> References: <70009382.47.1775640264483@jenkins.ci.freebsd.org> Subject: FreeBSD-main-amd64-test - Build #28202 - Failure List-Id: Continuous Integration Build and Test Results List-Archive: https://lists.freebsd.org/archives/dev-ci List-Help: List-Post: List-Subscribe: List-Unsubscribe: X-BeenThere: dev-ci@freebsd.org Sender: owner-dev-ci@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_74_998874607.1775661802753" X-Jenkins-Job: FreeBSD-main-amd64-test X-Jenkins-Result: FAILURE List-ID: FreeBSD CI Build Notifications Precedence: bulk ------=_Part_74_998874607.1775661802753 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable FreeBSD-main-amd64-test - Build #28202 (cff675e83cdb6c9027e94df9d010439e42e= 27dee) - Failure Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202= / Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202/c= hanges Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28202/co= nsole Status explanation: "Failure" - the build is suspected being broken by the following changes "Still Failing" - the build has not been fixed by the following changes and this is a notification to note that these changes have not been fully tested by the CI system Change summaries: (Those commits are likely but not certainly responsible) cff675e83cdb6c9027e94df9d010439e42e27dee by bnovkov: netstat: Add -F support for -g The end of the build log: [...truncated 4.32 MiB...] "in6_multi_list_mtx" -> "mld_mtx" -> "if_ovpn_lock" -> "so_rcv" -> "tcphash= " -> "in6_ifaddr_lock" -> "lle" hardcoded lock order "in6_multi_list_mtx"(sleep mutex) -> "mld_mtx"(sleep m= utex) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff80e30ed1 at mld_change_state+0x81 #3 0xffffffff80e1d8de at in6_joingroup_locked+0x3ae #4 0xffffffff80e1d504 at in6_joingroup+0x44 #5 0xffffffff80e14d4a at in6_update_ifa+0x102a #6 0xffffffff80e1af62 at in6_ifattach+0x132 #7 0xffffffff80e16c2f at in6_if_up+0x7f #8 0xffffffff80d171f6 at if_up+0xd6 #9 0xffffffff80d184d6 at ifhwioctl+0xdc6 #10 0xffffffff80d1992b at ifioctl+0x45b #11 0xffffffff80c51b81 at kern_ioctl+0x2a1 #12 0xffffffff80c5187f at sys_ioctl+0x12f #13 0xffffffff81132729 at amd64_syscall+0x169 #14 0xffffffff8110146b at fast_syscall_common+0xf8 lock order "mld_mtx"(sleep mutex) -> "if_ovpn_lock"(rm) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80bc9a49 at _rm_rlock_debug+0x129 #2 0xffffffff82ee9e37 at ovpn_output+0x57 #3 0xffffffff80e2ceb5 at ip6_output+0x19c5 #4 0xffffffff80e33175 at mld_dispatch_packet+0x325 #5 0xffffffff80e33c90 at mld_fasttimo+0x520 #6 0xffffffff80beeb1b at softclock_call_cc+0x19b #7 0xffffffff80bf0256 at softclock_thread+0xc6 #8 0xffffffff80b80112 at fork_exit+0x82 #9 0xffffffff81101b9e at fork_trampoline+0xe lock order "if_ovpn_lock"(rm) -> "so_snd"(sleep mutex) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff82eed67e at ovpn_peer_release_ref+0x20e #3 0xffffffff82ee9b32 at ovpn_clone_destroy+0x92 #4 0xffffffff80d1e2f9 at if_clone_destroyif_flags+0x69 #5 0xffffffff80d1ebe6 at if_clone_detach+0xe6 #6 0xffffffff82eef665 at ovpn_prison_remove+0x55 #7 0xffffffff80bacf32 at osd_call+0xb2 #8 0xffffffff80b8a14c at prison_deref+0x5dc #9 0xffffffff80b8bc47 at sys_jail_remove+0x1a7 #10 0xffffffff81132a11 at amd64_syscall+0x451 #11 0xffffffff8110146b at fast_syscall_common+0xf8 hardcoded lock order "so_snd"(sleep mutex) -> "so_rcv"(sleep mutex) first s= een at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff80c86def at soreserve+0x5f #3 0xffffffff80e46535 at udp6_attach+0x75 #4 0xffffffff80c8a0c8 at soattach+0xf8 #5 0xffffffff80c8997c at socreate+0x19c #6 0xffffffff80c9399e at kern_socket+0xbe #7 0xffffffff81132729 at amd64_syscall+0x169 #8 0xffffffff8110146b at fast_syscall_common+0xf8 lock order "if_ovpn_lock"(rm) -> "so_rcv"(sleep mutex) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff82eed653 at ovpn_peer_release_ref+0x1e3 #3 0xffffffff82ee9b32 at ovpn_clone_destroy+0x92 #4 0xffffffff80d1e2f9 at if_clone_destroyif_flags+0x69 #5 0xffffffff80d1ebe6 at if_clone_detach+0xe6 #6 0xffffffff82eef665 at ovpn_prison_remove+0x55 #7 0xffffffff80bacf32 at osd_call+0xb2 #8 0xffffffff80b8a14c at prison_deref+0x5dc #9 0xffffffff80b8bc47 at sys_jail_remove+0x1a7 #10 0xffffffff81132a11 at amd64_syscall+0x451 #11 0xffffffff8110146b at fast_syscall_common+0xf8 lock order "so_rcv"(sleep mutex) -> "tcphash"(sleep mutex) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff80e02881 at tcp6_usr_listen+0x1c1 #3 0xffffffff80c8b261 at solisten+0x41 #4 0xffffffff80c93e9f at kern_listen+0x6f #5 0xffffffff81132a11 at amd64_syscall+0x451 #6 0xffffffff8110146b at fast_syscall_common+0xf8 hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first = seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80bc9a49 at _rm_rlock_debug+0x129 #2 0xffffffff80e24ba7 at in6_selectsrc+0x3f7 #3 0xffffffff80e2474d at in6_selectsrc_socket+0x6d #4 0xffffffff80e21ae0 at in6_pcbconnect+0x220 #5 0xffffffff80e0494a at tcp6_connect+0xba #6 0xffffffff80e022c5 at tcp6_usr_connect+0x2f5 #7 0xffffffff80c8c240 at soconnectat+0xc0 #8 0xffffffff80c946b1 at kern_connectat+0xe1 #9 0xffffffff80c945a1 at sys_connect+0x81 #10 0xffffffff81132a11 at amd64_syscall+0x451 #11 0xffffffff8110146b at fast_syscall_common+0xf8 lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at: #0 0xffffffff80c4a2c4 at witness_checkorder+0x364 #1 0xffffffff80bcbc0d at __rw_rlock_int+0x7d #2 0xffffffff80e172bb at in6_lltable_lookup+0x10b #3 0xffffffff80e35da1 at nd6_lookup+0x81 #4 0xffffffff80e4138e at find_pfxlist_reachable_router+0x7e #5 0xffffffff80e411b6 at pfxlist_onlink_check+0x3c6 #6 0xffffffff80e3e6f0 at nd6_ra_input+0x1100 #7 0xffffffff80e0e430 at icmp6_input+0x5b0 #8 0xffffffff80e28d65 at ip6_input+0xbb5 #9 0xffffffff80d3e7b4 at netisr_dispatch_src+0xb4 #10 0xffffffff80d2055a at ether_demux+0x16a #11 0xffffffff80d21ace at ether_nh_input+0x3ce #12 0xffffffff80d3e7b4 at netisr_dispatch_src+0xb4 #13 0xffffffff80d209a5 at ether_input+0xd5 #14 0xffffffff82ee3b54 at epair_tx_start_deferred+0xd4 #15 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2 #16 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3 #17 0xffffffff80b80112 at fork_exit+0x82 lock order lle -> in6_multi_list_mtx attempted at: #0 0xffffffff80c4ac0f at witness_checkorder+0xcaf #1 0xffffffff80ba9111 at __mtx_lock_flags+0x91 #2 0xffffffff80e17701 at in6_lltable_delete_entry+0xc1 #3 0xffffffff80d2404a at lltable_delete_addr+0xda #4 0xffffffff80e6837b at rtnl_handle_delneigh+0x7b #5 0xffffffff80e64c12 at rtnl_handle_message+0x132 #6 0xffffffff80e6345c at nl_receive_message+0x11c #7 0xffffffff80e62da5 at nl_taskqueue_handler+0x3e5 #8 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2 #9 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3 #10 0xffffffff80b80112 at fork_exit+0x82 #11 0xffffffff81101b9e at fork_trampoline+0xe lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80152159290 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2461 2nd 0xffffffff822fbd80 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/neti= net6/in6_mcast.c:1329 lock order lle -> in6_multi_sx attempted at: #0 0xffffffff80c4ac0f at witness_checkorder+0xcaf #1 0xffffffff80bdacc0 at _sx_xlock+0x60 #2 0xffffffff80e1dd07 at in6_leavegroup+0x27 #3 0xffffffff80e1774c at in6_lltable_delete_entry+0x10c #4 0xffffffff80d2404a at lltable_delete_addr+0xda #5 0xffffffff80e6837b at rtnl_handle_delneigh+0x7b #6 0xffffffff80e64c12 at rtnl_handle_message+0x132 #7 0xffffffff80e6345c at nl_receive_message+0x11c #8 0xffffffff80e62da5 at nl_taskqueue_handler+0x3e5 #9 0xffffffff80c3cd12 at taskqueue_run_locked+0x1c2 #10 0xffffffff80c3dc03 at taskqueue_thread_loop+0xd3 #11 0xffffffff80b80112 at fork_exit+0x82 #12 0xffffffff81101b9e at fork_trampoline+0xe epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [5.679s] sys/netinet6/proxy_ndp:pndp_ifdestroy_success -> epair0a: Ethernet addres= s: 26:96:c1:d0:d5:8d epair0b: Ethernet address: ce:d1:4e:41:1d:da epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [1.752s] sys/netinet6/proxy_ndp:pndp_neighbor_advert -> epair0a: Ethernet address:= 2e:dc:e1:52:20:dd epair0b: Ethernet address: a6:23:66:37:45:be epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [4.819s] sys/netinet6/redirect:valid_redirect -> epair0a: Ethernet address: 6a:39:= fd:bc:0b:5b epair0b: Ethernet address: b6:29:b6:86:bd:4f epair0a: link state changed to UP epair0b: link state changed to UP epair0a: promiscuous mode enabled epair0a: promiscuous mode disabled epair0b: link state changed to DOWN epair0a: link state changed to DOWN passed [3.262s] sys/netinet6/scapyi386:scapyi386 -> epair0a: Ethernet address: c6:47:23:0= f:38:63 epair0b: Ethernet address: 3a:61:16:a0:02:92 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: promiscuous mode enabled epair0a: promiscuous mode disabled epair0b: link state changed to DOWN epair0a: link state changed to DOWN passed [4.381s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base -> broke= n: Test case body timed out [300.013s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop -> broke= n: Test case body timed out [300.006s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty] = -> broken: Test case body timed out [300.011s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame]= -> broken: Test case body timed out [300.005s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif= ] -> broken: Test case body timed out [300.013s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1= ] -> broken: Test case body timed out [300.008s] sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocal= ip] -> broken: Test case body timed out [300.006s] sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal ->= broken: Test case body timed out [300.011s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[gu-no_sav] -> broken: Test case body timed out [300.005s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[gu-sav] -> broken: Test case body timed out [300.004s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[ll-no_sav] -> broken: Test case body timed out [300.008s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[ll-sav] -> broken: Test case body timed out [300.010s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[lo-no_sav] -> broken: Test case body timed out [300.010s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tc= p[lo-sav] -> broken: Test case body timed out [300.011s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[gu-no_sav] -> broken: Test case body timed out [300.010s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[gu-sav] -> broken: Test case body timed out [300.008s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[ll-no_sav] -> broken: Test case body timed out [300.012s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[ll-sav] -> broken: Test case body timed out [300.007s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[lo-no_sav] -> broken: Test case body timed out [300.013s] sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_ud= p[lo-sav] -> broken: Test case body timed out [300.011s] sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multic= ast[ff02] -> 2026-04-08T15:22:10.399452+00:00 - auditd 1541 - - auditd_wa= it_for_events: SIGTERM 2026-04-08T15:22:10.401753+00:00 - auditd 1541 - - Auditing disabled 2026-04-08T15:22:10.405879+00:00 - auditd 1541 - - renamed /var/audit/20260= 408092527.not_terminated to /var/audit/20260408092527.20260408152210 2026-04-08T15:22:10.408500+00:00 - auditd 1541 - - Finished 2026-04-08T15:22:30.417051+00:00 - init 1 - - some processes would not die;= ps axl advised Waiting (max 60 seconds) for system process `vnlru' to stop... done Waiting (max 60 seconds) for system process `syncer' to stop...=20 Syncing disks, vnodes remaining... 0 done All buffers synced. + rc=3D0 + echo 'bhyve return code =3D 0' bhyve return code =3D 0 + sudo /usr/sbin/bhyvectl '--vm=3Dtestvm-main-amd64-28202' --destroy + sh -ex freebsd-ci/scripts/test/extract-meta.sh + METAOUTDIR=3Dmeta-out + rm -fr meta-out + mkdir meta-out + tar xvf meta.tar -C meta-out x ./ x ./disable-notyet-tests.sh x ./auto-shutdown x ./disable-dtrace-tests.sh x ./run-kyua.sh x ./disable-zfs-tests.sh x ./run.sh + rm -f 'test-report.*' + mv 'meta-out/test-report.*' . mv: rename meta-out/test-report.* to ./test-report.*: No such file or direc= tory + report=3Dtest-report.xml + [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report= .xml ] + rm -f disk-cam + jot 5 + rm -f disk1 + rm -f disk2 + rm -f disk3 + rm -f disk4 + rm -f disk5 + rm -f disk-test.img [PostBuildScript] - [INFO] Executing post build scripts. [FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins9281111414433552765.sh + ./freebsd-ci/artifact/post-link.py Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'cff675e83cdb6= c9027e94df9d010439e42e27dee', 'branch': 'main', 'target': 'amd64', 'target_= arch': 'amd64', 'link_type': 'latest_tested'} "Link created: main/latest_tested/amd64/amd64 -> ../../cff675e83cdb6c9027e9= 4df9d010439e42e27dee/amd64/amd64\n" Recording test results ERROR: Step =E2=80=98Publish JUnit test result report=E2=80=99 failed: No t= est report files were found. Configuration error? Checking for post-build Performing post-build step Checking if email needs to be generated Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Sending mail from default account using System Admin e-mail address ------=_Part_74_998874607.1775661802753--