Skip site navigation (1)Skip section navigation (2)
Date:      Thu, 30 Jul 2026 13:21:36 +0000 (GMT)
From:      jenkins-admin@FreeBSD.org
To:        kib@FreeBSD.org, kbowling@FreeBSD.org, dev-ci@FreeBSD.org
Cc:        jenkins-admin@FreeBSD.org
Subject:   FreeBSD-main-amd64-test - Build #29167 - Failure
Message-ID:  <1612330142.483.1785417697166@jenkins.ci.freebsd.org>
In-Reply-To: <572214320.473.1785396138704@jenkins.ci.freebsd.org>

index | next in thread | previous in thread | raw e-mail

FreeBSD-main-amd64-test - Build #29167 (a2ed165f0049595f2e52ec545095240e362f27c7) - Failure

Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29167/
Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29167/changes
Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/29167/console

Status explanation:
"Failure" - the build is suspected being broken by the following changes
"Still Failing" - the build has not been fixed by the following changes and
                  this is a notification to note that these changes have
                  not been fully tested by the CI system

Change summaries:
(Those commits are likely but not certainly responsible)

930f2e4da96487f18a82f912275c6302c39b9bd2 by kib:
kern_execve(): avoid storing non-VDIR into p_textdvp

a2ed165f0049595f2e52ec545095240e362f27c7 by kbowling:
igb: Add SR-IOV PF support for 82576 and I350



The end of the build log:

[...truncated 4.61 MiB...]
#3 0xffffffff82aebba2 at ovpn_clone_destroy+0x92
#4 0xffffffff80d709dc at if_clone_destroyif_flags+0x8c
#5 0xffffffff80d712f6 at if_clone_detach+0x106
#6 0xffffffff82af1815 at ovpn_prison_remove+0x55
#7 0xffffffff80bf2382 at osd_call+0xb2
#8 0xffffffff80bce41c at prison_deref+0x5ec
#9 0xffffffff80bcffa7 at sys_jail_remove+0x1a7
#10 0xffffffff811a76ce at amd64_syscall+0x45e
#11 0xffffffff8117479b at fast_syscall_common+0xf8

lock order "so_rcv"(sleep mutex) -> "tcphash"(sleep mutex) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80bee331 at __mtx_lock_flags+0x91
#2 0xffffffff80e16ac3 at in_pcbbind+0xb3
#3 0xffffffff80e593e4 at tcp_usr_listen+0x114
#4 0xffffffff80cd85e1 at solisten+0x41
#5 0xffffffff80ce145e at kern_listen+0x7e
#6 0xffffffff811a76ce at amd64_syscall+0x45e
#7 0xffffffff8117479b at fast_syscall_common+0xf8

hardcoded lock order "tcphash"(sleep mutex) -> "in6_ifaddr_lock"(rm) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80c0ff59 at _rm_rlock_debug+0x129
#2 0xffffffff80e7d4ce at in6_selectsrc+0x3ee
#3 0xffffffff80e7d050 at in6_selectsrc_socket+0x80
#4 0xffffffff80e7a42d at in6_pcbladdr+0x10d
#5 0xffffffff80e7a218 at in6_pcbconnect+0x338
#6 0xffffffff80e5c753 at tcp6_connect+0x83
#7 0xffffffff80e5a1fa at tcp6_usr_connect+0x2da
#8 0xffffffff80cd95b6 at soconnectat+0xc6
#9 0xffffffff80ce1c9c at kern_connectat+0xec
#10 0xffffffff80ce1b83 at sys_connect+0x73
#11 0xffffffff811a76ce at amd64_syscall+0x45e
#12 0xffffffff8117479b at fast_syscall_common+0xf8

lock order "in6_ifaddr_lock"(rm) -> "lle"(rw) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80c1215d at __rw_rlock_int+0x7d
#2 0xffffffff80e6f30b at in6_lltable_lookup+0x10b
#3 0xffffffff80e8edfc at nd6_lookup+0x8c
#4 0xffffffff80e9aa7e at find_pfxlist_reachable_router+0x7e
#5 0xffffffff80e9a866 at pfxlist_onlink_check+0x446
#6 0xffffffff80e9802a at nd6_ra_input+0x177a
#7 0xffffffff80e663d3 at icmp6_input+0x5b3
#8 0xffffffff80e81901 at ip6_input+0xbc1
#9 0xffffffff80d91dcf at netisr_dispatch_src+0xbf
#10 0xffffffff80d72cba at ether_demux+0x17a
#11 0xffffffff80d742da at ether_nh_input+0x3ea
#12 0xffffffff80d91dcf at netisr_dispatch_src+0xbf
#13 0xffffffff80d73129 at ether_input+0xe9
#14 0xffffffff82ae5b94 at epair_tx_start_deferred+0xd4
#15 0xffffffff80c86cfb at taskqueue_run_locked+0x1eb
#16 0xffffffff80c87ca3 at taskqueue_thread_loop+0xd3
#17 0xffffffff80bc3e52 at fork_exit+0x82

lock order "mld_mtx"(sleep mutex) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80bee331 at __mtx_lock_flags+0x91
#2 0xffffffff80e012cd at arpresolve+0x34d
#3 0xffffffff80d72500 at ether_output+0x300
#4 0xffffffff80e2469a at ip_output+0x158a
#5 0xffffffff80d7525a at gif_transmit+0x2fa
#6 0xffffffff80e85ccb at ip6_output+0x1b1b
#7 0xffffffff80e8c090 at mld_dispatch_packet+0x330
#8 0xffffffff80e8cb90 at mld_fasttimo+0x4f0
#9 0xffffffff80c36905 at softclock_call_cc+0x1b5
#10 0xffffffff80c380e6 at softclock_thread+0xc6
#11 0xffffffff80bc3e52 at fork_exit+0x82
#12 0xffffffff81174ece at fork_trampoline+0xe

lock order "if_ovpn_lock"(rm) -> "lltable"(sleep mutex) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80bee331 at __mtx_lock_flags+0x91
#2 0xffffffff80e012cd at arpresolve+0x34d
#3 0xffffffff80d72500 at ether_output+0x300
#4 0xffffffff80e2469a at ip_output+0x158a
#5 0xffffffff82af0f47 at ovpn_encap+0x6d7
#6 0xffffffff82af10f2 at ovpn_encrypt_tx_cb+0x142
#7 0xffffffff80f58928 at crypto_done+0x168
#8 0xffffffff81051c9a at aesni_process+0xea
#9 0xffffffff80f59185 at crypto_invoke+0x85
#10 0xffffffff80f57d79 at crypto_dispatch_one+0xe9
#11 0xffffffff82af0723 at ovpn_transmit_to_peer+0x663
#12 0xffffffff82aefe54 at ovpn_send_ping+0x124
#13 0xffffffff80c36905 at softclock_call_cc+0x1b5
#14 0xffffffff80c380e6 at softclock_thread+0xc6
#15 0xffffffff80bc3e52 at fork_exit+0x82
#16 0xffffffff81174ece at fork_trampoline+0xe

lock order "lltable"(sleep mutex) -> "lle"(rw) first seen at:
#0 0xffffffff80c946fa at witness_checkorder+0x36a
#1 0xffffffff80c113d5 at _rw_wlock_cookie+0x65
#2 0xffffffff80e9112c at nd6_add_ifa_lle+0xcc
#3 0xffffffff80e6cad0 at in6_update_ifa+0xdb0
#4 0xffffffff80e6b5df at in6_addifaddr+0x7f
#5 0xffffffff80e6b3f1 at in6_control_ioctl+0x9b1
#6 0xffffffff80ec255e at rtnl_handle_addr+0x62e
#7 0xffffffff80ebf860 at rtnl_handle_message+0x1a0
#8 0xffffffff80ebe02a at nl_receive_message+0x12a
#9 0xffffffff80ebd965 at nl_taskqueue_handler+0x3f5
#10 0xffffffff80c86cfb at taskqueue_run_locked+0x1eb
#11 0xffffffff80c87ca3 at taskqueue_thread_loop+0xd3
#12 0xffffffff80bc3e52 at fork_exit+0x82
#13 0xffffffff81174ece at fork_trampoline+0xe

lock order lle -> in6_multi_list_mtx attempted at:
#0 0xffffffff80c950cb at witness_checkorder+0xd3b
#1 0xffffffff80bee331 at __mtx_lock_flags+0x91
#2 0xffffffff80e6f751 at in6_lltable_delete_entry+0xc1
#3 0xffffffff80d7690a at lltable_delete_addr+0xda
#4 0xffffffff80ec3247 at rtnl_handle_delneigh+0x97
#5 0xffffffff80ebf7fd at rtnl_handle_message+0x13d
#6 0xffffffff80ebe02a at nl_receive_message+0x12a
#7 0xffffffff80ebd965 at nl_taskqueue_handler+0x3f5
#8 0xffffffff80c86cfb at taskqueue_run_locked+0x1eb
#9 0xffffffff80c87ca3 at taskqueue_thread_loop+0xd3
#10 0xffffffff80bc3e52 at fork_exit+0x82
#11 0xffffffff81174ece at fork_trampoline+0xe
lock order reversal: (sleepable after non-sleepable)
 1st 0xfffff8006e72a710 lle (lle, rw) @ /usr/src/sys/netinet6/in6.c:2461
 2nd 0xffffffff81e9dc20 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1329
lock order lle -> in6_multi_sx attempted at:
#0 0xffffffff80c950cb at witness_checkorder+0xd3b
#1 0xffffffff80c21df0 at _sx_xlock+0x60
#2 0xffffffff80e760c7 at in6_leavegroup+0x27
#3 0xffffffff80e6f79c at in6_lltable_delete_entry+0x10c
#4 0xffffffff80d7690a at lltable_delete_addr+0xda
#5 0xffffffff80ec3247 at rtnl_handle_delneigh+0x97
#6 0xffffffff80ebf7fd at rtnl_handle_message+0x13d
#7 0xffffffff80ebe02a at nl_receive_message+0x12a
#8 0xffffffff80ebd965 at nl_taskqueue_handler+0x3f5
#9 0xffffffff80c86cfb at taskqueue_run_locked+0x1eb
#10 0xffffffff80c87ca3 at taskqueue_thread_loop+0xd3
#11 0xffffffff80bc3e52 at fork_exit+0x82
#12 0xffffffff81174ece at fork_trampoline+0xe
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [5.613s]
sys/netinet6/proxy_ndp:pndp_ifdestroy_success  ->  epair0a: Ethernet address: 46:21:96:3d:6c:e3
epair0b: Ethernet address: 1a:9e:2d:26:a5:d7
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [1.971s]
sys/netinet6/proxy_ndp:pndp_neighbor_advert  ->  epair0a: Ethernet address: a2:ff:fa:a2:e0:3a
epair0b: Ethernet address: 3e:a8:69:85:79:da
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: link state changed to DOWN
epair0b: link state changed to DOWN
passed  [4.589s]
sys/netinet6/redirect:valid_redirect  ->  epair0a: Ethernet address: 26:c5:81:24:f9:77
epair0b: Ethernet address: 42:a8:25:ea:f5:6d
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [3.299s]
sys/netinet6/scapyi386:scapyi386  ->  epair0a: Ethernet address: 92:37:80:79:ae:f5
epair0b: Ethernet address: be:92:c8:c0:65:e5
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: promiscuous mode enabled
epair0a: promiscuous mode disabled
epair0b: link state changed to DOWN
epair0a: link state changed to DOWN
passed  [4.511s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_base  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_nhop  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[empty]  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ifsame]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[ipandif]  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[iponly1]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6Output::test_output6_pktinfo[nolocalip]  ->  broken: Test case body timed out  [300.006s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLL::test_output6_linklocal  ->  broken: Test case body timed out  [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-no_sav]  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[gu-sav]  ->  broken: Test case body timed out  [300.007s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-no_sav]  ->  broken: Test case body timed out  [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[ll-sav]  ->  broken: Test case body timed out  [300.010s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-no_sav]  ->  broken: Test case body timed out  [300.008s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_tcp[lo-sav]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-no_sav]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[gu-sav]  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-no_sav]  ->  broken: Test case body timed out  [300.005s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[ll-sav]  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-no_sav]  ->  broken: Test case body timed out  [300.007s]
sys/netinet6/test_ip6_output.py:TestIP6OutputLoopback::test_output6_self_udp[lo-sav]  ->  broken: Test case body timed out  [300.012s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff02]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff05]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff08]  ->  broken: Test case body timed out  [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6OutputMulticast::test_output6_multicast[ff0e]  ->  broken: Test case body timed out  [300.009s]
sys/netinet6/test_ip6_output.py:TestIP6OutputNhopLL::test_output6_nhop_linklocal  ->  broken: Test case body timed out  [300.004s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[gu_to_ll]  ->  broken: Test case body timed out  [300.011s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[ll_differentif1]  ->  broken: Test case body timed out  [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[ll_differentif2]  ->  broken: Test case body timed out  [300.013s]
sys/netinet6/test_ip6_output.py:TestIP6OutputScope::test_output6_linklocal_scope[same]  ->  2026-07-30T13:20:35.532743+00:00 - auditd 1422 - - auditd_wait_for_events: SIGTERM
2026-07-30T13:20:35.534922+00:00 - auditd 1422 - - Auditing disabled
2026-07-30T13:20:35.537499+00:00 - auditd 1422 - - renamed /var/audit/20260730072340.not_terminated to /var/audit/20260730072340.20260730132035
2026-07-30T13:20:35.539777+00:00 - auditd 1422 - - Finished
2026-07-30T13:20:55.541591+00:00 - init 1 - - some processes would not die; ps axl advised
Waiting (max 60 seconds) for system process `vnlru' to stop... done
Waiting (max 60 seconds) for system process `syncer' to stop... 
Syncing disks, vnodes remaining... 0 0 done
All buffers synced.
+ rc=0
+ echo 'bhyve return code = 0'
bhyve return code = 0
+ sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-29167' --destroy
+ sh -ex freebsd-ci/scripts/test/extract-meta.sh
+ METAOUTDIR=meta-out
+ rm -fr meta-out
+ mkdir meta-out
+ tar xvf meta.tar -C meta-out
x ./
x ./disable-dtrace-tests.sh
x ./run-kyua.sh
x ./auto-shutdown
x ./disable-zfs-tests.sh
x ./disable-notyet-tests.sh
x ./run.sh
+ rm -f test-report.txt test-report.xml
+ mv 'meta-out/test-report.*' .
mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory
+ report=test-report.xml
+ [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ]
+ rm -f disk-cam
+ jot 5
+ rm -f disk1
+ rm -f disk2
+ rm -f disk3
+ rm -f disk4
+ rm -f disk5
+ rm -f disk-test.img
[PostBuildScript] - [INFO] Executing post build scripts.
[FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins8955305395526321302.sh
+ ./freebsd-ci/artifact/post-link.py
Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': 'a2ed165f0049595f2e52ec545095240e362f27c7', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'}
"Link created: main/latest_tested/amd64/amd64 -> ../../a2ed165f0049595f2e52ec545095240e362f27c7/amd64/amd64\n"
Recording test results
ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error?
Checking for post-build
Performing post-build step
Checking if email needs to be generated
Email was triggered for: Failure - Any
Sending email for trigger: Failure - Any
Sending mail from default account using System Admin e-mail address
home | help

Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1612330142.483.1785417697166>