Date: Fri, 17 Apr 2026 14:49:59 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: kp@FreeBSD.org, dev-ci@FreeBSD.org Cc: jenkins-admin@FreeBSD.org Subject: FreeBSD-main-amd64-test - Build #28309 - Still Failing Message-ID: <1224209153.1321.1776437399627@jenkins.ci.freebsd.org> In-Reply-To: <163611526.1309.1776431661597@jenkins.ci.freebsd.org>
index | next in thread | previous in thread | raw e-mail
FreeBSD-main-amd64-test - Build #28309 (3c9cd6e4dc59202f2b150a5456541629b633af3b) - Still Failing Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28309/ Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28309/changes Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/28309/console Status explanation: "Failure" - the build is suspected being broken by the following changes "Still Failing" - the build has not been fixed by the following changes and this is a notification to note that these changes have not been fully tested by the CI system Change summaries: (Those commits are likely but not certainly responsible) 13b4a14c719ab7c65ccaab86ddc79f0edc312aa3 by kp: libpfctl: fix add state/source limiter 6f8ea66cbcf2e2e5bc82e8f0c2e0038a3c7d6a9e by kp: pfctl: fix how source and state limiters are wired into rbtrees 95fe1ba5579df2fe204ad30d892160966677ae98 by kp: pf tests: test having multiple state limiters 05ac1013984ced5b8b57430fe92a7074e34054ce by kp: pf: fix error handling in pf_sourcelim_add() 5b7192230a15bbf2378b8f74278d21d4766c5110 by kp: pf: pf_frag_compare() should not be using subtraction to compare 3c9cd6e4dc59202f2b150a5456541629b633af3b by kp: pf: use correct address family in pfr_pool_get() The end of the build log: [...truncated 4.30 MiB...] #15 0xffffffff8113ca11 at amd64_syscall+0x451 #16 0xffffffff8110b6eb at fast_syscall_common+0xf8 epair0a: link state changed to DOWN epair0b: link state changed to DOWN epair1a: link state changed to DOWN epair1b: link state changed to DOWN passed [1.214s] sys/netinet/output:output_raw_flowid_mpath_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 58:9c:fc:10:b5:f3 epair1b: Ethernet address: 58:9c:fc:10:25:ea epair1a: link state changed to UP epair1b: link state changed to UP lo1: link state changed to UP lo2: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN epair1a: link state changed to DOWN epair1b: link state changed to DOWN passed [0.856s] sys/netinet/output:output_raw_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [0.204s] sys/netinet/output:output_tcp_flowid_mpath_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 58:9c:fc:10:b5:f3 epair1b: Ethernet address: 58:9c:fc:10:25:ea epair1a: link state changed to UP epair1b: link state changed to UP lo1: link state changed to UP lo2: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN epair1a: link state changed to DOWN epair1b: link state changed to DOWN passed [3.106s] sys/netinet/output:output_tcp_setup_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [0.313s] sys/netinet/output:output_udp_flowid_mpath_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 58:9c:fc:10:b5:f3 epair1b: Ethernet address: 58:9c:fc:10:25:ea epair1a: link state changed to UP epair1b: link state changed to UP lo1: link state changed to UP lo2: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN epair1a: link state changed to DOWN epair1b: link state changed to DOWN passed [8.777s] sys/netinet/output:output_udp_setup_success -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: link state changed to DOWN epair0b: link state changed to DOWN passed [1.350s] sys/netinet/raw:input -> lo0: link state changed to UP passed [0.063s] sys/netinet/raw:reconnect -> lo0: link state changed to UP passed [0.055s] sys/netinet/redirect:valid_redirect -> epair0a: Ethernet address: 58:9c:fc:10:b7:c7 epair0b: Ethernet address: 58:9c:fc:10:cd:70 epair0a: link state changed to UP epair0b: link state changed to UP epair0a: promiscuous mode enabled epair0a: promiscuous mode disabled epair0b: link state changed to DOWN epair0a: link state changed to DOWN passed [1.905s] sys/netinet/so_reuseport_lb_test:basic_ipv4 -> Limiting tcp reset response from 8363 to 207 packets/sec passed [1.920s] sys/netinet/so_reuseport_lb_test:basic_ipv6 -> Limiting tcp reset response from 8432 to 199 packets/sec Limiting tcp reset response from 7587 to 213 packets/sec Limiting tcp reset response from 7618 to 213 packets/sec passed [2.152s] sys/netinet/so_reuseport_lb_test:bind_without_listen -> passed [0.008s] sys/netinet/so_reuseport_lb_test:concurrent_add -> passed [2.603s] sys/netinet/so_reuseport_lb_test:connect_bound -> passed [0.007s] sys/netinet/so_reuseport_lb_test:connect_not_bound -> passed [0.006s] sys/netinet/so_reuseport_lb_test:connect_udp -> passed [0.207s] sys/netinet/so_reuseport_lb_test:connect_udp6 -> passed [0.208s] sys/netinet/so_reuseport_lb_test:double_listen_ipv4 -> passed [0.006s] sys/netinet/so_reuseport_lb_test:double_listen_ipv6 -> passed [0.006s] sys/netinet/socket_afinet:socket_afinet -> passed [0.006s] sys/netinet/socket_afinet:socket_afinet_bind_connected_port -> passed [0.010s] sys/netinet/socket_afinet:socket_afinet_bind_ok -> passed [0.006s] sys/netinet/socket_afinet:socket_afinet_bind_zero -> skipped: doesn't work when mac_portacl(4) loaded (https://bugs.freebsd.org/238781) [0.006s] sys/netinet/socket_afinet:socket_afinet_bindany -> passed [0.007s] sys/netinet/socket_afinet:socket_afinet_multibind -> passed [0.180s] sys/netinet/socket_afinet:socket_afinet_poll_no_rdhup -> passed [0.006s] sys/netinet/socket_afinet:socket_afinet_poll_rdhup -> passed [0.006s] sys/netinet/socket_afinet:socket_afinet_stream_reconnect -> passed [0.006s] sys/netinet/tcp_connect_port_test:basic_ipv4 -> Limiting tcp reset response from 598 to 207 packets/sec Limiting tcp reset response from 10130 to 197 packets/sec Limiting tcp reset response from 10560 to 203 packets/sec Limiting tcp reset response from 10589 to 198 packets/sec Limiting tcp reset response from 10632 to 215 packets/sec Limiting tcp reset response from 10732 to 211 packets/sec Limiting tcp reset response from 10364 to 212 packets/sec passed [6.217s] sys/netinet/tcp_connect_port_test:basic_ipv6 -> Limiting tcp reset response from 9297 to 200 packets/sec Limiting tcp reset response from 9404 to 212 packets/sec Limiting tcp reset response from 9332 to 185 packets/sec Limiting tcp reset response from 9262 to 189 packets/sec Limiting tcp reset response from 9250 to 186 packets/sec Limiting tcp reset response from 9500 to 195 packets/sec Limiting tcp reset response from 9358 to 190 packets/sec passed [7.006s] TCP HPTS started 2 ((unbounded)) swi interrupt threads sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_concurrent_operations -> passed [0.467s] sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_cpu_assignment -> passed [0.474s] sys/netinet/tcp_hpts_test.py:TestTcpHpts::test_deferred_requests -> Kernel page fault with the following non-sleepable locks held: exclusive rw test-inp (test-inp) r = 0 (0xfffff800b9054830) locked @ /usr/src/sys/netinet/tcp_hpts.c:1275 Kernel page fault with 1 sleep inhibitors stack backtrace: #0 0xffffffff80c543dc at witness_debugger+0x6c #1 0xffffffff80c55ce9 at witness_warn+0x4c9 #2 0xffffffff8113bcdc at trap_pfault+0x8c #3 0xffffffff8110adf8 at calltrap+0x8 #4 0xffffffff8315f866 at __ktest_deferred_requests+0x996 #5 0xffffffff830e3abd at run_test+0x2ad #6 0xffffffff80e6d67c at nl_receive_message+0x11c #7 0xffffffff80e6cfc5 at nl_taskqueue_handler+0x3e5 #8 0xffffffff80c460b2 at taskqueue_run_locked+0x1c2 #9 0xffffffff80c46fa3 at taskqueue_thread_loop+0xd3 #10 0xffffffff80b89192 at fork_exit+0x82 #11 0xffffffff8110be1e at fork_trampoline+0xe Fatal trap 12: page fault while in kernel mode cpuid = 1; apic id = 01 fault virtual address = 0xc8 fault code = supervisor read data, page not present instruction pointer = 0x20:0xffffffff8316a3f1 stack pointer = 0:0xfffffe008c176ab0 frame pointer = 0:0xfffffe008c176bd0 code segment = base 0x0, limit 0xfffff, type 0x1b = DPL 0, pres 1, long 1, def32 0, gran 1 processor eflags = interrupt enabled, resume, IOPL = 0 current process = 0 (netlink_socket (PID) rdi: fffff800033b1d00 rsi: 0000000000000001 rdx: ffffffff82267d98 rcx: 0000000000000001 r8: ffffffff81ad2960 r9: 0000000000000001 rax: 0000000000000000 rbx: 0000000000002000 rbp: fffffe008c176bd0 r10: 0000000000000000 r11: 0000000000000001 r12: fffff800b9054800 r13: 0000000000000000 r14: fffff800b9054848 r15: 0000000000001388 trap number = 12 panic: page fault cpuid = 1 time = 1776437388 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008c1767e0 vpanic() at vpanic+0x136/frame 0xfffffe008c176910 panic() at panic+0x43/frame 0xfffffe008c176970 trap_pfault() at trap_pfault+0x422/frame 0xfffffe008c1769e0 calltrap() at calltrap+0x8/frame 0xfffffe008c1769e0 --- trap 0xc, rip = 0xffffffff8316a3f1, rsp = 0xfffffe008c176ab0, rbp = 0xfffffe008c176bd0 --- tcp_hptsi() at tcp_hptsi+0x6f1/frame 0xfffffe008c176bd0 __ktest_deferred_requests() at __ktest_deferred_requests+0x996/frame 0xfffffe008c176c60 run_test() at run_test+0x2ad/frame 0xfffffe008c176d00 nl_receive_message() at nl_receive_message+0x11c/frame 0xfffffe008c176d40 nl_taskqueue_handler() at nl_taskqueue_handler+0x3e5/frame 0xfffffe008c176e40 taskqueue_run_locked() at taskqueue_run_locked+0x1c2/frame 0xfffffe008c176ec0 taskqueue_thread_loop() at taskqueue_thread_loop+0xd3/frame 0xfffffe008c176ef0 fork_exit() at fork_exit+0x82/frame 0xfffffe008c176f30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe008c176f30 --- trap 0, rip = 0, rsp = 0x29dc45b3c34c, rbp = 0 --- KDB: enter: panic [ thread pid 0 tid 107462 ] Stopped at kdb_enter+0x33: movq $0,0x15dcb42(%rip) db:0:kdb.enter.panic> show pcpu cpuid = 1 dynamic pcpu = 0xfffffe008d3bdd00 curthread = 0xfffff801d1282780: pid 0 tid 107462 critnest 1 "netlink_socket (PID" curpcb = 0xfffff801d1282cd0 fpcurthread = none idlethread = 0xfffff8010240c000: tid 100004 "idle: cpu1" self = 0xffffffff82a11000 curpmap = 0xffffffff81da1d20 tssp = 0xffffffff82a11384 rsp0 = 0xfffffe008c177000 kcr3 = 0x8000000002945002 ucr3 = 0xffffffffffffffff scr3 = 0x3824ece7 gs32p = 0xffffffff82a11404 ldt = 0xffffffff82a11444 tss = 0xffffffff82a11434 curvnet = 0xfffff800030e7ec0 spin locks held: db:0:kdb.enter.panic> reset Uptime: 50m45s + rc=0 + echo 'bhyve return code = 0' bhyve return code = 0 + sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-28309' --destroy + sh -ex freebsd-ci/scripts/test/extract-meta.sh + METAOUTDIR=meta-out + rm -fr meta-out + mkdir meta-out + tar xvf meta.tar -C meta-out x ./ x ./run-kyua.sh x ./auto-shutdown x ./disable-notyet-tests.sh x ./run.sh x ./disable-dtrace-tests.sh x ./disable-zfs-tests.sh + rm -f 'test-report.*' + mv 'meta-out/test-report.*' . mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory + report=test-report.xml + [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ] + rm -f disk-cam + jot 5 + rm -f disk1 + rm -f disk2 + rm -f disk3 + rm -f disk4 + rm -f disk5 + rm -f disk-test.img [PostBuildScript] - [INFO] Executing post build scripts. [FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins7592954972427069381.sh + ./freebsd-ci/artifact/post-link.py Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '3c9cd6e4dc59202f2b150a5456541629b633af3b', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'} "Link created: main/latest_tested/amd64/amd64 -> ../../3c9cd6e4dc59202f2b150a5456541629b633af3b/amd64/amd64\n" Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Checking for post-build Performing post-build step Checking if email needs to be generated Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Sending mail from default account using System Admin e-mail addresshome | help
Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1224209153.1321.1776437399627>