Date: Sun, 21 Dec 2025 20:29:36 +0000 (GMT) From: jenkins-admin@FreeBSD.org To: kp@FreeBSD.org, dev-ci@FreeBSD.org Cc: jenkins-admin@FreeBSD.org Subject: FreeBSD-main-amd64-test - Build #27460 - Still Failing Message-ID: <1189263719.2469.1766348976643@jenkins.ci.freebsd.org> In-Reply-To: <1109477757.2461.1766336568712@jenkins.ci.freebsd.org> References: <1109477757.2461.1766336568712@jenkins.ci.freebsd.org>
index | next in thread | previous in thread | raw e-mail
FreeBSD-main-amd64-test - Build #27460 (823ebd7c4f897b1c620b6f21a68221da1cef7449) - Still Failing Build information: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27460/ Full change log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27460/changes Full build log: https://ci.FreeBSD.org/job/FreeBSD-main-amd64-test/27460/console Status explanation: "Failure" - the build is suspected being broken by the following changes "Still Failing" - the build has not been fixed by the following changes and this is a notification to note that these changes have not been fully tested by the CI system Change summaries: (Those commits are likely but not certainly responsible) 622d7fa18d33cd8c4e1195888068fe1fe7c631a1 by kp: pf: fix pcounters array size 823ebd7c4f897b1c620b6f21a68221da1cef7449 by kp: libpfctl: export a get states variant that takes a pfctl_handle The end of the build log: [...truncated 4.36 MiB...] sys/netpfil/pf/pfsync:af_to_out_if_bound -> epair0a: Ethernet address: 6a:73:21:3b:2d:6a epair0b: Ethernet address: ca:2c:49:93:f3:1f epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: d6:4c:f9:c4:7e:26 epair1b: Ethernet address: c6:bb:db:14:57:ee epair1a: link state changed to UP epair1b: link state changed to UP epair2a: Ethernet address: 76:7f:1a:98:b8:5e epair2b: Ethernet address: da:a1:c2:c0:a8:b1 epair2a: link state changed to UP epair2b: link state changed to UP epair3a: Ethernet address: 72:88:fc:8b:33:e1 epair3b: Ethernet address: e6:f7:15:54:d0:ae epair3a: link state changed to UP epair3b: link state changed to UP epair4a: Ethernet address: 1e:3f:42:d7:25:60 epair4b: Ethernet address: b6:33:bf:43:b1:07 epair4a: link state changed to UP epair4b: link state changed to UP epair1a: changing name to 'inif' epair3a: changing name to 'outif' carp: demoted by 240 to 240 (pfsync bulk start) epair2a: changing name to 'inif' epair4a: changing name to 'outif' carp: demoted by 240 to 240 (pfsync bulk start) epair3b: promiscuous mode enabled epair1b: promiscuous mode enabled epair1b: promiscuous mode disabled epair3b: promiscuous mode disabled carp: demoted by -240 to 0 (pfsync bulk done) carp: demoted by -240 to 0 (pfsync bulk done) epair0a: link state changed to DOWN epair0b: link state changed to DOWN epair1b: link state changed to DOWN inif: link state changed to DOWN epair2b: link state changed to DOWN inif: link state changed to DOWN epair3b: link state changed to DOWN outif: link state changed to DOWN epair4b: link state changed to DOWN outif: link state changed to DOWN failed: State not found for 'inif ipv6-icmp 64:ff9b::cb00:71fe\[128\] <- 2001:db8:4201::fe .* rule 3 .* creatorid: [0-9a-f]+' [6.520s] sys/netpfil/pf/pfsync:altq_queues -> epair0a: Ethernet address: 32:5b:47:f3:a3:57 epair0b: Ethernet address: 26:8b:46:8d:cd:ab epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 0e:68:b6:33:1e:b5 epair1b: Ethernet address: c6:ca:0a:ea:ea:f5 epair1a: link state changed to UP epair1b: link state changed to UP epair2a: Ethernet address: 8a:3e:1b:e7:92:64 epair2b: Ethernet address: 42:8a:4a:18:d0:10 epair2a: link state changed to UP epair2b: link state changed to UP epair3a: Ethernet address: a2:30:9e:05:09:52 epair3b: Ethernet address: ee:f9:0e:93:a4:fd epair3a: link state changed to UP epair3b: link state changed to UP epair4a: Ethernet address: 8e:ac:88:6c:57:49 epair4b: Ethernet address: 96:2f:ea:cb:ed:cb epair4a: link state changed to UP epair4b: link state changed to UP epair1a: changing name to 'inif' epair3a: changing name to 'outif' carp: demoted by 240 to 240 (pfsync bulk start) epair2a: changing name to 'inif' epair4a: changing name to 'outif' carp: demoted by 240 to 240 (pfsync bulk start) epair0a: link state changed to DOWN epair0b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) carp: demoted by -240 to 0 (pfsync destroy) epair1b: link state changed to DOWN inif: link state changed to DOWN epair2b: link state changed to DOWN inif: link state changed to DOWN epair3b: link state changed to DOWN outif: link state changed to DOWN epair4b: link state changed to DOWN outif: link state changed to DOWN skipped: Test requires ALTQ [0.417s] sys/netpfil/pf/pfsync:basic -> epair0a: Ethernet address: ba:60:4a:6f:bd:1f epair0b: Ethernet address: e2:95:3b:e7:e8:15 epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 76:75:45:55:ff:19 epair1b: Ethernet address: ca:78:ce:b7:70:6e epair1a: link state changed to UP epair1b: link state changed to UP epair2a: Ethernet address: 7a:27:94:c6:72:94 epair2b: Ethernet address: 12:56:dc:1a:3a:46 epair2a: link state changed to UP epair2b: link state changed to UP carp: demoted by 240 to 240 (pfsync bulk start) carp: demoted by 240 to 240 (pfsync bulk start) epair1a: link state changed to DOWN epair1b: link state changed to DOWN epair0a: link state changed to DOWN epair0b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) epair2a: link state changed to DOWN epair2b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) passed [2.362s] sys/netpfil/pf/pfsync:basic_defer -> epair0a: Ethernet address: 96:8c:22:ad:70:21 epair0b: Ethernet address: 0a:58:e1:82:2c:aa epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: 86:9d:70:18:ad:06 epair1b: Ethernet address: 4e:ea:2f:cf:3a:db epair1a: link state changed to UP epair1b: link state changed to UP epair2a: Ethernet address: aa:aa:e5:f5:e5:4b epair2b: Ethernet address: 8e:75:5a:4f:0a:c4 epair2a: link state changed to UP epair2b: link state changed to UP carp: demoted by 240 to 240 (pfsync bulk start) carp: demoted by 240 to 240 (pfsync bulk start) epair1a: link state changed to DOWN epair1b: link state changed to DOWN epair0a: link state changed to DOWN epair0b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) epair2a: link state changed to DOWN epair2b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) passed [2.350s] sys/netpfil/pf/pfsync:basic_ipv6 -> epair0a: Ethernet address: ea:e9:98:b9:6e:5a epair0b: Ethernet address: 16:de:6e:1e:5d:74 epair0a: link state changed to UP epair0b: link state changed to UP epair1a: Ethernet address: de:a6:75:ce:66:7d epair1b: Ethernet address: 76:fe:e4:ae:fa:ad epair1a: link state changed to UP epair1b: link state changed to UP epair2a: Ethernet address: d2:f9:95:54:37:0e epair2b: Ethernet address: 92:61:3f:0c:4d:e8 epair2a: link state changed to UP epair2b: link state changed to UP carp: demoted by 240 to 240 (pfsync bulk start) lock order reversal: (sleepable after non-sleepable) 1st 0xfffff80003711f10 pfsync (pfsync, sleep mutex) @ /usr/src/sys/netpfil/pf/if_pfsync.c:3156 2nd 0xffffffff81eee4d0 in6_multi_sx (in6_multi_sx, sx) @ /usr/src/sys/netinet6/in6_mcast.c:1216 lock order pfsync -> in6_multi_sx attempted at: #0 0xffffffff80c0dee1 at witness_checkorder+0xbe1 #1 0xffffffff80ba1880 at _sx_xlock+0x60 #2 0xffffffff80ddedc1 at in6_joingroup+0x31 #3 0xffffffff82c40f94 at pfsync_kstatus_to_softc+0x6e4 #4 0xffffffff82c4018b at pfsyncioctl+0x78b #5 0xffffffff80cdc030 at ifioctl+0x9a0 #6 0xffffffff80c142c1 at kern_ioctl+0x2a1 #7 0xffffffff80c13fbf at sys_ioctl+0x12f #8 0xffffffff810efd01 at amd64_syscall+0x451 #9 0xffffffff810bed0b at fast_syscall_common+0xf8 carp: demoted by 240 to 240 (pfsync bulk start) epair1a: link state changed to DOWN epair1b: link state changed to DOWN epair0a: link state changed to DOWN epair0b: link state changed to DOWN carp: demoted by -240 to 0 (pfsync destroy) panic: mld_change_state: bad ifp cpuid = 0 time = 1766348974 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe008c2b6990 vpanic() at vpanic+0x136/frame 0xfffffe008c2b6ac0 panic() at panic+0x43/frame 0xfffffe008c2b6b20 mld_change_state() at mld_change_state+0x6d0/frame 0xfffffe008c2b6b90 in6_leavegroup_locked() at in6_leavegroup_locked+0xa9/frame 0xfffffe008c2b6bf0 in6_leavegroup() at in6_leavegroup+0x32/frame 0xfffffe008c2b6c10 pfsync_multicast_cleanup() at pfsync_multicast_cleanup+0x83/frame 0xfffffe008c2b6c40 pfsync_clone_destroy() at pfsync_clone_destroy+0x260/frame 0xfffffe008c2b6c90 ifc_simple_destroy_wrapper() at ifc_simple_destroy_wrapper+0x26/frame 0xfffffe008c2b6ca0 if_clone_destroyif_flags() at if_clone_destroyif_flags+0x69/frame 0xfffffe008c2b6ce0 if_clone_detach() at if_clone_detach+0xe6/frame 0xfffffe008c2b6d10 vnet_pfsync_uninit() at vnet_pfsync_uninit+0xf0/frame 0xfffffe008c2b6d30 vnet_destroy() at vnet_destroy+0x154/frame 0xfffffe008c2b6d60 prison_deref() at prison_deref+0xaf5/frame 0xfffffe008c2b6dd0 sys_jail_remove() at sys_jail_remove+0x15c/frame 0xfffffe008c2b6e00 amd64_syscall() at amd64_syscall+0x451/frame 0xfffffe008c2b6f30 fast_syscall_common() at fast_syscall_common+0xf8/frame 0xfffffe008c2b6f30 --- syscall (508, FreeBSD ELF64, jail_remove), rip = 0x7b1985a031a, rsp = 0x7b193c990b8, rbp = 0x7b193c99140 --- KDB: enter: panic [ thread pid 99305 tid 107162 ] Stopped at kdb_enter+0x33: movq $0,0x12151b2(%rip) db:0:kdb.enter.panic> show pcpu cpuid = 0 dynamic pcpu = 0xa0b540 curthread = 0xfffff8009dbdd780: pid 99305 tid 107162 critnest 1 "jail" curpcb = 0xfffff8009dbddcd0 fpcurthread = 0xfffff8009dbdd780: pid 99305 "jail" idlethread = 0xfffff8010240c780: tid 100003 "idle: cpu0" self = 0xffffffff82610000 curpmap = 0xfffff800b80b7358 tssp = 0xffffffff82610384 rsp0 = 0xfffffe008c2b7000 kcr3 = 0x80000001a7b1273b ucr3 = 0x80000001a79e4f3b scr3 = 0x1a79e4f3b gs32p = 0xffffffff82610404 ldt = 0xffffffff82610444 tss = 0xffffffff82610434 curvnet = 0xfffff801b23e5580 spin locks held: db:0:kdb.enter.panic> reset Uptime: 1h26m33s + rc=0 + echo 'bhyve return code = 0' bhyve return code = 0 + sudo /usr/sbin/bhyvectl '--vm=testvm-main-amd64-27460' --destroy + sh -ex freebsd-ci/scripts/test/extract-meta.sh + METAOUTDIR=meta-out + rm -fr meta-out + mkdir meta-out + tar xvf meta.tar -C meta-out x ./ x ./disable-notyet-tests.sh x ./auto-shutdown x ./run.sh x ./disable-zfs-tests.sh x ./disable-dtrace-tests.sh x ./run-kyua.sh + rm -f 'test-report.*' + mv 'meta-out/test-report.*' . mv: rename meta-out/test-report.* to ./test-report.*: No such file or directory + report=test-report.xml + [ -e freebsd-ci/jobs/FreeBSD-main-amd64-test/xfail-list -a -e test-report.xml ] + rm -f disk-cam + jot 5 + rm -f disk1 + rm -f disk2 + rm -f disk3 + rm -f disk4 + rm -f disk5 + rm -f disk-test.img [PostBuildScript] - [INFO] Executing post build scripts. [FreeBSD-main-amd64-test] $ /bin/sh -xe /tmp/jenkins5516054455672741617.sh + ./freebsd-ci/artifact/post-link.py Post link: {'job_name': 'FreeBSD-main-amd64-test', 'commit': '823ebd7c4f897b1c620b6f21a68221da1cef7449', 'branch': 'main', 'target': 'amd64', 'target_arch': 'amd64', 'link_type': 'latest_tested'} "Link created: main/latest_tested/amd64/amd64 -> ../../823ebd7c4f897b1c620b6f21a68221da1cef7449/amd64/amd64\n" Recording test results ERROR: Step ‘Publish JUnit test result report’ failed: No test report files were found. Configuration error? Checking for post-build Performing post-build step Checking if email needs to be generated Email was triggered for: Failure - Any Sending email for trigger: Failure - Any Sending mail from default account using System Admin e-mail addresshelp
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1189263719.2469.1766348976643>