From nobody Wed Oct 8 13:06:18 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4chYDc09ppz69SwY for ; Wed, 08 Oct 2025 13:06:40 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Received: from mail-ed1-x52a.google.com (mail-ed1-x52a.google.com [IPv6:2a00:1450:4864:20::52a]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4chYDZ71Qzz43xk for ; Wed, 08 Oct 2025 13:06:38 +0000 (UTC) (envelope-from rick.macklem@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=gmail.com header.s=20230601 header.b=ETGXgulv; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (mx1.freebsd.org: domain of rick.macklem@gmail.com designates 2a00:1450:4864:20::52a as permitted sender) smtp.mailfrom=rick.macklem@gmail.com Received: by mail-ed1-x52a.google.com with SMTP id 4fb4d7f45d1cf-636de696e18so12779034a12.3 for ; Wed, 08 Oct 2025 06:06:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1759928791; x=1760533591; darn=freebsd.org; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:from:to:cc:subject:date :message-id:reply-to; bh=YwrJWKjpUE7RggOozOTM2Q4XEbyycg4CWIJzGaz+PGg=; b=ETGXgulvCVEWpO2ZHi9qlOLThtIXeLg+ReuiUrUoM4HyDSzixi3cN5DfMMvoVFQWDQ +BK9jEyV51cTio536TCfsui5Kw+uPbBxFbX42RpZ5f/9JgUsIsJoUJ9skw181ZMf4qH5 Phmx1xveequyRdpgrguGndCWLNhauBw36JId0GEjWVOy4JS2VFhcTJB8ZS8BAeEVtqFI tx925P9aFDmD7IJ5ZIB9Ax/TotGMkgp7CHt7q8l17rJYErNfLXkPjfMpBgURneFjMhWD zWnO3zJr1GJZIH0vY2rWXB6X1t/K7N1okXpwjAh1xnP9A1x99TYC1i5PNJ8uIasUFBi7 LQRw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1759928791; x=1760533591; h=content-transfer-encoding:to:subject:message-id:date:from :in-reply-to:references:mime-version:x-gm-message-state:from:to:cc :subject:date:message-id:reply-to; bh=YwrJWKjpUE7RggOozOTM2Q4XEbyycg4CWIJzGaz+PGg=; b=aos9o9K0EwhOKDzGKs/TpDjV1do01aGf1oa8Naz4/eWpfmThfYp5nU8MjmX+6gtx82 eVONBV8XztW/YTDGWaNfEf8AA+D6dd19pjIeq6TyOkDuitl1f5zdW89UES9RpcAJlcMZ gjCWDxQ1K7smT1mS78HQegu9tESqoLJhPggfTS6ZxHK6Sgg0sFI1ZbZwLjFgOmZEG0Fv uAA2cpIhgh1ffAOGGwmCnKpfRfY3t5CkL5jtv6TWpsSWHemTBmioMNjQei7YfnoLojaz vRT/qXh0HhcLzAVPwg65R25Mkz0XHW4dBsRSR5kLqdtzxejerf72MEXo4vRD4KuPlpqY fniA== X-Gm-Message-State: AOJu0YzFzaMEcAs1sHTbNXiST1g4kS/c+edbgBpbadMsIa61+IeW9P4k jK4zx2ZD5QK4jjPPoiPzAvBGR7Ln8c2yh1B3OE0KH7pqjbvkEBDuylTFylP3D32XHoflvyXVdXy QL3vIuTJeDkxV3hvuAhuVICDWNRL71m+OrR0= X-Gm-Gg: ASbGncscfD8yY78enawQCDM8IAzHLr/GNCHUXw97TEZLSLl1P30HX6DW7opiMdArIv4 tnTz4147NVSIIdC9RBjgabi7gb5aCllYLQbEkA8mJaxieowhXMGuIbFrFSvcpnSRn6w8nCFmHvb rCTxpd9yS0LbKEd0SUiQQdyUHLtq7UA62Ks5q/b+1IRqBImKciSchO1Dm/ZfVZjMn0EmtgcyaQ1 iuwPzYQKU8HEqcIg6J9u0eYGPRBJn07AVQ32FPijVzJrIXJhS0ZN7ze8aXEvRQ= X-Google-Smtp-Source: AGHT+IHSIIM58yYw5WbwMF1H08F295lHfFcHlO5jTRNzmYRcaL+06gZcqQSIrfWuQ31yUdqv2UqnQxLESd2i6YIf9Ak= X-Received: by 2002:a05:6402:2708:b0:634:5371:d713 with SMTP id 4fb4d7f45d1cf-639d5b894bbmr3083245a12.14.1759928790608; Wed, 08 Oct 2025 06:06:30 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <314494105.505.1759897474336@jenkins.ci.freebsd.org> <345944856.515.1759902279808@jenkins.ci.freebsd.org> In-Reply-To: <345944856.515.1759902279808@jenkins.ci.freebsd.org> From: Rick Macklem Date: Wed, 8 Oct 2025 06:06:18 -0700 X-Gm-Features: AS18NWC5IWrNsTuwGsla68ZkpQI1te2TluveWFdh5gkaBeCTj1jIx4G3KhKgF_A Message-ID: Subject: Re: FreeBSD-stable-15-amd64-test - Build #30 - Still Failing To: "freebsd-net@FreeBSD.org" Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.97 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.996]; NEURAL_HAM_MEDIUM(-0.97)[-0.973]; DMARC_POLICY_ALLOW(-0.50)[gmail.com,none]; R_DKIM_ALLOW(-0.20)[gmail.com:s=20230601]; R_SPF_ALLOW(-0.20)[+ip6:2a00:1450:4000::/36:c]; MIME_GOOD(-0.10)[text/plain]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FROM_HAS_DN(0.00)[]; MIME_TRACE(0.00)[0:+]; ARC_NA(0.00)[]; DWL_DNSWL_NONE(0.00)[gmail.com:dkim]; FREEMAIL_FROM(0.00)[gmail.com]; TAGGED_FROM(0.00)[]; DKIM_TRACE(0.00)[gmail.com:+]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MID_RHS_MATCH_FROMTLD(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; FROM_EQ_ENVFROM(0.00)[]; TO_DN_EQ_ADDR_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:15169, ipnet:2a00:1450::/32, country:US]; MISSING_XM_UA(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[2a00:1450:4864:20::52a:from] X-Rspamd-Queue-Id: 4chYDZ71Qzz43xk Just in case no one in networking is seeing this, I'm reposting it here. rick On Tue, Oct 7, 2025 at 10:44=E2=80=AFPM wrote: > > CAUTION: This email originated from outside of the University of Guelph. = Do not click links or open attachments unless you recognize the sender and = know the content is safe. If in doubt, forward suspicious emails to IThelp@= uoguelph.ca. > > FreeBSD-stable-15-amd64-test - Build #30 (23fbea8cf2f360dd45cb69c98f6f293= 1fff3721e) - Still Failing > > Build information: https://ci.FreeBSD.org/job/FreeBSD-stable-15-amd64-tes= t/30/ > Full change log: https://ci.FreeBSD.org/job/FreeBSD-stable-15-amd64-test/= 30/changes > Full build log: https://ci.FreeBSD.org/job/FreeBSD-stable-15-amd64-test/3= 0/console > > Status explanation: > "Failure" - the build is suspected being broken by the following changes > "Still Failing" - the build has not been fixed by the following changes a= nd > this is a notification to note that these changes have > not been fully tested by the CI system > > Change summaries: > (Those commits are likely but not certainly responsible) > > 23fbea8cf2f360dd45cb69c98f6f2931fff3721e by rmacklem: > kadmin.8: Document the new dump -f flag > > > > The end of the build log: > > [...truncated 3.96 MiB...] > epair0b: Ethernet address: d2:f4:4c:7c:25:d3 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: c6:fa:71:45:1f:b3 > epair1b: Ethernet address: 3a:02:db:62:eb:5a > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.136s= ] > sys/netpfil/pf/nat64:tcp_in_floating -> epair0a: Ethernet address: b2:2= 0:57:6c:d4:c5 > epair0b: Ethernet address: 5a:f0:ad:fb:8a:50 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 52:58:0c:ea:9b:f3 > epair1b: Ethernet address: ca:3f:da:2a:4d:86 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.125s= ] > sys/netpfil/pf/nat64:tcp_in_if_bound -> epair0a: Ethernet address: 52:7= d:e8:24:9b:38 > epair0b: Ethernet address: 6e:8e:70:d3:10:60 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 32:25:e3:7f:fe:7c > epair1b: Ethernet address: e6:f1:01:c1:4f:84 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.126s= ] > sys/netpfil/pf/nat64:tcp_out_floating -> epair0a: Ethernet address: ce:= 73:6d:57:a2:67 > epair0b: Ethernet address: 2a:28:48:af:e2:4a > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 82:12:d3:13:44:bb > epair1b: Ethernet address: c2:16:12:72:31:45 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.127s= ] > sys/netpfil/pf/nat64:tcp_out_if_bound -> epair0a: Ethernet address: 76:= e6:ab:94:3a:a3 > epair0b: Ethernet address: 12:ae:f5:b6:b8:19 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 56:3a:12:2a:60:8a > epair1b: Ethernet address: 76:ac:dc:80:e3:72 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.126s= ] > sys/netpfil/pf/nat64:tos -> epair0a: Ethernet address: 62:39:ae:b2:2a:d= b > epair0b: Ethernet address: 36:9f:e7:31:94:32 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 42:37:24:71:41:ed > epair1b: Ethernet address: d2:ca:da:c1:6c:54 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.126s= ] > sys/netpfil/pf/nat64:udp_in -> epair0a: Ethernet address: 16:99:da:0e:9= 1:0d > epair0b: Ethernet address: 3e:57:7e:63:8d:87 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 6e:95:d1:aa:b3:a9 > epair1b: Ethernet address: ba:59:41:61:6b:19 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.135s= ] > sys/netpfil/pf/nat64:udp_out -> epair0a: Ethernet address: 7a:b4:11:19:= 87:66 > epair0b: Ethernet address: 5e:70:01:e2:ea:b6 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 52:fd:81:7b:fc:61 > epair1b: Ethernet address: 1e:ba:76:e2:79:36 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair1b: link state changed to DOWN > epair1a: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.127s= ] > sys/netpfil/pf/nat64:v6_gateway -> epair0a: Ethernet address: ee:55:d2:= 9b:91:07 > epair0b: Ethernet address: fa:df:53:46:63:90 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 1e:a2:5a:f3:ee:cf > epair1b: Ethernet address: 26:8a:99:45:02:97 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair2a: Ethernet address: ae:b7:eb:ed:ec:d8 > epair2b: Ethernet address: 5a:ef:f6:5c:17:bd > epair2a: link state changed to UP > epair2b: link state changed to UP > epair2b: link state changed to DOWN > epair2a: link state changed to DOWN > epair1a: link state changed to DOWN > epair1b: link state changed to DOWN > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > failed: atf-check failed; see the output of the test for details [0.197s= ] > sys/netpfil/pf/nat64.py:TestNAT64::test_address_unreachable -> epair0a:= Ethernet address: f6:fd:4b:c1:53:2d > epair0b: Ethernet address: 5e:59:15:d0:79:82 > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 02:1f:0f:68:f7:17 > epair1b: Ethernet address: 92:43:e4:76:55:96 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair2a: Ethernet address: 7a:d1:1e:45:06:b3 > epair2b: Ethernet address: 4a:7d:09:c7:93:73 > epair2a: link state changed to UP > epair2b: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: promiscuous mode enabled > lo0: promiscuous mode disabled > epair0a: link state changed to DOWN > epair0b: link state changed to DOWN > epair2a: link state changed to DOWN > epair2b: link state changed to DOWN > epair1a: link state changed to DOWN > epair1b: link state changed to DOWN > failed: /usr/tests/sys/netpfil/pf/nat64.py:173: AttributeError [4.710s] > sys/netpfil/pf/nat64.py:TestNAT64::test_bad_len -> epair0a: Ethernet ad= dress: 2e:b0:05:ae:d6:d8 > epair0b: Ethernet address: 16:e7:ed:1d:32:aa > epair0a: link state changed to UP > epair0b: link state changed to UP > epair1a: Ethernet address: 8e:fb:19:37:fb:8e > epair1b: Ethernet address: 06:53:47:b9:ae:a8 > epair1a: link state changed to UP > epair1b: link state changed to UP > epair2a: Ethernet address: 2a:90:ff:29:ca:a0 > epair2b: Ethernet address: 56:89:04:58:36:84 > epair2a: link state changed to UP > epair2b: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: link state changed to UP > lo0: promiscuous mode enabled > > > Fatal trap 12: page fault while in kernel mode > cpuid =3D 0; apic id =3D 00 > fault virtual address =3D 0x18 > fault code =3D supervisor read data, page not present > instruction pointer =3D 0x20:0xffffffff80c0f132 > stack pointer =3D 0x28:0xfffffe008aef2980 > frame pointer =3D 0x28:0xfffffe008aef29c0 > code segment =3D base 0x0, limit 0xfffff, type 0x1b > =3D DPL 0, pres 1, long 1, def32 0, gran 1 > processor eflags =3D interrupt enabled, resume, IOPL =3D 0 > current process =3D 12 (swi1: netisr 0) > rdi: fffffe008aef29d8 rsi: fffff8008be43e96 rdx: 00000000ffffffff > rcx: 0000000000008466 r8: fffffe008aef2900 r9: 0000000000000003 > rax: 0000000000000000 rbx: 0000000000000000 rbp: fffffe008aef29c0 > r10: 0000000000000001 r11: 0000000000000000 r12: 0000000000000000 > r13: 000000000000000b r14: 000000000000000b r15: 00000000000001f5 > trap number =3D 12 > panic: page fault > cpuid =3D 0 > time =3D 1759902263 > KDB: stack backtrace: > #0 0xffffffff80bc033d at kdb_backtrace+0x5d > #1 0xffffffff80b73726 at vpanic+0x136 > #2 0xffffffff80b735e3 at panic+0x43 > #3 0xffffffff8107bf69 at trap_pfault+0x3c9 > #4 0xffffffff81051a88 at calltrap+0x8 > #5 0xffffffff80d84b19 at in6_cksum_partial_l2+0x109 > #6 0xffffffff8295cab5 at fr_cksum+0xa5 > #7 0xffffffff829621dd at ipf_checkl4sum+0xbd > #8 0xffffffff829586f6 at ipf_checkv6sum+0x56 > #9 0xffffffff8295a601 at ipf_makefrip+0x1691 > #10 0xffffffff8295b6de at ipf_check+0x15e > #11 0xffffffff82958c28 at ipf_check_wrapper6+0x58 > #12 0xffffffff80cc3438 at pfil_mbuf_in+0x38 > #13 0xffffffff80d92b94 at ip6_input+0x484 > #14 0xffffffff80cc0c98 at swi_net+0x128 > #15 0xffffffff80b2d359 at ithread_loop+0x239 > #16 0xffffffff80b298eb at fork_exit+0x7b > #17 0xffffffff81052aae at fork_trampoline+0xe > Uptime: 1h18m43s > Automatic reboot in 15 seconds - press a key on the console to abort > + rc=3D0 > + echo 'bhyve return code =3D 0' > bhyve return code =3D 0 > + sudo /usr/sbin/bhyvectl '--vm=3Dtestvm-15-amd64-30' --destroy > + sh -ex freebsd-ci/scripts/test/extract-meta.sh > + METAOUTDIR=3Dmeta-out > + rm -fr meta-out > + mkdir meta-out > + tar xvf meta.tar -C meta-out > x ./ > x ./disable-zfs-tests.sh > x ./disable-dtrace-tests.sh > x ./auto-shutdown > x ./run.sh > x ./run-kyua.sh > x ./disable-notyet-tests.sh > + rm -f test-report.txt test-report.xml > + mv 'meta-out/test-report.*' . > mv: rename meta-out/test-report.* to ./test-report.*: No such file or dir= ectory > + report=3Dtest-report.xml > + [ -e freebsd-ci/jobs/FreeBSD-stable-15-amd64-test/xfail-list -a -e test= -report.xml ] > + rm -f disk-cam > + jot 5 > + rm -f disk1 > + rm -f disk2 > + rm -f disk3 > + rm -f disk4 > + rm -f disk5 > + rm -f disk-test.img > [PostBuildScript] - [INFO] Executing post build scripts. > [FreeBSD-stable-15-amd64-test] $ /bin/sh -xe /tmp/jenkins1219699292212458= 3673.sh > + ./freebsd-ci/artifact/post-link.py > Post link: {'job_name': 'FreeBSD-stable-15-amd64-test', 'commit': '23fbea= 8cf2f360dd45cb69c98f6f2931fff3721e', 'branch': 'stable-15', 'target': 'amd6= 4', 'target_arch': 'amd64', 'link_type': 'latest_tested'} > "Link created: stable-15/latest_tested/amd64/amd64 -> ../../23fbea8cf2f36= 0dd45cb69c98f6f2931fff3721e/amd64/amd64\n" > Recording test results > ERROR: Step =E2=80=98Publish JUnit test result report=E2=80=99 failed: No= test report files were found. Configuration error? > Checking for post-build > Performing post-build step > Checking if email needs to be generated > Email was triggered for: Failure - Any > Sending email for trigger: Failure - Any > Sending mail from default account using System Admin e-mail address