From owner-freebsd-net@freebsd.org Thu Jun 25 15:57:44 2020 Return-Path: Delivered-To: freebsd-net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 8EA0135E90C for ; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mailman.nyi.freebsd.org (mailman.nyi.freebsd.org [IPv6:2610:1c1:1:606c::50:13]) by mx1.freebsd.org (Postfix) with ESMTP id 49t4RD3GVYz4FWk for ; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: by mailman.nyi.freebsd.org (Postfix) id 6E69135E90B; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) Delivered-To: net@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 6E2C835E4DC for ; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49t4RD2LhPz4FT4 for ; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4C24425452 for ; Thu, 25 Jun 2020 15:57:44 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 05PFvi6b099286 for ; Thu, 25 Jun 2020 15:57:44 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 05PFvifF099285 for net@FreeBSD.org; Thu, 25 Jun 2020 15:57:44 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 246951] carp(4): Active CARP member crashes: panic, trap_pfault, ip_input || ip_output when using ipSec, AES-NI (on Intel I350) Date: Thu, 25 Jun 2020 15:57:44 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.3-STABLE X-Bugzilla-Keywords: crash, needs-qa, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: igor-fbsdbugs@grinchenko.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: mfc-stable12? mfc-stable11? X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-net@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Networking and TCP/IP with FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 25 Jun 2020 15:57:44 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D246951 igor-fbsdbugs@grinchenko.org changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |igor-fbsdbugs@grinchenko.or | |g --- Comment #11 from igor-fbsdbugs@grinchenko.org --- unfortunately dtrace is not available on pfsense. is there another way to g= et the refcounts? I can confirm, however, that it does take a few days for this crash to happ= en. usually within 4-8 days, but never immediately. I have a handful of crash backtraces from previous crashes. I will paste the first 3 few lines from each. let me know if you need the entire dumps: Tracing pid 12 tid 100285 td 0xfffff8000ccf6620 ip_input() at ip_input+0x60e/frame 0xfffffe0451afee70 netisr_dispatch_src() at netisr_dispatch_src+0xa8/frame 0xfffffe0451afeec0 ether_demux() at ether_demux+0x173/frame 0xfffffe0451afeef0 Tracing pid 12 tid 100263 td 0xfffff8000c88f620 ip_output() at ip_output+0x1418/frame 0xfffffe0451a15a60 ipsec_process_done() at ipsec_process_done+0x1c8/frame 0xfffffe0451a15ab0 esp_output_cb() at esp_output_cb+0xeb/frame 0xfffffe0451a15b10 db:0:kdb.enter.default> bt Tracing pid 12 tid 100283 td 0xfffff8000c67b000 ip_output() at ip_output+0x1418/frame 0xfffffe0451af4a60 ipsec_process_done() at ipsec_process_done+0x1c8/frame 0xfffffe0451af4ab0 esp_output_cb() at esp_output_cb+0xeb/frame 0xfffffe0451af4b10 Tracing pid 12 tid 100270 td 0xfffff8000c8cf000 ip_input() at ip_input+0x60e/frame 0xfffffe0451a38e70 netisr_dispatch_src() at netisr_dispatch_src+0xa8/frame 0xfffffe0451a38ec0 ether_demux() at ether_demux+0x173/frame 0xfffffe0451a38ef0 Tracing pid 12 tid 100267 td 0xfffff8000c3f3620 ip_input() at ip_input+0x60e/frame 0xfffffe0451a29e70 netisr_dispatch_src() at netisr_dispatch_src+0xa8/frame 0xfffffe0451a29ec0 ether_demux() at ether_demux+0x173/frame 0xfffffe0451a29ef0 Tracing pid 18 tid 100138 td 0xfffff800085d1620 ip_output() at ip_output+0x1418/frame 0xfffffe044f4181c0 ipsec_process_done() at ipsec_process_done+0x1c8/frame 0xfffffe044f418210 esp_output_cb() at esp_output_cb+0xeb/frame 0xfffffe044f418270 Tracing pid 12 tid 100264 td 0xfffff8000c15f000 in_broadcast() at in_broadcast+0x43/frame 0xfffffe0451a1ac40 ip_output() at ip_output+0x7be/frame 0xfffffe0451a1ad70 ip_forward() at ip_forward+0x2b5/frame 0xfffffe0451a1ae10 our pfsense host is relatively busy pushing about 300mbit of traffic throug= h, with about half of it to the ipsec tunnel. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.=