From nobody Tue Jun 9 19:28:27 2026 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4gZf8W6Rx0z6gWCJ for ; Tue, 09 Jun 2026 19:28:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4gZf8W4ckJz3kZJ for ; Tue, 09 Jun 2026 19:28:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1781033307; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=viOIZoD9raLwji5wzEP90hK7T/zJ/W2/RmjxMVzodmQ=; b=YaMf0zONUF+kACFpJmo0ghOGm7f2JilYH/FrNJS/A0jBE9TKX6TcdRfcmow//zRtYJaXmD 7kHERswI5dFWgAHv6pzO8lXGL3G9F53nHSPaz2DXoSVh9j6Pn8AlN5mOpkxW6M6XiIWp27 EUactnMY+B6+ud1H//NZGo6HtUfbn1QVJ9TRJHypPhAwUnbekxADEepVXqO258287S/+zw tqBia5BlY62kHxM97PxEYU5en2zdaOcXrtCtii0W0Urkpidu3P6l6X8gq7hXAOcFRaSz+O UBeKWisCvtbCvVqAp4v/iI3nordGA8QZdOcmxREJNCuyahWzKgp7tyoYnayUxA== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1781033307; a=rsa-sha256; cv=none; b=J5LWtw1Yly9cx3MNV4ozd97Pnu1nagX8tsVj0XohlFwESh3ibfgUe1xF0ET4552S3P5fdQ WSM70XRWI4slLX8XK7HciVSGpLWjD+3BcdT6SDWk/Fw8NWweB4LVJp+jDduEiAIAyS8c4w I5xuZBmZaFdEG3Gm3z1w8GvX9zT8HD/JjyD30bjjN8ChJk3NDJZog9R78xYAMjqtC/ItMQ xtn/npGqmvZI9JkkfDuWpeeEah1Drc1zU2ROGkT2YXBSka6ZWS1T/EBly3JR66xyRjQKUg QEUXTOiLjJ2xbMq+ipAojbbbrhJWgDr/cd4ji2c1qrS/Ni0qRJJzSymDckRK6Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1781033307; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=viOIZoD9raLwji5wzEP90hK7T/zJ/W2/RmjxMVzodmQ=; b=FXmx7TuOvEQQ8eSfVwftfEj0E/goi9mT3ux8aOkvEApJ7HVvxY8WUyJ1Qm4g2IQ7gtTWpO 7UcJ3fBiEBGxYF1AJcA9jQFzhKwpEBMvIafOVFXwQu4ipyV1KuN3gprhf6Cge9kUf90bJb 4wXuo5j7EkLPsHHDtNSVWAjst5UWk+fu+R0tA+OwDqo6wbt25PMzKIbznkmlSADvJGvHhu yG32foi7rlQEnXUlC1/sPZ4dwkUQ8dTmr6sUCUR5HenRRQFCOFbkNF1fWPVOys1FdQaTYy qlat3brxYxIa1ZHUByfAGqslDLKx2bw09TNLl6fTV6b0mFYOvtrVflSI2kig1A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4gZf8W3yFcznv8 for ; Tue, 09 Jun 2026 19:28:27 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 659JSRfa022082 for ; Tue, 9 Jun 2026 19:28:27 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 659JSR13022080 for bugs@FreeBSD.org; Tue, 9 Jun 2026 19:28:27 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 295942] SSL_OP_ENABLE_KTLS_TX_ZEROCOPY_SENDFILE data corruption on files > 128KB Date: Tue, 09 Jun 2026 19:28:27 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gallatin@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@FreeBSD.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D295942 --- Comment #4 from Andrew Gallatin --- Your VM was not using ktls, based on those counters. I switched my VM from vtnet to e1000 and still didn't hit an issue. I don't think igb vs vtnet should matter. vtnet does not handle EXTPG mbufs, but t= hat just means the mbuf chain is re-written in ip_output, that does not impact = the crypto. So far I've tried: - current, UFS, no repro, vtnet - 15R, UFS, no repro, vtnet - 15R, ZFS, no repro, em0 I'd really like to figure out the issue here.=20=20 The big thing that stands out in the ktls stats is ocf.inplace vs ocf.separate_output. Our (Netflix) workload is nginx, with sendfile, and s= hows ~99% separate output, which is the path taken by sendfile without hdr/trl. = I recently fixed a bug in main (which I need to MFC to 15) that fixes a probl= em with mixing sendfile headers with normal sendfile file data (https://cgit.freebsd.org/src/commit/?id=3Dfd9af1e7084c550358d9598407f9ee75= 83e6a53f), but the failure mode there is very different. But I'm concerned there is s= ome similar bug someplace that has gone undiscovered because we don't use that = code path. The other thing you should be aware of is that the benefits of software ktls are mostly limited to the sendfile path, because it avoids having to copy t= he data into userspace, encrypt it, and copy it back into the kernel. If the = data is warm in cache because its not static, then there is not much benefit to = SW ktls (it may even cost more). So if I was you, I'd either disable ktls or = try to figure out why your static content is not using sendfile. Please don't take this as me trying to sweep this bug under the rug; I really want to fi= gure it out. If you could replicate it in a VM, that would be amazing. --=20 You are receiving this mail because: You are the assignee for the bug.=