From nobody Tue Jun 9 14:46:25 2026 X-Original-To: bugs@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4gZWv51sJzz6g5W7 for ; Tue, 09 Jun 2026 14:46:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R13" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4gZWv51CYdz40PF for ; Tue, 09 Jun 2026 14:46:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1781016385; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jS1o5qdHrWgikoKx8lAMzeOeijfOQ52iUULi6kUA/Mw=; b=npynzr7hoHU6quHPQe8gqkTPMmRiyyzxXtHcJOZxVfxeNjCmqX+Nxb8I7rV7UIZYUQbM+o 45I7SzIDvtcUvmEu81HwUSQy5xvg4Pme0e71Tjowh5SXH/LkJPWgNXsByJYpMTYPIvDFov Dv88uoNfyojD+9a2bBUonZsfQN9VSz3qWWhhubTU4xRe/Ycl21LiZ8DOjbfOw+Cu8XVEly zYErTZBNe2h/IzqI2QCzTlOVRVdHHfLULOIKs8Q378xku7q9gL6+r0yam298w8pz42yDgG /5CMn1a6pY5ImWLTHsa7stjRI4l36LpMQoZw7YwDJWxmIThB+XT2ESsi97oKMg== ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1781016385; a=rsa-sha256; cv=none; b=Rp6Chlrx/b52IFBHjsfvuySsLjHSqbR36BTVOEBpcCmAsEGZQmLAu8w6A5LLCTsX+YA1LG DpiXRLuhoKC0e3iKCSFBeRBqj/OMU0zvR4Uq+t0gEmiZnaewy+VkluTm1DInTYCTqu9E65 +S6b7K4KGHkP3HQUodyWZF75IGo3ubhNZQL2fVYDHUqM7NSdHuU1LEZ44P7GdbuU7cldv7 v4OXNj4ujK2/jWJezKyvDpgl4OH2yKW3sV4nnDcndDffZ7grIHYpKYxTHsijGpsxvTH1GG eMGj2UUHlNAk1QXwABiRW67q1DEpgpAoLajF2E0nPlW+F8bMDjpFUxZfvInHAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1781016385; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=jS1o5qdHrWgikoKx8lAMzeOeijfOQ52iUULi6kUA/Mw=; b=xeln2Xb5XqrLVkpTM85aCL9O1294co7GuHx8NzywfcDoklarYP22GOKZWqljTYSlEnLezn 8rbcH9ANNjX3EWgJblZn/0yXOFHlwcnNWBH6jrP8IMX+VLCdJzybanWsJZi1KuoRXgbszJ QLWgfzKIXpxS2869hv2MENA4GEYnWy/gDyzGNj+CUT1O+Sg0WADLj4erK7ljB8Waf/Fm2/ ByoGyxjmgzONF8BeTaFNkWcfhgZm963PM+9OWOW2AiG4VHoFwVZGzcTaVuOe2GA/hw4lsF a7aGiZQ4gZu61VJyMqj1DsCWMPZImmNjakayDtHq/KPM9T95SkWtjId/ADCH1A== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4gZWv50Rh4zg0x for ; Tue, 09 Jun 2026 14:46:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 659EkOJ5003367 for ; Tue, 9 Jun 2026 14:46:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 659EkOBj003366 for bugs@FreeBSD.org; Tue, 9 Jun 2026 14:46:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: bugs@FreeBSD.org Subject: [Bug 295942] SSL_OP_ENABLE_KTLS_TX_ZEROCOPY_SENDFILE data corruption on files > 128KB Date: Tue, 09 Jun 2026 14:46:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 15.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: gallatin@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: bugs@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="UTF-8" X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Bug reports List-Archive: https://lists.freebsd.org/archives/freebsd-bugs List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-bugs@FreeBSD.org List-Id: List-Post: List-Help: List-Subscribe: List-Unsubscribe: List-Owner: Precedence: list MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D295942 Andrew Gallatin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |gallatin@FreeBSD.org --- Comment #1 from Andrew Gallatin --- I tried to reproduce this. I installed 15R into a bhyve VM and selected e1= 000 as the nic (which is as close as I can get to igb, and they both use iflib,= so I don't think that matters). I was unable to reproduce it. My conf file looks like: root@15R:/home/gallatin # egrep -v ^# /usr/local/etc/lighttpd/lighttpd.conf include "/usr/local/etc/lighttpd/lighttpd*annotated.conf" include "/usr/local/etc/lighttpd/conf-enabled/*.conf" server.modules +=3D ( "mod_openssl" ) $SERVER["socket"] =3D=3D ":443" { ssl.engine =3D "enable" ssl.privkey =3D "/usr/local/etc/lighttpd/ssl/server.key" ssl.pemfile =3D "/usr/local/etc/lighttpd/ssl/server.crt" } And after transferring a large file (/boot/kernel/kernel copied to the docu= ment root) many times, I don't see any issues. One thing I noticed is that I see separate_output elevated in my counters, which indicates the server is using sendfile (confirmed via truss). The reporters counters show inplace elevated: root@15R:/home/gallatin # sysctl kern.ipc.tls | grep -v ': 0' kern.ipc.tls.ifnet.permitted: 1 kern.ipc.tls.sw.gcm: 84 kern.ipc.tls.max_reclaim: 1024 kern.ipc.tls.sw_buffer_cache: 1 kern.ipc.tls.cbc_enable: 1 kern.ipc.tls.enable: 1 kern.ipc.tls.ifnet_max_rexmit_pct: 2 kern.ipc.tls.maxlen: 16384 kern.ipc.tls.stats.ocf.separate_output: 139557 kern.ipc.tls.stats.ocf.inplace: 312 kern.ipc.tls.stats.ocf.tls13_gcm_encrypts: 139869 kern.ipc.tls.stats.ocf.tls13_gcm_decrypts: 935 kern.ipc.tls.stats.active: 84 kern.ipc.tls.stats.enable_calls: 156 kern.ipc.tls.stats.offload_total: 156 kern.ipc.tls.stats.sw_tx_inqueue: 1 kern.ipc.tls.stats.threads: 8 Dirk: Are you serving from a ZFS or UFS fs? If you truss the web server w= hile serving (and ktls enabled), do you see sendfile? Eg: root@15R:/home/gallatin # truss -cp `pgrep httpd` ^Csyscall seconds calls errors close 0.000044609 2 0 shutdown 0.003182343 2 0 sendfile 0.011392569 240 26 pread 0.000103809 6 0 fstatat 0.000041602 2 0 recvmsg 0.000379371 23 1 sendmsg 0.000223300 4 0 setsockopt 0.000085522 4 0 write 0.000330193 12 2 getpid 0.000484688 18 0 kevent 1.888839601 257 0 read 0.000713765 22 6 accept4 0.000378697 4 2 ------------- ------- ------- 1.906200069 596 37 --=20 You are receiving this mail because: You are the assignee for the bug.=