From nobody Mon Oct 21 10:17:01 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXB7L0Ggtz5Yp5T for ; Mon, 21 Oct 2024 10:17:02 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXB7K4YW0z3xMZ for ; Mon, 21 Oct 2024 10:17:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729505821; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=aRXOu/nc47XsrX+7ij0vblh8RSkwgHdHLUIdoOloDG0=; b=cWfEj0wGXNQFenYQVvN4lQu3SSwhTjI+5mu9wUqJHuK2VLpvrwB40lJBrNnuXcfR3M7XzE Gj2O8BCZMpS0gHo0l4YBGDaLldfh5nxSEG2IKTcAF6nZU8L/5LZ1k0QJ/UsdAmcEfxtyp3 49Cm15vU2nFY/Qj1jcfyeUR5lMbz9Mt/fkA6EmQY8dM8wtP0g7kPDR9x393dgRJ0ZAocQZ 2RLxy33X4dA3M4BkiPkspLnFPsidKyLh+0PnBbQHPJnifOxKa8ptyuorCRUcDu4drVWfec Ceo7HvHsyoIHjkqIxT+JVTc6HIG6GvHQtYE9ju2o0x31ZS6Uaj4bcAAHJwErDw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729505821; a=rsa-sha256; cv=none; b=kPL0hk2jL/GMvxV3tchUnf2/M4GhCJ1SqFK5ULm6Ph+HrIDOLydyozHijtMul/aqElhJNW 2u/VaE4tpZY69j7l7vRUgedmrew5BZjM0hDpy8S5qgwx2wuF68FecqGBOooGw/PJ/VIWGa hC0WvvMas9RnIiT/QRJMS/wkVZouCBzUyN4LWofHZ/8wr3Uz7CExKFRtmZhX2VXja6rv/1 dCwL5cWycPW79HifqP/MUogd+O40hRkMOUP+10jrsFmkDor3UZX1rAaSmKGfN5EJk12s/4 7hdvn/KpEhdqfpB1BSiQlqo95y5C4Kh4Njl8YCgK88I1EvScdCGF8dt7OGt2Hw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XXB7K48zYzQ97 for ; Mon, 21 Oct 2024 10:17:01 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49LAH1vN031322 for ; Mon, 21 Oct 2024 10:17:01 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49LAH1ea031321 for net@FreeBSD.org; Mon, 21 Oct 2024 10:17:01 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Mon, 21 Oct 2024 10:17:01 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pascal.guitierrez@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 --- Comment #20 from pascal.guitierrez@gmail.com --- (In reply to Kevin Bowling from comment #19) Thanks Kevin, yes you are right, repeating the test gets to a state where interrupts are processed on a single core and packet drops occur: 13 igb0:rxq0 7972 igb0:rxq1 97 igb0:rxq2 1 igb0:rxq3 On a good run there are zero drops and interrupts being processed on two co= res: 8041 igb0:rxq0 1 igb0:rxq1 8038 igb0:rxq2 igb0:rxq3 Do you know if this is expected behaviour or is it a problem? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 21 14:42:49 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXJ2p177yz5ZMGW for ; Mon, 21 Oct 2024 14:43:30 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f54.google.com (mail-lf1-f54.google.com [209.85.167.54]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXJ2n1CVSz4b7G for ; Mon, 21 Oct 2024 14:43:29 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of ccfreebsd@gmail.com designates 209.85.167.54 as permitted sender) smtp.mailfrom=ccfreebsd@gmail.com; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none) Received: by mail-lf1-f54.google.com with SMTP id 2adb3069b0e04-539e4908837so619337e87.0 for ; Mon, 21 Oct 2024 07:43:29 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729521806; x=1730126606; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=8iPAayadS1tC3PLQt6jx1fucIdBCfv0+dVgvWF+VpuQ=; b=KrLue5PIxZdOGvpcXcEqnpKX85qPW0Hpguzq7p+Cr7dnza0T+jF0+sT4ssnAYsjFWs PNiQMz0gpNwXHgna9gimlC+bT0UMgyjwnDA3O7i6HFtjqYWY7j+rfY6N2vDz41Umeduy Xe0JVMjKjyw0WD9nV0zdgs6KkFwsD2YGQlEdLoVTRQhwN6+PO7k5bw2y08py/D6Y9zt1 8kYjVu92nB7qCWkC3EW6m48eSfBgOGvaSHuCq0A51gP8SUsBU//6ZZeuYusSlyUDeEeI VixAlUivIIGob3By2HAS7Wd/FMvfteRRhs6UvvROZiLLCG/5b3ibxB7V7kAbhjuTgObo Uoeg== X-Gm-Message-State: AOJu0YwFNNtoh9kPOBsUwJMZPpXn9A8F2L030kDRPVzBDKzgW0m0xgw1 4BOp1CsmgBB+w8SQpTpuZgsOHrZ9zvBPrPe0jUBlox+6SxSRwuxNtBjUEw+n X-Google-Smtp-Source: AGHT+IEMuMbwYgCrnvWxyi64X9u+rj0ir0SLB7zx2t5JVLNd2N3/QbhJYX/TqxIaR3RnodmG1cZTpg== X-Received: by 2002:a05:6512:2386:b0:52f:c438:883c with SMTP id 2adb3069b0e04-53a154443efmr1831067e87.1.1729521806034; Mon, 21 Oct 2024 07:43:26 -0700 (PDT) Received: from mail-lf1-f45.google.com (mail-lf1-f45.google.com. [209.85.167.45]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-53a223f002dsm500070e87.108.2024.10.21.07.43.25 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 21 Oct 2024 07:43:25 -0700 (PDT) Received: by mail-lf1-f45.google.com with SMTP id 2adb3069b0e04-539e4908837so619333e87.0 for ; Mon, 21 Oct 2024 07:43:25 -0700 (PDT) X-Received: by 2002:a05:6512:3ca5:b0:52f:413:30de with SMTP id 2adb3069b0e04-53a154dab9amr1781292e87.7.1729521805630; Mon, 21 Oct 2024 07:43:25 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <20240912181618.7895d10ad5ff2ebae9883192@gmail.com> In-Reply-To: From: Cheng Cui Date: Mon, 21 Oct 2024 10:42:49 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: "freebsd-net@FreeBSD.org" Content-Type: multipart/alternative; boundary="000000000000db2dbc0624fdac81" X-Spamd-Result: default: False [-0.80 / 15.00]; NEURAL_HAM_LONG(-0.99)[-0.986]; NEURAL_SPAM_SHORT(0.93)[0.934]; NEURAL_HAM_MEDIUM(-0.85)[-0.849]; FORGED_SENDER(0.30)[cc@freebsd.org,ccfreebsd@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_TO(0.00)[f-m.fm]; FROM_HAS_DN(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; ARC_NA(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; MISSING_XM_UA(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[cc@freebsd.org,ccfreebsd@gmail.com]; FREEMAIL_ENVFROM(0.00)[gmail.com]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.54:from]; R_DKIM_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.54:from,209.85.167.45:received] X-Rspamd-Queue-Id: 4XXJ2n1CVSz4b7G X-Spamd-Bar: / --000000000000db2dbc0624fdac81 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Change the subject to `Performance test for CUBIC in stable/14`, was `Re: Performance issues with vnet jails + epair + bridge`. I actually prepared two patches, one depends on the other: https://reviews.freebsd.org/D47218 << apply this patch firstly https://reviews.freebsd.org/D47213 << apply this patch secondly Please let me know if you have any questions. It passed my local test on a 1% drop rate link, with nearly 3.9X performance improvement. before patching: [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.07 sec 27.0 MBytes 211 Mbits/sec 207 12.8 KBytes [ 5] 1.07-2.12 sec 18.0 MBytes 144 Mbits/sec 151 11.4 KBytes [ 5] 2.12-3.07 sec 22.0 MBytes 194 Mbits/sec 189 11.8 KBytes [ 5] 3.07-4.07 sec 23.0 MBytes 194 Mbits/sec 203 10.8 KBytes [ 5] 4.07-5.06 sec 18.0 MBytes 153 Mbits/sec 165 15.0 KBytes [ 5] 5.06-6.11 sec 25.0 MBytes 200 Mbits/sec 227 26.9 KBytes [ 5] 6.11-7.07 sec 23.0 MBytes 201 Mbits/sec 189 10.7 KBytes [ 5] 7.07-8.07 sec 23.0 MBytes 193 Mbits/sec 215 12.7 KBytes [ 5] 8.07-9.03 sec 22.0 MBytes 191 Mbits/sec 185 10.4 KBytes [ 5] 9.03-10.09 sec 24.0 MBytes 191 Mbits/sec 219 1.41 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.09 sec 225 MBytes 187 Mbits/sec 1950 sender [ 5] 0.00-10.14 sec 225 MBytes 186 Mbits/sec receiver iperf Done. after patching: [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.08 sec 118 MBytes 919 Mbits/sec 872 47.5 KBytes [ 5] 1.08-2.07 sec 109 MBytes 917 Mbits/sec 849 56.9 KBytes [ 5] 2.07-3.09 sec 111 MBytes 915 Mbits/sec 810 54.5 KBytes [ 5] 3.09-4.07 sec 108 MBytes 922 Mbits/sec 831 43.8 KBytes [ 5] 4.07-5.07 sec 109 MBytes 919 Mbits/sec 813 31.1 KBytes [ 5] 5.07-6.02 sec 103 MBytes 913 Mbits/sec 815 60.2 KBytes [ 5] 6.02-7.07 sec 116 MBytes 921 Mbits/sec 850 58.2 KBytes [ 5] 7.07-8.06 sec 109 MBytes 922 Mbits/sec 822 46.4 KBytes [ 5] 8.06-9.06 sec 109 MBytes 913 Mbits/sec 843 59.4 KBytes [ 5] 9.06-10.07 sec 110 MBytes 917 Mbits/sec 815 42.3 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.07 sec 1.08 GBytes 918 Mbits/sec 8320 sender [ 5] 0.00-10.11 sec 1.08 GBytes 915 Mbits/sec receiver iperf Done. cc On Fri, Oct 18, 2024 at 9:13=E2=80=AFAM void wrote: > On Fri, Oct 18, 2024 at 07:28:49AM -0400, Cheng Cui wrote: > > >The patch is a TCP congestion control algorithm improvement. So to > >be clear, it only impacts a TCP data sender. These hosts are just traffi= c > >forwarders, not TCP sender/receiver. > > > >I can send you a patch for the FreeBSD 14/stable to test performance > >improvement. > > sure! I'm happy to test > > >If you think FreeBSD 14.x releases are critical to your business, or you > >can't wait until FreeBSD 15 is released, you can file a request to add > this > >patch in the 14.x. I think https://bugs.freebsd.org/bugzilla/ is where a > >user can file such request. If it is approved, which I am not sure if > >it can be approved, then maybe it can be included in the next 14.x > release. > > thank you, I'll try :D > -- > > --=20 Best Regards, Cheng Cui --000000000000db2dbc0624fdac81 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Change the subject to `Performance test for CUBIC in = stable/14`, was `Re: Performan= ce issues with vnet jails + epair + bridge`.

I actually prepared two patches, one depends on the other:

=
https://reviews.freebsd.org/D47218 =C2=A0 =C2=A0 << apply= this patch firstly

before patching:
[ ID] Interval =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Transfer =C2=A0 = =C2=A0 Bitrate =C2=A0 =C2=A0 =C2=A0 =C2=A0 Retr =C2=A0Cwnd
[ =C2=A05] = =C2=A0 0.00-1.07 =C2=A0 sec =C2=A027.0 MBytes =C2=A0 211 Mbits/sec =C2=A020= 7 =C2=A0 12.8 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 1.07-2.12 = =C2=A0 sec =C2=A018.0 MBytes =C2=A0 144 Mbits/sec =C2=A0151 =C2=A0 11.4 KBy= tes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 2.12-3.07 =C2=A0 sec =C2=A02= 2.0 MBytes =C2=A0 194 Mbits/sec =C2=A0189 =C2=A0 11.8 KBytes =C2=A0 =C2=A0 = =C2=A0
[ =C2=A05] =C2=A0 3.07-4.07 =C2=A0 sec =C2=A023.0 MBytes =C2=A0 = 194 Mbits/sec =C2=A0203 =C2=A0 10.8 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2= =A05] =C2=A0 4.07-5.06 =C2=A0 sec =C2=A018.0 MBytes =C2=A0 153 Mbits/sec = =C2=A0165 =C2=A0 15.0 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 5.0= 6-6.11 =C2=A0 sec =C2=A025.0 MBytes =C2=A0 200 Mbits/sec =C2=A0227 =C2=A0 2= 6.9 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 6.11-7.07 =C2=A0 sec = =C2=A023.0 MBytes =C2=A0 201 Mbits/sec =C2=A0189 =C2=A0 10.7 KBytes =C2=A0 = =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 7.07-8.07 =C2=A0 sec =C2=A023.0 MBytes = =C2=A0 193 Mbits/sec =C2=A0215 =C2=A0 12.7 KBytes =C2=A0 =C2=A0 =C2=A0
= [ =C2=A05] =C2=A0 8.07-9.03 =C2=A0 sec =C2=A022.0 MBytes =C2=A0 191 Mbits/s= ec =C2=A0185 =C2=A0 10.4 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 = 9.03-10.09 =C2=A0sec =C2=A024.0 MBytes =C2=A0 191 Mbits/sec =C2=A0219 =C2= =A0 1.41 KBytes =C2=A0 =C2=A0 =C2=A0
- - - - - - - - - - - - - - - - - = - - - - - - - -
[ ID] Interval =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Transf= er =C2=A0 =C2=A0 Bitrate =C2=A0 =C2=A0 =C2=A0 =C2=A0 Retr
[ =C2=A05] =C2= =A0 0.00-10.09 =C2=A0sec =C2=A0 225 MBytes =C2=A0 187 Mbits/sec =C2=A01950 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 sender
[ =C2=A05] =C2=A0 0.00-= 10.14 =C2=A0sec =C2=A0 225 MBytes =C2=A0 186 Mbits/sec =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0receiver

iperf Done.

after patching:
[ ID] Interval =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 Transfer =C2=A0 =C2=A0 Bitrate =C2=A0 =C2=A0 =C2= =A0 =C2=A0 Retr =C2=A0Cwnd
[ =C2=A05] =C2=A0 0.00-1.08 =C2=A0 sec =C2=A0= 118 MBytes =C2=A0 919 Mbits/sec =C2=A0872 =C2=A0 47.5 KBytes =C2=A0 =C2=A0= =C2=A0
[ =C2=A05] =C2=A0 1.08-2.07 =C2=A0 sec =C2=A0 109 MBytes =C2=A0= 917 Mbits/sec =C2=A0849 =C2=A0 56.9 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2= =A05] =C2=A0 2.07-3.09 =C2=A0 sec =C2=A0 111 MBytes =C2=A0 915 Mbits/sec = =C2=A0810 =C2=A0 54.5 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 3.0= 9-4.07 =C2=A0 sec =C2=A0 108 MBytes =C2=A0 922 Mbits/sec =C2=A0831 =C2=A0 4= 3.8 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 4.07-5.07 =C2=A0 sec = =C2=A0 109 MBytes =C2=A0 919 Mbits/sec =C2=A0813 =C2=A0 31.1 KBytes =C2=A0 = =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 5.07-6.02 =C2=A0 sec =C2=A0 103 MBytes = =C2=A0 913 Mbits/sec =C2=A0815 =C2=A0 60.2 KBytes =C2=A0 =C2=A0 =C2=A0
= [ =C2=A05] =C2=A0 6.02-7.07 =C2=A0 sec =C2=A0 116 MBytes =C2=A0 921 Mbits/s= ec =C2=A0850 =C2=A0 58.2 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 = 7.07-8.06 =C2=A0 sec =C2=A0 109 MBytes =C2=A0 922 Mbits/sec =C2=A0822 =C2= =A0 46.4 KBytes =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 8.06-9.06 =C2=A0= sec =C2=A0 109 MBytes =C2=A0 913 Mbits/sec =C2=A0843 =C2=A0 59.4 KBytes = =C2=A0 =C2=A0 =C2=A0
[ =C2=A05] =C2=A0 9.06-10.07 =C2=A0sec =C2=A0 110 = MBytes =C2=A0 917 Mbits/sec =C2=A0815 =C2=A0 42.3 KBytes =C2=A0 =C2=A0 =C2= =A0
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval= =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 Transfer =C2=A0 =C2=A0 Bitrate =C2=A0 = =C2=A0 =C2=A0 =C2=A0 Retr
[ =C2=A05] =C2=A0 0.00-10.07 =C2=A0sec =C2=A01= .08 GBytes =C2=A0 918 Mbits/sec =C2=A08320 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 sender
[ =C2=A05] =C2=A0 0.00-10.11 =C2=A0sec =C2=A01.08 GByt= es =C2=A0 915 Mbits/sec =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0receiver

iperf Done.

cc
On Fri, O= ct 18, 2024 at 9:13=E2=80=AFAM void <void= @f-m.fm> wrote:
On Fri, Oct 18, 2024 at 07= :28:49AM -0400, Cheng Cui wrote:

>The patch is a TCP congestion control algorithm improvement. So to
>be clear, it only impacts a TCP data sender. These hosts are just traff= ic
>forwarders, not TCP sender/receiver.
>
>I can send you a patch for the FreeBSD 14/stable to test performance >improvement.

sure! I'm happy to test

>If you think FreeBSD 14.x releases are critical to your business, or yo= u
>can't wait until FreeBSD 15 is released, you can file a request to = add this
>patch in the 14.x. I think https://bugs.freebsd.org/bugzilla/<= /a> is where a
>user can file such request. If it is approved, which I am not sure if <= br> >it can be approved, then maybe it can be included in the next 14.x rele= ase.

thank you, I'll try :D
--



--
Best Regards,
Cheng Cui
--000000000000db2dbc0624fdac81-- From nobody Mon Oct 21 18:24:51 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXNyJ6F2pz5Zc4F for ; Mon, 21 Oct 2024 18:24:56 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-b8-smtp.messagingengine.com (fhigh-b8-smtp.messagingengine.com [202.12.124.159]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXNyH1JTJz4Db9 for ; Mon, 21 Oct 2024 18:24:55 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=xO6EqmYu; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=b5+AmMXK; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.159 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-06.internal (phl-compute-06.phl.internal [10.202.2.46]) by mailfhigh.stl.internal (Postfix) with ESMTP id 60BDE25400E4 for ; Mon, 21 Oct 2024 14:24:53 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-06.internal (MEProxy); Mon, 21 Oct 2024 14:24:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729535093; x=1729621493; bh=AzddR0BuuJ rjlCGvpV9OzQYdttdKoOxXrbG6hD60grw=; b=xO6EqmYu26bTkStut20qHmVF+a Jl4YcuVDyBOBKWMAO/foPtEwZNrdO1qZ+HAEWyzL+J2Q+khPY0yXm3z2BqBvpwco 7WsQO7CZc8J0qSZIRQ7qqwYB54ncFTwYE2MevixpYyMOfebtFPoYUG5uizwZ8d24 kqBq2xIH2VCAP8rLijBeE1MhmZPGSircke9RW+ZEUC0ltxlMY82dhQ4IPYxqmmn2 egvT4yCU/FOZfFk3JSk1TgMw9xoR72eTFMFkyHaR+nZApg4Xm6swZc/BxVzmqVJt UgfauI6OjjGH1rtawPGJFSEgM32Tk2xSnP9t2NP5xhaLHbkvwYF7Xke1B20w== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729535093; x=1729621493; bh=AzddR0BuuJrjlCGvpV9OzQYdttdK oOxXrbG6hD60grw=; b=b5+AmMXKs4pig5/DcDcFIw6RFe0pRUSYbdngiJXbMeM/ 6a55xNqK2x8x2DyAhwQnfAIk2WYjUaQQbTtkGo10x+fhxPYxL9cYfNxZF6NioKxm 3BExCwwWFWx4xbFhXwFXSXhpKVHMHgbZLUxQUGD5fATAYvzw+9Gbw5W4CQtcIh4A /Gk3sD/96rXv608vzkyzoBOj8io9lmWA8fyIIb6XZk++KcvmoGRjmF17qp+Ez4az NSkF5PSyOewKiDFkS527qI+2ifFsBK/KdGeFnP9kRMSbwkM2Rm2P8e+bKvIMllHS 8so7eA+2g9pRKu6fSDzKhiGTHeKKDs/XL7y3ZlxTPA== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdehledguddvhecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdp uffrtefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvf fukfhfgggtuggjsehttdertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdq mhdrfhhmqeenucggtffrrghtthgvrhhnpedthfehueetjeduffekhfdthfefkeegtddvie etvefgjedtgfeffffhueeiledtieenucffohhmrghinhepfhhrvggvsghsugdrohhrghen ucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhiug esfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgt phhtthhopehfrhgvvggsshguqdhnvghtsehfrhgvvggsshgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Mon, 21 Oct 2024 14:24:52 -0400 (EDT) Date: Mon, 21 Oct 2024 19:24:51 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: Performance test for CUBIC in stable/14 Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.60 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.159:from]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:151847, ipnet:202.12.124.0/24, country:AU]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XXNyH1JTJz4Db9 X-Spamd-Bar: --- On Mon, Oct 21, 2024 at 10:42:49AM -0400, Cheng Cui wrote: >Change the subject to `Performance test for CUBIC in stable/14`, was `Re: >Performance issues with vnet jails + epair + bridge`. > >I actually prepared two patches, one depends on the other: > >https://reviews.freebsd.org/D47218 << apply this patch firstly >https://reviews.freebsd.org/D47213 << apply this patch secondly > >Please let me know if you have any questions. Hi, What version (git -C /usr/src rev-list --count --first-parent HEAD) did you patch? I installed FreeBSD-14.1-STABLE-amd64-20241017-d36ba3989ca9-269125-disc1.iso and then updated the sources with git before checking out stable/14 which is n269252, applying the patches and building/installing kernel from there. What's the exact iperf command you're using please? I'm using # iperf --time 60 -c 192.168.1.232 but I'm not sure [see note a] if that one would give comparable tests to yours. In my context, the bge0 interface has hardware offloading enabled (as it does by default) Here's before and after patch results. The reference speed is that of the bhyve host. There seems to be a large delta between fastest and slowest speeds. 1. bhyve host [ ID] Interval Transfer Bandwidth [ 1] 0.00-60.03 sec 6.58 GBytes 941 Mbits/sec 2. 20241017-d36ba3989ca9-269125 [ ID] Interval Transfer Bandwidth [ 1] 0.00-60.02 sec 5.16 GBytes 738 Mbits/sec 3. n269252-e18ba5c5555a after patches applied and reboot [ ID] Interval Transfer Bandwidth [ 1] 0.00-60.01 sec 4.87 GBytes 697 Mbits/sec [a] iperf method from earlier emails iperf -B 192.168.1.13 -c 192.168.1.232 -l 1M -t 30 -i 2 -e ; netstat -nCRp tcp | egrep "Active|Proto|5001" ------------------------------------------------------------ Client connecting to 192.168.1.232, TCP port 5001 with pid 16360 (1/0 flows/load) Write buffer size: 1048576 Byte TCP congestion control using cubic TOS defaults to 0x0 (dscp=0,ecn=0) (Nagle on) TCP window size: 32.8 KByte (default) ------------------------------------------------------------ [ 1] local 192.168.1.13%vtnet0 port 42853 connected with 192.168.1.232 port 5001 (sock=3) on 2024-10-21 19:17:24.491 (BST) [ ID] Interval Transfer Bandwidth Write/Err [ 1] 0.00-2.00 sec 151 MBytes 633 Mbits/sec 151/0 [ 1] 2.00-4.00 sec 159 MBytes 667 Mbits/sec 159/0 [ 1] 4.00-6.00 sec 148 MBytes 621 Mbits/sec 148/0 [ 1] 6.00-8.00 sec 200 MBytes 839 Mbits/sec 200/0 [ 1] 8.00-10.00 sec 197 MBytes 826 Mbits/sec 197/0 [ 1] 10.00-12.00 sec 182 MBytes 763 Mbits/sec 182/0 [ 1] 12.00-14.00 sec 195 MBytes 818 Mbits/sec 195/0 [ 1] 14.00-16.00 sec 175 MBytes 734 Mbits/sec 175/0 [ 1] 16.00-18.00 sec 133 MBytes 558 Mbits/sec 133/0 [ 1] 18.00-20.00 sec 127 MBytes 533 Mbits/sec 127/0 [ 1] 20.00-22.00 sec 201 MBytes 843 Mbits/sec 201/0 [ 1] 22.00-24.00 sec 194 MBytes 814 Mbits/sec 194/0 [ 1] 24.00-26.00 sec 199 MBytes 835 Mbits/sec 199/0 [ 1] 26.00-28.00 sec 171 MBytes 717 Mbits/sec 171/0 [ 1] 28.00-30.00 sec 189 MBytes 793 Mbits/sec 189/0 [ 1] 0.00-30.00 sec 2.56 GBytes 733 Mbits/sec 2622/0 Active Internet connections Proto Recv-Q Send-Q Local Address Foreign Address flowid ftype CC cwin ssthresh MSS ECN tcp4 0 0 192.168.1.13.42853 192.168.1.232.5001 00000000 63 cubic 1721802 891968 1460 off -- From nobody Mon Oct 21 19:59:37 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXR3Z5Gd5z5ZhbH for ; Mon, 21 Oct 2024 19:59:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXR3Z4B0jz4YCx for ; Mon, 21 Oct 2024 19:59:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729540778; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=1TKc9gByGzNI9PjAYpmPQDG6z8xdRkrXUXzoH8CCPsQ=; b=BEMuu6ZoZlLVr6QzTgN97mLr++cN6AKH6zIjhmql4fXv9yDu7LmugGb3dggx2xbimgvGY1 t0aQSYCxh9KZ3q+YjSQcKj2Xlplg4Gp+7MbvrEMoZzQCx5wG++38OC9XnQjEBec+9CPmab gDnxBtPw31uNJWl4tjombhJy68zctHYiLZ5PIiPW/75Zhxi5tTzAp/99zNQILkFqt4F044 1POlXUh2aUTHDrmvuCjZ7z3gD9jNG3T9epgZkoa6WhD2arzYaPfuOg8cPLPFF2Rv3opczl aVVNKbCTUZO/KdyqVrjIdxF/jW64v/NjcOCNbWz9jp/1qi0aixvEywrmnvlydA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729540778; a=rsa-sha256; cv=none; b=RqFPFH/qtGi3jjW0rrqPofd2kiQEzt13jwNa8/c7FZyS9j8mG4pc6nrmGpcC4MfeNMrIuk YLMlEK3AaP+bGA0JpW+1KNlW3q0oGkmSZJQoJc53w9cyD/TiJ/cDs0qbQ+JuieZjY7vO9B 77khiP7WnOt6k6a2bB/Y9965v3YsYutcV42yRKj8q3Y+BNqy9i43Ezj3e/lywbb0tiYHQC w9MPSGOFZWe2DzokL8HlzYTCRnwFMl9zZBz3b0W85lXoms3inhBb5TuILHCRkLtajE3D6H U76fO0IMSPP/cnfhpUi1xTpWCYebkrEZSTfDcn7OEsHzDzyXWPgN+/DlJYIUNw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XXR3Z3pBKzkgn for ; Mon, 21 Oct 2024 19:59:38 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49LJxcBH075264 for ; Mon, 21 Oct 2024 19:59:38 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49LJxcvn075263 for net@FreeBSD.org; Mon, 21 Oct 2024 19:59:38 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Mon, 21 Oct 2024 19:59:37 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 --- Comment #21 from Kevin Bowling --- (In reply to pascal.guitierrez from comment #20) > Do you know if this is expected behaviour or is it a problem? Caveat it has been a long time since I have been line-rating large numbers = of FreeBSD systems so I may not be privy to all the developments in the network stack.. but I would say more /known/ than /expected/. With the if_bridge in play maybe you are more likely to see this since that may imply TSO was mas= ked off and you have a more expensive transmit path. I think https://reviews.freebsd.org/D4295 would be one way to fix the issue= but I am not sure it is the only or best way. In principle there isn't a problem because dropping packets is an expected behavior of overfull queues at any point of the network and TCP or other protocols should be dealing with it. But it is obviously suboptimal if we = have enough context to do something smarter. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Mon Oct 21 20:10:25 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXRJ23fCnz5ZjhN for ; Mon, 21 Oct 2024 20:10:26 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXRJ16ZRbz4ZKw for ; Mon, 21 Oct 2024 20:10:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729541425; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=ie0bPSbq2JuNWwBLkxt37SzbGUQnrIdwSXteGDHh4S0=; b=AM7is4m/F3HxTFUcUxTXH7N3MHgGulcSou4xCtHlfNkosl0MqEnrg9jZHZbQ3DIf16erxN LtRkBNYsP0zpIgIn9aGtIiHpRNoa0jzSJXCCXUgyqVbFRKG4hszmgvdZ0UKpPqVnO4UQCw F1OHZMXF54DD21q+Zim765ZTriq6ags3jjgZ5krNBgbvDzHwhuwhY+DulqnqFrPkRgCXMD 5IGSpF6zLkwdBzOPVc0BenSllCDvpZkMH0aZ+eMaxblZF/gxYEDBWpHliCm0iCWx1mT39v arKRurRzlavzzAD4Zca+/mZyuUon6mKRyKGXwIxDR+uf/ync/+Prl8teJIO5oQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729541425; a=rsa-sha256; cv=none; b=Z7Qiqm+nuvWMZdcfDXbQoiFaBaCIuI7LzsO9FyFZqSEvm8y8hGowZIJY9EGf8Q7gmzD0CA 7HylTPdtie9/g97MynMukECrPUh4tUD/jgqofbzWdV0pwRYiNgXvvRRMTrLqg/kTykR3lW 0gSiKECkHb7rNvCfXzzN+kS2gt/pk7UavDi8Pj2qu2SQ4/4Ltzw6d3dd+DK9lSviW65utV qhmAQvUT5aqqeP3TGrck/9hn9UKIfxId7qWxm++jlY4SIzGyvjqiMI0E1tVBGcVCvsETHk 5S34voCAj/bxR9QV/v1JZXKRLljeft/IuhyPLojXAl9lSDLamoF0nJRc2MLCKg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XXRJ1647yzkk2 for ; Mon, 21 Oct 2024 20:10:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49LKAP78096147 for ; Mon, 21 Oct 2024 20:10:25 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49LKAPf7096146 for net@FreeBSD.org; Mon, 21 Oct 2024 20:10:25 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Mon, 21 Oct 2024 20:10:25 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 --- Comment #22 from Kevin Bowling --- (In reply to Kevin Bowling from comment #21) Thinking back a bit harder one thing that might help workaround this is to increase the number of transmit descriptors.. try something like this in /boot/loader.conf: dev.igb.0.iflib.override_ntxqs=3D4096 and let us know ho= w it does. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 22 03:27:23 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXd0F0mPpz52J3J for ; Tue, 22 Oct 2024 03:27:25 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXd0D6pg7z590b for ; Tue, 22 Oct 2024 03:27:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729567645; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=w8OXxdWpGqCJP5PTT1ECfaK2Uh/flfZqYpg/H3l1A9k=; b=gqf0vWlG5dZwXpdx+9MIPDOdiq7QfvOKPboWJhb08V15o6JGmEp04F7FjsxuGlSB2tKjNr dZMm65BzOUL/cg14Dwh2MMZ5IWNLwE4UmG9t5RKJXglLUY7ibu7/oMU2u1Qnq24HO9XG/7 fEq8aAhlAhb5onFtkmx0J2L5fZRlXb4JksD9nf1q1METmCZ7Kw25+Tgi7Ozxuq/wlT7qTZ vb0QGoj3R31sMXBnSsA8PeN8dJWOooR0ZKeEbrgAdfx583xt694ZnWneQv3edM0sVCY5jC 4hEyUpSuSuFqwj+on2iBtlQcNKZTqtCZ+R7yDDBr6ke7/E1vdlXIUVEKZQ87Ow== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729567645; a=rsa-sha256; cv=none; b=wmhFTelbYAbzj9+IlAHkaDa27qJu07QGty6DNqZXb8kvCl7kPfyi0LOK7OH4gJ7lcOk81r FctmTWj+lZTeKNV5RgKfV345kscFhh10NIwTvC40LRmYPDmhUxLLcyI5jCXv5aCyPeNTZe EGjj9yx5lqlvdPb3442FcTqk1o/k1Ix5M4UpnsyShKi1jP9SJu8+0IiptFXc1IBUFETPRO a6lAPb3hMEwBhz3+YlmkGcDedFOLiweyTjpvUQEhYJvndRDcjQAgri8AKHcmzZZBsMr9q8 qL6IHTVMu81DKD4JjEzNQfkYW5KcaxlASiSjnM3yaGk95iVr7y4NV0Cgo7hxGQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XXd0D6PxwzxdJ for ; Tue, 22 Oct 2024 03:27:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49M3ROEi035201 for ; Tue, 22 Oct 2024 03:27:24 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49M3ROFi035200 for net@FreeBSD.org; Tue, 22 Oct 2024 03:27:24 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Tue, 22 Oct 2024 03:27:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: pascal.guitierrez@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 --- Comment #23 from pascal.guitierrez@gmail.com --- (In reply to Kevin Bowling from comment #21) (In reply to Kevin Bowling from comment #22) Interesting, thanks for that. I tried changing dev.igb.0.iflib.override_ntxqs=3D4096 but to no effect. What did make a difference was to use the rack tcp stack net.inet.tcp.functions_default=3Drack using rack there was next to no packet loss when interrupts were scheduled = onto a single core, obviously not fixing the root cause but is somewhat of a workaround. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 22 14:59:28 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXwMY1Rbhz5PYyw for ; Tue, 22 Oct 2024 15:00:09 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lj1-f176.google.com (mail-lj1-f176.google.com [209.85.208.176]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXwMX2R9pz4FVC for ; Tue, 22 Oct 2024 15:00:08 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lj1-f176.google.com with SMTP id 38308e7fff4ca-2fb4df8d0baso2798441fa.0 for ; Tue, 22 Oct 2024 08:00:08 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729609206; x=1730214006; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=QinzadyT7IRqw9vl7aRXodTScUbSLjvweMQvrfR0tI0=; b=B6d0W3eCXPCtzxBhep3Q6iSqB23v1dLdGI0DWmY0XOngO+EJu7/fXcyK777Tbvh00n IT7+NzOU+XXTHNpz9A8WzVbNWvyLFptC1j/umsGimxT42woxqSHCi2Bxq5yLpPP7JppP tLotNYX1aiR1rlzmEtO8HMc2Jz9o1QNqxBh911LwSfk3QYqDFIxfmAFgKBfnvTaH37ef rmd7RJvixJ/r6AlvGs9RYIVqm0MpN/XAdT+/NK9SUHwsXEelVf85LhBcVg+36kwva5dM Gn1c6SahZ3fZa7VuC0zVkjZtOa7YvexukefJl2VXVQ9m2t4me/xVREGqm+zdXWISTY5Q Ggtw== X-Gm-Message-State: AOJu0Yy1NTWI6xu15rzTKd/rQdzDPlFZ2Vui04BHJ0UQn2dcvzsrM7Xr fnHRm0QlKa2RoOUiWHsZlKUR0j0/7PUKtUK2FwUogfkaNHF/pEyc3L9jgPF9 X-Google-Smtp-Source: AGHT+IHGYFqHiTcRxfDGzLJVJyC/Z60RlPjl2XqH4yAU+avTGmD46zqy2O/EdmKxsfMWeUObZo6qXg== X-Received: by 2002:a05:651c:19a7:b0:2f7:7f76:992f with SMTP id 38308e7fff4ca-2fb82eab6c4mr26089071fa.6.1729609205637; Tue, 22 Oct 2024 08:00:05 -0700 (PDT) Received: from mail-lf1-f44.google.com (mail-lf1-f44.google.com. [209.85.167.44]) by smtp.gmail.com with ESMTPSA id 38308e7fff4ca-2fb9ae100d5sm8076941fa.108.2024.10.22.08.00.05 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 22 Oct 2024 08:00:05 -0700 (PDT) Received: by mail-lf1-f44.google.com with SMTP id 2adb3069b0e04-539e4488012so732957e87.1 for ; Tue, 22 Oct 2024 08:00:05 -0700 (PDT) X-Received: by 2002:a05:6512:ea0:b0:53a:415:d33b with SMTP id 2adb3069b0e04-53a154a84d6mr2265000e87.10.1729609205139; Tue, 22 Oct 2024 08:00:05 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Cheng Cui Date: Tue, 22 Oct 2024 10:59:28 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="00000000000045e46c0625120650" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4XXwMX2R9pz4FVC X-Spamd-Bar: ---- --00000000000045e46c0625120650 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Mon, Oct 21, 2024 at 2:25=E2=80=AFPM void wrote: > On Mon, Oct 21, 2024 at 10:42:49AM -0400, Cheng Cui wrote: > >Change the subject to `Performance test for CUBIC in stable/14`, was `Re= : > >Performance issues with vnet jails + epair + bridge`. > > > >I actually prepared two patches, one depends on the other: > > > >https://reviews.freebsd.org/D47218 << apply this patch firstly > >https://reviews.freebsd.org/D47213 << apply this patch secondly > > > >Please let me know if you have any questions. > > Hi, > > What version (git -C /usr/src rev-list --count --first-parent HEAD) did y= ou > patch? > It was based on the latest stable/14 branch @commit 025535f94525. Or your command returns this: # git -C /usr/src rev-list --count --first-parent HEAD 269221 > I installed > FreeBSD-14.1-STABLE-amd64-20241017-d36ba3989ca9-269125-disc1.iso and > then updated the sources with git before checking out stable/14 which is > n269252, applying the patches and building/installing kernel from there. > > What's the exact iperf command you're using please? I'm using > > # iperf --time 60 -c 192.168.1.232 > > This is ok. I used iperf3. but I'm not sure [see note a] if that one would give comparable tests to > yours. > > Please re-organize your test result in before/after patch order. So that = I can understand and compare them. -- Best Regards, Cheng Cui --00000000000045e46c0625120650 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable


=
On Mon, Oct 21, 2024 at 2:25=E2=80=AF= PM void <void@f-m.fm> wrote:
On Mon, Oct 21, 2024 at 10:42:49AM -0400, Cheng Cui wr= ote:
>Change the subject to `Performance test for CUBIC in stable/14`, was `R= e:
>Performance issues with vnet jails + epair + bridge`.
>
>I actually prepared two patches, one depends on the other:
>
>https://reviews.freebsd.org/D47218=C2=A0 =C2=A0 =C2=A0<= < apply this patch firstly
>https://reviews.freebsd.org/D47213=C2=A0 =C2=A0 =C2=A0<= < apply this patch secondly
>
>Please let me know if you have any questions.

Hi,

What version (git -C /usr/src rev-list --count --first-parent HEAD) did you=
patch?
It was based on the latest stable/14 branch @commit= 025535f94525.
Or your command returns this= :
# git -C /usr/src rev-list --count --firs= t-parent HEAD
269221


I installed FreeBSD-14.1-STABLE-amd64-20241017-d36ba3989ca9-269125-disc1.is= o and
then updated the sources with git before checking out stable/14 which is n269252, applying the patches and building/installing kernel from there.
What's the exact iperf command you're using please? I'm using
# iperf --time 60 -c 192.168.1.232

This is ok. I used iperf3.

but I'm not sure [see note a] if that one would give comparable tests t= o yours.

Please re-organize your test result in before/after p= atch order. So that I can understand
and compare them.
= =C2=A0
--
Best Regards,
Cheng Cui
--00000000000045e46c0625120650-- From nobody Tue Oct 22 15:31:18 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XXx3n41Txz5PbgH for ; Tue, 22 Oct 2024 15:31:33 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-a8-smtp.messagingengine.com (fhigh-a8-smtp.messagingengine.com [103.168.172.159]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XXx3m27H9z4K8Z for ; Tue, 22 Oct 2024 15:31:32 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=ZeV5ZjYa; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=jf0FZO9A; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 103.168.172.159 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-05.internal (phl-compute-05.phl.internal [10.202.2.45]) by mailfhigh.phl.internal (Postfix) with ESMTP id 9000A114022E for ; Tue, 22 Oct 2024 11:31:30 -0400 (EDT) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-05.internal (MEProxy); Tue, 22 Oct 2024 11:31:30 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729611090; x=1729697490; bh=oMvoUXzbzU 6czawSOWK64NvOKuU5JY4Rn3WFGoQ9DbM=; b=ZeV5ZjYa4oOZyU84KwHrFzzuQD 8HaS1MFET0nmu1EoXS3CTXK9ipAPxTDyWGW94Mn5ZWK2Pw3Dzi0Qq3SQxXZVswG8 ya4fS9yjPryDKkpo6eBcuUSngBvEEXeE2ucGOWYu+xmZnJ6TbM3vtwqISG0E1+07 v5ab6wXfBO2gFXDKFw6seYxFx8KeXIi5EsJZzGQNjdxtRndplykvkwFrkZ+Nl3JK yvNo/bSleDD9ZTMKvKvsJWGC1JImj4pFrG7by95yQ9uM/cTwmAyXNdtWaMxq2Fiv j+ZKUrmwJrKZAB8UbfFWM70E8JmmA0IUUGA9H/yWFK8mlAb/rGpsvteIEqrQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729611090; x=1729697490; bh=oMvoUXzbzU6czawSOWK64NvOKuU5 JY4Rn3WFGoQ9DbM=; b=jf0FZO9A+52Bk8oZT+rR3JaNOIPdlrxoAU5IXn/vAr/2 jNyCOp6feROCs7HZ6GgrVpXfwyqOJE98YlqpfsE9DNYBvobfYuw+rOdkjaiKzwZO AdCfnEKvWq+/1+dx7gBbmWGfDHWtB/iZiBpfowouPvGv+TqsfcGu/qNkZBTouZDG Zefbep81s6f74AKJwyXRGaVkmSWFUkGf+31NsrLhxJe5aGvIfp6nylZjn7+iGYc1 M/jCit5nBIt68KOqXOkikkqSONx30EVOqIJDP+eLvbIA22w9EF10ppORWxNwp0r9 Xl5dTNZQbeIN7V8UsDgR3crW8wXfBCNHS9DL56bi8w== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeihedgkeekucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuf fkfhggtggujgesthdtredttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgf dugfdvgeekjeejuddtheehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomhepvhhoihgusehfqdhmrdhfmhdpnhgspghrtghpthhtohepuddpmh houggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqnhgvthesfhhrvggv sghsugdrohhrgh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 22 Oct 2024 11:31:29 -0400 (EDT) Date: Tue, 22 Oct 2024 16:31:18 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: Performance test for CUBIC in stable/14 Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.80 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; RWL_MAILSPIKE_VERYGOOD(-0.20)[103.168.172.159:from]; R_SPF_ALLOW(-0.20)[+ip4:103.168.172.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[103.168.172.159:from]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_COUNT_THREE(0.00)[3]; MIME_TRACE(0.00)[0:+]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; ASN(0.00)[asn:151847, ipnet:103.168.172.0/24, country:AU]; RCVD_VIA_SMTP_AUTH(0.00)[]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XXx3m27H9z4K8Z X-Spamd-Bar: --- On Tue, Oct 22, 2024 at 10:59:28AM -0400, Cheng Cui wrote: > Please re-organize your test result in before/after patch order. So that I > can understand and compare them. Sure. Before: [ ID] Interval Transfer Bandwidth [ 1] 0.00-60.02 sec 5.16 GBytes 738 Mbits/sec After: [ ID] Interval Transfer Bandwidth [ 1] 0.00-60.01 sec 4.87 GBytes 697 Mbits/sec I was surprised as well. These numbers seem to be within the margin of error. I tested 'After' again just now: - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-60.06 sec 5.15 GBytes 737 Mbits/sec 963 sender [ 5] 0.00-60.06 sec 5.15 GBytes 737 Mbits/sec receiver iperf Done. I can spin up another couple of unmodified VMs if you like - they'll be created from older stable/14 snapshots - and compare against those. -- From nobody Tue Oct 22 17:57:03 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XY0Hg6hNhz5Vgrb for ; Tue, 22 Oct 2024 17:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XY0Hg42FJz4d8H for ; Tue, 22 Oct 2024 17:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729619823; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=NUq5JITZxLS/SKb44HnVn4Oyh/ozmf178Fta8xh4+aU=; b=uJG/E2JOqx7mMdK19g3rXHaMEP2YL9eEmeHv34HD/fepvP+Ia7pildCjXBfjZNUEJ6FbJ0 Y37yGdqnpqe4vbV6lVCQA5pjXtaSyis/55ujje/BLREIK71++IzjOnX15kNZIx3cLmj6i7 UV5oiON09xcvys6wIM3CWxPdEKDWANGJAnHEp/8Y1Up9Lh89ONJcVmckHWvUbyFFpt5qG4 DMFRu2SGch55euZYaUPUP3Y+qrWl//dUs4pDXu++h9IjUXVwKRnhySl128wyto7SGq53BD ul8F7IKdzCZDRfFQHxlX2d+bQ+UEXhN55hVZjOa+hHH72YdSzdDn4G/O+9nfWQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729619823; a=rsa-sha256; cv=none; b=mNyECZUse1yp50anNqMzL4MRt9V3lt97JFHxx2A+S00LAB050PB/iA4V4rFQG7ZXYZHk9S PGsCkYpKbzygfqcppzFhVilr0U6CUSBLKnkdkbwIgAgngf3KT1Uw+gQry7GoyTNPqpgbWx 8cMuswzuslnTDkM7/hWa7WYi/zYg3VyqNHEMPCR4olekjiovA8OnU1FrdmF1ZgVb4LmMvQ dJPxpPh8Nmua2PqLNpPprXENi3pySqudjUj59ku+Nk+Yolon/EH+6gzMO+20ceBmijZ0/4 LpDt5H75CsXtLWmaoiGdbIc7wnZfLkwa2O1gTUgkog7uEgzAWMzyXc2WNtYEgQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XY0Hg3V3szPRv for ; Tue, 22 Oct 2024 17:57:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49MHv3at068801 for ; Tue, 22 Oct 2024 17:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49MHv3HN068800 for net@FreeBSD.org; Tue, 22 Oct 2024 17:57:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Tue, 22 Oct 2024 17:57:03 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 --- Comment #24 from Kevin Bowling --- (In reply to pascal.guitierrez from comment #23) Thanks for reporting back. That is very interesting. There are two possibilities that come to mind 1) the RACK stack is correctly identifying the loss as feedback for it's flow/congestion control or 2) the RACK stack has some feature that is causing it to not overflow the lower layers. I'll see if I can find someone with more recent TCP stack experience to gla= nce at this and provide any additional insight or suggestions for the base stac= k. --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 22 19:57:42 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XY2zd6mGQz5ZJZy for ; Tue, 22 Oct 2024 19:58:21 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f53.google.com (mail-lf1-f53.google.com [209.85.167.53]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XY2zd3bWJz4197 for ; Tue, 22 Oct 2024 19:58:21 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f53.google.com with SMTP id 2adb3069b0e04-539e4908837so818692e87.0 for ; Tue, 22 Oct 2024 12:58:21 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729627100; x=1730231900; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=CbeAGU4aBg8bxCOrA5PKVvxqT1GxmTF4thB2F1ZzInE=; b=p7uDh5TMT8bSI4+dDvMy5ykf5jcxI6JktrilHkxjMGDS0Q4rFSjn4gFjvdw7HQEWFu WOQvJzpRUR6GH8r23qiAsB+khwmm07o4K1h8UkMikOS6klbKcEJhzxjntDfFXN0CykYa vyP4jANuC2pIoKA54nQsadCb0LNf09vP6c67YcBv1+5CIDl4a3ICzggxXdaFXM97Wz4j XAPu4HIJlLK696EuoU+RyP3Rm9hLHKli8Ft3NLMVPvFA91a8LQz6C3FZEBy6xXhusHJM iyIJipf/f92bEatP3xymaoOCyjdeTw9/0nPnKCnBYfxiATF5nZrQhZcF0mRDKoPV98tB 07EQ== X-Gm-Message-State: AOJu0YxFtHuf/d4ojmasIRIeSAMHZ3YKGizt8s/nlgOf4S8bTW5+LeJp Hb1ShlDMv9q8PrWtALqxqdPCPXHD7yqQ+J90vSq/s/yWDzadFS1pInZOPbuI X-Google-Smtp-Source: AGHT+IH7qsI/9vXq0MfHitBqhA7wkr+N/0Bfq6mc4ryAA+xdSJggzURS+bcHuWoLeJg82YQgc4hxog== X-Received: by 2002:a05:651c:1544:b0:2fb:5014:dd67 with SMTP id 38308e7fff4ca-2fc9d1db9demr364571fa.0.1729627099392; Tue, 22 Oct 2024 12:58:19 -0700 (PDT) Received: from mail-lf1-f46.google.com (mail-lf1-f46.google.com. [209.85.167.46]) by smtp.gmail.com with ESMTPSA id 38308e7fff4ca-2fb9ad4b843sm8907931fa.4.2024.10.22.12.58.19 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 22 Oct 2024 12:58:19 -0700 (PDT) Received: by mail-lf1-f46.google.com with SMTP id 2adb3069b0e04-539ec09d690so763619e87.2 for ; Tue, 22 Oct 2024 12:58:19 -0700 (PDT) X-Received: by 2002:a05:6512:3b85:b0:53a:40e:d560 with SMTP id 2adb3069b0e04-53b1a303803mr12509e87.3.1729627098780; Tue, 22 Oct 2024 12:58:18 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Cheng Cui Date: Tue, 22 Oct 2024 15:57:42 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="000000000000d124940625163050" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4XY2zd3bWJz4197 X-Spamd-Bar: ---- --000000000000d124940625163050 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable What is the output from `ping` (latency) between these VMs? cc On Tue, Oct 22, 2024 at 11:31=E2=80=AFAM void wrote: > On Tue, Oct 22, 2024 at 10:59:28AM -0400, Cheng Cui wrote: > > > Please re-organize your test result in before/after patch order. So tha= t > I > > can understand and compare them. > > Sure. > > Before: > > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-60.02 sec 5.16 GBytes 738 Mbits/sec > > After: > > [ ID] Interval Transfer Bandwidth > [ 1] 0.00-60.01 sec 4.87 GBytes 697 Mbits/sec > > I was surprised as well. These numbers seem to be within the margin of > error. > > I tested 'After' again just now: > > - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-60.06 sec 5.15 GBytes 737 Mbits/sec 963 > sender > [ 5] 0.00-60.06 sec 5.15 GBytes 737 Mbits/sec > receiver > > iperf Done. > > I can spin up another couple of unmodified VMs if you like - they'll be > created from older stable/14 snapshots - and compare against those. > > -- > > --=20 Best Regards, Cheng Cui --000000000000d124940625163050 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
What is the output from `ping` (latency) between thes= e VMs?

cc

On Tue, Oct 22, 2024 at 11:31=E2=80=AFAM = void <void@f-m.fm> wrote:
On Tue, Oct 22, 2024 at 10:59:28AM -0400, Cheng Cui wrote= :

> Please re-organize your test result in before/after patch order. So th= at I
> can understand and compare them.

Sure.

Before:

[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2=A0 =C2=A0Bandwi= dth
[=C2=A0 1] 0.00-60.02 sec=C2=A0 5.16 GBytes=C2=A0 =C2=A0738 Mbits/sec

After:

[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2=A0 =C2=A0Bandwi= dth
[=C2=A0 1] 0.00-60.01 sec=C2=A0 4.87 GBytes=C2=A0 =C2=A0697 Mbits/sec

I was surprised as well. These numbers seem to be within the margin of erro= r.

I tested 'After' again just now:

=C2=A0 - - - - - - - - - - - - - - - - - - - - - - - -
=C2=A0 [ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2= =A0 =C2=A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr
=C2=A0 [=C2=A0 5]=C2=A0 =C2=A00.00-60.06=C2=A0 sec=C2=A0 5.15 GBytes=C2=A0 = =C2=A0737 Mbits/sec=C2=A0 963=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0sender
=C2=A0 [=C2=A0 5]=C2=A0 =C2=A00.00-60.06=C2=A0 sec=C2=A0 5.15 GBytes=C2=A0 = =C2=A0737 Mbits/sec=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 receiver

=C2=A0 iperf Done.

I can spin up another couple of unmodified VMs if you like - they'll be=
created from older stable/14 snapshots - and compare against those.

--



--
Best Regards,
Cheng Cui
--000000000000d124940625163050-- From nobody Tue Oct 22 20:00:53 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XY32Z2kDFz5ZJdr for ; Tue, 22 Oct 2024 20:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XY32Y0RBNz41ff for ; Tue, 22 Oct 2024 20:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729627253; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=gnfw+M9uOtdUs58xP3xLAOBvcy+DurHClWj6b7ZSOqs=; b=Y5dUbzY/tao/Nv9zAqxdK5+9OsdsKmNvui7ThsNC1cZqKZtWf/ZPzNQD1jLHC65o9rBWPp ib5HRT0qkLP3CA4VpqYN/PYO9L/JV3jIWO4HEcNVpxN9fcHT9jjt/VH5z4HiNqQfZzjTqN ZdtE/e4uemlAwM79+d95NbpUy5oEYqxlgb7d3kOu8Xz3FHABxZW4qI+uJ0KLmU1I4I5MDs pjW4eM+iaeDBgUIUW5biV15szMCuKW/K/z2nOmG+a8rQAS7gkBTyEWFFUwcxkOmpIiYKFv OHHYBDseMQ/2EG2SYrYHP2FWw1zkRF1pz7aocp5T1PsyTjj6BcueBlLvVnAo3w== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729627253; a=rsa-sha256; cv=none; b=kEWPWPMGdhccHXjBJy6P4c+0QoxRZbbF4Sa85+XX4kp8bKhylAo7jF2cDAiQRDEZATbU9r LtnmsixyzK7f3GuuwwbLi2dspREd/F0YIlHBhfHHvRJ/FeFJUhl9eMiydWkLpJ6xxdOedy 2KNojfyi5onMqbr5ff1y9QXpP08NqLvkhlcuy7hlTv0edQbU37Hy9r6BUkD4GuO3kV0gSk 1JmhcU6Gzj4ZmEGaXpS941DGWUxKlNeFsaU6b5DyEFmajypLD+/HnF9TferxuTVh3UJpPc fRymmdc3wsCiPglC+HkPkRNzO2iZ4BvNF2g75PD1l1BRi5lRaveE0SrUFE+weg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XY32Y01rnzSVM for ; Tue, 22 Oct 2024 20:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49MK0qL1085726 for ; Tue, 22 Oct 2024 20:00:52 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49MK0qwR085725 for net@FreeBSD.org; Tue, 22 Oct 2024 20:00:52 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Tue, 22 Oct 2024 20:00:53 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cc@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 Cheng Cui changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cc@FreeBSD.org --- Comment #25 from Cheng Cui --- (In reply to Kevin Bowling from comment #22) (In reply to pascal.guitierrez from comment #23) I had a similar experience last year when I was debugging a ENOBUFS error returned to TCP on using bce NICs. But I am not sure if you can find a simi= lar solution. Turns out the root cause is the default NIC send queue length is too small.= The enobufs error came from the _IF_QFULL check in ifq.h. However, tuning "sysctl net.link.ifqmaxlen" directly does not work. There i= s a per NIC interface setup in the driver to setup device tx/rx queues. I have = to increase the tx queue "ifq_maxlen" from the device sysctl "hw.bce.tx_pages". After tuning that, I can achieve a stable 1Gbps x 100ms delay BDP. Talking about review D4295, it reminds me of `Linux has some work like TCP small queue at the sender side.` Talking about workaround, you may also test the following two patches I prepared in stable/14 branch as a workaround of improving TCP performance in congestion control. https://reviews.freebsd.org/D47218 << apply this patch firstly https://reviews.freebsd.org/D47213 << apply this patch secondly --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Tue Oct 22 20:12:42 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XY3JV3Z7Gz5ZKHP for ; Tue, 22 Oct 2024 20:12:58 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fout-b4-smtp.messagingengine.com (fout-b4-smtp.messagingengine.com [202.12.124.147]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XY3JS5gY8z43LC for ; Tue, 22 Oct 2024 20:12:56 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=PPW+akrA; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="K/eV8u1R"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.147 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-08.internal (phl-compute-08.phl.internal [10.202.2.48]) by mailfout.stl.internal (Postfix) with ESMTP id 2593211400A9 for ; Tue, 22 Oct 2024 16:12:55 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-08.internal (MEProxy); Tue, 22 Oct 2024 16:12:55 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729627974; x=1729714374; bh=lp5Ss2Sq+j cZ72svUSmsTlZBupthLMZxXDOcdScbgQc=; b=PPW+akrAOt6pSHQ9ISuO3CunXf jOaf08jtpt2EKG3MNR7rCtNVXwP1+l4DFVW8kD6+UDbGOdcyaKI3AOaTkT4L4b8A iIBKBgNdrgVHGkbuwWWmlwn/Z3197YU0g4uiGd0UqP5+WcxZbKFD288njKdSZtdL Evi4kHnXaGQghGvaVLKBtuUcpFcQ8Dna5H3J7pVgG3dvSwHlBIAdszJmkfuRi6ag xEUupDKDtNcU6eU+dowhAEfcr2uK7+kIAJaSESsCY33bNI4oRNo7+yeuzmqIGi1w b0x9fWJ2n7kXj4A1y6bEUb1rYr/1liybee5YFqJLaJAbMiz2J4ZjLhOr0X8Q== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729627974; x=1729714374; bh=lp5Ss2Sq+jcZ72svUSmsTlZBupth LMZxXDOcdScbgQc=; b=K/eV8u1RneUKCxSob8Qjp+kl4tEV3Jer5J3Gk2Onzwhw Km3nlVPsvoy3v9GsDGpEAyFyrhr3cIdhEwd1lBc9Qi+qnFUl+wfTL7lNj18zMQkx a73AiUFLaYdIiySBKK/NxFZWd47bFGXpg3POvxLRsw5e/sW68JwtbnbG54P+W8st jFkYyQcveSO85atK2ms7J0RH0biHhevHG+XUULSkGEgKlCq/zPJRsbbOSaKguMQM u/4ByZ5punuW72loe3rrkeuGDvjuN0mIB5Akx2x3CDfZluKUbHlK79ZKO5/alW7D QBUdm6ZRXpL4U2/5O03cfVmeW8FrqNVkVl0nr0ScEg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeihedgudegiecutefuodetggdotefrod ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpggftfghnshhusghstghrihgsvgdp uffrtefokffrpgfnqfghnecuuegrihhlohhuthemuceftddtnecunecujfgurhepfffhvf fukfhfgggtuggjsehttdertddttddvnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdq mhdrfhhmqeenucggtffrrghtthgvrhhnpeekleduvdelhfeileefgffghfffkedtheelle fgudfgvdegkeejjedutdehhefgueenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgr mhepmhgrihhlfhhrohhmpehvohhiugesfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupd hmohguvgepshhmthhpohhuthdprhgtphhtthhopehfrhgvvggsshguqdhnvghtsehfrhgv vggsshgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 22 Oct 2024 16:12:54 -0400 (EDT) Date: Tue, 22 Oct 2024 21:12:42 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: Performance test for CUBIC in stable/14 Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.60 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.147:from]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:151847, ipnet:202.12.124.0/24, country:AU]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XY3JS5gY8z43LC X-Spamd-Bar: --- On Tue, Oct 22, 2024 at 03:57:42PM -0400, Cheng Cui wrote: >What is the output from `ping` (latency) between these VMs? That test wasn't between VMs. It was from the vm with the patches to a workstation on the same switch. ping from the vm to the workstation: --- 192.168.1.232 ping statistics --- 10 packets transmitted, 10 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.643/0.796/0.870/0.070 ms ping from the vm with patches to an alpine linux vm on the same host: --- 192.168.1.65 ping statistics --- 10 packets transmitted, 10 packets received, 0.0% packet loss round-trip min/avg/max/stddev = 0.734/0.859/0.963/0.073 ms -- From nobody Wed Oct 23 00:29:22 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XY90M1pDbz5ZbRW for ; Wed, 23 Oct 2024 00:29:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R11" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XY90L6TW6z4ZGS for ; Wed, 23 Oct 2024 00:29:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729643362; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=6+MT6aqIqcVg2sAI49/sxz6Oba77WuXU8Jo3ITKrNGQ=; b=F3mWlVYy5AQoY3mM98updBfQvE36dUejXyKAuVeBbwbtBUn6Rr8PoSWY/6Zddqx/4zyowY K9xaf9v1ms+TmybzIlbeG1dZ1bKmC2enwmpldetDijvcj8ZV4ym3stvPFSbax0fh8udRYh cpzLAAQFlrbIJ4+KbXQjyd4sINZmMZxjSq2B6A5rbADnYPu0t4VmwEzDLlwh2HmCGtnRqs v7uv2VjzkXfGVIkjp0wiW2w0rykh4IMp8h1OO7cixR38k9Gtakl6nAyqX6bDtycsWdDrXh 0sLtiA7Xh25tRx78O4D8/VFqnzCNC7vFnCADXTvyChg15HobzYVQnFSewjtBjA== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729643362; a=rsa-sha256; cv=none; b=XbQTvoNFza/gfDg7UDsszA4jQVgewAYbf5fxPi90IqJGBNQK64oDuB0FRevIEjdzotezWY KAdPm4b91/P8NFOZdClZ08Fcy9NdUzwWV3+I9ojHkgUzndgx7cn6PfSajhLCdIGpL5B07L YBXebhvjh4AKPxToFnPO10ELyhWObDg1cpoaD+nBOANFlVlXakxJhI7l/8ZygKa/EWZ+xD zHd7hNEGSn9KBHXuGipobIrNQQ3LJ8/VjA/GkUvtIOlPuBeINnBqL649p5MMIJs8lVoeFo +gwBRU6pGuHarkaVYQY+N8VOEnwoAFgNrZBke/X/lWFA3riiNOETgMNOwqUnaw== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XY90L3bGLzcKq for ; Wed, 23 Oct 2024 00:29:22 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49N0TMYI057524 for ; Wed, 23 Oct 2024 00:29:22 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49N0TMV8057522 for net@FreeBSD.org; Wed, 23 Oct 2024 00:29:22 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 280386] if_bridge throws output errors under load Date: Wed, 23 Oct 2024 00:29:22 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 14.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: gallatin@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D280386 Andrew Gallatin changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |gallatin@FreeBSD.org --- Comment #26 from Andrew Gallatin --- (In reply to Kevin Bowling from comment #24) Indeed, when it gets an ENOBUFS back, RACK will start pacing the connection. Search for this comment: /* * Failures do not advance the seq counter above. For the * case of ENOBUFS we will fall out and retry in 1ms with * the hpts. Everything else will just have to retransmit * with the timer. * * In any case, we do not want to loop around for another * send without a good reason. */ --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Wed Oct 23 05:51:47 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYJ8P4wkYz5Zs1s for ; Wed, 23 Oct 2024 05:51:49 +0000 (UTC) (envelope-from pho@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYJ8P4RSGz3wjj for ; Wed, 23 Oct 2024 05:51:49 +0000 (UTC) (envelope-from pho@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729662709; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=gsC03sKAb19VkjO+Lqx902vqKTKyP6sr5SKlkDq+uo0=; b=JEZwSxy75cOT6dw+jUnoeEQiC0FCcTIsW20NOKrsXEdWAj7JzXIBMbRlxivwwBdZ68apB1 PcfagRbZcm/DpAeQpizaL1s+WRqYvDhQz8xMcNT/zfTKejujwBINPLDdSKH5cWnPu0cbpX GYUKOGhceWpmRacAS5v8IyFAXeAx5btiJmA4XtUkLYK4RtPK6CFvCp6prNE//ghvTT6kPL dsnStWDhFx1S2wukbDaGUJhEJj/byy7nJ6kDCTpp+A7JyefJug+ngGHrKtmD5JKF1G0pU/ UarnRHXKXMAKTbTGVuCSFQ6I7C/9gCM4NHzGh5TJMhUCi1adbHgUy8W0+6rFvg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729662709; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type; bh=gsC03sKAb19VkjO+Lqx902vqKTKyP6sr5SKlkDq+uo0=; b=CcnZeBFTlHAwyOwRnOPjzrHG/yFuJ4IIZbUdkrI92trTJoAaXtgeEGUbvkNN6KhVuidlOZ pSvb0KxoKVDlDS4qWLuBYv1P6s0yip53NpfeZSyPfMBXKUMX62LsC1YjTiVZr6HGRBfbte u9zJXA5KK0Wyr/Eq1DQyM62F4BN7QggzPy/MoizoynZnOo3sVCIKHcDdORd1AFAm6i7r4e NHqDB/aN8OuRk0MBR4bXCJD39E+ET3lys9owMO3fZ1GqPl978fZ3QRgBSVaDt1QW2GOcl4 FyUHqAy7WvZ1bjIJ4V7Inh1xKHkXfEOnJQrTz6xIHtHtdRTRT5TSaDC4j+lA3Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729662709; a=rsa-sha256; cv=none; b=yjciUkdabBVnLhhbsiyNSDmGP14NR8fgCjkp9zXzg4J8RHvnrC0oUJ3wJDOiZuKm92n8ev auZQMSGrSZd83Bc2m9ZkuDUSzeYVSev9K+2+wUm8DzECkZavExWp0b+WTw8GUNqCWLmboF nh37wHR+SCOi8xlOEr/x0aDyqGnasg3K/vB7YwPzH7Epwnko5yEvgxCenwj7bqSyUz3lfP w6XzaldOAF71cI8ueekss4RnPN/4k6ETUyVbK88X+KNhjBhI0VyYuQayoHqnVbzcbjGBm0 hnf73sVrRqUERj1cSud5LEqXwQCuLiNF4KXJVoya3rO6ub46GuL0jfTBSaUHcw== Received: from Peters-MacBook-Air.local (x5996a645.customers.hiper-net.dk [89.150.166.69]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: pho) by smtp.freebsd.org (Postfix) with ESMTPSA id 4XYJ8P1xnZzZbQ for ; Wed, 23 Oct 2024 05:51:49 +0000 (UTC) (envelope-from pho@FreeBSD.org) Date: Wed, 23 Oct 2024 07:51:47 +0200 From: Peter Holm To: freebsd-net@freebsd.org Subject: panic: tcp_do_segment: sent too much Message-ID: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline + export 'tcpINCARNATIONS=16678' + [ 16678 -le 0 ] + export 'TESTPROGS= ./testcases/tcp/tcp' + sleep 900 + su test -c '(cd ..; ./testcases/run/run $TESTPROGS)' run: run time 0+00:15:00, incarnations 1, load 100, verbose 1 23:59:21 Loop #1 tcp: run time 0+00:02:00, incarnations 3202, load 100, verbose 1 witness_lock_list_get: witness exhausted panic: tcp_do_segment: sent too much cpuid = 6 time = 1729634436 KDB: stack backtrace: db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01081bd9b0 vpanic() at vpanic+0x13f/frame 0xfffffe01081bdae0 panic() at panic+0x43/frame 0xfffffe01081bdb40 tcp_do_segment() at tcp_do_segment+0x29a2/frame 0xfffffe01081bdc20 tcp_input_with_port() at tcp_input_with_port+0x10e5/frame 0xfffffe01081bdd70 tcp_input() at tcp_input+0xb/frame 0xfffffe01081bdd80 ip_input() at ip_input+0x28f/frame 0xfffffe01081bdde0 swi_net() at swi_net+0x19b/frame 0xfffffe01081bde60 ithread_loop() at ithread_loop+0x266/frame 0xfffffe01081bdef0 fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 --- trap 0, rip = 0, rsp = 0, rbp = 0 --- Details @ https://people.freebsd.org/~pho/stress/log/log0557.txt - Peter From nobody Wed Oct 23 06:20:49 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYJp237ckz5ZtDm for ; Wed, 23 Oct 2024 06:20:58 +0000 (UTC) (envelope-from lexi@le-fay.org) Received: from fuchsia.eden.le-Fay.ORG (fuchsia.eden.le-fay.org [81.187.47.195]) by mx1.freebsd.org (Postfix) with ESMTP id 4XYJp11Bl4z40dT for ; Wed, 23 Oct 2024 06:20:57 +0000 (UTC) (envelope-from lexi@le-fay.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=le-fay.org header.s=fuchsia header.b=TJ02FdRB; spf=pass (mx1.freebsd.org: domain of lexi@le-fay.org designates 81.187.47.195 as permitted sender) smtp.mailfrom=lexi@le-fay.org; dmarc=none Received: from iris.eden.le-Fay.ORG (iris.eden.le-fay.org [IPv6:2001:8b0:aab5:4::1]) by fuchsia.eden.le-Fay.ORG (Postfix) with ESMTP id 4488D37B6E for ; Wed, 23 Oct 2024 06:20:50 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=le-fay.org; s=fuchsia; t=1729664450; bh=s0TIEegeM9y6KXIucipbdOo6UFysqR3+nYG/t1tWk/k=; h=Date:To:From:Subject; b=TJ02FdRBqmO4eQJ4v8aHwyrfkYPeqsaiUIfBMJdLd+QJIwPb+WD6pwVJH53RsYgc9 Xv2rfZOOhCEQCBi/UAHiXHjRja2S7j1VOtG4X5nTveMtjRnShyWMU5EUwig+jwZ3hR 4tx2Z8s0Niga+KLVW38iQdK1ueMrqDOYSNHDUiE8= Received: from [IPV6:2001:8b0:aab5:c210:899b:3939:5d83:3445] (unknown [IPv6:2001:8b0:aab5:c210:899b:3939:5d83:3445]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by iris.eden.le-Fay.ORG (Postfix) with ESMTPSA id AD00E2C0475 for ; Wed, 23 Oct 2024 07:20:49 +0100 (BST) Message-ID: Date: Wed, 23 Oct 2024 07:20:49 +0100 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Content-Language: en-GB To: freebsd-net@freebsd.org From: Lexi Winter Subject: Chelsio / cxlv(4): strange messages, SR-IOV interface does not work Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-3.39 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[le-fay.org:s=fuchsia]; R_SPF_ALLOW(-0.20)[+ip4:81.187.47.195]; RCVD_NO_TLS_LAST(0.10)[]; MIME_GOOD(-0.10)[text/plain]; XM_UA_NO_VERSION(0.01)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20712, ipnet:81.187.0.0/16, country:GB]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[le-fay.org]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; DKIM_TRACE(0.00)[le-fay.org:+] X-Rspamd-Queue-Id: 4XYJp11Bl4z40dT X-Spamd-Bar: --- hello, i'm trying to configure a cxlv(4) device, which is a VF of a Chelsio T540-CR on a host running bhyve. host: FreeBSD 15.0-CURRENT #3 lf/main-n269068-2cff93ced1d: Wed Oct 23 02:48:20 BST 2024 guest: FreeBSD 15.0-CURRENT #2 lf/main-n269067-56dd459904b: Sat Oct 19 18:36:40 BST 2024 the VF appears correctly in the VM: root@lily:~ # kldload if_cxlv t5vf0: mem 0xc000e000-0xc000efff,0xc0000000-0xc0007fff,0xc0008000-0xc0009fff at device 6.0 on pci0 t5vf0: 1 ports, 2 MSI-X interrupts, 4 eq, 2 iq cxlv0: on t5vf0 cxlv0: 2 txq, 1 rxq (NIC) and after bringing the interface 'up' everything seems fine: root@lily:~ # ifconfig cxlv0 cxlv0: flags=1008843 metric 0 mtu 1500 options=6ec07bb ether 06:44:3f:e7:60:30 media: Ethernet 10Gbase-Twinax (10Gbase-Twinax ) status: active nd6 options=29 however, trying to assign an IP address causes immediate problems: root@lily:~ # ifconfig cxlv0 inet6 2001:8b0:aab5:7::10/64 root@lily:~ # Oct 23 06:16:07 lily kernel: cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. root@lily:~ # dmesg|grep loop cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. cxlv0: a looped back NS message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. i find this strange because the link local IP address in the kernel error is not even configured on the interface: root@lily:~ # ifconfig cxlv0 cxlv0: flags=1008843 metric 0 mtu 1500 options=6ec07bb ether 06:44:3f:e7:60:30 inet6 2001:8b0:aab5:7::10/64 inet6 fe80::444:3fff:fee7:6030%cxlv0/64 tentative scopeid 0x3 media: Ethernet 10Gbase-Twinax (10Gbase-Twinax ) status: active nd6 options=21 am i doing something wrong here? thanks, lexi. From nobody Wed Oct 23 06:32:05 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYK395VCFz5ZvC1 for ; Wed, 23 Oct 2024 06:32:21 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Certum Domain Validation CA SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYK391zZxz42hN; Wed, 23 Oct 2024 06:32:21 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (unknown [IPv6:2003:a:e03:d412:e9aa:9ad6:b3da:9e92]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 0D057721BE033; Wed, 23 Oct 2024 08:32:06 +0200 (CEST) Content-Type: text/plain; charset=us-ascii List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3818.100.11.1.3\)) Subject: Re: panic: tcp_do_segment: sent too much From: Michael Tuexen In-Reply-To: Date: Wed, 23 Oct 2024 08:32:05 +0200 Cc: freebsd-net@freebsd.org, Warner Losh Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Peter Holm X-Mailer: Apple Mail (2.3818.100.11.1.3) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-Rspamd-Queue-Id: 4XYK391zZxz42hN X-Spamd-Bar: ---- > On 23. Oct 2024, at 07:51, Peter Holm wrote: >=20 > + export 'tcpINCARNATIONS=3D16678' > + [ 16678 -le 0 ] > + export 'TESTPROGS=3D ./testcases/tcp/tcp' > + sleep 900 > + su test -c '(cd ..; ./testcases/run/run $TESTPROGS)' > run: run time 0+00:15:00, incarnations 1, load 100, verbose 1 > 23:59:21 Loop #1 > tcp: run time 0+00:02:00, incarnations 3202, load 100, verbose 1 > witness_lock_list_get: witness exhausted > panic: tcp_do_segment: sent too much > cpuid =3D 6 > time =3D 1729634436 > KDB: stack backtrace: > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe01081bd9b0 > vpanic() at vpanic+0x13f/frame 0xfffffe01081bdae0 > panic() at panic+0x43/frame 0xfffffe01081bdb40 > tcp_do_segment() at tcp_do_segment+0x29a2/frame 0xfffffe01081bdc20 > tcp_input_with_port() at tcp_input_with_port+0x10e5/frame = 0xfffffe01081bdd70 > tcp_input() at tcp_input+0xb/frame 0xfffffe01081bdd80 > ip_input() at ip_input+0x28f/frame 0xfffffe01081bdde0 > swi_net() at swi_net+0x19b/frame 0xfffffe01081bde60 > ithread_loop() at ithread_loop+0x266/frame 0xfffffe01081bdef0 > fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 > --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- >=20 > Details @ https://people.freebsd.org/~pho/stress/log/log0557.txt Hi Peter, thank you very much for the report! Is this reproducible? I'm CC-ing Warner, since he has also reported this = to me privately, but wasn't able to reproduce it. Best regards Michael >=20 > - Peter >=20 From nobody Wed Oct 23 07:42:15 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYLbt0CdHz5ZyKG for ; Wed, 23 Oct 2024 07:42:18 +0000 (UTC) (envelope-from pho@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [IPv6:2610:1c1:1:606c::24b:4]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYLbs6tDmz4D33; Wed, 23 Oct 2024 07:42:17 +0000 (UTC) (envelope-from pho@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729669338; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=q7G79dylhapDuDXDTfCbrZBFzP7qrwpaX9TLpkA3dVA=; b=Y6FuWnSxQjdHetTkdL6v1hVYgef2ronQcgyYXtpswlw8GSXDvnRV1gApKdhv6Tk9D/My/Y VCvgJIErmHYbgv1RNuoH3Jx1wHU9TPuCWshLJKvWx4fxo4j/8Lj2JiPyfw4OStiSPqjRxJ USNmG2Awte5jf6h0gVf9MTbIx2MIyc3MZMombsvceh/BudRTLTwGIc3WrmIGje4mvvoN27 ClIOmQ9vA6rkzRRCNQDq/eXL+MzY9bLLgi1IOcY5E1KzgaqkFhTRN7lRjr2KRW9CpDMHfV DDi/ztLUA6XGtYlU9Zrf7/xL6e/TI4If7HizrqHuW6f1N95yhVsZGWiyEt01Zw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729669338; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=q7G79dylhapDuDXDTfCbrZBFzP7qrwpaX9TLpkA3dVA=; b=dX0ZIqU3lh8ZVSOw17yhJX67RuxXM5IUTr5Y84qqmhkbvflrbl7ev9ivQBssKMnqpJKS6n IDjVpmZckHfNI6fJX7BjwmX0/wWkZBM22b2DXybN9BD/oN+z/oTyiUDECuXh5TVNaWufFd YEs3kS7yO2lVXrNRLYF+nMFdZHd9TcwfZFPN6yxnuluskxX6TIc0dvVXmx00qo1cPOkAjI 4iFnVM6siN6KAyFc48Vjnm/aAA7yn/FfGWmN95Gq5+UEQu+h1P5IlMkUzEXyvpC5crrBKZ dgyMU2EayA+T9kSQaXQURvQ+w8CqtGd6+8TZiNp+a5lvTUQouGWoGrXEAn0a7A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729669338; a=rsa-sha256; cv=none; b=bVfaRlarJRO2Rsyt29dkNL7KWqa8a6ButCsc53wolUOqagdwy9DeMsC1SCL/+Neq51eveN Z6DY5U2wcg4oQCMIeerpIRd0dTjRwXn1SIqYpVzrmzlI1kYVf+LK37XCoM3seYuHFONFo5 5QWL6On7BtrqDgrQh7sCnULD+1Js+K2o+8xIGnYWfD7ZW3P5F2A62n1nJeFyTsD8UER/y1 dhWSxmZXmVGftb8U24vIqW03ADzcOeLhUOtBKHHqltG/B1STw+lmv96GP7pfNAvsydOkzA uhL13m29gwU6Du5Mwthc+3BpYh0CzQIRXqXJYiZxv1k7/22Ltc4AWx/bqPEtjg== Received: from Peters-MacBook-Air.local (x5996a645.customers.hiper-net.dk [89.150.166.69]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) (Authenticated sender: pho) by smtp.freebsd.org (Postfix) with ESMTPSA id 4XYLbs2rTqzZZP; Wed, 23 Oct 2024 07:42:17 +0000 (UTC) (envelope-from pho@FreeBSD.org) Date: Wed, 23 Oct 2024 09:42:15 +0200 From: Peter Holm To: Michael Tuexen Cc: freebsd-net@freebsd.org, Warner Losh Subject: Re: panic: tcp_do_segment: sent too much Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: On Wed, Oct 23, 2024 at 08:32:05AM +0200, Michael Tuexen wrote: > > On 23. Oct 2024, at 07:51, Peter Holm wrote: > > > > + export 'tcpINCARNATIONS=16678' > > + [ 16678 -le 0 ] > > + export 'TESTPROGS= ./testcases/tcp/tcp' > > + sleep 900 > > + su test -c '(cd ..; ./testcases/run/run $TESTPROGS)' > > run: run time 0+00:15:00, incarnations 1, load 100, verbose 1 > > 23:59:21 Loop #1 > > tcp: run time 0+00:02:00, incarnations 3202, load 100, verbose 1 > > witness_lock_list_get: witness exhausted > > panic: tcp_do_segment: sent too much > > cpuid = 6 > > time = 1729634436 > > KDB: stack backtrace: > > db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe01081bd9b0 > > vpanic() at vpanic+0x13f/frame 0xfffffe01081bdae0 > > panic() at panic+0x43/frame 0xfffffe01081bdb40 > > tcp_do_segment() at tcp_do_segment+0x29a2/frame 0xfffffe01081bdc20 > > tcp_input_with_port() at tcp_input_with_port+0x10e5/frame 0xfffffe01081bdd70 > > tcp_input() at tcp_input+0xb/frame 0xfffffe01081bdd80 > > ip_input() at ip_input+0x28f/frame 0xfffffe01081bdde0 > > swi_net() at swi_net+0x19b/frame 0xfffffe01081bde60 > > ithread_loop() at ithread_loop+0x266/frame 0xfffffe01081bdef0 > > fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 > > fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 > > --- trap 0, rip = 0, rsp = 0, rbp = 0 --- > > > > Details @ https://people.freebsd.org/~pho/stress/log/log0557.txt > Hi Peter, > > thank you very much for the report! > Is this reproducible? I'm CC-ing Warner, since he has also reported this to > me privately, but wasn't able to reproduce it. > > Best regards > Michael > > Hi Michael, I have have been able to reproduce the panic with several different tcp stress tests (on real hardware). Here's how to reproduce this one: cd src/tools/test/stress2/misc ./all.sh -o tcp.sh - Peter From nobody Wed Oct 23 10:03:26 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYPkr1tfMz5b4vb for ; Wed, 23 Oct 2024 10:03:32 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-b8-smtp.messagingengine.com (fhigh-b8-smtp.messagingengine.com [202.12.124.159]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYPkq2G3Yz4RRf for ; Wed, 23 Oct 2024 10:03:31 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=P66Cikvj; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=kTNo81EN; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.159 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-03.internal (phl-compute-03.phl.internal [10.202.2.43]) by mailfhigh.stl.internal (Postfix) with ESMTP id 92B6425400F2 for ; Wed, 23 Oct 2024 06:03:29 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-03.internal (MEProxy); Wed, 23 Oct 2024 06:03:29 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729677809; x=1729764209; bh=WUQ9lA7Kn8 aoz2Kfr7Iarcuitu3n2O3KFiAYy/n7vNo=; b=P66CikvjYpWU/yHZ9wgUf4B1TP CE0YU0bwlBd85cFbFF6863JR1AT4rsM67p8NqzhIXiovhv+vAAFfsWY5v3+vfzVY SQZywXVusW+c2+qx+mrtyLzKVdhi95r/psWqfiCLjh2QWcrPNCYhfUcwSeOd93wb EQhLT9PtGH0B5FQtSGXL6t2eKOuQxdkGdPckO0kRqQGd15E6zA1Y076nhYQmzZQm jlIDqVPCBWxBZvr/T/sGQJXbe7+/2ElvCucRHwRx2mEo+Zgo33kF7LofQrR0aog0 rvk33u4LULDfOmBYqq/nhFZg7V5FIL0prCWTMQeuHbamn09c1ztsJNivfIfw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729677809; x=1729764209; bh=WUQ9lA7Kn8aoz2Kfr7Iarcuitu3n 2O3KFiAYy/n7vNo=; b=kTNo81EN/EdOgTS7rBJPE9BLxettvWmzjKilLZlTwLYh nWf2C0Y24e6fti2K/UtbFVrw8FqbBtVTwK8I23W16Wlbnp5/VuOKqSfyRZRmSEiq XSfjsQ172QPqmJOTWYGzHuyLltMr+oo4OREm/xJAKG9bIAit5k6emaiw/h5EWmhy sPyRQjXjucWtSDhSooIfvys1OjKKfsZqYXm9xhcTK2U/V6zTEOWA4JKF36JJj42K B/RKJejtO+l+8anWNfLyAOQ0isYVrBV/7ccc9291Q7Sexryg1HSAzikLTGhVV0Iz HtwUCxY1MsGWkd7vM6iE7EHCYu7dQhTaNNNDqC6Rdg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeijedgvddvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuf fkfhggtggujgesthdtredttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgf dugfdvgeekjeejuddtheehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomhepvhhoihgusehfqdhmrdhfmhdpnhgspghrtghpthhtohepuddpmh houggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqnhgvthesfhhrvggv sghsugdrohhrgh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 23 Oct 2024 06:03:28 -0400 (EDT) Date: Wed, 23 Oct 2024 11:03:26 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: TCP Success Story (was Re: TCP_RACK, TCP_BBR, and firewalls) Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.58 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.98)[-0.980]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; MID_RHS_NOT_FQDN(0.50)[]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.159:from]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; RCVD_VIA_SMTP_AUTH(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; MISSING_XM_UA(0.00)[]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XYPkq2G3Yz4RRf X-Spamd-Bar: --- On Wed, Jul 17, 2024 at 02:00:31PM -0600, Alan Somers wrote: >So I benchmarked all available congestion control algorithms for >single download streams. The results are summarized in the table >below. Sorry for resurrecting an old thread, but I note your testing was with single streams. What are your thoughts wrt say RACK and *multiple* streams, on 14.1-p5? My context: I'm looking to get my settings right for best real-world bidirectional throughput for webdav, rsync, git, on server & client, in terms of sysctl tunables, tcp stacks, cc algos and any other resources. thanks, -- From nobody Wed Oct 23 10:09:00 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYPsQ4sKHz5b5C5 for ; Wed, 23 Oct 2024 10:09:14 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Received: from drew.franken.de (mail-n.franken.de [193.175.24.27]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Certum Domain Validation CA SHA2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYPsQ2bGqz4S55; Wed, 23 Oct 2024 10:09:14 +0000 (UTC) (envelope-from michael.tuexen@lurchi.franken.de) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (unknown [IPv6:2003:a:e03:d412:e9aa:9ad6:b3da:9e92]) (Authenticated sender: lurchi) by mail-n.franken.de (Postfix) with ESMTPSA id 2B3FB7223D012; Wed, 23 Oct 2024 12:09:01 +0200 (CEST) Content-Type: text/plain; charset=us-ascii List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3818.100.11.1.3\)) Subject: Re: panic: tcp_do_segment: sent too much From: Michael Tuexen In-Reply-To: Date: Wed, 23 Oct 2024 12:09:00 +0200 Cc: freebsd-net@freebsd.org, Warner Losh Content-Transfer-Encoding: quoted-printable Message-Id: References: To: Peter Holm X-Mailer: Apple Mail (2.3818.100.11.1.3) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00 autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:680, ipnet:193.174.0.0/15, country:DE] X-Rspamd-Queue-Id: 4XYPsQ2bGqz4S55 X-Spamd-Bar: ---- > On 23. Oct 2024, at 09:42, Peter Holm wrote: >=20 > On Wed, Oct 23, 2024 at 08:32:05AM +0200, Michael Tuexen wrote: >>> On 23. Oct 2024, at 07:51, Peter Holm wrote: >>>=20 >>> + export 'tcpINCARNATIONS=3D16678' >>> + [ 16678 -le 0 ] >>> + export 'TESTPROGS=3D ./testcases/tcp/tcp' >>> + sleep 900 >>> + su test -c '(cd ..; ./testcases/run/run $TESTPROGS)' >>> run: run time 0+00:15:00, incarnations 1, load 100, verbose 1 >>> 23:59:21 Loop #1 >>> tcp: run time 0+00:02:00, incarnations 3202, load 100, verbose 1 >>> witness_lock_list_get: witness exhausted >>> panic: tcp_do_segment: sent too much >>> cpuid =3D 6 >>> time =3D 1729634436 >>> KDB: stack backtrace: >>> db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame = 0xfffffe01081bd9b0 >>> vpanic() at vpanic+0x13f/frame 0xfffffe01081bdae0 >>> panic() at panic+0x43/frame 0xfffffe01081bdb40 >>> tcp_do_segment() at tcp_do_segment+0x29a2/frame 0xfffffe01081bdc20 >>> tcp_input_with_port() at tcp_input_with_port+0x10e5/frame = 0xfffffe01081bdd70 >>> tcp_input() at tcp_input+0xb/frame 0xfffffe01081bdd80 >>> ip_input() at ip_input+0x28f/frame 0xfffffe01081bdde0 >>> swi_net() at swi_net+0x19b/frame 0xfffffe01081bde60 >>> ithread_loop() at ithread_loop+0x266/frame 0xfffffe01081bdef0 >>> fork_exit() at fork_exit+0x82/frame 0xfffffe01081bdf30 >>> fork_trampoline() at fork_trampoline+0xe/frame 0xfffffe01081bdf30 >>> --- trap 0, rip =3D 0, rsp =3D 0, rbp =3D 0 --- >>>=20 >>> Details @ https://people.freebsd.org/~pho/stress/log/log0557.txt >> Hi Peter, >>=20 >> thank you very much for the report! >> Is this reproducible? I'm CC-ing Warner, since he has also reported = this to >> me privately, but wasn't able to reproduce it. >>=20 >> Best regards >> Michael >>>=20 >=20 > Hi Michael, >=20 > I have have been able to reproduce the panic with several different > tcp stress tests (on real hardware). >=20 > Here's how to reproduce this one: >=20 > cd src/tools/test/stress2/misc > ./all.sh -o tcp.sh Thank you. I will look into this. Best regards Michael >=20 > - Peter From nobody Wed Oct 23 12:28:01 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYSyK45Zxz5bBZB for ; Wed, 23 Oct 2024 12:28:41 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f49.google.com (mail-lf1-f49.google.com [209.85.167.49]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYSyK28rxz4bN6 for ; Wed, 23 Oct 2024 12:28:41 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f49.google.com with SMTP id 2adb3069b0e04-539ea686fd7so861016e87.2 for ; Wed, 23 Oct 2024 05:28:41 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729686519; x=1730291319; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=ztTSpBy4ytPUhD+C4a/Y311gG/yPdo/oR0A2G9l4MNk=; b=v5o+4U/K0exyWdsozVgasl8AM90UFVoKiJAc1l03/RkbZHANVfh8QJljEWPFcLKHGF sfpvO93HHpK5NUzMozJBW3hrrlFMhiakasC52ER13lpre2IjibxxuDTOcZUsXi2oUCOZ GgiZ5SE4jXftSPiWS4WjhTTiIo107qfgPhxbkipF4LXe9bOE6IJFqm29aCVo2Gs3HZ29 OZjlTjlfAahuC8zix8SXr4OhiROYZ5oO2R7f+ZQ6GObzHjyC7PchDwpfp7U5/y7lgI44 8q4YjXP3fHPXZwBDOejYQJSfJ2Mc1Muffa3CgyjfZib46xhT/QMELp/yboEAZZM6JnIp VNhQ== X-Gm-Message-State: AOJu0YzDG7AIBYgmW0xQHxavzGmGevm6gKmOyNUcsaxN7X0q0xiqTFZM 4zK+Y1vFIUax1ecY8cKlDmWwI7lR3iGi4CsFlRdjlAVZUVY6K0Lm9hWEZADp X-Google-Smtp-Source: AGHT+IFZjDl/pGEaIFQx73HRPrXO+Dl/WOwKQiv2UVxrPJANonQdf95pR8ONUDonEgNy61MKmT2WCQ== X-Received: by 2002:a2e:b8cd:0:b0:2fb:3e40:a8fc with SMTP id 38308e7fff4ca-2fc9d33e873mr3400371fa.5.1729686518467; Wed, 23 Oct 2024 05:28:38 -0700 (PDT) Received: from mail-lf1-f52.google.com (mail-lf1-f52.google.com. [209.85.167.52]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-53a22420110sm1050657e87.143.2024.10.23.05.28.38 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 23 Oct 2024 05:28:38 -0700 (PDT) Received: by mail-lf1-f52.google.com with SMTP id 2adb3069b0e04-539e576d665so889650e87.1 for ; Wed, 23 Oct 2024 05:28:38 -0700 (PDT) X-Received: by 2002:a05:6512:3b8b:b0:539:a353:2762 with SMTP id 2adb3069b0e04-53b1a231f4emr350628e87.0.1729686518064; Wed, 23 Oct 2024 05:28:38 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Cheng Cui Date: Wed, 23 Oct 2024 08:28:01 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="0000000000007b749c06252406ca" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4XYSyK28rxz4bN6 X-Spamd-Bar: ---- --0000000000007b749c06252406ca Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable The latency does not sound a problem to me. What is the performance of TCP congestion control algorithm `newreno`? In case you need to load `newreno` first. cc@n1:~ % sudo kldload newreno cc@n1:~ % sudo sysctl net.inet.tcp.cc.algorithm=3Dnewreno net.inet.tcp.cc.algorithm: cubic -> newreno cc@n1:~ % And let me know the result of `newreno` vs. `cubic`, for example: iperf3 -B ${src} --cport ${tcp_port} -c ${dst} -l 1M -t 20 -i 2 -VC newreno cc On Tue, Oct 22, 2024 at 4:13=E2=80=AFPM void wrote: > On Tue, Oct 22, 2024 at 03:57:42PM -0400, Cheng Cui wrote: > >What is the output from `ping` (latency) between these VMs? > > That test wasn't between VMs. It was from the vm with the patches to a > workstation > on the same switch. > > ping from the vm to the workstation: > > --- 192.168.1.232 ping statistics --- > 10 packets transmitted, 10 packets received, 0.0% packet loss > round-trip min/avg/max/stddev =3D 0.643/0.796/0.870/0.070 ms > > ping from the vm with patches to an alpine linux vm on the same host: > > --- 192.168.1.65 ping statistics --- > 10 packets transmitted, 10 packets received, 0.0% packet loss > round-trip min/avg/max/stddev =3D 0.734/0.859/0.963/0.073 ms > > -- > > --=20 Best Regards, Cheng Cui --0000000000007b749c06252406ca Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The latency does not sound a problem to me. What is t= he performance of
TCP congestion control algorithm `newreno`?

In case you need to load `newreno` first.=C2=A0
=

cc@n1:~ % sudo kldload newreno

cc@n1:~ % sudo sysctl net.inet.tcp.cc.algorithm=3Dnewreno

net.inet.tcp.cc.algorithm: cubic -> newreno

cc@n1:~ %


And let me know the res= ult of `newreno` vs. `cubic`, for example:
iperf3 -B ${src} --cpo= rt ${tcp_port} -c ${dst} -l 1M -t 20 -i 2 -VC newreno

cc

On Tue, Oct 22, 2024 at 4:13=E2=80=AFPM void <void@f-m.fm> wrote:
On Tue,= Oct 22, 2024 at 03:57:42PM -0400, Cheng Cui wrote:
>What is the output from `ping` (latency) between these VMs?

That test wasn't between VMs. It was from the vm with the patches to a = workstation
on the same switch.

ping from the vm to the workstation:

--- 192.168.1.232 ping statistics ---
10 packets transmitted, 10 packets received, 0.0% packet loss
round-trip min/avg/max/stddev =3D 0.643/0.796/0.870/0.070 ms

ping from the vm with patches to an alpine linux vm on the same host:

--- 192.168.1.65 ping statistics ---
10 packets transmitted, 10 packets received, 0.0% packet loss
round-trip min/avg/max/stddev =3D 0.734/0.859/0.963/0.073 ms

--



--
Best Regards,
Cheng Cui
--0000000000007b749c06252406ca-- From nobody Wed Oct 23 15:04:40 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYXQP0zVlz5ZKyv for ; Wed, 23 Oct 2024 15:04:45 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-b3-smtp.messagingengine.com (fhigh-b3-smtp.messagingengine.com [202.12.124.154]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYXQM6mdVz4qn9 for ; Wed, 23 Oct 2024 15:04:43 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=mKVkWafb; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=PL7twU2f; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.154 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-03.internal (phl-compute-03.phl.internal [10.202.2.43]) by mailfhigh.stl.internal (Postfix) with ESMTP id 2EB252540110 for ; Wed, 23 Oct 2024 11:04:43 -0400 (EDT) Received: from phl-mailfrontend-01 ([10.202.2.162]) by phl-compute-03.internal (MEProxy); Wed, 23 Oct 2024 11:04:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729695883; x=1729782283; bh=QdCIqQNALJ qN2B1IGsw2upWex4oOI72qQXSUkfXmj1A=; b=mKVkWafbNh5MzqpMXAx03n8700 Par7gGPMHwqat/++UeWQ2oPIB/f4jIQEs/jlouQZNwzTlapVWDN+SC0W7hA981SU mFz0WAL+uiAe1ByWiiJkCxDDBVHde4JKFAnrBUZ9iUmIjZDHmDZBAWjcsguYKJ+D ULehLlc8aGwjPRAPNU0mm+OtJzFsUazIXeyel/JN8G52iJxU0mA+qxQqpCOgJie0 NnanZyBtrZ7bVrowO7fdnVuRx7nIcoA2ihhkK4xJISXAMJziqOjv0/G2iNoaGy4D Hrzf4aZmpj+G4G6KayZ8NLct0aNYTLapxlni9W+nnqkalbhzMt03ItnHmHGw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729695883; x=1729782283; bh=QdCIqQNALJqN2B1IGsw2upWex4oO I72qQXSUkfXmj1A=; b=PL7twU2fU9NVwHjJg0yB5wZ6tnxmz4JaZztzJWVDW74Q meDRgSX5XvDzr7GIEUugqQ3itTZKJoFgZKzb2CnVk6YJMnAYnhqudFKXJK+BuKDi WUsvBn7mXGIvQDLD2BgOccik5juLMt/gqR5rh/XNYkAnhmY12Ptk5nhgkWQxioTb wDUnxhKyKJd5G0rApTYAHX8UoLGyQ65LgUQGdh1RtrYTX92FCR0DcmjEOpiXRcPB smNrnvUMoChU81c5xjIE7mf4mSgqB+OuwwQDUZAU96gfyeD53NXTOTkQBUYiZkGv 5m2rSUpHEdeL90mf52vSX5VKfcjkQl2qZsTOMHU4Rg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeijedgkedvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuf fkfhggtggujgesthdtredttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepgeetueejvdejfefhteeguddvgffgfffgtdfftd evueeklefgvdelffffffeuvefhnecuffhomhgrihhnpehttghprdgttgdphhhomhgvrdgr rhhprgenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpe hvohhiugesfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhu thdprhgtphhtthhopehfrhgvvggsshguqdhnvghtsehfrhgvvggsshgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 23 Oct 2024 11:04:42 -0400 (EDT) Date: Wed, 23 Oct 2024 16:04:40 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: Performance test for CUBIC in stable/14 Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.54 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.94)[-0.938]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.154:from]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:151847, ipnet:202.12.124.0/24, country:AU]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XYXQM6mdVz4qn9 X-Spamd-Bar: --- On Wed, Oct 23, 2024 at 08:28:01AM -0400, Cheng Cui wrote: >The latency does not sound a problem to me. What is the performance of >TCP congestion control algorithm `newreno`? > >In case you need to load `newreno` first. > >cc@n1:~ % sudo kldload newreno > >cc@n1:~ % sudo sysctl net.inet.tcp.cc.algorithm=newreno > >net.inet.tcp.cc.algorithm: cubic -> newreno > >cc@n1:~ % > >And let me know the result of `newreno` vs. `cubic`, for example: >iperf3 -B ${src} --cport ${tcp_port} -c ${dst} -l 1M -t 20 -i 2 -VC newreno speedtests@vm4-fbsd14s:~ % doas kldload newreno speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=newreno net.inet.tcp.cc.algorithm: cubic -> newreno speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c 192.168.1.232 -l 1M -t 20 -i 2 -VC newreno iperf 3.17.1 FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024 root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Control connection MSS 1460 Time: Wed, 23 Oct 2024 14:41:11 UTC Connecting to host 192.168.1.232, port 5201 Cookie: tvrlkd2axzx24uui7gglzk4ni66ib7qy4kxa TCP MSS: 1460 (default) [ 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 5201 Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks, omitting 0 seconds, 20 second test, tos 0 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-2.01 sec 137 MBytes 572 Mbits/sec 0 629 KBytes [ 5] 2.01-4.13 sec 159 MBytes 628 Mbits/sec 0 928 KBytes [ 5] 4.13-6.12 sec 192 MBytes 809 Mbits/sec 0 1.16 MBytes [ 5] 6.12-8.08 sec 153 MBytes 656 Mbits/sec 0 1.33 MBytes [ 5] 8.08-10.08 sec 176 MBytes 737 Mbits/sec 0 1.51 MBytes [ 5] 10.08-12.13 sec 211 MBytes 864 Mbits/sec 0 1.69 MBytes [ 5] 12.13-14.04 sec 138 MBytes 606 Mbits/sec 73 1.01 MBytes [ 5] 14.04-16.02 sec 155 MBytes 657 Mbits/sec 0 1.21 MBytes [ 5] 16.02-18.10 sec 168 MBytes 678 Mbits/sec 0 1.39 MBytes [ 5] 18.10-20.13 sec 188 MBytes 777 Mbits/sec 0 1.56 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-20.13 sec 1.64 GBytes 699 Mbits/sec 73 sender [ 5] 0.00-20.14 sec 1.64 GBytes 698 Mbits/sec receiver CPU Utilization: local/sender 97.7% (0.0%u/97.7%s), remote/receiver 19.5% (1.6%u/17.9%s) snd_tcp_congestion newreno rcv_tcp_congestion newreno iperf Done. ====================================== speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=cubic net.inet.tcp.cc.algorithm: newreno -> cubic speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c 192.168.1.232 -l 1M -t 20 -i 2 -VC cubic iperf 3.17.1 FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024 root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Control connection MSS 1460 Time: Wed, 23 Oct 2024 14:51:30 UTC Connecting to host 192.168.1.232, port 5201 Cookie: wp5nkovyy5pwzqos4lsdlqv4loccl6iu5kdv TCP MSS: 1460 (default) [ 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 5201 Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks, omitting 0 seconds, 20 second test, tos 0 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-2.03 sec 184 MBytes 762 Mbits/sec 0 752 KBytes [ 5] 2.03-4.07 sec 198 MBytes 811 Mbits/sec 0 1.05 MBytes [ 5] 4.07-6.13 sec 193 MBytes 787 Mbits/sec 0 1.28 MBytes [ 5] 6.13-8.08 sec 203 MBytes 874 Mbits/sec 0 1.48 MBytes [ 5] 8.08-10.13 sec 192 MBytes 786 Mbits/sec 0 1.65 MBytes [ 5] 10.13-12.13 sec 156 MBytes 653 Mbits/sec 44 1.40 MBytes [ 5] 12.13-14.13 sec 167 MBytes 703 Mbits/sec 16 1.04 MBytes [ 5] 14.13-16.07 sec 167 MBytes 721 Mbits/sec 0 1.25 MBytes [ 5] 16.07-18.02 sec 114 MBytes 490 Mbits/sec 0 1.37 MBytes [ 5] 18.02-20.04 sec 173 MBytes 719 Mbits/sec 0 1.53 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-20.04 sec 1.71 GBytes 731 Mbits/sec 60 sender [ 5] 0.00-20.05 sec 1.71 GBytes 730 Mbits/sec receiver CPU Utilization: local/sender 97.6% (0.0%u/97.6%s), remote/receiver 20.5% (1.8%u/18.6%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic iperf Done. speedtests@vm4-fbsd14s:~ % -- From nobody Wed Oct 23 19:14:08 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYdyw5DR9z5ZZrN for ; Wed, 23 Oct 2024 19:14:48 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f43.google.com (mail-lf1-f43.google.com [209.85.167.43]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYdyw1Rc5z4Hbw for ; Wed, 23 Oct 2024 19:14:48 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f43.google.com with SMTP id 2adb3069b0e04-539e58878f2so13072e87.2 for ; Wed, 23 Oct 2024 12:14:48 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729710886; x=1730315686; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=S5S6iRYJYkQZky/yhCS5fI5XjZYzIwbsVY0McEBJac4=; b=RKPFEjctJ0Th7KZJ64KHd+emEsP4mabfIgvFvrncZkntuPltQJpOxC4gsu/AsXd4xx Ozju9olgd8VWbveI+gOb9ZkuazRxskZQSrMyhKpMRykDe6IklDsfpL4Zjh1bzbR3vvdF auUTgr30AiwgST7EG7na7bMGnt28oPwJY0uTXvb58o1Yrc0u3s2ZKaPp10RW+McGj9pm eEZE1XgxmMrLmuptgEVIPSyLohTHfoT7oXpVqw2V0SjGY7y+wSQ+mi9ILzpN1Wx3kFeo KGA02Qi+8ZzKZ8uv51aBaCeuNGBsxnBch1aXQba/ZlkAx1bRQrU/McvESJ9PdnbQzySj cYMQ== X-Gm-Message-State: AOJu0YwGpWHMxBElcwwa2NzsTHTUyhd/JAVqiDIvSOKAgrM9D7hoOkAX UM7CxDaOKY87VafcwZY8U7J+fz99iEGYNh87pUHFxMa3a/BS5LsYOqF3qMYT X-Google-Smtp-Source: AGHT+IHN5FhsBJlVWa3LUvGNog6i+CQmp5PqxcO/pwkWb2Zuo37NegyFmN7z02U0LWPSBPxeC6/A9A== X-Received: by 2002:a05:6512:6cc:b0:536:554a:b9c2 with SMTP id 2adb3069b0e04-53b1a2fe0c4mr602138e87.2.1729710885764; Wed, 23 Oct 2024 12:14:45 -0700 (PDT) Received: from mail-lf1-f48.google.com (mail-lf1-f48.google.com. [209.85.167.48]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-53a224202e0sm1129343e87.167.2024.10.23.12.14.45 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 23 Oct 2024 12:14:45 -0700 (PDT) Received: by mail-lf1-f48.google.com with SMTP id 2adb3069b0e04-539d9ba5c81so17124e87.0 for ; Wed, 23 Oct 2024 12:14:45 -0700 (PDT) X-Received: by 2002:a05:6512:3c88:b0:535:4d89:5b52 with SMTP id 2adb3069b0e04-53b1a2fe5abmr639893e87.1.1729710885048; Wed, 23 Oct 2024 12:14:45 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Cheng Cui Date: Wed, 23 Oct 2024 15:14:08 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="000000000000de1bc8062529b2fb" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4XYdyw1Rc5z4Hbw X-Spamd-Bar: ---- --000000000000de1bc8062529b2fb Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I see. The result of `newreno` vs. `cubic` shows non-constant/infrequent packet retransmission. So TCP congestion control has little impact on improving th= e performance. The performance bottleneck may come from somewhere else. For example, the sender CPU shows 97.7% utilization. Would there be any way to reduce CPU usage? cc On Wed, Oct 23, 2024 at 11:04=E2=80=AFAM void wrote: > On Wed, Oct 23, 2024 at 08:28:01AM -0400, Cheng Cui wrote: > >The latency does not sound a problem to me. What is the performance of > >TCP congestion control algorithm `newreno`? > > > >In case you need to load `newreno` first. > > > >cc@n1:~ % sudo kldload newreno > > > >cc@n1:~ % sudo sysctl net.inet.tcp.cc.algorithm=3Dnewreno > > > >net.inet.tcp.cc.algorithm: cubic -> newreno > > > >cc@n1:~ % > > > >And let me know the result of `newreno` vs. `cubic`, for example: > >iperf3 -B ${src} --cport ${tcp_port} -c ${dst} -l 1M -t 20 -i 2 -VC > newreno > > speedtests@vm4-fbsd14s:~ % doas kldload newreno > speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=3Dnewren= o > net.inet.tcp.cc.algorithm: cubic -> newreno > > speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c > 192.168.1.232 > -l 1M -t 20 -i 2 -VC newreno > iperf 3.17.1 > FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 > stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024 > root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 > Control connection MSS 1460 > Time: Wed, 23 Oct 2024 14:41:11 UTC > Connecting to host 192.168.1.232, port 5201 > Cookie: tvrlkd2axzx24uui7gglzk4ni66ib7qy4kxa > TCP MSS: 1460 (default) > [ 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 5201 > Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks, omitting 0 > seconds, > 20 second test, tos 0 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-2.01 sec 137 MBytes 572 Mbits/sec 0 629 KBytes > > [ 5] 2.01-4.13 sec 159 MBytes 628 Mbits/sec 0 928 KBytes > > [ 5] 4.13-6.12 sec 192 MBytes 809 Mbits/sec 0 1.16 MBytes > > [ 5] 6.12-8.08 sec 153 MBytes 656 Mbits/sec 0 1.33 MBytes > > [ 5] 8.08-10.08 sec 176 MBytes 737 Mbits/sec 0 1.51 MBytes > > [ 5] 10.08-12.13 sec 211 MBytes 864 Mbits/sec 0 1.69 MBytes > > [ 5] 12.13-14.04 sec 138 MBytes 606 Mbits/sec 73 1.01 MBytes > > [ 5] 14.04-16.02 sec 155 MBytes 657 Mbits/sec 0 1.21 MBytes > > [ 5] 16.02-18.10 sec 168 MBytes 678 Mbits/sec 0 1.39 MBytes > > [ 5] 18.10-20.13 sec 188 MBytes 777 Mbits/sec 0 1.56 MBytes > > - - - - - - - - - - - - - - - - - - - - - - - - - > Test Complete. Summary Results: > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-20.13 sec 1.64 GBytes 699 Mbits/sec 73 sender > [ 5] 0.00-20.14 sec 1.64 GBytes 698 Mbits/sec receiver > CPU Utilization: local/sender 97.7% (0.0%u/97.7%s), remote/receiver 19.5% > (1.6%u/17.9%s) > snd_tcp_congestion newreno > rcv_tcp_congestion newreno > > iperf Done. > > =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > > speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=3Dcubic > net.inet.tcp.cc.algorithm: newreno -> cubic > > speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c > 192.168.1.232 > -l 1M -t 20 -i 2 -VC cubic > iperf 3.17.1 > FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 > stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024 > root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 > Control connection MSS 1460 > Time: Wed, 23 Oct 2024 14:51:30 UTC > Connecting to host 192.168.1.232, port 5201 > Cookie: wp5nkovyy5pwzqos4lsdlqv4loccl6iu5kdv > TCP MSS: 1460 (default) > [ 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 5201 > Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks, > omitting 0 seconds, 20 second test, tos 0 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-2.03 sec 184 MBytes 762 Mbits/sec 0 752 KBytes > > [ 5] 2.03-4.07 sec 198 MBytes 811 Mbits/sec 0 1.05 MBytes > > [ 5] 4.07-6.13 sec 193 MBytes 787 Mbits/sec 0 1.28 MBytes > > [ 5] 6.13-8.08 sec 203 MBytes 874 Mbits/sec 0 1.48 MBytes > > [ 5] 8.08-10.13 sec 192 MBytes 786 Mbits/sec 0 1.65 MBytes > > [ 5] 10.13-12.13 sec 156 MBytes 653 Mbits/sec 44 1.40 MBytes > > [ 5] 12.13-14.13 sec 167 MBytes 703 Mbits/sec 16 1.04 MBytes > > [ 5] 14.13-16.07 sec 167 MBytes 721 Mbits/sec 0 1.25 MBytes > > [ 5] 16.07-18.02 sec 114 MBytes 490 Mbits/sec 0 1.37 MBytes > > [ 5] 18.02-20.04 sec 173 MBytes 719 Mbits/sec 0 1.53 MBytes > > - - - - - - - - - - - - - - - - - - - - - - - - - > Test Complete. Summary Results: > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-20.04 sec 1.71 GBytes 731 Mbits/sec 60 > sender > [ 5] 0.00-20.05 sec 1.71 GBytes 730 Mbits/sec > receiver > CPU Utilization: local/sender 97.6% (0.0%u/97.6%s), remote/receiver > 20.5% (1.8%u/18.6%s) > snd_tcp_congestion cubic > rcv_tcp_congestion cubic > > iperf Done. > speedtests@vm4-fbsd14s:~ % > > -- > > --=20 Best Regards, Cheng Cui --000000000000de1bc8062529b2fb Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I see. The result of `newreno` vs. `cubic` shows non-= constant/infrequent packet
retransmission. So TCP congestion cont= rol has little impact on improving=C2=A0the
performance.

The performance bottleneck=C2=A0may come=C2=A0from somewhe= re else. For=C2=A0example, the
sender CPU shows 97.7% utilization= . Would there be any way to reduce CPU
usage?

<= /div>
cc

On Wed, Oct 23, 2024 at 11:04=E2=80=AFAM void <void@f-m.fm> wrote:
On W= ed, Oct 23, 2024 at 08:28:01AM -0400, Cheng Cui wrote:
>The latency does not sound a problem to me. What is the performance of<= br> >TCP congestion control algorithm `newreno`?
>
>In case you need to load `newreno` first.
>
>cc@n1:~ % sudo kldload newreno
>
>cc@n1:~ % sudo sysctl net.inet.tcp.cc.algorithm=3Dnewreno
>
>net.inet.tcp.cc.algorithm: cubic -> newreno
>
>cc@n1:~ %
>
>And let me know the result of `newreno` vs. `cubic`, for example:
>iperf3 -B ${src} --cport ${tcp_port} -c ${dst} -l 1M -t 20 -i 2 -VC new= reno

speedtests@vm4-fbsd14s:~ % doas kldload newreno
speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=3Dnewreno<= br> net.inet.tcp.cc.algorithm: cubic -> newreno

speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c 192.168.1= .232
-l 1M -t 20 -i 2 -VC newreno
iperf 3.17.1
FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024
root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Control connection MSS 1460
Time: Wed, 23 Oct 2024 14:41:11 UTC
Connecting to host 192.168.1.232, port 5201
=C2=A0 =C2=A0 =C2=A0 =C2=A0Cookie: tvrlkd2axzx24uui7gglzk4ni66ib7qy4kxa
=C2=A0 =C2=A0 =C2=A0 =C2=A0TCP MSS: 1460 (default)
[=C2=A0 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 520= 1
Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks, omitting 0 se= conds,
20 second test, tos 0
[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr=C2=A0 Cwnd
[=C2=A0 5]=C2=A0 =C2=A00.00-2.01=C2=A0 =C2=A0sec=C2=A0 =C2=A0137 MBytes=C2= =A0 =C2=A0572 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A0 629 KBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A02.01-4.13=C2=A0 =C2=A0sec=C2=A0 =C2=A0159 MBytes=C2= =A0 =C2=A0628 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A0 928 KBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A04.13-6.12=C2=A0 =C2=A0sec=C2=A0 =C2=A0192 MBytes=C2= =A0 =C2=A0809 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.16 MBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A06.12-8.08=C2=A0 =C2=A0sec=C2=A0 =C2=A0153 MBytes=C2= =A0 =C2=A0656 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.33 MBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A08.08-10.08=C2=A0 sec=C2=A0 =C2=A0176 MBytes=C2=A0 = =C2=A0737 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.51 MBytes=C2=A0 =C2=A0 =C2= =A0 =C2=A0
[=C2=A0 5]=C2=A0 10.08-12.13=C2=A0 sec=C2=A0 =C2=A0211 MBytes=C2=A0 =C2=A08= 64 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.69 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 12.13-14.04=C2=A0 sec=C2=A0 =C2=A0138 MBytes=C2=A0 =C2=A06= 06 Mbits/sec=C2=A0 =C2=A073=C2=A0 =C2=A01.01 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 14.04-16.02=C2=A0 sec=C2=A0 =C2=A0155 MBytes=C2=A0 =C2=A06= 57 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.21 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 16.02-18.10=C2=A0 sec=C2=A0 =C2=A0168 MBytes=C2=A0 =C2=A06= 78 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.39 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 18.10-20.13=C2=A0 sec=C2=A0 =C2=A0188 MBytes=C2=A0 =C2=A07= 77 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.56 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr
[=C2=A0 5]=C2=A0 =C2=A00.00-20.13=C2=A0 sec=C2=A0 1.64 GBytes=C2=A0 =C2=A06= 99 Mbits/sec=C2=A0 =C2=A073 sender
[=C2=A0 5]=C2=A0 =C2=A00.00-20.14=C2=A0 sec=C2=A0 1.64 GBytes=C2=A0 =C2=A06= 98 Mbits/sec receiver
CPU Utilization: local/sender 97.7% (0.0%u/97.7%s), remote/receiver 19.5% (= 1.6%u/17.9%s)
snd_tcp_congestion newreno
rcv_tcp_congestion newreno

iperf Done.

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

speedtests@vm4-fbsd14s:~ % doas sysctl net.inet.tcp.cc.algorithm=3Dcubic net.inet.tcp.cc.algorithm: newreno -> cubic

speedtests@vm4-fbsd14s:~ % iperf3 -B 192.168.1.13 --cport 5201 -c 192.168.1= .232
-l 1M -t 20 -i 2 -VC cubic
iperf 3.17.1
FreeBSD vm4-fbsd14s.home.arpa 14.2-PRERELEASE FreeBSD 14.2-PRERELEASE #0 stable/14-n269252-e18ba5c5555a-dirty: Mon Oct 21 18:09:22 BST 2024
root@vm4-fbsd14s.home.arpa:/usr/obj/usr/src/amd64.amd64/sys/GENERIC amd64 Control connection MSS 1460
Time: Wed, 23 Oct 2024 14:51:30 UTC
Connecting to host 192.168.1.232, port 5201
=C2=A0 =C2=A0 =C2=A0 =C2=A0Cookie: wp5nkovyy5pwzqos4lsdlqv4loccl6iu5kdv
=C2=A0 =C2=A0 =C2=A0 =C2=A0TCP MSS: 1460 (default)
[=C2=A0 5] local 192.168.1.13 port 5201 connected to 192.168.1.232 port 520= 1
Starting Test: protocol: TCP, 1 streams, 1048576 byte blocks,
omitting 0 seconds, 20 second test, tos 0
[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr=C2=A0 Cwnd
[=C2=A0 5]=C2=A0 =C2=A00.00-2.03=C2=A0 =C2=A0sec=C2=A0 =C2=A0184 MBytes=C2= =A0 =C2=A0762 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A0 752 KBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A02.03-4.07=C2=A0 =C2=A0sec=C2=A0 =C2=A0198 MBytes=C2= =A0 =C2=A0811 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.05 MBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A04.07-6.13=C2=A0 =C2=A0sec=C2=A0 =C2=A0193 MBytes=C2= =A0 =C2=A0787 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.28 MBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A06.13-8.08=C2=A0 =C2=A0sec=C2=A0 =C2=A0203 MBytes=C2= =A0 =C2=A0874 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.48 MBytes=C2=A0 =C2=A0= =C2=A0 =C2=A0
[=C2=A0 5]=C2=A0 =C2=A08.08-10.13=C2=A0 sec=C2=A0 =C2=A0192 MBytes=C2=A0 = =C2=A0786 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.65 MBytes=C2=A0 =C2=A0 =C2= =A0 =C2=A0
[=C2=A0 5]=C2=A0 10.13-12.13=C2=A0 sec=C2=A0 =C2=A0156 MBytes=C2=A0 =C2=A06= 53 Mbits/sec=C2=A0 =C2=A044=C2=A0 =C2=A01.40 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 12.13-14.13=C2=A0 sec=C2=A0 =C2=A0167 MBytes=C2=A0 =C2=A07= 03 Mbits/sec=C2=A0 =C2=A016=C2=A0 =C2=A01.04 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 14.13-16.07=C2=A0 sec=C2=A0 =C2=A0167 MBytes=C2=A0 =C2=A07= 21 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.25 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 16.07-18.02=C2=A0 sec=C2=A0 =C2=A0114 MBytes=C2=A0 =C2=A04= 90 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.37 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
[=C2=A0 5]=C2=A0 18.02-20.04=C2=A0 sec=C2=A0 =C2=A0173 MBytes=C2=A0 =C2=A07= 19 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A01.53 MBytes=C2=A0 =C2=A0 =C2=A0 =C2= =A0
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr
[=C2=A0 5]=C2=A0 =C2=A00.00-20.04=C2=A0 sec=C2=A0 1.71 GBytes=C2=A0 =C2=A07= 31 Mbits/sec=C2=A0 =C2=A060
sender
[=C2=A0 5]=C2=A0 =C2=A00.00-20.05=C2=A0 sec=C2=A0 1.71 GBytes=C2=A0 =C2=A07= 30 Mbits/sec
receiver
CPU Utilization: local/sender 97.6% (0.0%u/97.6%s), remote/receiver
20.5% (1.8%u/18.6%s)
snd_tcp_congestion cubic
rcv_tcp_congestion cubic

iperf Done.
speedtests@vm4-fbsd14s:~ %

--



--
Best Regards,
Cheng Cui
--000000000000de1bc8062529b2fb-- From nobody Wed Oct 23 21:43:21 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYjGP5SsXz5ZjGf for ; Wed, 23 Oct 2024 21:43:25 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fhigh-a3-smtp.messagingengine.com (fhigh-a3-smtp.messagingengine.com [103.168.172.154]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYjGN6sBkz4ZLD for ; Wed, 23 Oct 2024 21:43:24 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=q2z8ImfJ; dkim=pass header.d=messagingengine.com header.s=fm3 header.b=U1eWDxRM; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 103.168.172.154 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-05.internal (phl-compute-05.phl.internal [10.202.2.45]) by mailfhigh.phl.internal (Postfix) with ESMTP id B0570114016C for ; Wed, 23 Oct 2024 17:43:23 -0400 (EDT) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-05.internal (MEProxy); Wed, 23 Oct 2024 17:43:23 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-type:content-type:date:date:from:from:in-reply-to :in-reply-to:message-id:mime-version:references:reply-to:subject :subject:to:to; s=fm3; t=1729719803; x=1729806203; bh=H0mpX96msi o0xBJWrwxOxNdyV8PWOiZqIC4v3ETmkvs=; b=q2z8ImfJI/KxM6HVPip4DX+HZ9 x7Yzk8qn+9hL9qw3jYZt4Agu55yhMQvEO0OGvvy8yxPM1NlqqvXq9qOfijjo6Vrn Xf+WKtsQSYHr7/+BqhpEllCm3dXePd24zTNUMzANc8842EeVOMzJqhzSmhbOb5kM 5J4BCHl8//a62lan1QAU5xnmEvU7+fapJCo69LrygkjzeklDylWQt/mgUVhEiT9m 7W0tM0HbtJmjCE5a6o21RBmdWYNYIMhfb19tk4aoxh9JsgZtS7BL7q0bCgb1HEbi FmOSZg8bzz5CJIKLSxfKMAjP2fdOgA51/dhvKdklVN5vWV89Wo7+VeFOq6RQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:content-type:date:date :feedback-id:feedback-id:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:subject:subject:to :to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm3; t=1729719803; x=1729806203; bh=H0mpX96msio0xBJWrwxOxNdyV8PW OiZqIC4v3ETmkvs=; b=U1eWDxRMtokCNKoYdJD6D1i8Qw1YRItnAh0FUz4/ZKN7 izn/yNHyF9yKYRUVjokxaY16oIIsZB6kTKCNxwVmAkYyvkKyJaGLfQVZ2k0bZRGT LMkf+o6yZlNhjVFRt4nuH1R8LxRqkwpWkIUObHmUtHLcO0O9mOkEW1BisJGNzDII AqzpNmQlGTYgzVWbrJs+B4uZNEKCo+bwwVK/wuQky+oxn9WdkbV7lSkIdJeqEr7/ LlXRANUmWbv9iuf9W8OoIsUywtSwE+XGjLmKD3Ky4p1NUrkWSPBbI9TpQv3/ZJtW WbyArvJS/xD/oSBcUwx7gICqljhWPeeoJaYTUiny2w== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdeikedgtddvucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpeffhffvuf fkfhggtggujgesthdtredttddtvdenucfhrhhomhepvhhoihguuceovhhoihgusehfqdhm rdhfmheqnecuggftrfgrthhtvghrnhepkeeluddvlefhieelfefggffhffektdehleelgf dugfdvgeekjeejuddtheehgfeunecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghm pehmrghilhhfrhhomhepvhhoihgusehfqdhmrdhfmhdpnhgspghrtghpthhtohepuddpmh houggvpehsmhhtphhouhhtpdhrtghpthhtohepfhhrvggvsghsugdqnhgvthesfhhrvggv sghsugdrohhrgh X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Wed, 23 Oct 2024 17:43:23 -0400 (EDT) Date: Wed, 23 Oct 2024 22:43:21 +0100 From: void To: freebsd-net@freebsd.org Subject: Re: Performance test for CUBIC in stable/14 Message-ID: References: List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline In-Reply-To: X-Spamd-Result: default: False [-3.56 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-0.98)[-0.980]; NEURAL_HAM_SHORT(-0.98)[-0.980]; MID_RHS_NOT_FQDN(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:103.168.172.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[103.168.172.154:from]; FREEMAIL_FROM(0.00)[f-m.fm]; RCVD_TLS_LAST(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_THREE(0.00)[3]; RCPT_COUNT_ONE(0.00)[1]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; MISSING_XM_UA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; ASN(0.00)[asn:209242, ipnet:103.168.172.0/24, country:US]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim] X-Rspamd-Queue-Id: 4XYjGN6sBkz4ZLD X-Spamd-Bar: --- On Wed, Oct 23, 2024 at 03:14:08PM -0400, Cheng Cui wrote: >I see. The result of `newreno` vs. `cubic` shows non-constant/infrequent >packet >retransmission. So TCP congestion control has little impact on improving the >performance. > >The performance bottleneck may come from somewhere else. For example, the >sender CPU shows 97.7% utilization. Would there be any way to reduce CPU >usage? There are 11 VMs running on the bhyve server. None of them are very busy but the server shows % uptime 9:54p.m. up 8 days, 6:08, 22 users, load averages: 0.82, 1.25, 1.74 The test vm vm4-fbsd14s: % uptime 9:55PM up 2 days, 3:12, 5 users, load averages: 0.35, 0.31, 0.21 It has % sysctl hw.ncpu hw.ncpu: 8 and avail memory = 66843062272 (63746 MB) so it's not short of resources. A test just now gave these results: - - - - - - - - - - - - - - - - - - - - - - - - - Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-20.04 sec 1.31 GBytes 563 Mbits/sec 0 sender [ 5] 0.00-20.06 sec 1.31 GBytes 563 Mbits/sec receiver CPU Utilization: local/sender 94.1% (0.1%u/94.1%s), remote/receiver 15.5% (1.5%u/13.9%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic iperf Done. so I'm not sure how the utilization figure was synthesised, unless it's derived from something like 'top' where 1.00 is 100%. Load when running the test got to 0.83 as observed in 'top' in another terminal. Five mins after the test, load in the vm is: 0.32, 0.31, 0.26 on the bhyve host: 0.39, 0.61, 1.11 Before we began testing, I was looking at the speed issue as being caused by something to do with interrupts and/or polling, and/or HZ, somehting that linux handles differently and gives better results on the same bhyve host. Maybe rebuilding the kernel with a different scheduler on both the host and the freebsd vms will give a better result for freebsd if tweaking sysctls doesn't make much of a difference. In terms of real-world bandwidth, I found that the combination of your modified cc_cubic + rack gave the best results in terms of overall throughput in a speedtest context, although it's slower to get to its max throughput than cubic alone. I'm still testing with a webdav/rsync context (cubic against cubic+rack) The next lot of testing after changing the scheduler will be on a KVM host, with various *BSDs as guests. There may be a tradeoff of stability against speed I guess. -- From nobody Wed Oct 23 23:43:17 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XYlwx2nPQz5Znsf for ; Wed, 23 Oct 2024 23:43:29 +0000 (UTC) (envelope-from nparhar@gmail.com) Received: from mail-yw1-x112d.google.com (mail-yw1-x112d.google.com [IPv6:2607:f8b0:4864:20::112d]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XYlwx2Kbqz4mWd for ; Wed, 23 Oct 2024 23:43:29 +0000 (UTC) (envelope-from nparhar@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-yw1-x112d.google.com with SMTP id 00721157ae682-6e34fa656a2so3487447b3.1 for ; Wed, 23 Oct 2024 16:43:29 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1729727008; x=1730331808; darn=freebsd.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=PpBppLbdKKjpayb0pGphjeqtoA8xYV/HbeKEKBOoPZU=; b=aPYpWsu+4Xz7IW8jJJum7H/uqrJZH/pmjIFhKx5W2ciVsm0nFnvmgirYzGhQhGQWpY cYcUedretxxGMXJWquLMsTnhCr5OSN35wzEedj7pXvtnh6Y8/Ws05PdBeJLg5bfvjrvW L6Eq6n3NWBvWz0ZgZoD0DhsEV3ORF3QoECx+baNjQ74SXXSTY8W3v4dMRXGGF5HY7aeq 3Cwehku0jEagUUTbaDc302Nsv/J6Fj6QBkl5GEkOMGkDvP+ZkRMkqlLTEv4vwFON9QkR 4DfXdAUG9HtF2m87W6353JcPUfStr3kb3xauiVQwd2HcWwB1uxqBSiepfp2pxJH2JZyp 6H4A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729727008; x=1730331808; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=PpBppLbdKKjpayb0pGphjeqtoA8xYV/HbeKEKBOoPZU=; b=EXJiFvNkqlN8vaBRLJ8+Cpem9l7aVYAd8Y0PR92sl94Rv/kdrgbpJbQ1lVYkk2P9je BRDEEVPv3WfHQTsrNFdLtSKzGI6oILs419lvRiqEg/aI7qRewzLzIeSEz6VGtu3WZltA /mloCaCV22f1MWdcMbfxys/gF3nX2tKRD+x0LxKLB4Rbk1HNc//vBoj7l3u0qj4gEv55 l4/EUCwKI5QSHi/leXnF4pc5bF+Sbe/mQwI0q6Y+qPvaaV9+jELSqvSf/1O3rDF9C2Sc SWcoR1O0DGrBVHIoVCxDFaQiChBxKeRkz1h9TxFvBNHwycr1n9X+lG97p3fgMpqXpD9n ndtQ== X-Gm-Message-State: AOJu0YyXS9OgH0ntzKWpcET2v0x2JMUA48kIfzQJ0GqgOsoldQqRasi0 qri7mxI9I/RdZ2dR+E8sCUDIeyzFXvJvbuvy7+7Z4uoLRnNZK3q5hQwdHrXsDBgPx05BH18e+fu 9xBmmvhn0qFuJbMjPOx9YTeV6qPCfPugM X-Google-Smtp-Source: AGHT+IG5w1DWZeJyShPRsY4/82IQBEuJoRELXWMrT9+D3mO1Z9Xi6IeR0DeldgokNxlQ9uSmA5J7PUTQlIesLpjEL6U= X-Received: by 2002:a05:690c:f0d:b0:6e2:d2a:e998 with SMTP id 00721157ae682-6e7f0dc197fmr41837077b3.2.1729727008579; Wed, 23 Oct 2024 16:43:28 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Navdeep Parhar Date: Wed, 23 Oct 2024 16:43:17 -0700 Message-ID: Subject: Re: Chelsio / cxlv(4): strange messages, SR-IOV interface does not work To: Lexi Winter Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="000000000000e7a81406252d733f" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:2607:f8b0::/32, country:US] X-Rspamd-Queue-Id: 4XYlwx2Kbqz4mWd X-Spamd-Bar: ---- --000000000000e7a81406252d733f Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On Tue, Oct 22, 2024 at 11:21=E2=80=AFPM Lexi Winter wrot= e: > hello, > > i'm trying to configure a cxlv(4) device, which is a VF of a Chelsio > T540-CR on a host running bhyve. > > host: FreeBSD 15.0-CURRENT #3 lf/main-n269068-2cff93ced1d: Wed Oct 23 > 02:48:20 BST 2024 > guest: FreeBSD 15.0-CURRENT #2 lf/main-n269067-56dd459904b: Sat Oct 19 > 18:36:40 BST 2024 > > the VF appears correctly in the VM: > > root@lily:~ # kldload if_cxlv > t5vf0: mem > 0xc000e000-0xc000efff,0xc0000000-0xc0007fff,0xc0008000-0xc0009fff at > device 6.0 on pci0 > t5vf0: 1 ports, 2 MSI-X interrupts, 4 eq, 2 iq > cxlv0: on t5vf0 > cxlv0: 2 txq, 1 rxq (NIC) > > and after bringing the interface 'up' everything seems fine: > > root@lily:~ # ifconfig cxlv0 > cxlv0: flags=3D1008843 > metric 0 mtu 1500 > > > options=3D6ec07bb > ether 06:44:3f:e7:60:30 > media: Ethernet 10Gbase-Twinax (10Gbase-Twinax > ) > status: active > nd6 options=3D29 > > however, trying to assign an IP address causes immediate problems: > > root@lily:~ # ifconfig cxlv0 inet6 2001:8b0:aab5:7::10/64 > root@lily:~ # Oct 23 06:16:07 lily kernel: cxlv0: a looped back NS > message is detected during DAD for fe80:3::444:3fff:fee7:6030. Another > DAD probes are being sent. > root@lily:~ # dmesg|grep loop > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > cxlv0: a looped back NS message is detected during DAD for > fe80:3::444:3fff:fee7:6030. Another DAD probes are being sent. > > i find this strange because the link local IP address in the kernel > error is not even configured on the interface: > > root@lily:~ # ifconfig cxlv0 > cxlv0: flags=3D1008843 > metric 0 mtu 1500 > > > options=3D6ec07bb > ether 06:44:3f:e7:60:30 > inet6 2001:8b0:aab5:7::10/64 > inet6 fe80::444:3fff:fee7:6030%cxlv0/64 tentative scopeid 0x3 > media: Ethernet 10Gbase-Twinax (10Gbase-Twinax > ) > status: active > nd6 options=3D21 > > am i doing something wrong here? > You can disable IPv6 DAD as a workaround for this issue. The problem is that the VF's multicast tx is getting reflected back to it by the internal switch when it shouldn't. # sysctl net.inet6.ip6.dad_count=3D0 Regards, Navdeep > > thanks, lexi. > > --000000000000e7a81406252d733f Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable

On Tue, Oct 22, 2024 at 11:21=E2=80=AFPM Lexi Winter <lexi@le-fay.org> wrote:
hello,

i'm trying to configure a cxlv(4) device, which is a VF of a Chelsio T540-CR on a host running bhyve.

host: FreeBSD 15.0-CURRENT #3 lf/main-n269068-2cff93ced1d: Wed Oct 23
02:48:20 BST 2024
guest: FreeBSD 15.0-CURRENT #2 lf/main-n269067-56dd459904b: Sat Oct 19
18:36:40 BST 2024

the VF appears correctly in the VM:

root@lily:~ # kldload if_cxlv
t5vf0: <Chelsio T540-CR VF> mem
0xc000e000-0xc000efff,0xc0000000-0xc0007fff,0xc0008000-0xc0009fff at
device 6.0 on pci0
t5vf0: 1 ports, 2 MSI-X interrupts, 4 eq, 2 iq
cxlv0: <port 0> on t5vf0
cxlv0: 2 txq, 1 rxq (NIC)

and after bringing the interface 'up' everything seems fine:

root@lily:~ # ifconfig cxlv0
cxlv0: flags=3D1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP&g= t;
metric 0 mtu 1500

options=3D6ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_H= WCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HW= RXTSTMP,MEXTPG>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ether 06:44:3f:e7:60:30
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0media: Ethernet 10Gbase-Twinax <full-d= uplex> (10Gbase-Twinax
<full-duplex,rxpause,txpause>)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0status: active
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D29<PERFORMNUD,IFDISABLED= ,AUTO_LINKLOCAL>

however, trying to assign an IP address causes immediate problems:

root@lily:~ # ifconfig cxlv0 inet6 2001:8b0:aab5:7::10/64
root@lily:~ # Oct 23 06:16:07 lily kernel: cxlv0: a looped back NS
message is detected during DAD for fe80:3::444:3fff:fee7:6030.=C2=A0 Anothe= r
DAD probes are being sent.
root@lily:~ # dmesg|grep loop
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.
cxlv0: a looped back NS message is detected during DAD for
fe80:3::444:3fff:fee7:6030.=C2=A0 Another DAD probes are being sent.

i find this strange because the link local IP address in the kernel
error is not even configured on the interface:

root@lily:~ # ifconfig cxlv0
cxlv0: flags=3D1008843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST,LOWER_UP&g= t;
metric 0 mtu 1500

options=3D6ec07bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_H= WCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,LINKSTATE,RXCSUM_IPV6,TXCSUM_IPV6,HWSTATS,HW= RXTSTMP,MEXTPG>
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0ether 06:44:3f:e7:60:30
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet6 2001:8b0:aab5:7::10/64
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0inet6 fe80::444:3fff:fee7:6030%cxlv0/64 t= entative scopeid 0x3
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0media: Ethernet 10Gbase-Twinax <full-d= uplex> (10Gbase-Twinax
<full-duplex,rxpause,txpause>)
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0status: active
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0nd6 options=3D21<PERFORMNUD,AUTO_LINKL= OCAL>

am i doing something wrong here?

You ca= n disable IPv6 DAD as a=20 workaround for this issue.=C2=A0 The problem is that the VF's multicast= tx is getting reflected back to it by the internal switch when it shouldn't.=

# sysctl net.inet6.ip6.dad_count=3D0

Regards,
Navdeep
=C2=A0

=C2=A0 =C2=A0 =C2=A0 =C2=A0 thanks, lexi.

--000000000000e7a81406252d733f-- From nobody Fri Oct 25 12:13:24 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XZhXY6HrSz5Zfg0 for ; Fri, 25 Oct 2024 12:14:05 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f47.google.com (mail-lf1-f47.google.com [209.85.167.47]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XZhXX64XSz4F46 for ; Fri, 25 Oct 2024 12:14:04 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; dkim=none; spf=pass (mx1.freebsd.org: domain of ccfreebsd@gmail.com designates 209.85.167.47 as permitted sender) smtp.mailfrom=ccfreebsd@gmail.com; dmarc=fail reason="SPF not aligned (relaxed), No valid DKIM" header.from=freebsd.org (policy=none) Received: by mail-lf1-f47.google.com with SMTP id 2adb3069b0e04-539f1d96668so234506e87.3 for ; Fri, 25 Oct 2024 05:14:04 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729858442; x=1730463242; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=Q8aABl+vUKHvu+wBy1vsVHyA7MOda6zok5EfiT0VPMg=; b=gw0pzmVVenM4dH3Kk12p9Vx92HM8GN9vNUD/Dx9qKCNt/Mf0qW5oX3kil2Ei4WVcz3 15tYjX0VrMkaYjri/P5NisNi+642SBxmygdSF1tK3mRXY8dpAy7RekV3TJzCFlp/5OJe u14XTaAZEAUx1/OZ/E5HfthZJvCEw/FXAn2MnYCrWKn6I13HxXwTuxb0/0M3t3ntunT/ T76HCCo2FxyHOTgXEKkjpNH93olllzZlqQwW5vJE1RjdBufH7wnqqpknDJrrYqk+YhvD Kd/qWzHFyQbuLPzmLZhjyLNvgsKOLMinyK1ZJLC+wIdqPuUuZ1GpmVL64nIm8kZyd/mC UGwQ== X-Gm-Message-State: AOJu0YzF/lrt6SiOEl8gk169G7elL2nWX1+6IknZZeBqttqZR+4WXYDE /omKyTgsWiEXYKGP3Zh8qOpJ45+CKWz78XkdjB7zQp3gtLQe6lW40Gtzsa7v X-Google-Smtp-Source: AGHT+IHC9YV7iNxuHkD0IgL+hk8ds+tQ+6GOHa0VU1qOYdbf/9uM3NaMmIuegt/pr7u1Ze6mdElsfA== X-Received: by 2002:a05:6512:6c3:b0:539:eaa9:738c with SMTP id 2adb3069b0e04-53b2f66c720mr241947e87.7.1729858441905; Fri, 25 Oct 2024 05:14:01 -0700 (PDT) Received: from mail-lj1-f173.google.com (mail-lj1-f173.google.com. [209.85.208.173]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-53b2e12452fsm161056e87.73.2024.10.25.05.14.01 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Fri, 25 Oct 2024 05:14:01 -0700 (PDT) Received: by mail-lj1-f173.google.com with SMTP id 38308e7fff4ca-2f75d529b49so1227591fa.1 for ; Fri, 25 Oct 2024 05:14:01 -0700 (PDT) X-Received: by 2002:a05:651c:b26:b0:2fb:55e0:feca with SMTP id 38308e7fff4ca-2fcb6331828mr2171231fa.1.1729858441322; Fri, 25 Oct 2024 05:14:01 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: In-Reply-To: From: Cheng Cui Date: Fri, 25 Oct 2024 08:13:24 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance test for CUBIC in stable/14 To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="000000000000e8353806254c0df1" X-Spamd-Result: default: False [-2.89 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.995]; FORGED_SENDER(0.30)[cc@freebsd.org,ccfreebsd@gmail.com]; R_SPF_ALLOW(-0.20)[+ip4:209.85.128.0/17]; DMARC_POLICY_SOFTFAIL(0.10)[freebsd.org : SPF not aligned (relaxed), No valid DKIM,none]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RCPT_COUNT_TWO(0.00)[2]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_TO(0.00)[f-m.fm]; ARC_NA(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_SOME(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; FROM_HAS_DN(0.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US]; FREEMAIL_ENVFROM(0.00)[gmail.com]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; FROM_NEQ_ENVFROM(0.00)[cc@freebsd.org,ccfreebsd@gmail.com]; MISSING_XM_UA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RWL_MAILSPIKE_POSSIBLE(0.00)[209.85.167.47:from]; R_DKIM_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[209.85.167.47:from,209.85.208.173:received] X-Rspamd-Queue-Id: 4XZhXX64XSz4F46 X-Spamd-Bar: -- --000000000000e8353806254c0df1 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Here is my example. I am using two 6-core/12-threads desktops for my bhyve servers. CPU: AMD Ryzen 5 5560U with Radeon Graphics (2295.75-MHz K8-class CPU) You can find test results on VMs from my wiki: https://wiki.freebsd.org/chengcui/testD46046 All the CPU utilization results are low, especially for these throughput over 900 Mb/s. cc On Wed, Oct 23, 2024 at 5:43=E2=80=AFPM void wrote: > On Wed, Oct 23, 2024 at 03:14:08PM -0400, Cheng Cui wrote: > >I see. The result of `newreno` vs. `cubic` shows non-constant/infrequent > >packet > >retransmission. So TCP congestion control has little impact on improving > the > >performance. > > > >The performance bottleneck may come from somewhere else. For example, th= e > >sender CPU shows 97.7% utilization. Would there be any way to reduce CPU > >usage? > > There are 11 VMs running on the bhyve server. None of them are very busy > but the > server shows > % uptime > 9:54p.m. up 8 days, 6:08, 22 users, load averages: 0.82, 1.25, 1.74 > > The test vm vm4-fbsd14s: > % uptime > 9:55PM up 2 days, 3:12, 5 users, load averages: 0.35, 0.31, 0.21 > > It has > % sysctl hw.ncpu > hw.ncpu: 8 > > and > avail memory =3D 66843062272 (63746 MB) > > so it's not short of resources. > > A test just now gave these results: > - - - - - - - - - - - - - - - - - - - - - - - - - > Test Complete. Summary Results: > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-20.04 sec 1.31 GBytes 563 Mbits/sec 0 > sender > [ 5] 0.00-20.06 sec 1.31 GBytes 563 Mbits/sec > receiver > CPU Utilization: local/sender 94.1% (0.1%u/94.1%s), remote/receiver 15.5% > (1.5%u/13.9%s) > snd_tcp_congestion cubic > rcv_tcp_congestion cubic > > iperf Done. > > so I'm not sure how the utilization figure was synthesised, unless it's > derived > from something like 'top' where 1.00 is 100%. Load when running the test > got to > 0.83 as observed in 'top' in another terminal. Five mins after the test, > load in the vm is: 0.32, 0.31, 0.26 > on the bhyve host: 0.39, 0.61, 1.11 > > Before we began testing, I was looking at the speed issue as being caused > by > something to do with interrupts and/or polling, and/or HZ, somehting that > linux > handles differently and gives better results on the same bhyve host. > Maybe rebuilding the kernel with a different scheduler on both the host > and the > freebsd vms will give a better result for freebsd if tweaking sysctls > doesn't > make much of a difference. > > In terms of real-world bandwidth, I found that the combination of your > modified > cc_cubic + rack gave the best results in terms of overall throughput in a > speedtest context, although it's slower to get to its max throughput than > cubic > alone. I'm still testing with a webdav/rsync context (cubic against > cubic+rack) > > The next lot of testing after changing the scheduler will be on a KVM > host, > with various *BSDs as guests. > > There may be a tradeoff of stability against speed I guess. > -- > > --=20 Best Regards, Cheng Cui --000000000000e8353806254c0df1 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Here is my example. I am using two 6-core/12-threads = desktops for my bhyve servers.
CPU: AMD Ryzen 5 5560U = with Radeon Graphics=C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 (2295.75-MHz K8-class CPU)

<= /div>
You can find test results on VMs from my wiki:=C2=A0https://wiki.freebsd.org/chengc= ui/testD46046

All the CPU utilization results = are low, especially for these throughput over 900 Mb/s.

cc

On Wed, Oct 23, 2024 at 5:43=E2=80=AFPM void <void@f-m.fm> wrote:
On Wed, O= ct 23, 2024 at 03:14:08PM -0400, Cheng Cui wrote:
>I see. The result of `newreno` vs. `cubic` shows non-constant/infrequen= t
>packet
>retransmission. So TCP congestion control has little impact on improvin= g the
>performance.
>
>The performance bottleneck may come from somewhere else. For example, t= he
>sender CPU shows 97.7% utilization. Would there be any way to reduce CP= U
>usage?

There are 11 VMs running on the bhyve server. None of them are very busy bu= t the
server shows
% uptime
=C2=A0 9:54p.m.=C2=A0 up 8 days,=C2=A0 6:08, 22 users, load averages: 0.82,= 1.25, 1.74

The test vm vm4-fbsd14s:
% uptime
=C2=A0 9:55PM=C2=A0 up 2 days,=C2=A0 3:12, 5 users, load averages: 0.35, 0.= 31, 0.21

It has
% sysctl hw.ncpu
hw.ncpu: 8

and
avail memory =3D 66843062272 (63746 MB)

so it's not short of resources.

A test just now gave these results:
- - - - - - - - - - - - - - - - - - - - - - - - -
Test Complete. Summary Results:
[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr
[=C2=A0 5]=C2=A0 =C2=A00.00-20.04=C2=A0 sec=C2=A0 1.31 GBytes=C2=A0 =C2=A05= 63 Mbits/sec=C2=A0 =C2=A0 0=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0= sender
[=C2=A0 5]=C2=A0 =C2=A00.00-20.06=C2=A0 sec=C2=A0 1.31 GBytes=C2=A0 =C2=A05= 63 Mbits/sec=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = receiver
CPU Utilization: local/sender 94.1% (0.1%u/94.1%s), remote/receiver 15.5% (1.5%u/13.9%s)
snd_tcp_congestion cubic
rcv_tcp_congestion cubic

iperf Done.

so I'm not sure how the utilization figure was synthesised, unless it&#= 39;s derived
from something like 'top' where 1.00 is 100%. Load when running the= test got to
0.83 as observed in 'top' in another terminal. Five mins after the = test,
load in the vm is: 0.32, 0.31, 0.26
on the bhyve host: 0.39, 0.61, 1.11

Before we began testing, I was looking at the speed issue as being caused b= y
something to do with interrupts and/or polling, and/or HZ, somehting that l= inux
handles differently and gives better results on the same bhyve host.
Maybe rebuilding the kernel with a different scheduler on both the host and= the
freebsd vms will give a better result for freebsd if tweaking sysctls doesn= 't
make much of a difference.

In terms of real-world bandwidth, I found that the combination of your modi= fied
cc_cubic + rack gave the best results in terms of overall throughput in a speedtest context, although it's slower to get to its max throughput th= an cubic
alone. I'm still testing with a webdav/rsync context (cubic against cub= ic+rack)

The next lot of testing after changing the scheduler will be on a KVM host,=
with various *BSDs as guests.

There may be a tradeoff of stability against speed I guess.
--



--
Best Regards,
Cheng Cui
--000000000000e8353806254c0df1-- From nobody Fri Oct 25 20:21:47 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XZvMT260wz5b75Z for ; Fri, 25 Oct 2024 20:21:57 +0000 (UTC) (envelope-from lexi@le-fay.org) Received: from fuchsia.eden.le-Fay.ORG (fuchsia.eden.le-fay.org [81.187.47.195]) by mx1.freebsd.org (Postfix) with ESMTP id 4XZvMS3BXjz4nfb for ; Fri, 25 Oct 2024 20:21:56 +0000 (UTC) (envelope-from lexi@le-fay.org) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=le-fay.org header.s=fuchsia header.b="BU9/jmyM"; spf=pass (mx1.freebsd.org: domain of lexi@le-fay.org designates 81.187.47.195 as permitted sender) smtp.mailfrom=lexi@le-fay.org; dmarc=none Received: from iris.eden.le-Fay.ORG (unknown [IPv6:2001:8b0:aab5:7::11]) by fuchsia.eden.le-Fay.ORG (Postfix) with ESMTP id 98483501; Fri, 25 Oct 2024 20:21:48 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=le-fay.org; s=fuchsia; t=1729887708; bh=OQAwOITPAmtbTu66fve3uv9rFGww5Cq0uhQY+GIeKe8=; h=Date:Subject:To:Cc:References:From:In-Reply-To; b=BU9/jmyMLyf4tqFCaZ+WBIXVyZJG50fzyZSkv6qXho0ghK3UBrfS6khHA2yOZJzv5 LU/uU/rB1wk62AOuRvJFU88jWzA83Vx5kmQMKL8x1wximVe5oDsrX4n2b3WjcHnD/W BIAcKo2aGENBL1KET9xjvoSM4j3yxs3z3GmS125k= Received: from [IPV6:2001:8b0:aab5:c210:2052:cb63:121f:e82] (unknown [IPv6:2001:8b0:aab5:c210:2052:cb63:121f:e82]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature ECDSA (secp384r1) server-digest SHA384) (No client certificate requested) by iris.eden.le-Fay.ORG (Postfix) with ESMTPSA id 591052C0475; Fri, 25 Oct 2024 21:21:47 +0100 (BST) Message-ID: Date: Fri, 25 Oct 2024 21:21:47 +0100 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: Chelsio / cxlv(4): strange messages, SR-IOV interface does not work Content-Language: en-GB To: Navdeep Parhar Cc: freebsd-net@freebsd.org References: From: Lexi Winter In-Reply-To: Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit X-Spamd-Result: default: False [-3.39 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-0.999]; R_SPF_ALLOW(-0.20)[+ip4:81.187.47.195]; R_DKIM_ALLOW(-0.20)[le-fay.org:s=fuchsia]; MIME_GOOD(-0.10)[text/plain]; RCVD_NO_TLS_LAST(0.10)[]; XM_UA_NO_VERSION(0.01)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; ARC_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:20712, ipnet:81.187.0.0/16, country:GB]; FROM_HAS_DN(0.00)[]; FREEMAIL_TO(0.00)[gmail.com]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; DMARC_NA(0.00)[le-fay.org]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; DKIM_TRACE(0.00)[le-fay.org:+] X-Rspamd-Queue-Id: 4XZvMS3BXjz4nfb X-Spamd-Bar: --- On 24/10/2024 00:43, Navdeep Parhar wrote: > On Tue, Oct 22, 2024 at 11:21 PM Lexi Winter > wrote: > however, trying to assign an IP address causes immediate problems: > > root@lily:~ # ifconfig cxlv0 inet6 2001:8b0:aab5:7::10/64 > root@lily:~ # Oct 23 06:16:07 lily kernel: cxlv0: a looped back NS > message is detected during DAD for fe80:3::444:3fff:fee7:6030.  Another > DAD probes are being sent. > You can disable IPv6 DAD as a workaround for this issue.  The problem is > that the VF's multicast tx is getting reflected back to it by the > internal switch when it shouldn't. > > # sysctl net.inet6.ip6.dad_count=0 thanks Navdeep, after enabling this, networking is working in the VM. however, i can't tell if VLAN filtering is supposed to be working for VF interfaces. from looking at src, it seems like after a couple of recent commits (c57c261790 and 1389314d5) this should be supported. so i configured a VLAN restriction in the iovctl.conf: PF { device : "cxl3"; num_vfs : 16; } DEFAULT { passthrough : true; vlan : 111; } VF-0 { passthrough : true; vlan : 111; mac-addr : "06:00:00:00:05:a0" } configuring cxlv0.111 in the VM works and the VM can communicate on VLAN 111, but if i look at tcpdump inside the VM, i also see untagged traffic on the host port: 21:16:23.874161 74:4d:28:08:81:f6 > 01:80:c2:00:00:0e, ethertype LLDP (0x88cc), length 177: LLDP, length 163: c1.i.lfns.org.uk as well as traffic for VLAN 3003, which is the bhyve host's VLAN: 21:14:28.550117 06:00:00:00:06:01 > 01:00:5e:00:00:0d, ethertype 802.1Q (0x8100), length 72: vlan 3003, p 0, ethertype IPv4 (0x0800), 172.22.0.37 > 224.0.0.13: PIMv2, Hello, length 34 so, it seems like there's no actual VLAN filtering happening in the hardware. is there a sysctl that needs to be enabled to work this? (i did have a quick look through the hw.cxgbe MIB but didn't see anything obvious.) or is this only supported for T4 ASICs, not T5? From nobody Sat Oct 26 17:23:23 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XbRM03lFNz5b0Jv for ; Sat, 26 Oct 2024 17:23:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XbRM001qmz4jNJ for ; Sat, 26 Oct 2024 17:23:24 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729963404; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=StvXt0dcLDjCiud7nQq/eRoR6r4DYIFGa4lN8ph2MmA=; b=XfunGoCMiWKAFgqqIEl4fLWSz6G8hZyUCaCkbRQ/4d9ZBXT1A+9bBpDZoJSqZqrPxwTBLh wEBZ4331YHSPPnA2zBlZC+Okf67PQogw1BYoDghYu1o2uHdTisGUg5Oct7RdOAjwL0nvJZ vEUlfXiAEI1ugH+ioWpvd1bDaHARxQoZC+4FingM/AxynQUYnh6Xgd6GTtJXYuX934/UVI HedjaVpeBrP5CDo7aCYb7WCyalLa6YcIsItVi2ln58uxXU1H31qF83F+lZ+KRf/39J1yWS eXF5fUCrDezAU7AMVHKO9woMBQFC0kBAOraaRvNlPE1aBgr2FWqrH2ULzBbhTQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729963404; a=rsa-sha256; cv=none; b=weB0WMFC3UKBC7+Fe7TmAVddahNnbmBlSrii4kWSXXjrHU9J3xaATDfanJfK363prx90fX pBnLaUmlFwzwLUQhdWVY1SWVOCAwGFw5V9StJTl5eWyFxiWJvtLWTYmQMC5KeeKsiuPv3r 814+0uW+L6NcmROvC2+GBnVt+lNsGpcfK9ROiVLNVRjUmtw2Dcs8yqsodkshYL3F6qS8wH huyeO62UBw0smswANMOELONsuCYYB4buMflrcLIH1VBYA4rAfgl3y2eGXxhwGvPPXO0Mo0 /KwOPEJwmjbXyGutq9AR1J+bXyBfGh2388cQNa88yearVMWtpM1PUrqu8AhH1Q== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XbRLz6mGrzKFW for ; Sat, 26 Oct 2024 17:23:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49QHNNb3063560 for ; Sat, 26 Oct 2024 17:23:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49QHNN8l063559 for net@FreeBSD.org; Sat, 26 Oct 2024 17:23:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 277038] igc driver accesses hardware resources after they are released. Date: Sat, 26 Oct 2024 17:23:23 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 13.2-STABLE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: markj@FreeBSD.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: markj@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D277038 Mark Johnston changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |markj@FreeBSD.org Assignee|net@FreeBSD.org |markj@FreeBSD.org --- Comment #1 from Mark Johnston --- https://reviews.freebsd.org/D47293 --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 26 21:38:02 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XbY0q3CM5z5bCYW for ; Sat, 26 Oct 2024 21:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XbY0q266xz4JfF for ; Sat, 26 Oct 2024 21:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729978683; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=xp8iNZ6KZwae0ncahb4PKstitoQS7jWXXOmhQLtCrZs=; b=O5vciSGoL7iDGqZClz+j1wJcHSIWUwRPLaqJdalOQ/TC3u0Xd/nWIuXpHIy4cfN1dGPI3f LsgHa41HZowah52OByVUs1OnuYtbC1ipAhj8PwNLtVKDSgT3b6N2zbrsFGQDrhOMzBnPmH jEilEM4CQiaRz0wcI5nA7v5tMgX8EG4gfOvhf6lqLrqQ54k7Nn2NN6vVVaz7Jrydpubaja d/w0KXxv5tedwk22zLtLPfiI2DvDRAISIJT1ZhQxPpRGxuvhPmr7UEWhpJZXEBZv2SF9JZ 3ERz3+y1Pn1WGqcOVND4SUF8KvjmdpManrl9kDlWEs40/bzCOv6/bGb7QNBWNg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729978683; a=rsa-sha256; cv=none; b=EuJAvJv0bO2nEJoeulCWaR7oWrX2ofW75SEdv364ws8XNBEnP9ag0LO+UGqGd0xHDNG9YF n/fwP0aRq5wKvYj2f3O0UK25Ibuy2Ictja/rKFtSLFgp5xvHT1r4mmkd5BKeKgL8jZUsAQ mHn6mKwLU59uBCrr+SB0Ve5uDHBZdCGIwUVyK7RhZqeHDiw3MOpN+IgxPl2xJR8SiozgHR Pxerui4pZTD467tzwiDpwElSNas1aHHvOFbdBm1hPAyEeKYaFNbMtcZ6rExmR5fNyhwgf+ 2wutiG7MOBJfqAI+3G+zCSaPrDL2EMJ6quCHq7eiu2P1A5+rnCdvbjBluoysWQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XbY0q1ZjMzR11 for ; Sat, 26 Oct 2024 21:38:03 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49QLc3Z0012536 for ; Sat, 26 Oct 2024 21:38:03 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49QLc3FZ012535 for net@FreeBSD.org; Sat, 26 Oct 2024 21:38:03 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 268092] ixgbe: if_ixv driver have mismatched Rx buffer size and rx_mbuf_sz Date: Sat, 26 Oct 2024 21:38:02 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: commit-hook@FreeBSD.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268092 --- Comment #1 from commit-hook@FreeBSD.org --- A commit in branch main references this bug: URL: https://cgit.FreeBSD.org/src/commit/?id=3Dcdbe3de5383706da0f6d3c29f1ec2dcfe= d366bf1 commit cdbe3de5383706da0f6d3c29f1ec2dcfed366bf1 Author: Kevin Bowling AuthorDate: 2024-10-26 21:34:30 +0000 Commit: Kevin Bowling CommitDate: 2024-10-26 21:36:48 +0000 ixv: Dynamically size the receive packet size If MTU of the if_ixv VF driver is configured between 1501 and 2030, and if a peer box have bigger MTU and sends a packet bigger than MTU into this guest, kernel could crash. Dynamically calculate the receive packet size on rx_mbuf_sz as ix(4) does. PR: 268092 Reported by: Kumara Babu MFC after: 3 days Sponsored by: BBOX.io sys/dev/ixgbe/if_ixv.c | 8 +++----- 1 file changed, 3 insertions(+), 5 deletions(-) --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sat Oct 26 21:38:21 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XbY195S9Nz5bCFS for ; Sat, 26 Oct 2024 21:38:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XbY194Lvxz4Jy4 for ; Sat, 26 Oct 2024 21:38:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1729978701; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=LUfXabQE29QqSdhSQrtb0E3J9j6KhAP1TsQLf9rfLZk=; b=S1wslImBjO8CRdXcfMSBUAmTzSkHmGRUqp/Sul0mNKJcoQf+/qv4W7wajWt5rWTCbU1kGB 1G7YWcibUzRkI7rjAhn1bbBmcLya+xFV6mEBRRJ/2QoNVsLMNeEk2ZodMb9ViS5pvqrgw8 9ArZVIOAsaALsI9LG8e7BwcJLrnbRdkSkutkup72QI78Lh+vJ8ZtkN0FDloKxYH1RqmY8i YBnAPbTlB3tbcSSuezOwZb/mTdEbnvPTiJQvbhPgRW0vKDmDDGcqS6SY5vJNnDK8vto5OI N/XEs/pD60sIHJccbFXoBPMvSDrXYp+8ae+YXboKzHPYR+U03dbju2v+0SCE+Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1729978701; a=rsa-sha256; cv=none; b=UBlXVoYog1Kiv+2EsdAvbYTJ6JMgqe7FUoKvkvjgLj2nDAvZIjYWZeFyYpyFbDCNRxI1Ao gPgMs3HlReyjzR0RhSDGO9k8Ubabhzl6Gr7fhw83R9YDlm8r/FIfn9Ps0vISgqtVuO+sfj bVL5bkG6lnPe/k1Lsdda6mwNdvKvJTPFm1A3Vsx3qva7u1yh3qfgGb8xfYsdF63sPJdirg KtAoj7rbgsaplee6xrHsj8dQp9c7gbSIA0HTV9aulTta+RQV5zyQ8u0gjCOo8aDBipeo+T 7FdRbUtbgGLgPzlYzTyYTtYXm+h7Y8OxH+tp6+CqQep7lmKmntMhmDI8K8CvMg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XbY193m0QzRLL for ; Sat, 26 Oct 2024 21:38:21 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49QLcLcd012772 for ; Sat, 26 Oct 2024 21:38:21 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49QLcLkZ012771 for net@FreeBSD.org; Sat, 26 Oct 2024 21:38:21 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 268092] ixgbe: if_ixv driver have mismatched Rx buffer size and rx_mbuf_sz Date: Sat, 26 Oct 2024 21:38:21 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.2-STABLE X-Bugzilla-Keywords: IntelNetworking X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: kbowling@freebsd.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D268092 Kevin Bowling changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress CC| |kbowling@freebsd.org Assignee|net@FreeBSD.org |kbowling@freebsd.org --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 27 05:29:57 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XblTL1rdLz5bcTC for ; Sun, 27 Oct 2024 05:29:58 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XblTK6zs0z4J5Z for ; Sun, 27 Oct 2024 05:29:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730006998; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=iSpYl52iM80E6NBPPuR/edgaaENEWC3azkNp3W/liXg=; b=Zt2iSx2T6zXQrrSxdXdfW+U7MSaIq4r+FeSXlUQb90nJqhbaWAsea0L02Zv7rd4EuRgLkC 2Pi6nL9rUrqsdXaHtVgwPmCG6PnKeDNagZPhn2BMGmRa+f0oBgwByzFdbij90ozqUq2ChG tC5BNqUYjovKRIa8sBsJUUFuFKjKN7ftjPkuAqkflvjEDQKj0Jk3f85vUroxTvQ5vO/t9o 6kuz0amt8rxMdXz/vtgIAOkDAy2JraU3XIDsz10eGOf0gHgjTnEvgtp3Uoh3wvj/AGhwFB sJpMsSTNgmlmjbNl9MVdYL8byGqaYFWeKfGmAEjIb2UBXdzHE+Z60jJx1Cyy3g== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730006998; a=rsa-sha256; cv=none; b=EKAxtLyDIyLy7+3hqLdu9Rd55ZpLmHRnFiq0TPclsDipksFAu6UazRLPRXjo/Cey1RNV4S o2MP6X1unV+6MWLMyACq7Hq6v9ynLfxEwnldV8/hZMEG971JEuoEd0VJhJkoCGT6DSy5AC mjcaFNOVPZ1xbObLAiWkOcn1GsdaAiGTYpLE3gJfULdcebMpNb+sNK8t8pSkyi5ZpkK2Ur x2gruDdwLXJCJPxaOOJBsEwQRkjN89w1S9X8rbrv3txp7Xl+uHrjTDepLtMx9WBCguKe+b z/2MyUuemMneIAippkDMy7K2zYRrKSKzju8LBf0dikKcar+TR3vbqygYEO2gEQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4XblTK6SbMzhMh for ; Sun, 27 Oct 2024 05:29:57 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49R5Tv37081402 for ; Sun, 27 Oct 2024 05:29:57 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49R5TvMU081400 for net@FreeBSD.org; Sun, 27 Oct 2024 05:29:57 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 271205] [ix] [carp]: Continuous input errors on Intel X553 Date: Sun, 27 Oct 2024 05:29:57 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 12.4-RELEASE X-Bugzilla-Keywords: IntelNetworking, regression X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D271205 Kevin Bowling changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |Open CC| |kbowling@freebsd.org --- Comment #1 from Kevin Bowling --- These are MAC (hardware) error counters so I am less inclined to look toward the OS without seeing the issue clear by revert or bisect first. Do you st= ill see the issue? --=20 You are receiving this mail because: You are the assignee for the bug.= From nobody Sun Oct 27 05:36:17 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xblcd6Rhlz5bcTh for ; Sun, 27 Oct 2024 05:36:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xblcd4Bhsz4JtS for ; Sun, 27 Oct 2024 05:36:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730007377; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=39kUb0SosgTpRW1Yj22ndNYsDKljw+HQervs5jVRbhc=; b=HppDMMop0adCFKYjwO/pj2jOUF5Fuu1grYgdvXuqRhoGMp7S/F7kjOv2VDRzMjlmsPyAoB xhjufFp6W03i+Dd01W7AvEITEbsXDPHAnpptEpmIoMKrMJnevMTGZVjIl4ghjsIO6bAJFl kXTggoLYmMGybbspwcKsMsP7Yjn0LYGnPH7KtSvMU52REU3rFfvoyvVygFbgM3Zk8nXegT xPlsbW+pSQgGsGMOfdmTDezSB+NGt2wY7Zqhdg0dECKbfxsdPjV4AJM38GmSzv+N/w/goW mu1YHhLvwCrTFd1mqQnAPT7DcVjSFKQ+YJkN/lmWfhE4ae+orwFnkgaGpfChAg== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730007377; a=rsa-sha256; cv=none; b=dw+NKsihAAnAcjNtJbaTE12K1Pi4clc0sR+wNO/CSkxrfXTPZStsyQterDTwL0TIoraPC5 53+8uHxWbqwVmUKQsEX70JUPS5Bly4AA3tWWCaCtKpHL35/TnQCjpbqxhC/wfTA6n/yqbb L587se1AOgAcsw2sbk5OnSSNwYpM35Ue7/exVCiOzwFQ8CV4aWZJu/OQNk41LbvlExzhh4 NexyPFgqgFRNIUMOA+DdX81N6AXEjoWl2ibRxs5eDL4e1ULGd/4zyyDyIEwnG/3JU1o7fM 3h776DkOkXjwEo7KX0hwobEZ6QJRejUJagcxS3oVxPJMT64G7dNY+fgD5a/xKQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xblcd3hKmzhxx for ; Sun, 27 Oct 2024 05:36:17 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49R5aH5e095882 for ; Sun, 27 Oct 2024 05:36:17 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49R5aHWb095881 for net@FreeBSD.org; Sun, 27 Oct 2024 05:36:17 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 261129] IPv6 default route vanishes with rtadvd/rtsold Date: Sun, 27 Oct 2024 05:36:17 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: tatsuki_makino@hotmail.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: melifaro@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261129 --- Comment #19 from Tatsuki Makino --- If something like the one shown below was about to be built, /etc/rc.conf needed to define a value like: ipv6_cpe_wanif=3D"em0" Also, it is mandatory to send RA from the bridge interface. If it is sent by a member of the bridge, it does not work for some reason. For the time being, my progress is on my way :) Below is the figure :) (WAN) | | RA v +-----+-----+ | em0 | | | | FreeBSD |=20=20 | | | em1 | +-----+-----+ | | RA by rtadvd v (LAN) --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Oct 27 05:55:15 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xbm2X14Cvz5bct9 for ; Sun, 27 Oct 2024 05:55:16 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xbm2W65sBz4L4S for ; Sun, 27 Oct 2024 05:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730008515; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=nGNUroHPEwGmbq3uzcBLxhPgh1Vtx/DV4Wr6DbnRryA=; b=Vwpszt9EAykBPTAK/i5yyjE72U6H2ZbhXlMe08mB/C18QMpIoBEAFHuORZb1l1kt0zEUoA ij+n5wUKCYQSqllYigKivSRNnODckfZeVDgKrvlIADw9RBemHxUhwn2Lxwt8vuiH9vidAy QFfIHOXwehmn8v4KdozWDysYASgzm0HikKkGRdG5SEq99bHmLud6MRZqaRKFfFNgMmaMZH 9s6e4qegevZ9sJtsTrYQDFF6ifQmaFOFTCqUetUTS00IT5B4Yz7P8spMoIKN1BD6YQokV9 XcvEaPGzucj38RmaMLTk76on6q9bhyJ1WuvoaIqGcfl4Ye784mjjT2jitUE8tw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730008515; a=rsa-sha256; cv=none; b=q1+e4aganAlQQjLEfJryDQnz+EJ9zKKxkpl0egogAjnOuFR1wT+cQAEPhfKtt2fM14JN7v Z+I1QS/Nsa+Yk+fzyCBjjqnD8Xz+sFc41LjjqlH2SwTUteo+Xyv44ZLSePaAqK5iGou97G w8uNCG/qvuaw6q5RkA9w++yBE+LIZWGUxauVJ2ey/oixo5PCldPpbJg1UpC7/q2QClLn1G 9/Rj5ZqoEjzTqgK1whHJ98waKfLknH3bjSyiIglM0xq2POiu4wcIJoVuCS3soyAGi4kzEC 34Jq9t1Z1VwKJcQkHOPOLEB5lxbk1wJ7C5iwbfsTy+J5dreTpC+z2tJgAnJecA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xbm2W5hv8zjgq for ; Sun, 27 Oct 2024 05:55:15 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49R5tFbS028113 for ; Sun, 27 Oct 2024 05:55:15 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49R5tFsv028112 for net@FreeBSD.org; Sun, 27 Oct 2024 05:55:15 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 262024] em(4): iflib handles bad packets incorrectly Date: Sun, 27 Oct 2024 05:55:15 +0000 X-Bugzilla-Reason: AssignedTo CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: IntelNetworking, needs-patch, needs-qa X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: kbowling@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: maintainer-feedback? maintainer-feedback? X-Bugzilla-Changed-Fields: bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D262024 Kevin Bowling changed: What |Removed |Added ---------------------------------------------------------------------------- Status|Open |In Progress --- Comment #6 from Kevin Bowling --- https://reviews.freebsd.org/D47296 --=20 You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug.= From nobody Sun Oct 27 14:54:22 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xc0144m7Tz5b6hf for ; Sun, 27 Oct 2024 14:54:48 +0000 (UTC) (envelope-from void@f-m.fm) Received: from fout-b2-smtp.messagingengine.com (fout-b2-smtp.messagingengine.com [202.12.124.145]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xc0135wXNz4Fwc for ; Sun, 27 Oct 2024 14:54:47 +0000 (UTC) (envelope-from void@f-m.fm) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=f-m.fm header.s=fm3 header.b=ezBIC5r7; dkim=pass header.d=messagingengine.com header.s=fm3 header.b="E z4RAyX"; spf=pass (mx1.freebsd.org: domain of void@f-m.fm designates 202.12.124.145 as permitted sender) smtp.mailfrom=void@f-m.fm; dmarc=pass (policy=none) header.from=f-m.fm Received: from phl-compute-05.internal (phl-compute-05.phl.internal [10.202.2.45]) by mailfout.stl.internal (Postfix) with ESMTP id 3BE02114007D for ; Sun, 27 Oct 2024 10:54:46 -0400 (EDT) Received: from phl-imap-04 ([10.202.2.82]) by phl-compute-05.internal (MEProxy); Sun, 27 Oct 2024 10:54:46 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=f-m.fm; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:in-reply-to:message-id:mime-version :references:reply-to:subject:subject:to:to; s=fm3; t=1730040886; x=1730127286; bh=woPhh4vV9MsImy0X8DPfmued/LaUsnW5kcWnI/+gelM=; b= ezBIC5r7elIWL8yD0o4wKj5jIvY69GBxjfE5OxEXWV4J3KmBWzbcaEAaoD5+oCI/ o11jom/yW+sB4jZR90o3cfHJNQ992igVpAedACV54GkyzPc6/qGUptYuf0Kcxgwx cFC+bMFPN6fe7vG0IFZwqEGIfDBdTH+nEdxfinx67pEhnqMVbwJ6a6ddLdIvlkMb fEeqJ/pM2kgXg3eyC9ZOzT3/Ije8kAxFS4LT8fPAUK37mmO7aMM4dxF6N6jd86ab iiuBqHs188epxBLhSHO/v6pNft4LOeNpSdDWhgQ0DgdVuNJI1LQS1k3BdigeGsvR gYQlHx6d0QLp+HVbwMUlVg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=1730040886; x= 1730127286; bh=woPhh4vV9MsImy0X8DPfmued/LaUsnW5kcWnI/+gelM=; b=E z4RAyXjNiXPEFlpuUgOK3xuoP1HeW8MLxnNSL8fcBwPtJ1RekYbdjA66hHETvvwW kyrXiV65+Oh+g1WkMlG5yrGdz2p8u0LXmtV2M1rmuvTcShQlvwyVOdxsQHuqGg8l CE3FUPfTkrUaGgESc4OMeDEvzZR6cGDLUABohGWbxKKMPxETv0oFNpLUNAEAF9B5 nwOoJ+oK+1kh8IuCMSePvJIfMzohl01cvjIdAe67kXwL6GnCMz0L/Tt0Y61ndQkU io8AAYTt2twGtBTmwjwS/1Ot3erJZHsDn823pio2nwc4h8taLRBDbDTUdlvEPFGz x6L5pLAHScUIw47R/8Cuw== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeeftddrvdejiedgjedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggvpdfu rfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefoggffhf fvkfgjfhfutgfgsehtjeertdertddtnecuhfhrohhmpehvohhiugcuoehvohhiugesfhdq mhdrfhhmqeenucggtffrrghtthgvrhhnpedvkefhgeekudfhlefhkeegvdfgieekledvve ethfelvedvfeffkeeftdeukeetvdenucffohhmrghinhepfhhrvggvsghsugdrohhrghen ucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehvohhiug esfhdqmhdrfhhmpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgt phhtthhopehfrhgvvggsshguqdhnvghtsehfrhgvvggsshgurdhorhhg X-ME-Proxy: Feedback-ID: i2541463c:Fastmail Received: by mailuser.phl.internal (Postfix, from userid 501) id CDCB32E60084; Sun, 27 Oct 2024 10:54:45 -0400 (EDT) X-Mailer: MessagingEngine.com Webmail Interface List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Date: Sun, 27 Oct 2024 14:54:22 +0000 From: void To: freebsd-net@freebsd.org Message-Id: <4a5dd205-6c8f-4964-b254-7092aa590602@app.fastmail.com> In-Reply-To: References: Subject: Re: Performance test for CUBIC in stable/14 Content-Type: text/plain Content-Transfer-Encoding: 7bit X-Spamd-Result: default: False [-4.06 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.97)[-0.966]; DMARC_POLICY_ALLOW(-0.50)[f-m.fm,none]; R_DKIM_ALLOW(-0.20)[f-m.fm:s=fm3,messagingengine.com:s=fm3]; R_SPF_ALLOW(-0.20)[+ip4:202.12.124.128/27]; MIME_GOOD(-0.10)[text/plain]; RCVD_IN_DNSWL_LOW(-0.10)[202.12.124.145:from]; XM_UA_NO_VERSION(0.01)[]; ARC_NA(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_NONE(0.00)[messagingengine.com:dkim]; FREEMAIL_ENVFROM(0.00)[f-m.fm]; MIME_TRACE(0.00)[0:+]; FREEMAIL_FROM(0.00)[f-m.fm]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_COUNT_THREE(0.00)[3]; FROM_EQ_ENVFROM(0.00)[]; FROM_HAS_DN(0.00)[]; RCVD_TLS_LAST(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[f-m.fm:+,messagingengine.com:+] X-Rspamd-Queue-Id: 4Xc0135wXNz4Fwc X-Spamd-Bar: ---- On Fri, 25 Oct 2024, at 13:13, Cheng Cui wrote: > Here is my example. I am using two 6-core/12-threads desktops for my > bhyve servers. > CPU: AMD Ryzen 5 5560U with Radeon Graphics (2295.75-MHz > K8-class CPU) > > You can find test results on VMs from my wiki: > https://wiki.freebsd.org/chengcui/testD46046 > > All the CPU utilization results are low, especially for these > throughput over 900 Mb/s. > > cc I have to tabulate my results better :D Those are some p impressive performance gains for your modified cc_cubic against % packet loss. This is a freebsd14-stable vm with your patches applied. iperf3 -B 192.168.1.13 -c 192.168.1.232 -l 1M -t 60 -i 1 -VC cubic Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-60.07 sec 5.92 GBytes 847 Mbits/sec 1 sender [ 5] 0.00-60.09 sec 5.92 GBytes 846 Mbits/sec receiver CPU Utilization: local/sender 90.6% (0.0%u/90.6%s), remote/receiver 23.8% (2.0%u/21.8%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic here's the Alpine linux vm: vm7-alpine:~$ iperf3 -B 192.168.1.65 -c 192.168.1.232 -l 1M -t 60 -i 1 -VC cubic Test Complete. Summary Results: [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-60.02 sec 6.58 GBytes 941 Mbits/sec 24 sender [ 5] 0.00-60.03 sec 6.58 GBytes 941 Mbits/sec receiver CPU Utilization: local/sender 8.2% (0.1%u/8.2%s), remote/receiver 26.7% (2.1%u/24.5%s) snd_tcp_congestion cubic rcv_tcp_congestion cubic Load on the bhyve host was between 3.00 & 4.00 during the tests. It was running a poudriere build (PARALLEL_JOBS=1) Why the massive difference in load on the vms? I'm trying to look at something that's maybe related, but not in a congested environment context. I think it's deeper than that. I need to try 'options RSS' in the freebsd guests as well, (see https://lists.freebsd.org/archives/freebsd-net/2024-September/005531.html ) -- From nobody Sun Oct 27 16:48:20 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xc2X76K93z5bD7m for ; Sun, 27 Oct 2024 16:48:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xc2X75FBGz4Ty5 for ; Sun, 27 Oct 2024 16:48:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730047703; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=FEQC5YaTFmsGW0OehVWiZPD1V10UhnTj2xqSVHS/LF8=; b=JnUiD92bpw5ORjrmDyJJtY/wjiSffjD6Y8tSVkV0ge/NOv+fI7dIWgX28IHkD3v07fgqwg lwUYVIpENmcVrIibTtRB6T1cish2vWWe5Pzxyf2WlkQjccfmPwkBlOZUo3p1JMG2+XHEaN ZIjA9hdkyg2QK9rjS1dTRrJzo8p/rrT1Cb7rgRXD2Dj3UMFtM6O94DjK0JOB+kZ6Z+rcHv xlUE45s9JWlVvXmHmsq04QLnUKTNYHu0ilU/CbvKXv5ow7yGJHaYXNO5toIEKL3PCrMHz2 4/1mnanphQw2jGQx2xKFPdRjPd9enzCXHeY93U9eCu695ellzXiFw8y2Q9BRjQ== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730047703; a=rsa-sha256; cv=none; b=eIid7ERCj2emW0O7jr59lk1CdOIv/L1YUsgqAunqov7lZmwXdr9+WW1PTG8tfnCINXHeMm ddRNjJlkL4RzpSt/SyrtmhzaZpMgoMgIAHyaLvhleElufkyR0juLhRlUzn6n6vEJhC09eI dPfxlGiVU+x6LEAgdFgiqPccjbx5bseoWDXExBUtsJUaq1Uuk0olqXxfSQ5sN5MnhEhzAn A1UOJyE1kQFCufVdzgHO/4Xym0iwnizHtDvYSgBlAoXeR/PRX7atS9S4WY+vgfim8dsdbc s+/Q7OZTT/m3pesagEctXamoikx7OtDTu6Mb+n4TH0tWvwkdExDtNnabIxcDGQ== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xc2X74s7Jz131v for ; Sun, 27 Oct 2024 16:48:23 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49RGmNVj059266 for ; Sun, 27 Oct 2024 16:48:23 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49RGmNb3059264 for net@FreeBSD.org; Sun, 27 Oct 2024 16:48:23 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 261129] IPv6 default route vanishes with rtadvd/rtsold Date: Sun, 27 Oct 2024 16:48:20 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 13.0-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: pmh@hausen.com X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: melifaro@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D261129 Patrick M. Hausen changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |pmh@hausen.com --- Comment #20 from Patrick M. Hausen --- > Also, it is mandatory to send RA from the bridge interface. It is mandatory to have all layer 3 configuration, specifically all address= es on the bridge interface. This is documented in the bridge section in the Handbook. A bridge member interface must not have any IP address. It becomes a layer 2 port like in a switch. --=20 You are receiving this mail because: You are on the CC list for the bug.= From nobody Sun Oct 27 21:00:53 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xc87V0BLFz5bRjH for ; Sun, 27 Oct 2024 21:00:54 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xc87T4D8sz4t50 for ; Sun, 27 Oct 2024 21:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730062853; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding; bh=4tPsi29cfjYE0IpPZ4VBnXUG2xW9LNs1LLFTepHTHBg=; b=GY/TMCiw+oA5T8naSg1KCZHidypVnayllJXMZXLlCLgX4//rGzhxpR2dL34U0qyDIRmwVe qexaPufh22KTKAiqs0kPVXAU2VfnGG0pzL3vlNcnRGgjuSVDiTUSrDcYvBpZm1nsZZGYfZ DssAItdpSu1YKHloyZcElrt0VkHnnv8EiJ7dRNgta2mnTmM3blQ6hN8QICyUv/Y0z5kKfO 27tQiOlrtrCqtn+BBTB0+unYuGCPyxnuNe07kVLldYAJbVKYCG0nJSdhvvZLp6ePStw32l aK27cnS0BwPTSLEEZr4mhXwMbEvihrT86hsUL0orSoQZEiswDtgqVY7GnzX28A== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730062853; a=rsa-sha256; cv=none; b=stdgklpaGmaHNzgZk3IRq9ROq09IXdxp/HRz/72m51D9hfodmchzlntkT/wqPV9A2rJjPu uPOQRpgEJxj9CGoeIzvImbQL8RFy+o7Ntd2Dl0CJ2wiCwrWxqEQcdFkMwQ6BqpeJ7iOb6y p62e3CyjaNL04b371HNZyLbhHmg/Tu7EB2g+xW+K6vFMgnxpndJKgr4I9jwUTiCDRFjFsH AtY8Wil5c01hhakrBxBx3LWB5wywyexVb4WDnVDZ7g5a7aDJfoeNo5TojZkH3/b72zv1Ia 0Bt6vP3ZJqLON+a3xWXjtdty+fyI2EaK8d+cbGCWTQ5SMib6TvsYREQpNosQVg== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xc87T3XHsz19Kp for ; Sun, 27 Oct 2024 21:00:53 +0000 (UTC) (envelope-from bugzilla-noreply@FreeBSD.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49RL0rEP017911 for ; Sun, 27 Oct 2024 21:00:53 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Received: (from bugzilla@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49RL0rAk017910 for net@FreeBSD.org; Sun, 27 Oct 2024 21:00:53 GMT (envelope-from bugzilla-noreply@FreeBSD.org) Message-Id: <202410272100.49RL0rAk017910@kenobi.freebsd.org> X-Authentication-Warning: kenobi.freebsd.org: bugzilla set sender to bugzilla-noreply@FreeBSD.org using -f From: bugzilla-noreply@FreeBSD.org To: net@FreeBSD.org Subject: Problem reports for net@FreeBSD.org that need special attention Date: Sun, 27 Oct 2024 21:00:53 +0000 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 Content-Type: multipart/alternative; boundary="17300628534.6d900BC7.13378" Content-Transfer-Encoding: 7bit --17300628534.6d900BC7.13378 Date: Sun, 27 Oct 2024 21:00:53 +0000 MIME-Version: 1.0 Content-Type: text/plain; charset="UTF-8" To view an individual PR, use: https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=(Bug Id). The following is a listing of current problems submitted by FreeBSD users, which need special attention. These represent problem reports covering all versions including experimental development code and obsolete releases. Status | Bug Id | Description ------------+-----------+--------------------------------------------------- New | 254445 | cloned_interfaces="bridge0" does not respect net. In Progress | 118111 | rc: network.subr Add MAC address based interface 2 problems total for which you should take action. --17300628534.6d900BC7.13378 Date: Sun, 27 Oct 2024 21:00:53 +0000 MIME-Version: 1.0 Content-Type: text/html; charset="UTF-8" 
The following is a listing of current problems submitted by FreeBSD users,
which need special attention. These represent problem reports covering
all versions including experimental development code and obsolete releases.

Status      |    Bug Id | Description
------------+-----------+---------------------------------------------------
New         |    254445 | cloned_interfaces="bridge0" does not respect net.
In Progress |    118111 | rc: network.subr Add MAC address based interface 

2 problems total for which you should take action.
--17300628534.6d900BC7.13378-- From nobody Sun Oct 27 22:05:01 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Xc9Yf3zHTz5bV8l for ; Sun, 27 Oct 2024 22:05:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from mxrelay.nyi.freebsd.org (mxrelay.nyi.freebsd.org [IPv6:2610:1c1:1:606c::19:3]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "mxrelay.nyi.freebsd.org", Issuer "R10" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Xc9Yf2x9rz50wL for ; Sun, 27 Oct 2024 22:05:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1730066710; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=L/MDiuOafroIjyasUCOFq4kLVuDuioXRgoOAZ1TQpgU=; b=kCxzYs2WHC6nSwisHd38dTx2fcoJq5U4vQiqoU/XxaNQ/Iajd9z810e8MOxtF55fyQCssZ BeLrNR1DUnVzC+BL+m6AeIxfKc0HFJ0o53SlGXci+zLkWyvs64WkmBCrgCFGSSxFw+g913 dIQgAky4ipLHERHhMYf7kE51Nl2eYz7KPnEkPpBwx3FmhheRfxfc61YFSmgOspv7c4HoED ZnXpdklZodcLYvasFVy9e1d2F+ZJUcD4WxQoafBhcdq9XjjJ4aDMhxjB6Wy6BQl6PMn1VZ IsA5CCB1P6hKeaiaOzAj/ZNmCtvlvTt/6LxSYRWtSFNUpaOyoK4BbIP/Ti6wuw== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1730066710; a=rsa-sha256; cv=none; b=NLCQ1tk7vF0Ex7DVtWWUE6773VEhf6m5OgwDyODdoAVd9lWFd77Lmt8KDVoOmX94OljqNe 7FbE/pdGK/PF4bJwpFSpI8gOYcPrjNljq/Y7CPHDhqw/7L/tbNE8yI7lC9lWqYlSaDg2la TrdMynaCQuaGm6J7lVgsO7Zr1NXsHQDENH2VuGOSoeN3Fs8oUfOczusqQ1JFyutagScZQU A8nodkXNrCspopcQ5aoA/vv+c3V3apkiMU4cBsTfodsItnPGQbEIdkJRIdaMbL/Rj5/J6n hTQNveyulU/VNu0wTLhrdcG35jCdVLSrQ5Hf4Kj3N90dYtblR+03hIC9+BvyDA== Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2610:1c1:1:606c::50:1d]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mxrelay.nyi.freebsd.org (Postfix) with ESMTPS id 4Xc9Yf2Y5Pz1C5f for ; Sun, 27 Oct 2024 22:05:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org ([127.0.1.5]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id 49RM5AYA034446 for ; Sun, 27 Oct 2024 22:05:10 GMT (envelope-from bugzilla-noreply@freebsd.org) Received: (from www@localhost) by kenobi.freebsd.org (8.15.2/8.15.2/Submit) id 49RM5AWU034445 for net@FreeBSD.org; Sun, 27 Oct 2024 22:05:10 GMT (envelope-from bugzilla-noreply@freebsd.org) X-Authentication-Warning: kenobi.freebsd.org: www set sender to bugzilla-noreply@freebsd.org using -f From: bugzilla-noreply@freebsd.org To: net@FreeBSD.org Subject: [Bug 166724] if_re(4): watchdog timeout Date: Sun, 27 Oct 2024 22:05:01 +0000 X-Bugzilla-Reason: CC AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: kern X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: needs-patch, needs-qa X-Bugzilla-Severity: Affects Many People X-Bugzilla-Who: jplx256@gmail.com X-Bugzilla-Status: Open X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: net@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D166724 --- Comment #122 from Jan Przybylak --- I was using the patched driver for a several of years without issue, but it stopped working earlier this year due to a different bug. I switched back to the regular driver and it was fine until a few weeks ago, now I'm back to watchdog timeouts every couple of days. I don't remember if I did anything that could have caused the issue to reappear. I'm using 14.1-RELEASE-p5 now. I had a look at /var/log/messages from July until now. There are a couple of isolated instances of two to three watchdog timeouts, but these weren't a problem. The first occurrence of the actual problem, where times out every couple of seconds until I reboot the machine, was on the 8th of September. I seem to have updated from 14.1-p3 to p4 the day before, but I don't know of that could have caused it. --=20 You are receiving this mail because: You are on the CC list for the bug. You are the assignee for the bug.=