From nobody Sat Nov 18 19:11:57 2023 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4SXk0h6fqwz51V5B; Sat, 18 Nov 2023 19:12:04 +0000 (UTC) (envelope-from zlei@FreeBSD.org) Received: from smtp.freebsd.org (smtp.freebsd.org [96.47.72.83]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (4096 bits) client-digest SHA256) (Client CN "smtp.freebsd.org", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4SXk0h6Qs4z4KG4; Sat, 18 Nov 2023 19:12:04 +0000 (UTC) (envelope-from zlei@FreeBSD.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1700334724; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=R/ioEw3Sxqkpn+Ru5uizaBz//B8St8P2BbwF/hiv4eE=; b=LvKl7VREC10oz23HMemjjiCXp/da73p5c3va/zEIvKuw71enUy2OdMRDRkWj8iHsip641m obYXjmSsZyLJGPpEER9bp6Y1UCQE4YQAMEttR7gdBA++4Qe1MONfXuxVrTJ7EwLxU1+2lN c2rPj5wYCoG9A+1F4rNN+GiAbnhuvelfMpdvLAlCqP8/v3vCDXSd8KeTsx4Wc8VVQle72V 1YUvBxk4y0Ooec/UslH47qiewgoULngAsMNzJyGS21evAzbmVQL6U1KXVDiaCnyII+39jr Ng7gFnMRQyvpx34aCTBc419D+QYoA1AClMU50kBh5d7TQy9m1IkcJtVzOmv03w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=freebsd.org; s=dkim; t=1700334724; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=R/ioEw3Sxqkpn+Ru5uizaBz//B8St8P2BbwF/hiv4eE=; b=J3lOISKkZIn4RY0amqRJKSDht3HKYS4vRezvAu8SrNo2woQyoNspJmUi+DW9OwO4CJv7m1 qcwmGBcXzApdLhu2liLx0h/kY4E6x/kNiemHkmrdDKe3UCOXF7avmTH+p7qoFRChTdxTdT nXXohqqJNjtZEFOdkcP58cI1XVvGce3Y4oEebhN00aRJSOr1k5+qu1/LUHWeBuxkEu/r1J SWYQeBzF+iomXLiOkYfgCWZ/mC1osyhOqOjA9/gyCuKDWmE46oTmYxv9iyx/GfAHDBvAjC SJooUUqnFmiihyOLpA3qRKwEUEhKF6tU83ZQ0m5ayTpDE3E84sxsF7UZW/aa7Q== ARC-Authentication-Results: i=1; mx1.freebsd.org; none ARC-Seal: i=1; s=dkim; d=freebsd.org; t=1700334724; a=rsa-sha256; cv=none; b=gP/BCroEqq5Z6RUatqTGeZvrXWsGUHnbgyCHBbzXIgVZuL2UVb6+fs3fRFQN82NG7fSNZF l2Ql74sNUw+cm4p/VDe+mNvMKx1Rir3wGg4R91VkKevVVJDr7GUxPyRT1/ok9FfXrEK5Lh y8Y8zmLZHf1WpADFKph7R4G6J0hF6IHpj55/56hWdtOXyU/zAb+4p5r9dD4Q5QqMKjCKAF jDDNkQ1IFavzA282liZrArT6cwcQtDx2Woi47uQSnL+TTpXXRnLnTBo7/9DjIWH+OolbI5 fjz12hi8lokzSK9Vo5aNpcJ5TYeB/C2/rnuRNpXyyPaQv1H/5XyJhE0ljKZpbg== Received: from smtpclient.apple (ns1.oxydns.net [45.32.91.63]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) (Authenticated sender: zlei/mail) by smtp.freebsd.org (Postfix) with ESMTPSA id 4SXk0g2g4Qz106M; Sat, 18 Nov 2023 19:12:03 +0000 (UTC) (envelope-from zlei@FreeBSD.org) From: Zhenlei Huang Message-Id: <64F46D36-7327-44E9-A0AD-59669452217B@FreeBSD.org> Content-Type: multipart/alternative; boundary="Apple-Mail=_0CD24F9E-1A69-4822-9C27-CFB1FF17C237" List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3696.120.41.1.4\)) Subject: Re: Request for Testing: TCP RACK Date: Sun, 19 Nov 2023 03:11:57 +0800 In-Reply-To: <941203D6-3A72-48A4-8C2C-F59C964199A9@FreeBSD.org> Cc: FreeBSD Current , net@freebsd.org To: tuexen@freebsd.org References: <42C327BD-6CE4-43AA-A1AE-3BEC08D623DB@freebsd.org> <941203D6-3A72-48A4-8C2C-F59C964199A9@FreeBSD.org> X-Mailer: Apple Mail (2.3696.120.41.1.4) --Apple-Mail=_0CD24F9E-1A69-4822-9C27-CFB1FF17C237 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii > On Nov 19, 2023, at 2:35 AM, Zhenlei Huang wrote: >=20 >=20 >=20 >> On Nov 16, 2023, at 5:13 PM, tuexen@freebsd.org wrote: >>=20 >> Dear all, >>=20 >> recently the main branch was changed to build the TCP RACK stack >> which is a loadable kernel module, by default: >> = https://cgit.FreeBSD.org/src/commit/?id=3D3a338c534154164504005beb00a3c6fe= b03756cc >>=20 >> As discussed on the bi-weekly transport call, it would be great if = people >> could test the RACK stack for their workload. Please report any = problems to the >> net@ mailing list or open an issue in the bug tracker and drop me a = note via email. >> This includes regressions in CPU usage, regressions in performance or = any other >> unexpected change you observe. >=20 > I see some performance regression with the rack stack. >=20 > This is iperf3 test on local host (bare metal, an old i5 2 cores 4 = threads MBP). >=20 > freebsd: 16.1 Gbits/sec > rack: 12.3 Gbits/sec >=20 > The congestion control algorithm is cubic. >=20 > Note this is a quick test with DEBUG options enabled. >=20 > I'll try with no debug options and report later. ** UPDATE ** With no debug options: freebsd: 37.2 Gbits/sec rack: 27.9 Gbits/sec >=20 >>=20 >> You can load the kernel module using >> kldload tcp_rack >>=20 >> You can make the RACK stack the default stack using >> sysctl net.inet.tcp.functions_default=3Drack >>=20 >> Based on the feedback we get, the default stack might be switched to = the >> RACK stack. >>=20 >> Please let me know if you have any questions. >>=20 >> Best regards >> Michael >>=20 >>=20 >>=20 >=20 > Best regards, > Zhenlei --Apple-Mail=_0CD24F9E-1A69-4822-9C27-CFB1FF17C237 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii

On Nov 19, 2023, at 2:35 AM, Zhenlei Huang <zlei@FreeBSD.org> = wrote:



On = Nov 16, 2023, at 5:13 PM, tuexen@freebsd.org wrote:

Dear= all,

recently the main branch was changed = to build the TCP RACK stack
which is a loadable kernel = module, by default:
https://cgit.FreeBSD.org/src/commit/?id=3D3a338c534154164504005= beb00a3c6feb03756cc

As discussed on the = bi-weekly transport call, it would be great if people
could = test the RACK stack for their workload. Please report any problems to = the
net@ mailing list or open an issue in the bug tracker = and drop me a note via email.
This includes regressions in = CPU usage, regressions in performance or any other
unexpected change you observe.

I see some = performance regression with the rack stack.

This is = iperf3 test on local host (bare metal, an old i5 2 cores 4 threads = MBP).

freebsd: = 16.1 = Gbits/sec
rack: = 12.3 = Gbits/sec

The = congestion control algorithm is cubic.

Note this is a quick test with DEBUG options = enabled.

I'll try with = no debug options and report later.

** UPDATE **

With no debug options:

freebsd: 37.2 = Gbits/sec
rack: 27.9 = Gbits/sec



You can load the = kernel module using
kldload tcp_rack

You can make the RACK stack the default stack using
sysctl net.inet.tcp.functions_default=3Drack

Based on the feedback we get, the default stack might be = switched to the
RACK stack.

Please let me know if you have any questions.
Best regards
Michael




Best = regards,
Zhenlei



= --Apple-Mail=_0CD24F9E-1A69-4822-9C27-CFB1FF17C237--