From nobody Sat Mar 16 19:24:25 2024 X-Original-To: net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4Txrf74ZnCz5D8KF; Sat, 16 Mar 2024 19:24:31 +0000 (UTC) (envelope-from tuexen@freebsd.org) Received: from drew.franken.de (drew.ipv6.franken.de [IPv6:2001:638:a02:a001:20e:cff:fe4a:feaa]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "*.franken.de", Issuer "Sectigo RSA Domain Validation Secure Server CA" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4Txrf71Zk4z4hZt; Sat, 16 Mar 2024 19:24:31 +0000 (UTC) (envelope-from tuexen@freebsd.org) Authentication-Results: mx1.freebsd.org; none Received: from smtpclient.apple (ip4d15f54e.dynamic.kabel-deutschland.de [77.21.245.78]) (Authenticated sender: micmac) by mail-n.franken.de (Postfix) with ESMTPSA id E155B721E2806; Sat, 16 Mar 2024 20:24:25 +0100 (CET) Content-Type: text/plain; charset=us-ascii List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3774.500.171.1.1\)) Subject: Re: Request for Testing: TCP RACK From: tuexen@freebsd.org In-Reply-To: Date: Sat, 16 Mar 2024 20:24:25 +0100 Cc: garyj@gmx.de, current@freebsd.org, net@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <4FF534F6-B35D-4596-8D1E-226AD1347AC8@freebsd.org> References: <42C327BD-6CE4-43AA-A1AE-3BEC08D623DB@freebsd.org> <486915F0-456B-4B09-A8BC-93BBA79C4CA1@freebsd.org> <20240313080624.6c73908c@ernst.home> <508E3B47-8E1B-469F-97B1-2171A3098888@freebsd.org> <86a5n1i0xg.fsf@ltc.des.dev> <78D1FF09-71A3-4486-B934-D8332F54B237@freebsd.org> <20240316104053.20bef8c2@ernst.home> <20240316115128.33d11f7b@ernst.home> <7367F29A-D52B-4828-B79A-AA2667E81E7D@freebsd.org> To: Nuno Teixeira X-Mailer: Apple Mail (2.3774.500.171.1.1) X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00, T_SCC_BODY_TEXT_LINE autolearn=disabled version=3.4.1 X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on mail-n.franken.de X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:680, ipnet:2001:638::/32, country:DE] X-Rspamd-Queue-Id: 4Txrf71Zk4z4hZt > On 16. Mar 2024, at 20:06, Nuno Teixeira wrote: >=20 >>> Will update amd64 laptop to main-n268827-75464941dc17 (Mar 16) and = test it. >> Please do so... >=20 > @main-n268827-75464941dc17 GENERIC-NODEBUG amd64 >=20 > Ok, I think I have here some numbers related to disk performance being > affected by tcp_rack that somehow is messing with something. >=20 > NOTES: > - test [1] was done after a boot without tcp_rack in loader.conf and > [2] tcp_rack was loaded manually with kldload (without rebooting) > - After unloading tcp_rack, same results as [2] > - Cannot unload tcptpts: device busy tcphpts does not support unloading. So that is fine. Just to double check: you only load the tcp_rack. You don't run sysctl net.inet.tcp.functions_default=3Drack This means you load RACK, but you don't use it. What does "poudriere testport net/gitup" do? Only build stuff or does is also download something? What does bonnie++ do? Could you reboot the system, run the test, do kldload tcphpts, run the test again, do kldload tcp_rack, and run it again. I'm wondering if tcphpts is affecting the measurements... Thanks for testing. Best regards Michael >=20 > [1] without tcp_rack loaded: >=20 > =3D=3D> poudriere testport net/gitup: > 11.16s real 5.35s user 6.35s sys >=20 > =3D=3D> bonnie++: > Version 1.98 ------Sequential Output------ --Sequential Input- = --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- = --Seeks-- > Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > leg.home 32G 25k 99 105m 99 88.7m 99 77k 99 198m 99 = 12716 1784 > Latency 351ms 1793us 2340us 241ms 638us = 2514us > Version 1.98 ------Sequential Create------ --------Random = Create-------- > leg.home -Create-- --Read--- -Delete-- -Create-- --Read--- = -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > 16 14908.273230 97 +++++ +++ 6878.516657 99 > 15194.808063 97 +++++ +++ 8019.731670 99 > Latency 1108us 182us 2228us 1013us 152us = 2424us >=20 > [2] kldload tcp_rack: >=20 > =3D=3D> poudriere testport net/gitup: > 1m0.54s real 4.98s user 1m31.38s sys >=20 > =3D=3D> bonnie++: > Version 1.98 ------Sequential Output------ --Sequential Input- = --Random- > -Per Chr- --Block-- -Rewrite- -Per Chr- --Block-- = --Seeks-- > Name:Size etc /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > leg.home 32G 14k 99 78.0m 99 46.6m 99 25k 99 120m 99 = 6688 2161 > Latency 676ms 18309us 76171us 385ms 924us = 2274us > Version 1.98 ------Sequential Create------ --------Random = Create-------- > leg.home -Create-- --Read--- -Delete-- -Create-- --Read--- = -Delete-- > files /sec %CP /sec %CP /sec %CP /sec %CP /sec %CP = /sec %CP > 16 8139.513260 96 19437.792294 99 5494.638508 99 > 8099.275425 96 19723.528878 99 6363.123671 99 > Latency 2982us 338us 3072us 1135us 591us = 3236us >=20 > Cheers, >=20 >=20 >=20 >=20 >=20 >=20 >=20 > -- > Nuno Teixeira > FreeBSD Committer (ports)