From nobody Tue Oct 15 13:48:58 2024 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4XSb7Q3kJYz5Yybw for ; Tue, 15 Oct 2024 13:49:38 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Received: from mail-lf1-f44.google.com (mail-lf1-f44.google.com [209.85.167.44]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "smtp.gmail.com", Issuer "WR4" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4XSb7Q1Bzvz4v57 for ; Tue, 15 Oct 2024 13:49:38 +0000 (UTC) (envelope-from ccfreebsd@gmail.com) Authentication-Results: mx1.freebsd.org; none Received: by mail-lf1-f44.google.com with SMTP id 2adb3069b0e04-539f1d96668so270135e87.3 for ; Tue, 15 Oct 2024 06:49:38 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1729000176; x=1729604976; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=CuBXQqOztKcjXXhVRtw7rmcRKhZ0dElRRDY6sd8xBOQ=; b=L0oI+Ze1+2GcvWzlUW1zISRyGhOgoJAV5yceHWGwxSgyz7nqG1xaTez4kkHJgpzZOB neDntS6rxs9UIEwncNPsliIgtK3Jzzf2UlDb5M0WeW7seY08+y642+XmsKYw1V8mVQfq bMOrVH6DyTVlJHXAexo7p7ZjXt3j29bQDxvzDWtM1o7VHAJwRzWmsZHrMaeIf+w4LsIb A5YU2GkBKSH8aQaqAGfvjgbp1XUN+EI8IpC6FAwucU4vWjRpkgRiVoWUBGYtxFcWU2db CdUsmLe7II1t6lL5wjt0G19uyiXPNtK6hG0QOT4kQZc6+2pzhWt6pa+nbzIXQq3d4OhV ETjw== X-Gm-Message-State: AOJu0YxqzAieCYBScikLHPDk4SvcI++dHNLUjj6mHAu5FnBM/w3GbSkT VdUid5H3rsgxGvEgHdlY6ozzKVnZNgOqOF1DpIGKc6ovgj7xBrGubG3mKvp8 X-Google-Smtp-Source: AGHT+IGrQd3HB8dfRaSd9CEo7rJQLROi4kLJ6P+bIbAW+osOQv5if/FZqWMdeZXbf8KZT4KqKR5oyw== X-Received: by 2002:a05:6512:3090:b0:539:a353:2762 with SMTP id 2adb3069b0e04-539da22e80fmr2303673e87.0.1729000175558; Tue, 15 Oct 2024 06:49:35 -0700 (PDT) Received: from mail-lf1-f44.google.com (mail-lf1-f44.google.com. [209.85.167.44]) by smtp.gmail.com with ESMTPSA id 2adb3069b0e04-53a000134afsm174951e87.263.2024.10.15.06.49.35 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 15 Oct 2024 06:49:35 -0700 (PDT) Received: by mail-lf1-f44.google.com with SMTP id 2adb3069b0e04-539ea686fd7so380685e87.2 for ; Tue, 15 Oct 2024 06:49:35 -0700 (PDT) X-Received: by 2002:a2e:bd89:0:b0:2f7:5c24:979 with SMTP id 38308e7fff4ca-2fb329dedc1mr21560431fa.10.1729000175133; Tue, 15 Oct 2024 06:49:35 -0700 (PDT) List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 References: <20240912181618.7895d10ad5ff2ebae9883192@gmail.com> In-Reply-To: From: Cheng Cui Date: Tue, 15 Oct 2024 09:48:58 -0400 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: Performance issues with vnet jails + epair + bridge To: void Cc: freebsd-net@freebsd.org Content-Type: multipart/alternative; boundary="0000000000004179a106248439e2" X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:15169, ipnet:209.85.128.0/17, country:US] X-Rspamd-Queue-Id: 4XSb7Q1Bzvz4v57 X-Spamd-Bar: ---- --0000000000004179a106248439e2 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I am not sure if you are using FreeBSD15-CURRENT for testing in VMs. But given your iperf3 test result has retransmissions, if you can try, ther= e is a recent VM friendly improvement from TCP congestion control CUBIC. commit ee45061051715be4704ba22d2fcd1c373e29079d Author: Cheng Cui Date: Thu Sep 5 14:52:57 2024 -0400 cc_cubic: use newreno to emulate AIMD in TCP-friendly region Reviewed by: rscheff, tuexen Differential Revision: https://reviews.freebsd.org/D46546 cc On Mon, Oct 14, 2024 at 11:12=E2=80=AFPM void wrote: > On Tue, Oct 15, 2024 at 03:48:56AM +0100, void wrote: > > (snip) > > main-n272915-c87b3f0006be GENERIC-NODEBUG with > tcp_rack_load=3D"YES" in /boot/loader.conf and in /etc/sysctl.conf: > > # > # network > net.inet.tcp.functions_default=3Drack > net.pf.request_maxcount=3D400000 > net.local.stream.recvspace=3D65536 > net.local.stream.sendspace=3D65536 > kern.ipc.somaxconn=3D8192 > kern.ipc.maxsockbuf=3D4737024 > # > > gets > > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-60.08 sec 5.06 GBytes 724 Mbits/sec 428 > sender > [ 5] 0.00-60.08 sec 5.06 GBytes 724 Mbits/sec > receiver > > in iperf3 testing (iperf3 --time 60) which is nearly 77% of the > bitrate result on hardware. > -- > > --=20 Best Regards, Cheng Cui --0000000000004179a106248439e2 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I am not sure if you are using FreeBSD15-= CURRENT for testing in VMs.
But given your iperf3 test result has= retransmissions, if you can try, there
is a recent VM friendly i= mprovement from TCP congestion control CUBIC.

commit ee45061051715be4704ba22d2fcd1c373e29079d

Author: Cheng Cui <cc@FreeBSD.org= >

Date: =C2=A0 Thu S= ep 5 14:52:57 2024 -0400


=C2=A0 =C2=A0 cc_c= ubic: use newreno to emulate AIMD in TCP-friendly region

=C2=A0=C2= =A0 =C2=A0

=C2=A0 =C2=A0 Revi= ewed by: rscheff, tuexen

=C2=A0 =C2=A0 Diff= erential Revision: https://r= eviews.freebsd.org/D46546


cc

On Mon, Oct 1= 4, 2024 at 11:12=E2=80=AFPM void <void@f-= m.fm> wrote:
On Tue, Oct 15, 2024 at 03:48= :56AM +0100, void wrote:

(snip)

main-n272915-c87b3f0006be GENERIC-NODEBUG with
tcp_rack_load=3D"YES" in /boot/loader.conf and in /etc/sysctl.con= f:

#
# network
net.inet.tcp.functions_default=3Drack
net.pf.request_maxcount=3D400000
net.local.stream.recvspace=3D65536
net.local.stream.sendspace=3D65536
kern.ipc.somaxconn=3D8192
kern.ipc.maxsockbuf=3D4737024
#

gets

[ ID] Interval=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Transfer=C2=A0 =C2= =A0 =C2=A0Bitrate=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0Retr
[=C2=A0 5]=C2=A0 =C2=A00.00-60.08=C2=A0 sec=C2=A0 5.06 GBytes=C2=A0 =C2=A07= 24 Mbits/sec=C2=A0 428=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0sende= r
[=C2=A0 5]=C2=A0 =C2=A00.00-60.08=C2=A0 sec=C2=A0 5.06 GBytes=C2=A0 =C2=A07= 24 Mbits/sec=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = receiver

in iperf3 testing (iperf3 --time 60) which is nearly 77% of the
bitrate result on hardware.
--



--
Best Regards,
Cheng Cui
--0000000000004179a106248439e2--