From nobody Wed Oct 22 14:35:15 2025 X-Original-To: freebsd-net@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4csBXZ157Yz6FN0Z for ; Wed, 22 Oct 2025 14:35:26 +0000 (UTC) (envelope-from sm@codenetworks.net) Received: from relayout07-q01.dominioabsoluto.net (relayout07-q01.dominioabsoluto.net [217.116.26.57]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4csBXX5WXjz47gQ for ; Wed, 22 Oct 2025 14:35:24 +0000 (UTC) (envelope-from sm@codenetworks.net) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=codenetworks.net header.s=domabs header.b=IpdgdL2s; dmarc=none; spf=pass (mx1.freebsd.org: domain of sm@codenetworks.net designates 217.116.26.57 as permitted sender) smtp.mailfrom=sm@codenetworks.net Received: from relayout07-redir.dominioabsoluto.net (relayout07-redir.dominioabsoluto.net [217.116.26.62]) by relayout07.dominioabsoluto.net (Postfix) with ESMTP id 4csBXT4YHyz1jQyh for ; Wed, 22 Oct 2025 16:35:21 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=codenetworks.net; s=domabs; t=1761143721; bh=01iJKN7h3ZSRUxburKUiD8bdRc/nj3ktK7MGQqEAhEQ=; h=Date:Subject:To:References:From:In-Reply-To:From; b=IpdgdL2sPjHpTy046iM5VW/IfO1EeNPqY2dd8ZFWGT50f0Di0AI130QWYTElRz44j KR9N4KkQL+etdZeCoRIH1HQPnVxauP0vpNORyKXOqM7lVD6EgiLsvJ6m1EEXwtYW+1 icCZz5synTrkmHzUUSFiE06e5a0cLF2d8QlAWEzw= Received: from [192.168.3.20] (unknown [188.241.98.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) (Authenticated sender: sm.codenetworks.net) by relayout07-dsp.dominioabsoluto.net (Postfix) with ESMTPSA id 4csBXS5Nq3z1jQy8 for ; Wed, 22 Oct 2025 16:35:20 +0200 (CEST) Content-Type: multipart/alternative; boundary="------------ed2qSepWqfxR9IX1m5XDHKOF" Message-ID: <649d06b9-17d7-4d67-a2d0-bb53c76b62fe@codenetworks.net> Date: Wed, 22 Oct 2025 16:35:15 +0200 List-Id: Networking and TCP/IP with FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-net List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-net@FreeBSD.org MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: vtnet is still slow To: freebsd-net@freebsd.org References: Content-Language: es-ES From: Santiago Martinez In-Reply-To: X-PostalOut-Country: IP: 188.241.98.146 | Country: ES X-PostalOut-Information: AntiSPAM and AntiVIRUS on relayout07 X-PostalOut-MsgID: 4csBXS5Nq3z1jQy8.A5553 X-PostalOut-SpamCheck: no es spam, clean X-PostalOut-From: sm@codenetworks.net X-PostalOut-Watermark: 1761748521.29987@pInIDmH0QkHK5GT2CRjbcA X-Spam-Status: No X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.80 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ip4:217.116.26.0/24]; R_DKIM_ALLOW(-0.20)[codenetworks.net:s=domabs]; RCVD_IN_DNSWL_LOW(-0.20)[217.116.26.57:from,217.116.26.62:received]; MIME_GOOD(-0.10)[multipart/alternative,text/plain]; RWL_MAILSPIKE_GOOD(-0.10)[217.116.26.57:from]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:16371, ipnet:217.116.24.0/21, country:ES]; RCVD_VIA_SMTP_AUTH(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; DMARC_NA(0.00)[codenetworks.net]; MID_RHS_MATCH_FROM(0.00)[]; MLMMJ_DEST(0.00)[freebsd-net@freebsd.org]; RCVD_COUNT_TWO(0.00)[2]; FROM_EQ_ENVFROM(0.00)[]; ARC_NA(0.00)[]; TO_DN_NONE(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-net@freebsd.org]; TO_MATCH_ENVRCPT_ALL(0.00)[]; RCVD_TLS_LAST(0.00)[]; DKIM_TRACE(0.00)[codenetworks.net:+] X-Rspamd-Queue-Id: 4csBXX5WXjz47gQ This is a multi-part message in MIME format. --------------ed2qSepWqfxR9IX1m5XDHKOF Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit Hi there, how does the topology looks? This is from a 14.3 host  (bhyve) with a 14.3 guest. Host is server, 14.3 is client 14.3 Best regards. Santiago iperf3 -c 192.168.1.1 -t 5 -P1 -Z Connecting to host 192.168.1.1, port 5201 [  5] local 192.168.1.10 port 13866 connected to 192.168.1.1 port 5201 [ ID] Interval           Transfer     Bitrate         Retr  Cwnd [  5]   0.00-1.01   sec   271 MBytes  2.25 Gbits/sec    0    739 KBytes [  5]   1.01-2.01   sec   250 MBytes  2.09 Gbits/sec    0   1.44 MBytes [  5]   2.01-3.01   sec   262 MBytes  2.21 Gbits/sec    0   1.60 MBytes [  5]   3.01-4.01   sec   222 MBytes  1.86 Gbits/sec    0   1.60 MBytes [  5]   4.01-5.01   sec   224 MBytes  1.89 Gbits/sec    0   1.60 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval           Transfer     Bitrate         Retr [  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec    0            sender [  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec                  receiver On 10/22/25 16:03, void wrote: > Hi, > > I wondered if any work was happening to address the long-standing issue > of slow vtnet? (in my case, this leads to slow freebsd guest performance > in bhyve compared with every linux guest tested and OpenBSD). > > I thought maybe the recent bridge work may have ameliorated the > problem some, but testing, after configuring a (recent) stable/15 > server to use the ip-configured-on-bridge-method, showed no > improvement using > a (recent) stable/14 guest > > [ ID] Interval           Transfer     Bitrate         Retr > [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec    0 sender > [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec receiver > > for comparison, an ubuntu 25.04 guest: > > [ ID] Interval           Transfer     Bitrate         Retr > [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec  5427 sender > [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec receiver > > the baremetal host > > [ ID] Interval           Transfer     Bitrate         Retr > [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec    0 sender > [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec receiver > > Tests done a year and a half ago on similar hardware showing > the same patterns http://void.f-m.fm.user.fm/bhyve-virtio-testing.html --------------ed2qSepWqfxR9IX1m5XDHKOF Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit

Hi there, how does the topology looks?

This is from a 14.3 host  (bhyve) with a 14.3 guest.

Host is server, 14.3 is client 14.3

Best regards.

Santiago

iperf3 -c 192.168.1.1 -t 5 -P1 -Z
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.10 port 13866 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.01   sec   271 MBytes  2.25 Gbits/sec    0    739 KBytes        
[  5]   1.01-2.01   sec   250 MBytes  2.09 Gbits/sec    0   1.44 MBytes        
[  5]   2.01-3.01   sec   262 MBytes  2.21 Gbits/sec    0   1.60 MBytes        
[  5]   3.01-4.01   sec   222 MBytes  1.86 Gbits/sec    0   1.60 MBytes        
[  5]   4.01-5.01   sec   224 MBytes  1.89 Gbits/sec    0   1.60 MBytes        
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec    0            sender
[  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec                  receiver

On 10/22/25 16:03, void wrote:
Hi,

I wondered if any work was happening to address the long-standing issue
of slow vtnet? (in my case, this leads to slow freebsd guest performance
in bhyve compared with every linux guest tested and OpenBSD).

I thought maybe the recent bridge work may have ameliorated the problem some, but testing, after configuring a (recent) stable/15 server to use the ip-configured-on-bridge-method, showed no improvement using
a (recent) stable/14 guest

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec    0     sender
[  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec          receiver

for comparison, an ubuntu 25.04 guest:

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec  5427    sender
[  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec          receiver

the baremetal host

[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec    0     sender
[  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec          receiver

Tests done a year and a half ago on similar hardware showing
the same patterns http://void.f-m.fm.user.fm/bhyve-virtio-testing.html
--------------ed2qSepWqfxR9IX1m5XDHKOF--