Skip site navigation (1)Skip section navigation (2)
Date:      Wed, 22 Oct 2025 16:35:15 +0200
From:      Santiago Martinez <sm@codenetworks.net>
To:        freebsd-net@freebsd.org
Subject:   Re: vtnet is still slow
Message-ID:  <649d06b9-17d7-4d67-a2d0-bb53c76b62fe@codenetworks.net>
In-Reply-To: <aPjkGDgl6MCF-unb@int21h>
References:  <aPjkGDgl6MCF-unb@int21h>

next in thread | previous in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
Hi there, how does the topology looks?

This is from a 14.3 host  (bhyve) with a 14.3 guest.

Host is server, 14.3 is client 14.3

Best regards.

Santiago

iperf3 -c 192.168.1.1 -t 5 -P1 -Z
Connecting to host 192.168.1.1, port 5201
[  5] local 192.168.1.10 port 13866 connected to 192.168.1.1 port 5201
[ ID] Interval           Transfer     Bitrate         Retr  Cwnd
[  5]   0.00-1.01   sec   271 MBytes  2.25 Gbits/sec    0    739 KBytes
[  5]   1.01-2.01   sec   250 MBytes  2.09 Gbits/sec    0   1.44 MBytes
[  5]   2.01-3.01   sec   262 MBytes  2.21 Gbits/sec    0   1.60 MBytes
[  5]   3.01-4.01   sec   222 MBytes  1.86 Gbits/sec    0   1.60 MBytes
[  5]   4.01-5.01   sec   224 MBytes  1.89 Gbits/sec    0   1.60 MBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bitrate         Retr
[  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec    0            sender
[  5]   0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec 
                  receiver

On 10/22/25 16:03, void wrote:
> Hi,
>
> I wondered if any work was happening to address the long-standing issue
> of slow vtnet? (in my case, this leads to slow freebsd guest performance
> in bhyve compared with every linux guest tested and OpenBSD).
>
> I thought maybe the recent bridge work may have ameliorated the 
> problem some, but testing, after configuring a (recent) stable/15 
> server to use the ip-configured-on-bridge-method, showed no 
> improvement using
> a (recent) stable/14 guest
>
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec    0 sender
> [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec receiver
>
> for comparison, an ubuntu 25.04 guest:
>
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec  5427 sender
> [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec receiver
>
> the baremetal host
>
> [ ID] Interval           Transfer     Bitrate         Retr
> [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec    0 sender
> [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec receiver
>
> Tests done a year and a half ago on similar hardware showing
> the same patterns http://void.f-m.fm.user.fm/bhyve-virtio-testing.html
[-- Attachment #2 --]
<!DOCTYPE html>
<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Hi there, how does the topology looks?</p>
    <p>This is from a 14.3 host  (bhyve) with a 14.3 guest.</p>
    <p>Host is server, 14.3 is client 14.3</p>
    <p>Best regards.</p>
    <p>Santiago</p>
    <p><span style="font-family:monospace"><span
          style="color:#000000;background-color:#ffffff;">iperf3 -c
          192.168.1.1 -t 5 -P1 -Z</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">Connecting
          to host 192.168.1.1, port 5201</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
          local 192.168.1.10 port 13866 connected to 192.168.1.1 port
          5201</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[ ID]
          Interval           Transfer     Bitrate         Retr  Cwnd</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            0.00-1.01   sec   271 MBytes  2.25 Gbits/sec    0    739
          KBytes       </span><span
          style="color:#000000;background-color:#ffffff;"> </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            1.01-2.01   sec   250 MBytes  2.09 Gbits/sec    0   1.44
          MBytes       </span><span
          style="color:#000000;background-color:#ffffff;"> </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            2.01-3.01   sec   262 MBytes  2.21 Gbits/sec    0   1.60
          MBytes       </span><span
          style="color:#000000;background-color:#ffffff;"> </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            3.01-4.01   sec   222 MBytes  1.86 Gbits/sec    0   1.60
          MBytes       </span><span
          style="color:#000000;background-color:#ffffff;"> </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            4.01-5.01   sec   224 MBytes  1.89 Gbits/sec    0   1.60
          MBytes       </span><span
          style="color:#000000;background-color:#ffffff;"> </span><br>
        <span style="color:#000000;background-color:#ffffff;">- - - - -
          - - - - - - - - - - - - - - - - - - - -</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[ ID]
          Interval           Transfer     Bitrate         Retr</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec    0
                     sender</span><span
          style="color:#000000;background-color:#ffffff;">
        </span><br>
        <span style="color:#000000;background-color:#ffffff;">[  5]
            0.00-5.01   sec  1.20 GBytes  2.06 Gbits/sec
                           receiver</span><br>
      </span><br>
    </p>
    <div class="moz-cite-prefix">On 10/22/25 16:03, void wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:aPjkGDgl6MCF-unb@int21h">Hi,
      <br>
      <br>
      I wondered if any work was happening to address the long-standing
      issue
      <br>
      of slow vtnet? (in my case, this leads to slow freebsd guest
      performance
      <br>
      in bhyve compared with every linux guest tested and OpenBSD).
      <br>
      <br>
      I thought maybe the recent bridge work may have ameliorated the
      problem some, but testing, after configuring a (recent) stable/15
      server to use the ip-configured-on-bridge-method, showed no
      improvement using
      <br>
      a (recent) stable/14 guest
      <br>
      <br>
      [ ID] Interval           Transfer     Bitrate         Retr
      <br>
      [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec    0    
      sender
      <br>
      [  5]   0.00-60.03  sec  3.17 GBytes   454 Mbits/sec         
      receiver
      <br>
      <br>
      for comparison, an ubuntu 25.04 guest:
      <br>
      <br>
      [ ID] Interval           Transfer     Bitrate         Retr
      <br>
      [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec  5427   
      sender
      <br>
      [  5]   0.00-60.00  sec  6.42 GBytes   919 Mbits/sec         
      receiver
      <br>
      <br>
      the baremetal host
      <br>
      <br>
      [ ID] Interval           Transfer     Bitrate         Retr
      <br>
      [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec    0    
      sender
      <br>
      [  5]   0.00-60.01  sec  6.58 GBytes   941 Mbits/sec         
      receiver
      <br>
      <br>
      Tests done a year and a half ago on similar hardware showing
      <br>
      the same patterns
      <a class="moz-txt-link-freetext" href="http://void.f-m.fm.user.fm/bhyve-virtio-testing.html">http://void.f-m.fm.user.fm/bhyve-virtio-testing.html</a>;
      <br>
    </blockquote>
  </body>
</html>

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?649d06b9-17d7-4d67-a2d0-bb53c76b62fe>