Skip site navigation (1)Skip section navigation (2)
Date:      Tue, 23 May 2023 19:58:07 +0000
From:      Benoit Chesneau <benoitc@enki-multimedia.eu>
To:        "freebsd-net@FreeBSD.org" <freebsd-net@freebsd.org>
Subject:   how to increase the vnet speed?
Message-ID:  <TbR2mwTT9IpAlR-ds87h3qzhRbj1mVmWUGVVsmxQU2qq6Z1Bv52fsaB5LqUxaZT9ooHdXo2VIhcYQu2zkT7eVMxwbbfxIv6q2JNHp7l-ydM=@enki-multimedia.eu>

next in thread | raw e-mail | index | archive | help

[-- Attachment #1 --]
Hi all,

I've created a jail using bastille and setup network. The mainin terface is a 25Gbps nic and between hosts I get 24.6 Gbits/sec :

[ ID] Interval Transfer Bitrate[ 5] 0.00-1.00 sec 2.87 GBytes 24.6 Gbits/sec
[ 5] 1.00-2.00 sec 2.88 GBytes 24.7 Gbits/sec
[ 5] 2.00-3.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 3.00-4.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 4.00-5.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 5.00-6.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 6.00-7.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 7.00-8.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 8.00-9.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 9.00-10.00 sec 2.87 GBytes 24.7 Gbits/sec
[ 5] 10.00-10.00 sec 128 KBytes 17.2 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate
[ 5] 0.00-10.00 sec 28.7 GBytes 24.7 Gbits/sec receiver

But between one host and the jail I only get 3.96 Gbits/sec

ID] Interval Transfer Bitrate Retr Cwnd[ 5] 0.00-1.00 sec 477 MBytes 4.00 Gbits/sec 44 278 KBytes
[ 5] 1.00-2.00 sec 455 MBytes 3.82 Gbits/sec 41 215 KBytes
[ 5] 2.00-3.00 sec 463 MBytes 3.89 Gbits/sec 61 391 KBytes
[ 5] 3.00-4.00 sec 488 MBytes 4.10 Gbits/sec 39 336 KBytes
[ 5] 4.00-5.00 sec 484 MBytes 4.06 Gbits/sec 30 253 KBytes
[ 5] 5.00-6.00 sec 448 MBytes 3.76 Gbits/sec 44 355 KBytes
[ 5] 6.00-7.00 sec 454 MBytes 3.81 Gbits/sec 56 266 KBytes
[ 5] 7.00-8.00 sec 471 MBytes 3.95 Gbits/sec 41 325 KBytes
[ 5] 8.00-9.00 sec 500 MBytes 4.20 Gbits/sec 39 321 KBytes
[ 5] 9.00-10.00 sec 475 MBytes 3.98 Gbits/sec 42 367 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bitrate Retr
[ 5] 0.00-10.00 sec 4.61 GBytes 3.96 Gbits/sec 437 sender
[ 5] 0.00-10.00 sec 4.61 GBytes 3.96 Gbits/sec receiver

Is there a way to increase the performance of the of the jail? The nice is a mellannox ConnectX-4 Lx, mce(4) .

Benoît
[-- Attachment #2 --]
<div style="font-family: Arial, sans-serif; font-size: 14px;">Hi all,<br>
<br>
I've created a jail using bastille and setup network. The mainin terface is a 25Gbps nic and between hosts I get&nbsp;24.6 Gbits/sec :<br>
<br>
[ ID] Interval &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Transfer &nbsp; &nbsp; Bitrate[ &nbsp;5] &nbsp; 0.00-1.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.6 Gbits/sec<br>
[ &nbsp;5] &nbsp; 1.00-2.00 &nbsp; sec &nbsp;2.88 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 2.00-3.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 3.00-4.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 4.00-5.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 5.00-6.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 6.00-7.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 7.00-8.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 8.00-9.00 &nbsp; sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp; 9.00-10.00 &nbsp;sec &nbsp;2.87 GBytes &nbsp;24.7 Gbits/sec<br>
[ &nbsp;5] &nbsp;10.00-10.00 &nbsp;sec &nbsp; 128 KBytes &nbsp;17.2 Gbits/sec<br>
- - - - - - - - - - - - - - - - - - - - - - - - -<br>
[ ID] Interval &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Transfer &nbsp; &nbsp; Bitrate<br>
[ &nbsp;5] &nbsp; 0.00-10.00 &nbsp;sec &nbsp;28.7 GBytes &nbsp;24.7 Gbits/sec &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;receiver<br>
<br>
<br>
But between one host and the jail I only get 3.96 Gbits/sec<br>
<br>
<br>
&nbsp;ID] Interval &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Transfer &nbsp; &nbsp; Bitrate &nbsp; &nbsp; &nbsp; &nbsp; Retr &nbsp;Cwnd[ &nbsp;5] &nbsp; 0.00-1.00 &nbsp; sec &nbsp; 477 MBytes &nbsp;4.00 Gbits/sec &nbsp; 44 &nbsp; &nbsp;278 KBytes<br>
[ &nbsp;5] &nbsp; 1.00-2.00 &nbsp; sec &nbsp; 455 MBytes &nbsp;3.82 Gbits/sec &nbsp; 41 &nbsp; &nbsp;215 KBytes<br>
[ &nbsp;5] &nbsp; 2.00-3.00 &nbsp; sec &nbsp; 463 MBytes &nbsp;3.89 Gbits/sec &nbsp; 61 &nbsp; &nbsp;391 KBytes<br>
[ &nbsp;5] &nbsp; 3.00-4.00 &nbsp; sec &nbsp; 488 MBytes &nbsp;4.10 Gbits/sec &nbsp; 39 &nbsp; &nbsp;336 KBytes<br>
[ &nbsp;5] &nbsp; 4.00-5.00 &nbsp; sec &nbsp; 484 MBytes &nbsp;4.06 Gbits/sec &nbsp; 30 &nbsp; &nbsp;253 KBytes<br>
[ &nbsp;5] &nbsp; 5.00-6.00 &nbsp; sec &nbsp; 448 MBytes &nbsp;3.76 Gbits/sec &nbsp; 44 &nbsp; &nbsp;355 KBytes<br>
[ &nbsp;5] &nbsp; 6.00-7.00 &nbsp; sec &nbsp; 454 MBytes &nbsp;3.81 Gbits/sec &nbsp; 56 &nbsp; &nbsp;266 KBytes<br>
[ &nbsp;5] &nbsp; 7.00-8.00 &nbsp; sec &nbsp; 471 MBytes &nbsp;3.95 Gbits/sec &nbsp; 41 &nbsp; &nbsp;325 KBytes<br>
[ &nbsp;5] &nbsp; 8.00-9.00 &nbsp; sec &nbsp; 500 MBytes &nbsp;4.20 Gbits/sec &nbsp; 39 &nbsp; &nbsp;321 KBytes<br>
[ &nbsp;5] &nbsp; 9.00-10.00 &nbsp;sec &nbsp; 475 MBytes &nbsp;3.98 Gbits/sec &nbsp; 42 &nbsp; &nbsp;367 KBytes<br>
- - - - - - - - - - - - - - - - - - - - - - - - -<br>
[ ID] Interval &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; Transfer &nbsp; &nbsp; Bitrate &nbsp; &nbsp; &nbsp; &nbsp; Retr<br>
[ &nbsp;5] &nbsp; 0.00-10.00 &nbsp;sec &nbsp;4.61 GBytes &nbsp;3.96 Gbits/sec &nbsp;437 &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; sender<br>
[ &nbsp;5] &nbsp; 0.00-10.00 &nbsp;sec &nbsp;4.61 GBytes &nbsp;3.96 Gbits/sec &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;receiver<br>
<br>
<br>
Is there a way to increase the performance of the of the jail? The nice is a mellannox ConnectX-4 Lx, mce(4) .<br>
<br>

<div class="protonmail_signature_block" style="font-family: Arial, sans-serif; font-size: 14px;">
    <div class="protonmail_signature_block-user">
        <div style="font-style:normal;font-weight:normal;letter-spacing:normal;text-indent:0px;text-transform:none;white-space:normal;word-spacing:0px;text-decoration:none;color:rgb(0,0,0);font-family:Helvetica;font-size:12px;">Benoît</div></div>
</div>
</div>

Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?TbR2mwTT9IpAlR-ds87h3qzhRbj1mVmWUGVVsmxQU2qq6Z1Bv52fsaB5LqUxaZT9ooHdXo2VIhcYQu2zkT7eVMxwbbfxIv6q2JNHp7l-ydM=>