Date: Thu, 16 Jun 2022 16:48:50 -0400 From: Mike Jakubik <mike.jakubik@swiftsmsgateway.com> To: "freebsd-net" <freebsd-net@FreeBSD.org> Subject: Re: Poor performance with stable/13 and Mellanox ConnectX-6 (mlx5) Message-ID: <1816e469bdf.126cdb81b2139485.369352368493375815@swiftsmsgateway.com> In-Reply-To: <18162a4a3f6.10a1a03d11472072.3783895140221599214@swiftsmsgateway.com> References: <1815e506878.cf301a5a1195924.6506017618978817828@swiftsmsgateway.com> <63396d47-3d0b-fd83-7b2e-ae5c02eeae2e@selasky.org> <18162979a8f.e81f383a1466900.9104319828015733292@swiftsmsgateway.com> <18162a4a3f6.10a1a03d11472072.3783895140221599214@swiftsmsgateway.com>
next in thread | previous in thread | raw e-mail | index | archive | help
------=_Part_6787798_67531831.1655412530143 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable After multiple tests and tweaks i believe the issue is not with the HW or N= uma related (Infinity fabric should do around 32GB) but rather with FreeBSD= TCP/IP stack. It's like it cant figure itself out properly for the speed t= hat the HW can do, i keep getting widely varying results when testing. Belo= w is an example of two tests, with about a 15 second break in between the t= wo. [root@db-02 ~]# iperf3 -i 1 -t 30 -c db-01=20 Connecting to host db-01, port 5201 [=C2=A0 5] local 192.168.10.31 port 49155 connected to 192.168.10.30 port 5= 201 [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Retr=C2=A0 Cwnd [=C2=A0 5]=C2=A0=C2=A0 0.00-1.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 991 MBytes=C2= =A0 8.32 Gbits/sec=C2=A0 268=C2=A0=C2=A0=C2=A0 579 KBytes [=C2=A0 5]=C2=A0=C2=A0 1.00-2.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 945 MBytes=C2= =A0 7.93 Gbits/sec=C2=A0 369=C2=A0=C2=A0=C2=A0 777 KBytes [=C2=A0 5]=C2=A0=C2=A0 2.00-3.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 793 MBytes=C2= =A0 6.65 Gbits/sec=C2=A0=C2=A0 60=C2=A0=C2=A0 1.03 MBytes [=C2=A0 5]=C2=A0=C2=A0 3.00-4.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 666 MBytes=C2= =A0 5.59 Gbits/sec=C2=A0 203=C2=A0=C2=A0=C2=A0 976 KBytes [=C2=A0 5]=C2=A0=C2=A0 4.00-5.01=C2=A0=C2=A0 sec=C2=A0=C2=A0 575 MBytes=C2= =A0 4.78 Gbits/sec=C2=A0 202=C2=A0=C2=A0 1.13 MBytes [=C2=A0 5]=C2=A0=C2=A0 5.01-6.00=C2=A0=C2=A0 sec=C2=A0=C2=A0 169 MBytes=C2= =A0 1.43 Gbits/sec=C2=A0 134=C2=A0=C2=A0=C2=A0 699 KBytes [=C2=A0 5]=C2=A0=C2=A0 6.00-7.00=C2=A0=C2=A0 sec=C2=A0 1.21 GBytes=C2=A0 10= .4 Gbits/sec=C2=A0 383=C2=A0=C2=A0 1.08 MBytes [=C2=A0 5]=C2=A0=C2=A0 7.00-8.00=C2=A0=C2=A0 sec=C2=A0 1.21 GBytes=C2=A0 10= .4 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.16 MBytes [=C2=A0 5]=C2=A0=C2=A0 8.00-9.00=C2=A0=C2=A0 sec=C2=A0 1.32 GBytes=C2=A0 11= .3 Gbits/sec=C2=A0 124=C2=A0=C2=A0=C2=A0 780 KBytes [=C2=A0 5]=C2=A0=C2=A0 9.00-10.00=C2=A0 sec=C2=A0=C2=A0 690 MBytes=C2=A0 5.= 79 Gbits/sec=C2=A0 316=C2=A0=C2=A0=C2=A0 605 KBytes [=C2=A0 5]=C2=A0 10.00-11.00=C2=A0 sec=C2=A0=C2=A0 685 MBytes=C2=A0 5.75 Gb= its/sec=C2=A0=C2=A0 97=C2=A0=C2=A0=C2=A0 854 KBytes [=C2=A0 5]=C2=A0 11.00-12.00=C2=A0 sec=C2=A0 1.08 GBytes=C2=A0 9.30 Gbits/s= ec=C2=A0 383=C2=A0=C2=A0=C2=A0 538 KBytes [=C2=A0 5]=C2=A0 12.00-13.00=C2=A0 sec=C2=A0=C2=A0 682 MBytes=C2=A0 5.72 Gb= its/sec=C2=A0=C2=A0 88=C2=A0=C2=A0=C2=A0 870 KBytes [=C2=A0 5]=C2=A0 13.00-14.00=C2=A0 sec=C2=A0=C2=A0 678 MBytes=C2=A0 5.69 Gb= its/sec=C2=A0 123=C2=A0=C2=A0=C2=A0 964 KBytes [=C2=A0 5]=C2=A0 14.00-15.00=C2=A0 sec=C2=A0=C2=A0 670 MBytes=C2=A0 5.62 Gb= its/sec=C2=A0 290=C2=A0=C2=A0=C2=A0 763 KBytes [=C2=A0 5]=C2=A0 15.00-16.00=C2=A0 sec=C2=A0 1.01 GBytes=C2=A0 8.71 Gbits/s= ec=C2=A0 228=C2=A0=C2=A0 1.08 MBytes [=C2=A0 5]=C2=A0 16.00-17.00=C2=A0 sec=C2=A0=C2=A0 886 MBytes=C2=A0 7.44 Gb= its/sec=C2=A0 118=C2=A0=C2=A0=C2=A0 615 KBytes [=C2=A0 5]=C2=A0 17.00-18.00=C2=A0 sec=C2=A0=C2=A0 734 MBytes=C2=A0 6.16 Gb= its/sec=C2=A0 291=C2=A0=C2=A0=C2=A0 902 KBytes [=C2=A0 5]=C2=A0 18.00-19.00=C2=A0 sec=C2=A0 1.04 GBytes=C2=A0 8.96 Gbits/s= ec=C2=A0 212=C2=A0=C2=A0=C2=A0 323 KBytes [=C2=A0 5]=C2=A0 19.00-20.00=C2=A0 sec=C2=A0=C2=A0 710 MBytes=C2=A0 5.96 Gb= its/sec=C2=A0 193=C2=A0=C2=A0=C2=A0 547 KBytes [=C2=A0 5]=C2=A0 20.00-21.00=C2=A0 sec=C2=A0=C2=A0 693 MBytes=C2=A0 5.82 Gb= its/sec=C2=A0 370=C2=A0=C2=A0=C2=A0 942 KBytes [=C2=A0 5]=C2=A0 21.00-22.00=C2=A0 sec=C2=A0=C2=A0 704 MBytes=C2=A0 5.91 Gb= its/sec=C2=A0=C2=A0 80=C2=A0=C2=A0 1022 KBytes [=C2=A0 5]=C2=A0 22.00-23.00=C2=A0 sec=C2=A0 1.26 GBytes=C2=A0 10.8 Gbits/s= ec=C2=A0 262=C2=A0=C2=A0=C2=A0 965 KBytes [=C2=A0 5]=C2=A0 23.00-24.00=C2=A0 sec=C2=A0=C2=A0 828 MBytes=C2=A0 6.94 Gb= its/sec=C2=A0 202=C2=A0=C2=A0=C2=A0 763 KBytes [=C2=A0 5]=C2=A0 24.00-25.00=C2=A0 sec=C2=A0=C2=A0 774 MBytes=C2=A0 6.49 Gb= its/sec=C2=A0 227=C2=A0=C2=A0=C2=A0 581 KBytes [=C2=A0 5]=C2=A0 25.00-26.00=C2=A0 sec=C2=A0=C2=A0 734 MBytes=C2=A0 6.15 Gb= its/sec=C2=A0 256=C2=A0=C2=A0=C2=A0 664 KBytes [=C2=A0 5]=C2=A0 26.00-27.00=C2=A0 sec=C2=A0=C2=A0 753 MBytes=C2=A0 6.32 Gb= its/sec=C2=A0 331=C2=A0=C2=A0=C2=A0 540 KBytes [=C2=A0 5]=C2=A0 27.00-28.00=C2=A0 sec=C2=A0=C2=A0 764 MBytes=C2=A0 6.41 Gb= its/sec=C2=A0 298=C2=A0=C2=A0=C2=A0 823 KBytes [=C2=A0 5]=C2=A0 28.00-29.00=C2=A0 sec=C2=A0=C2=A0 757 MBytes=C2=A0 6.35 Gb= its/sec=C2=A0 123=C2=A0=C2=A0=C2=A0 850 KBytes [=C2=A0 5]=C2=A0 29.00-30.00=C2=A0 sec=C2=A0=C2=A0 754 MBytes=C2=A0 6.32 Gb= its/sec=C2=A0=C2=A0 74=C2=A0=C2=A0=C2=A0 970 KBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Retr [=C2=A0 5]=C2=A0=C2=A0 0.00-30.00=C2=A0 sec=C2=A0 24.4 GBytes=C2=A0 6.98 Gb= its/sec=C2=A0 6305=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 sender [=C2=A0 5]=C2=A0=C2=A0 0.00-30.00=C2=A0 sec=C2=A0 24.4 GBytes=C2=A0 6.98 Gb= its/sec=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 receiver iperf Done. [root@db-02 ~]# iperf3 -i 1 -t 30 -c db-01 Connecting to host db-01, port 5201 [=C2=A0 5] local 192.168.10.31 port 25061 connected to 192.168.10.30 port 5= 201 [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Retr=C2=A0 Cwnd [=C2=A0 5]=C2=A0=C2=A0 0.00-1.00=C2=A0=C2=A0 sec=C2=A0 1.81 GBytes=C2=A0 15= .5 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 1.00-2.00=C2=A0=C2=A0 sec=C2=A0 1.83 GBytes=C2=A0 15= .7 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 2.00-3.00=C2=A0=C2=A0 sec=C2=A0 1.98 GBytes=C2=A0 17= .0 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 3.00-4.00=C2=A0=C2=A0 sec=C2=A0 2.11 GBytes=C2=A0 18= .1 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 4.00-5.00=C2=A0=C2=A0 sec=C2=A0 2.12 GBytes=C2=A0 18= .2 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 5.00-6.00=C2=A0=C2=A0 sec=C2=A0 2.16 GBytes=C2=A0 18= .5 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.11 MBytes [=C2=A0 5]=C2=A0=C2=A0 6.00-7.00=C2=A0=C2=A0 sec=C2=A0 1.90 GBytes=C2=A0 16= .3 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.12 MBytes [=C2=A0 5]=C2=A0=C2=A0 7.00-8.02=C2=A0=C2=A0 sec=C2=A0 1.28 GBytes=C2=A0 10= .8 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.12 MBytes [=C2=A0 5]=C2=A0=C2=A0 8.02-9.00=C2=A0=C2=A0 sec=C2=A0 1.83 GBytes=C2=A0 16= .0 Gbits/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.17 MBytes [=C2=A0 5]=C2=A0=C2=A0 9.00-10.00=C2=A0 sec=C2=A0 1.91 GBytes=C2=A0 16.4 Gb= its/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.20 MBytes [=C2=A0 5]=C2=A0 10.00-11.00=C2=A0 sec=C2=A0 1.79 GBytes=C2=A0 15.3 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.60 MBytes [=C2=A0 5]=C2=A0 11.00-12.00=C2=A0 sec=C2=A0 1.77 GBytes=C2=A0 15.2 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.60 MBytes [=C2=A0 5]=C2=A0 12.00-13.00=C2=A0 sec=C2=A0 1.69 GBytes=C2=A0 14.5 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 13.00-14.00=C2=A0 sec=C2=A0 1.57 GBytes=C2=A0 13.5 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 14.00-15.00=C2=A0 sec=C2=A0 1.60 GBytes=C2=A0 13.8 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 15.00-16.00=C2=A0 sec=C2=A0 1.89 GBytes=C2=A0 16.2 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 16.00-17.00=C2=A0 sec=C2=A0 1.76 GBytes=C2=A0 15.1 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 17.00-18.00=C2=A0 sec=C2=A0 1.93 GBytes=C2=A0 16.6 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 18.00-19.00=C2=A0 sec=C2=A0 1.77 GBytes=C2=A0 15.2 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 19.00-20.00=C2=A0 sec=C2=A0 1.68 GBytes=C2=A0 14.5 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 20.00-21.00=C2=A0 sec=C2=A0 1.66 GBytes=C2=A0 14.3 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 21.00-22.00=C2=A0 sec=C2=A0 1.75 GBytes=C2=A0 15.1 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 22.00-23.00=C2=A0 sec=C2=A0 1.76 GBytes=C2=A0 15.1 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 23.00-24.00=C2=A0 sec=C2=A0 2.05 GBytes=C2=A0 17.7 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 24.00-25.00=C2=A0 sec=C2=A0 1.79 GBytes=C2=A0 15.4 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 25.00-26.00=C2=A0 sec=C2=A0 1.71 GBytes=C2=A0 14.7 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 26.00-27.00=C2=A0 sec=C2=A0 2.08 GBytes=C2=A0 17.9 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 27.00-28.00=C2=A0 sec=C2=A0 2.09 GBytes=C2=A0 18.0 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 28.00-29.00=C2=A0 sec=C2=A0 2.05 GBytes=C2=A0 17.6 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes [=C2=A0 5]=C2=A0 29.00-30.00=C2=A0 sec=C2=A0 1.81 GBytes=C2=A0 15.6 Gbits/s= ec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0 1.61 MBytes - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 = Transfer=C2=A0=C2=A0=C2=A0=C2=A0 Bitrate=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 Retr [=C2=A0 5]=C2=A0=C2=A0 0.00-30.00=C2=A0 sec=C2=A0 55.2 GBytes=C2=A0 15.8 Gb= its/sec=C2=A0=C2=A0=C2=A0 0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 sender [=C2=A0 5]=C2=A0=C2=A0 0.00-30.00=C2=A0 sec=C2=A0 55.2 GBytes=C2=A0 15.8 Gb= its/sec=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 receiver iperf Done. ------=_Part_6787798_67531831.1655412530143 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <!DOCTYPE html PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN"><html><head>= <meta content=3D"text/html;charset=3DUTF-8" http-equiv=3D"Content-Type"></h= ead><body ><div style=3D"font-family: Verdana, Arial, Helvetica, sans-serif= ; font-size: 10pt;"><div>After multiple tests and tweaks i believe the issu= e is not with the HW or Numa related (Infinity fabric should do around 32GB= ) but rather with FreeBSD TCP/IP stack. It's like it cant figure itself out= properly for the speed that the HW can do, i keep getting widely varying r= esults when testing. Below is an example of two tests, with about a 15 seco= nd break in between the two.<br></div><div><br></div><div>[root@db-02 ~]# i= perf3 -i 1 -t 30 -c db-01 <br></div><div>Connecting to host db-01, port 520= 1<br></div><div>[ 5] local 192.168.10.31 port 49155 connected to 192.= 168.10.30 port 5201<br></div><div>[ ID] Interval &nb= sp; Transfer Bitrate&= nbsp; Retr Cwnd<br></div><d= iv>[ 5] 0.00-1.00 sec 991 MBytes&= nbsp; 8.32 Gbits/sec 268 579 KBytes<br></div><div>[= 5] 1.00-2.00 sec 945 MBytes = ; 7.93 Gbits/sec 369 777 KBytes<br></div><div>[&nbs= p; 5] 2.00-3.00 sec 793 MBytes 6.= 65 Gbits/sec 60 1.03 MBytes<br></div><div>[ 5= ] 3.00-4.00 sec 666 MBytes 5.59 G= bits/sec 203 976 KBytes<br></div><div>[ 5]&nb= sp; 4.00-5.01 sec 575 MBytes 4.78 Gbits= /sec 202 1.13 MBytes<br></div><div>[ 5] = 5.01-6.00 sec 169 MBytes 1.43 Gbits/sec = ; 134 699 KBytes<br></div><div>[ 5] 6.0= 0-7.00 sec 1.21 GBytes 10.4 Gbits/sec 383&nbs= p; 1.08 MBytes<br></div><div>[ 5] 7.00-8.00 &n= bsp; sec 1.21 GBytes 10.4 Gbits/sec 0 &n= bsp; 1.16 MBytes<br></div><div>[ 5] 8.00-9.00 = sec 1.32 GBytes 11.3 Gbits/sec 124 780= KBytes<br></div><div>[ 5] 9.00-10.00 sec &nbs= p; 690 MBytes 5.79 Gbits/sec 316 605 KBytes<b= r></div><div>[ 5] 10.00-11.00 sec 685 MBytes&= nbsp; 5.75 Gbits/sec 97 854 KBytes<br></div><= div>[ 5] 11.00-12.00 sec 1.08 GBytes 9.30 Gbi= ts/sec 383 538 KBytes<br></div><div>[ 5] = ; 12.00-13.00 sec 682 MBytes 5.72 Gbits/sec &n= bsp; 88 870 KBytes<br></div><div>[ 5] 13.00-1= 4.00 sec 678 MBytes 5.69 Gbits/sec 123 &= nbsp; 964 KBytes<br></div><div>[ 5] 14.00-15.00 sec= 670 MBytes 5.62 Gbits/sec 290 76= 3 KBytes<br></div><div>[ 5] 15.00-16.00 sec 1.01 GB= ytes 8.71 Gbits/sec 228 1.08 MBytes<br></div><div>[= 5] 16.00-17.00 sec 886 MBytes 7.44 Gbi= ts/sec 118 615 KBytes<br></div><div>[ 5] = ; 17.00-18.00 sec 734 MBytes 6.16 Gbits/sec 2= 91 902 KBytes<br></div><div>[ 5] 18.00-19.00&= nbsp; sec 1.04 GBytes 8.96 Gbits/sec 212  = ; 323 KBytes<br></div><div>[ 5] 19.00-20.00 sec &nbs= p; 710 MBytes 5.96 Gbits/sec 193 547 KBytes<b= r></div><div>[ 5] 20.00-21.00 sec 693 MBytes&= nbsp; 5.82 Gbits/sec 370 942 KBytes<br></div><div>[= 5] 21.00-22.00 sec 704 MBytes 5.91 Gbi= ts/sec 80 1022 KBytes<br></div><div>[ 5] = ; 22.00-23.00 sec 1.26 GBytes 10.8 Gbits/sec 262&nb= sp; 965 KBytes<br></div><div>[ 5] 23.00-24.00 = sec 828 MBytes 6.94 Gbits/sec 202  = ; 763 KBytes<br></div><div>[ 5] 24.00-25.00 sec &nbs= p; 774 MBytes 6.49 Gbits/sec 227 581 KBytes<b= r></div><div>[ 5] 25.00-26.00 sec 734 MBytes&= nbsp; 6.15 Gbits/sec 256 664 KBytes<br></div><div>[= 5] 26.00-27.00 sec 753 MBytes 6.32 Gbi= ts/sec 331 540 KBytes<br></div><div>[ 5] = ; 27.00-28.00 sec 764 MBytes 6.41 Gbits/sec 2= 98 823 KBytes<br></div><div>[ 5] 28.00-29.00&= nbsp; sec 757 MBytes 6.35 Gbits/sec 123 = 850 KBytes<br></div><div>[ 5] 29.00-30.00 sec = ; 754 MBytes 6.32 Gbits/sec 74 97= 0 KBytes<br></div><div>- - - - - - - - - - - - - - - - - - - - - - - - -<br= ></div><div>[ ID] Interval &= nbsp; Transfer Bitrate  = ; Retr<br></div><div>[ 5] 0.00-30= .00 sec 24.4 GBytes 6.98 Gbits/sec 6305 = sender<br></di= v><div>[ 5] 0.00-30.00 sec 24.4 GBytes = 6.98 Gbits/sec &= nbsp; receiver<br></div><div><br></div>= <div>iperf Done.<br></div><div><br></div><div>[root@db-02 ~]# iperf3 -i 1 -= t 30 -c db-01<br></div><div>Connecting to host db-01, port 5201<br></div><d= iv>[ 5] local 192.168.10.31 port 25061 connected to 192.168.10.30 por= t 5201<br></div><div>[ ID] Interval &nbs= p; Transfer Bitrate &n= bsp; Retr Cwnd<br></div><div>[ 5]= 0.00-1.00 sec 1.81 GBytes 15.5 Gbits/s= ec 0 1.11 MBytes<br></div><div>[ 5]&nbs= p; 1.00-2.00 sec 1.83 GBytes 15.7 Gbits/sec&n= bsp; 0 1.11 MBytes<br></div><div>[ 5] &n= bsp; 2.00-3.00 sec 1.98 GBytes 17.0 Gbits/sec = 0 1.11 MBytes<br></div><div>[ 5] = 3.00-4.00 sec 2.11 GBytes 18.1 Gbits/sec &nbs= p; 0 1.11 MBytes<br></div><div>[ 5] 4.0= 0-5.00 sec 2.12 GBytes 18.2 Gbits/sec &n= bsp; 0 1.11 MBytes<br></div><div>[ 5] 5.00-6.= 00 sec 2.16 GBytes 18.5 Gbits/sec = 0 1.11 MBytes<br></div><div>[ 5] 6.00-7.00&n= bsp; sec 1.90 GBytes 16.3 Gbits/sec 0&n= bsp; 1.12 MBytes<br></div><div>[ 5] 7.00-8.02 = sec 1.28 GBytes 10.8 Gbits/sec 0 = 1.12 MBytes<br></div><div>[ 5] 8.02-9.00 &nbs= p; sec 1.83 GBytes 16.0 Gbits/sec 0 &nbs= p; 1.17 MBytes<br></div><div>[ 5] 9.00-10.00 sec&nb= sp; 1.91 GBytes 16.4 Gbits/sec 0 1.20 M= Bytes<br></div><div>[ 5] 10.00-11.00 sec 1.79 GByte= s 15.3 Gbits/sec 0 1.60 MBytes<br></div= ><div>[ 5] 11.00-12.00 sec 1.77 GBytes 15.2 G= bits/sec 0 1.60 MBytes<br></div><div>[ = 5] 12.00-13.00 sec 1.69 GBytes 14.5 Gbits/sec = 0 1.61 MBytes<br></div><div>[ 5] 13.00= -14.00 sec 1.57 GBytes 13.5 Gbits/sec 0= 1.61 MBytes<br></div><div>[ 5] 14.00-15.00 s= ec 1.60 GBytes 13.8 Gbits/sec 0 1= .61 MBytes<br></div><div>[ 5] 15.00-16.00 sec 1.89 = GBytes 16.2 Gbits/sec 0 1.61 MBytes<br>= </div><div>[ 5] 16.00-17.00 sec 1.76 GBytes 1= 5.1 Gbits/sec 0 1.61 MBytes<br></div><div>[&n= bsp; 5] 17.00-18.00 sec 1.93 GBytes 16.6 Gbits/sec&= nbsp; 0 1.61 MBytes<br></div><div>[ 5] = 18.00-19.00 sec 1.77 GBytes 15.2 Gbits/sec &nb= sp; 0 1.61 MBytes<br></div><div>[ 5] 19.00-20.00&nb= sp; sec 1.68 GBytes 14.5 Gbits/sec 0 &nb= sp; 1.61 MBytes<br></div><div>[ 5] 20.00-21.00 sec = 1.66 GBytes 14.3 Gbits/sec 0 1.61 MByte= s<br></div><div>[ 5] 21.00-22.00 sec 1.75 GBytes&nb= sp; 15.1 Gbits/sec 0 1.61 MBytes<br></div><di= v>[ 5] 22.00-23.00 sec 1.76 GBytes 15.1 Gbits= /sec 0 1.61 MBytes<br></div><div>[ 5]&n= bsp; 23.00-24.00 sec 2.05 GBytes 17.7 Gbits/sec &nbs= p; 0 1.61 MBytes<br></div><div>[ 5] 24.00-25.= 00 sec 1.79 GBytes 15.4 Gbits/sec 0&nbs= p; 1.61 MBytes<br></div><div>[ 5] 25.00-26.00 sec&n= bsp; 1.71 GBytes 14.7 Gbits/sec 0 1.61 = MBytes<br></div><div>[ 5] 26.00-27.00 sec 2.08 GByt= es 17.9 Gbits/sec 0 1.61 MBytes<br></di= v><div>[ 5] 27.00-28.00 sec 2.09 GBytes 18.0 = Gbits/sec 0 1.61 MBytes<br></div><div>[ = 5] 28.00-29.00 sec 2.05 GBytes 17.6 Gbits/sec = ; 0 1.61 MBytes<br></div><div>[ 5] 29.0= 0-30.00 sec 1.81 GBytes 15.6 Gbits/sec = 0 1.61 MBytes<br></div><div>- - - - - - - - - - - - - - - - - -= - - - - - - -<br></div><div>[ ID] Interval &n= bsp; Transfer Bitrate = Retr<br></div><div>[ 5]&nb= sp; 0.00-30.00 sec 55.2 GBytes 15.8 Gbits/sec = 0 &= nbsp; sender<br></div><div>[ 5] 0.00-30.00 se= c 55.2 GBytes 15.8 Gbits/sec  = ; receive= r<br></div><div><br></div><div>iperf Done.<br></div></div><br></body></html= > ------=_Part_6787798_67531831.1655412530143--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?1816e469bdf.126cdb81b2139485.369352368493375815>