From owner-freebsd-arm@freebsd.org Thu Jul 9 07:22:46 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id CABCA362E16 for ; Thu, 9 Jul 2020 07:22:46 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-23.consmr.mail.gq1.yahoo.com (sonic311-23.consmr.mail.gq1.yahoo.com [98.137.65.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4B2SLY3Vyrz4d2N for ; Thu, 9 Jul 2020 07:22:45 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 6.efTNAVM1lNUdaiIqPTPaOvI9_TEy2Oa7ruhpwUmZnGPgJCCsbqvvYjEZ9SzZ9 snKWHjSCnB5h4YqHX4sFIuP4IbvDsGA0MdMVh.IYFe0_OxZ0SgC07bGzY1g.6cq8QLwvE7H.FAgC 4JCNf_wtXrmgB70KZUZRmxZ5Us7y1L0mMbU4ou4BfjzMeigMPaow70TSXk_IyrJO2Kh7Bra_1znC C.Cq46DxT_u3k83YVnVO71_jj8ux7J132UkRCoL3gHvv9DQ7UQYrhAXENi6HTxm_9Ng1Uea6VguK KvcSWHXVUNTpJJR7xmTii1in7ISZOr8vdDIkHbYk4zO5KHYrRy1108OIt2SXCUSanmQ92Y0s.V4S QB9g0h2RNCe7gDmI4vi327Z.TLx0oQwN5oFGO68Q6gToPi4OhJy0M7LolRR4dzEik8QU07GEe32q QtnMvN6mEV8ZbzChu4_uy7gHvmEjMjFGW_T09i.FYhCFEj5g0uPOjnw2J6hI58xQ_.TxSvM9T2Xf U6q6V58kaTDewiACrGinLmOADk9sBfI4o6Irf7tIExmepzN3TLVVUJ2V8FX_JvbxCAOYnRvGkWt1 vZv0NgLFROCoqImg8R6PHcjAdNMP2qIL0UTtjd50h.zoD2H5OH.bHA9S.o1ulo6e9T3gt7mg_SiF zuKGR2lE5fzTB.E6fkQsUvwTELRtxnVgWzcYX2bAoN015c7VSqVe43T2UGB050Hl8Mfx2EAbhjCW wHsBtxmpx17bOrgxTmrccnE9W0HUb8LuBZggXKBsH__5v2y3d5pzqa3DxysjUuOk5jpyOoCw4pyd fP5cghWgK1CbFyFBakBgrOExW4NKaksMMJoBsHJjqLiFmMd0hg4R3l_J9ZPu4S4M2UCIaoOOibcs wvdAjhegWMllufUxNq7O38NdGtJVnu2mAjnqbnBMhbPY.5a3E_FbnloNI7qzmCWcLQ1Yjsh4DMR1 CKtDXkBeUZrZS_yWoY6T7tAOdJeS4ZQCogo0L7R30ebW1nvZY2D2Mhlc4Pk3GhzEtC6IbFb9UDSf rddopOJCkWHF1a2H.z3ThTugCSUTgf5lr_iQa2N.YZtbWZHDwOqBnVmYCX_WY0Ir4hU2hczDDOFm ZggXmbU8zvFowBfLkUVKL_13b36YIg9zGKPilIN2SalFx1ApQNA1J03RgHCKilHkkeoRZp5bVMRe MgMqKfk6QCrYSuPxNhwGMEtY3G7qgHFFmEmAaFuNjBE6TV5__9T8inGE8dXUFqyC8Lrk2SP8eeZB tFUcM613Dx1wIADGPvM_xVDOS4_SHKM6UODBX3PVHYbmaIf5P3EUhVuPyiF3h1Ch_3Rw_Ax5RMwT RmejIqgwT2uGJImpuq0JSRf1nrL8.UTihay.tnd1XymDpZnUOKGRWZ9jMxb_zt3LxxHpvUAXVqFX hW15JGTCclWo1QpEwFv4bMrB_vuHnLU6qhnpBfJQ45Cv1s6d5XputR5qnrpc- Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Thu, 9 Jul 2020 07:22:43 +0000 Received: by smtp417.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID f5bd290183c1ab6d44f5e3a892919c2b; Thu, 09 Jul 2020 07:22:38 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: freebsd-arm Digest, Vol 740, Issue 7 (Rock64 Ethernet testing) From: Mark Millard In-Reply-To: <4AA1D1FD-F9A4-400E-80FA-C1888F399602@yahoo.com> Date: Thu, 9 Jul 2020 00:22:36 -0700 Cc: Peter Jeremy , freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: References: <1731fbded28.10a3342f0357159.8148813293316485882@fkardame.com> <20200706204707.GA94158@bluezbox.com> <0A2E974E-39D3-46C8-8791-3BD914EBE7E9@yahoo.com> <0C77695E-A9D0-410A-B105-5B69823E17E2@yahoo.com> <3289DA3D-03FB-43BD-9A6A-956AC0A03B59@yahoo.com> <20200708021226.GA77884@bluezbox.com> <4AA1D1FD-F9A4-400E-80FA-C1888F399602@yahoo.com> To: Oleksandr Tymoshenko X-Mailer: Apple Mail (2.3608.80.23.2.2) X-Rspamd-Queue-Id: 4B2SLY3Vyrz4d2N X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.12 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.204:from]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; NEURAL_HAM_LONG(-1.03)[-1.028]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.204:from]; NEURAL_HAM_SHORT(-0.62)[-0.622]; NEURAL_HAM_MEDIUM(-0.97)[-0.974]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 09 Jul 2020 07:22:46 -0000 On 2020-Jul-8, at 00:27, Mark Millard wrote: > On 2020-Jul-7, at 21:52, Mark Millard wrote: >=20 >> On 2020-Jul-7, at 19:12, Oleksandr Tymoshenko = wrote: >>=20 >>> Mark Millard (marklmi at yahoo.com) wrote: >>>> Any chance that the delays (or other parameters) depend >>>> on the operating temperature(s) of some parts? >>>>=20 >>>> If yes, then some of the following about the Rock64 V2 >>>> context that I have access to might be relevant to >>>> explaining my already reported V2 results (not much >>>> for Retr): >>>>=20 >>>> A) The Rock64 has a "case" that is really just a top >>>> and a bottom with posts: open on all 4 sides. >>>>=20 >>>> B) It has a fan blowing down on the board from the >>>> top. >>>>=20 >>>> C) It has a heat sink on the SOC, which the fan blows >>>> on directly. >>>>=20 >>>> D) It has a heat sink on the RAM, which the fan also >>>> blows on directly. >>>>=20 >>>> (I've not dealt with a more modern non-debug kernel >>>> build yet. It still may be some time before I deal >>>> with that.) >>>=20 >>> Temperature is not likely to be a factor in the delay values. >>> Rock64 V2 has a known issue with Gigabit ethernet stability: >>>=20 >>> https://forum.pine64.org/showthread.php?tid=3D7545 >>> https://sanisimov.com/2019/08/fixing-rock64-v2-gigabit-ethernet/ >>>=20 >>> Althought judging by description it's more like an almost complete >>> network lock-up and not performance degradation. >>>=20 >>> I received another board with RK3328 today and will investigate >>> the issue further. >>=20 >> Okay. >>=20 >> Looks like I should have copied iperf3 output from the server >> side as well: somewhat different information. The output was >> still available from the earlier runs so here it is . . . >>=20 >> The modern debug-kernel runs: >>=20 >> Accepted connection from 192.168.1.109, port 47111 >> [ 5] local 192.168.1.122 port 5201 connected to 192.168.1.109 port = 17015 >> [ ID] Interval Transfer Bitrate >> [ 5] 0.00-1.00 sec 17.5 MBytes 147 Mbits/sec =20= >> [ 5] 1.00-2.00 sec 45.3 MBytes 380 Mbits/sec =20= >> [ 5] 2.00-3.00 sec 44.9 MBytes 376 Mbits/sec =20= >> [ 5] 3.00-4.00 sec 45.2 MBytes 379 Mbits/sec =20= >> [ 5] 4.00-5.00 sec 44.9 MBytes 377 Mbits/sec =20= >> [ 5] 5.00-6.00 sec 45.1 MBytes 379 Mbits/sec =20= >> [ 5] 6.00-7.00 sec 44.5 MBytes 373 Mbits/sec =20= >> [ 5] 7.00-8.00 sec 45.0 MBytes 378 Mbits/sec =20= >> [ 5] 8.00-9.00 sec 44.9 MBytes 377 Mbits/sec =20= >> [ 5] 9.00-10.00 sec 44.5 MBytes 373 Mbits/sec =20= >> [ 5] 10.00-10.62 sec 27.9 MBytes 379 Mbits/sec =20= >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID] Interval Transfer Bitrate >> [ 5] 0.00-10.62 sec 450 MBytes 355 Mbits/sec = receiver >>=20 >> Accepted connection from 192.168.1.109, port 22375 >> [ 5] local 192.168.1.122 port 5201 connected to 192.168.1.109 port = 54738 >> [ ID] Interval Transfer Bitrate Retr Cwnd >> [ 5] 0.00-1.00 sec 24.7 MBytes 207 Mbits/sec 0 265 = KBytes =20 >> [ 5] 1.00-2.00 sec 61.6 MBytes 517 Mbits/sec 4 211 = KBytes =20 >> [ 5] 2.00-3.00 sec 61.4 MBytes 515 Mbits/sec 1 352 = KBytes =20 >> [ 5] 3.00-4.00 sec 61.3 MBytes 514 Mbits/sec 4 269 = KBytes =20 >> [ 5] 4.00-5.00 sec 61.4 MBytes 515 Mbits/sec 2 355 = KBytes =20 >> [ 5] 5.00-6.00 sec 61.3 MBytes 514 Mbits/sec 3 304 = KBytes =20 >> [ 5] 6.00-7.00 sec 61.3 MBytes 514 Mbits/sec 2 327 = KBytes =20 >> [ 5] 7.00-8.00 sec 61.4 MBytes 515 Mbits/sec 5 278 = KBytes =20 >> [ 5] 8.00-9.00 sec 61.4 MBytes 515 Mbits/sec 2 393 = KBytes =20 >> [ 5] 9.00-10.00 sec 61.4 MBytes 515 Mbits/sec 3 284 = KBytes =20 >> [ 5] 10.00-10.61 sec 37.3 MBytes 514 Mbits/sec 2 282 = KBytes =20 >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID] Interval Transfer Bitrate Retr >> [ 5] 0.00-10.61 sec 614 MBytes 486 Mbits/sec 28 = sender >>=20 >> (So a fairly consistent Retr rate.) >>=20 >> The non-debug head -r360311 kernel runs: >>=20 >> Accepted connection from 192.168.1.109, port 46431 >> [ 5] local 192.168.1.122 port 5201 connected to 192.168.1.109 port = 39541 >> [ ID] Interval Transfer Bitrate >> [ 5] 0.00-1.00 sec 50.3 MBytes 422 Mbits/sec =20= >> [ 5] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec =20= >> [ 5] 2.00-3.00 sec 72.9 MBytes 611 Mbits/sec =20= >> [ 5] 3.00-4.00 sec 72.8 MBytes 611 Mbits/sec =20= >> [ 5] 4.00-5.00 sec 72.9 MBytes 611 Mbits/sec =20= >> [ 5] 5.00-6.00 sec 72.9 MBytes 611 Mbits/sec =20= >> [ 5] 6.00-7.00 sec 72.8 MBytes 611 Mbits/sec =20= >> [ 5] 7.00-8.00 sec 72.8 MBytes 610 Mbits/sec =20= >> [ 5] 8.00-9.00 sec 72.8 MBytes 610 Mbits/sec =20= >> [ 5] 9.00-10.00 sec 72.8 MBytes 610 Mbits/sec =20= >> [ 5] 10.00-10.32 sec 23.4 MBytes 612 Mbits/sec =20= >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID] Interval Transfer Bitrate >> [ 5] 0.00-10.32 sec 729 MBytes 593 Mbits/sec = receiver >>=20 >> Accepted connection from 192.168.1.109, port 40223 >> [ 5] local 192.168.1.122 port 5201 connected to 192.168.1.109 port = 50696 >> [ ID] Interval Transfer Bitrate Retr Cwnd >> [ 5] 0.00-1.00 sec 78.5 MBytes 659 Mbits/sec 0 480 = KBytes =20 >> [ 5] 1.00-2.00 sec 113 MBytes 945 Mbits/sec 0 747 = KBytes =20 >> [ 5] 2.00-3.00 sec 112 MBytes 941 Mbits/sec 0 940 = KBytes =20 >> [ 5] 3.00-4.00 sec 84.5 MBytes 709 Mbits/sec 52 368 = KBytes =20 >> [ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec 0 681 = KBytes =20 >> [ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec 0 889 = KBytes =20 >> [ 5] 6.00-7.00 sec 112 MBytes 942 Mbits/sec 0 1.03 = MBytes =20 >> [ 5] 7.00-8.00 sec 112 MBytes 942 Mbits/sec 0 1.17 = MBytes =20 >> [ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec 0 125 = KBytes =20 >> [ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec 3 586 = KBytes =20 >> [ 5] 10.00-10.31 sec 34.7 MBytes 942 Mbits/sec 0 667 = KBytes =20 >> - - - - - - - - - - - - - - - - - - - - - - - - - >> [ ID] Interval Transfer Bitrate Retr >> [ 5] 0.00-10.31 sec 1.07 GBytes 892 Mbits/sec 55 = sender >>=20 >> So: Larger total Retr than the modern debug kernel case >> but not a fairly consistent rate of Retr values. >>=20 >>=20 >> I've still not dealt with updating to a modern non-debug >> environment to test it. >>=20 >=20 > Turns out that I get non-zero Retr values between > any two machines that I try, even when both are not > arm at all. >=20 > For example, between a PowerMac G5 (2 sockets, 2 cores each, > powerpc64) and a Threadripper 1950X (amd64), Both are Gbps=20 > capable . . . >=20 > FBSDG5L2# iperf3 -c 192.168.1.120 > Connecting to host 192.168.1.120, port 5201 > [ 5] local 192.168.1.7 port 17239 connected to 192.168.1.120 port = 5201 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-1.00 sec 113 MBytes 946 Mbits/sec 0 489 = KBytes =20 > [ 5] 1.00-2.00 sec 113 MBytes 944 Mbits/sec 0 730 = KBytes =20 > [ 5] 2.00-3.00 sec 113 MBytes 945 Mbits/sec 48 1.03 = MBytes =20 > [ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec 95 52.8 = KBytes =20 > [ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec 95 21.4 = KBytes =20 > [ 5] 5.00-6.00 sec 112 MBytes 941 Mbits/sec 96 1.04 = MBytes =20 > [ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec 91 148 = KBytes =20 > [ 5] 7.00-8.00 sec 112 MBytes 941 Mbits/sec 92 388 = KBytes =20 > [ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec 99 792 = KBytes =20 > [ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec 93 1.07 = MBytes =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-10.00 sec 1.10 GBytes 943 Mbits/sec 709 = sender > [ 5] 0.00-10.79 sec 1.10 GBytes 874 Mbits/sec = receiver >=20 >=20 > Accepted connection from 192.168.1.120, port 24400 > [ 5] local 192.168.1.7 port 5201 connected to 192.168.1.120 port = 14839 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-1.00 sec 109 MBytes 914 Mbits/sec 84 668 = KBytes =20 > [ 5] 1.00-2.00 sec 112 MBytes 942 Mbits/sec 102 942 = KBytes =20 > [ 5] 2.00-3.00 sec 112 MBytes 942 Mbits/sec 101 603 = KBytes =20 > [ 5] 3.00-4.00 sec 112 MBytes 941 Mbits/sec 95 868 = KBytes =20 > [ 5] 4.00-5.00 sec 112 MBytes 941 Mbits/sec 92 135 = KBytes =20 > [ 5] 5.00-6.00 sec 112 MBytes 942 Mbits/sec 89 989 = KBytes =20 > [ 5] 6.00-7.00 sec 112 MBytes 941 Mbits/sec 95 28.5 = KBytes =20 > [ 5] 7.00-8.00 sec 112 MBytes 942 Mbits/sec 100 158 = KBytes =20 > [ 5] 8.00-9.00 sec 112 MBytes 941 Mbits/sec 102 20.0 = KBytes =20 > [ 5] 9.00-10.00 sec 112 MBytes 941 Mbits/sec 99 335 = KBytes =20 > [ 5] 10.00-10.00 sec 7.50 KBytes 525 Mbits/sec 0 344 = KBytes =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-10.00 sec 1.09 GBytes 939 Mbits/sec 959 = sender >=20 > Accepted connection from 192.168.1.7, port 30451 > [ 5] local 192.168.1.120 port 5201 connected to 192.168.1.7 port = 28078 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-1.00 sec 38.8 MBytes 326 Mbits/sec 36 1.61 = MBytes =20 > [ 5] 1.00-2.01 sec 80.6 MBytes 667 Mbits/sec 471 817 = KBytes =20 > [ 5] 2.01-3.00 sec 106 MBytes 901 Mbits/sec 114 688 = KBytes =20 > [ 5] 3.00-4.00 sec 111 MBytes 933 Mbits/sec 0 893 = KBytes =20 > [ 5] 4.00-5.00 sec 111 MBytes 933 Mbits/sec 2 523 = KBytes =20 > [ 5] 5.00-6.00 sec 111 MBytes 932 Mbits/sec 0 774 = KBytes =20 > [ 5] 6.00-7.00 sec 108 MBytes 903 Mbits/sec 361 551 = KBytes =20 > [ 5] 7.00-8.00 sec 96.3 MBytes 808 Mbits/sec 180 473 = KBytes =20 > [ 5] 8.00-9.00 sec 111 MBytes 933 Mbits/sec 0 740 = KBytes =20 > [ 5] 9.00-10.00 sec 111 MBytes 933 Mbits/sec 0 934 = KBytes =20 > [ 5] 10.00-10.67 sec 74.1 MBytes 933 Mbits/sec 1 456 = KBytes =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-10.67 sec 1.03 GBytes 833 Mbits/sec 1165 = sender >=20 > Connecting to host 192.168.1.7, port 5201 > [ 5] local 192.168.1.120 port 60431 connected to 192.168.1.7 port = 5201 > [ ID] Interval Transfer Bitrate Retr Cwnd > [ 5] 0.00-1.00 sec 97.8 MBytes 818 Mbits/sec 0 633 = KBytes =20 > [ 5] 1.00-2.00 sec 111 MBytes 934 Mbits/sec 128 649 = KBytes =20 > [ 5] 2.00-3.00 sec 112 MBytes 937 Mbits/sec 0 863 = KBytes =20 > [ 5] 3.00-4.00 sec 111 MBytes 933 Mbits/sec 2 394 = KBytes =20 > [ 5] 4.00-5.00 sec 111 MBytes 933 Mbits/sec 0 693 = KBytes =20 > [ 5] 5.00-6.00 sec 111 MBytes 933 Mbits/sec 0 897 = KBytes =20 > [ 5] 6.00-7.00 sec 111 MBytes 932 Mbits/sec 2 480 = KBytes =20 > [ 5] 7.00-8.00 sec 111 MBytes 933 Mbits/sec 0 746 = KBytes =20 > [ 5] 8.00-9.00 sec 62.3 MBytes 523 Mbits/sec 320 436 = KBytes =20 > [ 5] 9.00-10.00 sec 111 MBytes 934 Mbits/sec 0 717 = KBytes =20 > - - - - - - - - - - - - - - - - - - - - - - - - - > [ ID] Interval Transfer Bitrate Retr > [ 5] 0.00-10.00 sec 1.03 GBytes 881 Mbits/sec 452 = sender > [ 5] 0.00-10.01 sec 1.02 GBytes 880 Mbits/sec = receiver >=20 > I may need to establish a better context or just may be > limited to Bitrate comparisons instead of looking for > Retr staying zero. >=20 > (Still not at a modern non-debug build for the Rock64.) The Rock64 V2 is now running head -r363021 with a non-debug kernel and world: # uname -apKU FreeBSD Rock64orRPi4 13.0-CURRENT FreeBSD 13.0-CURRENT #5 r363021M: Wed = Jul 8 20:30:01 PDT 2020 = markmi@FBSDFHUGE:/usr/obj/cortexA53_clang/arm64.aarch64/usr/src/arm64.aarc= h64/sys/GENERIC-NODBG arm64 aarch64 1300100 1300100 The patch for extra messages (and a potential bug fix) has not been applied. The iperf3 outputs are below. # iperf3 -c 192.168.1.120 Connecting to host 192.168.1.120, port 5201 [ 5] local 192.168.1.109 port 40422 connected to 192.168.1.120 port = 5201 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 73.3 MBytes 615 Mbits/sec 0 732 KBytes = =20 [ 5] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec 0 732 KBytes = =20 [ 5] 2.00-3.00 sec 72.9 MBytes 612 Mbits/sec 0 1.07 MBytes = =20 [ 5] 3.00-4.00 sec 72.7 MBytes 610 Mbits/sec 0 1.07 MBytes = =20 [ 5] 4.00-5.00 sec 72.7 MBytes 610 Mbits/sec 0 1.07 MBytes = =20 [ 5] 5.00-6.00 sec 72.7 MBytes 610 Mbits/sec 0 1.07 MBytes = =20 [ 5] 6.00-7.00 sec 72.6 MBytes 609 Mbits/sec 0 1.07 MBytes = =20 [ 5] 7.00-8.00 sec 72.6 MBytes 609 Mbits/sec 0 1.07 MBytes = =20 [ 5] 8.00-9.00 sec 72.7 MBytes 609 Mbits/sec 0 1.07 MBytes = =20 [ 5] 9.00-10.00 sec 72.7 MBytes 610 Mbits/sec 0 1.07 MBytes = =20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.00 sec 727 MBytes 610 Mbits/sec 0 = sender [ 5] 0.00-10.57 sec 727 MBytes 577 Mbits/sec = receiver iperf Done. # iperf3 -R -c 192.168.1.120 Connecting to host 192.168.1.120, port 5201 Reverse mode, remote host 192.168.1.120 is sending [ 5] local 192.168.1.109 port 10711 connected to 192.168.1.120 port = 5201 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 111 MBytes 932 Mbits/sec =20 [ 5] 1.00-2.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 2.00-3.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 3.00-4.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 4.00-5.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 5.00-6.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 6.00-7.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 7.00-8.00 sec 111 MBytes 933 Mbits/sec =20 [ 5] 8.00-9.00 sec 111 MBytes 932 Mbits/sec =20 [ 5] 9.00-10.00 sec 111 MBytes 933 Mbits/sec =20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.56 sec 1.09 GBytes 885 Mbits/sec 932 = sender [ 5] 0.00-10.00 sec 1.09 GBytes 933 Mbits/sec = receiver Where the server-side reported: # iperf3 -s ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 192.168.1.109, port 17887 [ 5] local 192.168.1.120 port 5201 connected to 192.168.1.109 port = 40422 [ ID] Interval Transfer Bitrate [ 5] 0.00-1.00 sec 32.1 MBytes 269 Mbits/sec =20 [ 5] 1.00-2.00 sec 72.7 MBytes 610 Mbits/sec =20 [ 5] 2.00-3.00 sec 72.7 MBytes 610 Mbits/sec =20 [ 5] 3.00-4.00 sec 72.5 MBytes 608 Mbits/sec =20 [ 5] 4.00-5.00 sec 72.7 MBytes 610 Mbits/sec =20 [ 5] 5.00-6.00 sec 72.6 MBytes 609 Mbits/sec =20 [ 5] 6.00-7.00 sec 72.6 MBytes 609 Mbits/sec =20 [ 5] 7.00-8.00 sec 72.6 MBytes 609 Mbits/sec =20 [ 5] 8.00-9.00 sec 72.6 MBytes 609 Mbits/sec =20 [ 5] 9.00-10.00 sec 72.7 MBytes 610 Mbits/sec =20 [ 5] 10.00-10.57 sec 41.3 MBytes 610 Mbits/sec =20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate [ 5] 0.00-10.57 sec 727 MBytes 577 Mbits/sec = receiver ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Accepted connection from 192.168.1.109, port 45095 [ 5] local 192.168.1.120 port 5201 connected to 192.168.1.109 port = 10711 [ ID] Interval Transfer Bitrate Retr Cwnd [ 5] 0.00-1.00 sec 50.3 MBytes 422 Mbits/sec 36 375 KBytes = =20 [ 5] 1.00-2.00 sec 111 MBytes 933 Mbits/sec 95 1.61 MBytes = =20 [ 5] 2.00-3.00 sec 111 MBytes 933 Mbits/sec 92 265 KBytes = =20 [ 5] 3.00-4.00 sec 111 MBytes 932 Mbits/sec 95 342 KBytes = =20 [ 5] 4.00-5.00 sec 111 MBytes 934 Mbits/sec 95 1.01 MBytes = =20 [ 5] 5.00-6.00 sec 111 MBytes 933 Mbits/sec 93 471 KBytes = =20 [ 5] 6.00-7.00 sec 111 MBytes 933 Mbits/sec 96 1.10 MBytes = =20 [ 5] 7.00-8.00 sec 111 MBytes 933 Mbits/sec 100 656 KBytes = =20 [ 5] 8.00-9.00 sec 111 MBytes 933 Mbits/sec 86 676 KBytes = =20 [ 5] 9.00-10.00 sec 111 MBytes 932 Mbits/sec 91 1.08 MBytes = =20 [ 5] 10.00-10.56 sec 62.6 MBytes 933 Mbits/sec 53 696 KBytes = =20 - - - - - - - - - - - - - - - - - - - - - - - - - [ ID] Interval Transfer Bitrate Retr [ 5] 0.00-10.56 sec 1.09 GBytes 885 Mbits/sec 932 = sender ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Side note for a networking problem one can run into on the Rock64 . . . I'll note that the kernel for the Rock64 still leaks mbuf_clusters during network activity, not freeing most of them: vm.uma.mbuf_cluster.stats.xdomain: 0 vm.uma.mbuf_cluster.stats.fails: 0 vm.uma.mbuf_cluster.stats.frees: 0 vm.uma.mbuf_cluster.stats.allocs: 3302 vm.uma.mbuf_cluster.stats.current: 3302 . . . vm.uma.mbuf_cluster.limit.max_items: 84417 vm.uma.mbuf_cluster.limit.items: 3302 Copying an about 4 GiByte tar to the Rock64 uses up a large portion of the 84417 max_items : vm.uma.mbuf_cluster.stats.current ends up being rather large and vm.uma.mbuf_cluster.stats.frees ends up being rather small. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)