From nobody Thu Aug 31 06:16:52 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RbrY55255z4rn0s for ; Thu, 31 Aug 2023 06:17:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-20.consmr.mail.gq1.yahoo.com (sonic301-20.consmr.mail.gq1.yahoo.com [98.137.64.146]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RbrY50kXMz4LLH for ; Thu, 31 Aug 2023 06:17:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693462630; bh=f7jJxsq9YMt+FEU02hVvSlRP5PpxXNqMNUmzdBHsueE=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=ZFStYIbikTntEVQtFA2dDyZsTHc6YYIWZ7oik7cGCzt+18CRZkV7Gj3jvnaS3F89RKEby3qFMlfPmZ5NKkDipMomE0n32uGFIs4G/miPm2x+5JfVeCfBlfV/QfpkYEXG6Cj2BV27QmY8mKUH5GPegWmsK7Sv6IYa3gnttCT43nl9XbsF2YT9WGlEaPeZTohEsFOKeB5+aMpWOy/+LrPWHMOURkUIp77pXlXy/Ag/7Q5YD46nY9e1chIQAJFjE4QzC6WEmjT4J16vsHuNdwHy410U8reifi6J9t3X+2PAFJnk4Nlfv7l5ZGmHtar06EawfJACgmaNWa4bLZpafYL57w== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693462630; bh=bB4/XL452EM3fWMN4Q/WpZSi37PL9rvs3Z1cVD2Ki9w=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=flX0IylnGrvEB7ZUfqxX9UUm0CSvYt3r77GT4Z0OVooXWOkHLqC0F4GToM1F2PaXiimeAZSB4PkfjistRrId70gi5H/0+duquwiJf6RkknjafqwVTsfalLalEs0AnvAGBUX5Xc2pTPcpS37BFvM97o4cSpUMdp/0mPAF8lHjK4Zsf+JiKb4dAOy/2ouKiOS2A1WLNC0G94SbN6aICvIat/agZXis2OCnGEDfVUsk1Mzjze8TCrlBLciBbRT21ngEJ9Fnx2ZOENvibPSB1d9cgQRLhJdsj8OzWWMIgZoJHLef/o3Ewjw1KUGh1P2evjy1yRvq66PExuokB6nmK366bA== X-YMail-OSG: VI3UhWMVM1nEtR3C7E6.pYCZIpM3s3ySn8PXXsZZAcHRZh8XMSkQ8peJhLWR5gq mj8.DrbQOyrkRToiwOjwNsvhWnZH5XQ3geu3Buke3xCGG.1nF4ZyiVIibKtTpTejNpOi_9FgwJKK iftLySrfyKo1CJSvnoLgmUvFHY_x1DfRePYe6HzFp562mLEdUIHJguI33UrOCxrY31sRh8Ku9xu7 GoDB6igKRfW04nkqPopt1.bbXBQAq1vWpBOUUO7DdpRYUtWQITgOC.zmBpEaOUMzK4Yr5Jx5b7r6 o85lR7WdPvT.PXphfU5Xh8u7GmAgtGiFggihB8LQejA5Cs_tong97afhuFwHEHfQSCmmIXrHL1fO CCmR6bkpKpwth4foDWRDgbrAsr5AClrScN_FcXpBkHb8ifpWnyfDcwhMY9hy3QKzXmxPxqpNJFeU QZhWsTfxtNZJK2m3sXwGESHxRu71fclF8s3OPVl3EqaDVPCtbimGfxpGBdvXBwjUB8.B0i_jVdUZ iQl6at10qqyeUHnUnjaqYm33QAzRGRsd7RdnbNfNB9tR.eORGTa9d9kQ0DH9hhZCaD6YW71Rr4Az 0b4QW4WZaEe0myjnV44al51cfeiFdYS4wLIdGqG8Fl62oWlD6PDp8hPHTLnSILXEJP7KnqY6Ifmi bb9oubgVlKMHOATulaEzwrp2kO8vlujbmmRVVxlb2PhZeCa4iplLtfzC4bdVFyBcg.2eP6LT4079 dZ1C.TrRKz3ZKCzPslaIb6KYcrQpFyYwmC86WkP08JcixFqJNJoi4b4GlrhHlBr2TjuXjFs6iTPX iaOwkpTfcZOewEUi0hqpDF4binGW.xHiqxip1Rrv3gbaRCVQbh09ssV.DvCHBLN..Ymb4c7q55B2 c2.T8rkSdoYGZJtB6h_H8qLWuFeHhTBN6uJHZZa2LMqXxfWJIPgEr2A8jge6UWcKBErYILROzhzZ rgTna6kuq0J.sm3_JlApUo7EG6IdKphM2ciXixPsfXHO5Cn7nIMsWiXblJ3pOTe6851ZX1A4i0hu 56kSXQc4Q7N992LGw0xMp38O09c6WsQjd1d_H8Z.UfrXo7BT4svBOUbFuaeUjovt6j5QPKt8pS2t y_6E1poM7K.D76Q4eElinyWPEuGThuPSyazchVgSEp2sGuhRZFWKlB4JLisFEJk_g11Iy0XgFDEY xh5.5dCLpCMn6fJ8SEpQ8hqC6xi1AOHmQzj9eR8M8NzD6WxXYqr2lkSpitYss6vAXkWgZJVB2bjL AtGklWG4VP32zaW50OKoPsh8sB3dYL10w6ZlY1.c_1XYBkmJjlPZU2j1OJrVgGRM7tZn5Bl71MeL pMo_q8cYKTbLdNHPGEf2TkEBEQGfw828tPznGPjCpsDRcmtLFG_NWwDlrC5YrzGoioDTTcrilL3m bbeKbX7iTQxNkXHMtIzFo0E4LByp8plBBY2Tz.840zZmwLgfDtybfRyQfdPX9cWe1aIpuMQG_foO tfMKnok.U90CTJu4syLVQ1_4_o0Pbe3ma8mEG0IuSvk4iEZvHxn_RHO7XraqUaoalOxadvmxj_1h PXSH.56HvcRjBH2HsXfAU5iRzYuYiOY1lXJN3voP6FMfByN9QJlYncCvobZM8mj55u66aLzPmK8i AwBjh49lE28_jtmeIIzGiJZok03AHwyzVjebyM55.PGZyf3MakKSiAVVXPaEFJrEkAfIsJQRUMlw w1z5S6QIyR9dDwXn_Z5v.Su5ab.tMtn36bWmXsCd31._uP3Z_xX7QuIh6dVoi6agoawkQaEdBpu6 jBxc4DvvP9oKLRoig.BQymSzPHm6yA3WhkAFyYF6fdX9ZZDx.OxvBZsus4EA12JsAlVY7XXXmpEi g_gH9LmRIsxW4GGFkv0l6UqH00ZZYIZU_SBW5BoA522Oh6bi3yOsQ55Rihp5PCsXxX8aBahQDHmK ZQ_Ngms0Lkg9b4.VerAzh2oXmRTJaj.ohRmyjcYHqGYYrztjf3lA.aueRJHSRu6JvZCRZmFx4n5Y NepWOLUuZUFE7F5R.wZrfa8Tbne8OvUzTOrPFvGism_PX4ipCZ3LLSn93cjnOhTfCd5JgnSU2s6p 4dLad_0G1GpYTULIbSLJPAf2Ifm6Dke51JTppfv03KTu9oAdkDGoZb9_ziSemV.l0BOHNNzD2Dhe LEC1dIg6jxNeSA80.lhaWb_goq_6gf8rlKLfLfKRlYs2SM6Wb5HgCL8iVp5CyvmMdPAQgc7hg2Sz ApOttqQSJ5gJQwAz8t7riQeMWjIrdl1R47xYM5Yh8mFwoMOU27neND5OeI7sFKviiCT4v.FgxCaQ - X-Sonic-MF: X-Sonic-ID: 6830c2fe-9ced-41d5-82ef-2c5784f6789d Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Thu, 31 Aug 2023 06:17:10 +0000 Received: by hermes--production-bf1-865889d799-r6v2w (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 69861597924a96dff4bcabb35f394169; Thu, 31 Aug 2023 06:17:05 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Very slow scp performance comparing to Linux [dd to /dev/null shows substantial FreeBSD vs. Ubuntu differences for bs=1k (or 1K) and bs=512] From: Mark Millard In-Reply-To: Date: Wed, 30 Aug 2023 23:16:52 -0700 Cc: Wei Hu , FreeBSD Hackers Content-Transfer-Encoding: quoted-printable Message-Id: References: <2D466F3C-527C-4EE1-8C3D-3E8CDD8D547F@yahoo.com> <543FBABC-C75A-4AB0-BFB6-1C7C15ECBA4E@longcount.org> <96A99928-4E8E-4AB1-BF3A-D026B280EC0E@yahoo.com> To: Mark Saad X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: ---- X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Queue-Id: 4RbrY50kXMz4LLH On Aug 30, 2023, at 20:59, Wei Hu wrote: >> -----Original Message----- >> From: Mark Millard >> Sent: Thursday, August 31, 2023 10:18 AM >> To: Mark Saad >> Cc: Wei Hu ; FreeBSD Hackers > hackers@freebsd.org> >> Subject: Re: Very slow scp performance comparing to Linux [dd to = /dev/null >> shows substantial FreeBSD vs. Ubuntu differences for bs=3D1k (or 1K) = and >> bs=3D512] >>=20 >> On Aug 30, 2023, at 18:45, Mark Saad wrote: >>=20 >>> All >>> Why not take scp out of the picture and try iperf? Why , we could be = looking >> at rss by default in Linux . >=20 > Actually I did the iperf3 test as well and posted results a couple = days ago.=20 > Pasting here: >=20 > FreeBSD iperf3 to localhost, single stream: 30.9 Gb/s=20 > Linux iperf3 to localhost, single stream: 48.8 Gb/s I'll note that (48.8Gb/s) / (30.9Gb/s) is a much smaller ratio than then either of the originally reported Ubuntu/FreeBSD ratios: (550 MB/s) / (70 MB/s) or: (350 MB/s) / (70 MB/s) Suggesting one or more non-network issues are contributing, especially vs. the localhost test that had the 550/70 ratio. > Neither of them has any tcp retry.=20 >=20 > Both VMs run on Intel(R) Xeon(R) Platinum 8473C (2100.00-MHz K8-class = CPU).=20 > The FreeBSD VM is 16 vcpu, with 128 GB memory. > The Linux VM is 4 vcpu, with 32 GB memory. >=20 > Wei >=20 >=20 >>=20 >> . . . =3D=3D=3D Mark Millard marklmi at yahoo.com