From nobody Wed Aug 30 08:17:34 2023 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RbHGp0zTFz4rrvG for ; Wed, 30 Aug 2023 08:17:54 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic301-21.consmr.mail.gq1.yahoo.com (sonic301-21.consmr.mail.gq1.yahoo.com [98.137.64.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RbHGm5hX1z3GMt for ; Wed, 30 Aug 2023 08:17:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=b57mZMNG; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693383469; bh=vmDbPCdJ5cL5EoNEgS19dOPb1QT1xl72mc7GW3ScXd8=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=b57mZMNGDDxjmwG1K0rIvpL3MQQFff4LxaDrPzqbQtHnrHE+KhNKaXc1kfKTtXqq1yZUq1WCG91GLXf4LTLI2xby3Wir9uV3NdX2Yt/JcD6w/rw1LinI6ppNcaniW1kMoqEqKP4M+tNUOQozJJBi4SktCsXHr59c0wYk14hXYa+wEMxff/dU/h525NLxk8bMxbAVowADAbX0jbA1qKf2zzfY7D1BU1Ojyw0PdQgWWaTfGCLsdFYwNOldES8RfnSLOVxHHq5+Z7bsBizXc8qkESYAaUS+9nQdjHbhyvPjQIunpWRkIpmpDPPHLlPjHfyQXZfi6nWHKeaUck5zx1gMnQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1693383469; bh=Fz1RKUSps2/az0ca9rCcunKb8A7e4e/l8VkMiziFlaE=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=LlArUrp4kq2EjTQde8kAN3nrgsgN88++fVTWtoP0JwF7dVRAeRFg2iqyuumG73xeCIyH70yay45IuhGm3cPoYPAF3rxdri/1IhIOKBguCaBSYZji1o8r6RzBFsbTsLRi0+1cRKiB5Poojd0DUP3DB+2cI33NF2uAo2PQvFldZal+NPFXVxnWcCBlY1Je7uFtBm3ZdW1w0mNNyJoFwDnPH8gjEEwJ8iD/blW4srT8rvgoa900bQjmQyAXZMmGzYDkbA/OGkVeVs/4cfXsmotxq4qWx/bqsberdw84P+dZQcsdz2rFBLkV5mPPryTe/pW0O0iMIDW3NXLNRaAGmITruA== X-YMail-OSG: jz6v3kUVM1lLbNC7HFUjAlkzW3aRSW0PYQAukdQPjjZmTclzyuQRJNzgjcAnU9C oFdpFFFToCe8W3DhLco5sWBT0MnmGrS.kUwlguKMVyHxAfbbJgiF9fBtdh1M4mlxCGZ4WPVCRaj8 epgpQXFh8uv.c8EQLzjtlkhvfJvn_96lvLheRqnKqNv8L8TXcm5qcs9iS7niIVlC2rOQbHojK2Xd TQREqfohVsm2DxzeviJ_QXSnRCZ82zgSbqlS3bkGNBChtx.P1spt2g6J21UZOjNLbnnlscXzUwmE QJcESkr745B3_Mnm7Z5uExGEvvofszyxcyDiSs9AoRE7ondKreYx_0mdo2nm1n3hguZh_yQFeU2M usiRC1aW7Zyxo3oSkC_Rix454IvzcfjyGIITNXIsb69wE4QPx9vMslLj1Qmne4ZJJkOy0mXnqpWS xIwo6iB7DaH6JWqv.hfWkH2K6hjc6z4QxsWus1Ltd_Jc4sU8vkldt8yDOEHyoFvHB3C9sA6OkjiQ 3zc9tT.6vgeZrD5YnzxiK71Tvha9KjpiJfAfGnyJzA4KiMgkOYWfIu5K1gPEK8ZW2fynD_5BKpCa 0XYIGpiaEMVPPtn2ZXJI9SKyD.pW1HCD3LDAGy2pYDED5PzWhA4lMB3c7EMZQP2mTCTfDzEUZTgJ jcJhjQSE2Mtf1pusqPl3I5ePaYuTf8WFoZR80Oi0djQWhX9adZf4LvMOQO9paaQ.4BemlVqDikiJ d0L1REq0OA1RABNc1Y1UtjVxYArUIbyn4GGRNrPsYDmVXtTWI1iTcMX0hOGAIDK3pGo2PoAyfO.t psJdb_TElM7Sq_ceFOhCqgscG_AgMoT11UdmkS8YjQJzFo6hDXlJtTww7b5ZkesFgQ6OX05lBa.i R.ybjLQDDH5rTvHSRxevg8gwcRK4KtTlQc.NlK5AmWXHFKjbcyede5pCPlsRI6MjIoMExfCjhDM8 SGlQUQCcXwMm2l6dGTwRtWbzJBzMG7N9TSV_Z0YdkaR_BR79hvxXTOHoNXDbeonesOY1K0uushnx _y9y4MwNImbuJnwG8_0PjytAPEZRRg69pOdmdkCJK.2GZxqKr1QNIHgWx_rhDxNO_PP1pVZhAZN. ubD661ul3qN2Fl0zFzC7p8Q3ZlD8rcsgy0GERT37LOuvFK7BywRM1OfLjo6JMl77MKH2TOuSDrbr Hm1v6ovGUAc4fCDlgT5wY1PCx4TSd.ZqTc1jRsT5qqt4BM45wqXvrTp3sxHxxx.ve_F3LH2jAYVS j8zxNby7SBEk_gcJwosRS_MLvfhyZEex7W_WvkrstW3YQLVvo1w1_DElDmkC2yCIZD92ts2SbKrT gm1liNzOq.dOFeYF7BzG4LJ76hb0KcT0xfunCSLEBzd_skaDPOWO5UjurM6yB7yw7IDynRoVdn7X 3BQtJmTTcxbyEbYJ.DJcvDtQSJA32y5dwmF4Js1oqh3xc_q5_4CZ1hDXndEk3n1FnjiAt6QruEj_ jWb0Q.wnk._LeDEG1uWYsjYurIsLNh7qoxkBd1PNAxhNfwKDJq6XmPq6tbNjCTpaxEeIddN3T0oN JbsWs2JGNyUN6oYDmZavFN_LUeZOMnSswGZE8QQrequ_11ENbn4pNTOVL4Q9yuzRUspjIPn7ARwT m4BGRdUuWViCtwDyiCLyFVu5hjXvFqeG5nfjp5OAJ3tZH94se4JKRhb3cN4QDK2A44JP.b1mM9Fm GfOSqsjm7xyEbfNJyXgYQA1pWmki26WNZLzT6JwFWgog.RT8_BiIR1IlHMID25KXZcIhNMiQtvSO bGVFOW4kEqddBDUh..OgEoSkOaYDvSYiVIXb9IPgF36E6yJTujtHer585RmZqId2LS_pDosMEmni 7BqUajoFNAeahDxqjkMgRVYQ1uzo2M8J_IEcwsJF8.MQkfVbGb0cALOMiF64fodqVMZ0erHAO2iI XU.AVoYSofX.n5x6ofaOOiuNPXhO81M5IPuSfp7uFsn8VybizrjVTSrxsWzOAQaXe2doyhusb5lP LfoQNmjq3RCLifyskVyUecaOKUImrIXWMhIiaJLh9rn.kGJvW7PPjMRfNGp1qBDVjElrGMEq.6em szPUftnSo_bWL3yJcLZ6NrDvjCkb8c8kPEByOQ7PMqmrPDX4qAM5Wi8ow7korU0oA.pZ.nXT4wNm BdiEgsuwzlJkLgIjCNmhpdgxy9VflIOBKgPLRS8JhaUsQfFPEuvOK.UDV5xypXsSZW5buqEmTf0J rH1ttRbZkI40Bgq_RTYgvAOXmVDCycrU7ddgkFEoSkG8_LEVJR.lVW10RaQIdQYPMBBn9HfEr2QA - X-Sonic-MF: X-Sonic-ID: c1e29675-80ae-4261-877a-01be25f38a9d Received: from sonic.gate.mail.ne1.yahoo.com by sonic301.consmr.mail.gq1.yahoo.com with HTTP; Wed, 30 Aug 2023 08:17:49 +0000 Received: by hermes--production-gq1-6b7c87dcf5-9dzwt (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 002dc3c216f619f1fefa6b8a120b1603; Wed, 30 Aug 2023 08:17:44 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Very slow scp performance comparing to Linux Date: Wed, 30 Aug 2023 01:17:34 -0700 References: <87B95CDA-1812-44B8-9356-46631DEA9428@yahoo.com> To: weh@microsoft.com, FreeBSD Hackers In-Reply-To: <87B95CDA-1812-44B8-9356-46631DEA9428@yahoo.com> Message-Id: X-Mailer: Apple Mail (2.3731.700.6) X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.49 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.987]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-hackers@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.147:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.64.147:from]; DKIM_TRACE(0.00)[yahoo.com:+]; FREEMAIL_FROM(0.00)[yahoo.com]; TO_DN_SOME(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Rspamd-Queue-Id: 4RbHGm5hX1z3GMt On Aug 29, 2023, at 12:52, Mark Millard wrote: > Wei Hu wrote on > Date: Tue, 29 Aug 2023 12:55:35 UTC : >=20 >> Thanks for the update. Seems the numbers are the same on zfs and ufs. = That's=20 >> good to know.=20 >>=20 >> Yes, your numbers on ARM64 are better than mine on Intel. However, my = original >> intention was to find out why scp on Linux is performing much better = than FreeBSD >> under the same hardware env.=20 >>=20 >> Is it possible to try Linux in your ARM64 setting? I am using Ubuntu = 22.04 on ext4=20 >> file system. >=20 >=20 > I tried to use the Hyper-V Quick Create on the Windows Dev Kit 2023 > to install a Ubuntu 22.04 . (No clue if ext4 would result.) But the > Hyper-V UEFI reports for the disk created: >=20 > 1. SCSI Disk 0,0 > The boot loader did not load an operating system. >=20 > (It then reports the network adapter attempt found no > boot image, but that is expected.) >=20 > That leaves me wondering if Hyper-V Quick Create > established a VM file holding Intel/AMD material > despite the aarch64 context. >=20 > Establishing a Ubuntu more directly is not familiar and > will have to be a background activity and, so, likely > will not be timely. If I did any experiments outside > Hyper-V (native booting), they would be with slower > USB3 SSD media than I use for FreeBSD. >=20 > I did notice that Hyper-V Quick Create did not create > a fixed sized disk but a dynamic sized one. That is > different than what I did for FreeBSD. >=20 > Also, it was not obvious if you were after aarch64 > Hyper-V testing vs. native-boot testing vs. both. So > I may have gone the wrong direction from the start. > It is possible that I'd find establishing a native-boot > easier and then be able to have a VM file created from > the media, more like what I did with FreeBSD. >=20 > The Ubuntu activity likely would not be analogous to > the FreeBSD builds having -mcpu=3D optimization used. >=20 > Back to $work. >=20 I found a sequence of UI operations that worked for installing Ubuntu server 22.04.3 into Hyper-V in Windows 11 Pro on the Windows Dev Kit 2023 via use of a downloaded *.iso . The kernel that results predates 6.0: $ uname -ap Linux ubwdk23s 5.15.0-82-generic #91-Ubuntu SMP Mon Aug 14 14:19:18 UTC = 2023 aarch64 aarch64 aarch64 GNU/Linux Using my usual rule of rebooting before the first scp: $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img . . . FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 431.3MB/s 00:11=20 $ rm FreeBSD-14-TEST.img $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img . . . FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 482.2MB/s 00:10 Definitely faster than the FreeBSD results that I reported earlier, including faster than the ThreadRipper 1950X with Optane in a PCIe slot (more like 300 MiBytes/sec). I again used 6 cores, 24576 MiBytes of RAM, a fixed sized virtual hard disk under Hyper-V. For reference: $ lsblk -f NAME FSTYPE FSVER LABEL UUID FSAVAIL = FSUSE% MOUNTPOINTS loop0 squashfs 4.0 0 = 100% /snap/core20/1977 loop1 squashfs 4.0 0 = 100% /snap/lxd/24326 loop2 squashfs 4.0 0 = 100% /snap/snapd/19459 sda = =E2=94=9C=E2=94=80sda1 vfat FAT32 F7E9-1344 = 1G 1% /boot/efi =E2=94=94=E2=94=80sda2 ext4 1.0 = 48a0dbe6-5a99-4b6e-92dc-fe6d8efc6ffe 99.3G 14% / An experiment would be to have a small amount if RAM relative the file size. That would force it to actually write to media for some part of the file copy. So using 1024 MiByte of RAM assigned in Hyper-V: $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img . . . FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 407.5MB/s 00:12 $ rm FreeBSD-14-TEST.img $ scp = FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = markmi@localhost:FreeBSD-14-TEST.img . . . FreeBSD-14.0-ALPHA2-arm-armv7-GENERICSD-20230818-77013f29d048-264841.img = = 100% 5120MB 404.7MB/s 00:12 Still definitely faster than the FreeBSD results that I reported earlier, including faster than the ThreadRipper 1950X with Optane in a PCIe slot (more like 300 MiBytes/sec). =3D=3D=3D Mark Millard marklmi at yahoo.com