From owner-freebsd-ppc@freebsd.org Sun Nov 18 20:43:00 2018 Return-Path: Delivered-To: freebsd-ppc@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E4945112124D for ; Sun, 18 Nov 2018 20:42:59 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-22.consmr.mail.gq1.yahoo.com (sonic311-22.consmr.mail.gq1.yahoo.com [98.137.65.203]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 110416FAAA for ; Sun, 18 Nov 2018 20:42:58 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: fMAF3wUVM1lsKTnOtMchFPyqf2pFwsHuS9Vbo9Qh.e0.AjrlrbXdHpkd_BI8mnT qziZ__OmbsNbQJhsqXZQJIzR4hycgIA97ozyQTwlTeJYATb1hwMeEpfrGxNa.Kr1UEbAFvIwybUc xlQw7AEkCzNw1EttgHAHclGl2FPDqfxO.EFwpCtkC2GKXWzZq4M2la_kYe8go0gYCJbsXnSj_TUb rE4LIE_PhHV4F2btVA04LI10Vf_5K28nELL1Kzza8nNwFvuM6VpiCzU8HkcQabm0WVuI0kNqoMOo OcdHMRU5.OTW9C9EAVU0xaN72RiqA0ByApbmdSrTd8pIpxb9BY7gkJsuk2VQVKQ0Q1bHmgm1Rhn4 XO01AzFGrPbeNVFFNYkncqBZtKXt_NFcaHUMMoiIia5ZiB9vRC83OdIw5qtT5BgDs1EMzKaAjiob 4kEMUuDuGqtZbk.nANs3ndLtWTeQNpEZDzoqAitYbjePGvdcZ3IKKA8omcT1D1GtG1QcEbLPVry8 JvNmY.Zzvwoz5Mz8kQ0zxI3w6n3BmZFaQk5yEaW08hhmgNKrm_wU8ieWRA.7IL6QVq71AGdfZfQ7 fuRM7DvDH1fHJwjfGclJS72aNDXyV6r4UWMnjFSdzo0Z_NBx2abygkm8jtQGOMzIH1tMRbavtQHL 5IEg4hV3jNR7HVx2mAa4gArG9DO8Jr_gAVPtb7vBRVMCkf_Q_8EAV53IGun3P0L6Zy3adOcoRvNx t.BGZmQkdrVLrIJRqj7MKMQWQM99Ch6QtuW37K5HBxsMfHhdsqKRR.4NYJXDZZczsBbsPLqSAiSQ fyM69sx7PQu.tTjYe1YD3IMlxGjF8wx0F2gzSZt0GuEmvDs9owIW4YjBnMSIJ2hp4f45v3rPcprn .TehipzzcUteQZAsIpt5VHunkNl8.4U6LycWdUWccYlNRRxNeVYoQib2oc6R9lCoLqlXK63DSecA k6Rzn3ODOeQQSS.DqnkQbI.8RvcCUUNTHJkNCzFv5Ix59M3Zzsp84ZJ_E_lFMGTM8VIQvvA9ttoY vXjAX9pfQPXvF5_3BwhfyOURPsJxTOrhVLCrMsROVNflpKfvKOtJbBaMKXrA- Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Sun, 18 Nov 2018 20:42:57 +0000 Received: from c-76-115-7-162.hsd1.or.comcast.net (EHLO [192.168.1.25]) ([76.115.7.162]) by smtp414.mail.gq1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID fbee8744c12f3d38c4a610811118e725; Sun, 18 Nov 2018 20:42:52 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.1 \(3445.101.1\)) Subject: Re: FreeBSD 12.0RC1 desperately slow From: Mark Millard In-Reply-To: Date: Sun, 18 Nov 2018 12:42:51 -0800 Cc: FreeBSD PowerPC ML Content-Transfer-Encoding: quoted-printable Message-Id: <5948241B-D3D9-4467-BA19-6063FFDFF7C6@yahoo.com> References: <9cd40cca-72c6-7394-48b4-c2101c812c9d@blastwave.org> To: Dennis Clarke X-Mailer: Apple Mail (2.3445.101.1) X-Rspamd-Queue-Id: 110416FAAA X-Spamd-Result: default: False [-0.56 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com]; NEURAL_HAM_MEDIUM(-0.77)[-0.769,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; FREEMAIL_FROM(0.00)[yahoo.com]; NEURAL_SPAM_SHORT(0.46)[0.462,0]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; RCVD_IN_DNSWL_NONE(0.00)[203.65.137.98.list.dnswl.org : 127.0.5.0]; RCPT_COUNT_TWO(0.00)[2]; IP_SCORE(0.26)[ipnet: 98.137.64.0/21(0.77), asn: 36647(0.61), country: US(-0.09)]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[] X-Rspamd-Server: mx1.freebsd.org X-BeenThere: freebsd-ppc@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting FreeBSD to the PowerPC List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Nov 2018 20:43:00 -0000 [I should have mentioned: non-debug kernel, buildworld and buildkernel using devel/powerpc64-xtoolchain-gcc materials instead of gcc 4.2.1 . I add another comparison.] On 2018-Nov-18, at 10:41, Mark Millard wrote: > On 2018-Nov-18, at 05:16, Dennis Clarke = wrote: >=20 >> I am seeing nearly 1980's type speeds : >>=20 >>=20 >> eris# uname -a >> FreeBSD eris 12.0-RC1 FreeBSD 12.0-RC1 r340470 GENERIC powerpc >> eris# >>=20 >> eris# /usr/bin/time -p /usr/sbin/portsnap fetch extract >> . >> . >> . >> Building new INDEX files... done. >> real 4181.61 >> user 306.68 >> sys 2917.95 >> eris# >>=20 >>=20 >> dmesg says : >>=20 >> ada0 at ata2 bus 0 scbus0 target 0 lun 0 >> ada0: ATA-7 SATA 1.x device >> ada0: Serial Number KRVN23ZAHA5DBD >> ada0: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes) >> ada0: 476940MB (976773168 512 byte sectors) >>=20 >> However performance in just about any trivial test is very very very >> bad. Three "very" on purpose. Better than serial interface speeds = and >> even better than old SCO ODT3 UNIX running with tape based swap. = However >> this is just like being back in mid 1980's on MFM/RLL disks : >>=20 >> eris# uname -a >> FreeBSD eris 12.0-RC1 FreeBSD 12.0-RC1 r340470 GENERIC powerpc >> eris# >> eris# /usr/bin/time -p dd if=3D/dev/urandom = of=3D/var/tmp/root/random_8GB.dat bs=3D8192 count=3D1048576 >> 1048576+0 records in >> 1048576+0 records out >> 8589934592 bytes transferred in 498.075845 secs (17246238 bytes/sec) >> real 498.11 >> user 0.99 >> sys 260.24 >> eris# >=20 >=20 > For comparison: for head based on -r339076 on a G5 Quad Core (system > total core count), 16 GiBytes RAM, SSD file system, SMP enabled (so > Justin's change has been reverted): >=20 > # /usr/bin/time -p dd if=3D/dev/urandom of=3D/var/tmp/random_8GB.dat = bs=3D8192 count=3D1048576 > 1048576+0 records in > 1048576+0 records out > 8589934592 bytes transferred in 206.345413 secs (41628910 bytes/sec) > real 206.35 > user 1.03 > sys 201.34 >=20 > # uname -apKU > FreeBSD FBSDG5L 12.0-ALPHA8 FreeBSD 12.0-ALPHA8 #4 r339076M: Mon Oct = 15 13:19:35 PDT 2018 = markmi@FBSDG5L:/usr/obj/powerpc64vtsc_xtoolchain-gcc/powerpc.powerpc64/usr= /src/powerpc.powerpc64/sys/GENERIC64vtsc-NODBG powerpc powerpc64 = 1200084 1200084 >=20 > The old SSD vs. old hardrive transfer rate differences might not > be all that surprising. I should have mentioned: non-debug kernel, buildworld and buildkernel using devel/powerpc64-xtoolchain-gcc materials instead of gcc 4.2.1 and its toolchain. [I'll note that such experiments with alternate toolchains end up with some aspects that do not work right, even if things build. (I sometimes experiment in this area for more modern compilers/toolchains.)] I'll also provide one more item for comparison/contrast to help isolate processor bottlenecks from I/O ones: # /usr/bin/time -p dd if=3D/dev/zero of=3D/var/tmp/zero_8GB.dat bs=3D8192 = count=3D1048576 1048576+0 records in 1048576+0 records out 8589934592 bytes transferred in 85.941324 secs (99951155 bytes/sec) real 85.95 user 0.92 sys 30.48 So, in my context it looks like /dev/urandom use is the bottleneck when it is in use for the dd. But it still does around 40 MByte/s for storage I/O with /dev/urandom --instead of around 17 MByte/s. For reference, using the dd with /dev/urandom I see things like the following for the top cpu usage: PID USERNAME THR PRI NICE SIZE RES SWAP STATE C TIME = CPU COMMAND 11 root 4 155 ki31 0 128K 0 RUN 0 1503.4 = 283.49% [idle] 49063 root 1 101 0 12M 2804K 0 CPU3 3 0:33 = 94.77% dd if=3D/dev/urandom of=3D/var/tmp/random_8GB.dat bs=3D8192 = count=3D1048576 12 root 22 -56 - 0 704K 0 WAIT -1 159:20 = 6.87% [intr] 2 root 2 -16 - 0 64K 0 - 0 5:17 = 5.81% [cam] 0 root 23 -16 - 0 736K 0 swapin 1 1:53 = 5.72% [kernel] 18 root 5 20 - 0 160K 0 qsleep 0 3:05 = 1.72% [bufdaemon] 21 root 1 -16 - 0 32K 0 smu 3 179:44 = 1.33% [pmac_thermal] 5 root 1 -16 - 0 32K 0 - 0 1:59 = 0.16% [rand_harvestq] . . . >> A small x86 boxen machine nearby says : >>=20 >> titan# >> titan# uname -a >> FreeBSD titan 12.0-RC1 FreeBSD 12.0-RC1 r340470 GENERIC amd64 >> titan# /usr/bin/time -p dd if=3D/dev/urandom = of=3D/var/tmp/root/random_8GB.dat bs=3D8192 count=3D1048576 >> 1048576+0 records in >> 1048576+0 records out >> 8589934592 bytes transferred in 116.799755 secs (73544115 bytes/sec) >> real 116.80 >> user 0.40 >> sys 115.80 >> titan# >>=20 >>=20 >> and ye old Solaris SPARC crate : >>=20 >> node000 $ uname -a >> SunOS node000 5.10 Generic_150400-61 sun4u sparc = SUNW,SPARC-Enterprise >> node000 $ /usr/bin/time -p dd if=3D/dev/urandom of=3Drandom_8GB.dat = bs=3D8192 count=3D1048576 >> 0+1048576 records in >> 0+1048576 records out >>=20 >> real 161.95 >> user 1.01 >> sys 159.46 >>=20 >>=20 >> Sure /dev/urandom should be fed as fast as the system can make up >> numbers from whatever noise sources it has but even a trivial copy >> of that 8GB file is terribly slow. >>=20 >> eris# /usr/bin/time -p cp -p random_8GB.dat /home/dclarke/ >> real 727.43 >> user 0.05 >> sys 46.81 >> eris# >>=20 >> eris# echo "8k 8589934592 727.43 / pq" | dc >> 11808606.45285457 >>=20 >> So maybe 10 or 11MB/sec on the filesystem. >> Would love ZFS but this is UFS here. >>=20 >> However I am running with kern.smp.disable=3D1 but that can't account = for >> this mess .. could it ? =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)