From owner-freebsd-arm@freebsd.org Fri Mar 26 08:33:40 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 856995B7936 for ; Fri, 26 Mar 2021 08:33:40 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-23.consmr.mail.gq1.yahoo.com (sonic311-23.consmr.mail.gq1.yahoo.com [98.137.65.204]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4F6FcM1ZZhz3tlb for ; Fri, 26 Mar 2021 08:33:38 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1616747616; bh=vp6+fpy/CMc9cVLIKHVDSEwgAXtsoJCGqWity8RH2dR=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=pNnMFvmXzrbVjjhFRZF0wZsh2NSyhEO6lqTIBnzgdpjkU/0uoZ4q5JKfyHCfICCnqnSLO1oxMMT+wHq2z0TuTNUBVtiDVEmcDEYuLOCGkZG4OWbdoFxk8JJBR1uCv0q2R5W05xX8e1hx5jvD02pjc4bDk7wLdlrDGzl8M1wU696ivrKEOYnvsjKPl6EmODXjIdYQFPFq43VzU2D4yF+PYHF/Do9h83gtFPXibzWb7aTm1ZHetz7ncoJcbeTOgvf6NTmYJ91MBdT7sFh+unfYEiACPILs3QujqBoB4AwIe2Is6IEIGOejpbc3ogV/CIP472sMF5sOGtCrtNcC56KEZw== X-YMail-OSG: cLaNe6QVM1lkGd8QSdoox0oAikT7kNql6s2i0yaWVMyuW62tMAbbOEt3hN0pzDY 4vsEenuHreIDzX.fSRWBEsI_kGpCAnwAB.JyPASoewwpkJshJ6FZ91v.E4l_S4ujYIPmfecW7RtU iftj29_dYOpNyK8pjqEzBdIOrHJVA.oSNJXUntiftpG_TazXzb0GtBO2Nf0CTL_5BGbkRToz7CqK x2WaQCPO35NnbsKJVA9tFXNXvpezJ3_xJNUajyRy1zdEYaSbafQ94sHlAWfxuPPffIDZlNX5iLBk Fl4DFCjAt1uW7g5F59KIyeG1vX4uy9IiIW1.Edwpi1KcGRWJW1tgxyiRPdoYb6aystAelhyGUI6X KVM_KHGZCvJYLrG5PX22nCqJ2T7mIQ4.yaDg9ytke3yBFQ.uTU1Ma4fliAcH0ExQvVXpXTcgpMS1 dxuy.jep.gmaKbix3JJ2ZNirbEjiWvzsVvGs6iZD9yCD.H6CdookD7GndZNONzGt.A0VjQaGnWOq 998GCU7I.HDhaQ.r2E_jzTFMY2jcKJX0NGyuCehujN8CFmRYXBZZNpiQNof9_9S3vXaDSVXHXtuL E3q7IpVmfv8zB3snDCuRxe2ja.vVANldCB3HmLy9kqjIH_bZqf9jc.zzvT_kajO6abcBZO2jttA4 BxZMZO.9QT8Wa46rNL_lv_4us60z9slQ_jM8LLAJ_irCpRwrlK5k2wINRxIOvPX7Wu8YEplBONTa Cj8VMs6CiSJ_WU7Y8C0jmm.EUu8lcOHeugl5M5ogB878Z.7zn9bL78QlYoF4Gdutmv.jNMs4VAIX 5ARx.SAAL8XP1s8E3v_hziQjjMYibVkneKeuZeFq48ylFONocZMMHrWVmanJhoW5EX730nv3VEJL sONjS2.eRAXiCFFR2dwfIoo4mAvyISRSboEJs2lfrw8Yw65SWylh2.aAfNIhnwmY3xAIeT4uIaP1 Yjs_KVXm0daQ3_iNN_LTM0YEugTRsXT2WCRGYCZ8JE6myzM2Ydz1n2CJbRII3MgBvSGYGD30pW5F r8guu.39InJkC6UThOZzhJ1a8V5F2qOrg59C7qexNlXWYg9cG.XFhKmSf7Bc.UuvJHXLL8603xL8 zb94BUuXa6aBGbXpfoExfZpKlv.JE2NLj8TaXOGNJjZCQ5NS8P5ngS23Kct7naXTYuFIph2zMt.2 Zt7sJfumMHvbkwJhRU.jFVyZpPaxODpQnzsCWm23JPKVobN1kQbNXdBMdzXLNfbcnwID_1vZmf40 8P64Is4cldQuYyOToeQqWi2FFbWxJ4dUniD8G0t_0jzJSlrBXUPFBCzoJMEJ2En6.7LYYQXqYGHy WfpBjGjijW2.DaJqvMDJGwiMfpCsHIuvTrcS1OvtwK6y1IqYoHkOT3PzOfS9pct57O68_lKMJpQ_ s2Dw4kAsojG4jF5qT3hF1CkDXQaAg9JPfu7B9Y.xy7td.3P_tCSULG.P0a_rCkf2bBoEPWHM28.g BK8gsMfUrOLoDYdQoDSjzTdUprawpUTC4q57Lfo.VCEfaZzAk8veTuHbLbDL3dDpNmMFNFJ4OADt iWp7.AUsrB_Li7xc26l4NxqTi3xn0YDzRbRGcgMQdHpQyq4k_muxHnQsQCke0kYw6px6z8g2LUqD yhCuhwVoPAOYO0vwTZ2mdfxvi9yD7Qcf1IHhOfNU0r8g5cXeK2RPsvO0RsBORI50riYHPeqhA.4n _Yc.Z6m7a4YsjBHgyRpABDT0JnIm4f.qflx7qN9xx_ikK9nfSTiIG5._AA1QdR.eLLjdrOJiuqFa tuFtuMRMvOyMVbluwQnzTlWoYuhv7LV4eItdZPFwdCp4xUtz0WKonZFGefQX7AfDJ8uQCblhXcxC s1C6FY4c8ygCoJhJXc_UGUOItYA.fy9P6Gj17P9XuLMy2P7qL66sHg5xY7a64GynNVufW4mLREaE wsojENONU2AHhys1_cVxwJHXyiuPMNozKc..a2kQsExjYG7ydvwB0psAGWA1jtcv.S61Nzv1P3Ad E2.Ix23Uqk0oB8FNo9YWg2tG1czZaYZm5gmTD7etSU_jdhEcMvbK5EcBDU0qr6_jLlWfuSpEasvY Maj.hLcmVE4bAXynUKBkE779J6nDRQy3HwZjYBTpjXoqAicmEQAwSD7ttvx.p9Bb21E7OEqH3iTI jywr53ILM2pL7P147yKJCyIwJ47CWYlGz7qJ8vRMUNEeXobtWCfs_WA9rCXzO0X1J5cMVWqPKWmA 4oLQz3hd3pdyD8zjFz_kIebprSjm.3EzkOF1ud2hyF1CsNgQO8RdTE1ydUyUa7_2gczAyUsFcL1k eBOQE56gsOl9idR12KufPnMukgEgOhf9wd4U3DKyexbxpNwWbX5iC3YCBpmYK9rBxglPqM78LROp Advv7pjVRodfGpbOUiGwVrl9Wj.uvpDSsY5RzQ.OwqRqFESZ3J8rpZz5K98qCYUTLHnUSIIQUx_0 NhMKhzRKiI8.7DDxa8WOWG8.jcaQjFDwJBEPUqf6gIv7.2oeBUd8zPZ7whsU2EGns5uT1ZN33Chf 4b1UGF6aMcllpcW_4Kb6njjECKkGad4LAf_NDXJKX3FQeGOu.g8MTq7hf6yJJ79lLMjUsT_L16a0 d_EGLeahienFkZUyZSsoLoA2qA4bU1QzfGETUb7WWF6S25XvJmEzYRXTzTFc8ITLe4BpM8OIRPiQ DNm_VOw-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Fri, 26 Mar 2021 08:33:35 +0000 Received: by smtp411.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID c9ce2ab0649a86143b6afefdbd24e84b; Fri, 26 Mar 2021 08:33:31 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.60.0.2.21\)) Subject: Re: RPi and powerd, was: Re: RPI4 clock speeds and serial port ( temperatures idle and -j4 buildworld buildkernel ) From: Mark Millard In-Reply-To: Date: Fri, 26 Mar 2021 01:33:29 -0700 Cc: freebsd-arm Content-Transfer-Encoding: quoted-printable Message-Id: <1B9C90A7-5F37-41AC-8314-3E7C11B12B00@yahoo.com> References: <20210320005302.GA40542@www.zefox.net> <81CB0CCA-59AC-49A2-9372-4E2C22E3214D@googlemail.com> <20210320155638.GA41617@www.zefox.net> <63E61033-667C-4A08-9012-7D987B652176@yahoo.com> <20210320182821.GA49050@www.zefox.net> <5BF4DC26-8CCC-48E8-802F-34C42084D47F@yahoo.com> <20210321181339.GA56351@www.zefox.net> <01787975-3D1A-4D28-8F0F-957D6842D487@googlemail.com> <59B618B3-7AC9-41DF-9807-173DE34B0F8D@yahoo.com> <70CED341-5638-49EE-A32D-2BD0AC22687C@yahoo.com> To: tech-lists X-Mailer: Apple Mail (2.3654.60.0.2.21) X-Rspamd-Queue-Id: 4F6FcM1ZZhz3tlb X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.204:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.204:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.204:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.204:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Porting FreeBSD to ARM processors List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 26 Mar 2021 08:33:40 -0000 On 2021-Mar-25, at 18:18, Mark Millard wrote: > [Eliminating bad history and replacing with test > information from corrected context, just -j6 for > now.] >=20 > On 2021-Mar-25, at 10:59, Mark Millard wrote: >=20 >> [Turns out I somehow ended up with /etc/rc.conf not edited >> to enable powerd : that is what I found when I went back >> to disable it. Now I get to re-run the tests.] >>=20 >> On 2021-Mar-25, at 10:23, Mark Millard wrote: >>=20 >>> On 2021-Mar-24, at 14:13, Mark Millard wrote: >>>=20 >>>> On 2021-Mar-23, at 16:15, Mark Millard = wrote: >>>>=20 >>>>> On 2021-Mar-23, at 12:57, Mark Millard = wrote: >>>>>>=20 >>>>>>=20 >>>>>> On 2021-Mar-23, at 06:56, tech-lists = wrote: >>>>>>=20 >>>>>>> Hi, >>>>>>>=20 >>>>>>> latest build run: >>>>>>=20 >>>>>> Had a -mcpu=3Dcortext-a72 world and kernel been >>>>>> installed and booted first? Was the system >>>>>> running a world and kernel that had not been >>>>>> tuned for the Cortex-A72? >>>>>=20 >>>>> I've started an experimental build in my >>>>> -mcpu=3Dcortex-a72 tuned context . . . >>>>>=20 >>>>>>>>>> World built in 22976 seconds, ncpu: 4, make -j6 >>>>>>> -------------------------------------------------------------- >>>>>>>=20 >>>>>>> 6 Hours : 22 Minutes : 56 Seconds >>>>>>>=20 >>>>>>> created kernel.bin from kernel.full >>>>>>> -------------------------------------------------------------- >>>>>>>>>> Kernel build for GENERIC-NODEBUG completed on Mon Mar 22 = 13:54:53 >>>>>>>>>> UTC 2021 >>>>>>> -------------------------------------------------------------- >>>>>>>>>> Kernel(s) GENERIC-NODEBUG built in 2086 seconds, ncpu: 4, = make -j6 >>>>>>> -------------------------------------------------------------- >>>>>>>=20 >>>>>>> 0 Hours : 34 Minutes : 46 Seconds >=20 > Based on the later results reported, I get a build that > takes a little less time for buildworld+buildkernel, a > build that does not involve devel/ccache . >=20 > So it could be that devel/cache had an empty cache for > your build for all I can tell from the timing information. >=20 >>>>>>> commands used: >>>>>>> 1. cd /usr/src >>>>>>> 2. git pull --ff-only >>>>>=20 >>>>> I'm simply from-scratch rebuilding what I'm >>>>> already running, based on main 7381bbee29df from >>>>> 2021-03-12: >>>>>=20 >>>>> # ~/fbsd-based-on-what-freebsd-main.sh=20 >>>>> merge-base: 7381bbee29df959e88ec59866cf2878263e7f3b2 >>>>> merge-base: CommitDate: 2021-03-12 20:29:42 +0000 >>>>> def0058cc690 (HEAD -> mm-src) mm-src snapshot for mm's patched = build in git context. >>>>> 7381bbee29df (freebsd/main, freebsd/HEAD, pure-src, main) cam: Run = all XPT_ASYNC ccbs in a dedicated thread >>>>> FreeBSD RPi4B 14.0-CURRENT FreeBSD 14.0-CURRENT = mm-src-n245445-def0058cc690 GENERIC-NODBG arm64 aarch64 1400005 1400005 >>>>>=20 >>>>>>> 3. make -j10 cleanworld >>>>>>> 4. make -j10 cleandir >>>>>>> 5. make -j10 clean >>>>>=20 >>>>> My /usr/obj/cortexA72_clang/ was empty at the >>>>> start of the buildworld buildkernel . >>>>> devel/ccache is still not installed. >>>>>=20 >>>>>> This does not show ccache being cleared out >>>>>> before the below. So the times may be examples >>>>>> of "with ccache benefit" times. The contrast >>>>>> with mine and Bob P.'s times suggests a >>>>>> nice time-benefit can occur. >>>>>>=20 >>>>>>> 6. make -j6 buildworld >>>>>>> 7. make -j6 buildkernel >>>>>=20 >>>>> I'm using "-j6 buildworld buildkernel". >>>>>=20 >>>>>>> here's the src.conf : >>>>>>> https://cloud.zyxst.net/~john/FreeBSD/rpi4-main/src.conf >>>>>=20 >>>>> I'm using my normal src.conf equivalent, not >>>>> yours. (So the experiment is comparable to my >>>>> normal past experiments in this respect, matching >>>>> what I've reported in the past.) >>>>>=20 >>>>>> I seem to get intermittent access to >>>>>> https://cloud.zyxst.net/ but got to >>>>>> see the file content eventually. >>>>>>=20 >>>>>>> relevant rc.conf settings: >>>>>>> powerd_enable=3D"YES" >>>>>>> powerd_flags=3D"-r 1" >>>>>=20 >>>>> I commented out the config.txt line that assigned >>>>> arm_freq_min and the /etc/sysctl/conf line that >>>>> assigned an arm frequency. >>=20 >> I get to retry, attempting to actually do what I said >> I'd done for powerd enabling . . . I've rebooted and >> verified powerd now shows with the appropriate command >> line in top. So I've cleared things out in >> /usr/obj/cortexA72_clang/ and started a -j6 experiment >> as the first one. >>=20 >>>>> I put the 2 powerd_* lines above in my /etc/rc.conf . >>>>>=20 >>>>>>> sysctl.conf settings: >>>>>>> vfs.read_max=3D128 # default 64 # Cluster read-ahead max block = count >>>>>=20 >>>>> I added the above line to my /etc/sysctl.conf . >>>>>=20 >>>>>>> config.txt: >>>>>>> kernel=3Du-boot.bin >>>>>>> over_voltage=3D6 >>>>>>> arm_freq=3D2000 >>>>>>> sdram_freq_min=3D3200 >>>>>=20 >>>>> Ignoring comment differences, mine matches >>>>> for such lines. >>>>>=20 >>>>> I rebooted on the basis of all these changes >>>>> before starting the "-j6 buildworld buildkernel" >>>>> style build. >>>>>=20 >>>>>> Thanks much for the information. >>>>>>=20 >>>>>=20 >>>>> So, 6..10(?) of hours from when the >>>>> build started I should have time frames >>>>> to report for a "no ccache benefit" >>>>> build to compare to my past reported >>>>> build times. >>>>>=20 >=20 > With powerd actually enabled ("-r 1") this time . . . >=20 > -j6 summary: Overall somewhat under 9 hrs historically > for -j4 in my non-powerd configuration turned into > somewhat under 6 hrs 45 min for -j6 in the test powerd > configuration, somewhat over 2 hr 10 min faster.=20 >=20 > I plan on a -j4 test in the context as well. -j4 summary: somewhat under 6 hrs 45 min for -j4 in the powerd configuration but just a little longer than -j6 . In more detail: a little over 4 min longer than -j6 . I plan on a -j4 build without the vfs.read_max=3D128 as the next test of a related context. > The -j6 details . . . > (builds are via a EtherNet ssh session) >=20 > First a reminder of the prior timing that I > reported for my normal configuration of my > normal -j4 buildworld buildkernel in my > usual overclocking style: >=20 > World build completed on Thu Mar 11 18:39:37 PST 2021 > World built in 29780 seconds, ncpu: 4, make -j4 > Kernel build for GENERIC-NODBG completed on Thu Mar 11 19:18:02 PST = 2021 > Kernel(s) GENERIC-NODBG built in 2305 seconds, ncpu: 4, make -j4 >=20 > So a few minutes under 9 hr total for my > normal configuration. >=20 > By contrast, for the -j6 powerd configuration in this > experiment: >=20 > World build completed on Thu Mar 25 16:52:56 PDT 2021 > World built in 22324 seconds, ncpu: 4, make -j6 > Kernel build for GENERIC-NODBG completed on Thu Mar 25 17:21:16 PDT = 2021 > Kernel(s) GENERIC-NODBG built in 1700 seconds, ncpu: 4, make -j6 >=20 > So somewhat under 6 hrs 45 min. Nice! > (It is a little bit faster than the total for > the build times that you reported.) >=20 > Interestingly, after the build and some idle time > I see no evidence of the CPUs being slowed down: >=20 > # sysctl dev.cpu.0.freq > dev.cpu.0.freq: 2000 >=20 > # sysctl hw.cpufreq.arm_freq > hw.cpufreq.arm_freq: 2000000000 >=20 > For reference: the cpu's had definitely cooled > (from the low 50C's range): >=20 > # sysctl hw.cpufreq.temperature > hw.cpufreq.temperature: 37447 >=20 > # sysctl dev.cpu.0.temperature > dev.cpu.0.temperature: 36.4C >=20 > Also: >=20 > # sysctl dev.bcm2835_cpufreq.0.freq_settings > dev.bcm2835_cpufreq.0.freq_settings: 2000/-1 600/-1 >=20 > # sysctl dev.cpu.0.freq_levels > dev.cpu.0.freq_levels: 2000/-1 600/-1 >=20 > [Fedora gives a much longer list (in other > units) when the minimum is not forced: > int f over 6<=3Df<=3D20: (f*100)*1MHz . But, as > I remember, other linux OS's gave an even > different list. Seems to be a choice as to > what possibilities to expose of many > that can be set up.] >=20 > I note that sysctl reports: >=20 > # sysctl hw.cpufreq.turbo > hw.cpufreq.turbo: 1 >=20 > I'm not sure of the value that shows up in in my normal > configuration but I do not explicitly set it in any > configuration. >=20 >=20 > FYI: my modified version of top reported Maximum > Observed for Active+Wired of: 3468Mi MaxObs(Act+Wir), > suggesting that a 4 GiByte RPi4B might be a little > constrained at some point(s) in the build by the more > limited RAM and 2 GiByte RPi4B's or less would be > constrained for sure. >=20 The -j4 details . . . (builds are via a EtherNet ssh session) (I reboot before testing) World build completed on Fri Mar 26 00:44:13 PDT 2021 World built in 22552 seconds, ncpu: 4, make -j4 Kernel build for GENERIC-NODBG completed on Fri Mar 26 01:12:48 PDT 2021 Kernel(s) GENERIC-NODBG built in 1715 seconds, ncpu: 4, make -j4 So somewhat under 6 hrs 45 min. Nice! (It is a little bit faster than the total for the build times that you reported.) The sysctl value information is similar to what it was for -j16, not repeated here. FYI: my modified version of top reported Maximum Observed for Active+Wired of: 2589Mi MaxObs(Act+Wir), suggesting that a 2 GiByte RPi4B would be somewhat constrained at some point(s) in the build by the more limited RAM but a 4 GiByte one would not. (Memory use is a -j4 vs -j6 tradeoff.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)