From owner-freebsd-arm@freebsd.org Sat Jan 23 06:21:05 2021 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 62FC54E75AB for ; Sat, 23 Jan 2021 06:21:05 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic313-21.consmr.mail.gq1.yahoo.com (sonic313-21.consmr.mail.gq1.yahoo.com [98.137.65.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DN5c03V5zz3HXB for ; Sat, 23 Jan 2021 06:21:04 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1611382862; bh=WWkY6KulgbqkTCHXD3oCX3pflb+ZhhI+HY0tiT8m3kO=; h=Subject:From:Date:To:From:Subject:Reply-To; b=eN13ukf2aLYUCYGtUmRxoK5SbMG7No0+Tzfh5G61xWQDpN1qY6SZ7u60MFbpezkwMAgBbh/bdHg6TDvyAhxElHnr8PR4Drlj98edvhpbHwJG6ZM8HeFrzKi3KKdaSD63whFuBX5Zh2lYaLBCOQrdjOxvngiErx+rZMp5ecn3ZLeYY9dVQvBoGF0cMX23n0ylAncVxiJWqKRTefMXh575KR9Zz+6aJN85nrD2HdDIT5ZN73zMG/34HnpfHIZUggaUIoZglFE4jL5leR4nkZF0SgMxEf7Dc/8E/m71Zm0xIRl7TZV8vk/jpV0xz6mllPpiE8UPSt+DU/YM5tMxeK69mA== X-YMail-OSG: zetg3NoVM1k8bf4rfxxotnZG6_LnGzwzTXrp264GexFqA4q2k_NllAW0RIsH6N8 i4bAT.6UFiJMnJQDQaWIhB1us3pMdHulQyfVKqhrLXd.5YwRqPTvyhPihTeLBBZndkMGndnZIf3e _MRjgO3fHHHBIV.ujPcuNJlzTJxm6065r9adXDJtlvvfeywIB5aobWcpbDmpN3vVFtI6T2QuHVVq .viAE1u2oCoEO6RlHqKiMCLCK45972L_Z47rdBgkxGDH1BvZymys.Op7TIgHIZkeXG7o1qu7RTnv m0YdmF7J472u5Q8TZHlwnUC4Q92.4BIGt7xYgl7m7SoPRrLtwd1uZF2.Fqfcb85XL0emD1cDoUok LTmuUjPbnwnBcLpjhCqCIHbq3O.qxE6_dIPM0Glgx8jl5utHbCwRsULKbdFpp6Ji3s_HWBC29l.q tnOSgzxO13XMbOUmFamExIpmOcOEzg81prI5EZDrpfnjAYzY0zEPBIOntpCSzEuH3paW8y__eE_E RiD2UYbb9SH.UJfFe74OyZq0b7WBpeL3DmEjMQ4_D8_rEOiTEmfHZteUuXEcXyScF3SKWyOpPT5n mv4JRTGGpZju3zW5VY83O06A_vaa1WVaKpQGHbfDpAzesHHygIs6WWoSZU0PA60cFIy9GhL1A8s0 bFVOEJExLcB98lsiBHRRj0kn.FP6._nIoVxcbwvpidyAriFxgw8GIt32UMPzWc6.H.JbgoQakrc1 r9KeNeRvKBaG3Yif2CzS7cM_dcDSm.lm2pQIG06LOEuVwy3Oynj8HLEqYL5M5NcSHDiKvPkvlrO5 YoqWvtepfH8ibeKsZZior1P4QgyXqrCHI0WrOFW3P_jbWk6gTxAGRuDW7T13ldXJs8.uPTn7uxJ8 rKZDyxKfSZJTn.5tdUze6M7V5GPr.wT2WjZH7XgyIt3O9NyhOTpCKRra04LQnAhZpJ_EZWP2Bx5j do_M8mKaHYaDtx8hbzg6e5UOiLhKtFaWjdLiivES1oTbk_qiPYhnUbtWgYwG.5TmjxJ34jdo46bg WFtZm1LlOUXkfXlxWAnqhh9.biQmw_YDW4J2UG9Y4NLpH60WeQ9sa75qrRhUHsD6_DxqFIU02nKL mKWwHQvgRBHmxHNS9WFS0ABCwnhL.XNMkv_hkZGdBlQFx84VqqNOEudMdPVpx2Wno1YipeeErkM4 Thh4cob8AEU5lCGubw.wsi9fV7LtawqfWtmm6JXSYZOWr8xJxeDhlT9tn8wITLoAIxvcblIiPn.k NGm5OaHb02R3pw21ok1Dom.1Y4KOT3hP3biwWf1hyQcVt19CoDW4u.KehE0AJKyTNnASliWNVV0c iH0ICQ5HI08YNaRkjYmVUtMe025ubX.zsGwWLe8IAzjThmHNMWL4i97ccZ1t5nkA4yuBBWKKAd8o sGmqGUW.3Zc_rDMko3wS5Gi1p1MtqjMqq0aECkX5zQJEVQNJ1sj_b18GmfW3sNINj.awAm60dVF2 hRsDnR5IIAcRvxPKW1uKt1IYYQfIZnBJWeNvgBaGcyOgdll8RCCdEspQNztNJyrR8RFNyRCYKnvr zD5znQZF0zMojb3D3fNc4pMpKzXIB.v_6YNvGD_kEuBzUS7VbHmaS3N..Qo.mdhzcwkotam0HoSg tls899R.LFDVn3o7oSbVr1E84m5h63kRXbXq47S8arzKf4YnBdp0PZsFR1oGCJzAWL6BoT2rP0Sm SFezsPyKc7QAqJlb3JRUan_Ljcq_IJ6MEYMNSyrQHQ2s8llu5OW3x8J38O92w2xmF_DShrATU57y RBF3OpYuRn_Ewdc2yR7Oq5dYdybt9FhQEekmqBnqpJoAmidKTt3lTeYaOXgNehMJgEXwSzd69eI6 Ph7nBFIaf1OwMXDe1qAgcowSjUXAKtrUeEBjL6IJrha2n86dfNd.WL1WGWQvVBecRzECFqQQsV9R gYe8_G9U3CSNo7jrfyvVzHUEnzFfAtwVK.CKUe21yH3sgPc5DW6k1k_VloUxHsgwaf77vWpJspNe YDxNK55k2ax25AZNxisi8ODXLFirEgLQZ_tYE2tVlixHDAIyFx3nkRw2NuGvcY_.3kfypk8CAxia LiZ8FPiXQipNXDUZXjtf7AWatFlDxkJDCmfol3kqlmIGYbjI3uhNgqaTFnZb5NdpvSj1qIv8gluW eG9wrYgcMJ9Scz79fExy1wtHOo874KYcAs2s2uRV6RCCqU17E9kT_7KvlXg.b.zEbVLLtwJRrEAy Lu_gOl6dFT09BPwdQk7HfLPrRWY.NcXC3VatLVQRXhCMK.Od05kpsGLvLr5JOgTHef802Nmroqj9 YRrNHEIReIKASQQeh25lYuzoILPfE8b.nNzIs7xyteJrHLLfqmRbqASvkldILNbMLhTrrClBTGW7 9jjV7x5SBVUQWBFTL0RDEQerJtbRnr5WMpSSb3w..FRKZS986dzENXqaHgnGGwOC9hWw4JQtGlFX LeJr_Y4wW16ZxHLPLYR9WsuTuCq5RZq0fGUdI4TvADNcFqUTFpOJCzHSRhgt8VMYADNAjHqHWYp7 x9Jd__yXWgxzJWMExAMx6ouFmVMoA16AYYTRha_s3gam3pw-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.gq1.yahoo.com with HTTP; Sat, 23 Jan 2021 06:21:02 +0000 Received: by smtp425.mail.bf1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 61481be51602cc494e60ca898124d0d3; Sat, 23 Jan 2021 06:20:55 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.40.0.2.32\)) Subject: Re: Needless work in buildworld Was: Re: Silent hang in buildworld, was Re: Invoking -v for clang during buildworld From: Mark Millard In-Reply-To: <2903491E-7DE7-4F17-B515-120BA447B8B3@yahoo.com> Date: Fri, 22 Jan 2021 22:20:53 -0800 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <00104FAD-E32B-4DDE-80DD-FCEF14CEC06B@yahoo.com> <056845FE-7131-4951-96AF-805D07F7BE0D@yahoo.com> <20210121023358.GA58854@www.zefox.net> <8D0C2A4C-B616-47B9-864E-D846A6EBA3D6@yahoo.com> <20210122011535.GA66611@www.zefox.net> <655C6BAA-8B10-4130-A5C9-EDED6906207D@yahoo.com> <36A2E015-78DF-40AB-BF53-FB3D26FA5AAC@yahoo.com> <20210122224656.GA76907@www.zefox.net> <2903491E-7DE7-4F17-B515-120BA447B8B3@yahoo.com> To: bob prohaska X-Mailer: Apple Mail (2.3654.40.0.2.32) X-Rspamd-Queue-Id: 4DN5c03V5zz3HXB X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.84:from]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.84:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.84:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.84:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 23 Jan 2021 06:21:05 -0000 On 2021-Jan-22, at 15:23, Mark Millard wrote: > On 2021-Jan-22, at 14:46, bob prohaska wrote: >=20 >> On Fri, Jan 22, 2021 at 01:53:06PM -0800, Mark Millard wrote: >>>=20 >>> I made a discovery of an unfortunate property of META_MODE relative >>> to minimizing builds with installworld invovled between builds as >>> things are. See: >>>=20 >>> = https://lists.freebsd.org/pipermail/freebsd-current/2021-January/078488.ht= ml >>>=20 >>> for details. >>>=20 >> Is this simply because the "target" is timestamped at installation, = while the >> object files are dated at creation? Just FYI, In things such as (abbreviated): file '. . ./tmp/legacy/usr/sbin/awk' is newer than the target... The "target" is the object file or whatever that might need to be replaced, not the . . ./tmp/legacy/usr/sbin/???. The examples of such lines listed the target file path before the word "file" above. I only showed one line with the common suffix text, no hint of the prior text on the lines summarized. So the targets were timestamped at the prior build's creation of them. It is the installworld installkernel sorts of activity that ends up with . . ./tmp/legacy/usr/sbin/awk and the like having time stamps from the new build's time frame. But the META_MODE records indicate that . . ./tmp/legacy/usr/sbin/awk (or whatever) was involved in generating the target in the prior build so the updated timestamp leads to questions of needing regeneration of the target. But a . . ./tmp/legacy/. . ./??? generally is not likely to cause such a need, even with new timestamps. >> If so, would some sort of checksum be able >> to distinguish meaningful changes? Would it be computationally = worthwhile? I leave the overall issue to Bryan Drewery to decide if there is something to be done or not. > The files (programs) were used during the activity that generated the = prior > build of the target. The worry is that the updated programs might have > differing results from older ones and so the new timestamps lead to > rebuilding. The worry is just unlikely to be an actual problem for = many of > the particular programs. >=20 > It would be good if META_MODE could ignore those programs that are in = the > legacy area and are unlikely to cause the output to vary in some > significant way. >=20 >> More broadly, I've been surprised to see lots of files associated = with foreign >> architechtures reported in self-hosting buildworld logs on the Pi2/3. = Things >> with mips, ppc and i386 in the pathname. The log always reports = building "cross=20 >> tools" when it's compiling for itself, which puts an odd meaning on = the term "cross".=20 >> Are cross tools and object files for alien hardware really needed in = such a case? >=20 > Clang and the llvm tools are by default built to be cross > compile capable. You could compile targeting powerpc64 while > building on armv7, for example. (Gcc had had separate > compilers for such.) >=20 > In an earlier message I showed my src.conf like file that I > use that included turning off generating a clang that can > do so, limiting it to arm (including aarch64). This is > not the same as the "cross tools" stage issue but does get > rid of some of the build activity for clang. It also does > not change all llvm tools to completely avoid other processor > families. >=20 > I'll note that building main (14-CURRENT) armv7 from > stable/13 armv7 or 13-CURRENT armv7, is an example of > "cross tools" being involved. Cross-tools span more > issues than you might initially think of, such as some > differing defaults for the host targeted files (old > context) vs. the new context's files. Thus the: >=20 > "/usr/src/Makefile.inc1" line 335: SYSTEM_COMPILER: libclang will be = built for bootstrapping a cross-compiler. >=20 > that is involved. Example difference in context in an > explicit notation (amd64 context example, not armv7): >=20 > -target x86_64-unknown-freebsd13.0 > -target x86_64-unknown-freebsd14.0 >=20 > The processor family is not what is varying for those. >=20 >>> I'll note that stable/13 now exists and git's main is now = 14-CURRENT. >>> Unfortunately, it seems that main (14-CURRENT) will not get the >>> weekly snapshot builds that are reported at any: >>>=20 >>> = https://lists.freebsd.org/pipermail/freebsd-snapshots/202*-*/thread.html >>>=20 >>> and go somewhere below (for example): >>>=20 >>> http://ftp3.freebsd.org/pub/FreeBSD/snapshots/ >>>=20 >>> until sometime after after 13.0-RELEASE : only stable/{11,12,13} >>> likely will, from what I'm told. Also, ci.freebsd.org is not >>> building main (14-CURRENT) yet. stable/13 builds are non-debug >>> builds. >>>=20 >>> https://artifact.ci.freebsd.org/snapshot/ being filling in has >>> not caught up with 13.0-STABLE , stable/13 , 14.0-CURRENT , or >>> main yet. >>>=20 =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)