From owner-freebsd-current@freebsd.org Thu Jan 21 04:46:36 2021 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 818394E94BA for ; Thu, 21 Jan 2021 04:46:36 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic314-21.consmr.mail.gq1.yahoo.com (sonic314-21.consmr.mail.gq1.yahoo.com [98.137.69.84]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4DLqbv2clVz4s64 for ; Thu, 21 Jan 2021 04:46:35 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1611204393; bh=Q6tdiBSh+pauA23v9tIrkUHL/B4LX3+QPAg65MIhzer=; h=Subject:From:Date:To:From:Subject:Reply-To; b=b8WnBwO06FhSMjlc08nemK5jTsrV4t4MsaNksxyVrBbzRbl7pvEVJPQ3dSVh+p1ThnEYxKvjxu07HXhW1pHsM2z/3s61cUWk5yyRAw/Arl52F/TUEUC8JHHpfIXrfhpr8NGi8kcBo8PDah5ItdqOMwnS7QrJHEYJY3gboIsthXv0NyvYUGYUOHWvBYf/Hoa/bGK1Rs7ea1u7sYwMfeTYVoYrvKTnvouoLIAGyxCFJ7DjFuDLNj+tPgIc4vYS0HzlFVe2Jeogx6MnoNyZD+hRZoJpC+suiyOw8xx6twvJbWUum98CIc6lJX1hWhsvmHmSCbN+VO8z/Hfpkq4HMDdfsQ== X-YMail-OSG: dR.cp7kVM1mrszuCozoPelNESZsn5jRNjG7R9ChN8PFgBRsfj4vUzGa2ThJRjKX Cwf2mB1WBTP6ry16JUN8Q.IfLzl_mTMVYF1TC6w5XGZWoYuqN8kVl9Daew9aL.NSlMxA0pknnKdg biQNiWbkPb_Dkj8ByXKHcINnIBZ5hjOS0Fw6acrwXpi9F7IiKHN9zt9jT4UCAEPysqGSLOYze1Fn 15UaM6pX77M7e_ZpXPZM0SZHRn2zCEmiHTu3ayqkOGE_4KeaDVDPbdJ5vmdIhCAZ0NPdHc9WPu7a PAvhQOrgvh2kidKWwSlMXFhvVDLCYz1C_B4tPOQqArhqiHhBDjJqqvmceAfyvl69A9p.3h9wLSmr HwY0eK7lilD8ABMjiLkIb_55WEacaM7IPikhIMsN8cs0.ST0kjm7mr5CAhyZ3goyOjZH6kr6q7k5 _eaHU1ahJyT9WZh0Ab60KyrJFRVHNJjO5W7Ac7WWHgNfytTbNqQkugg0ujgQOtu7kUdsXVdv9QBx ubKNI.w38FFPmxkqBfkZ3tckoCQ7BDxRoVw_eOp2yf4alewdinHWpT3Ndglnl2_87PsP9aukwdFV 6D3.von5CaGYGDyBDXdmKB6BcVeVQzk1tYwa.H9J__XGPNc2GJopZx3Y02_10B4BIF82pLIXxhX_ 42boNP6tss68SaXNsTE99UFOj9JBLjc4GCKSDIwLLNFeb346q3j4FF0AhxOloHsiKlvmXGXlo3Qo NxNsAdu3DnrMO35483GWSJUNHPvIYNM.i5SlCWE95pwLzxTH8uUskJNpbkYF3DcbMfdpE28bneUK oiLwyu6CMp1hwS6dBSItLyXxEBWcLBlf8t9w_7kp64oSiEALgetkvOYXSaM3KJMcuBWKnQ0a1gD8 GmMDNEL_DRQtGsCxNmM_p.VDP.XBSOOPhiApAlFi1UtvHK_IwACbXVmgdeUYBm9uCp1IZknW5qus ndduKh2lNdnphvmzm3x14bUdMpghhJkNzV6kBxnjON.k8kAVjfLNy1Hhd820MNroWjp0BFjLNs3K O1.CgyZX58hZD.aNH8fsJArhmYuo4x_OHfMQvBvtNVwV_ls18OhI7UpP17JtbPtKdtsyAAgA7mCN LEAvO_IIYVr3y_peOkiVp5WSdnIgZ0YJN3LfjyynjlFuGcoATrcz2O1.koxPEejafDx7LoLdk06H iwjLEgpBG7VkhqoazihQP3lIvzHDAoOb2m47BH7_cBvfwFJZY5ng5G4JZl1vr3jLLQmLvtsNeRSq 7hBTDBRPWC_9o9Ea_f1.z2dw9aW98o_jIwtnb4qDflOnwqIkCmNx93uKUJp5n2OCEbyYm_aGWZtX S8dOLJ42qUrjtlXdyTHrwaje1A8OQOE4gCbtbEqO_BA0UcywSD38kkKDKfD7DD6GR.xaeyYQyEm5 gwCmUUKKJrXFBdPJ0OMoK8EIS.ghW2Uk79.2Luz0KtjeCFwvJmHcEvdXruK1J1bQdQg2gT0MS7r0 UqGf4coEdnFsDsLIllZiQ2nS3TfQ5Ac8VMb4nf8KN8HiOrucoZGesslks166WkSJY3fGeBZDmS.Y iS5w4RRKNq4G7DPd5nH.zZJetx6VyTtopgLxMSUJWiSLZs8gFgrbvCljy9oySC.Jh8IGjV1Ltjnl bjCU.IJbIpXo1zetOEAcGBI3atVmY.849jnt6qdi.BXnqgkVULAxv5CTK6EqJwjDcPdrwkQk7Tnd DSOWA0nPcnfrynG.SfrmxpRatqJbNtSNInZGfn5a.3MyZR37WTLePUKb4S9rvTa3Lv9Y04xTqkCq OpultnUJkNNVm1exjiRzOaeVr5pUScZQayJ5CnK8gC8DxsUZ93MhUPKo3ctwwiyc76TWrIW3JJX7 zscq.m4hCxgba4V1lBwre3.w9y8iMbRuYsd2WvZUWOPqy6UjkhZHBa8AN0TdWPwkEMH38lk2gpDY 5hO4eiWz.xeWQobdK86FZ2ParI9XpBr59QGnTrL3xdU.Pu1_1cAzYrzeeeBoMpo8pKiRHMV6_bj1 Ugy_xxbEkWRDVbDGVK1AwivTn4V6xa_uEH3goGvMFBtq5N7M.128dRWviEhx2V09h8D9rU_c2baq nun8q4iQk9Dfx7kqbHizQyxMddUsQAgoAILSCKzMP2JFOfhN9_W2CuSVyMx0Ufo0KhNmay9FjqTO 3gs.V2FAVjyPZ.znTi6ViaVcyI1p9HLw05MjBi.0lim1Flx_vEnN4EuzsXB4gRW6z6FXy2F_KF6J qgrAU89TDzdSVkra9.8qq.C2Z3WUMKnesczTS4OJ2hqUKV45Ya_0.0KVipnlzWlDeIWGf5rC05ft 0oPLB_iUVXuvG1Pbj508WKd1oTN2tjD9u2k0OB3jREjiPyVTbE3FMEu.6NW7BaMegdyn_LrIIyA7 .nyKMhvmc09s1PoQKWgvv01V5.ZHK.KOvwBpXzSfbkEU.RmA2m7G2k0Dzk8GsIimsTWvkyvIkSFk vXpIAk_RqstMwzBOZzGongsjO_3sd7deLZVDcU_5iEQAV6FAam3NrZrYsj12iM6X5zRycHaCdStP siTpdXHKzoC0fxuP_US2S2mpJwUVOrqRa4eSMcL8xj2gCz8HkILanV9XY1PPYNQTiXVDE.AAQlfF MxPZqLqZw8BvVtW8EuLxX3PODetB4yr8H9euiHYFrc9WXVrAPPYY9N7_TCAI- Received: from sonic.gate.mail.ne1.yahoo.com by sonic314.consmr.mail.gq1.yahoo.com with HTTP; Thu, 21 Jan 2021 04:46:33 +0000 Received: by smtp425.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 209cfd8f6f68de0991eb03b51cd3fcc5; Thu, 21 Jan 2021 04:46:30 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.40.0.2.32\)) Subject: Re: Silent hang in buildworld, was Re: Invoking -v for clang during buildworld From: Mark Millard In-Reply-To: <20210121023358.GA58854@www.zefox.net> Date: Wed, 20 Jan 2021 20:46:28 -0800 Cc: Current FreeBSD , freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <8D0C2A4C-B616-47B9-864E-D846A6EBA3D6@yahoo.com> References: <20210117174006.GA30728@www.zefox.net> <85889EAE-F579-4220-9185-944D9AA5075A@yahoo.com> <20210118015009.GA31353@www.zefox.net> <60CCCDE8-E3D3-4920-9FC0-A945330F6830@yahoo.com> <00104FAD-E32B-4DDE-80DD-FCEF14CEC06B@yahoo.com> <056845FE-7131-4951-96AF-805D07F7BE0D@yahoo.com> <20210121023358.GA58854@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3654.40.0.2.32) X-Rspamd-Queue-Id: 4DLqbv2clVz4s64 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.84:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.84:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.84:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.84:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-current] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 21 Jan 2021 04:46:36 -0000 On 2021-Jan-20, at 18:33, bob prohaska wrote: >> . . . > A first OS build/install cycle on armv7 (RPI2) using meta mode=20 > finished without trouble. Sources were a day or two newer than=20 > the kernel, -j4 buildworld took 157121 seconds. Peak swap use=20 > was half again as much at 732932. No constraints on ld.lld=20 > beyond defaults. I'm a little surprised at the extreme slowness, > but this was a fully-debug'd-current kernel and sources were > slightly newer than existing world. >=20 > In case there's interest I've put what log files I could gather at > http://www.zefox.net/~fbsd/rpi2/buildworld/main-c950-gff1a307801/ The first META_MODE build has no META_MODE information from the prior build. You might want to have META_MODE do a build without updating sources and leaving the existing build materials in place. It would give you an idea of the lower bound on how much time a minimal build would take in your context. On the OPi+2E, for my context, for no linking-thread constraint, an example was: World built in 1468 seconds, ncpu: 4, make -j4 Kernel(s) GENERIC-NODBG built in 116 seconds, ncpu: 4, make -j4 So, somewhat under 30 minutes total. (There can be some things that do get some rebuild activity in such a build. Lots of things can end up relinked, so .full and .debug and such regenerated.) I'll note that for META_MODE to work well, you need to keep using it so that its records stay up to date as a description of the build materials that are to be the basis for the next update. Forgetting to supply WITH_META_MODE would not be good for approximately minimizing the rebuild work done. I've never tried to compare how much more memory is used under a debug kernel than a non-debug one. My use of non-debug vs. your use of debug could explain a lot for both memory use and some part of the time difference compared to my reports. I've only used a debug kernel to buildworld or buildkernel when trying to get evidence for a system problem that was occurring during build* operation(s). QUOTE (from UPDATING) NOTE TO PEOPLE WHO THINK THAT FreeBSD 13.x IS SLOW: FreeBSD 13.x has many debugging features turned on, in both the = kernel and userland. These features attempt to detect incorrect use of system primitives, and encourage loud failure through extra = sanity checking and fail stop semantics. They also substantially = impact system performance. If you want to do performance measurement, benchmarking, and optimization, you'll want to turn them off. = This includes various WITNESS- related kernel options, INVARIANTS, = malloc debugging flags in userland, and various verbose features in the kernel. Many developers choose to disable these features on = build machines to maximize performance. (To completely disable malloc debugging, define WITH_MALLOC_PRODUCTION in /etc/src.conf and = rebuild world, or to merely disable the most expensive debugging = functionality at runtime, run "ln -s 'abort:false,junk:false' = /etc/malloc.conf".) END QUOTE I was using a 1008 MHz clocked OPi+2E. You may well have been using a 600 MHz clocked RPi2B. I do not know if there are L1 or L2 RAM caching differences involved. There are enough differences to not make the variations in figures from our runs all that surprising. I see that you kept the 2048 MiByte total swap space, so still exceeding the documented recommended-maximum for the context. Since it used under 800 MiBytes, it would seem that it would fit to use more like <=3D1800 MiByte to avoid what the documentation warns about for tradeoffs for having too much swap space. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)