From owner-freebsd-stable@freebsd.org Wed Jul 24 17:21:37 2019 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 0EB4AB29C9 for ; Wed, 24 Jul 2019 17:21:37 +0000 (UTC) (envelope-from mike@sentex.net) Received: from pyroxene.sentex.ca (unknown [IPv6:2607:f3e0:0:3::18]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "pyroxene.sentex.ca", Issuer "Let's Encrypt Authority X3" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id E5A9E8FDBC; Wed, 24 Jul 2019 17:21:35 +0000 (UTC) (envelope-from mike@sentex.net) Received: from [IPv6:2607:f3e0:0:4:4d5a:b467:255f:a544] ([IPv6:2607:f3e0:0:4:4d5a:b467:255f:a544]) by pyroxene.sentex.ca (8.15.2/8.15.2) with ESMTPS id x6OHLXHM084755 (version=TLSv1.2 cipher=AES128-SHA bits=128 verify=NO); Wed, 24 Jul 2019 13:21:35 -0400 (EDT) (envelope-from mike@sentex.net) Subject: Re: Buildworld times (was Re: svn commit: r350256 - in stable/12: . contrib/compiler-rt/lib/sanitizer_common contrib/libunwind/src contrib/llvm/lib/DebugInfo/DWARF contrib/llvm/lib/MC contrib/llvm/lib/Object contrib/llvm/lib/Ta...) To: Dimitry Andric Cc: freebsd-stable@freebsd.org References: <201907231840.x6NIeWeq024894@repo.freebsd.org> <0CB72C19-405C-41F0-8967-96F363228ED6@FreeBSD.org> <8373E39A-46E7-41AB-BC1F-8CDF65F47287@FreeBSD.org> From: mike tancsa Message-ID: Date: Wed, 24 Jul 2019 13:21:35 -0400 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: <8373E39A-46E7-41AB-BC1F-8CDF65F47287@FreeBSD.org> Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: 8bit Content-Language: en-US X-Rspamd-Queue-Id: E5A9E8FDBC X-Spamd-Bar: / Authentication-Results: mx1.freebsd.org; spf=pass (mx1.freebsd.org: domain of mike@sentex.net designates 2607:f3e0:0:3::18 as permitted sender) smtp.mailfrom=mike@sentex.net X-Spamd-Result: default: False [0.59 / 15.00]; ARC_NA(0.00)[]; RDNS_NONE(1.00)[]; RCVD_TLS_ALL(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2607:f3e0::/32]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[sentex.net]; NEURAL_HAM_LONG(-0.61)[-0.613,0]; LONG_SUBJ(1.70)[227]; IP_SCORE(-1.72)[ipnet: 2607:f3e0::/32(-4.94), asn: 11647(-3.58), country: CA(-0.09)]; MX_GOOD(-0.01)[cached: smtp.sentex.ca]; RCPT_COUNT_TWO(0.00)[2]; NEURAL_HAM_SHORT(-0.99)[-0.988,0]; NEURAL_HAM_MEDIUM(-0.98)[-0.984,0]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:11647, ipnet:2607:f3e0::/32, country:CA]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 24 Jul 2019 17:21:37 -0000 On 7/24/2019 12:02 PM, Dimitry Andric wrote: > On 24 Jul 2019, at 17:12, mike tancsa wrote: >> On 7/24/2019 9:45 AM, Dimitry Andric wrote: >>> On 24 Jul 2019, at 14:47, mike tancsa wrote: >>>> On 7/23/2019 2:40 PM, Dimitry Andric wrote: >>>>> Author: dim >>>>> Date: Tue Jul 23 18:40:32 2019 >>>>> New Revision: 350256 >>>>> URL: https://svnweb.freebsd.org/changeset/base/350256 >>>>> >>>> Hi, >>>> >>>> Not sure if this is just a difference in the versions or more things >>>> are being compiled, but I noticed a buildworld on my Ryzen went from ~ >>>> 31min to just over 40min. Is this expected ? >>> Most likely this is because it will now build a bootstrap compiler, >>> whereas previously your system may have skipped this step. Can you >>> compare the results when setting MK_SYSTEM_COMPILER=no and >>> MK_SYSTEM_LINKER=no ? >> Adding those two to src.conf and make.conf still shows 40min >> >> time make -j14 buildworld > /var/log/build.out ; time make -j14 >> buildkernel > /var/log/build.out. >> [Creating objdir /usr/obj/usr/src/amd64.amd64...] >> 25312.621u 1237.984s 40:09.72 1101.8% 45579+3473k 656666+3288880io >> 214633pf+0w >> 1675.467u 173.497s 2:37.90 1170.9% 37728+3167k 207118+3329460io >> 61829pf+0w >> >> Should I be setting these vars somewhere else ? > Ah, setting them in src.conf, make.conf or the environment will be > overridden from Makefile.inc1, unfortunately. It will then show > something like: > > make[1]: "/home/dim/src/stable-12/Makefile.inc1" line 343: SYSTEM_COMPILER: libclang will be built for bootstrapping a cross-compiler. > make[1]: "/home/dim/src/stable-12/Makefile.inc1" line 348: SYSTEM_LINKER: libclang will be built for bootstrapping a cross-linker. > > E.g, it detects that your system compiler is of a lower version than > the compiler in the source tree, and will thus bootstrap the latter. > > Can you compare the timings when setting MK_SYSTEM_COMPILER=yes and > MK_SYSTEM_LINKER=yes? In that case, both before and after r350256, the > results should be fairly similar, I expect. odd, its still taking the same 40min  # time make  -j14 buildworld > /var/log/build.out ; time make -j14 buildkernel > /var/log/build.out.                                             [Creating objdir /usr/obj/usr/src/amd64.amd64...] 25281.564u 1233.340s 40:31.08 1090.6%   45595+3474k 633698+3288574io 213653pf+0w 1675.796u 172.082s 2:38.19 1168.1%      37746+3170k 205909+3329072io 61654pf+0w Looking at /var/log/build.out, the top line show # head /var/log/build.out --- buildworld --- make[1]: "/usr/src/Makefile.inc1" line 343: SYSTEM_COMPILER: libclang will be built for bootstrapping a cross-compiler. make[1]: "/usr/src/Makefile.inc1" line 348: SYSTEM_LINKER: libclang will be built for bootstrapping a cross-linker. --- buildworld_prologue --- despite # cat /etc/src.conf /etc/make.conf MK_SYSTEM_COMPILER=no MK_SYSTEM_LINKER=no KERNCONF=server MK_SYSTEM_COMPILER=no MK_SYSTEM_LINKER=no