From nobody Sat Aug 19 02:09:10 2023 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4RSMcm6l4Bz4g4nf for ; Sat, 19 Aug 2023 02:09:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4RSMcl21B0z3RHk for ; Sat, 19 Aug 2023 02:09:27 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Qv4PUjb7; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com; dmarc=pass (policy=reject) header.from=yahoo.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692410964; bh=qg22xNyQepmNaljF8gUhYKG+OpZ9ELPN5yKCOvJ2QSA=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=Qv4PUjb7C0zMZQ+IbvS5uCD6ScaOY5TePQEerKm7qFFH7tHKhBGAgHtshHJkizm2XvlUcFXNBBmg20HGBuOuHP54wICClPFG+Behzywy0iKwdG3BWZBwnUsYBI7v2PDF6Wyft+GG+06f5smGCLKd1xyLfcsILTEpZh8bDOkigIlkxH2dY3crm+XTPrWW0/6r7zXwxwq3wq3vAJWau8R16OAmW3a6v+JhFI5r6R9uW4kBq3WfV1nvn+OSUec8uYMPuHu7xkrBxnZuFW89kvLsGYpQqZDvZdb0jSWfEoYO+30ycGF7uvaq9cORuQ95cou5wcEisgzjbbl8QsQ7VgikTg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1692410964; bh=QNT6lAoANQgG2sDHTT3F5VijVNjiG90wfAxrmGXZX4C=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=eLil2h9R61tZ7UYFSlizeNEPRvtvJ1X3Y6JBXzbyrU2AYIhnuInDLZp2vNWOmTcQlkKg/yrMaRXB8I2tV0DuQe4ZDBVDomJHLlEb3YR2vD5Ar08qjLF5UwGqwAohyKtuwbIsMW/I6BxJuGmCXWWxZ289WAtjz3zOchqxlqVSQR4QWO9Q032P2wLmYk4uoAEliepKO3WrSiam9kNgFCBJQcZXgtvx4aHloMkxgmlDs87eHjLUGpDjrYEOGCbcf/te2qdyLfk8yi1nnrba69UZP+uboyQ3e269HIycbFrg95JvBACD5b848lPw84rjFwRSXCOPczWGIw+Cln48KKI7lg== X-YMail-OSG: iNdv0ooVM1lQmFvd1fKH4uHTm5I6SsOpFfxM4ZpVxCdqaFLyY8zxNt5CD6dBuev xR1pNC8RMh9bI5SYP8sJ1_o3LbRU28gHK4_vs8aKag4cm.q56ps6DuRpt1KqKG.xW53rE9nyLrhO zbDQyJJGNWWDaXxPuNCXrW7nNDSR1u0LgL6yY5uCosGUyM8JLU0mSMrRbUyuRnyHaf2o99afo0CQ tmgpn_oogEpH2UZXARPRNPZiIy4SiUHIQOhtRzPaWewxZWELTTi.URLFDb6wJqWGQPOxn1UHyJW4 2DTnuuyfV0eS6WFenxuRMxUFhPpLUq8ZiWDIHUyYGd9o9q6IpWsfiYhlpN_eTZlwsWjecE0AYNA5 RMgRYp2Z7KnA66pCaS.smsjWi1AGU5CRQc.alv46Xy5kRPOi87IO1rYSWSC4IAoDz0g8Nq0UtGNu la0_eYSyE9l330jqVOrHG8M.Srr_yIGdrJ0I3VCrhaGLP8.ll5TyP3MhKHX0F8UZ4qFZQgqKycKj KTRqV3VML3zf3swvYmJY4vjdXVeIYx7ZuzZHblhiTTGjtFOhk.GQV5eawJw9UMUeZQdGUOEBkzHs e.HkCqbzKueEvttY8IIoq2LGSJuW_XT.Nb2TsbqkUdFZEnEgq9Hqr20unwIYzD7ijjAhlVwXLXK2 XCtuu1SksQYcOBoClhqIJsF2Gn8C0m2KqIV6zWf5M17LFa4hJs.p8vZgXy9XT_VWgMgXmoDh7Akp mRHpZFJU_r9ukN7LFITZywOobSXjIZOoJJTwnnwjX34B5PrjmrMC6OoqPGR7ri7d.dN5oDu3A2hP a213VUaErM6fsl2M0FM2SYFgJgtdAenKCQ4.P9MeCrfNBmi4KHVKL.pVCXVOf6Ti6SmG18DAeOqV xM.j2w6J_bRBMyGNYf5RqB_oGznAe_XuAfd7NX2RhC7izIvbUUcZjJzNe0_BoDRNBTdI8_hDvaze dVtAwvDJ_jzdsOZZh7paK765Gl36iyq_amiNDZEgNszdtBxzAiPl7dCTikfadf57emZ0o9clLkVF I.JQCNV3E32Xl4MayRvvm56P4ot11kpfc.V2nd.szH6KQHX22dQ_lJW0p0fAFNe.rMOfQkPVZDcW QeUgiJOu9iEsZkxSPZerccc0WAKFIC_xbGSaVd.3JKTv0KSQQVX7Ii2HDwNkrPlGQZe60RBD9.kd jYj7TA3rHp_7rby7xlmNeZwjzHD19RQcTU4PJxlPNxPsONYCBDpikUfpfA4nghTGl57XhV_eja8i pRe_8yboqgfX1xbZg9rAgmhDKQvl1Lp5YcriVhf9gmMuNboS9pnkka5lnUqrG_2DaFsCLveaJRTH 94dF.08A5hH1YB0emsDnFsRA1n.yeLkOhIZ1AQluQ0ayaOcZ8AdHIgKVordwJy4xBdmRQvFDZKUq vr5GnoSuxHXVV4ZeVzB4Kv9trv9lMXOhoIbuCCSNRqqMsmNWdyc8HHOybcZCNOfsCRwD_6pf4zGx 3vT5VpEZ_KV39hdexKVAh9WUeTJkDisCVhembm8cv.UUjmx.zZ74y6gCMXNYxODY391GqNEnSj96 GqoeAIn6foS3CTBm.pRnVgkrklObSPzGU2LwIPbGRz0cs_O9T0Ln_XDlezBZdrNkkqDuS7QouwWu xQ9W9j8cPcL2LpWPFdHEnsCavoLlDAoWEWwHk9r7kYfWU_d22fG9zukPz.9bbw64UuyuGMu.d7ZT 90OdHBmST1G5Cczs3aMWmeDIhLfgUIolLTy_JpE947CQ57m69t3e24mh0KteslKKrEVsoeCGHlng PQdGQMlYpeL5LtYVajixAHpQCYO4Ol8TsmHImG9B4IF2oOfM0ZEu4zgXwR9VhfIFotg7JK8AEzm_ tfPyLghUJhIBAQANNqzreXEz7gGAyhgAeoEsYhhxHuGV6hDMshKROXHN3LnZ5eFGcQaP0qqW5QwP Q26NdAXwRxkcqBH1g7esN6VGHU0z7Osc_37BxouKK3mdD5PZlPkcgFeZvWAkbW.BvA2SLRRv_PKN FjFjdW2l4GPWOd5JPDxIGtlb5bjOJZjZtY1NeljEbvkORtMas_JnEMohB7TfPKG9ACR.ZOBofM9W Wx0lDtga29qDLYg0HtCHElLBxDkaHaoOYaHfq2_4m6iFDj9x.GqwjAcMtbj.8AxDU04eXUMjTEMw iTSWGRJqb2YynE8BQTZT7C7I7zcz4CVUaCgyGsbMYkMnRuUSjfYIziH9YaG49c9Z2FTG8oEdb44y ncrwpV44icgshYQvIbxPqLuI0WN6t8sN.LTpTeFS0U3P0AqGpj6xAex8MOlcH.W8nFQHLtg5oUaj j X-Sonic-MF: X-Sonic-ID: 667af094-968a-4eac-9a05-e67f2bac61f2 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sat, 19 Aug 2023 02:09:24 +0000 Received: by hermes--production-ne1-7b767b77cc-27nt8 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3bd7c4e696cc0fc53140f24bb44348a4; Sat, 19 Aug 2023 02:09:22 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.700.6\)) Subject: Re: Possible regression in main causing poor performance Message-Id: <8A267B4A-1B7B-4D61-AA57-8E3156470617@yahoo.com> Date: Fri, 18 Aug 2023 19:09:10 -0700 To: Glen Barber , Current FreeBSD X-Mailer: Apple Mail (2.3731.700.6) References: <8A267B4A-1B7B-4D61-AA57-8E3156470617.ref@yahoo.com> X-Spamd-Result: default: False [-3.50 / 15.00]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; MIME_GOOD(-0.10)[text/plain]; FROM_HAS_DN(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; ARC_NA(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; DKIM_TRACE(0.00)[yahoo.com:+]; TO_DN_ALL(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MID_RHS_MATCH_FROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; MIME_TRACE(0.00)[0:+]; RCVD_COUNT_TWO(0.00)[2] X-Spamd-Bar: --- X-Rspamd-Queue-Id: 4RSMcl21B0z3RHk Glen Barber wrote on Date: Sat, 19 Aug 2023 00:10:59 UTC : > I am somewhat inclined to look in the direction of ZFS here, as two > things changed: >=20 > 1) the build machine in question was recently (as in a week and a half > ago) upgraded to the tip of main in order to ease the transition from > this machine from building 14.x to building 15.x; > 2) there is the recent addition of building ZFS-backed virtual machine > and cloud images. >=20 > . . . > The first machine runs: > # uname -a > FreeBSD releng1.nyi.freebsd.org 14.0-CURRENT FreeBSD 14.0-CURRENT \ > amd64 1400093 #5 main-n264224-c84617e87a70: Wed Jul 19 19:10:38 UTC = 2023 I'm confused: "the build machine in question was recently (as in a week and a half ago) upgraded to the tip of main in order to ease the transition from this machine from building 14.x to building 15.x"? But the above kernel is from mid July? (-aKU was not used to also get some clue about world from the pair of 140009? that would show.) > Last week's snapshot builds were completed in a reasonable amount of > time: >=20 > root@releng1.nyi:/releng/scripts-snapshot/scripts # ./thermite.sh -c = ./builds-14.conf ; echo ^G > 20230811-00:03:11 INFO: Creating /releng/scripts-snapshot/logs > 20230811-00:03:11 INFO: Creating /releng/scripts-snapshot/chroots > 20230811-00:03:12 INFO: Creating /releng/scripts-snapshot/release > 20230811-00:03:12 INFO: Creating /releng/scripts-snapshot/ports > 20230811-00:03:12 INFO: Creating /releng/scripts-snapshot/doc > 20230811-00:03:13 INFO: Checking out https://git.FreeBSD.org//src.git = (main) to /releng/scripts-snapshot/release > [...] > 20230811-15:11:13 INFO: Staging for ftp: 14-i386-GENERIC-snap > 20230811-16:27:28 INFO: Staging for ftp: 14-amd64-GENERIC-snap > 20230811-16:33:43 INFO: Staging for ftp: 14-aarch64-GENERIC-snap >=20 > Overall, 17 hours, including the time to upload EC2, Vagrant, and GCE. >=20 > With no changes to the system, no stale ZFS datasets laying around = from > last week (everything is a pristine environment, etc.), this week's > builds are taking forever: My confusion may extend to this "no changes" status vs. the uname output identifying the kernel is from mid July. > root@releng1.nyi:/releng/scripts-snapshot/scripts # ./thermite.sh -c = ./builds-14.conf ; echo ^G > 20230818-00:15:44 INFO: Creating /releng/scripts-snapshot/logs > 20230818-00:15:44 INFO: Creating /releng/scripts-snapshot/chroots > 20230818-00:15:45 INFO: Creating /releng/scripts-snapshot/release > 20230818-00:15:45 INFO: Creating /releng/scripts-snapshot/ports > 20230818-00:15:45 INFO: Creating /releng/scripts-snapshot/doc > 20230818-00:15:46 INFO: Checking out https://git.FreeBSD.org//src.git = (main) to /releng/scripts-snapshot/release > [...] > 20230818-18:46:22 INFO: Staging for ftp: 14-aarch64-ROCKPRO64-snap > 20230818-20:41:02 INFO: Staging for ftp: 14-riscv64-GENERIC-snap > 20230818-22:54:49 INFO: Staging for ftp: 14-amd64-GENERIC-snap >=20 > Note, it is just about 4 minutes past 00:00 UTC as of this writing, so > we are about to cross well over the 24-hour mark, and cloud provider > images have not yet even started. >=20 > . . . In: = https://lists.freebsd.org/archives/freebsd-current/2023-August/004314.html= ("HEADS UP: $FreeBSD$ Removed from main", Wed, 16 Aug 2023) Warner wrote: QUOTE . . . , but there's no incremental building with this change, . . . Also: expect long build times, git fetch times, = etc after this. END QUOTE Might this be contributing? How long did those two "Checking out . . ." take? Similar time frames? =3D=3D=3D Mark Millard marklmi at yahoo.com