From nobody Sat Mar 26 20:16:42 2022 X-Original-To: toolchain@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8604B1A3BEE5 for ; Sat, 26 Mar 2022 20:16:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-55.consmr.mail.gq1.yahoo.com (sonic316-55.consmr.mail.gq1.yahoo.com [98.137.69.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4KQqxM4M3gz3MhP for ; Sat, 26 Mar 2022 20:16:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1648325808; bh=6fMW0EMzBlkN/3lFVF+PmsHUr/WR0pnUSh2x1QGcXzU=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Q3TU51rg7tiNx8u+3tgomaaLHNgKhesDc1gI70TjIzbbscJIUrs/MD+8yunoc/mOin7AmxyQrQzAD79ejERUj7AwlysrumMXsOQUooMXmWcSe/UPfAKStHjFn/q5UitAooX9TJ3Auko65ylLYLbamFqNJ3I6o9b1IJdlIUwveu9K9/Ek1302CxZsVvEQM4SKEB0vvq4c3g4kdR9elIhPvWT0Ay27D3AaMnQzrls1SXi9JxFUPFnbFehg0Dz/GDEqPiauvDnqPfM6Yxv/sWUTyVuK282F3r19ZfOhdvzcoiWH6dkta2538Qh2/gvMFRPOfa4J52+yTAA1/ul6OQS3DA== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1648325808; bh=Ld0Jdwuk0pjd3fFchGMbNLgjqLBsNn+2FHuLDfEtPsw=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=Sp6etxeh3gqdh6bK9ckjQWtTJO8ToZy+TXvfEY1/MlNsp4iUC0UyNI4hpY7AROCnMQTqsjqP81bOh2BPyWhYPVUBbnwFk/J6ha5kXLA8O2cI1lieQicrY7C0sOQW4mso53PHyjuxW2fSW0WmI/cwZVrPaMjX4BDtlrhcl/qLEiQATc0IC5NLlz8lldnh9GQwXUHfmUBM1Dj3sQUSn4upgQCBgzYMb3iLrKJWvea3tpDpC9YZu+cvBfR8dgJvyq468DSsROnxE+kuyWNDappcG1vGRxl48nTA9TUoOpz6byKrDLM34hIJkaxsR0w3oBoeKC32xhbXuwC1jPa4MeGUQQ== X-YMail-OSG: EMJyEPQVM1maZC8roY24ohcX0yl7vZhSDpWkwEXdRKVbmLTGjY3gfZa7Zgsuqga odO9DIhJFegYfc48yOrJt8fz3OBrXklNyVvAW.Lr5cV9FPm4N26zoFtSm4VZJJ8vY5lPxwIq8gVm O6yE55ugLioyxfrzynOneI7cAKFAqqcHMZ_mLK_bqR0iFa_Fc64VIRAY1zTX40vxIgMp83XeG7GL oTRp8LW.lWr53nzcEyv43DO4Qovn2DkwQRM4zI2qrbDW4DD6Lm_lOnlbxRHTKYDPqg6rmwtjuBql JdQFw6K1Dgf1V7SlyAyTaYd5wE8aY9YqpuS_6dQNO_6ZrAyRRfnpiRNAtXwyssamcki4FKljSfhN 2aEqpkP4dqejBi9KS9FkhqeTXxGPS6r3QkfwhpU89QqEhrFD6DdeJ9C2w46.xqavBkSEm83HqNHj r4VEDdro6mZzTHxTd.ViMRLqN0ufdEuyWzqvMlEtGKo73ub3dY0doj8DmA_g2U0dNuF3momQsWsh xnu7AoerrdRmJYMjeRcVqymUB2D1r8Vkz8RmlMZmXDST4cz1ePnbHm1rm20K_ot3muNrZWx.ogXF ag6RcWtXad.KjId7qp_kwPacRWHPcLn.OsDJcSHvcVYR68uYc5bpz9JtX3FTkoIjduxnyQGJK3yi HZzMLbhBY9V0nW4L83K7VBKXjJk1JuP0SUO08H3uBqerw3e4LxO4kVk9qPSxuMzPFNm4JjxT1Fou osv4ycNEkpBhQVSpXiknCcWcmIOgPM6mo0BKiMUP_k9JCYOgX.3s5XVZi4O_zwOpazZmCAibLcsi gSPWB9p_J1IA0Z3OMyJWuxJKZBReRT9COZa_0ZMBuMkK1h2ldqeR41AGGo0GA1.wA2K3vdpS5j1i EHPrSdzVursnwHyJom3Zds9Lj9HonGFv_4wLA86Js6xTIhrAmJwLt_UXR1dsdUdXHEmqEp9H7Vo9 iNltQZvcwG.2UrQdOKHFjhzr8l9Q84GDLhVtHryTkRPOXvsgynaghgs_7YnO6jlR57faoQ331Y_d Na0GKpZ0JuIc6jbJSX80YPZjBA.iJplBO11uGOotw_soa7W.AQbNhk8i.NKu5mJDweDY5yZ0Wn93 N1UzankNfxodq8jxc7kGXBQ.xGgq4cB4hr4pJJkPTbd3OCTPswF7.4SBRrdKm5XcsSOZpfBS6D9I UqoCxivvvk4Uub1qmLGnL9.OecVqWgrXxgyVIH7NzxnuZ2wNM6WdFO8Fy53OgHuIUTbexU9Jyq8m CQ0hEIekZIvW5m3xVyD.rCk6h14tapUYH7db7l_Rf88xzCK4umsQER5t_ybth5LCg9hRBjBfKA9m poPOFtaDjlhtwF_X06J5CduerJ0tPcOf3dTR4hAtkeyo73qq21gmINtPmPnBzs2lHrUYI3Pfe4sI dS_vHn4Xqu6faUz3cU0Jy_IWqeXDQ3L9DACJc3zZrlrHP4dhfHtV7JJKQI9YAP0ugPGY_XOCAfeZ 39pWH70WiNSwaAJ5JAxQbM2o_fMKWvkoh6hNwGgTPmodnAPWp0o5pH.buBiG1U2w9PtueazYijCp ..c1RqCVtqd6XtvorqqAzcXBxjj3eDC98PDyD.yq5_3bLMrhY4do7uUv6nffSFSMilwFFJh.iL1D T7IfoGY5ViKsIGB9lCAJYIwRltAXsCMiUWOpM2PkUz9fkyZymo5gCph.MP9sZW.eXRoIdf41r3yy VfKR2CH2uoZLKDX.VscyB_.N8EZt27xToN288EJ_UFWSD3wKOE5ldGsJQF6LbPJKIw_YW4vR.0KA NzlnB9SlpuPXwXTXDYk9y2GIj.uJvqkGSTuNpk2olOdxD_mLU0wg71TLAD7spME2iHHwiKXRkhX5 zh24OkbQ_XGH2h6GpbCZVQ2Glq9XDkeM7hACP4_oEv9yMXxs5SWSoRp0GPdHVWgGoSso2jT5gDuS 2B_NgxADRdXyadTM2i4CjLPYsXSlRYO9yzta4syXH0ihTmuICzTs3ziWeWNKJhRkNosGC0BmU1wI FoBa.Gknr8ehGmsdi.wwC0qz0OXr3QfOe8JzO_lSMVDjpC51ca3NGcdJwzv5BiQFfO3MU5ioXXvW djE_YA6oqAAiyz2ftEcCrEDffts3aP_R3mpf7IwhVmhb61dUMFWswvii.sOSzFdavr.UZSdUOF2N W9v3Nth60sv3qI_bt.KlxQyyHuHgNsUOOF8fy3PwtK1d0_Ux8mTDG5sCYeanhyzwj6M1iP6XRNFN a.5_4wZ4tm0FyyAAm0il2NNLVzoaNykdJzLPxYyrgFzAa0Tg5FJDMNSATvibfSOgiICzpdPAHZni ZOvZO0mhn.1vCqiPyqbAD25jCfNclUT_1qi2Z9FgbeYNgmk.qQm3WRC1SgPLOdis25BMg6ItAdAa rd3fDpjhAMKq6LyCye6OqfKiwDSobVsDp2Fa8jgeBiHzxSOPhvHBMbbYvzQ-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Sat, 26 Mar 2022 20:16:48 +0000 Received: by kubenode546.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID f14185ab09ff04145acb3f312dcb1e8c; Sat, 26 Mar 2022 20:16:43 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Maintenance of FreeBSD s integrated toolchain List-Archive: https://lists.freebsd.org/archives/freebsd-toolchain List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-toolchain@freebsd.org X-BeenThere: freebsd-toolchain@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: [package - 130arm64-default][lang/gcc12-devel] Failed for gcc12-devel-12.0.1.s20220306_2 in build/runaway From: Mark Millard In-Reply-To: <21D1C2BF-151E-4252-936C-B5B22C9C8071@yahoo.com> Date: Sat, 26 Mar 2022 13:16:42 -0700 Cc: "toolchain@freebsd.org" Content-Transfer-Encoding: quoted-printable Message-Id: <75A61EB5-70D1-4E1F-89D2-524407854D6F@yahoo.com> References: <202203261416.22QEGtRR065106@ampere3.nyi.freebsd.org> <21D1C2BF-151E-4252-936C-B5B22C9C8071@yahoo.com> To: Dimitry Andric X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4KQqxM4M3gz3MhP X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Q3TU51rg; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.69.31 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.02 / 15.00]; TO_DN_EQ_ADDR_SOME(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-0.99)[-0.988]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.53)[-0.532]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.31:from]; MLMMJ_DEST(0.00)[toolchain]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.31:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N On 2022-Mar-26, at 12:35, Mark Millard wrote: > On 2022-Mar-26, at 07:26, Dimitry Andric wrote: >=20 >> On 26 Mar 2022, at 15:16, pkg-fallout@freebsd.org = wrote: >>>=20 >>> You are receiving this mail as a port that you maintain >>> is failing to build on the FreeBSD package build server. >>> Please investigate the failure and submit a PR to fix >>> build. >>>=20 >>> Maintainer: toolchain@FreeBSD.org >>> Log URL: = http://ampere3.nyi.freebsd.org/data/130arm64-default/60ab72786154/logs/gcc= 12-devel-12.0.1.s20220306_2.log >>> Build URL: = http://ampere3.nyi.freebsd.org/build.html?mastername=3D130arm64-default&bu= ild=3D60ab72786154 >>=20 >> So there isn't any actual error message in this log, except at the = end: >>=20 >> ... >> =3D>> Cleaning up wrkdir >> =3D=3D=3D> Cleaning for gcc12-devel-12.0.1.s20220306_2 >> Killed >> build of lang/gcc12-devel | gcc12-devel-12.0.1.s20220306_2 ended at = Sat Mar 26 14:16:58 UTC 2022 >> build time: 12:31:35 >> !!! build failure encountered !!! >>=20 >> It looks like the last command being run before "Killed" is the = cc1plus >> executable being linked with LTO, so I am assuming the build is = killed >> due to an out-of-memory condition? >>=20 >> But this is only visible to people that have access to the machine = the >> poudriere instance is running on. Can somebody with access please = check? >>=20 >=20 > I do not have access but I've started a poudriere build > of my own on a HoneyComb. I've a patched top that monitors > and reports various Maximum Observed (MaxObs????) figures, > 64 GiBytes of RAM and slightly over 246 GiBytes of swap. > So hopefully it will report on about how big the memory use > gets. But it is allowed to use all 16 cores and there will > be no competing bulk builds using resources. So not a match > to the build server context. >=20 > Note: It is a ZFS context, so MaxObsWired is normally large > and shrinks over times where memory needs to be used for > other things. So the primary memory figures would be: >=20 > MaxObsSwapUsed (if any) > MaxObsActive > MaxObs(Act+Lndry+SwapUsed) >=20 >=20 > Side Note: >=20 > = http://ampere3.nyi.freebsd.org/build.html?mastername=3D130arm64-default&bu= ild=3D60ab72786154 >=20 > reports a Time of 11:48:41 but the log reports "build time: 12:31:35". > My guess is that processing the log file for extracting the type of > error makes some (much?) of the difference. (Type being = runaway_process > in this case.) >=20 >=20 I did just observe a cc1plus take somewhat over 30min of CPU time before completing and the lto1 related activity starting. It was under 5 GiBytes MaxObs(Act+Lndry+SwapUsed) [No swap use observed] before the lto1 related activity started. For the lto1 related activity MaxObs(Act+Lndry+SwapUsed) has, so far, gotten up to around 12 GiBytes, still no swap use observed: 12079Mi MaxObsActive 12278Mi MaxObs(Act+Lndry+SwapUsed) I'll note that: last pid: . . .; load averages: . . . MaxObs: 28.02, 16.88, 15.82 . . . threads: . . . running, . . . sleeping, 77 MaxObsRunning So, on the timescale of the first load average, it does not always stay limited to the hardware threads available. No process with sustained CPU activity sticks around across the lto1 activity. So I'll not be able to observe much about cpu time. The elasped time doing lto1 activity has been going for a while but I'm unlikely to be able to observe its end happen. So I'll likely not have a good clue about that. =3D=3D=3D Mark Millard marklmi at yahoo.com