From nobody Sun Aug 14 16:35:23 2022 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4M5NLq0Wlhz4ZfjL for ; Sun, 14 Aug 2022 16:35:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic305-20.consmr.mail.gq1.yahoo.com (sonic305-20.consmr.mail.gq1.yahoo.com [98.137.64.83]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4M5NLp1m2Fz3rcN for ; Sun, 14 Aug 2022 16:35:30 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1660494927; bh=dOFa62iDxOFkKwQnDI4FwxFsvlC10afa1aMBY5qJ0Eg=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=Htu0sAp01RrokmlxGPRFPalhjgIWhUblo436vXiEdEgf8OhKuDplwsdWxkhiTzJJE3GSR41DRyOvkY172HZdqGizycMNmTRgtDNKE2FkXsODNSrhQ/l/R7av6YKY2j8dqfUsYD8cMMj+5wvcfy4Ilfn/p1ds5snZWXXRhTddwlgf2FBlAIudYisLk8U7sB0DFclZYVChWh+KzOqnJrLEH5vjs3DSkD/kjSYuzBl/PoabhSXhuUS2LdE82FmO1Zr3BCCd1owaZGWT2jVMRpNiJOBImdb44VeBc2JYZbaP/rLyrtGz4owpeO/lb7gvOlQ5Ej5Vjy7flP6KhJVWKaM/xQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1660494927; bh=BGDyS8DyXA4plodugHh+Q4dwAZ+Csv0mcP4v6COVkGK=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=pzChPvhK3M9FnJSn+dHD/y8o7uGOlMsbAN72v9o6anZ+EbcNfQxTJdrzOWM/HtrTjgx5CHOh8pKoS8GYMr8MBaq6CdEykbS/Kg0jIiq60O5fFPXMCe8EM3eh/EPRrEk+U9ogwcCyYTolBr9hnuOERNBJyTmhHuUbzWhH0CmHGxOJFJKS36ZIvukmAfi9YndTeiB0NnY0iw4ES1/Nrf4YgAdBgxRGHTPjuaxDnZye8iOiZO1lUIdMtaG83b5IyStQVdkH0V5oa7Hozyeybvm9j+ay3B/CCK8NjslDUXZSNORRJ62dZA9IosIVmWna9oFZZzsZ6UqN7Zo8vpxIVcAf9g== X-YMail-OSG: GJdEGmwVM1naRqr7wQbfYGXDoJxyKwNnMKm1FRWsLwdsP5tL2sbV0CRPONjLjfb KkQX9rXM6pg3t14nrG2BnqF5aLYYL8qkyujZ9FOBUPLR.RpVCHP2TfCNBjzRwpCa6V.v2mYJaKwE oAbGKvKmtkJItne2wFs6XxGQa2GHI3k16vF__XDOukZbGSW7PdcST8_OSr9zwjAmmvG5ckg2RNHH sX.FFABiALIRUCX19SXWDRbMZVzuPwKLbiS5MiXACHPGx0lBNgMLS5i_n_LAMzH7bpjErEtpxnri W8L0Q6KhW9H61DN_Yxt7JK_z3t2pY9T5kvQQe8LbW8SHptZcHMKn3PKDJ3Nz1etJL.slRzUw4x4g 52huHtKATxvfSatK1_xANcdnLnIofti9eS6ZU7oUH6VkIXMhFzmWxAny6H1IW2L8dOVcVkmJjvYM 081gsL0Dw.LjybqC9.Zae96T3.6Znn1grDmiwWwx.FeBRqajpzcsaLcMrFEfdO3mJqy7ORPWIJQh XTDT7GACDa5mXb1Rx8jxUtAkCcsy57EQ_f4CrSJmp54SFCuakKsbCW1dtdPovZMPm.OVDrQJ2Sxe w1X4tbkP_lFD9l7idShtJUY7oKQ6s54L9NVd9Aki0YFIpqSjjMRDIPWDaeyHKz4XhajWuZE2Kf1n R6JNttd7RWUnCukHuSpoAc1ixuyiEI0EwwWq7ia__eYoK0C4dsIAY9zQiK2L6dVXNb6zT8MekEwo EBSzsy4AI9cj2hI2dwzNtugjIdBjV4OG5K6LHkH1tX1BRrhPH6Oavue5kP9TJLWeM8b2dyJDl.1P mf8aTrd7fn9vHKH_N31M4YplaLqBNzGw5HrrpEnuZeDb97lw3ohLjjLbg82lcnBQr51GXLyswnv9 vx.8z3cySwpqvuegQHsmGidHGMUnrT4JdVBRU0NXE14GKHekW81UpLFLKtHWhriAAuTIO4L1DtpU YJGcPqxh6B0cIRpoCFi2RKsRLK.cPBw0TwoYBv3dILnOK13aDyqfZbCJcs1RyWLLeE2Y8hZGu1mW 56nqYPmJmoNlT6nvtRnD7CrRlCq5i_sksgizYIbqo9a5oZGkjAYksNbhKccR3mM6jw2FzFVSkVPM .PwZlFCVB9dIYMsolLt0c9L52OKYz.DukS9fnjUZl8U7QXehusAipMqpTLhUfKRjqlRFVcWrZMDq WvS4DQWWdLASPWaW63FygSPRad6OdkE8d5Wz8Okkll7gOtOgjcY0Njw6q37uyasN0cmNa07Fasl8 1S6DmxaBp6uz4GaPuRjC3XFoQMgaVDoDQiBWFIcFN.6VOecemG_aFeW25bYdrloL9KKm4ledgzpJ hJHChyQdNGhJZrMn.7PH_vd1DkbSyjrKl4QeoOawFhfJmn9_wDNUmTBR_jgKtaQBxKpF2H9jnC5D uIqCP8dFJKk_DNxIQy1DSUxuEWiGUkoR2CQ1x4_WvvEaVYhejh.xoyXY1nU_xtMRKE.Qpcm1rmMr 4mGhUTkHRtIRdQ6BqI96IkUhn56qV56SisHgQxUk7p9ltFMLnBxp0bprxkV90qoIP1dwv8NlW9zo qcsPxUHmfonVgSQKvgsWiyct928e3MpzJbgCQV63CeQttwcfSoG6JXchww0yb9XFIyHPSrz.Scko XwLDSS4A4MyujUmGFdU5_SoB8cTkJZC7Rlm8FcWNxtYL2Efs7ckCNYzhHFFIiRrloiK4e3W4Xuh5 NwV8cwv1IRAYM9H5rhSUikdbgdGkN.tL_ZvAodbvcBPU5DLUiGkNaeW3hzsQVHaXuc6rGYRz4NRp xGVfYC8TlZgJM5DrhJsDD7aH3i9_xgw4tui.bwPPHmSigorlHtVWhkRtnga426y9AvcA1834jTXk TFe74ngwptXZTm3n0Yvs_I8umI9.3TeysrakzENrozAroEZysyYXszLigClYz8m1GlznTxkYj27U qjqBjo2awlT5n0CNItpN7IXAlZbMEz0364kGpj0R29Py1C2rco71FzivpuuVXSJtmC84RFC_mIqK e5EO0BDtNR7JkerQmOiazBDQlJEZ2HYiGGkFeBnraN2O7b67CInVcUGs_fhHdJwm0G98VaMBBoRB ASoOhoo8u9REEa47cqzX0AgBuSn1BbEXXjlo1i8g0eB7DM4OQI5dxPMsEVXjpgrUio9H0FB5hcoZ k_tl1i0AIRWtKEO.8X9BNJltp4Qs1BOw.TogUFiE3S9d_mw_ZrCSLvDMnKa_zdmeYql4jr8pgvCu jin2UnHQ8mSj6ce9fHLjZyIJVpUz04uzjKld.M70dS1_FGS_Z0OmBeJxvTQOl0h7Tu4taknn4p1p E X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic305.consmr.mail.gq1.yahoo.com with HTTP; Sun, 14 Aug 2022 16:35:27 +0000 Received: by hermes--production-gq1-686964ccb6-vb224 (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 3151ea52fcb9eb1a35244ceebc2984c7; Sun, 14 Aug 2022 16:35:24 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: Resolved: devel/llvm13 build: "ninja: build stopped: subcommand failed" From: Mark Millard In-Reply-To: Date: Sun, 14 Aug 2022 09:35:23 -0700 Cc: FreeBSD Mailing List Content-Transfer-Encoding: quoted-printable Message-Id: <7CDC63F3-8B68-420E-8012-B1692667E293@yahoo.com> References: <1D4C14BD-8955-4B86-9C99-3E58D7603122.ref@yahoo.com> <1D4C14BD-8955-4B86-9C99-3E58D7603122@yahoo.com> To: Nuno Teixeira X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4M5NLp1m2Fz3rcN X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=Htu0sAp0; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.64.83 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.34 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_SHORT(-0.99)[-0.993]; NEURAL_HAM_MEDIUM(-0.85)[-0.849]; MV_CASE(0.50)[]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MIME_GOOD(-0.10)[text/plain]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; RCVD_IN_DNSWL_NONE(0.00)[98.137.64.83:from]; TO_DN_ALL(0.00)[]; RCVD_COUNT_THREE(0.00)[3]; FREEMAIL_FROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; DKIM_TRACE(0.00)[yahoo.com:+]; FROM_EQ_ENVFROM(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; MIME_TRACE(0.00)[0:+]; MLMMJ_DEST(0.00)[freebsd-ports@freebsd.org] X-ThisMailContainsUnwantedMimeParts: N On 2022-Aug-14, at 07:50, Nuno Teixeira wrote: Hello Mark, > I use poudriere with USE_TMPFS=3Dno, ofc because of low mem) > The problem "ninja: build stopped: subcommand failed" That is never the original error, just ninja reporting after it observed an error that occurred, generally in another process that is involved. A wide variety of errors will end up with a "ninja: build stopped: subcommand failed" notice as well. The original error should be earlier in the log or on the console ( or in /var/log/messages ). The "was killed: failed to reclaim memory" is an example. With 16 GiBytes of RAM you could have up to something like 60 GiByte of swap without FreeBSD complaining about being potentially mistuned. (It would complain before 64 GiBytes of SWAP.) 16+60 would be 76 GiBytes for RAM+SWAP. I forgot to ask about UFS vs. ZFS being in use: which is in use? (ZFS uses more RAM.) > have some time now and it's caused by a build peak of memory that = affects people with less than 32/64GB mem and to solve building it must = be build using one builder with one core thats takes about 7 hours on my = machine or with 6c+6t on 12.3 i386 that takes about 45min (123i386 is = the only jail that I can use all cores). Last I tried I built all the various devel/llvm* on a 8 GiByte RPi4B, 4 builders active and ALLOW_MAKE_JOBS=3Dyes in use. 4 FreeBSD cpus. So the load average would have been around 16+ much of the time during devel/llvm13 's builder activity. USE_TMPFS=3Ddata in use. Similarly for a 16 GiByte machine --but it is also an aarch64 context, also 4 FreebSD cpus. But I use in /boot/loader.conf: # # Delay when persistent low free RAM leads to # Out Of Memory killing of processes: vm.pageout_oom_seq=3D120 This has been historically important to avoiding the likes of "was killed: failed to reclaim memory" and related notices on various armv7 and aarch64 small board computers used to buildworld buildkernel and build ports, using all the cores. The only amd64 system that I've access to has 32 FreeBSD cpus and 128 GiBytes of RAM. Not a good basis for a comparison test with your context. I've no i386 access at all. > llvm 12 build without problems Hmm. I'll try building devel/llvm13 on aarch64 with periodic sampling of the memory use to see maximum observed figures for SWAP and for various categories of RAM, as well as the largest observed load averages. ZFS context use. I could try UFS as well. Swap: 30720Mi Total on the 8GiByte RPi4B. So about 38 GiBytes RAM+SWAP available. We should see how much SWAP is used. Before starting poudriere, shortly after a reboot: 19296Ki MaxObs(Act+Lndry+SwapUsed) (No SWAP in use at the time.) # poudriere bulk -jmain-CA72-bulk_a -w devel/llvm13 for the from scratch build: reports: [00:00:34] Building 91 packages using up to 4 builders The ports tree is about a month back: # ~/fbsd-based-on-what-commit.sh -C /usr/ports/ branch: main merge-base: 872199326a916efbb4bf13c97bc1af910ba1482e merge-base: CommitDate: 2022-07-14 01:26:04 +0000 872199326a91 (HEAD -> main, freebsd/main, freebsd/HEAD) = devel/ruby-build: Update to 20220713 n589512 (--first-parent --count for merge-base) But, if I gather right, the problem you see goes back before that. I can not tell how 4 FreeBSD cpus compares to the count that the Lenovo Legion 5 gets. I'll report on its maximum observed figures once the build stops. It will be a while before the RPi4B gets that far. The ports built prior to devel/llvm13's builder starting will lead to load averages over 4 from up to 4 builders, each potentially using up to around 4 processes. I'll see about starting a separate tracking once devel/llvm13 's builder has started if I happen to observe it at the right time frame for doing such. > Cheers >=20 > Mark Millard escreveu no dia domingo, 14/08/2022 = =C3=A0(s) 03:54: > Nuno Teixeira wrote on > Date: Sat, 13 Aug 2022 16:52:09 UTC : >=20 > > . . . > > I've tested it but it still fails: > > --- > > pid 64502 (c++), jid 7, uid 65534, was killed: failed to reclaim = memory > > swap_pager: out of swap space > > --- > > on a Lenovo Legion 5, 16GB RAM and 4GB swap. > > . . . >=20 > This leaves various points unclear: >=20 > poudriere style build? Some other style? >=20 > (I'll state questions in a form generally for a poudriere style > context. Some could be converted to analogous points for other > build-styles.) >=20 > How many poudriere builders allowed (-JN) ? >=20 > /usr/local/etc/poudreire.conf : > ALLOW_MAKE_JOBS=3Dyes in use? > ALLOW_MAKE_JOBS_PACKAGES=3D??? in use? > USE_TMPFS=3D??? With what value? Anything other that "data" or "no"? >=20 > /usr/local/etc/poudriere.d/make.conf (or the like): > MAKE_JOBS_NUMBER=3D??? in use? With what value? >=20 > Is tmpfs in use such that it will use RAM+SWAP when the > used tmpfs space is large? >=20 > How much free space is available for /tmp ? >=20 > Are you using something like ( in, say, /boot/loader/conf ): That should have been: /boot/loader.conf Sorry. > # > # Delay when persistent low free RAM leads to > # Out Of Memory killing of processes: > vm.pageout_oom_seq=3D120 >=20 >=20 > How many FreeBSD cpus does a Lenovo Legion 5 present > in the configuration used? >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com