Skip site navigation (1)Skip section navigation (2)
Date:      Sun, 14 Aug 2022 15:50:54 +0100
From:      Nuno Teixeira <eduardo@freebsd.org>
To:        Mark Millard <marklmi@yahoo.com>
Cc:        FreeBSD Mailing List <freebsd-ports@freebsd.org>
Subject:   Re: Resolved: devel/llvm13 build: "ninja: build stopped: subcommand failed"
Message-ID:  <CAFDf7UK-pAFXCrZZA9veASaa-wf9HKMdX52fxmcmDgRFiNOF7A@mail.gmail.com>
In-Reply-To: <1D4C14BD-8955-4B86-9C99-3E58D7603122@yahoo.com>
References:  <1D4C14BD-8955-4B86-9C99-3E58D7603122.ref@yahoo.com> <1D4C14BD-8955-4B86-9C99-3E58D7603122@yahoo.com>

next in thread | previous in thread | raw e-mail | index | archive | help
--000000000000b1e29a05e634a54d
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

Hello Mark,

I use poudriere with USE_TMPFS=3Dno, ofc because of low mem)

The problem "ninja: build stopped: subcommand failed" have some time now
and it's caused by a build peak of memory that affects people with less
than 32/64GB mem and to solve building it must be build using one builder
with one core thats takes about 7 hours on my machine or with 6c+6t on 12.3
i386 that takes about 45min (123i386 is the only jail that I can use all
cores).

llvm 12 build without problems

Cheers

Mark Millard <marklmi@yahoo.com> escreveu no dia domingo, 14/08/2022 =C3=A0=
(s)
03:54:

> Nuno Teixeira <eduardo_at_freebsd.org> wrote on
> Date: Sat, 13 Aug 2022 16:52:09 UTC :
>
> > . . .
> > I've tested it but it still fails:
> > ---
> > pid 64502 (c++), jid 7, uid 65534, was killed: failed to reclaim memory
> > swap_pager: out of swap space
> > ---
> > on a Lenovo Legion 5, 16GB RAM and 4GB swap.
> > . . .
>
> This leaves various points unclear:
>
> poudriere style build? Some other style?
>
> (I'll state questions in a form generally for a poudriere style
> context. Some could be converted to analogous points for other
> build-styles.)
>
> How many poudriere builders allowed (-JN) ?
>
> /usr/local/etc/poudreire.conf :
> ALLOW_MAKE_JOBS=3Dyes in use?
> ALLOW_MAKE_JOBS_PACKAGES=3D??? in use?
> USE_TMPFS=3D??? With what value? Anything other that "data" or "no"?
>
> /usr/local/etc/poudriere.d/make.conf (or the like):
> MAKE_JOBS_NUMBER=3D??? in use? With what value?
>
> Is tmpfs in use such that it will use RAM+SWAP when the
> used tmpfs space is large?
>
> How much free space is available for /tmp ?
>
> Are you using something like ( in, say, /boot/loader/conf ):
>
> #
> # Delay when persistent low free RAM leads to
> # Out Of Memory killing of processes:
> vm.pageout_oom_seq=3D120
>
>
> How many FreeBSD cpus does a Lenovo Legion 5 present
> in the configuration used?
>
>
> =3D=3D=3D
> Mark Millard
> marklmi at yahoo.com
>
>

--=20
Nuno Teixeira
FreeBSD Committer (ports)

--000000000000b1e29a05e634a54d
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hello Mark,</div><div><br></div><div>I use poudriere =
with USE_TMPFS=3Dno, ofc because of low mem)<br></div><div><br></div><div>T=
he problem &quot;ninja: build stopped: subcommand failed&quot; have some ti=
me now and it&#39;s caused by a build peak of memory that affects people wi=
th less than 32/64GB mem and to solve building it must be build using one b=
uilder with one core thats takes about 7 hours on my machine or with 6c+6t =
on 12.3 i386 that takes about 45min (123i386 is the only jail that I can us=
e all cores).</div><div><br></div><div>llvm 12 build without problems</div>=
<div><br></div><div>Cheers<br></div></div><br><div class=3D"gmail_quote"><d=
iv dir=3D"ltr" class=3D"gmail_attr">Mark Millard &lt;<a href=3D"mailto:mark=
lmi@yahoo.com">marklmi@yahoo.com</a>&gt; escreveu no dia domingo, 14/08/202=
2 =C3=A0(s) 03:54:<br></div><blockquote class=3D"gmail_quote" style=3D"marg=
in:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1e=
x">Nuno Teixeira &lt;<a href=3D"http://eduardo_at_freebsd.org" rel=3D"noref=
errer" target=3D"_blank">eduardo_at_freebsd.org</a>&gt; wrote on<br>
Date: Sat, 13 Aug 2022 16:52:09 UTC :<br>
<br>
&gt; . . .<br>
&gt; I&#39;ve tested it but it still fails:<br>
&gt; ---<br>
&gt; pid 64502 (c++), jid 7, uid 65534, was killed: failed to reclaim memor=
y<br>
&gt; swap_pager: out of swap space<br>
&gt; ---<br>
&gt; on a Lenovo Legion 5, 16GB RAM and 4GB swap.<br>
&gt; . . .<br>
<br>
This leaves various points unclear:<br>
<br>
poudriere style build? Some other style?<br>
<br>
(I&#39;ll state questions in a form generally for a poudriere style<br>
context. Some could be converted to analogous points for other<br>
build-styles.)<br>
<br>
How many poudriere builders allowed (-JN) ?<br>
<br>
/usr/local/etc/poudreire.conf :<br>
ALLOW_MAKE_JOBS=3Dyes in use?<br>
ALLOW_MAKE_JOBS_PACKAGES=3D??? in use?<br>
USE_TMPFS=3D??? With what value? Anything other that &quot;data&quot; or &q=
uot;no&quot;?<br>
<br>
/usr/local/etc/poudriere.d/make.conf (or the like):<br>
MAKE_JOBS_NUMBER=3D??? in use? With what value?<br>
<br>
Is tmpfs in use such that it will use RAM+SWAP when the<br>
used tmpfs space is large?<br>
<br>
How much free space is available for /tmp ?<br>
<br>
Are you using something like ( in, say, /boot/loader/conf ):<br>
<br>
#<br>
# Delay when persistent low free RAM leads to<br>
# Out Of Memory killing of processes:<br>
vm.pageout_oom_seq=3D120<br>
<br>
<br>
How many FreeBSD cpus does a Lenovo Legion 5 present<br>
in the configuration used?<br>
<br>
<br>
=3D=3D=3D<br>
Mark Millard<br>
marklmi at <a href=3D"http://yahoo.com" rel=3D"noreferrer" target=3D"_blank=
">yahoo.com</a><br>
<br>
</blockquote></div><br clear=3D"all"><br>-- <br><div dir=3D"ltr" class=3D"g=
mail_signature"><div dir=3D"ltr"><span style=3D"color:rgb(102,102,102)">Nun=
o Teixeira<br>FreeBSD Committer (ports)</span></div></div>

--000000000000b1e29a05e634a54d--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFDf7UK-pAFXCrZZA9veASaa-wf9HKMdX52fxmcmDgRFiNOF7A>