Date: Fri, 26 May 2023 08:21:51 +0100 From: Nuno Teixeira <eduardo@freebsd.org> To: Ronald Klop <ronald-lists@klop.ws> Cc: FreeBSD Mailing List <freebsd-ports@freebsd.org>, freebsd-arm@freebsd.org Subject: Re: Improving www/chromium build time on arm64 Message-ID: <CAFDf7U%2Ba-85W-XRyo4NxDEWenueXBgcc7H%2BkRX_Ho77cf_oMzA@mail.gmail.com> In-Reply-To: <1623315797.5.1684837400228@mailrelay> References: <CAFDf7U%2B1p5HSEmXzSKU62ULgAevGK-g93nBqix2hzafEDs4F-Q@mail.gmail.com> <CAFDf7ULoK-P7h8E2PGz1S3-8Dr8EZLD_o7dWku3eZn7FEXV2Cg@mail.gmail.com> <1623315797.5.1684837400228@mailrelay>
next in thread | previous in thread | raw e-mail | index | archive | help
--000000000000f3031a05fc9397e0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello! Time out again! ~94%: =3D>> Killing timed out build after 172800 seconds But it built until 99% I will raise MAX_EXECUTION_TIME and NOHANG_TIME to 259200 !!! Log: https://people.freebsd.org/~eduardo/logs/chromium/chromium-113.0.5672.126_t= imeout2.log See you next week :) "Try Again. Fail Again. Fail Better." -- Samuel Beckett Ronald Klop <ronald-lists@klop.ws> escreveu no dia ter=C3=A7a, 23/05/2023 = =C3=A0(s) 11:23: > =C3=82 > > *Van:* Nuno Teixeira <eduardo@freebsd.org> > *Datum:* dinsdag, 23 mei 2023 09:48 > *Aan:* FreeBSD Mailing List <freebsd-ports@freebsd.org>, > freebsd-arm@freebsd.org > *Onderwerp:* Re: Improving www/chromium build time on arm64 > > (...) > =C3=82 > But I also found that poudriere: > [88:53:28] Failed ports: www/chromium:build/timeout > =C3=82 > So I will search how do I increase build time to avoid timeout: > --- > # This defines the max time (in seconds) that a command may run for a bui= ld > # before it is killed for taking too long. Default: 86400 > #MAX_EXECUTION_TIME=3D86400 > --- > =C3=82 > I suspect it can be the cause of build failure because build >24h. > =C3=82 > Nuno Teixeira <eduardo@freebsd.org> escreveu no dia ter=C3=83=C2=A7a, 23/= 05/2023 > =C3=83 (s) 08:31: > >> Hello all, >> =C3=82 >> I'm running 13-STABLE on rpi4 8 and since firefox{-esr} is constantly ta= b >> crashing and seg faulting I decided to give chromium a try. >> chromium pkg isn't available for arm64 and I didn't found error log at >> https://pkg-status.freebsd.org/ so I decided to build it on poudriere. >> =C3=82 >> It fails to build around 70% but my biggest concern is build time: 27 >> hours for 70% compilation! >> =C3=82 >> Just for comparison: >> llvm15: 12h >> rust: 9h >> firefox: 6h >> =C3=82 >> rip4 v1.5 8GB @ 2000Hz ~62 Celsius >> zfs >> poudriere: >> USE_TMPFS=3Dno >> PARALLEL_JOBS=3D1 >> ALLOW_MAKE_JOBS=3Dyes >> =C3=82 >> Any hints on how to speed build? ccache? >> Does cflags "-O -pipe" not present in compilation is related to build >> time? >> =C3=82 >> Full log: >> >> https://people.freebsd.org/~eduardo/logs/chromium/chromium-113.0.5672.12= 6.log >> =C3=82 >> Thanks! >> =C3=82 >> --- >> <SNIP> >> In file included from ../../base/check.h:11: >> ../../base/compiler_specific.h:8:10: fatal error: 'build/build_config.h' >> file not found >> #include "build/build_config.h" >> ^~~~~~~~~~~~~~~~~~~~~~ >> 1 error generated. >> ninja: build stopped: subcommand failed. >> =3D=3D=3D> Compilation failed unexpectedly. >> Try to set MAKE_JOBS_UNSAFE=3Dyes and rebuild before reporting the failu= re >> to >> the maintainer. >> *** Error code 1 >> >> Stop. >> make: stopped in /usr/ports/www/chromium >> build of www/chromium | chromium-113.0.5672.126 ended at Tue May 23 >> 02:22:56 WEST 2023 >> build time: 27:15:37 >> !!! build failure encountered !!! >> --- >> -- >> Nuno Teixeira >> FreeBSD Committer (ports) >> > > =C3=82 > -- > Nuno Teixeira > FreeBSD Committer (ports) > > > > Hi, > > My poudriere.conf for building ports on rpi4 contains these two changes: > > # This defines the max time (in seconds) that a command may run for a bui= ld > # before it is killed for taking too long. Default: 86400 > #MAX_EXECUTION_TIME=3D86400 > MAX_EXECUTION_TIME=3D172800 > > # This defines the time (in seconds) before a command is considered to > # be in a runaway state for having no output on stdout. Default: 7200 > #NOHANG_TIME=3D7200 > NOHANG_TIME=3D172800 > > > I'm maintaining some mongodb ports which also take a long long time to > build on rpi4. > But I don't remember which of these settings has the preferred impact on > your situation. > > Oh... now I'm reading your log better. It contains this: > "=3D>> Killing timed out build after 86400 seconds" > > And some time later: > "=3D>> Cleaning up wrkdir > =3D=3D=3D> Cleaning for chromium-113.0.5672.126" > > So the errors about missing files happen because poudriere is removing > files while some processes of the build are still running. > > I'm curious how far it gets after you increase MAX_EXECUTION_TIME. > > Regards, > Ronald. > =C3=82 > --=20 Nuno Teixeira FreeBSD Committer (ports) --000000000000f3031a05fc9397e0 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable <div dir=3D"ltr"><div>Hello!</div><div><br></div><div>Time out again!</div>= <div>~94%:</div><div>=3D>> Killing timed out build after 172800 secon= ds</div><div><br></div><div>But it built until 99%</div><div><br></div><div= >I will raise MAX_EXECUTION_TIME and NOHANG_TIME to 259200 !!!</div><div><b= r></div><div>Log: <a href=3D"https://people.freebsd.org/~eduardo/logs/chrom= ium/chromium-113.0.5672.126_timeout2.log">https://people.freebsd.org/~eduar= do/logs/chromium/chromium-113.0.5672.126_timeout2.log</a></div><div><br></d= iv><div>See you next week :)<br></div><br>"Try Again. Fail Again. Fail= Better."<br>-- Samuel Beckett</div><br><div class=3D"gmail_quote"><di= v dir=3D"ltr" class=3D"gmail_attr">Ronald Klop <<a href=3D"mailto:ronald= -lists@klop.ws">ronald-lists@klop.ws</a>> escreveu no dia ter=C3=A7a, 23= /05/2023 =C3=A0(s) 11:23:<br></div><blockquote class=3D"gmail_quote" style= =3D"margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding= -left:1ex"><div>=C3=82=C2=A0 <p><strong>Van:</strong> Nuno Teixeira <<a href=3D"mailto:eduardo@freebs= d.org" target=3D"_blank">eduardo@freebsd.org</a>><br> <strong>Datum:</strong> dinsdag, 23 mei 2023 09:48<br> <strong>Aan:</strong> FreeBSD Mailing List <<a href=3D"mailto:freebsd-po= rts@freebsd.org" target=3D"_blank">freebsd-ports@freebsd.org</a>>, <a hr= ef=3D"mailto:freebsd-arm@freebsd.org" target=3D"_blank">freebsd-arm@freebsd= .org</a><br> <strong>Onderwerp:</strong> Re: Improving www/chromium build time on arm64<= /p> <blockquote style=3D"padding-right:0px;padding-left:5px;margin-left:5px;bor= der-left:2px solid rgb(0,0,0);margin-right:0px"> <div id=3D"m_-8699411192049167067P"> <div> <div id=3D"m_-8699411192049167067P.P.P"> <div>(...) <div>=C3=82=C2=A0</div> <div>But I also found that poudriere:</div> <div>[88:53:28] Failed ports: www/chromium:build/timeout</div> <div>=C3=82=C2=A0</div> <div>So I will search how do I increase build time to avoid timeout:</div> <div>---</div> <div># This defines the max time (in seconds) that a command may run for a = build<br> # before it is killed for taking too long. Default: 86400<br> #MAX_EXECUTION_TIME=3D86400</div> <div>---</div> <div>=C3=82=C2=A0</div> <div>I suspect it can be the cause of build failure because build >24h.<= /div> </div> =C3=82=C2=A0 <div class=3D"gmail_quote"> <div class=3D"gmail_attr">Nuno Teixeira <<a href=3D"mailto:eduardo@freeb= sd.org" target=3D"_blank">eduardo@freebsd.org</a>> escreveu no dia ter= =C3=83=C2=A7a, 23/05/2023 =C3=83=C2=A0(s) 08:31:</div> <blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-= left:1px solid rgb(204,204,204);padding-left:1ex"> <div>Hello all, <div>=C3=82=C2=A0</div> <div>I'm running 13-STABLE on rpi4 8 and since firefox{-esr} is constan= tly tab crashing and seg faulting I decided to give chromium a try.</div> <div>chromium pkg isn't available for arm64 and I didn't found erro= r log at=C2=A0<a href=3D"https://pkg-status.freebsd.org/" target=3D"_blank"= >https://pkg-status.freebsd.org/</a>; so I decided to build it on poudriere.= </div> <div>=C3=82=C2=A0</div> <div>It fails to build around 70% but my biggest concern is build time: 27 = hours for 70% compilation!</div> <div>=C3=82=C2=A0</div> <div>Just for comparison:</div> <div>llvm15: 12h</div> <div>rust: 9h</div> <div>firefox: 6h</div> <div>=C3=82=C2=A0</div> <div>rip4 v1.5 8GB @ 2000Hz ~62 Celsius</div> <div>zfs</div> <div>poudriere:</div> <div>USE_TMPFS=3Dno</div> <div>PARALLEL_JOBS=3D1</div> <div>ALLOW_MAKE_JOBS=3Dyes</div> <div>=C3=82=C2=A0</div> <div>Any hints on how to speed build? ccache?</div> <div>Does cflags "-O -pipe" not present in compilation is related= to build time?=C2=A0</div> <div>=C3=82=C2=A0</div> <div>Full log:</div> <div><a href=3D"https://people.freebsd.org/~eduardo/logs/chromium/chromium-= 113.0.5672.126.log" target=3D"_blank">https://people.freebsd.org/~eduardo/l= ogs/chromium/chromium-113.0.5672.126.log</a></div> <div>=C3=82=C2=A0</div> <div>Thanks!</div> <div>=C3=82=C2=A0</div> <div>---</div> <div><SNIP></div> <div>In file included from ../../base/check.h:11:<br> ../../base/compiler_specific.h:8:10: fatal error: 'build/build_config.h= ' file not found<br> #include "build/build_config.h"<br> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0^~~~~~~~~~~~~~~~~~~~~~<br> 1 error generated.<br> ninja: build stopped: subcommand failed.<br> =3D=3D=3D> Compilation failed unexpectedly.<br> Try to set MAKE_JOBS_UNSAFE=3Dyes and rebuild before reporting the failure = to<br> the maintainer.<br> *** Error code 1<br> <br> Stop.<br> make: stopped in /usr/ports/www/chromium<br> build of www/chromium | chromium-113.0.5672.126 ended at Tue May 23 02:22:5= 6 WEST 2023<br> build time: 27:15:37<br> !!! build failure encountered !!!</div> <div> <div>---</div> <span>-- </span> <div> <div><span style=3D"color:rgb(102,102,102)">Nuno Teixeira<br> FreeBSD Committer (ports)</span></div> </div> </div> </div> </blockquote> </div> =C2=A0 <div>=C3=82=C2=A0</div> <span>-- </span> <div> <div><span style=3D"color:rgb(102,102,102)">Nuno Teixeira<br> FreeBSD Committer (ports)</span></div> </div> </div> </div> </div> </blockquote> <br> <br> Hi,<br> <br> My poudriere.conf for building ports on rpi4 contains these two changes:<br= > <br> # This defines the max time (in seconds) that a command may run for a build= <br> # before it is killed for taking too long. Default: 86400<br> #MAX_EXECUTION_TIME=3D86400<br> MAX_EXECUTION_TIME=3D172800<br> <br> # This defines the time (in seconds) before a command is considered to<br> # be in a runaway state for having no output on stdout. Default: 7200<br> #NOHANG_TIME=3D7200<br> NOHANG_TIME=3D172800<br> <br> <br> I'm maintaining some mongodb ports which also take a long long time to = build on rpi4.<br> But I don't remember which of these settings has the preferred impact o= n your situation.<br> <br> Oh... now I'm reading your log better. It contains this:<br> "=3D>> Killing timed out build after 86400 seconds"<br> <br> And some time later:<br> "=3D>> Cleaning up wrkdir<br> =3D=3D=3D> Cleaning for chromium-113.0.5672.126"<br> <br> So the errors about missing files happen because poudriere is removing file= s while some processes of the build are still running.<br> <br> I'm curious how far it gets after you increase MAX_EXECUTION_TIME.<br> <br> Regards,<br> Ronald.<br> =C3=82=C2=A0</div></blockquote></div><br clear=3D"all"><br><span class=3D"g= mail_signature_prefix">-- </span><br><div dir=3D"ltr" class=3D"gmail_signat= ure"><div dir=3D"ltr"><span style=3D"color:rgb(102,102,102)">Nuno Teixeira<= br>FreeBSD Committer (ports)</span></div></div> --000000000000f3031a05fc9397e0--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?CAFDf7U%2Ba-85W-XRyo4NxDEWenueXBgcc7H%2BkRX_Ho77cf_oMzA>