From nobody Tue May 30 09:46:53 2023 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4QVncG24M0z4XCWV for ; Tue, 30 May 2023 09:47:10 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic316-8.consmr.mail.gq1.yahoo.com (sonic316-8.consmr.mail.gq1.yahoo.com [98.137.69.32]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4QVncF6CCpz3vM7 for ; Tue, 30 May 2023 09:47:09 +0000 (UTC) (envelope-from marklmi@yahoo.com) Authentication-Results: mx1.freebsd.org; none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1685440027; bh=5xjSvY+5EAU72X9WQxLadJvle5gZRO3c6DOpyGXIsl0=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=mhWcmRSU/i22IJhaeIHPi2DY88IAtSQTB7/LJTjXDd4Zhxit0fFKeEzYU08sLmz2gcodr4uQOB8qaU2r59WZpFeCbC9pHA1MaGP6HF8kYkzH2WitZau011WqiUoKxnZbnMiMn00tFZSus9Nl2NUM61xahI0rR0ZkdN+76f1D4beIZVssWbrgyxPemTC4PXk0lLarLS5GZCXMA1Jn6pxnMlfLUvP+QmXgvwCJQbp5R0eszrxlr7nC6qmz4Dce/gB9p29nTYb/YjUOGSjUtZcFHrjD6FhHkWmsnr7ScJn0/UdxrJZe37HU9HvyPfZzYHAuXjXdyAh6T6oAw+PYRWd0hQ== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1685440027; bh=nbH9L6RiGAql6zu3mPPAEwaL3T54bfXkdZ+gjTfyGJO=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=BlLOCm9S+An5phxRGPlrGIQMRRH+pM11bGIpGd8EYrgxhjiDPgvj/6WmHRTz/dc5SDWzG//UcLRsYcl5YjoDroLGWskosIG0kr3euHSu3LHhOUby1U54OmY3Qt3/kaG1nkEs3TLN1Ql+hS1unJsjlu5RJao3nvWukqbbci0cNU/pgy7zNwyJmMkImhtPqlmc+mHRs1O4bCG8PtoNEoGrX0PWodORGkHES4Y23FBuzNUg7KDPdJule0i49doeKYPgxvQX93maCs0K6EfqDO1ehWk8gth+8ASqF+2uvQvKZb/WHfuymRAYndPX+4s1EEKDMXmNZyPJ/BQp5UdypracLQ== X-YMail-OSG: aw4xY1MVM1lDm7FtHDcRe4ukb0eiluiOVKsb33b5vI7omRj8QOD8P.D8Uyf0ccW U8TODOSgFHfkQpKNseuCA3ttnfsxWw9uA2TyW7lw0Lm31uElDrFNvGsk4v43GkTWV2mSERh.h.QK Y_M8sRuwBfYw4f1I_3.d.GNq8zUBLCJWJ1tZiGeMrDoyuyAYqPXfbaS6oU_otZfTm_UqqIjO61j_ 3vRRIrmf9CPLppmKE8r5pvCmOs1ZHChSwWrww7SR6Vk93tGc.O_TK9OBSHlbM7aS_4uoRWTKw1Br CX7E5.kQcLVnsMEnG9NKrTqE1Y0w0..4jq9h.OXN6e_hOhOEbqDuWDj6Dw_ZttkdlvbzsZBOuXzf V.cy3kzlCtXJ69jyI37DcHdZV.6.a_4H1gwJW.4ZzORe9ywW6IOcxF.Hr6XGpf9pvZvUM8ilfuno 9vday71793MGPcfnYVGGE6zIgBDv1RuqdaMo1vJ7Wfgouqk.s.g9aXVBycD0LliJG7lD5Pq9hLad xOWGOJy66GhiBg_V_YXtwrWsV5gph_wshLm6_dn00fYmB0Wrd2JD0_jr1AaBFAJ42sFXLQOX.LpQ VlLSY50ROFhdMAFRSOyhqpL8wv5a3gU_5bYYAN76HuparqV6gHAt5YbYYa2Po_BnhNhhbwPvDfMN fkXnGrbLS9dbWFPyF70ejh6nFzd_MPAKkDxozwoFa9Top5tsYEOlhZH6EEiTFUVtfpAVENf6O7dD jWPXEWnO9_Ua9.NXB5Hp9HyB5jBhWsU6zGI3hkErkBZe49bqD9WjiQk6ob2OpTchlByWcNa1U530 aXPKuOCmei2bDBdjc5CYlr474DlnB9WNoz52Q8iPkdFdqdYk8IUNhNmD.RAEL1Clp_wAWhdm1yh8 zKx60OlSIdFqFkeWIbT237iyuMGvIitbTb4OPdxWiKWXg8wcaJvmwEJ.fTJ5T7ZX0rFrUaXJvKph HvdFgA9EZ43HKT09L0s2aXIP1Q0ghPJNppb7Nzd0UranjvkTEvTjQj06S6kgVKjrXy25ltCxTCIj 8co3__1ia2mOi90ZerWTvdV6LE8j_IiCkKCZG2CUy3hEyKOBmB4hJV8Y2pPPWidzbpT4Tl7ZasfM 9Nz6A.djf91Izu.efZh26YcjzVqejmYlcZtJbB8Gt4UlBB.T5XWqlKSwiZ3z5p3szEzteTAO.Ab. QtuYK5PgUV_lkfDX85uuGeUWCfXuVnELm2_j2ZyEjumh.xIssGtr5oHCo8fMN9zwcjA0H_6Ewkd_ X5HXe0GkJOK6OrpyjkTKEcFuvTHixI6ZdV3iEManhMQyfd8Ru41DO1vu60lCECbSU_pCxU8mYsm7 SFBSXVNSOtWYDnrbDuxJsIsJ_5LnWY_zTkIS3p8zzDGttGIJQxTEC9QMQuzwTjqqnt0dxsrvg_cf T9V0l5VnOP4F3e4LoR_3TOnJWgd13m5T.cfClE1M7HhJerLPLx1Ys9NuOKGeO5QOlPinx_fkXPml IchbAoTtu_szAqrUquau5n1wesS5RWbN3qC.dVWZSqJ5KNag7k1e6brV5yg67ry6OjSjrR2MTe1c O8lS5qFdsc65Ow8Slo0D.dwavlsr3F7HfifZuTnSDYL_deP023GgkhzWxS0Dx84PRehDlWWmIRK6 rendxFWpHGvaGkaWuL0VFYj1G9Jtn2LVzIZUUhjF8CtTxF2E.8SCLeCpD9HWh8WKxXL7CMG.MRix ESYpMwTu.bmIMULNwFq9SSEACn37PlAAfCk1Is.JyHMqu9zmUQanJA0codNWaB5cYFsT6GIpN4uD kAij_EeMRsq9CDBkH2Qc2UbQEzRfyTMPNI98Z7_UDll4xVxsDEd284zMRnj8mO7j9I40QCCfdEaQ bDvytoOMrU4mSXX9PxfJ5vqXyyQbxMIgTiIjrOLEHlJuLkqQydAixZWu_dYDRWuIOmXc_cxqdL65 GNke6lUURoUQ3WKSrSklk.BmVzDUt.ruFGoJB.bLcQUihI6W5KrVOTH4FARsP8X44iJsyENw_56j ZtJOunuVXS.vDAo8UQrsXtBskAX4k5PsGJpkQ1od5Ev7gP5IYKQWZvZssQWCDHC1OinMgSTGKye9 85mhL7DcaUSpRwsbkWZ7QCZmMRWjpgUfu8UgdCCZ3V2WJkxrixbdwhKv3CVrws68ibg2OOSZHfxp TPLrwwaTpZpa2N.IFotcqNV6ZkhTokGxrZtlKAahP1mAWCP0lbd_lYaBztCF5ztZIQzp9REu3UBK XDLDs9waJ2HhILW7csq0nEe9mqPVssYfw_xgEsItnzV0SIpYiD7W5wJAx_1j7B.fl.HLZdYP_kQI - X-Sonic-MF: X-Sonic-ID: dcec2aa0-11c9-4001-adde-4fa25c477187 Received: from sonic.gate.mail.ne1.yahoo.com by sonic316.consmr.mail.gq1.yahoo.com with HTTP; Tue, 30 May 2023 09:47:07 +0000 Received: by hermes--production-gq1-6db989bfb-c6sbx (Yahoo Inc. Hermes SMTP Server) with ESMTPA ID 2a80b32e902eeca34c947d2fa44cdec0; Tue, 30 May 2023 09:47:04 +0000 (UTC) Content-Type: text/plain; charset=utf-8 List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 16.0 \(3731.400.51.1.1\)) Subject: Re: Improving www/chromium build time on arm64 From: Mark Millard In-Reply-To: Date: Tue, 30 May 2023 02:46:53 -0700 Cc: Ronald Klop , FreeBSD Mailing List , freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <1623315797.5.1684837400228@mailrelay> To: Nuno Teixeira X-Mailer: Apple Mail (2.3731.400.51.1.1) X-Rspamd-Queue-Id: 4QVncF6CCpz3vM7 X-Spamd-Bar: ---- X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US] X-Rspamd-Pre-Result: action=no action; module=replies; Message is reply to one we originated X-ThisMailContainsUnwantedMimeParts: N On May 30, 2023, at 01:39, Nuno Teixeira wrote: > Hello Ronald and all! >=20 > Finally I build it after 57 hours @ 2000MHz !!! So the prior "[88:53:28] Failed ports: www/chromium:build/timeout" was not with the overclocking? Other differences that could contribute to the time difference? MAX_EXECUTION_TIME=3D86400 (the default) only allows for 24 hours before it starts analyzing the log for failure information (while letting the build continue while that scanning is done). > Configs, photos and log at: = https://people.freebsd.org/~eduardo/logs/chromium/ https://people.freebsd.org/~eduardo/logs/chromium/poudriere.conf shows no assignments to MAX_EXECUTION_TIME or NOHANG_TIME or other such (outside comments). In the comments are the default values, not increases. Similarly for PARALLEL_JOBS , PREPARE_PARALLEL_JOBS , ALLOW_MAKE_JOBS , and so on. (It is not clear what the load average behavior/ idle time behavior might have been.) The file does show explicit assignments to: ZPOOL, FREEBSD_HOST , RESOLV_CONF , BASEFS , USE_PORTLINT , USE_TMPFS , DISTFILES_CACHE , and PACKAGE_FETCH_URL . > I'm running it right now and it runs very smooth! >=20 > Next step will be compiling with LTO to check compile time and do some = comparisons on binary size and run performance. >=20 > Should I bother with LTO? Will it add performance? >=20 > Thanks all! >=20 >=20 > Ronald Klop escreveu no dia ter=C3=A7a, = 23/05/2023 =C3=A0(s) 11:23: >> =C3=82 =20 >>> Van: Nuno Teixeira >>> Datum: dinsdag, 23 mei 2023 09:48 >>> Aan: FreeBSD Mailing List , = freebsd-arm@freebsd.org >>> Onderwerp: Re: Improving www/chromium build time on arm64 >>> (...)=20 >>> =C3=82=20 >>> But I also found that poudriere: >>> [88:53:28] Failed ports: www/chromium:build/timeout >>> =C3=82=20 >>> So I will search how do I increase build time to avoid timeout: >>> --- >>> # This defines the max time (in seconds) that a command may run for = a build >>> # before it is killed for taking too long. Default: 86400 >>> #MAX_EXECUTION_TIME=3D86400 >>> --- >>> =C3=82=20 >>> I suspect it can be the cause of build failure because build >24h. >>> =C3=82 =20 >>> Nuno Teixeira escreveu no dia ter=C3=83=C2=A7a, = 23/05/2023 =C3=83 (s) 08:31: >>> Hello all,=20 >>> =C3=82=20 >>> I'm running 13-STABLE on rpi4 8 and since firefox{-esr} is = constantly tab crashing and seg faulting I decided to give chromium a = try. >>> chromium pkg isn't available for arm64 and I didn't found error log = at https://pkg-status.freebsd.org/ so I decided to build it on = poudriere. >>> =C3=82=20 >>> It fails to build around 70% but my biggest concern is build time: = 27 hours for 70% compilation! >>> =C3=82=20 >>> Just for comparison: >>> llvm15: 12h >>> rust: 9h >>> firefox: 6h >>> =C3=82=20 >>> rip4 v1.5 8GB @ 2000Hz ~62 Celsius >>> zfs >>> poudriere: >>> USE_TMPFS=3Dno >>> PARALLEL_JOBS=3D1 >>> ALLOW_MAKE_JOBS=3Dyes >>> =C3=82=20 >>> Any hints on how to speed build? ccache? >>> Does cflags "-O -pipe" not present in compilation is related to = build time?=20 >>> =C3=82=20 >>> Full log: >>> = https://people.freebsd.org/~eduardo/logs/chromium/chromium-113.0.5672.126.= log >>> =C3=82=20 >>> Thanks! >>> =C3=82=20 >>> --- >>> >>> In file included from ../../base/check.h:11: >>> ../../base/compiler_specific.h:8:10: fatal error: = 'build/build_config.h' file not found >>> #include "build/build_config.h" >>> ^~~~~~~~~~~~~~~~~~~~~~ >>> 1 error generated. >>> ninja: build stopped: subcommand failed. >>> =3D=3D=3D> Compilation failed unexpectedly. >>> Try to set MAKE_JOBS_UNSAFE=3Dyes and rebuild before reporting the = failure to >>> the maintainer. >>> *** Error code 1 >>>=20 >>> Stop. >>> make: stopped in /usr/ports/www/chromium >>> build of www/chromium | chromium-113.0.5672.126 ended at Tue May 23 = 02:22:56 WEST 2023 >>> build time: 27:15:37 >>> !!! build failure encountered !!! >>> --- >>> -- Nuno Teixeira >>> FreeBSD Committer (ports) >>> =C3=82=20 >>> -- Nuno Teixeira >>> FreeBSD Committer (ports) >>>=20 >>=20 >> Hi, >>=20 >> My poudriere.conf for building ports on rpi4 contains these two = changes: >>=20 >> # This defines the max time (in seconds) that a command may run for a = build >> # before it is killed for taking too long. Default: 86400 >> #MAX_EXECUTION_TIME=3D86400 >> MAX_EXECUTION_TIME=3D172800 >>=20 >> # This defines the time (in seconds) before a command is considered = to >> # be in a runaway state for having no output on stdout. Default: 7200 >> #NOHANG_TIME=3D7200 >> NOHANG_TIME=3D172800 >>=20 >>=20 >> I'm maintaining some mongodb ports which also take a long long time = to build on rpi4. >> But I don't remember which of these settings has the preferred impact = on your situation. >>=20 >> Oh... now I'm reading your log better. It contains this: >> "=3D>> Killing timed out build after 86400 seconds" >>=20 >> And some time later: >> "=3D>> Cleaning up wrkdir >> =3D=3D=3D> Cleaning for chromium-113.0.5672.126" >>=20 >> So the errors about missing files happen because poudriere is = removing files while some processes of the build are still running. >>=20 >> I'm curious how far it gets after you increase MAX_EXECUTION_TIME. >=20 =3D=3D=3D Mark Millard marklmi at yahoo.com