From owner-freebsd-ports@freebsd.org Sun Aug 18 08:27:56 2019 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 9E2A6C0B0D for ; Sun, 18 Aug 2019 08:27:56 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-22.consmr.mail.ne1.yahoo.com (sonic315-22.consmr.mail.ne1.yahoo.com [66.163.190.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 46B9DC2mKQz4HWq for ; Sun, 18 Aug 2019 08:27:55 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: qV6GggUVM1mDM10mq_Hn.MZSjT3IK0iydoZLLe2lqc90j0J_ri2tm6sy_vzrpXh U5PwadkGowjLMc6DtUDUjnNU0afj07zBAvXU5YX9LjiRHSKTDPw8sJw.LOOL1iBfR514ReHEhFfR EBFLe4af7aMDg4xmcdxG5vv.6oPKOQAo4XZ8z9ve6o7QxvNJVTnY06w_sX5OtDCcTZTgv9XrhZ9w loEoGa0sT6i2YKOPPUBgGEes0Wwdnyhj0T0qvJwoX9uC0BSK1Jxfx_FvQJMO92ukycr8PDo307E3 eNYJiIH3.M5_p0L5neoenEenP8c7zpPIPnKgHPYzg.vVpR2xOseAccAizTRDw3ErYpnCcGVuWrZD qDxd9pfljogCQquCyzOWEN7BuGlt5cXSp_gImTdtY1mfvMS7UhiQHVGNsQL22xhXOJdAJzYnX94m I5oC16iyUP9JcAIznRuJYgaUcr75nJaWgwNeMW7l.gXI5ljjNYQ3asVl8Vo3mta66gk0rWCAd4HG 09Or8ppoDw.NPz1DPArKV9gnUSM7zxzgkBOCH7bNIy5rctBut05gAze4_YHb1NeqXJ3Sphyw.jk1 IKbgjympwbFj48R.DG.JutRpGu9qjy0LjxSI36oZeQ.T2LdNHf2j1GEcNYeCRwccba4szOgxan7V y4x_GCo00U9uwsuc3nOvBYpQ36cwQJOA_u7PLsXhPKEdDMXtMXN9diDIUMN9.flgEVblXsWwm.Mv 7318f1pKAkFHZI7ZjdG900PCE6jMJVtHFxtHMiSDGI22Go3KemSnQTU4eANUMKrMfk_xF0KmhsgT w6RHiY4tWUid.GZsizEJ86hwSlJ9q3TGWIwDdeuVJtjylSnvuUXzEgCs4nJ6gQQUH9sQCgfC7Jjz R.SKm6KFoFjFHElD_LgQpqEXwnqYzggR5Ik.VA2Zl4ebvnBifFbq6xrtXGhiKqndkN7II5GpN0U5 PEvD_VGa2PQNJds_fL0usjYt5p45aZIYwcrR5loJ1GERHCp1n6roZz8hd33qpeBKnJJX716JSM0H ESU74eALp_guI3C20SQEpV8WS4WGUkJM8t3N7pJx8fwqTdPZLIeJgMLw7Q4tdnWXELzzjgQCgnM. kIz4dYtRRl4nKsBUvTtnNEzu3nHKyld0sLQmUxwnTRz_NQgCFKLJ2UfELreeKM9ahWiCO_0Rpi8D nJNDXsillfsPlOOFtSjJDDAOIOKumZtpJ4A0qDR0PehcRyR914UhvkwmypvQpYo6WmCzDoHdtWYA Pz4a63KjdAN_JsL528MTvvg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.ne1.yahoo.com with HTTP; Sun, 18 Aug 2019 08:27:53 +0000 Received: by smtp421.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 4c0de56aa4ddae1214284ac4aa70e38d; Sun, 18 Aug 2019 08:27:52 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.4 \(3445.104.11\)) Subject: Re: FYI: x11/xscreensaver appears to have a build-race From: Mark Millard In-Reply-To: Date: Sun, 18 Aug 2019 01:27:50 -0700 Cc: freebsd-ports@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: References: <6EAA8CE2-3521-42D9-9B6D-30C40CE442B4@yahoo.com> <40596e0e-d455-6b34-9564-e5d0c9c1ab95@freebsd.org> To: Niclas Zeising X-Mailer: Apple Mail (2.3445.104.11) X-Rspamd-Queue-Id: 46B9DC2mKQz4HWq X-Spamd-Bar: - X-Spamd-Result: default: False [-1.10 / 15.00]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.50)[-0.501,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.74)[0.745,0]; NEURAL_HAM_LONG(-0.84)[-0.843,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.00)[ip: (4.74), ipnet: 66.163.184.0/21(1.28), asn: 36646(1.02), country: US(-0.05)]; IP_SCORE_FREEMAIL(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[148.190.163.66.list.dnswl.org : 127.0.5.0]; RCVD_COUNT_TWO(0.00)[2] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 18 Aug 2019 08:27:56 -0000 On 2019-Aug-18, at 01:03, Niclas Zeising wrote: > On 2019-08-18 09:48, Mark Millard wrote: >> On 2019-Aug-18, at 00:34, Niclas Zeising = wrote: >>> On 2019-08-18 09:07, Mark Millard via freebsd-ports wrote: >>>> I ran two separate devel/poudriere-devel amd64->aarch64 >>>> cross builds on the same system (head -r 351178 based) >>>> with the same /usr/ports/ tree (ports head -r509171), >>>> building the same 97 ports each, mostly overlapping >>>> in time, and one got: >>>> gmake[2]: *** [Makefile:37: gen/apple_png.h] Error 2 >>>> while building x11/xscreensaver but the other >>>> completed building x11/xscreensaver just fine. >>>> There was also a armv7-targeting poudriere-devel ports >>>> update running, also mostly overlapping in time. With >>>> 28 FreeBSD CPUs (under Hyper-V), the load average was >>>> frequently over 90. (The armv7 x11/xscreensaver build >>>> also completed fine.) >>>> All 3 poudriere's had ALLOW_MAKE_JOBS=3Dyes and all 3 set >>>> up to have "Building 97 packages using 28 builders". >>>> devel/llvm90 was one of the ports being built. All 3 >>>> poudriere's had native-xtools in use. The context has >>>> ECC DRAM, 96 GiBytes worth. >>>=20 >>> I'm just about to update x11/xscreensaver, but through multiple = poudriere runs I haven't noticed any issues. I have a much smaller = machine to do builds on though. >>> It would be interesting to see more context of the error as well. >> Here you go: >=20 > Thank you >=20 >> The overall build is still in progress. So I've not had >> a chance to run poudriere again to have it retry just >> the 3 ports (1 failed and 2 skipped). (Presumes the rest >> build okay.) >> A race suggests that MAKE_JOBS_UNSAFE=3Dyes may well be appropriate. >=20 > I'll look into it. However, this is the only report I have of this = issue, so it's not very common, and setting MAKE_JOBS_UNSAFE would slow = down the build quite a lot. >=20 > The error is a little strange, since it looks like it is when = generating apple_png.h. I wonder which file it is that it complains = about not being there... =46rom what I can tell: ../../utils/bin2c apple.png gen/apple_png.h is supposed to produce gen/apple_png.h from the binary file apple.png . Presuming that is true, the: gmake[2]: *** [Makefile:37: gen/apple_png.h] Error 2 indicates that the Makefile tried to reference gen/apple_png.h before ../../utils/bin2c had gotten around to creating gen/apple_png.h (the race). Similar points go for gen/atm_png.h gen/atari_png.h and gen/earth_png.h . The original 3 builds completed so I started poudriere again for the failing one, without the machine being otherwise busy. The result was: [00:00:36] [01] [00:00:00] Building x11/xscreensaver | xscreensaver-5.42 [00:04:25] [01] [00:03:49] Finished x11/xscreensaver | = xscreensaver-5.42: Success This too suggests a race condition. If the FreeBSD port-build servers report this sort of failure at some point, you may then want to change things to avoid the failures on those servers so that dependent ports are not skipped. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)