From owner-freebsd-ports@freebsd.org Mon Dec 31 20:05:52 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 8FFAA143E895 for ; Mon, 31 Dec 2018 20:05:52 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.ne1.yahoo.com (sonic310-22.consmr.mail.ne1.yahoo.com [66.163.186.203]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 35F2482F52 for ; Mon, 31 Dec 2018 20:05:51 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: UQN7FI0VM1n5nZk3WR3voHWoQkVFc6BC1vW._8LcwBAopbwO7AHVzxG7qmOPrlx u50CR1tA3.WxwmDlKbwNj8g8eYbLA4i8GBr2XryOSXBXnkHqCyf7wR..dwylwJosA8HBa8z9xNDk l5a7x3z.bV17_Ej_JvXYfE0Mo7jL_cOhTJzIlzNHi6xRUffUJdSAZCRLmBEWGWwIlvI7G22Ud.Ta D7HveKucFNnU7jtBYndMvV6b5BAh9aRJ.RlMm18pzIxflRK0pBA1a9olyHtbtRGJv7lXtnRTr60q 0FdzRc6Em3k_Qgoy3q.WEa1pxqav4MpLlaiTi0Tjbjg_6Bie.3qvw46S7Uv2.baDUmJgXYEhcnuK CUYHQpVZSzZkovyYweOeM47ig8Hj1qK8_HPkcufNw_.ADmUqk0E6_v.BtPX_GWrMPJqfNoVG8rID G9e4gh6SCTaZiQRxOwSOZs3Jow5lMbx1w4F0MS3R1zexC0O.FnurA7ey2GL4MxJnVLRUimGkWUJc AzNip8NuCDI4X8EOq6rfHsX9qDta_ZpiElLGPMROOrtM8SybWX6k9mzFaPX5.0.VxFITauYev82o 25wWdSe0iaIwl.eYGb0Ik7GH4qTefPVzuYmsWDsiSTdS4movVJz2XaTAbjVtuYN2pZvhg_MGGevb EcjeejGw.VhCRi69NPw3ADGA33XGbsoHeDyZXo.eiTcM1WPMBSOHtkne8kqijQbadAKhOOJVbqK0 kmVzK9fPFTKDH4pkMRQUleVMk_mVSDQlVLY4qc1efmZTPDTquHdJiC_tQMtsDqpuhEs46acJR5T4 txwRCOVOntd13W42m.2PwnHMq_nBea.440oPOkGeapy1tPXkUJje0hHqesXDCd3PSmQhLVe5oypm uCGoXH82YZnQD1_QWmEpHiGkf3Ayx_yfaBN9kN_DFaumSZOkDKilGebtSBVUzbOMwZP_1cIcg9jJ bA.df6KbWuB8F1p0.bP.FAzSarQjsYPBZMkYyGoKNAk2POecB5ZvKqYqGPqbLhuOGJYt1qh0xSbS mCKsJ0AujfgArFk5N6KAnPv2Z69tLoKudQpOmBUJgxASb77WfuQ6RsbXhYe.4t2WUCs8w Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.ne1.yahoo.com with HTTP; Mon, 31 Dec 2018 20:05:43 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp409.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID 0742405770bc6c0a367a982b1de2352c; Mon, 31 Dec 2018 20:05:39 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) [details of a specific qemu-arm-static source code problem] From: Mark Millard In-Reply-To: Date: Mon, 31 Dec 2018 12:05:37 -0800 Cc: freebsd-emulation@freebsd.org, FreeBSD Current , freebsd-arm , ports-list freebsd , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <984303F3-ADCD-442A-B1E9-412B8365B399@yahoo.com> References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> <13f5e4dd-33fb-2170-e31a-1b5d5f155869@freebsd.org> <2E3F6196-4652-40D2-937F-8860B6005A35@yahoo.com> <82478A45-7D15-4995-B333-FC42B39E5345@yahoo.com> To: Jonathan Chen X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 35F2482F52 X-Spamd-Bar: / X-Spamd-Result: default: False [0.55 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[6]; RCVD_COUNT_THREE(0.00)[3]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.50)[-0.495,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.84)[0.844,0]; NEURAL_HAM_LONG(-0.40)[-0.397,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.11)[ip: (3.58), ipnet: 66.163.184.0/21(1.13), asn: 36646(0.91), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[203.186.163.66.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 31 Dec 2018 20:05:52 -0000 On 2018-Dec-31, at 10:16, Jonathan Chen wrote: > On Mon, 31 Dec 2018 at 21:05, Mark Millard = wrote: > [...] >> But if you have a form of hang-up that shows no sign of being tied >> to kevent or hangs-up only sometimes, I'd be surprised if the = __packed >> change(s) would fix the issue. >=20 > With the __packed-modified qemu-user-static, the amd64->armv7 > crossbuilds does not hang anymore, but I get build failures instead. > Interestingly enough, an unmodified qemu-user-static gets further > along in a amd64->armv6 crossbuild, with only one reproducible hang. I tend to compare cross-build failures to native-build attempts. The multimedia-gstreamer1-qt@qt5 hang-up was qemu-arm-static specific, not occurring native. That and being reliable about hanging-up is what prompted the investigation. The lld thread fanout hangup also has only happened under qemu-arm-static but I do not have a context with more than 4 cores for armv7: far less than 28 (FreeBSD under Hyper-V) or 32 cpus (FreeBSD native) that I use for cross-builds. I do not know if you care to but it is possible to see if the FreeBSD package builders get failures or hangs for the same ports. I use head port build examples below: http://beefy16.nyi.freebsd.org/jail.html?mastername=3Dhead-armv7-default http://beefy8.nyi.freebsd.org/jail.html?mastername=3Dhead-armv6-default The pages displayed show a list of port version (p??????) and freebsd version (s??????) looking like p??????_s?????? . Those links take you to pages for exploring the built, failed, skipped, and ignored ports. Of course, for race-condition problems in builds, checking is messier because of needing to look at possibly many port/system combinations. My attempts to build x11/lumina fail for: [00:01:02] [01] [00:00:00] Building multimedia/libvpx | libvpx-1.7.0_2 [00:02:23] [01] [00:01:21] Saved multimedia/libvpx | libvpx-1.7.0_2 = wrkdir to: = /usr/local/poudriere/data/wrkdirs/FBSDFSSDjailArmV7-default/default/libvpx= -1.7.0_2.tar [00:02:23] [01] [00:01:21] Finished multimedia/libvpx | libvpx-1.7.0_2: = Failed: build [00:02:24] [01] [00:01:22] Skipping multimedia/ffmpeg | ffmpeg-4.1,1: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-libav | = gstreamer1-libav-1.14.4_2: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping multimedia/gstreamer1-plugins-core | = gstreamer1-plugins-core-1.14: Dependent port multimedia/libvpx | = libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping x11/lumina | lumina-1.4.1,3: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed [00:02:24] [01] [00:01:22] Skipping x11/lumina-core | lumina-core-1.4.1: = Dependent port multimedia/libvpx | libvpx-1.7.0_2 failed . . . [00:06:19] Failed ports: multimedia/libvpx:build [00:06:19] Skipped ports: multimedia/ffmpeg multimedia/gstreamer1-libav = multimedia/gstreamer1-plugins-core x11/lumina x11/lumina-core [FBSDFSSDjailArmV7-default] [2018-12-30_17h04m02s] [committing:] Queued: = 7 Built: 1 Failed: 1 Skipped: 5 Ignored: 0 Tobuild: 0 Time: = 00:06:16 Native build attempts on an armv7 get the same. But I'm still at: # svnlite info | grep "Re[plv]" Relative URL: ^/head Repository Root: svn://svn.freebsd.org/base Repository UUID: ccf9f872-aa2e-dd11-9fc8-001c23d0bc1f Revision: 341836 Last Changed Rev: 341836 because I froze at that while investigating the reliable hang and have not started progressing again yet. Last I looked the head-armv7-default package builds were also failing for libvpx if I remember right. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)