From owner-freebsd-current@freebsd.org Sat Dec 22 08:10:25 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 3FF26134A13A for ; Sat, 22 Dec 2018 08:10:25 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-13.consmr.mail.bf2.yahoo.com (sonic311-13.consmr.mail.bf2.yahoo.com [74.6.131.123]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 98B7D7600B for ; Sat, 22 Dec 2018 08:10:23 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: 00_AYygVM1n.r2zTFDBgo6Qzlb4DEIcbm8wNIaXGaa6wIEMnhhdRmLY4F3kS2OV qucmF_2nks3QmCbDQwCUZrJl3ox3uFLsjAUf3O4_KwUsDFFL94eytyvrHlsHbZApWxlTDOWzw5ad wxSn9mTIpZgLTd5NutDqnrPaI.PYiRQmorshO.CMUdSkS3CU0h_axUIQ47mTEWCE8uLx6M0FeG6W hyC4nCG5YuIgPTvyWN30qygMZexqb7ph8eljqjUk4vNAvAr1_BQiZDMZbWVzbUAzJZfizu52t423 DekEJ3fUaA3ixYlvKbyy2FvCrKH0wQbODk6y8yJTYg1LajCnOa3FUuxPx_5wMG2xkUsBc5qOyFVc hJUUQs9Z8NH_UqBFABGqmkGwCdDGVV_S5Rw08xg1Dfi287XstrKq2dROUJLLDtPNAgXjz1GO8.G_ 0fegxANvPS6hUCd3NrBvrJhD3ArH5lI5OC2TLBimEeBdfLPHZ0OiXoZ.LxhR.dUx67H5SUrtKsBj hCFWc5WaPX53NaKkVRnUEULs5FzXu57RWLQxPykjfF24SHjDvqYI4oiTvnP6MXLM9udO7PJTpR6R p0hw4LeM40A0GzlO7xMgJF5ZMj_EiKe3rM2BRpff6zJYHFRaD8et7a0o1W2doKQTc5pAqxj0nAv0 VBcNQ59ZRMJxdVbug23O_vYk7FC6eWehie9S5wERNS7Qi2AJ5ri4FHtnMMSTikYSsk3smWh3Iv8_ ljWJ9OZGal74mFFcBeh8XbV4AAxlhZKI2VvhIX_THdwWgqDOn.ZP8gyKCHs8_1Gawlc6SZl7pYSx ecWFpKDpY1G5dH3nsz5_Rmh20MKfso6Vbco.MZBc4I_E3ZIrfqWo0A8xvPhbECAtkD8MrYzbTjSw CjP55jwJ_l7J.kAFdzB_.FZwpUhuktWTkYLQVu3wLr1UwC43ZJWqpo2fDr5sF06st1fqoCAN5Cmy gCynnEA5rwTer6mWI3osko1R2ERotO9K_g3T.J.ztHLKsyj8wIjfYz8C7qYi4J6dEQesHd76SiSr CBfKRhcDnHeSCffcUMyLkqjL.7rSpIFlkqzX7YfbkKq4VKqmXuorJYP350E75hEZzntLupdNXOtL Mv5MWjw-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.bf2.yahoo.com with HTTP; Sat, 22 Dec 2018 08:10:16 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp403.mail.bf1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID bdc0811dc73c0818dc840b939212d3b0; Sat, 22 Dec 2018 08:10:13 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: Date: Sat, 22 Dec 2018 00:10:11 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> References: To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 98B7D7600B X-Spamd-Bar: + X-Spamd-Result: default: False [1.47 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:26101, ipnet:74.6.128.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.22)[-0.220,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.99)[0.993,0]; NEURAL_HAM_LONG(-0.38)[-0.382,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(1.59)[ip: (5.08), ipnet: 74.6.128.0/21(1.64), asn: 26101(1.31), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[123.131.6.74.list.dnswl.org : 127.0.5.0] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 22 Dec 2018 08:10:25 -0000 [I messed up the freebsd-emulation email address the first time I sent this. I also forgot to indicate the qemu-user-static vintage = relationship.] I had been reporting intermittent hang-ups for my amd64->{aarch64,armv7} = port cross builds in another message sequence. But it turns out that one thing I = ran into has hung-up every time, the same way, for amd64->armv7 cross builds: multimedia/gstreamer1-qt@qt5 . So I extract the material here into a = separate report with some updated notes. A little context: I had built from ports head -r484783 before under = FreeBSD head -r340287 (as I remember the version). Back then it did not have this = problem that it now has under FreeBSD head -r341836 . One ports-specific change was to = force perl5.28 as the default instead of perl5.26 originally. In fact this is what = drives what is being rebuilt for my experiment that caught this. But I doubt the perl = version is important to the problem. The context has a Ryzen Threadripper 1950X and = has been tested both for FreeBSD under Hyper-V and for the same media = native-booted. Both hang-up at the same point as seen via ps or top. The native tools for = cross-build speedup were in use. Cross-builds targeting aarch64 did not get this = problem but targeting armv7 did. 121 of 129 armv7 ports built before the hang-up for = the first armv7 try. ADDED: The qemu-user-static back with head -r340287 before installing = the updated ports would likely be different than the -r484783 vintage. So = both FreeBSD and qemu-user-static may have changed over the comparison. The hang-up: In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 = hung-up and timed out. Looking during the wait in later tries shows something much like = (from one of the examples): root 33719 0.0 0.0 12920 3528 0 I 11:40 0:00.03 | = | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg = (gstreamer1-qt5-1.2.0_14) (sh) root 41551 0.0 0.0 12920 3520 0 I 11:43 0:00.00 | = | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) root 41552 0.0 0.0 10340 1744 0 IJ 11:43 0:00.01 | = | `-- /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt = FLAVOR=3Dqt5 build root 41566 0.0 0.0 10236 1796 0 IJ 11:43 0:00.00 | = | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE root 41567 0.0 0.0 89976 12896 0 IJ 11:43 0:00.07 | = | `-- /usr/local/bin/qemu-arm-static ninja -j28 -v all root 41585 0.0 0.0 102848 25056 0 IJ 11:43 0:00.10 | = | |-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g root 41586 0.0 0.0 102852 25072 0 IJ 11:43 0:00.11 | = | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g or as top showed it: 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 = 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 = build 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 = 0.00% /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELECT=3Dqt5 QMAKEMODULES 41567 root 2 52 0 88M 13M 0 select 4 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. So: waiting in kqread trying to run cmake. Unlike some intermittent hang-ups, attaching-then-detaching via gdb does = not resume the hung-up processes. Kills of the processes waiting on kqread = stop the build. Given the prior ports have been built already, building just multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same point. Building anything that requires multimedia/gstreamer1-qt@qt5 seems to be solidly blocked in my environment. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)