From owner-freebsd-arm@freebsd.org Mon Dec 24 07:28:16 2018 Return-Path: Delivered-To: freebsd-arm@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id D14A0135995D for ; Mon, 24 Dec 2018 07:28:16 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic303-20.consmr.mail.ne1.yahoo.com (sonic303-20.consmr.mail.ne1.yahoo.com [66.163.188.146]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 7F87E73265 for ; Mon, 24 Dec 2018 07:28:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: USfH7uwVM1mN_Vom2xbVmt1a8ZuJMmK5wDkUqu5hPZCed.rUt2Qaz4umdHTYy7C Dd8e_FBRO4PNJTxMx_6t_l.g8j2Kk6VrQfdmTNlISv8eEIZqT4eFgbfDdBLMI3_y6hhpBqtfyPZQ nIxb8IJVE20S33uIMF_RFKAW9TM.LSIkZfOxD0_3zqVgFh9HOv7REpH4JuGMSvSBlK9xFIH_cPBj FpdgT4._gjabkLhVi9fyVpmDoR4Z1gZioe7J2PN2pkyGZvMOc8WDoKy1h9C9Kvxwi66vA33HeVEI 0kFM.JYThO3q7EOfJ04lnGHyjEKUckpstH0LH2..h8ZHm6T81GOUCBjZTElJw8r8aMuXc0bwZmbk iJSZnjcIjrsVsKGul3nlroQOGkuF0n47hanlENF_cXWl1JfO.1x2iaVUcP3eQr1bxHcDJm0bg5LD EZSrQxigTv7PCWd9rdZQiasK4MvJyazvyfWZRNna97D1TSMs26zHu5L5ujudGF6Toj71qh80U.zD tyH9k4NJ07FFdSrrCQzLEOB5.57idmo3qFwycNnGbWc0l13HnNM88_AS.9iOGjody_c1RFw58Bo4 Im.I72NQFyRq0l1Cbgb9DoaNsQSWYyyIu5MWbbjqMRL4bsvx6EQ7eS6Tk3nQU9nzVZyrfBhVgv1c 5Zmtl5VtxTHuBdhqRhmcvT_jqyJD9NwZqa51b8g3fMyyoW683JEQNfd1RF2249hdEQNX7MN3T7Pb tkzeYVu81xsE9UppwiwIgiqBWWc0GnMX5xwOfYLmII2NBPdyBpBXxATwYFqyhnlkiIbtMIiYyTh3 dTuB1WUodjck_FLuOWv2E0JdO4NcsQS3Qy4Bqn5myO9PfwpAG2I1yFyh8nhVPwlQuRteggDGr4xT AmZudsABZmMDmJBm6IwuJVWmvBo16VVWT4hUkUp_w2hatHEctCCNnxJ_KGYGc1YW5kLeQ0tQHxDW BhVLLqZcGAETpJcUW0DrI9etkBFB45qrZLHOgf3BtYv5YUP5WUEBjIziyHyCbMdJKkzcsNnp4QMR gCqqcxmUWXPJ5ECjt4OtrwKeiXDD3.mERDWVyKL1XdRPOdwMkapjw3V93P9YWVS6VFVK2nd9c_jc pExodOY8- Received: from sonic.gate.mail.ne1.yahoo.com by sonic303.consmr.mail.ne1.yahoo.com with HTTP; Mon, 24 Dec 2018 07:28:07 +0000 Received: from c-67-170-167-181.hsd1.or.comcast.net (EHLO [192.168.1.109]) ([67.170.167.181]) by smtp427.mail.ne1.yahoo.com (Oath Hermes SMTP Server) with ESMTPA ID bca93c63249a32ac899d0ee694652ba8; Mon, 24 Dec 2018 07:28:05 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 12.2 \(3445.102.3\)) Subject: Re: A reliable port cross-build failure (hangup) in my context (amd64->armv7 cross build, with native-tool speedup involved) From: Mark Millard In-Reply-To: <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> Date: Sun, 23 Dec 2018 23:28:04 -0800 Cc: freebsd-arm , FreeBSD Toolchain Content-Transfer-Encoding: quoted-printable Message-Id: References: <865A13C8-9749-486E-9F79-5EEDDECBE621@yahoo.com> <0154C3AC-D85B-4FCF-BA63-454BC26BC1A2@yahoo.com> To: freebsd-emulation@freebsd.org, FreeBSD Current , ports-list freebsd X-Mailer: Apple Mail (2.3445.102.3) X-Rspamd-Queue-Id: 7F87E73265 X-Spamd-Bar: / X-Spamd-Result: default: False [-0.95 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; MV_CASE(0.50)[]; FREEMAIL_FROM(0.00)[yahoo.com]; RCPT_COUNT_FIVE(0.00)[5]; RCVD_COUNT_THREE(0.00)[3]; DKIM_TRACE(0.00)[yahoo.com:+]; MX_GOOD(-0.01)[cached: mta6.am0.yahoodns.net]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36646, ipnet:66.163.184.0/21, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com.dwl.dnswl.org : 127.0.5.0]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.95)[-0.952,0]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_SPAM_SHORT(0.91)[0.908,0]; NEURAL_HAM_LONG(-0.98)[-0.985,0]; MIME_GOOD(-0.10)[text/plain]; IP_SCORE(0.59)[ip: (0.88), ipnet: 66.163.184.0/21(1.20), asn: 36646(0.96), country: US(-0.08)]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[146.188.163.66.list.dnswl.org : 127.0.5.0]; RWL_MAILSPIKE_POSSIBLE(0.00)[146.188.163.66.rep.mailspike.net : 127.0.0.17] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 24 Dec 2018 07:28:17 -0000 [I built a FreeBSD head -r340288 context and tried ports head -r484783 and the problem repeated.] On 2018-Dec-22, at 12:55, Mark Millard wrote: > [I found my E-mail records reporting successful builds using > qemu-user-static from ports head -r484783 under FreeBSD > head -r340287.] >=20 > On 2018-Dec-22, at 00:10, Mark Millard wrote: >=20 >> [I messed up the freebsd-emulation email address the first time I = sent >> this. I also forgot to indicate the qemu-user-static vintage = relationship.] >>=20 >> I had been reporting intermittent hang-ups for my = amd64->{aarch64,armv7} port cross >> builds in another message sequence. But it turns out that one thing I = ran into >> has hung-up every time, the same way, for amd64->armv7 cross builds: >> multimedia/gstreamer1-qt@qt5 . So I extract the material here into a = separate report >> with some updated notes. >>=20 >> A little context: I had built from ports head -r484783 before under = FreeBSD head >> -r340287 (as I remember the version). Back then it did not have this = problem that it >> now has under FreeBSD head -r341836 . One ports-specific change was = to force perl5.28 >> as the default instead of perl5.26 originally. In fact this is what = drives what is >> being rebuilt for my experiment that caught this. But I doubt the = perl version is >> important to the problem. The context has a Ryzen Threadripper 1950X = and has been >> tested both for FreeBSD under Hyper-V and for the same media = native-booted. Both >> hang-up at the same point as seen via ps or top. The native tools for = cross-build >> speedup were in use. Cross-builds targeting aarch64 did not get this = problem but >> targeting armv7 did. 121 of 129 armv7 ports built before the hang-up = for the first >> armv7 try. >>=20 >> ADDED: The qemu-user-static back with head -r340287 before installing = the >> updated ports would likely be different than the -r484783 vintage. So = both >> FreeBSD and qemu-user-static may have changed over the comparison. >=20 > CORRECTION to ADDED: Back on 2018-Nov-11 I reported successful = cross-builds > based on qemu-user-static from ports head -484783 --all built under = FreeBSD > head -r340287 . So the use of the perl5.28 as the forced-default and = the > newer FreeBSD head version -r341836 as the context are the differences = here. >=20 >> The hang-up: >>=20 >> In the port rebuilds targeting armv7, multimedia/gstreamer1-qt@qt5 = hung-up and timed >> out. Looking during the wait in later tries shows something much like = (from one of the >> examples): >>=20 >> root 33719 0.0 0.0 12920 3528 0 I 11:40 = 0:00.03 | | `-- sh: poudriere[FBSDFSSDjailArmV7-default][02]: = build_pkg (gstreamer1-qt5-1.2.0_14) (sh) >> root 41551 0.0 0.0 12920 3520 0 I 11:43 = 0:00.00 | | `-- sh: = poudriere[FBSDFSSDjailArmV7-default][02]: build_pkg = (gstreamer1-qt5-1.2.0_14) (sh) >> root 41552 0.0 0.0 10340 1744 0 IJ 11:43 = 0:00.01 | | `-- /usr/bin/make -C = /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 build >> root 41566 0.0 0.0 10236 1796 0 IJ 11:43 = 0:00.00 | | `-- /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELE >> root 41567 0.0 0.0 89976 12896 0 IJ 11:43 = 0:00.07 | | `-- /usr/local/bin/qemu-arm-static ninja = -j28 -v all >> root 41585 0.0 0.0 102848 25056 0 IJ 11:43 = 0:00.10 | | |-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >> root 41586 0.0 0.0 102852 25072 0 IJ 11:43 = 0:00.11 | | `-- /usr/local/bin/qemu-arm-static = /usr/local/bin/cmake -E cmake_autogen /wrkdirs/usr/ports/multimedia/g >>=20 >> or as top showed it: >>=20 >> 41552 root 1 52 0 10M 1744K 0 wait 15 0:00 = 0.00% /usr/bin/make -C /usr/ports/multimedia/gstreamer1-qt FLAVOR=3Dqt5 = build >> 41566 root 1 52 0 10M 1796K 0 wait 1 0:00 = 0.00% /bin/sh -e -c (cd = /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/.build; if ! = /usr/bin/env QT_SELECT=3Dqt5 QMAKEMODULES >> 41567 root 2 52 0 88M 13M 0 select 4 0:00 = 0.00% /usr/local/bin/qemu-arm-static ninja -j28 -v all >> 41585 root 2 52 0 100M 24M 0 kqread 8 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >> 41586 root 2 52 0 100M 24M 0 kqread 22 0:00 = 0.00% /usr/local/bin/qemu-arm-static /usr/local/bin/cmake -E = cmake_autogen /wrkdirs/usr/ports/multimedia/gstreamer1-qt/work-qt5/. >>=20 >> So: waiting in kqread trying to run cmake. >>=20 >> Unlike some intermittent hang-ups, attaching-then-detaching via gdb = does not >> resume the hung-up processes. Kills of the processes waiting on = kqread stop >> the build. >>=20 >> Given the prior ports have been built already, building just >> multimedia/gstreamer1-qt@qt5 still gets the hang-up at the same = point. >>=20 >> Building anything that requires multimedia/gstreamer1-qt@qt5 seems to = be >> solidly blocked in my environment. I built a FreeBSD head -r340288 context and tried cross-buiding an amd64->armv7 ports head -r484783 of my usual ports and the problem repeated. I also found evidence that originally in the old time frame I'd disabled part of my originally-intended port builds because of other problems so multimedia/gstreamer1-qt 's build was not being tried. So the qemu-user-static vintage or content may be what to vary to narrow down the problem instead of bisecting FreeBSD kernel or world vintages. clang7 building qemu-user-static or the kernel/world has been eliminated. (I used -r340288 to match a artifact.ci.freebsd.org build, incorrectly expecting to bisect via kernel substitutions.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)