From owner-freebsd-emulation@freebsd.org Sun May 17 23:35:28 2020 Return-Path: Delivered-To: freebsd-emulation@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 5D5E92F9358 for ; Sun, 17 May 2020 23:35:28 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic317-21.consmr.mail.gq1.yahoo.com (sonic317-21.consmr.mail.gq1.yahoo.com [98.137.66.147]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49QJRM0wMgz3cbJ for ; Sun, 17 May 2020 23:35:26 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-YMail-OSG: oEbrD.8VM1koBN.UNql_iffih3k38D3aFmdalY1c2DTS5dW6aW3klOatup6sFpt rRsut7LqK7zqyZQ8yfTshCwmPyA9FX21p2NCWDSivUW0n7zvLbTJqMfTKuk5taGeAM_Yp6tuSeet LvOe7r.e7phrsycfzQ4jxlpjHTXsnnKeZVPxVv7QzpK5vx_Uy4whehb7az9WInWnI7BniD8avNz2 KsScPwjvhX9QprG4xgVrQLlnBhaaZFrivODc9AKTpIaIAyVqiyQvCZRDhB7cT7zgvTnXV_p28pqN DWkimHxyr51WwXe8XpCw559Jmb9c9rJXnET9MD6v77YJJtxi3434OxOgmQx5WN2Qzi4DAK5I2Gh_ 9egVo7ebl_EMDiWwAkuAzjMoE2Uza4C4c8JmUC6fgQQlg92BQsBaUeHno9HdTjSrmYHDycK8CSHR itc1vN6PF_JDLVHOHzgUH8S_AkawKrA90la.HoPaRywvt_rjnpV.tcGKiDQbEUlfJpH1e_u70s8y CH5fK7ihFbkTcnkUz.7o8BPpZxJGMnZp3x1iJi5oAlTUdAr6odl4HpRLCRb2rkofaUihnxo05qJH Zj4vKZ5XMdL4X.DRexKKWhIJLLn6DM1loIex1dAs0Y2i.gxrDpX92Y4mhTfQnpeHZZy71x2D17.x O3gfoe7gFy7mo.e5mMvX6tIi2u_3rjHYcFhHwqfeG7cwiIVt1eed7SNx8Qbii7TcGaiCgJx24phD G46QQ46NJm285VBr.7wAmFzgqmG1clEG15UEr02J9IVZ3N9FKrYlEOcwAZz93.4R81kkschWbyh4 Fr9Xlqegik8J9e1IRsY6Muf68s2ZNRZz60I8r4U9Xst4JfcwT0DFMptTQSeOZe8wLOmhJ15IhjN8 G0tadAC4kLScmyuf.LL3JAzBRtqm3N3B6SKHLiiUWJuUkEPyv0kJhFnTg2PIW3RpIvyEN1JA1O2q MHgbWvw6M4Sd35qfxGCvMxpv7az6Jz0GhnbfYl3NLbyqCqjjorRswB012ntsG0SEHBODgBYpl8ZG BsjO2wj.ZODyrXDxO7SLHUkYhwlyDFgZDHV5tArj3tVUVjzAhtuM673T9lWvOZrBDw3w_K6W1rV1 Aw5hK4g2IDlDnedZa8vjizK.Lji5faQ_Bf41dabmk8qnjFqdu5N4s6IQfpXdeY5E2lFuG8uK9vzd w8sT_k.bnVbYgRsdaN75QJuVBPaoad58xVJyo0hP4GtWtCb3ZK1BPQM4N2PQ.wqiGqJuaoOJla3U pQwIxaETsjnkDndFfChGaJzkn4oWu2jSaKx6UN_2hvZdacCA2MNeOf8sYVdk_fczfZiXdrTg80UF ww_9McyNxroUb0_n54O8xvzv7.PmqDs5OsdVBVqGlkQE6G9LxoMYLcu84FQaMOmGZ5HCtg5ZrKoa 0Xw4XEMkOuxPXVrBo1tCfLqUWPg-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic317.consmr.mail.gq1.yahoo.com with HTTP; Sun, 17 May 2020 23:35:24 +0000 Received: by smtp419.mail.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 7874183d9202a337cdbbb9ad9c19fe7b; Sun, 17 May 2020 23:35:20 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 13.4 \(3608.80.23.2.2\)) Subject: Re: [Bug 246527] emulators/qemu-user-static: please add syscall 574 (__realpathat) Message-Id: <0EFAE09B-98C5-4F53-BB1F-A5C4754FA661@yahoo.com> Date: Sun, 17 May 2020 16:35:19 -0700 To: Kyle Evans , freebsd-emulation@freebsd.org X-Mailer: Apple Mail (2.3608.80.23.2.2) References: <0EFAE09B-98C5-4F53-BB1F-A5C4754FA661.ref@yahoo.com> X-Rspamd-Queue-Id: 49QJRM0wMgz3cbJ X-Spamd-Bar: / X-Spamd-Result: default: False [-0.99 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.66.147:from]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_MATCH_ENVRCPT_SOME(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; RCVD_IN_DNSWL_NONE(0.00)[98.137.66.147:from]; NEURAL_HAM_SHORT(-0.49)[-0.494]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/21, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim] X-Mailman-Approved-At: Mon, 18 May 2020 08:11:29 +0000 X-BeenThere: freebsd-emulation@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Development of Emulators of other operating systems List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 17 May 2020 23:35:28 -0000 Kyle Evans wrote: QUOTE --- Comment #3 from Kyle Evans --- Yup- I should have mentioned, if you do or are willing to build your own qemu-user-static port, I have a patch available here that updates it to = a version that implements most of the latest syscalls and seemingly fixes = issues with multi-threaded stuff:=20 https://reviews.freebsd.org/D24655 -> It doesn't fix the aforementioned signal regression, but it's generally stable. END QUOTE So I tried updating and then doing a poudriere bulk run on amd64 targeting armv7 (/nxb-bin/ style). I'm getting my historical style of hangups. First I'll list the example for lld getting no cpu time (from top): Building qt5-qmake-5.14.2 . . . 16570 root 52 0 540336Ki 199216Ki uwait 12 0:02 0.00% = qemu-arm-static -0 /usr/bin/ld -L /usr/gnemul/qemu-arm /usr/bin/ld = --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-s . . . (long list of threads) . . . 16570 root 52 0 540336Ki 199216Ki uwait 5 0:00 0.00% = qemu-arm-static -0 /usr/bin/ld -L /usr/gnemul/qemu-arm /usr/bin/ld = --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --hash-s In other words (showing the thread count instead): 16570 root 34 52 0 540336Ki 199216Ki uwait 12 0:03 = 0.00% qemu-arm-static -0 /usr/bin/ld -L /usr/gnemul/qemu-arm /usr/bin/ld = --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 --ha FYI, the matchup to that ld is: 16161 root 2 52 0 150652Ki 33900Ki wait 5 0:00 = 0.00% /usr/local/bin/qemu-arm-static clang++ -o ../bin/qmake main.o = meta.o option.o project.o property.o ioutils.o proitems.o qma An interesting point for that last is that clang++ was not via use of a /nxb-bin/ path. There also seem to be 4 gmake's that are stuck using about 100% of a cpu: 94366 root 2 103 0 99252Ki 22000Ki CPU14 14 40:30 = 99.76% /usr/local/bin/qemu-arm-static gmake DESTDIR=3D = RPATH_ENVVAR=3DLD_LIBRARY_PATH TARGET_SUBDIR=3Darmv7-portbld-freebsd13.0 = bindir=3D/ 17816 root 2 103 0 102076Ki 24388Ki CPU17 17 39:44 = 99.76% /usr/local/bin/qemu-arm-static gmake = DESTDIR=3D/wrkdirs/usr/ports/devel/aarch64-none-elf-gcc/work/stage = RPATH_ENVVAR=3DLD_LIBRA 26001 root 2 103 0 96544Ki 19152Ki CPU31 31 35:39 = 99.76% /usr/local/bin/qemu-arm-static gmake DESTDIR=3D = RPATH_ENVVAR=3DLD_LIBRARY_PATH TARGET_SUBDIR=3Darm-none-eabi = bindir=3D/usr/local/bi 42110 root 2 103 0 101120Ki 23820Ki CPU24 24 33:28 = 99.76% qemu-arm-static -0 gmake -L /usr/gnemul/qemu-arm = /usr/local/bin/gmake -f Makefile -j32 all Some of these have defunct subprocesses (from ps -auxd): Building ffmpeg-4.2.2_11,1 . . . root 42110 100.0 0.0 101120 23820 0 RJ 15:31 = 34:09.07 | | | `-- qemu-arm-static -0 gmake -L = /usr/gnemul/qemu-arm /usr/local/bin/gmake -f Makefile -j32 all root 44988 0.0 0.0 0 0 0 ZJ 15:32 = 0:15.08 | | | |-- root 44991 0.0 0.0 0 0 0 ZJ 15:32 = 0:42.60 | | | |-- root 44993 0.0 0.0 0 0 0 ZJ 15:32 = 0:53.06 | | | |-- root 45006 0.0 0.0 0 0 0 ZJ 15:32 = 0:30.58 | | | |-- root 45239 0.0 0.0 0 0 0 ZJ 15:32 = 0:17.28 | | | |-- root 45244 0.0 0.0 0 0 0 ZJ 15:32 = 0:15.74 | | | |-- root 45245 0.0 0.0 0 0 0 ZJ 15:32 = 0:09.55 | | | `-- Building arm-none-eabi-gcc-8.4.0_1 . . . root 26001 100.0 0.0 96544 19152 0 RJ 15:27 = 36:20.30 | | | `-- /usr/local/bin/qemu-arm-static = gmake DESTDIR=3D RPATH_ENVVAR=3DLD_LIBRARY_PATH TARGET_SUBDIR=3Darm-none root 34753 0.0 0.0 0 0 0 ZJ 15:30 = 0:46.74 | | | `-- Building gcc9-9.3.0_1 . . . root 94366 100.0 0.0 99252 22000 0 RJ 15:21 = 41:10.84 | | | `-- /usr/local/bin/qemu-arm-static = gmake DESTDIR=3D RPATH_ENVVAR=3DLD_LIBRARY_PATH TARGET_SUBDIR=3Darmv root 15615 0.0 0.0 0 0 0 ZJ 15:25 = 0:07.77 | | | |-- root 15616 0.0 0.0 0 0 0 ZJ 15:25 = 0:02.85 | | | |-- root 15617 0.0 0.0 0 0 0 ZJ 15:25 = 0:03.32 | | | |-- root 15618 0.0 0.0 0 0 0 ZJ 15:25 = 0:03.35 | | | |-- root 15623 0.0 0.0 0 0 0 ZJ 15:25 = 0:02.29 | | | |-- root 16142 0.0 0.0 0 0 0 ZJ 15:25 = 0:00.05 | | | `-- One does not: Building aarch64-none-elf-gcc-8.4.0_1 . . . root 17816 100.0 0.0 102076 24388 0 RJ 15:25 = 40:24.87 | | | `-- /usr/local/bin/qemu-arm-static gmake = DESTDIR=3D/wrkdirs/usr/ports/devel/aarch64-none-elf-gcc/work/sta I seem to also have one other stuck process that is not using cpu time: Building xcb-util-keysyms-0.4.0_1 . . . root 38255 0.0 0.0 91108 11408 0 IJ 15:08 = 0:00.00 | | `-- /usr/local/bin/qemu-arm-static = /usr/bin/nm conftest.o I'll leave them all running a while longer. There is also a boost-libs-1.72.0_2 running bjam but I expect this one to take a very long time, even when things are working well. So I expect that it might complete. For reference (top's TIME showing more like 62 minutes now instead of the 33+ minutes above): [FBSDFSSDjailArmV7-default] [2020-05-17_15h05m26s] [parallel_build:] = Queued: 237 Built: 141 Failed: 2 Skipped: 68 Ignored: 0 Tobuild: 26 = Time: 01:26:55 [01]: devel/qt5-qmake | qt5-qmake-5.14.2 = build (01:24:35 / 01:26:02) [02]: devel/arm-none-eabi-gcc | arm-none-eabi-gcc-8.4.0_1 = build (01:13:07 / 01:15:30) [03]: lang/gcc9 | gcc9-9.3.0_1 = build (01:16:34 / 01:18:31) [05]: devel/boost-libs | boost-libs-1.72.0_2 = stage (01:10:31 / 01:16:35) [11]: devel/aarch64-none-elf-gcc | aarch64-none-elf-gcc-8.4.0_1 = stage (01:06:29 / 01:18:41) [24]: multimedia/ffmpeg | ffmpeg-4.2.2_11,1 = build (01:00:31 / 01:02:47) [29]: x11/xcb-util-keysyms | xcb-util-keysyms-0.4.0_1 = configure (01:24:38 / 01:25:43) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)