From nobody Sun Oct 3 00:31:18 2021 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 8316F17ED0E6 for ; Sun, 3 Oct 2021 00:31:32 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-22.consmr.mail.gq1.yahoo.com (sonic309-22.consmr.mail.gq1.yahoo.com [98.137.65.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4HMPsv1W1wz3hHZ for ; Sun, 3 Oct 2021 00:31:31 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1633221084; bh=wCHZRzIaoqM1pAO5RFW8ddTKYVnEolIbmqJElXxsVoE=; h=From:Subject:Date:References:To:In-Reply-To:From:Subject:Reply-To; b=ADEgNmbcf948Ze9wHIbpzMuFWzYFuK67zbL80kVgsdFAUHjPM250OObSjBx8h2JliHH7EkFaqe6ufoF9AjFnNM7y2t+wN5WPM7HBserSVAzJrwZ7DEd9op03ci0hDDPkkMPWmAEDyU2oaEMCYaGqqPJsausQO0BNnd7XR+asij/UziES0P5UQ7YK6AyBuvskAXekPtPcsj7VkHGu26nnfvqr4XESkRVmYT97x7EBrO66T7gkJP1dZMHPkzJgl/dMrETWceIHgLnZPWTtluYOx/5S64WAp5EOJgKRJ2Uzt8OkND2D08AZb/aAgdJpUVndLfSH2xvvWjz+Tsh75gev7w== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1633221084; bh=7z6gtVETNZ+sYXcszVf58VE5EXgeKpv3B/25Pr/ZqyI=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=QcLS+gxal6RScX/z7YttASq6q0pg2i7yoBMyOU0zbXdYhJsXqe2BAXcSb7VV5Wabuj5Gd5wMd+ikhuMNVbbXN1m8Zgx3mqWqy8YBpWVAIQVfRtXtBHjZXJ0TbKk8JolfIgNJRI7GxwIRvvFPtzbtxEYgXrk9fG6zSftOW0qRb6rJ0fx/3Hx8rldu1/+NpAMLoMo9gcTMoL8Ip6Tdptu3nurZeyNXO1q+oy2VTOlNh90MFeq17r0phsomNjhJJM7t/oUBHDkKPEvBdnvUkQMnQNvh7UVK1sa/OqT8IsPNY79J5xupwltgIxIgZN8uvNd5w1mroD/fOnZl9hcdEWUzXA== X-YMail-OSG: vK2jCc8VM1k87Us5fk7cMokC..405XRmbWqD8sWjF_bjQ_TKAhPog.qBz4Ubcnf y3yEiIlWG0iQGnNuSlWBie3gvC3x3Wh6u_hlTyGQtfxbZMi5Robm1NRNB3TTve1UIK.smFTca9p4 IiOo0SNrgVxFvg2y_6IvTI0R7EY8uzyuPDw04kWr3.M_giLRwo0ReDy6EwvbOrTVhtwgJl40kJC2 ryxJEJvVPFDMDONS576NqOE0li1WI0R63woTepFCnESgg83005CExTGDdBRduwzrxRAJTYLB4YQJ aqhJoXLJathForEErmAXvfq_A.QRPIgnf807YZERWV0dFHNIx69ui3SKb5VEMsJ4LYijkfCpJlCL kE_wJa4JIVjeugBMjVLW_hNTgVTEOOfjyIx12uCmf0xFaTaWGFV6rzT7PWOF7B7p2brm5SVDNDu2 BU7xXeVjiGKDBff3DTvH01zWb6UErxKGRKMSlsqZfgxZGeJv_NNWhIFOR42e6FP0voRzegsHuzsF YAzn2ZDi.pFeZB2PVi5SdcoyeCLwSTJ87dAAxEGI3iov7m_A9EXdFJE2Zg7vmSR7It0ezKY.u3VF 1xA1Yde50rQ_mFiTnuU0tfGVrYpr.erc0y76SGRxus6MrxiyiAEH7htDd_YdxuWtJrUg0lKphXbU RfQj6AelkZxzSx5sHkr5IYPFzP5tYvfpoOYR29gEiDGDArU62dyOOl.dgrZ_wbkUNzpCwbnq4lZx HrtfZSQEkzUnREeTNuEhHgK1fAFRTemZvo21GZ7mI26_t.upxIR4_FYXUKqg9TT.tdcYyw0JR8wp cRN03pnLTXqp.80408UfPUfemhKTTzCRdRIVrcvWawhyc8qc3LzkTwfC4Cs071zgVe3MQ.ioQwis f.qrQlN0UwTJ6vy.omKTjkVfcUZdmFt7yM_G6Qzwe2GiehaGN7igCsZS1uw9A8nfgpgm7PdbVpm5 i1__vlICVLJtTMZKHd7bLQCv6PiWbCwHebTcetPBgMJgFa0Jd0NuB.ZYXXNIuFvZMkxfTC01ts._ oPIKXlJ3wVOTOM6ClSMTAhwKLEAtNNk6S9z8aRo1LZJfbQADTymVpAYwxXE2IBDUdNiUhndtcXWI IOJufG_pUfX.Er7utifbwqauyIHNeoeERYpgxAIVF2VPn6LicPJBV5vq3_DNvU2TKN1l0roLCRGm ul2C10pgKbXHbnQfn74wZQaoVIC94JfLppJqhlNJKecN0k4kUQMEzt.dcqgJInOnFrmwbwkFWbYX phFoeuocWPiQDUJGM7Bri1AbtGu.brzLT9tauvAoEHOJFQG6.THRzXJL_Mv.k1keT1dTOMDrrD7O lMRl9W1BsQnCj.bhhpXDEhkSzjhMEzR6FFKBQaIMjG9S4XWN0..gyaGG0El63SQOfntckNNncBQi UaYmz202Z_t_0XWtvL4O.HJkMnmDJz3iRZ2EA9oNJfM8yZUKSpo5.KbG4r4bqHNc.1J5aLw1qB1k nNqr.9ir8B96QJJ0lvUe6f0_jl2JibPLmtXYtS.Z67R3MFaNlmNSHq8wL.7T0v00jYHf1KzocAWo ow9RSU68lJAG_P.4Fvsr0.4CLR.Ej00PJBaRXahOVK2ilTXiE5UB8tJ91Y9GEVnDhls6pDVKaEUm Js5ajbHfy8EV24bs._fzxTedGSfP5txPw8KL.xUO9t_RlHORhWbiVAB9xweFQK8AZ.Oq30_tyPRW UTqVOPjNoo7utiQdIbe6Up6PeT5tV5qPBqJ2gQLhVDUSUAIk.k.mPuvjOa.8PejB46d.AZk7Rew0 6xDv2Y0jLo_0k30OQ3lDT5bwB4gAnS5WF80_kbwFte7.Z1B8KdyRQ_h5Ii.kbmVwb4U75aMgHo4D cptWIhN2OxCvu5YOl1WXy9E_UFbrzrU3HjVZFoz22m5WLWdUdPouEUazDGn3EXfUPnoWqQ9iP7r3 aPbxsL8a3xpCwqgNBmyFzPhK_G_aPDrRlwmnFA8SEPZ1OP7eo7DNmlIK1zFDHnzB1veaBD6W2NQ_ H7hnad5lFPs9KqH9eu.FMmaAua5_ZmjxcoQ1sIqqDEB69.Xyy8Bpkq_Tn7koPD_uB25ee.L8XP8P rRMQn0ue.mVJtJNmTsM0n4gzT8nhk488xUeZZk3d20qqIT8xNYf.KNj4BD7Fmed0LK32nNeinoQv 1lnbddahcdtk7PsmKDq7kiL90huEWqlk4UbcpU0bLuBeMZB7D22e6N9K9WleeAwlIfMsK9pNpuDe O93l.dE4d0533ict0hCGMeDTmRz62KCq2umlHzFTycN2kNGU_k9tpkJtMe4jlMx70kAgZHNCjEfB gDBN4_wR0wT90aUXA5WlYQAnyLcvgJ1wbXYupOn7Ct.hMfBZ7MisE6OswZZje05FWiRN6dZ7YM4F YVXOae0mo2A02onxCvvdbv25cUsB3LTnrMEXXrcWi_9n2SUnKNNE7XsW8.KNf0sAC6rXjgq.5KdS 2dtGdzZMtSSoKm.0ZFMirZ9eHeZjZj9Q- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Sun, 3 Oct 2021 00:31:24 +0000 Received: by kubenode520.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID e9338eb490071939a5910b11ec69f0ff; Sun, 03 Oct 2021 00:31:20 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: poudriere-devel bulk -a python-related www/chromium build failures (aarch64 context) Date: Sat, 2 Oct 2021 17:31:18 -0700 References: <497EAE44-E8D0-4193-B50B-27048D4357FF@yahoo.com> To: freebsd-ports@freebsd.org In-Reply-To: <497EAE44-E8D0-4193-B50B-27048D4357FF@yahoo.com> Message-Id: <7C864817-7C45-439A-9DD0-5C75CA5455D7@yahoo.com> X-Mailer: Apple Mail (2.3654.120.0.1.13) X-Rspamd-Queue-Id: 4HMPsv1W1wz3hHZ X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=ADEgNmbc; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.148 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; RCVD_TLS_LAST(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; MIME_GOOD(-0.10)[text/plain]; TO_DN_NONE(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; RCPT_COUNT_ONE(0.00)[1]; TO_MATCH_ENVRCPT_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.148:from]; NEURAL_HAM_SHORT(-1.00)[-1.000]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RCVD_COUNT_TWO(0.00)[2]; MID_RHS_MATCH_FROM(0.00)[]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.148:from] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-ports X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N On 2021-Sep-23, at 15:07, Mark Millard wrote: > So far my attempts at an aarch64 native bulk -a have had > www/chromium fail with: >=20 > . . . > python3 ../../build/util/python2_action.py = ../../third_party/blink/renderer/bindings/scripts/generate_bindings.py = --web_idl_database = gen/third_party/blink/renderer/bindings/web_idl_database.pickle --r > oot_src_dir ../../ --root_gen_dir gen --output_core_reldir = third_party/blink/renderer/bindings/core/v8/ --output_modules_reldir = third_party/blink/renderer/bindings/modules/v8/ enumeration callback_fun > ction callback_interface interface namespace typedef union > Traceback (most recent call last): > File = "/wrkdirs/usr/ports/www/chromium/work/chromium-92.0.4515.159/buildtools/fr= eebsd/clang-format", line 34, in > stdout, stderr =3D proc.communicate(input=3Dcontents) > File "/usr/local/lib/python3.8/subprocess.py", line 1028, in = communicate > stdout, stderr =3D self._communicate(input, endtime, timeout) > File "/usr/local/lib/python3.8/subprocess.py", line 1848, in = _communicate > input_view =3D memoryview(self._input) > TypeError: memoryview: a bytes-like object is required, not 'str' > Traceback (most recent call last): > File = "/wrkdirs/usr/ports/www/chromium/work/chromium-92.0.4515.159/buildtools/fr= eebsd/clang-format", line 34, in > stdout, stderr =3D proc.communicate(input=3Dcontents) > File "/usr/local/lib/python3.8/subprocess.py", line 1028, in = communicate > stdout, stderr =3D self._communicate(input, endtime, timeout) > File "/usr/local/lib/python3.8/subprocess.py", line 1848, in = _communicate > input_view =3D memoryview(self._input) > TypeError: memoryview: a bytes-like object is required, not 'str' > . . . (more such tracebacks) . . . >=20 > I do not see such a failure in the likes of: >=20 > = http://ampere2.nyi.freebsd.org/data/main-arm64-default/p5f5c0fe00a09_s3fcb= de5e88/logs/chromium-92.0.4515.159_2.log >=20 > I've yet to figure out why my build attempts are different. >=20 > For reference: >=20 > The deafult lvm is llvm12. >=20 > # pwd > /usr/ports > # ~/fbsd-based-on-what-commit.sh=20 > branch: main > merge-base: a59b4fa83271ce1a7610973b2a5f3f0362e4bfba > merge-base: CommitDate: 2021-09-21 01:12:16 +0000 > a59b4fa83271 (HEAD -> main, freebsd/main, freebsd/HEAD) = security/py-scramp: Update to 1.4.1 > n558469 (--first-parent --count for merge-base) >=20 > # uname -apKU > FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #12 = main-n249019-0637070b5bca-dirty: Tue Aug 31 02:24:20 PDT 2021 = root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm6= 4.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400032 1400032 >=20 > I do not normally build chromium or do bulk -a runs. > My activity is exploratory to see what problems I'd > run into and if I'd need adjustments to do bulk -a > runs successfully. (It has lead to the (root) file > system being made larger, for example. I also disabled > lang/ratfor because the port does not deal with > platforms that have char as unsigned but the port is > coded requiring a form of signed char. This avoided > unbounded looping and a timeout.) When I look at: = /wrkdirs/usr/ports/www/chromium/work/chromium-92.0.4515.159/buildtools/fre= ebsd/clang-format I see (in part): . . . contents =3D '' if '-' in args or not inputfiles: contents =3D sys.stdin.read() . . . proc =3D subprocess.Popen( ['clang-format'] + args, stdin=3Dsubprocess.PIPE, stdout=3Dsubprocess.PIPE, stderr=3Dsubprocess.PIPE, env=3Denv) stdout, stderr =3D proc.communicate(input=3Dcontents) . . . Which looks to me to be passing a str, not a bytes or bytearray and not None. Also Popen.stdin is documented with: QUOTE Popen.stdin If the stdin argument was PIPE, this attribute is a writeable stream = object as returned by open(). If the encoding or errors arguments were = specified or the universal_newlines argument was True, the stream is a text = stream, otherwise it is a byte stream. If the stdin argument was not PIPE, this attribute is None. END QUOTE So, if I gather correctly, stdin ends up being a byte stream acording to the documenation. proc.communicate is documented with "If streams were opened in text mode, input must be a string. Otherwise, it must be bytes." as well. And that in turn involves: /usr/local/lib/python3.8/subprocess.py has: def communicate(self, input=3DNone, timeout=3DNone): . . . stdout, stderr =3D self._communicate(input, endtime, = timeout) . . . So inpput still seems to be a str for the following: def _communicate(self, input, endtime, orig_timeout): . . . self._save_input(input) =20 if self._input: input_view =3D memoryview(self._input) . . . but self._input need not be. This is where: def _save_input(self, input): # This method is called from the _communicate_with_*() = methods # so that if we time out while communicating, we can = continue # sending input if we retry. if self.stdin and self._input is None: self._input_offset =3D 0 self._input =3D input if input is not None and self.text_mode: self._input =3D = self._input.encode(self.stdin.encoding, self.stdin.errors) The implication of the error would seem to be that the encode did not happen and, so, either self.stdin and self._input is None was false or: self.text_mode was false (and it appears to be the later). This fits with the stdin being a byte stream but input being a str --and so the error report from memoryview. But I still have no clue why the FreeBSD server builds of chromium do not end up with such an error report. Note: I've duplicated the failure in my amd64 context. The issue is not aarch64 specific in my environment. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)