From nobody Sat Sep 11 23:43:55 2021 X-Original-To: freebsd-arm@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id A412D17C6173 for ; Sat, 11 Sep 2021 23:43:57 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (fuz.su [IPv6:2001:41d0:8:e508::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256 client-signature RSA-PSS (2048 bits) client-digest SHA256) (Client CN "amnesiac", Issuer "amnesiac" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 4H6Tph5M7wz4hvd for ; Sat, 11 Sep 2021 23:43:56 +0000 (UTC) (envelope-from fuz@fuz.su) Received: from fuz.su (localhost [127.0.0.1]) by fuz.su (8.16.1/8.16.1) with ESMTPS id 18BNhtOV042556 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO) for ; Sun, 12 Sep 2021 01:43:55 +0200 (CEST) (envelope-from fuz@fuz.su) Received: (from fuz@localhost) by fuz.su (8.16.1/8.16.1/Submit) id 18BNhtV0042555 for freebsd-arm@freebsd.org; Sun, 12 Sep 2021 01:43:55 +0200 (CEST) (envelope-from fuz) Date: Sun, 12 Sep 2021 01:43:55 +0200 From: Robert Clausecker To: Mark Millard via freebsd-arm Subject: Re: armv7 (on aarch64) 13 GByte+ poudriere build logs (and growing) for devel/cargo-c and for devel/rust-cbindgen (build stage over 15 Hr each so far) Message-ID: References: <67875293-A964-4471-A7A8-D027243A4629@yahoo.com> <5CFAC3D9-FE4A-4A0B-8897-ECF12EB2FF05@yahoo.com> List-Id: Porting FreeBSD to ARM processors List-Archive: https://lists.freebsd.org/archives/freebsd-arm List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-arm@freebsd.org MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5CFAC3D9-FE4A-4A0B-8897-ECF12EB2FF05@yahoo.com> X-Rspamd-Queue-Id: 4H6Tph5M7wz4hvd X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of fuz@fuz.su designates 2001:41d0:8:e508::1 as permitted sender) smtp.mailfrom=fuz@fuz.su X-Spamd-Result: default: False [-3.30 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+a:c]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-arm@freebsd.org]; DMARC_NA(0.00)[fuz.su]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000]; TO_DN_ALL(0.00)[]; NEURAL_HAM_SHORT(-1.00)[-0.996]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:16276, ipnet:2001:41d0::/32, country:FR]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[] X-ThisMailContainsUnwantedMimeParts: N Hi Mark, Please read the relevant PR. I have enumerated all ports that fail with this kind of error by painstakingly compiling them all and watching the logs for unexpected growth. No need to do it again. Yours, Robert Clausecker Am Sat, Sep 11, 2021 at 04:32:42PM -0700 schrieb Mark Millard via freebsd-arm: > On 2021-Sep-11, at 15:48, Mark Millard wrote: > > > > On 2021-Sep-11, at 15:17, Mark Millard wrote: > > > >> The following is from an on-going attempt at a poudreire bulk -a build targeting > >> armv7 on an aarch64 system (Cortext-A72's). > >> > >> From ps -auxd : > >> > >> root 32585 0.0 0.0 15540 6708 1 I 23:16 0:00.20 | |-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh) > >> root 58437 0.0 0.0 15540 6700 1 I 23:22 0:00.00 | | `-- sh: poudriere[main-CA7-default][15]: build_pkg (cargo-c-0.9.2_1) (sh) > >> root 58440 0.0 0.0 6760 4232 1 IJ 23:22 0:00.15 | | `-- /usr/bin/make -C /usr/ports/devel/cargo-c build > >> root 58459 41.3 0.1 203760 80560 1 SJ 23:22 342:31.37 | | `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9.2+cargo-0.55/C > >> root 61396 0.0 3.0 2078828 1995664 1 IJ 23:23 33:21.39 | | `-- /usr/local/bin/rustc --crate-name im_rc --edition=2018 /wrkdirs/usr/ports/devel/cargo-c/work/cargo-c-0.9. > >> > >> # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log > >> -rw-r--r-- 3 root wheel 13355735461 Sep 11 14:35:46 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/cargo-c-0.9.2_1.log > >> > >> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5 > >> stack backtrace: > >> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. > >> > >> error: internal compiler error: unexpected panic > >> > >> note: the compiler unexpectedly panicked. this is a bug. > >> > >> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md > >> > >> note: rustc 1.54.0 running on armv7-unknown-freebsd > >> > >> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib > >> > >> note: some of the compiler flags provided by cargo are hidden > >> > >> query stack during panic: > >> #0 [trimmed_def_paths] calculating trimmed def paths > >> #1 [lint_mod] linting module `vector` > >> #2 [analysis] running analysis passes on this crate > >> end of query stack > >> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13 > >> stack backtrace: > >> 0: 0x4704a088 - ::fmt::h62ff206af4f307a3 > >> 1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e > >> 2: 0x47039e34 - > >> > >> . . . > >> > >> 54: 0x41ec94e4 - > >> 55: 0x4703fbd0 - > >> 56: 0x401361bc - > >> 57: 0x40135cd8 - pthread_create > >> 58: 0x40138b64 - pthread_peekjoin_np > >> 59: 0x40138b64 - pthread_peekjoin_np > >> 60: 0x40138b64 - pthread_peekjoin_np > >> 61: 0x40138b64 - pthread_peekjoin_np > >> . . . > >> 305514048: 0x40138b64 - pthread_peekjoin_np > >> 305514049: 0x40138b64 - pthread_peekjoin_np > >> 305514050: 0x40138b64 - pthread_peekjoin_np > >> 305514051: 0x40138b64 - pthread_peekjoin_np > >> 305514052: 0x40138b64 - pthread_peekjoin_np > >> 305514053: 0x40138b64 - pthread_peekjoin_np > >> 305514054: 0x40138b64 - pthread_peekjoin_np > >> 305514055: 0x40138b64 - pthread_peekjoin_np > >> . . . > >> > >> > >> root 84847 0.0 0.0 15540 6704 1 I 23:09 0:00.14 | |-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh) > >> root 680 0.0 0.0 15540 6696 1 I 23:11 0:00.00 | | `-- sh: poudriere[main-CA7-default][16]: build_pkg (rust-cbindgen-0.20.0_1) (sh) > >> root 683 0.0 0.0 6120 3512 1 IJ 23:11 0:00.08 | | `-- /usr/bin/make -C /usr/ports/devel/rust-cbindgen build > >> root 709 80.8 0.1 116812 54448 1 RJ 23:11 362:50.69 | | `-- /usr/local/bin/cargo build --manifest-path /wrkdirs/usr/ports/devel/rust-cbindgen/work/cbindgen-0.20.0/Car > >> root 1882 12.9 3.0 2045144 1970100 1 IJ 23:11 35:48.21 | | `-- /usr/local/bin/rustc --crate-name tempfile --edition=2018 /wrkdirs/usr/ports/devel/rust-cbindgen/work/cb > >> > >> # ls -TldtL /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log > >> -rw-r--r-- 3 root wheel 13910063729 Sep 11 14:36:43 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/rust-cbindgen-0.20.0_1.log > >> > >> thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5 > >> stack backtrace: > >> note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. > >> > >> error: internal compiler error: unexpected panic > >> > >> note: the compiler unexpectedly panicked. this is a bug. > >> > >> note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md > >> > >> note: rustc 1.54.0 running on armv7-unknown-freebsd > >> > >> note: compiler flags: -C opt-level=2 -C embed-bitcode=no -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib > >> > >> note: some of the compiler flags provided by cargo are hidden > >> > >> query stack during panic: > >> #0 [trimmed_def_paths] calculating trimmed def paths > >> #1 [lint_mod] linting module `file` > >> #2 [analysis] running analysis passes on this crate > >> end of query stack > >> thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13 > >> stack backtrace: > >> 0: 0x4704a088 - ::fmt::h62ff206af4f307a3 > >> 1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e > >> 2: 0x47039e34 - > >> 3: 0x470443fc - > >> . . . > >> 51: 0x4703fbd0 - > >> 52: 0x401361bc - > >> 53: 0x40135cd8 - pthread_create > >> 54: 0x40138b64 - pthread_peekjoin_np > >> 55: 0x40138b64 - pthread_peekjoin_np > >> 56: 0x40138b64 - pthread_peekjoin_np > >> 57: 0x40138b64 - pthread_peekjoin_np > >> 58: 0x40138b64 - pthread_peekjoin_np > >> . . . > >> 320127389: 0x40138b64 - pthread_peekjoin_np > >> 320127390: 0x40138b64 - pthread_peekjoin_np > >> 320127391: 0x40138b64 - pthread_peekjoin_np > >> 320127392: 0x40138b64 - pthread_peekjoin_np > >> 320127393: 0x40138b64 - pthread_peekjoin_np > >> 320127394: 0x40138b64 - pthread_peekjoin_np > >> 320127395: 0x40138b64 - pthread_peekjoin_np > >> . . . > >> > >> For reference: > >> > >> I have higer timeout figures set for poudriere than the > >> defaults. > >> > >> I have since forced the two builders to stop by killing > >> processes. > >> > >> I will be deleteing the log files because of their size. > >> > >> The system is a HoneyComb (16 core Cortext-A72). > >> > >> # uname -apKU > >> FreeBSD CA72_16Gp_ZFS 14.0-CURRENT FreeBSD 14.0-CURRENT #12 main-n249019-0637070b5bca-dirty: Tue Aug 31 02:24:20 PDT 2021 root@CA72_16Gp_ZFS:/usr/obj/BUILDs/main-CA72-nodbg-clang/usr/main-src/arm64.aarch64/sys/GENERIC-NODBG-CA72 arm64 aarch64 1400032 1400032 > >> > >> # poudriere jail -i -jmain-CA7 > >> Jail name: main-CA7 > >> Jail version: 14.0-CURRENT > >> Jail arch: arm.armv7 > >> Jail method: null > >> Jail mount: /usr/obj/DESTDIRs/main-CA7-poud > >> Jail fs: > >> Jail updated: 2021-06-27 17:58:33 > >> Jail pkgbase: disabled > >> > >> # cd /usr/ports/ > >> # ~/fbsd-based-on-what-commit.sh > >> branch: main > >> merge-base: b0c4eaac2a3aa9bc422c21b9d398e4dbfea18736 > >> merge-base: CommitDate: 2021-09-07 21:55:24 +0000 > >> b0c4eaac2a3a (HEAD -> main, freebsd/main, freebsd/HEAD) security/suricata: Add patch for upstream locking fix > >> n557269 (--first-parent --count for merge-base) > >> > >> There are other ports that fail to build in various ways, > >> but so far these two have the only system-wide nasty > >> consequences for their failure mode. > >> > > > > Another one: sysutils/potnet > > > > # ls -Tld /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log > > -rw-r--r-- 3 root wheel 8463393229 Sep 11 15:39:44 2021 /usr/local/poudriere/data/logs/bulk/main-CA7-default/2021-09-10_17h13m49s/logs/potnet-0.4.4_14.log > > > > thread 'rustc' panicked at 'capacity overflow', library/alloc/src/raw_vec.rs:560:5 > > stack backtrace: > > note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace. > > > > error: internal compiler error: unexpected panic > > > > note: the compiler unexpectedly panicked. this is a bug. > > > > note: we would appreciate a bug report: https://github.com/rust-lang/rust/issues/new?labels=C-bug%2C+I-ICE%2C+T-compiler&template=ice.md > > > > note: rustc 1.54.0 running on armv7-unknown-freebsd > > > > note: compiler flags: -C embed-bitcode=no -C debug-assertions=off -C target-cpu=cortex-a7 -C linker=cc -C link-arg=-fstack-protector-strong --crate-type lib > > > > note: some of the compiler flags provided by cargo are hidden > > > > query stack during panic: > > #0 [trimmed_def_paths] calculating trimmed def paths > > #1 [typeck] type-checking `::fmt` > > #2 [typeck_item_bodies] type-checking all item bodies > > #3 [analysis] running analysis passes on this crate > > end of query stack > > thread 'rustc' panicked at 'cannot panic during the backtrace function', library/std/src/../../backtrace/src/lib.rs:147:13 > > stack backtrace: > > 0: 0x4704a088 - ::fmt::h62ff206af4f307a3 > > 1: 0x47113174 - core::fmt::write::h1cff52b8c9dac53e > > 2: 0x47039e34 - > > 3: 0x470443fc - 65: 0x401361bc - > > . . . > > 66: 0x40135cd8 - pthread_create > > 67: 0x40138b64 - pthread_peekjoin_np > > 68: 0x40138b64 - pthread_peekjoin_np > > . . . > > 196328992: 0x40138b64 - pthread_peekjoin_np > > 196328993: 0x40138b64 - pthread_peekjoin_np > > 196328994: 0x40138b64 - pthread_peekjoin_np > > 196328995: 0x40138b64 - pthread_peekjoin_np > > 196328996: 0x40138b64 - pthread_peekjoin_np > > . . . > > > > More ports that have builds that use what is failing: > > net-im/libsignal-client > textproc/mdbook > > It may be that the poudriere bulk -a attempt requires more > hand manipulation than I'll be willing to put in. > > === > Mark Millard > marklmi at yahoo.com > ( dsl-only.net went > away in early 2018-Mar) > > > -- () ascii ribbon campaign - for an 8-bit clean world /\ - against html email - against proprietary attachments