From owner-freebsd-arm@freebsd.org Tue Dec 29 22:50:15 2020 Return-Path: Delivered-To: freebsd-arm@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 3187A4CD26E for ; Tue, 29 Dec 2020 22:50:15 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic311-24.consmr.mail.gq1.yahoo.com (sonic311-24.consmr.mail.gq1.yahoo.com [98.137.65.205]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4D58kr6gNvz3m0s for ; Tue, 29 Dec 2020 22:50:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1609282211; bh=jsRt+kc+9TjAaz3KC0Yp8F8xL9ayUNBpTfHQo5fVKU6=; h=Subject:From:Date:To:From:Subject; b=CxPAfaJCqpwg11FjZyLd1r0PHOfX/TWymZj1M2YuzGoMa7n7xUOA43jG5tJBUbmDBoa4+fAkmW8o/HAYeNczl7Lb8QFi3tIYYc0FD1ktf/P+8B2XNAXrrz46XtFCwvR8OmTCrbkmF4E8BRrQlXQd+rNxxZNHtW88Lyp4Oe6gbFUOxDEQEHfFFhGqhOZxS2EZk8bOjjHLf51rudbbWcYt5aVOyvucIqMVDGAhE55wCPlaks69kvpSG5oPMLUhN28vAg3ewoP6qg/T5iNSMApMGnCPoLYSzfbqxDW+ZfOH217mK4dDEgeCJUE/lM8qeysKF/MEWdZOe8Vrj/BzJ/DMXA== X-YMail-OSG: bxzqOc0VM1nq0T_Ccef1GW9WB2YO.RhkATKtmmWvY4m84RVU6MgDQm1xeeQwi7m IMbQv0V5wy7K4V.DJ.mHBnGXc34h_r0FfOHkczB_J_buiBKylTppLYXHzIDiURiRWJ3NvkpNI1uv WWNhpGXoYVgXsseM4MhRFOvbqgPzgcUwS7qzjj3VC3tXjdI9XzWi.HP7zPOx2ebftSK7rt9i76J0 LLqyAstuEx3L5bg2rK0_IjzRahMS1oN4FnkQaVa.q79sdYxoY0c5kKqtEgytln0IuAfxYDqKinNm E429MrdS5v8cveyRfASZI5i7LhM8_PA5bUe7D8jBIirdxHyC6BJkzTEx93NoIAO_b_1CQ0TSa2tT WK4BgXtOjPw1sfz.zv0T_aHHlZSGZgCawAKQBg0yHNk3KpI1xgez.ZnE_9GNGyRIvtBK_64hJtRB bmapXDToD0FEUlHw4Aa2rfiChyYXT.jcK9XeJzcjyoUDNIb0e2ekSVIo6iCaGccDF4X59m8AbLPp S.xFpuGs7s2Eg_A4ojYhswydNazOhnrtpALqh5ww7cRlqv.CkTIpFl6bEhqA1pGwEfcNlP1jjYfP 2LxBBdJNLRX6xt7j8Kt9kb3d03LfOhDJEt_H6byax7TjZA8NuWsTd3AnerRZHIujMMcDF1RbCRvN gMToJ7_ghWPQswfMlrTC9doqT8.0LheuICrSpoRs.sCp_Df2b_0wwuOPXV9klW3vkrxlscQNuoaG U3YLPJ_yjzVdApPY8M9HacnhQr_IieosWDF0j0ieqYonsoCl53xFmIaj8EA1RiGXothuXK3BFIDe w6MDEA0JXouUNWAU4145UT74Pbx8bw_wut24.26UDjOOobJ1sCRtvgvC1KjDXmLRqT6vBkGCiX.R FIRCBisVxSeXzdBzWV1XGwrWtMqjhDR_MmCUEdmyajfhrE.UpfNHAH6Co4xhC.3WufnSwTvGEyMp o0dkmGtzxK4NbNgCKoZp2CviGm9.muUWd1I4KfW3wZi7NJ8z9.6JgDBdh7.Q8wMriP.zt7w_KyTo uLbal9QvtG2EFtfy2pc_MW2xGl1vbUh7fYspMxbF.kpY17SBVAHj45TuG1470N_r5efGdmGvUCRL 26ASICs_IcqLNTidJ0_qebWSrxKZ4EIgcaWsI2gUAoLgp52bkEh7l85aZqLHXtiSsh5uAjIRjAPs nFFJnVvHGBUkMMI.j1YQlq6E2jGr1XCT7p3ciqNEIH3A7Pg0vjST0VRB.yL0wzKY_h2BFoX8gT_6 wThVh0IlbpNKyBlFZhx4rJgXd23iVYqtmYqlPOGMsy3xRw7ns2v2bgswFd.hgzUPl1Go8eiW4l4A iB9jps9ZG_rI97IR1f3ID4JzFcegFBC8PJZxFAK2ymNi8zyWJjCrXofnbaM4P3pk8EJncm3ZzacL TjFEj8.mV7Rcd004jtZFVM1jhRr_I9pCJJxGF5PVbKfvalgz_e93RNBhybrWG3Om4d5F1iZDHZzi tZbxHW_ixT4d9cfqODY.LFInkq_29o8UZDIG.efJhYKHbq30yilLYmxxnQPnB7bfdvtxOQAXkAuI mW4qvQ9pSfsnGALuQwCqnGoG9BfiWaoh07DFqoxBD3jZKohYjJlNYFHeWHlTL35HDWpYZJAbfB7s NJ6OAOxZg0Na.EpTg8ZxsOZlYBfpnGleE1hpwPd6_Mh5jFbSCqktpSNVOkNLAha4YEdJSbrx4BRR L.QrSftf1L_AvUjAtJcX17ev6EgA1WK8YloT8pzoPWBFRE0HT9ADdW_odV141Th1joirMOI_AJXx PG9Wtvi0avB3uttVuHnk2tfmUQ8dZBbvX95y9TEWhBjKY88_J0NlXEileqvDi69lKIUlcKCZ7JJS Hx4Rs24_kPXx0W.Tsf2y0WtUrhpGUAvGCEy1QYvdPDC_agDfk6N67iKmcH8DvE2IBOhMn0v0k6pr ePzV41QI15dFIcjoeySGFijh.tJsQ..Jm_TzSDpaZVXcWUltkxhhDewgPmaU.gdagI6Fxt.sL2xo x1ElKv6nTDgbpTmRr3YjmIvV1n.fIL27ne8oU9F8e5.QnUu2On_xrlFWaaet_HbGcTUy5WGTC6uU BYod78g.z8uvWHaSIjhdJ.mNfKoUO8dXG3YZ5dV4cs0JRWIc1RMj3mHvJv.m760oAr4A1zEghG8t PTSm4Kkl4_nLBAbKWoU0w7NZcZNs.AXW_fqwh7aSt1GFUrJKh.uA_SgY_nZbxF.vwJuk.8DwFadn XMv7ZZ.k_HZQVTM9f5LpU7P9cJlomZJqcp_rqL7B1SAP.reSUrgQs3Hz0L1kDTRmugDrEdWGabIa hU6m6lXQPk890_KUoQNJX4KzTHGZILuxezKaz73Ah_XtWvPXI7D5I7A_snkh93_afOUboyaDJxwc 1sH8mI_9k4ypYQrAPM3HXfFwGeR0X8XTJjT2QFITtjsYi.0SuDIOCiv42.OLrymR16M5_eLlXC1f xvDzgqi15YgDt8Iuc5g7HVmb_zYARtfFtL7k4wjeFa12DCfVoWenZXEl9zc.Exjd9m5fq1Jp3Zd4 pWEefaA-- Received: from sonic.gate.mail.ne1.yahoo.com by sonic311.consmr.mail.gq1.yahoo.com with HTTP; Tue, 29 Dec 2020 22:50:11 +0000 Received: by smtp420.mail.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID d33c7f8819c482a6c44dd5a22990d845; Tue, 29 Dec 2020 22:50:07 +0000 (UTC) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.40.0.2.32\)) Subject: Re: Migrating from -current to stable/12 on RPI2B (ARMv7) From: Mark Millard In-Reply-To: Date: Tue, 29 Dec 2020 14:50:07 -0800 Cc: freebsd-arm@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <67E8786A-79E7-409A-BF4D-738F4FEB5EFF@yahoo.com> References: <20201228044840.GA28380@www.zefox.net> <20201228185622.GB28380@www.zefox.net> <2C1E2F87-2FC3-481C-A508-C76B2D7CFF7F@yahoo.com> <619A02CC-0EBA-4B50-A3BB-C326996AE706@yahoo.com> <20201229010220.GA36311@www.zefox.net> <78A4DEC3-421F-419D-ABDE-9F3724E44C8D@yahoo.com> <7E0A320A-4C81-4C7B-B5D0-E6681FFA24FC@yahoo.com> To: bob prohaska X-Mailer: Apple Mail (2.3654.40.0.2.32) X-Rspamd-Queue-Id: 4D58kr6gNvz3m0s X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.65.205:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.65.205:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.205:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.205:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-arm] X-BeenThere: freebsd-arm@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: "Porting FreeBSD to ARM processors." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 29 Dec 2020 22:50:15 -0000 [clang.full built this time.] On 2020-Dec-29, at 13:24, Mark Millard wrote: > On 2020-Dec-29, at 02:15, Mark Millard wrote: >=20 >> On 2020-Dec-29, at 00:16, Mark Millard wrote: >>=20 >>> On 2020-Dec-28, at 17:02, bob prohaska wrote: >>>=20 >>>> On Mon, Dec 28, 2020 at 04:14:51PM -0800, Mark Millard wrote: >>>>> [I get the problem as well! I report a backtrace of the failure >>>>> and some more.] >>>>>=20 >>>>=20 >>>> Relieved to see it's reproducible. =20 >>> . . . >>>=20 >>> I tried reducing the size of things to be produced via building >>> the target based on the likes of using: >>>=20 >>> WITHOUT_LLVM_TARGET_AARCH64=3D >>> WITH_LLVM_TARGET_ARM=3D >>> WITHOUT_LLVM_TARGET_MIPS=3D >>> WITHOUT_LLVM_TARGET_POWERPC=3D >>> WITHOUT_LLVM_TARGET_RISCV=3D >>> WITHOUT_LLVM_TARGET_X86=3D >>> MALLOC_PRODUCTION=3D >>> WITH_MALLOC_PRODUCTION=3D >>> WITHOUT_ASSERT_DEBUG=3D >>> WITHOUT_LLVM_ASSERTIONS=3D >>> WITHOUT_DEBUG_FILES=3D >>>=20 >>> (But the host 13 was unchanged.) >>>=20 >>> It still failed, but at a different memory allocation, of a >>> different size: >>>=20 >>> r4 0x8000 32768 >>>=20 >>> (gdb) bt >>> #0 thr_kill () at thr_kill.S:4 >>> #1 0x4227d998 in __raise (s=3D6) at = /usr/src/lib/libc/gen/raise.c:52 >>> #2 0x42332284 in abort () at /usr/src/lib/libc/stdlib/abort.c:67 >>> #3 0x00da5e4c in report_bad_alloc_error () at = /usr/src/contrib/llvm-project/llvm/lib/Support/ErrorHandling.cpp:174 >>> #4 0x00da61c8 in out_of_memory_new_handler() () at = /usr/src/contrib/llvm-project/llvm/lib/Support/ErrorHandling.cpp:187 >>> #5 0x420f5d24 in operator new (size=3D) at = /usr/src/contrib/llvm-project/libcxx/src/new.cpp:73 >>> #6 0x00e16878 in SetBufferSize () at = /usr/src/contrib/llvm-project/llvm/include/llvm/Support/raw_ostream.h:131 >>> #7 SetBuffered () at = /usr/src/contrib/llvm-project/llvm/lib/Support/raw_ostream.cpp:97 >>> #8 0x00e17368 in write () at = /usr/src/contrib/llvm-project/llvm/lib/Support/raw_ostream.cpp:251 >>> #9 0x00ddfe20 in operator<< () at = /usr/src/contrib/llvm-project/llvm/include/llvm/Support/raw_ostream.h:192 >>> #10 operator<< () at = /usr/src/contrib/llvm-project/llvm/include/llvm/Support/raw_ostream.h:205 >>> #11 printSymbolizedStackTrace () at = /usr/src/contrib/llvm-project/llvm/lib/Support/Signals.cpp:154 >>> #12 0x00de163c in PrintStackTrace () at = /usr/src/contrib/llvm-project/llvm/lib/Support/Unix/Signals.inc:575 >>> #13 0x00ddf604 in RunSignalHandlers () at = /usr/src/contrib/llvm-project/llvm/lib/Support/Signals.cpp:67 >>> #14 0x00de1f3c in SignalHandler () at = /usr/src/contrib/llvm-project/llvm/lib/Support/Unix/Signals.inc:396 >>> #15 0x42021db4 in handle_signal (actp=3Dactp@entry=3D0x424df7b0, = sig=3D, info=3Dinfo@entry=3D0x424df7f0, ucp=3D) at /usr/src/lib/libthr/thread/thr_sig.c:303 >>> #16 0x420213f8 in thr_sighandler (sig=3D0, info=3D0x424df7f0, = _ucp=3D0x424df830) at /usr/src/lib/libthr/thread/thr_sig.c:246 >>> #17 0xffffe190 in ?? () >>> Backtrace stopped: previous frame identical to this frame (corrupt = stack?) >>=20 >>=20 >> Updating the host 13 made no significant difference in >> behavior. >>=20 >> Using: >>=20 >> time -l /usr/bin/ld --eh-frame-hdr -Bstatic -o clang /usr/lib/crt1.o = /usr/lib/crti.o /usr/lib/crtbeginT.o = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/legac= y/usr/lib = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-t= ools/lib/libz = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-t= ools/lib/libexecinfo = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-t= ools/lib/libelf = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-t= ools/lib/ncurses/ncursesw = -L/usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-t= ools/lib/libthr -L/usr/lib --gc-sections cc1_main.o cc1as_main.o = cc1gen_reproducer_main.o driver.o = /usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-too= ls/lib/clang/libclang/libclang.a = /usr/obj/rpi2_clang/arm.armv7/usr/fbsd/stable-12-src/arm.armv7/tmp/obj-too= ls/lib/clang/libllvm/libllvm.a -lz -lexecinfo -lelf -lncursesw -lpthread = -legacy -lc++ -lm -lgcc -lgcc_eh -lc -lgcc -lgcc_eh /usr/lib/crtend.o = /usr/lib/crtn.o >>=20 >> it reported after the failure output (an example): >>=20 >> time: command terminated abnormally >> 26.59 real 9.40 user 12.48 sys >> 2052032 maximum resident set size >> 21793 average shared memory size >> 218 average unshared data size >> 127 average unshared stack size >> 703238 page reclaims >> 0 page faults >> 0 swaps >> 55 block input operations >> 3104 block output operations >> 0 messages sent >> 0 messages received >> 1 signals received >> 41126 voluntary context switches >> 447 involuntary context switches >>=20 >> where looking up getrusage reports that: >>=20 >> ru_maxrss the maximum resident set size utilized (in kilobytes). >>=20 >> which means: 44.0625 MiByte below 2 GiBytes for the resident set. >>=20 >> Adding --threads=3D1 made little difference: >>=20 >> time: command terminated abnormally >> 28.84 real 9.28 user 12.78 sys >> 2065016 maximum resident set size >> 21872 average shared memory size >> 219 average unshared data size >> 127 average unshared stack size >> 709661 page reclaims >> 0 page faults >> 0 swaps >> 48 block input operations >> 3050 block output operations >> 0 messages sent >> 0 messages received >> 1 signals received >> 36717 voluntary context switches >> 114 involuntary context switches >> Abort trap >=20 >=20 > I found another difference between how 13 is built and > stable/12 is built, so I'm trying another build. >=20 > The below shows what I've changed in stable/12 , but 13 > eliminated even having the conditional logic, always > using -O2 -pipe : >=20 > # git diff | more > diff --git a/share/mk/sys.mk b/share/mk/sys.mk > index 9099b63a61a0..53d1e30b1d56 100644 > --- a/share/mk/sys.mk > +++ b/share/mk/sys.mk > @@ -167,7 +167,7 @@ CFLAGS ?=3D -O > .else > CC ?=3D cc > .if ${MACHINE_CPUARCH} =3D=3D "arm" || ${MACHINE_CPUARCH} =3D=3D = "mips" > -CFLAGS ?=3D -O -pipe > +CFLAGS ?=3D -O2 -pipe > .else > CFLAGS ?=3D -O2 -pipe > .endif >=20 > I'll report if the use of ld to produce clang.full still > fails or not. >=20 > I've left the other things attempting to lead to less memory > use in place. >=20 With the use of -O2 instead of -O , the bootstrap clang.full linked and the later activities in building the bootstrap clang worked as well. The build has also built the bootstrap lld and is off doing things that use the bootstrap clang and lld. I've not checked if -O2 usage would be a sufficient change by itself. For one, various other aspects of my normal builds vs. yours could be different: I've not replicated your context in any detail. =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)