Date: Thu, 27 Jan 2022 17:43:48 -0800 From: Mark Millard <marklmi@yahoo.com> To: bob prohaska <fbsd@www.zefox.net> Cc: Free BSD <freebsd-arm@freebsd.org> Subject: Re: devel/llvm13 failed to reclaim memory on 8 GB Pi4 running -current Message-ID: <6528ED25-A3C6-4277-B951-1F58ADA2D803@yahoo.com> In-Reply-To: <20220127233048.GA51951@www.zefox.net> References: <20220127164512.GA51200@www.zefox.net> <C8BDF77F-5144-4234-A453-8DEC9EA9E227@yahoo.com> <2C7E741F-4703-4E41-93FE-72E1F16B60E2@yahoo.com> <20220127214801.GA51710@www.zefox.net> <5E861D46-128A-4E09-A3CF-736195163B17@yahoo.com> <20220127233048.GA51951@www.zefox.net>
next in thread | previous in thread | raw e-mail | index | archive | help
On 2022-Jan-27, at 15:30, bob prohaska <fbsd@www.zefox.net> wrote: > On Thu, Jan 27, 2022 at 02:21:44PM -0800, Mark Millard wrote: >>=20 >> Okay. I just started a poudriere bulk devel/llvm13 build >> in a ZFS context: >>=20 >> . . . >> [00:00:37] Pkg: +BE_AMDGPU -BE_FREEBSD +BE_NATIVE -BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS -FLANG +LIT +LLD +LLDB +MLIR -OPENMP = -PYCLANG >> [00:00:37] New: +BE_AMDGPU -BE_FREEBSD -BE_NATIVE +BE_STANDARD = +BE_WASM +CLANG +DOCS +EXTRAS +FLANG +LIT +LLD +LLDB +MLIR +OPENMP = +PYCLANG >> . . . >> [00:01:27] [01] [00:00:00] Building devel/llvm13 | llvm13-13.0.0_3 >>=20 >=20 > Is this ARM hardware, or an emulator? 8 GiByte RPi4B, USB3 NVMe media with a ZFS partition. The content is a slightly modified copy of the HoneyComb's PCIe slot Optane media. The UFS-based 8 GiByte RPi4B is also based on copying from the same Optane media, both for the system materials and various ports/packages/pouriere related materials. (Not, necessarily, other things.) > I've been using plain old make in /usr/ports/devel,=20 > might it be informative to try a poudriere build as well? The Pkg:, New:, and llvm13 lines I listed are poudriere(-devel) output. I am doing my builds via poudriere. ALLOW_PARALLEL_JOBS=3D and USE_TMPFS=3D"data" in use. I have a context in which almost all prerequisites had already been built. (The change in options lead to 2 very small ports to build before devel/llvm13's started in a builder.) (You might not have a jail that already has the prerequisites.) > One would expect the added overhead to increase memory use. >=20 Well, from the context I started in, only devel/llvm13 is being built once it starts. Once it gets to the build phase (after dependencies and such are set up), there is not much overhead because the only activity is the one builder and it is only building llvm13 --via make in the builder. At the end there would be extra activity as poudriere finishes up. During the build phase, I only expect minor overhead from poudriere monitoring the build logs and such. I expect that the mere fact that a poudriere jail is in use for the builder to execute in does not contribute to significantly increasing the system's memory use or changing the system's memory use pattern. There are some other differences my context. The instances of main [so: 14] are non-debug builds (but with symbols). The builds are optimized for the RPi4B (and others) via use of -mcpu=3Dcortex-a72 usage. My /usr/main-src/ does have some personal changes in it. (Some messaging about the kills is part of that.) The RPi4B's are using: over_voltage=3D6=20 arm_freq=3D2000=20 sdram_freq_min=3D3200=20 force_turbo=3D1=20 (There are heat-sinks, fans, and good power supplies.) The media in use are USB3 1 TB Samsung Portable SSD T7 Touch's. I'm unlikely to see "swap_pager: indefinite wait buffer:" notices if the cause was based on the media performance. (You have spinning rust, if I remember right.) I do not have a monitoring script making a huge log file during the build. So less is competing for media access or leading to other overheads. (But, as I remember, you have gotten the problem without having such a script running.) =3D=3D=3D Mark Millard marklmi at yahoo.com
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?6528ED25-A3C6-4277-B951-1F58ADA2D803>