From owner-freebsd-stable@freebsd.org Tue Jun 30 08:40:00 2020 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 11D5D36274F for ; Tue, 30 Jun 2020 08:40:00 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from vtr.rulingia.com (vtr.rulingia.com [IPv6:2001:19f0:5801:ebe:5400:1ff:fe53:30fd]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "vtr.rulingia.com", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 49wyTp5QJnz464q for ; Tue, 30 Jun 2020 08:39:58 +0000 (UTC) (envelope-from peter@rulingia.com) Received: from server.rulingia.com (ppp239-208.static.internode.on.net [59.167.239.208]) by vtr.rulingia.com (8.15.2/8.15.2) with ESMTPS id 05U8dgxG062771 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 30 Jun 2020 18:39:48 +1000 (AEST) (envelope-from peter@rulingia.com) X-Bogosity: Ham, spamicity=0.000000 Received: from server.rulingia.com (localhost.rulingia.com [127.0.0.1]) by server.rulingia.com (8.15.2/8.15.2) with ESMTPS id 05U8daUY069917 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NO); Tue, 30 Jun 2020 18:39:36 +1000 (AEST) (envelope-from peter@server.rulingia.com) Received: (from peter@localhost) by server.rulingia.com (8.15.2/8.15.2/Submit) id 05U8daNq069916; Tue, 30 Jun 2020 18:39:36 +1000 (AEST) (envelope-from peter) Date: Tue, 30 Jun 2020 18:39:36 +1000 From: Peter Jeremy To: Donald Wilde Cc: freebsd-stable Subject: Re: swap space issues Message-ID: <20200630083936.GA63105@server.rulingia.com> References: <20200625025248.GB10210@eureka.lemis.com> <20200626102331.GA6406@server.rulingia.com> <1140215402.1.1593187896838@localhost> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="gBBFr7Ir9EOA20Yy" Content-Disposition: inline In-Reply-To: X-PGP-Key: http://www.rulingia.com/keys/peter.pgp X-Rspamd-Queue-Id: 49wyTp5QJnz464q X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of peter@rulingia.com designates 2001:19f0:5801:ebe:5400:1ff:fe53:30fd as permitted sender) smtp.mailfrom=peter@rulingia.com X-Spamd-Result: default: False [-4.38 / 15.00]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-0.99)[-0.991]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; NEURAL_HAM_LONG(-1.02)[-1.018]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; DMARC_NA(0.00)[rulingia.com]; NEURAL_SPAM_SHORT(0.03)[0.027]; RCVD_COUNT_THREE(0.00)[3]; TO_MATCH_ENVRCPT_SOME(0.00)[]; TO_DN_ALL(0.00)[]; RCPT_COUNT_TWO(0.00)[2]; SIGNED_PGP(-2.00)[]; FREEMAIL_TO(0.00)[gmail.com]; FROM_EQ_ENVFROM(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; ASN(0.00)[asn:20473, ipnet:2001:19f0:5800::/38, country:US]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.33 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 30 Jun 2020 08:40:00 -0000 --gBBFr7Ir9EOA20Yy Content-Type: text/plain; charset=us-ascii Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On 2020-Jun-28 12:33:21 -0700, Donald Wilde wrote: >On 6/28/20, Donald Wilde wrote: >> On 6/27/20, Donald Wilde wrote: >>> 'spinning rust' for a disk. My loader.conf has >>> kern.maxswzone=3D4200000 and ccache is fully active and working for both >>> root on tcsh and users on sh. Based on my calculations, that maxswzone is good for just under 1GB swap. What do you see have for vm.swap_maxpages and vm.swzone? >> Synth is still crashing hard, same issue. >An update. Synth still crashed with one swap zone of 16GB. What do you mean by "swap zone"? Do you mean you have one 16GB swap device? >stack overflow. As I say, there was no warning. Everything was fine, >then memory usage went through the roof! I've just tried building llvm80 via ports[1] on my laptop, using the same options as you. I have 4GB RAM and 4GB swap with system defaults and had no problems with an 8-way build. The highest swap usage I noticed was <500MB. I suspect your problems are related to either ccache or synth. >The second one, hopefully, contains every log up to the one that >crashed and hopefully also the beginning of that task. As I say, ONE >builder and ONE task, after a reboot. LLVM80 was the only builder >input. "one builder and one task" - these are presumably synth terms since they aren't standard ports building terms. You should be able to do a single-theaded build of llvm80 in 4GB RAM without problems. That said, I notice that the first log file suggests you were building 3 ports in parallel, and each port build was running 3 jobs - that's 9 jobs in parallel on a low-spec CPU with 4 threads. You should limit the number of CPU-bound processes to the number of CPU threads you have. [1] cd /usr/ports/devel/llvm80 && make --=20 Peter Jeremy --gBBFr7Ir9EOA20Yy Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEE2M6l8vfIeOACl4uUHZIUommfjLIFAl76+kFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldEQ4 Q0VBNUYyRjdDODc4RTAwMjk3OEI5NDFEOTIxNEEyNjk5RjhDQjIACgkQHZIUommf jLKbgg//d0CZ8FCMHjXHzH5ZXM2edr7zbfF+JQZBhGY3t7M4xnMq5rQZtWd7pRzY i9Zes0vVqF21eMPDlJSL0DJ8gJmyrxauMZ+1TNx2JvpRIAqK77v4LuUrzXKjjcn6 qVObiwzaAocMEk02ghb5EGZGZcmAO4G2Ww3Fh2cbx2wBs6b2z8mzqAA4xTI4klaY ueP77RRu4IxJeIH98FanlEfFfeS3CoI2qKMBeAylHABKYJPqghnkGwWrX+UKyeY5 lmljeH2p5Cm+/1TxpuWPm/xKXcq+QK9svZKxTKfZ+4BWFx8goqRYlwgnvFQbhgAl LBBtIBbtokZ4XhoXVoeFbpTu8pqWRyDjwrrg+Aw/AfVcvIxI6cRXbw9rjVt900w6 ayb+b0UPul9Ki6xZclteoDFsPZC9PDgiDO0EqS86h8ihZ/1qQjLt9zpxR8xwkNIf Qrud2nA+Da1T3qYyXWZ8fApb2iXzJ0luDJrUVD9yAh7pREtfJFcueHVJsKLPi/uv g36zPSvp5fIlqvXVL4wJDVXxiV2OqU+Ds6LYaqIIGsg1qHddUz+hs3crD7LArSEQ OaV5fmThYjtOTIVgel7VYcNbY5FkMgvDj6i/h7sWC1mnvxqqPkRK9G9X5WKx9Tyj Ois6VvZ1+7iOSDg6apvOKbMwki+bQjFHZZ8/CPO6IkEOJalob7A= =FiWs -----END PGP SIGNATURE----- --gBBFr7Ir9EOA20Yy--