From nobody Fri Feb 11 01:14:01 2022 X-Original-To: questions@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id E2E3219AA650 for ; Fri, 11 Feb 2022 01:14:10 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from out2-smtp.messagingengine.com (out2-smtp.messagingengine.com [66.111.4.26]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Jvwcf1Mcqz3CgZ for ; Fri, 11 Feb 2022 01:14:10 +0000 (UTC) (envelope-from tech-lists@zyxst.net) Received: from compute2.internal (compute2.nyi.internal [10.202.2.46]) by mailout.nyi.internal (Postfix) with ESMTP id EB9C15C00EE for ; Thu, 10 Feb 2022 20:14:03 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute2.internal (MEProxy); Thu, 10 Feb 2022 20:14:03 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=zyxst.net; h=cc :content-type:date:date:from:from:in-reply-to:in-reply-to :message-id:mime-version:references:reply-to:sender:subject :subject:to:to; s=fm1; bh=iJOH7WRwVCAYy3kAI8m17iwkHjuxpKmS4xXIqe hBLoM=; b=e/ePq9ocoXNMvja5RsTNnz+1y+S8gJYIEIAS+AaClohzlW8p0b02l1 Zo0T2Mm9ykCqpTvcAO818efKENEQYhqoMSe1yo4uUzSIGMqNIaYd7Y0g1oVrd+5O eeDbU33L2P+yUNbVxKq5CgUubyve/8ewK9au/DrELPn+dtFRWcT93m380MGAz8O0 cHh+YxMKi01f99zCGd2SeU1WEEV5anYTYhJJBPTqDs6cE7lTXFguNJIaLZX84Ef+ AhKMJJOdJD8Twd5bh85AHRfXfpSwK9nxutmOWhoYPDk+NCccZm2xpC+B9Dve7EZy JEuaJl4fiQZHyEbMqfx8/vgYc2k0xTvA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:date:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=iJOH7WRwVCAYy3kAI 8m17iwkHjuxpKmS4xXIqehBLoM=; b=Ggb4sAkVpEqrHEFjqVK+WjRNg7PZtt+3M SXZnQfGJieLOlbMHapkDReG/n3iY7txD37P33QTAG9p7P4OG9sXsFLxRK2T8e93u p8qZFrNPZtCsFiAEweEtVRnRZGp2XEBF3emfY/a1RIueaNXiXNWS2J+4RjCqihSq 8DHaUYLm9kyXbaRDj8QGNIVWVwjih/9UdGyw8/8y6nkJ8ayA0EQeydp/bh5hU7Pr CyIS3tsLl4JxATkgyK2WFEBTQAxbm/Tooua45jzvMcrz980qA6icMLXI6j6Nmk7p pZNycP1LSbVwXRsdSF1ow1+5CHjlZ/01hZaaeSShs8ajUzaEm1zpQ== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvvddriedvgddvjecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecunecujfgurhepfffhvffukfhfgggtuggjsehgtderre dttddvnecuhfhrohhmpehtvggthhdqlhhishhtshcuoehtvggthhdqlhhishhtshesiiih gihsthdrnhgvtheqnecuggftrfgrthhtvghrnheptdehiefgvddufeekkedvtdefvdettd dtkeduvdegveelffdtkeffudejvdfhudetnecuvehluhhsthgvrhfuihiivgeptdenucfr rghrrghmpehmrghilhhfrhhomhepthgvtghhqdhlihhsthhsseiihiigshhtrdhnvght X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Thu, 10 Feb 2022 20:14:03 -0500 (EST) Date: Fri, 11 Feb 2022 01:14:01 +0000 From: tech-lists To: questions@freebsd.org Subject: Re: swap/page problem Message-ID: References: List-Id: User questions List-Archive: https://lists.freebsd.org/archives/freebsd-questions List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-questions@freebsd.org X-BeenThere: freebsd-questions@freebsd.org MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="fqIMx3Kuc2tfVDWt" Content-Disposition: inline In-Reply-To: X-Rspamd-Queue-Id: 4Jvwcf1Mcqz3CgZ X-Spamd-Bar: ------ Authentication-Results: mx1.freebsd.org; dkim=pass header.d=zyxst.net header.s=fm1 header.b="e/ePq9oc"; dkim=pass header.d=messagingengine.com header.s=fm2 header.b=Ggb4sAkV; dmarc=none; spf=pass (mx1.freebsd.org: domain of tech-lists@zyxst.net designates 66.111.4.26 as permitted sender) smtp.mailfrom=tech-lists@zyxst.net X-Spamd-Result: default: False [-6.70 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RWL_MAILSPIKE_GOOD(0.00)[66.111.4.26:from]; R_SPF_ALLOW(-0.20)[+ip4:66.111.4.26]; TO_DN_NONE(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; MID_RHS_MATCH_FROMTLD(0.00)[]; DKIM_TRACE(0.00)[zyxst.net:+,messagingengine.com:+]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:~]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:19151, ipnet:66.111.4.0/24, country:US]; RCVD_IN_DNSWL_LOW(-0.10)[66.111.4.26:from]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[zyxst.net:s=fm1,messagingengine.com:s=fm2]; FROM_HAS_DN(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[questions@freebsd.org]; DMARC_NA(0.00)[zyxst.net]; RCPT_COUNT_ONE(0.00)[1]; DWL_DNSWL_LOW(-1.00)[messagingengine.com:dkim]; MLMMJ_DEST(0.00)[questions] X-ThisMailContainsUnwantedMimeParts: N --fqIMx3Kuc2tfVDWt Content-Type: text/plain; charset=us-ascii; format=flowed Content-Disposition: inline Content-Transfer-Encoding: quoted-printable Hi, On Thu, Feb 10, 2022 at 02:28:50PM -0800, Kevin Oberman wrote: >During a large build (llvm13), my system ground to a near halt with almost >everything suspended. After several minutes, the system slowly recovered. >When I looked at the messages log, I found 57 kernel messages spread over >3.75 hours, in the form of: >wap_pager: indefinite wait buffer: bufobj: 0, blkno: 862845, size: 20480 > >The block numbers and sizes varied. bufobj was always '0'. I had >significant swap available swap space,as far as I could tell. I have 20GB >of RAM and 24GB of swap. I am running stable 48937-3c6b6246f2f from January >13. > >I know that the LLVM build is huge, but I've not seen this before. What, >exactly, is this message telling me? Am I out of RAM and swap? I couldd add >another 24GB of swap, though it would be on spinning rust, not SSD. I've seen this problem before and came to the conclusion=20 after reading threads on the lists and asking questions that=20 it wasn't a swap problem as primary issue but maybe theres some contention= =20 between processes which affects llvm in particular and makes it eat swap. Also, as you noted, swap doesn't really run out. I use poudriere to build and have parallel jobs set to 1 now=20 with make jobs enabled and the problem doesn't happen. If you're just using the ports tree in the traditional way, try make -j1. If parallel jobs is unset it would use hw.ncpu which here is 8 which would produce the problem you descrive when compiling llvm13. These sysctls are now set: vfs.read_max=3D128 # default 64 - speeds up disk i/o vfs.aio.max_buf_aio=3D8192 vfs.aio.max_aio_queue_per_proc=3D65536 vfs.aio.max_aio_per_proc=3D8192 vfs.aio.max_aio_queue=3D65536 vm.pageout_oom_seq=3D120 vm.pfault_oom_attempts=3D-1 those last two may be especially helpful for your situation. My context here is amd64 i7-4770K (so 8 cpus with HT) clocked to 4.3GHz and the disk used for building poers is SSD wiht 16GB swap (partition). RAM is 32GB --=20 J. --fqIMx3Kuc2tfVDWt Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCAAdFiEE8n3tWhxW11Ccvv9/s8o7QhFzNAUFAmIFuFAACgkQs8o7QhFz NAUr1xAAig+npXZB5qXHzpPX8nnO0q5tDTuuXYAP/rM2SwHT2Nkw3p3N5CGpAYw/ 3AscbD3Iq40WZOPIPtI3UgGU8h2hrvr3nt2dBgK4Q3ueIABwoZ3AF0gQ4D9HS1Tj ZUaAd576CBPpAWCo5io7QFAd3dPNjPRxCIEb99z6XCY1KYMKx6QnTvFOY1MKuWOe nazPi2peUUEzYqGFZRkCXCs43+rb2AjcqDQhZlPi3Ff5YLtO2mMGvEx+Yj256p6r XxQ9c+w256MWIsEtjn4FiyeOPWo0lrNm2bVsrrdT0WFRB8vHKZgu0SkKvpR89DmM kv4Q5zsqIh2Vjc+XYipdMnZaCrs60yR2AahR2iADqgVhgNSU+dIxn3kIHXxinpXW jBV81RoCzJwHLroT4VevuzOB0JDjEvUr66H9P78YFZsJRVVKfr/hW5NByONzr/kJ gfmM2/pT1udzwusbmL5obdPwyQtZjsRtGllAZ4eK77oNRZAZkAxgmioKWSqo26Gi nrFPoYuKPvtr5aWbKqD04bUjdMi0R9gIBbS3rJhnomP7wXy+9EAAnLdXR9Vs1ocu PiwVFQebSobrLY7GEyA1fCp5BWIl/YTLGg+UxaS9ZqKXR6DwZHwvaAiM7R4MU+UE oAFmqfbwobW8P2ZP+9OfVGs5o6IQweQ8VYq5nPTdvDuk1KJ3JeQ= =TjLf -----END PGP SIGNATURE----- --fqIMx3Kuc2tfVDWt--