From nobody Fri Apr 15 18:40:02 2022 X-Original-To: freebsd-hackers@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id B68977CEDA4 for ; Fri, 15 Apr 2022 18:40:13 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic309-21.consmr.mail.gq1.yahoo.com (sonic309-21.consmr.mail.gq1.yahoo.com [98.137.65.147]) (using TLSv1.3 with cipher TLS_AES_128_GCM_SHA256 (128/128 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4Kg4rX4M4Tz4WT1 for ; Fri, 15 Apr 2022 18:40:12 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1650048005; bh=FyTs13evGZ/vmrZbqA28EsaQw3eJDAvrX8CZQ/88TtE=; h=From:Subject:Date:To:References:From:Subject:Reply-To; b=HByoeTYzDrpVLMxg7u+BX7q4cglAecFyLGZVx85nRvrSSa6xbjDfcw79rSxBk/Ki/iSCAAldpP5npyzHuPT5qDQYG35b5ltBskn4HDAsC+OdInozqJAYvWOt9haQ3m+olGSPsZ2RsDZ5YFMhs/z+sNcU5TJF9zaWQDavGdCSKqPhyVDUBmOvZYjrCBqHqHECYqtLwNkZvKMLvSUHrLnamCMO9gOUQwQ95ZZmv77XjMcBjrgQN3k2GfmKaavu2y1plAilj8t2eHW6WUnROtTMO0Gj3rk++p05rEYxn7bsXI+KZy7TrWSV+hC48ZAIiFEops9xhOcobm73L1nCmYp2Vg== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1650048005; bh=SKTWUMSop/wBtgbwPc7zvgQKiliu9NghILdTVp6NnwA=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=jzDNvzZgoCQ0M9pFWXyXs3hTmkPnn490rPTV2+GhqyJY7cN9oCipQziEiPLR5S9phNHo7Ln9E7GYCZjJTBGD38tjBdv6+VhNOe+Onn12LQA0bwgFQNHwgLT07HXhN62tQN0trPK6lXGSx9k1HpcetX0ACjP4y2ib8gSxGD09uDeiaTFGfDga/ZIZXffWWog0ziG/TAB5RO8LexfjT8Zkl3/R4bzDiL8avFUXBlVoKvPlGXcJGnROVWP2LNr80FY+fsEecJej9ewDRhQfUq+9D9gxPPvULRY4kJU+9YACSC43+3VtLeROyX6i7czi9O1oc+JEszdmvR6YDoBeuo+TTA== X-YMail-OSG: AGlsPGcVM1mVpS2No0BtFhh608VOXIR8WPf.wpVO5b_Fk6qsatnaMGgIr6Y5qzP HNNxG2Iot92oC1gdn15MzHCEmbvhzcxgoygPAD4IjrJ2d.LQ4n2Khc2Uj9QSGA244KFqjD3MYyxG X9u8rIDOHNrVxk2RrkQ8oJG9vcCFA2dA2dycjW7I8YFt0SWzjKt2ikJJSiyGnC3hQeappFSmGpHf vHs6M.43liVBU0kraHezmDzNabklX1ZNiO4TeSRvVjbL_x7_C0Wyb2OlCnbDVumufudQiCB_k6Jd DSQgC4hXWX3TOkw7mBW.rIQt3jnCVnBYJtKlfCiBELSlJFDBKLH7ss8xQwmZU0XP8WHu1zPGzVfC zB3AUMJyIVOKmmQFhHCqze11bl2M0CD_cEaEOaQVZmR0eFdqxhiVYIisJsYonyhmV6H.4DS65b.p nEiIxvvXZtXsVldRkWC0u5Yj89rEdsluwbBzLAOSGqSievmYbcTLvoMq3wm6NIU_Ls1BgpZusYTd IK8BPK.KJ1soeOEJ9bMPvJF9J.ifpV4B59QW3EBezMwF_nZSQTg.HTjtr3Ma4_8EdpVZSMkC3TTl _yPHDUWdQxsafWIk0fEaWpZNZ7ngAZ9qVH3nYJ5XHfS47X_AsnMj0N9Ok8IIJx1L7KWKSUL9q4pa HTz7WKKt879pnsnK3sBiB2NYn_YYAmyWkoZCPofPdR7Q07T7sMAk1lAOpUPGUPYUJ3CkMY8Fx7SR RfjPUdQD38G3fU7mEtRfn1x.wgm1rstKrn.jzRXNVoLnZmhML7RfJsCi3S4sbszuLAoo02aMdOWb .y8FCBoGpTJHBvKjLUoj9U3LsDms6zjR14Lu.16J7tOz15ER2g9P2DjW5TANWVVV.j0RVaOyWYFd BuBIO8vxQoCaRfysvezNFUJmNuu8FAN2fujmk4kQW2NNyE7WfUKZjQJH6vaacv.iVaTHdXUvoCXR QXRmswKueQBar6ddUontAOoXtEMu4UTgCTqWOaw288h5CN2j1SNkc8sWJgP1yGpua4Z9bAo8TNOD Uq4AH09p1zydV6JcD5de9gfH19Qw27QxR34QBsaAGSeCr_ZqVpStuAn4e6vI17GzEouIC.Pj8TDB 0u2W5ZloS8Aza3CweEURroVKoS_rqY1husESL4NS63nAlcDBboq7ZzAqCdV.6BM9OZihEw0KHXYF .uUItYDWK1K_.hIR3ZL2SpcRuH0K8_MlfaGjKVsdZBO4k3oGkX1eW.V720i2DgYhUZgfzM2lOuks vfHtkFjiSMyT_SF63Vgh10UlyrUeEGnXnNEp0j.MhGDbmPc1pdYvwrnN3mGNGG0.epHPSqIZTEQk xgWJAOgkpgvgbTG3JelrogACOVENmNwZly7jZKx67z3Vfc4BV81XLJX1k3YWY6Yo5hN3bSP5g74b owWLKq3DM6hLpxi09wHjooMjZg255LKEZCTfK9Cy6G.MnM6iF0YfamVKT1jw1iw_3TBPMF5ueiuv kM3uRWiQ7E8eZUL3WC75Z0k1PEO0Ya8GoLsUYESHJ.oedDhKv9imIW5gP6GrUO1nr_0_u1GreRLI YVcvkVQ9FTky9TUyxGquGkwj9lccJr4P0U2vlKCL55XsKdM2psS1Bf.qOMYOCKE8lsKQuDAYX4W. e5.mAD5lNaRfa_Gipxoy7r.01n8Dso5D4w8yvVdOXYyyaNpU5Rhx3ZBxICY73FxjPViGDAbcTA76 gCHLWNGq9InjkKcnxxEOw.3uRe5IDN.qynsKwCRKl7myDk22Qi90ZOiD2nUwI_qTHP9nyq2ZSQFp 1qJhwlq5QHY4tSzofBS2ntwvkczsA.novTnsspPlcheQV15XpZYAezxWn8Mn1s87Iz3Ug.HWQBLO Lo95Nso31Y6UeS9NVdkhoo4AaEFAtdoukYtWLOj7aFb7MnM14_5d_Kw9moSv2symoKMzOqkeQort mCh7pNeOb0LbcY7.53gStvnIMQEQjTylrtGuuFJiZczRXSXR7If1wnJeBgWxITdGGx07xj5tyIz5 tXzwsH6GNS._aiHQ8mQibBl2c7xc_CIGARdC2MIOdv_.IpDaVPeE38AidCK8c.pMbM.OS35E9Obo 4flra0VGsQSJtzNVaz.6saGYKwir3X4SZEKnR1M9O621f4pC6xWGDcpN2U2KqGEOwNLFaPiw100K JaruM3hwxqggwiXjoBZlfkEzxtGr_7i8kotXXyxl_EXEPVlkWjmrNQ825T3we6XVZVPzM1X7hFy5 MGVs4wCgPysGzOOl169Wg2d3AfRTgMiBbbAKKiAx6zLcRJUZDpTpeRHKzW_vav1Ew0oRe5sKoF09 _oSbotOJHjdA- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic309.consmr.mail.gq1.yahoo.com with HTTP; Fri, 15 Apr 2022 18:40:05 +0000 Received: by hermes--canary-production-gq1-665697845d-l9qwj (VZM Hermes SMTP Server) with ESMTPA ID f4ed47a04c9617a76e8115d87d9e7f06; Fri, 15 Apr 2022 18:40:03 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable List-Id: Technical discussions relating to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-hackers List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-hackers@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.120.0.1.13\)) Subject: Re: Can not build kernel on 1GB VM Message-Id: Date: Fri, 15 Apr 2022 11:40:02 -0700 To: freebsd07@wayne47.com, FreeBSD Hackers X-Mailer: Apple Mail (2.3654.120.0.1.13) References: X-Rspamd-Queue-Id: 4Kg4rX4M4Tz4WT1 X-Spamd-Bar: --- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=yahoo.com header.s=s2048 header.b=HByoeTYz; dmarc=pass (policy=reject) header.from=yahoo.com; spf=pass (mx1.freebsd.org: domain of marklmi@yahoo.com designates 98.137.65.147 as permitted sender) smtp.mailfrom=marklmi@yahoo.com X-Spamd-Result: default: False [-3.50 / 15.00]; TO_DN_SOME(0.00)[]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; DKIM_TRACE(0.00)[yahoo.com:+]; RCPT_COUNT_TWO(0.00)[2]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-1.000]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; MID_RHS_MATCH_FROM(0.00)[]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; FROM_HAS_DN(0.00)[]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.10)[text/plain]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.65.147:from]; MLMMJ_DEST(0.00)[freebsd-hackers]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.65.147:from]; RCVD_COUNT_TWO(0.00)[2] X-ThisMailContainsUnwantedMimeParts: N From: Michael Wayne =20 Date: Fri, 15 Apr 2022 13:49:53 -0400 : > I have a VM with 1GB RAM running FreeBSD 12.1-RELEASE-p3 >=20 > I'm trying to upgrade the machine to 12.3 and having swap failures. >=20 > This machine runs bird to advertise BGP, ssh and not much else so > the small amount of RAM is (usually) fine. >=20 > For a long time, there was a 1 GB swap file which handled the > occasional time when excess memory got used. >=20 > Machine needs a custom kernel for BGP, the conf file consists of: > include GENERIC > ident ROUTING > options TCP_SIGNATURE >=20 >=20 > Today, while building the 12.3 kernel with: > cd /usr/src > sudo make toolchain > sudo make buildkernel KERNCONF=3DROUTING > the machine ran out of swap. with a bunch of messages like: > Apr 15 12:11:26 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 240593, size: 4096 > Apr 15 12:11:35 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 236224, size: 16384 > Apr 15 12:11:37 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 245, size: 12288 > Apr 15 12:11:46 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 240593, size: 4096 > Apr 15 12:11:55 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 236224, size: 16384 > Apr 15 12:11:57 g1 kernel: swap_pager: indefinite wait buffer: = bufobj: 0, blkno: 245, size: 12288 >=20 > Thinking it was a sawp space issue, I increased the swap to 4 GB and > tried again with the same results. Boot gave the kern.maxswzone = message, > I ignored it as I had planned to change as soon as I completed the = build. >=20 > So I pulled up top in a console window and watched swap during the > build. About 400 MB of RAM was free and about 3 MB of swap was > used when the machine started linking the kernel: > ctfmerge -L VERSION -g -o kernel.full ... > While this command was running, I saw swap usage go to ~5MB (so > just over 1%), then started seeing processes being killed due to > out of swap space. The "out of swap space" message is usually a misnomer and has been replaced in main [so: 14], stable/13 , and releng/13.1 : case VM_OOM_MEM: reason =3D "failed to reclaim memory"; break; case VM_OOM_MEM_PF: reason =3D "a thread waited too long to allocate = a page"; break; (There is one more case that still has the misnomer but case VM_OOM_SWAPZ seems unlikely to actually happen.) Given that you are getting the swap_pager: indefinite wait buffer notices I can not tell which of the two above is happening. > So, how to proceed? My /boot/loader/conf has the likes of: # Delay when persistent low free RAM leads to # Out Of Memory killing of processes: vm.pageout_oom_seq=3D120 # # For plunty of swap/paging space (will not # run out), avoid pageout delays leading to # Out Of Memory killing of processes: vm.pfault_oom_attempts=3D-1 # # For possibly insufficient swap/paging space # (might run out), increase the pageout delay # that leads to Out Of Memory killing of # processes (showing defaults at the time): #vm.pfault_oom_attempts=3D 3 #vm.pfault_oom_wait=3D 10 # (The multiplication is the total but there # are other potential tradoffs in the factors # multiplied, even for nearly the same total.) The vm.pageout_oom_seq=3D120 delays VM_OOM_MEM. The vm.pfault_oom_attempts=3D-1 avoids VM_OOM_MEM_PF. Note: vm.pfault_oom_attempts=3D-1 can lead to deadlock if you actually run out of swap as I understand. You could try setting both vm.pfault_oom_attempts and vm.pfault_oom_wait but I've no specific suggested values for your context. Note: I do not recommend having so much swap that you get the the kern.maxswzone message. I do not recommend adjusting kern.maxswzone as it competes with other kernel resources --unless you understand the tradeoffs in fair detail. (I do not understand them in much detail.) =3D=3D=3D Mark Millard marklmi at yahoo.com