From nobody Thu Jan 11 09:02:58 2024 X-Original-To: freebsd-current@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id 4T9dx340D7z56wjK for ; Thu, 11 Jan 2024 09:03:03 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Received: from www121.sakura.ne.jp (www121.sakura.ne.jp [153.125.133.21]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4T9dx10scPz4c8F for ; Thu, 11 Jan 2024 09:03:00 +0000 (UTC) (envelope-from junchoon@dec.sakura.ne.jp) Authentication-Results: mx1.freebsd.org; dkim=none; dmarc=none; spf=pass (mx1.freebsd.org: domain of junchoon@dec.sakura.ne.jp designates 153.125.133.21 as permitted sender) smtp.mailfrom=junchoon@dec.sakura.ne.jp Received: from kalamity.joker.local (123-1-91-49.area1b.commufa.jp [123.1.91.49]) (authenticated bits=0) by www121.sakura.ne.jp (8.17.1/8.17.1/[SAKURA-WEB]/20201212) with ESMTPA id 40B92wLs070161 for ; Thu, 11 Jan 2024 18:02:58 +0900 (JST) (envelope-from junchoon@dec.sakura.ne.jp) Date: Thu, 11 Jan 2024 18:02:58 +0900 From: Tomoaki AOKI To: freebsd-current@freebsd.org Subject: Re: poudriere: swap_pager: out of swap space Message-Id: <20240111180258.ad42faf5d5ff05c8c80a30c6@dec.sakura.ne.jp> In-Reply-To: References: Organization: Junchoon corps X-Mailer: Sylpheed 3.7.0 (GTK+ 2.24.33; amd64-portbld-freebsd14.0) List-Id: Discussions about the use of FreeBSD-current List-Archive: https://lists.freebsd.org/archives/freebsd-current List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-current@freebsd.org Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-Spamd-Bar: -- X-Spamd-Result: default: False [-2.70 / 15.00]; NEURAL_HAM_LONG(-1.00)[-1.000]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; NEURAL_HAM_SHORT(-1.00)[-1.000]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ip4:153.125.133.16/28]; ONCE_RECEIVED(0.10)[]; MIME_GOOD(-0.10)[text/plain]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; ASN(0.00)[asn:7684, ipnet:153.125.128.0/18, country:JP]; RCVD_COUNT_ONE(0.00)[1]; MIME_TRACE(0.00)[0:+]; HAS_ORG_HEADER(0.00)[]; R_DKIM_NA(0.00)[]; ARC_NA(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; TO_DN_NONE(0.00)[]; FROM_EQ_ENVFROM(0.00)[]; MID_RHS_MATCH_FROM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[freebsd-current@freebsd.org]; DMARC_NA(0.00)[sakura.ne.jp]; RCVD_TLS_LAST(0.00)[]; MLMMJ_DEST(0.00)[freebsd-current@freebsd.org]; FROM_HAS_DN(0.00)[] X-Rspamd-Queue-Id: 4T9dx10scPz4c8F On Thu, 11 Jan 2024 02:21:19 +0000 Lexi Winter wrote: > hi list, > > i'm having a recurring problem with poudriere that i hope someone might > have an idea about. > > i'm building packages with poudriere on a system with 32GB memory, with > tmpfs and md disabled in poudriere (so it's using ZFS only) and with the > ZFS ARC limited to 8GB. > > running poudriere produces many kernel log messages like this: > > Jan 10 21:40:00 ilythia kernel: swap_pager: out of swap space > Jan 10 21:40:00 ilythia kernel: swp_pager_getswapspace(2): failed > Jan 10 22:41:55 ilythia kernel: swap_pager: out of swap space > Jan 10 22:41:55 ilythia kernel: swp_pager_getswapspace(21): failed > Jan 10 23:48:03 ilythia kernel: swap_pager: out of swap space > Jan 10 23:48:03 ilythia kernel: swp_pager_getswapspace(8): failed > Jan 11 00:05:00 ilythia kernel: swp_pager_getswapspace(1): failed > Jan 11 00:21:45 ilythia kernel: swp_pager_getswapspace(10): failed > > this is despite the system having a large amount of "Inact" memory > according to top(1): > > Mem: 3828M Active, 15G Inact, 2921M Laundry, 9263M Wired, 1559M Buf, 892M Free > ARC: 3113M Total, 994M MFU, 884M MRU, 39M Anon, 49M Header, 1139M Other > 1296M Compressed, 4130M Uncompressed, 3.19:1 Ratio > Swap: 2048M Total, 2048M Used, 8192B Free, 99% Inuse > > from what i can tell, these swap errors don't cause any issues with the > poudriere build, but they do seem to hinder interactive usage by causing > long hangs. > > does anyone have some idea what's going on here? i don't really > understand why the system has used 100% of available swap space when it > has plenty of Inact memory it could free to fulfill requirements. I'm currently building www/chromium, consuming 23.1GiB of memory and 11.4GiB of swap in use. 32GiB of physical memory but not intentionally limiting ZFS arc. If you don't build such a large ports, you could lower the number of poudriere jail with option -J, for example, from auto-tuned value to reduce memory usage. FYI: When chromium built around 87%, with USE_TMPFS=yes. 172 processes: 16 running, 156 sleeping CPU: 91.2% user, 1.5% nice, 6.7% system, 0.6% interrupt, 0.0% idle Mem: 13G Active, 1670M Inact, 6499M Laundry, 6985M Wired, 347K Buf, 3490M Free ARC: 3183M Total, 393M MFU, 2102M MRU, 2980K Anon, 34M Header, 643M Other 1826M Compressed, 3471M Uncompressed, 1.90:1 Ratio Swap: 64G Total, 12G Used, 53G Free, 18% Inuse -- Tomoaki AOKI