From owner-freebsd-current@freebsd.org Mon Jan 27 20:48:53 2020 Return-Path: Delivered-To: freebsd-current@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 2F85D22E7FF for ; Mon, 27 Jan 2020 20:48:53 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from smtp-out-so.shaw.ca (smtp-out-so.shaw.ca [64.59.136.137]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "Client", Issuer "CA" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 48620M5gg3z4BMg for ; Mon, 27 Jan 2020 20:48:51 +0000 (UTC) (envelope-from cy.schubert@cschubert.com) Received: from spqr.komquats.com ([70.67.125.17]) by shaw.ca with ESMTPA id wBJOi3ARN17ZDwBJQiz8My; Mon, 27 Jan 2020 13:48:49 -0700 X-Authority-Analysis: v=2.3 cv=ZsqT1OzG c=1 sm=1 tr=0 a=VFtTW3WuZNDh6VkGe7fA3g==:117 a=VFtTW3WuZNDh6VkGe7fA3g==:17 a=kj9zAlcOel0A:10 a=Jdjhy38mL1oA:10 a=CjxXgO3LAAAA:8 a=YxBL1-UpAAAA:8 a=6I5d2MoRAAAA:8 a=o_fEvd48_l3giiTbq5UA:9 a=fA33GuqEjCHS9fZ1:21 a=MqgclpkY7po7t7Dk:21 a=CjuIK1q_8ugA:10 a=Ia-lj3WSrqcvXOmTRaiG:22 a=IjZwj45LgO3ly-622nXo:22 Received: from slippy.cwsent.com (slippy8 [10.2.2.6]) by spqr.komquats.com (Postfix) with ESMTPS id 96CFDB6E; Mon, 27 Jan 2020 12:48:45 -0800 (PST) Received: from slippy.cwsent.com (localhost [127.0.0.1]) by slippy.cwsent.com (8.15.2/8.15.2) with ESMTP id 00RKmjFW006729; Mon, 27 Jan 2020 12:48:45 -0800 (PST) (envelope-from Cy.Schubert@cschubert.com) Received: from slippy (cy@localhost) by slippy.cwsent.com (8.15.2/8.15.2/Submit) with ESMTP id 00RKmiZs006726; Mon, 27 Jan 2020 12:48:44 -0800 (PST) (envelope-from Cy.Schubert@cschubert.com) Message-Id: <202001272048.00RKmiZs006726@slippy.cwsent.com> X-Authentication-Warning: slippy.cwsent.com: cy owned process doing -bs X-Mailer: exmh version 2.9.0 11/07/2018 with nmh-1.7.1 Reply-to: Cy Schubert From: Cy Schubert X-os: FreeBSD X-Sender: cy@cwsent.com X-URL: http://www.cschubert.com/ To: Mark Millard cc: Cy Schubert , "Rodney W. Grimes" , sgk@troutmask.apl.washington.edu, freebsd-current@freebsd.org, yasu@utahime.org Subject: Re: After update to r357104 build of poudriere jail fails with 'out of swap space' In-reply-to: References: <202001261745.00QHjkuW044006@gndrsh.dnsmgr.net> <202001271309.00RD96nr005876@slippy.cwsent.com> Comments: In-reply-to Mark Millard message dated "Mon, 27 Jan 2020 12:36:27 -0800." Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Date: Mon, 27 Jan 2020 12:48:44 -0800 X-CMAE-Envelope: MS4wfJs4Lvme5bWWEocbnJ3A3+ZXgDINNTJhZhOdi+UYh8gApqbPR5dab4arlJ93xGikLsDY8otZXB1Mxvm/8kmWaQlF4A2DWDWS9F6q7pGVsnjGTbj4QCxA KHMZx94ZhhKqtHSQxonLlBo5zmMdXzI7lhRBt+WpU3BEtSQEcTyu/5/jfQqCOWpYxKaY75zYS3q2umURXg4D26mFmST2oVL3/0LgxnFN4/6+6u7Y8cJhEJuY sYQz7YWNyoxCN+1r9s4cJ/KtpUU8uuol8FCEJ82uDQUP5fSSFSRdgJEWC832cdiVoqQ4pFkGnydljpGJq8jHczf/aQYGHOpCC9TGSLJKXYs= X-Rspamd-Queue-Id: 48620M5gg3z4BMg X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; dkim=none; spf=none (mx1.freebsd.org: domain of cy.schubert@cschubert.com has no SPF policy when checking 64.59.136.137) smtp.mailfrom=cy.schubert@cschubert.com X-Spamd-Result: default: False [-4.08 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; RCVD_COUNT_FIVE(0.00)[5]; RECEIVED_SPAMHAUS_PBL(0.00)[17.125.67.70.khpj7ygk5idzvmvt5x4ziurxhy.zen.dq.spamhaus.net : 127.0.0.11]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; MV_CASE(0.50)[]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; MIME_GOOD(-0.10)[text/plain]; HAS_XAW(0.00)[]; HAS_REPLYTO(0.00)[Cy.Schubert@cschubert.com]; RCPT_COUNT_FIVE(0.00)[6]; REPLYTO_EQ_FROM(0.00)[]; TO_MATCH_ENVRCPT_SOME(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000,0]; R_SPF_NA(0.00)[]; FREEMAIL_TO(0.00)[yahoo.com]; RCVD_IN_DNSWL_LOW(-0.10)[137.136.59.64.list.dnswl.org : 127.0.5.1]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:6327, ipnet:64.59.128.0/20, country:CA]; RCVD_TLS_LAST(0.00)[]; IP_SCORE(-2.38)[ip: (-6.14), ipnet: 64.59.128.0/20(-3.18), asn: 6327(-2.47), country: CA(-0.09)]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 27 Jan 2020 20:48:53 -0000 In message , Mark Millard write s: > > > > On 2020-Jan-27, at 10:20, Cy Schubert wrote: > > > On January 27, 2020 5:09:06 AM PST, Cy Schubert > wrote: > >>> . . . > >> > >> Setting a lower arc_max at boot is unlikely to help. Rust was building > >> on > >> the 8 GB and 5 GB 4 core machines last night. It completed successfully > >> on > >> the 8 GB machine, while using 12 MB of swap. ARC was at 1307 MB. > >> > >> On the 5 GB 4 core machine the rust build died of OOM. 328 KB swap was > >> used. ARC was reported at 941 MB. arc_min on this machine is 489.2 MB. > > > > MAKE_JOBS_NUMBER=3 worked building rust on the 5 GB 4 core machine. ARC is > at 534 MB with 12 MB swap used. > > If you increase vm.pageout_oom_seq to, say, 10 times what you now use, > does MAKE_JOBS_NUMBER=4 complete --or at least go notably longer before > getting OOM behavior from the system? (The default is 12 last I checked. > So that might be what you are now using.) It's already 4096 (default is 12). > > Have you tried also having: vm.pfault_oom_attempts="-1" (Presuming > you are not worried about actually running out of swap/page space, > or can tolerate a deadlock if it does run out.) This setting presumes > head, not release or stable. (Last I checked anyway.) Already there. The box is a sandbox with remote serial console access so deadlocks are ok. > > It would be interesting to know what difference those two settings > together might make for your context: it seems to be a good context > for testing in this area. (But you might already have set them. > If so, it would be good to report the figures in use.) > > Of course, my experiment ideas need not be your actions. It's a sandbox machine. We already know 8 GB works with 4 threads on as many cores. And, 5 GB works with 3 threads on 4 cores. -- Cheers, Cy Schubert FreeBSD UNIX: Web: http://www.FreeBSD.org The need of the many outweighs the greed of the few.