From owner-freebsd-toolchain@freebsd.org Tue May 11 05:20:02 2021 Return-Path: Delivered-To: freebsd-toolchain@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D46DF64FEB9 for ; Tue, 11 May 2021 05:20:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic310-22.consmr.mail.gq1.yahoo.com (sonic310-22.consmr.mail.gq1.yahoo.com [98.137.69.148]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4FfR7j43fTz3CR1 for ; Tue, 11 May 2021 05:20:01 +0000 (UTC) (envelope-from marklmi@yahoo.com) X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1620710399; bh=SKLvwKS1G7xPMYYIbmrOJiS8hC5UCIEF8sDU98sHOJH=; h=X-Sonic-MF:From:Subject:Date:To:From:Subject; b=MTF6o1GC1ZKkFsUO3uBp5gRSVxJrxM7a4NShcMRPsO4wgagl4jSqal72WXgIV7q+QDu3Q0cNXnBF92GtMbZOmLfdlaZv0CIYsxcz3dRsCW4rlrGBXIW0OzZ81b4YEJMjG2eHEvd3N/BUXg+02KKxp8zM2DTkjDa7VAaUjKKhuEOqQUY/Ls4yNS+H/GghV7envyQOfc608C9mb4hhnuyAcXyY4D91vog1xJ8USttphHNwT7IC4XGSx/17Nro075ka7wroVhEg52+D5Dp3X3J9h9xhcsII6QRg+qau8Z18T3Om8hbdjayWVui56AdHMkfn5ZahTxYDsrviO9pnqI9QfA== X-YMail-OSG: JBWUamkVM1n4O5GTTrN7Rs0oLI0BhF5biTxdup2elnTBf04PSHOFReC0Ek2vkhp Mlmc9CBsIHUUkyQiJ6LzxTSl1ePwYdlb8sXfDR9b1VQelSuvof9AkwtxvvoPbXLZ6Edc3x4_cCIc I901XTGJX1F8VLDpGH8dHplnRHdw1Xfm7lKOOjRBM3DKnXVZAfV1Yq8K4lEnEcLGhcuowJDTs3p3 pmdpD6MMKje3MmQBKt0u9jgqV9WS9_2wawYKcn.ShVKs1Es0eXhXGwuuq8dZyiOBlmRc7FmANLUh OFGmyJ9kMnH9w.JXK8lzkvM5aW9kmCTe7lcvgIw1faHwtcMBGpJt8_wMBu6U3M25jKXbr3no3xO5 Y82yVT7DTvfzfDxoP3K7SGIqN9gA._uamvzN2IAFmuQ7B2GeIkrBbXNsgb_0Keei4T_VMcJemfQB hklgqZ0UjFG9YyfjnJRjqTGiyAbz5Srwzj_lbHOyZbvoy4sRjdMzY1IivbdntVzODgaxMnOQryHf k3Le30DBjE0s3_xGAMCkznadoISELAiT.Lh_OZMirvqEZfcx156jnSAiuJu7hggPlB9PhVx.iTgg Y2rQvIiGG6.e8o6ZfuWDhckfxO8.4hAmVIYTdYgpqQ_jXPAYWT_LzjxfYHhOZLirLeLST1s0YwpY neGEe3Bf.Dn9amrH2pfII96SReR7Zjl2nrhKpPBWdUp0OOOakTQ38_KBDH6GWgLyF9aGQNlINHo6 dbW5X1QuefS36QGZt0Eox0vcTX1znYSFw2RHzGSMXL.4Hor1I9Eo8IPmyK_IhIbKXa06QTNGGWGw qaH7d4JTaXl5JEpPp2DFDW8Q9xWJ_kCt_64TAS1cOrSarjn63B6UlD3Nsc8KiLPbHouAZVehqU.X KTWv5qkwh53Pht9rrfo6qiyc9YZfgIOcbR_1C7wnATlrgGpdeUEt_GfEKgBscRctlwKiSi7IqX9v Vq816GsI_0I1cDgTLvDYK8tHQVZ3YFFSLQ0o6idlDa_9AWYGPp5MAZ2Jkr_9SKj9prZ03rRfLxyc OWK5d3ujN8ecWVqBi5mPfhIOEJ09x2bXJeWC5MPQrElumEGfravPrHGZIhllc5y2NYZUSkzmRM87 Y1gyGy3rfWeu0bFruO9uaaoKDbwuR1RJ1kBb0sUToKDu.6qWzditk0iw20Fa5BDSwueTJu8CKpH8 3VGyhta6iRU2jTdXEwrSkYxWTNyGMaT8PS8mlAp8Z7IZwkTZ3MJt0vPJaPqjd.kwDlbD9eNBitD. MLRdh2ZqqVuZcaSFrevVDF2VSnflasHejd7S7g4KkVrUJk1QL0oJYy_KncjaDnYYZD21TNgfeBWc HG.5PfqTgc5mWDO8CordicirkRIxn_.pr2.VRTt2NXF.BJ6_QOa0ofljecf59sLvTsqFwVhUP0kZ Txew7upAI3XQZLG4YWHKZhpjQVCde2PBLXG5QkPrj.EMHXsS1HYQMz4BqxYOwmsdwIGWuCUvVJjr F8d3mxmcos9Rl7vkIVise.3L1BxLMlXZgmO6XQrh9yzHE23htJqi2aNKx5IT.wxKJ7Utsg8Uktzv uGXL1GSHxBwcUd2iWYqf.Pl36K6w0SkKTqyXxO_FWnWBaXiLpEYW3J.rRO4BL52bz.dKvs9Fl9DF cDGiTcV23wddM_9aHdaiB1YYBjzMU7dObbii_utOMCyPIEncmdVELLZ1HIzuT2QFHczbdi908ofq Grm7kStxqhXliqwk6YRe9.oWbMGUk71RLzkNGnPRZY.ouYyAC8V2VMD1KvXc09aWhdfkI0HYoXT4 fEo6rz7XYvmfBj9G2AIZjf5Ce5Jya6FXTUbGFg7pFFes.aZiW16ITJDTuBdNXn59WmgGKa_h0eV. 74RKnXyYng85dUlfkUrpPmyONKTiqcSvMgQPzdLn5anUWKOQYLTKguT8Ysm_9wFCs3El9ko9hTXH EofIlnlkJyyDIivsL1jDbPekU.AbmA4ssjUTRXwc4xyQSDiaxmWaWquYa6OlCKgmbG0s4Cc_KqE0 5Q5wEPcgSXSKQXf6OmK_ulXVNSnpADyyYHX9fsFGjyRvQQuGsny5iFsYwaKHicyHPNfDnSNhHzVo G0YN2f5NjYV548areE2zqzW.VRJjrg6SHei84c.qPATprQyzmBI8vNZeN9zfFVvE4V2pmND.jlMu CdOuiJ8Dh29CfBIe0ig26MCE8H4__HthXn3D3Oj_Ju1E457m6XS47Rg.5je53oV9Bju40UZ1ixAF Pw.e7LypxRdCou1F7eX4enVcwPvwMxvN7KKNEMI2K5BZlOdcBvYiwrrqGPUIJXr0VRA9fp9Wp0Tq qjpnms2j_Agjr3wkew6PpFFQMPPXPSzgHmTGcu4U_saCjt_LkDxD1Ac6g1N7ywOlK3IZntTCUxHi 5.UgyG1Q8d8PETNZGEKumX6D9nwuGBTxfiLW.v2GUqUTN.yl2lbuRnEqKMKPZKvU.nNmRk9SlxcI t4ufnAnRdyCIcuebYRZBjRHAWCtoDGbmJEy87CiC1tc6sJi1IU5kVQICVeqH7boXZJRm2TLCl.tW 1HbrIzscfPlxzLwyYi8EzG6hMowaOFvhmrgzegvmYOD6ETEA_LwWyKcfRNL6aTw99uB29RqwGsI0 J2XUWwKz9HBZfBL6xU15oiTftz9BHZX9frEb5.4DjBg-- X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic310.consmr.mail.gq1.yahoo.com with HTTP; Tue, 11 May 2021 05:19:59 +0000 Received: by kubenode546.mail-prod1.omega.ne1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 8b141e7ad40fb65f0e381c6903d73ec7; Tue, 11 May 2021 05:19:57 +0000 (UTC) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.80.0.2.43\)) Subject: ports-mgmt/poudriere-devel, lang/rust (for example), and USE_TMPFS that includes wrkdir (or yes) Message-Id: <8534A936-B9E6-4BF1-AF26-7F214D359E5C@yahoo.com> Date: Mon, 10 May 2021 22:19:53 -0700 Cc: FreeBSD ports To: Bryan Drewery , FreeBSD Toolchain X-Mailer: Apple Mail (2.3654.80.0.2.43) References: <8534A936-B9E6-4BF1-AF26-7F214D359E5C.ref@yahoo.com> X-Rspamd-Queue-Id: 4FfR7j43fTz3CR1 X-Spamd-Bar: --- X-Spamd-Result: default: False [-3.50 / 15.00]; FREEMAIL_FROM(0.00)[yahoo.com]; MV_CASE(0.50)[]; R_SPF_ALLOW(-0.20)[+ptr:yahoo.com]; TO_DN_ALL(0.00)[]; DKIM_TRACE(0.00)[yahoo.com:+]; DMARC_POLICY_ALLOW(-0.50)[yahoo.com,reject]; NEURAL_HAM_SHORT(-1.00)[-0.999]; FROM_EQ_ENVFROM(0.00)[]; RCVD_TLS_LAST(0.00)[]; MIME_TRACE(0.00)[0:+]; FREEMAIL_ENVFROM(0.00)[yahoo.com]; ASN(0.00)[asn:36647, ipnet:98.137.64.0/20, country:US]; RBL_DBL_DONT_QUERY_IPS(0.00)[98.137.69.148:from]; DWL_DNSWL_NONE(0.00)[yahoo.com:dkim]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; R_DKIM_ALLOW(-0.20)[yahoo.com:s=s2048]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; NEURAL_HAM_LONG(-1.00)[-0.999]; MIME_GOOD(-0.10)[text/plain]; SPAMHAUS_ZRD(0.00)[98.137.69.148:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; RCVD_IN_DNSWL_NONE(0.00)[98.137.69.148:from]; RWL_MAILSPIKE_POSSIBLE(0.00)[98.137.69.148:from]; RCVD_COUNT_TWO(0.00)[2]; MAILMAN_DEST(0.00)[freebsd-toolchain] X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 May 2021 05:20:02 -0000 I've been using USE_TMPFS=3Dyes (so "wrkdir data") on various systems, both ZFS (recently) and UFS (generally, even now). Only one system builds rust (in order for something else to be built), at least so far. An example of the wrkdirs tmpfs use for rust is (UFS context): # df -m | grep tmpfs Filesystem 1M-blocks Used Avail Capacity Mounted on . . . tmpfs 301422 17859 283563 6% = /usr/local/poudriere/data/.m/FBSDFSSDjail-default/01/wrkdirs . . . This was near the end but the maximum figure was probably somewhat higher than the 17 GiByte+ figure above. The context the example is from is for the only large capacity build machine that I have access to, an amd64 context. I have other build contexts as well, but, so far, none have had to deal with building rust. Rust likely would fit the 8 GiByte RAM + 24 GiByte swap aarch64 build context with USE_TMPFS including wrkdir if it was the only builder running at the time. But the existing builds for the context allow 4 builders in parallel, one per core. [This deals just fine with llvm10, llvm11, llvm12, and, gcc10 (no bootstrap) being what happens to build in parallel, even with USE_TMPFS that includes wrkdir. Rust is just uses more space all by itself.] If I end up with something that requires rust for the aarch64 builder context, is there a different technique to deal with the tradeoff other than giving up on USE_TMPFS spanning wrkdir for all other other ports/builder-instances as well, presuming the same media and partitioning (such as total swap space)? Imaginary examples could be: A) Tell poudriere that lang/rust is to be built by itself despite the general 4-builder context. B) Tell poudriere that USE_TMPFS excludes wrkdir for lang/rust's specific builder. C) . . . (good question) . . . So far all I've come up with is explicitly building lang/rust by itself first, a form of (A): # poudriere bulk -jNAME -w lang/rust # poudriere bulk -jNAME -w -f ~/origins/CA72-origins.txt (Hopefully, reliably remembering to do so.) Is there any better technique that I've not noticed? To some extent here, lang/rust is being used an example of a more general issue: Other ports could have similar issues with attempted wrkdir-included USE_TMPFS use. Note: If I build using WITH_DEBUG, the one system that I have access to that can build such a lang/rust with workdir included in USE_TMPFS shows over 130 GiBytes in the tmpfs earn the end of the builder's activity. (This is a amd64 context with 128 GiBytes of RAM and 192 GiBytes of swapping/paging space.) =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)