From owner-freebsd-ports@freebsd.org Tue May 5 18:04:43 2020 Return-Path: Delivered-To: freebsd-ports@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id D0A7B13F6C9 for ; Tue, 5 May 2020 18:04:43 +0000 (UTC) (envelope-from freebsd@quinteiro.org) Received: from mx2.quinteiro.org (mx2.quinteiro.org [71.19.154.200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 49GngG1Y9tz4KkP for ; Tue, 5 May 2020 18:04:42 +0000 (UTC) (envelope-from freebsd@quinteiro.org) Received: from www.quinteiro.org (www.quinteiro.org [204.109.56.22]) (using TLSv1 with cipher ADH-CAMELLIA256-SHA (256/256 bits)) (No client certificate requested) by mx2.quinteiro.org (Postfix) with ESMTPS id A5EB721D9A6 for ; Tue, 5 May 2020 18:04:35 +0000 (UTC) (envelope-from freebsd@quinteiro.org) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=quinteiro.org; s=default; t=1588701875; bh=06VXoXADA6kTrWhGBlW4r4t9EDfndexsN1gWhF4Y1y8=; h=Subject:To:References:From:Date:In-Reply-To; b=bQVzwk+8UxWCiLT3ssbpGl9Nf7rLyiAzjTCROEKNmZJiempyomYH6u1EfRlOkvG6L y7Hww6sFMUprOJx4yqR0uqRiLD2mwgClCjra+wBFO7y6t3XbYTP7Cm5TxYEEqeEqQZ uQT26yqC0dB4+bO/V8NIhLxC4e83D+ubvtBy07Ys= Received: from [172.16.1.157] (157-131-78-48.fiber.dynamic.sonic.net [157.131.78.48]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (No client certificate requested) by www.quinteiro.org (Postfix) with ESMTPSA id C5CB73263A for ; Tue, 5 May 2020 18:04:33 +0000 (UTC) Subject: Re: Out of memory building lang/ghc-8.8.3 To: freebsd-ports@freebsd.org References: <20200505093712.5qeyqt7gioolhdyu@ozzmosis.com> <20200505110900.za365npmukedw4x3@ozzmosis.com> From: Jose Quinteiro Message-ID: <32253ebf-a693-1ab6-c5b2-0c99c99c5fca@quinteiro.org> Date: Tue, 5 May 2020 11:04:32 -0700 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:68.0) Gecko/20100101 Thunderbird/68.7.0 MIME-Version: 1.0 In-Reply-To: <20200505110900.za365npmukedw4x3@ozzmosis.com> Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-Rspamd-Queue-Id: 49GngG1Y9tz4KkP X-Spamd-Bar: -- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=quinteiro.org header.s=default header.b=bQVzwk+8; dmarc=none; spf=pass (mx1.freebsd.org: domain of freebsd@quinteiro.org designates 71.19.154.200 as permitted sender) smtp.mailfrom=freebsd@quinteiro.org X-Spamd-Result: default: False [-2.41 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; R_DKIM_ALLOW(-0.20)[quinteiro.org:s=default]; NEURAL_HAM_MEDIUM(-1.00)[-0.995,0]; FROM_HAS_DN(0.00)[]; R_SPF_ALLOW(-0.20)[+mx]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[freebsd-ports@freebsd.org]; TO_DN_NONE(0.00)[]; RCPT_COUNT_ONE(0.00)[1]; NEURAL_HAM_LONG(-1.00)[-1.000,0]; RCVD_COUNT_THREE(0.00)[3]; DMARC_NA(0.00)[quinteiro.org]; DKIM_TRACE(0.00)[quinteiro.org:+]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; IP_SCORE(0.09)[ipnet: 71.19.154.0/24(0.28), asn: 47066(0.19), country: US(-0.05)]; ASN(0.00)[asn:47066, ipnet:71.19.154.0/24, country:US]; MID_RHS_MATCH_FROM(0.00)[]; RCVD_TLS_ALL(0.00)[] X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.30 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 May 2020 18:04:43 -0000 Something like this maybe: ALLOW_MAKE_JOBS_PACKAGES="pkg llvm* gcc* node* *webengine rust* firefox* mame mess" >From this Forums post: https://forums.freebsd.org/threads/howto-speeding-up-poudriere-build-times.69431/#post-460170 HTH, Jose On 2020-05-05 04:09, andrew clarke wrote: > On 2020-05-05 14:19:50, Gleb Popov (arrowd@freebsd.org) wrote: > >> On Tue, May 5, 2020 at 1:37 PM andrew clarke wrote: >> >>> Beware anyone building lang/ghc-8.8.3 from the ports tree. Building it >>> here on FreeBSD 12.1-REL AMD64 with Poudriere, the build ran out of swap, >>> despite the PC having 8 GB RAM, 8 GB swap and not much else running. >>> >>> My /usr/local/etc/poudriere.conf: >>> >>> BASEFS=/poudriere >>> ZPOOL=zroot >>> FREEBSD_HOST=http://mirror.internode.net/ >>> POUDRIERE_DATA=/poudriere/data >>> RESOLV_CONF=/etc/resolv.conf >>> DISTFILES_CACHE=/usr/ports/distfiles >>> USE_TMPFS=yes >>> ALLOW_MAKE_JOBS=yes >>> KEEP_OLD_PACKAGES=yes >>> PARALLEL_JOBS=8 >>> >>> Maybe I can retune the last three parameters to use less memory. I've not >>> tried yet. >>> >>> This isn't really a whinge, I'm just surprised it failed. I'd have thought >>> 8 GB was enough. >>> >>> (ghc is a build dependency of textproc/hs-pandoc) >>> >> >> Did you have something else building at the same time? >> >> On my laptop with 16 Gb of RAM I also see OOM failures when building >> multiple "heavy" packages (llvmXX, gccX, ghc, rust, libreoffice) >> simultaneously. In this case I use -J poudriere option to limit number of >> jobs. > > Nothing else building. > > This is a headless server, so I've no need to build something the size of > libreoffice or chromium. I've noticed llvm10 takes a long time to build, but > 8 GB seems plenty of memory for it. > > The -J option sounds like the way to go, provided I remember to use it > next time. Or I could instead set PARALLEL_JOBS=1 in poudriere.conf but then > build performance will suffer for every port, which isn't ideal. > > But perhaps there's an option to limit make jobs just for a single port, set in > /usr/local/etc/poudriere.d/make.conf ? That would be nice. > _______________________________________________ > freebsd-ports@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-ports > To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org" >