From owner-freebsd-ports@freebsd.org Thu Aug 11 12:17:12 2016 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6899FBB31A6 for ; Thu, 11 Aug 2016 12:17:12 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: from mail-yw0-x22e.google.com (mail-yw0-x22e.google.com [IPv6:2607:f8b0:4002:c05::22e]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 241E11895 for ; Thu, 11 Aug 2016 12:17:12 +0000 (UTC) (envelope-from ultima1252@gmail.com) Received: by mail-yw0-x22e.google.com with SMTP id r9so1070515ywg.0 for ; Thu, 11 Aug 2016 05:17:12 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:from:date:message-id:subject:to; bh=Pjv492lJ1MPHZ6upj/VgEW+aVBiIQ1GjvVJMbSO9mFc=; b=GdaaG7jI4/JJ63EynBjoSHb6XN5WV7eC5xnxuzXpvIZAcD/y5ApUripp5VWhz/ygFH zJV3I49UP3Wpk/PuugaduYrWOwT5j1lRzteQLa6j28cpnOZkfNRnE+JL7Gcxjxnbpee2 1K/Km8PFCpfKRCwDTRFxrBlJUJo/H1Ju4QPt0QvyAGOV2XPFY/dgP3IwfFTQ9iGRbb9D Tg269vaKGv789Zv76oQ5HMLLignl0Ujd9I/yGs/D64QliqQeobZl+MhRmw4khF9Yiuqi BEMsNF2upP4wuoulIihL6uhBvTjvA4b0ip+4o/RdWbxgUiFSoK3Ms35Cbu+OzNbs0Mt+ ngJQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:from:date :message-id:subject:to; bh=Pjv492lJ1MPHZ6upj/VgEW+aVBiIQ1GjvVJMbSO9mFc=; b=c6IapCfYoxkGqw7wkk+sQeUr0YDXWg/cim30nUss3lpnL7++/gMsC8gXhFPCTDOVTJ Tp+AakjJIQ+rijsfQW2SdkzY6DGMmEfGE2Zc3LBL8Ry9n9UDfFVc7fd72WbOiJJ4vkeH otYMNWF0s1wc8dnY+p7JSbkzupR6iDtwAVp1D+IGx+tGk9NinY/A0YEZ6XYuAQ33So0a dey3K7P/nel9+V6QYaJQQ4XRFMz2dTYmaBUFzZceskqoRu23Petn5OWZfviAQprwqWy0 4eeK0aCY3iCyAUhGrRgQxCd7Wj6kxa273ZzfmchXmdK4x26oXUN1+apVhslqzpdA8Q2/ 0Lig== X-Gm-Message-State: AEkoouuw3KcPZ6aROQHYxcpMHkPXns1QeDpViZhLIUx5o0yLn0VO/gDDjT2P5J7lm1PbBqjgUgbLeYA+Owwpwg== X-Received: by 10.13.222.133 with SMTP id h127mr6814519ywe.279.1470917831256; Thu, 11 Aug 2016 05:17:11 -0700 (PDT) MIME-Version: 1.0 Received: by 10.129.51.150 with HTTP; Thu, 11 Aug 2016 05:17:10 -0700 (PDT) In-Reply-To: <20160811074959.GA2444@c720-r292778-amd64> References: <051C3C33-AAB5-43CD-A089-600420F1648D@ellael.org> <20160806153522.GB20662@csarch> <20160811074959.GA2444@c720-r292778-amd64> From: Ultima Date: Thu, 11 Aug 2016 08:17:10 -0400 Message-ID: Subject: Re: poudriere: howto build ports with 'make -j x'? To: Matthias Apitz , Ultima , Michael Grimm , freebsd-ports@freebsd.org Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.22 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.22 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 11 Aug 2016 12:17:12 -0000 Chromium and Libreoffice are two programs that are massive and have the longest compile times in the ports tree along with eclipse. If the system only has 2 cpus I would expect those to take at least 4-8 hours minimum. If they are also building in parallel you can expect that to also increase. My system takes 40 minutes for Chromium and 50 for Libreoffice, and thats with jobs=3D40 on 2.0 cores. Sorry if my comment was confusing, this variable's use-case is better to limit the amount of jobs per jail on a given system. Enabling ALLOW_MAKE_JOBS=3Dyes will set the makejobs on all jails to maximum amount = of cpu's, in you're case 2. The reason I made my comment, if makejobs > 64 some ports will begin to fail to build due to too many makejobs. Also, for multiple threaded cpu's it may increase performance setting it lower when running many jails in parallel. > These I do run as single steps each from a shell script > poudriere bulk -j freebsd-head -p ports-head www/firefox > poudriere bulk -j freebsd-head -p ports-head www/chromium It may run faster, but only because they are not building in parallel. On Thu, Aug 11, 2016 at 3:49 AM, Matthias Apitz wrote: > El d=C3=ADa Saturday, August 06, 2016 a las 02:13:39PM -0400, Ultima escr= ibi=C3=B3: > > > If you plan on running build in parallel it maybe necessary to also > > set MAKE_JOBS_NUMBER_LIMIT=3D into the make.conf file as well. > > I have a list of some 270 ports which poudriere should work through with > 3 builders, resulting in some 1700 ports to build: > > poudriere bulk -f /usr/local/etc/poudriere-list -J 3 -j freebsd-head -p > ports-head > > This list does not include some ports which are verry time consuming on > my hardware (2 CPU 3.7 GHz) like > > www/firefox > www/chromium > editors/openoffice-devel > editors/libreoffice > ... > > These I do run as single steps each from a shell script > > poudriere bulk -j freebsd-head -p ports-head www/firefox > poudriere bulk -j freebsd-head -p ports-head www/chromium > ... > > matthias > -- > Matthias Apitz, =E2=9C=89 guru@unixarea.de, =E2=8C=82 http://www.unixarea= .de/ =E2=98=8E > +49-176-38902045 > "Ohne die Mauer h=C3=A4tte es Krieg gegeben" Fritz Streletz u.a. > "Sin el Muro hubiese habido guerra." >