From nobody Sat Jul 10 00:12:57 2021 X-Original-To: freebsd-ports@mlmmj.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mlmmj.nyi.freebsd.org (Postfix) with ESMTP id BE0031272104 for ; Sat, 10 Jul 2021 00:13:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) Received: from sonic315-55.consmr.mail.gq1.yahoo.com (sonic315-55.consmr.mail.gq1.yahoo.com [98.137.65.31]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 4GM9Tp3MV7z4T61 for ; Sat, 10 Jul 2021 00:13:02 +0000 (UTC) (envelope-from marklmi@yahoo.com) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1625875980; bh=vDCWyXD5uwUWu5ms1X6LOBbYrRwBrbruuDgsVFGEhyM=; h=Subject:From:In-Reply-To:Date:Cc:References:To:From:Subject:Reply-To; b=XqtlXH0axH0GPLXmhEaSdAp6w1PPv02hJhXsQ+HPCs1lilB5srYWz8fHQm01vF59OBiwlR0zFsyJHyb6ZgWbqFJ7UwARb5lpc6XUK6GW87eIX2WoeiUDOksMdM6gewGli0swQj3p88FEG0x8bBajhrM2ZlRy8qq81nj/JDqx9jW0d5ExXKgMp8n0gJ5njX/xC/WFz0wswCLgDrN1KW8QLFeBBGEPg8VMKRKdMnMDqPSTh0iE/UKV5LAgiHVel8o2ogCBMpTDGJR+U/oByiwZVKZY6mHr7vhQLUFyBxNOAV54xLVuxInGHjZ/QtndzLZLkBdTFHvyueUM3cz+b2Wuaw== X-SONIC-DKIM-SIGN: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s2048; t=1625875980; bh=VwZXB1AgpJF1Y7iQ3JKkU7iMIZuuDyDtAJyH0XxAaop=; h=X-Sonic-MF:Subject:From:Date:To:From:Subject; b=oqeWlTrQyYQFP0kxpwKANjrPxGxk+kG+iMQ9Ok6+694BpVRxEcibjP7QdcL/dsvtrzjKJvP52UM58D+5weMlgwZ5UlyUIUsJyYxCW3L79zh9GhR3QHhdAPBFn1spHBNkN4XP9cOO0uYSU56aE9WF0SHb01KL6vBPCFhPklWP512cJnvLwycYhnAuT0DfqvCakXd5AldTVjyxFCfIAJIBgNVgslqCOct1X9vj8cVFFiggy+B15LbzCTSB66lbS1YoRlK4WT4yvheIAdWz0q8nX+2w97UcivM4bG3TZrq1+LHkE8QbUBCaxXY+jU0oUSln5Vas6V4fm4zmhIeG98DvXQ== X-YMail-OSG: ViR03tgVM1knDzuxgjLiMCByLen8aCXr0zIo_vmgu4iGD2RhdDrcJ_TaSDsb1Xu Z..uNLLb2FPAyntLAzudSBFsNRzVGscAQiVtqLQazUAPQ8RXwXq028KhQLFQrB3gXWoYCno2teBB vTpoWmBWpcaZ6gIKnGhtED9J4uc8Jm4oaTHUTqZQdXqjkegBaKW2tZRvAx9.q7KgjgxyH59yFW5s NG0xqFC9vUyt6x9pDaM5lrWlO5BnG0dXyBVvNJo409uN8UH2S8humFr_S8T1mdvVXFCPz4oA8oBy 4UzHruqMqzockJfhEGG9t_TfEnv2Jju9G7y7GSkefe7Y6COiUbIf.0pr5tNR62U.dHnGWCwXwTXW O6mt9F4D.LkIjEgnSmVVbZ2XfsDbtGtnmfa6ZPxuQlqgdWGadgUdrY8R.02wkdvwpo1zDY6j_gtU 1eKfBZw.bqnupNdSK.7sVh1LnnKui12_cFCW1csfyKhHpw5t5NFOld5OQykKF37ibVzUkh9phTHR IP1QHTqnBwjGGGXGGoix6In41GxQ.7GlOd44kRFynwAvSimWyqB.JKFjEbjTmHKaTf9YLANP2oxK fIV22DQp1RDuowpW0sQ.qtoTm0cGBfjgQltPxE.Ce7rjtvZo0wJZd12y7VUDAzGju02bhS1dKlPh 39zyEw6ongOwL3IP7ySdMquR8lurD6x2BWsz3iOOXBUlLRc2fCylU3mUs9KEdll1xvwArM8DZM.B UXe_6OnsnKIW0E.9aFkM_AMn8_hL5ZqoQovoz.L48gi4wQ9p8McV5Z_rqRpnA4SE3LISLLb7zC7A cnaoOQUE.1aQFANtsPef0iCzd2LKcj3F2SNNn623SXBQ9aoSUDgxwwydtTvTF2n1TVNLzst1tmfr sHYp.ENYv0HDWcV1eFnpC297AqCCQWZevJemDn.eOBSE2X_IjVbaqc42Gj14G3mk6t_4NNYQz_lT w6r.JXfV82qUjNeYur1I.fDLQG2z6hxQCJJmRVvWPphP.dfFfPB65rmYQxFzYkpAOe1w1kGKTilX Cxqm02jdqLhiJUKi4yVyGmHj9L5gPwYUzKuRCqYQLdWT0PrJaCH3qJLu_S9Swk8sDPvsIAYHJTNt 99lowszQlmq0Mq5AT6oD3JypuDiXHM5tS_tM2FEbw4I7WiFHW1wgHgEgGGciLx6FmPYs2DaN3RLw NzWV2c_9YuFy8ug8.KSXvFBe25aZaSR7EQ7xdSSaITyKZBrLdeigGEi9qBaA_Pj.FqUQVYxMJci2 rnkXH0ZRQDwCiUTo100rCzvinYz.znRPJd2dohec.0MDrPM1mFA.3k_7AvDq24e7.Z5ljZZhgCFq YpuddoixFA8g07C1TLRDIrrF03EE7vNVaglWOSNBCjCBs_js52vm3oVz9wkg0.7MZnU0AMLg_doZ aplAo4GaUs6D_8DTaDmJsmSQzsBNKMAr8eUXq7waVA813OVugsX7AHHuGO_Ep4Z15hHNaCjwHRVy dwn8Fq_rHIJOTGGzZMsoK1cj_kS_dNgx6k1q2e5W54ky0wvB2o67Pf2hAQ.e.lOA0wLhGq4L0udt IV41FvkcTXlNNaoadD2svV_TSA1WVuoZ8cOXCVj1kewm3dPqkcEC0bI.8BoTbG7xYROhH5u0XHf9 3Vp6EtG.UzovMxOzkqmj2ZJFJyeEp5OwFe76n80NTIU0fJrOSkwVUS_Wi71FZnTzbAo0KCgHEnHD ExDyMF8bfsaFSy.bm2GGJnqj1IUbhEbLuh0dmw0eK1mFCmWZHbhyBYQaswSxC_MJI9hkJLDvJ4o3 acsZkA2pGwLePKUJCj9yk0Ymofa4mn.2gUaWxWwMZmj99brPm.8L4WM3Bc4XaLBCkqPGhdhnolw_ jklHxLslxExfKhCz315caDtt0Z2g9Lvmob6Ukf_s4HTX8Dt5Yq21pHqZjKEP1kJ31xZY8H.5w23H qFxVATy2WMCxBz_CcWCtOiuRvdTNrDEpvEzgzSUtq1U8ibwpf8Ll6kQlvystav8ZZE_Itvftx6n3 .YxOAQcoa9BJb_.jW4PWND1pyiiTkid1aWZ74Fer7iEBvVJJSq2eeDql0GiXPxjgKEMmWRZ1urrF _YRVqd2w1SXO6dUdfMy9WjoP_O_gUB1H55GqAyajTlTlkUPCE0HjS6h7ma6MFJVj55DIQHZt138S m2NRR2_cYLmh7673.PJkG3FIYl9Wf_oTzsG3UN5KbgcKNncHC1_pwxQ9SJ3.pHMslhiA0.hR3dH5 b3jwDt_J48NjmgtoFNXT.V0gWeCBPkeTJbbgE7215Xg2pFR98P0WLtZbpQqyhUz08ryoKkGaDC2x ANXDZ6MxzKyrP5RGbxoOGNtUN0CvKlnVLQ5AbkEq1Mx9EP3X8YlRF5JhSBHHEMFrgJalbxLR02Mh HzLeak4SxjI0scK3kY_ZhF6w50ZefSiKrlAGPvoIgANmhIJ8oZMkwv5fw4NPFfRl2mUxEIroOMtn EPt9wmfEYP1wDKGY3H.oE.1artOzLcfXs8HYgTI8uk7frZLUAi7eGjYb.6W0qI.cnZa84K7LT0kJ 8YGyyDbag9xX9 X-Sonic-MF: Received: from sonic.gate.mail.ne1.yahoo.com by sonic315.consmr.mail.gq1.yahoo.com with HTTP; Sat, 10 Jul 2021 00:13:00 +0000 Received: by kubenode500.mail-prod1.omega.gq1.yahoo.com (VZM Hermes SMTP Server) with ESMTPA ID 1a843aa11e1a9de01149e9e7a77d23e0; Sat, 10 Jul 2021 00:12:58 +0000 (UTC) Content-Type: text/plain; charset=us-ascii List-Id: Porting software to FreeBSD List-Archive: https://lists.freebsd.org/archives/freebsd-ports List-Help: List-Post: List-Subscribe: List-Unsubscribe: Sender: owner-freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org Mime-Version: 1.0 (Mac OS X Mail 14.0 \(3654.100.0.2.22\)) Subject: Re: Too many pythons in poudriere In-Reply-To: <20210709230738.GA83522@www.zefox.net> Date: Fri, 9 Jul 2021 17:12:57 -0700 Cc: freebsd-ports@freebsd.org Content-Transfer-Encoding: quoted-printable Message-Id: <0313838D-C54A-4517-A53B-C70B4EDDE296@yahoo.com> References: <044A7E63-2734-41F4-A1A2-AE5096C6A62C@yahoo.com> <20210708154558.GB60914@www.zefox.net> <20210708175436.GA70414@www.zefox.net> <24795168-CEBF-4049-A4BD-D529F70E7F8D@yahoo.com> <6D9BAA86-CB85-42E9-B4FC-6272141CFFDB@yahoo.com> <20210709230738.GA83522@www.zefox.net> To: bob prohaska X-Mailer: Apple Mail (2.3654.100.0.2.22) X-Rspamd-Queue-Id: 4GM9Tp3MV7z4T61 X-Spamd-Bar: ---- Authentication-Results: mx1.freebsd.org; none X-Spamd-Result: default: False [-4.00 / 15.00]; REPLY(-4.00)[] Reply-To: marklmi@yahoo.com From: Mark Millard via freebsd-ports X-Original-From: Mark Millard X-ThisMailContainsUnwantedMimeParts: N On 2021-Jul-9, at 16:07, bob prohaska wrote: > On Fri, Jul 09, 2021 at 12:46:47PM -0700, Mark Millard wrote: >>=20 >> Going in different direction, when you updated: >>=20 >> /usr/local/poudriere/poudriere-system >>=20 >> to have Jail OSVERSION: 1400024 (and probably >> matching the host OS main-n247590-5dd84e315a9), >> matching /usr/src/ as well, did you rebuild all >> your ports under the coherent combination? >>=20 > No. >> Or are you still using port builds in poudriere that >> were built with the jail OSVERSION being older than >> the /usr/src/ the builds were based on? >>=20 >=20 > Yes. >=20 >> Just like devel/llvm10 had a command that only-sometimes >> had problems when built via the incoherent combination, >> other ports could have odd behavior --but only sometimes. >>=20 >> My guess is that you have not done such because it would >> have taken far more time than I've noticed in your >> activities. >>=20 > Correct! >=20 >> I recommended before doing such a rebuild of the ports >> and then a reinstall of them. Given the odd behaviors >> being observed that do not repeat each time tried, I >> still make the recommendation. >>=20 >=20 > Just to be clear, after updating kernel and world I gather the=20 > suggestion is to repeat >=20 > # cd /usr/src > # make installworld DESTDIR=3D/usr/local/poudriere/poudriere-system = DB_FROM_SRC=3D1 > # make distrib-dirs DESTDIR=3D/usr/local/poudriere/poudriere-system = DB_FROM_SRC=3D1 > # make distribution DESTDIR=3D/usr/local/poudriere/poudriere-system = DB_FROM_SRC=3D1 I though you had already synchronized = /usr/local/poudriere/poudriere-system to match /usr/src/ and the host root file system in use. If so, no = reason to repeat until /usr/src/ (and the booted host root file system) is = updated for some reason. Avoid mixes where /usr/src/ is mismatched with the root file system at the time. Of course, you might want to do another update to those for all I know. One thing you did not show was the command for after the above block of 4 commands for updates: # make -DBATCH_DELETE_OLD_FILES delete-old = DESTDIR=3D/usr/local/poudriere/poudriere-system DB_FROM_SRC=3D1 If you have not done that yet, it would be appropriate. For the current context of starting over, another command that is appropriate (that would normally be delayed to after all the poudreire bulk commands are done [were prior package builds were instead being put to use]) is: # make -DBATCH_DELETE_OLD_FILES delete-old-libs = DESTDIR=3D/usr/local/poudriere/poudriere-system DB_FROM_SRC=3D1 I'll note that the host updating procedure also involves using delete-old and, after package updates are all installed, delete-old-libs . (No explicit DESTDIR=3D or DB_FROM_SRC=3D use involved for the root file system update.) > Next,=20 > cd /usr/local/poudriere > poudriere jail -d main -C all > to get rid of the old jail and packages, then re-make the jail with=20 >=20 > # poudriere ports -c -m null -M /usr/ports > # poudriere jail -c -j main -m null -M = /usr/local/poudriere/poudriere-system -S /usr/src -v 14.0-CURRENT >=20 > Have I got this right? One thing I'm hesitant about is=20 > the -C all option.=20 No reason to delete and recreate the jail, just do a bulk build that rebuilds the ports. The first "poudriere bulk" of a sequence can use the "-c" option to clear out the existing packages (and logs) before the builders start building. As far as I know you eventually want to install: # pkg install chromium (that will also install things required to run chromium). I'm not sure if you have a list of other packages that you want explicitly installed. So my notes below need not cover everything that you want to do. (I do not know if ALLOW_MAKE_JOBS=3D and such is appropriate for the llvm10 bulk build but it may fit in the resources okay:) # poudriere bulk -j main -c devel/llvm10 > = bulk_from_scratch_for_llvm10_1st.log (I'm unclear if you would want a -J? to limit the builders count for the above command: if so, use it too.) That -c will first clear out the existing package builds (and the logs according to the documentation). Then it will start from scratch building the required ports. This will build a lot of ports, those needed to in turn build devel/llvm10 . So having -J1 used and ALLOW_MAKE_JOBS missing would make for a very long build time. You probably want to allow some combination of multiple cores to be in use, possibly also involving MAKE_JOBS_NUMBER=3D use. You know more about what combinations worked before. Reminder that ALLOW_MAKE_JOBS=3D control would go in: /usr/local/etc/poudriere.conf but MAKE_JOBS_NUMBER=3D control would go in: /usr/local/etc/poudriere.d/make.conf (I do not know if ALLOW_MAKE_JOBS=3D and such is appropriate for the rust bulk build but some combination may fit in the resources okay:) # poudriere bulk -j main lang/rust > bulk_for_rust_2nd.log (I'm unclear if you would want a -J? to limit the builders count for the above command: if so, use it too. You know more about what combinations worked before.) (Without ALLOW_MAKE_JOBS=3D is likely appropriate --or at least the MAKE_JOBS_NUMBER=3D may be needed-- for:) # poudriere bulk -j main www/chromium > bulk_for_chromium_3rd.log (I'm unclear if you would want a -J? to limit the builders count for the above command: if so, use it too. You know more about what combinations worked before.) Note that the management of the limited RPi3B context involves adjusting things like ALLOW_MAKE_JOBS=3D and -J? usage for each huge build to limit resource use to an appropriate scale for those builds. For smaller builds, more can be allowed (more adjustments). I do not know if there are other ports that you would want to build and later install that are not automatically built by the above or if you have a list of such in a file that can be used with -f . In your context this would probably be a list of ports that do not involve huge builds, given that you had already done the above bulk runs (and any others that might involve more huge builds). =3D=3D=3D Mark Millard marklmi at yahoo.com ( dsl-only.net went away in early 2018-Mar)