From owner-freebsd-ports@freebsd.org Wed Sep 12 01:46:58 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 29AAA10A570B for ; Wed, 12 Sep 2018 01:46:58 +0000 (UTC) (envelope-from ndowens@yahoo.com) Received: from sonic313-39.consmr.mail.ne1.yahoo.com (sonic313-39.consmr.mail.ne1.yahoo.com [66.163.185.62]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B69E893C6C for ; Wed, 12 Sep 2018 01:46:57 +0000 (UTC) (envelope-from ndowens@yahoo.com) X-YMail-OSG: 847UHwUVM1n.ewBWI5SobEj7._uLoSP3rhq3J6h2o5z0vbut77Adk8Ge9x_bFxM 3wqblWEIx5T1fHw2Adi5aArVfvAWD_DpVKzaFXktjBT65zA7_Ye1acrOpL5VBaUexehKoczdQHmZ gRw8nzD9dcJSY0IbKInSGsdkJLVdlj0O9LxtFT2zPW641LnreDFTm6.z6PL9lMXUQla3utgEKlu2 F_YEmSZcelANkpWeKP1VwAjXnns72aJK49NwnpPPqUNuvKlLaH9EbA6IgRn1DpwpjtQjYvx_4x5k GOGmXn9Ti7Et6K.gfmQqrWvg9tiiPGLRlptBl8fAvJv.IXpdk6KrMdWXqOx5jyXg.PUmDGF.hEdO C64vXrkJjfCEJ0cq5NB7uZmPl3wD37nzu1fKt1j5jtUkhSrczoXNvN6kgZrK0IQxdtLJOrzIPUvn pwDiIKk0eYrBN.ZStVNzbQ9kkX_9DAiK0ZvYdqz18IDLROmLRN4jEsDrotot_FBIHNU_AXypZh40 MyucGILya_ZQpQJQAV4scDfZv6dacE8Vkj.yn4cEfjYHW4a2vh.Gcc.sDiUhAQ3E5wt4tF2zSY5N d8tZJF6fjYZBH87OFvc50ypGmZfYk1SEVr2JAkSkx7DDX0PG0UEW7FtU7s8fkKsF6RB4oShyxk5_ L6XwIcQcs.MWZ_aVW0cHlXvDcIfHxdOSncwH4QI39yRWuefv34wlKxgXHHfmEG2TrNJFGj.zmtxi UFhPHZpIKq1x9O.wow_O6epO5Mn5KHAR1a5tCbkZFy3bvqwgYW6ZQ5LadAZt2fNfOmvjZZwa0UOn Xub8MVz61C1P3U8QtVQ2L7PcN3wHTgkToK5AsfbmaBUpubqT55zUaKUTBMxM_c9H6jXsIf9YpVQR vqcnv8OmfKJMg8xyTH.9MX8t3h0mGj6LhB9dVqGw5tm_s2EcoQYHZFxyjU7Oxwg4dvkI3oIWUkRY .hXcQaYVZK9s- Received: from sonic.gate.mail.ne1.yahoo.com by sonic313.consmr.mail.ne1.yahoo.com with HTTP; Wed, 12 Sep 2018 01:46:50 +0000 Date: Wed, 12 Sep 2018 00:44:14 +0000 (UTC) From: Nathan Owens To: FreeBSD Ports Message-ID: <632795939.3873980.1536713054861@mail.yahoo.com> In-Reply-To: <1756904160.3584383.1536683534378@mail.yahoo.com> References: <596850902.3408902.1536665148359.ref@mail.yahoo.com> <596850902.3408902.1536665148359@mail.yahoo.com> <1756904160.3584383.1536683534378@mail.yahoo.com> Subject: Re: Poudriere MIME-Version: 1.0 X-Mailer: WebService/1.1.12406 YMailNorrin Mozilla/5.0 (X11; FreeBSD amd64; rv:62.0) Gecko/20100101 Firefox/62.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Sep 2018 01:46:58 -0000 Removed that file from those ports and didn't seem to help On Tuesday, September 11, 2018, 11:32:14 AM CDT, Nathan Owens wrote: =20 =20 It happens only on non x86 no matter version of freebsd. =C2=A0Py-pytest a= t py36 does it for me. Koobs tested it in his arm64 at py36. =C2=A0It=E2=80= =99s not the port itself. As the file that touches during build isn=E2=80= =99t related to the port=C2=A0The freebsd11 changes to freebsd12 according = to jail version=C2=A0 usr/local/lib/python3.6/__pycache__/_sysconfigdata_m_freebsd11_.cpython-36.= pyc: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 size (17379, 17331) Sent from Yahoo Mail for iPhone On Tuesday, September 11, 2018, 6:44 AM, Lorenzo Salvadore via freebsd-port= s wrote: > Submitting this here as I believe this may be best place to ask the quest= ion as I use poudriere to test ports before sending patches > I am on 12 current. If I=E2=80=99m building a port that can use either py= 27 or py36 on an non x86based system the py27 works fine on all my jails. I= f I test with py36 poudriere errors out saying a file touched my FS during = build and it actually does install a file on my FS as I can delete the file= it refers to and retry build and it will be there again. The FS violation = happens on my mips/mips64/armv6/arm64/ poudriere jails with py36. To try so= mething I forced it to use py37 and it does the same.=C2=A0 > I=E2=80=99ve created a new arch jail with new name and it happens on fres= h jail install as well. I=E2=80=99ve disabled ccache and that didn=E2=80=99= t fix the issue either=C2=A0 This looks like a problem in some py36 port's Makefile. Can you tell us which file is installed? This might help find the right package. Moreover, does it happen only on 12 current? Can you try on 11.2-RELEASE for example? What about changing architecture? Is py36 fine on a x86 based system? I could do some testing too: can you give an explicit example of broken port? Lorenzo Salvadore. _______________________________________________ freebsd-ports@freebsd.org mailing list https://lists.freebsd.org/mailman/listinfo/freebsd-ports To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org" =20 From owner-freebsd-ports@freebsd.org Wed Sep 12 04:42:23 2018 Return-Path: Delivered-To: freebsd-ports@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B57F10A8B7E for ; Wed, 12 Sep 2018 04:42:23 +0000 (UTC) (envelope-from bjb@darco.dk) Received: from mail.blichsoft.dk (mail.blichsoft.dk [80.62.0.186]) by mx1.freebsd.org (Postfix) with ESMTP id AAD4E709CF for ; Wed, 12 Sep 2018 04:42:22 +0000 (UTC) (envelope-from bjb@darco.dk) Received: by mail.blichsoft.dk (Postfix, from userid 110) id 1C0CE620A4; Wed, 12 Sep 2018 06:42:18 +0200 (CEST) X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on per.blichsoft.dk X-Spam-Level: X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_ADSP_NXDOMAIN,HTML_MESSAGE,NO_DNS_FOR_FROM autolearn=no autolearn_force=no version=3.4.1 Received: from [192.168.1.200] (unknown [192.168.1.200]) by mail.blichsoft.dk (Postfix) with ESMTP id CB54A62099 for ; Wed, 12 Sep 2018 06:42:15 +0200 (CEST) From: Bjarne Subject: Re: Re: poudriere, FLAVOR and rebuilding for python3.6 To: freebsd-ports@freebsd.org References: <4ad9fa73-aa42-5cff-2f0c-26f27a0873e5@darco.dk> <7d98555c-14bb-ddf2-09fd-045fff1d4a45@FreeBSD.org> Message-ID: Date: Wed, 12 Sep 2018 06:42:12 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <7d98555c-14bb-ddf2-09fd-045fff1d4a45@FreeBSD.org> Content-Language: en-US X-Virus-Status: No X-Virus-Checker-Version: clamassassin 1.2.4 with clamdscan / ClamAV 0.100.1/24924/Wed Sep 12 02:52:24 2018 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit X-Content-Filtered-By: Mailman/MimeDel 2.1.27 X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 12 Sep 2018 04:42:23 -0000 Mailtrouble - hopefully this is not duplicated. Thanks for your response On 10-09-2018 08:11, Matthew Seaman wrote: > On 09/09/2018 19:34, Bjarne wrote: >> I have been using python 2.7 so far for all ports, which means all >> python packages  are built as py27-something. These python packages are >> all automaticcaly build as dependencies from other packages, for example >> like py27-dnspython which is a requirement of mailman. >> >> Now I am trying to change to python36, but can't get the py36 packages >> to build. In the transition period,  I would like to simultaneously have: >> py27-something >> py36-something >> >> >> In make.conf for the jail I set: >> DEFAULT_VERSIONS+= python=3.6 python=2.7 > This does not do what you're expecting, and will be equivalent to just > 'python=2.7' OK, I see. I saw this in an old post, hence the test. >> I would expect a new "poudriere bulk" command would build all >> py36-something for me, but no, got nothing. >> No packages where build. >> >> >> I added the follwing to  poudriere.conf: >> FLAVOR_DEFAULT_ALL=yes >> Still without any luck. >> >> I can of course specify that I want to build for example dnspython and >> then poudriere builds py36-dnspython, but that means I will have to go >> through all dependencies by hand. >> >> So what am I supposed to do. > OK, there are two ways of handling this. > > Firstly you can specify a package as: > > some/port@all > > in the list of packages you feed to poudriere. I think you can use that > on a package which is not itself flavoured, and the effect is inherited > by flavoured dependencies, but you'll need to experiment. If you do > this explicitly for python ports it will result in building both > python-2.7 and python-3.6 versions. That seems to work .  At the same time I get all php7 and php56 packages. I did not foresee that. That is the next update project. setting FLAVOR_DEFAULT_ALL=yes  in poudriere.conf has the same effect, without adding @all   to the port names. > Secondly you can build your packages with one default setting, and then > do an incremental bulk using the other default setting, which should > result in you ending up with both flavours in your repository. > Something like: > > # echo 'DEFAULT_VERSIONS+= python=3.6' > > /usr/local/etc/poudriere.d/python36-make.conf > # poudriere bulk -c -f /usr/local/etc/poudriere.d/my-ports > # poudriere bulk -z python36 -f /usr/local/etc/poudriere.d/my-ports Interesting - i was not aware of sets, thanks for pointing that out to me. However, This seems to  result in an extra repository containing ALL packages with the new options: 00:00:01] [Dry Run] Mounting system devices for freebsd_11-2-HEAD-python27 [00:00:01] [Dry Run] Mounting ports/packages/distfiles [00:00:01] [Dry Run] Stashing existing package repository [00:00:01] [Dry Run] Mounting packages from: /tank/poudriere/data/packages/freebsd_11-2-HEAD-python27 [00:00:01] [Dry Run] Copying /var/db/ports from: /usr/local/etc/poudriere.d/freebsd_11-2-HEAD-options [00:00:01] [Dry Run] Appending to make.conf: /usr/local/etc/poudriere.d/freebsd_11-2-make.conf [00:00:01] [Dry Run] Appending to make.conf: /usr/local/etc/poudriere.d/freebsd_11-2-python27-make.conf /etc/resolv.conf -> /tank/poudriere/data/.m/freebsd_11-2-HEAD-python27/ref/etc/resolv.conf [00:00:01] [Dry Run] Starting jail freebsd_11-2-HEAD-python27 [00:00:01] [Dry Run] Logs: /tank/poudriere/data/logs/bulk/freebsd_11-2-HEAD-python27/2018-09-10_17h51m05s [00:00:01] [Dry Run] WWW: xxxxxxxxxxxxxx/build.html?mastername=freebsd_11-2-HEAD-python27&build=2018-09-10_17h51m05s [00:00:01] [Dry Run] Loading MOVED for /tank/poudriere/data/.m/freebsd_11-2-HEAD-python27/ref/usr/ports [00:00:02] [Dry Run] Ports supports: FLAVORS SELECTED_OPTIONS [00:00:02] [Dry Run] Gathering ports metadata [00:00:04] [Dry Run] Calculating ports order and dependencies [00:00:05] [Dry Run] pkg package missing, skipping sanity [00:00:05] [Dry Run] Skipping incremental rebuild and repository sanity checks [00:00:05] [Dry Run] Cleaning the build queue [00:00:05] [Dry Run] Sanity checking build queue [00:00:05] [Dry Run] Processing PRIORITY_BOOST [00:00:05] [Dry Run] Balancing pool [00:00:05] [Dry Run] Dry run mode, cleaning up and exiting [00:00:05] [Dry Run] Would build 340 packages using 5 builders I was kind of hoping i could end with one repository, containing both py27 and py36, but maybe this is better for some projects. > :snip > > However, your example of trying to treat the mail/mailman port in this > way is unfortunately doomed to failure, as mailman is specifically > restricted to python-2.7 only. oh bummer - I missed that. Decision time for the future of mailman.... Ok, in my case, I think adding FLAVOR_DEFAULT_ALL=yes to poudriere.conf seems to be the way to go. That will give me acces to all versions from the same repository and i can work my way through the different servers to update python and php packages. Python and php -  what a lovely couple! Thanks a lot for your input, that actually helped me understand poudriere a little better. > Cheers, > > Matthew > -- mvh, Bjarne