Date: Wed, 12 Sep 2018 00:44:14 +0000 (UTC) From: Nathan Owens <ndowens@yahoo.com> To: FreeBSD Ports <freebsd-ports@freebsd.org> Subject: Re: Poudriere Message-ID: <632795939.3873980.1536713054861@mail.yahoo.com> In-Reply-To: <1756904160.3584383.1536683534378@mail.yahoo.com> References: <596850902.3408902.1536665148359.ref@mail.yahoo.com> <596850902.3408902.1536665148359@mail.yahoo.com> <R4I-qjOsvzEti1oPulneh7jmMd8-R_uTIr2MR_fwIgJ-IDxiOi-TyIrItrOMIyKMGl415B-nGe0Hor1yMyZGaFv9gNBVQ3W6AALFgygvNf0=@protonmail.ch> <1756904160.3584383.1536683534378@mail.yahoo.com>
next in thread | previous in thread | raw e-mail | index | archive | help
Removed that file from those ports and didn't seem to help
On Tuesday, September 11, 2018, 11:32:14 AM CDT, Nathan Owens <ndowens@=
yahoo.com> wrote: =20
=20
It happens only on non x86 no matter version of freebsd. =C2=A0Py-pytest a=
t py36 does it for me. Koobs tested it in his arm64 at py36. =C2=A0It=E2=80=
=99s not the port itself. As the file that touches during build isn=E2=80=
=99t related to the port=C2=A0The freebsd11 changes to freebsd12 according =
to jail version=C2=A0
usr/local/lib/python3.6/__pycache__/_sysconfigdata_m_freebsd11_.cpython-36.=
pyc: =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =
=C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 size (17379, 17331)
Sent from Yahoo Mail for iPhone
On Tuesday, September 11, 2018, 6:44 AM, Lorenzo Salvadore via freebsd-port=
s <freebsd-ports@freebsd.org> wrote:
> Submitting this here as I believe this may be best place to ask the quest=
ion as I use poudriere to test ports before sending patches
> I am on 12 current. If I=E2=80=99m building a port that can use either py=
27 or py36 on an non x86based system the py27 works fine on all my jails. I=
f I test with py36 poudriere errors out saying a file touched my FS during =
build and it actually does install a file on my FS as I can delete the file=
it refers to and retry build and it will be there again. The FS violation =
happens on my mips/mips64/armv6/arm64/ poudriere jails with py36. To try so=
mething I forced it to use py37 and it does the same.=C2=A0
> I=E2=80=99ve created a new arch jail with new name and it happens on fres=
h jail install as well. I=E2=80=99ve disabled ccache and that didn=E2=80=99=
t fix the issue either=C2=A0
This looks like a problem in some py36 port's Makefile. Can you tell us
which file is installed? This might help find the right package.
Moreover, does it happen only on 12 current? Can you try
on 11.2-RELEASE for example? What about changing
architecture? Is py36 fine on a x86 based system?
I could do some testing too: can you give an explicit example
of broken port?
Lorenzo Salvadore.
_______________________________________________
freebsd-ports@freebsd.org mailing list
https://lists.freebsd.org/mailman/listinfo/freebsd-ports
To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org"
=20
From owner-freebsd-ports@freebsd.org Wed Sep 12 04:42:23 2018
Return-Path: <owner-freebsd-ports@freebsd.org>
Delivered-To: freebsd-ports@mailman.ysv.freebsd.org
Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1])
by mailman.ysv.freebsd.org (Postfix) with ESMTP id 5B57F10A8B7E
for <freebsd-ports@mailman.ysv.freebsd.org>;
Wed, 12 Sep 2018 04:42:23 +0000 (UTC) (envelope-from bjb@darco.dk)
Received: from mail.blichsoft.dk (mail.blichsoft.dk [80.62.0.186])
by mx1.freebsd.org (Postfix) with ESMTP id AAD4E709CF
for <freebsd-ports@freebsd.org>; Wed, 12 Sep 2018 04:42:22 +0000 (UTC)
(envelope-from bjb@darco.dk)
Received: by mail.blichsoft.dk (Postfix, from userid 110)
id 1C0CE620A4; Wed, 12 Sep 2018 06:42:18 +0200 (CEST)
X-Spam-Checker-Version: SpamAssassin 3.4.1 (2015-04-28) on per.blichsoft.dk
X-Spam-Level:
X-Spam-Status: No, score=-2.0 required=5.0 tests=ALL_TRUSTED,AWL,BAYES_00,
DKIM_ADSP_NXDOMAIN,HTML_MESSAGE,NO_DNS_FOR_FROM autolearn=no
autolearn_force=no version=3.4.1
Received: from [192.168.1.200] (unknown [192.168.1.200])
by mail.blichsoft.dk (Postfix) with ESMTP id CB54A62099
for <freebsd-ports@freebsd.org>; Wed, 12 Sep 2018 06:42:15 +0200 (CEST)
From: Bjarne <bjb@darco.dk>
Subject: Re: Re: poudriere, FLAVOR and rebuilding for python3.6
To: freebsd-ports@freebsd.org
References: <4ad9fa73-aa42-5cff-2f0c-26f27a0873e5@darco.dk>
<7d98555c-14bb-ddf2-09fd-045fff1d4a45@FreeBSD.org>
Message-ID: <a36127c8-65da-8ee3-60eb-63bb585acba8@darco.dk>
Date: Wed, 12 Sep 2018 06:42:12 +0200
User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101
Thunderbird/52.8.0
MIME-Version: 1.0
In-Reply-To: <7d98555c-14bb-ddf2-09fd-045fff1d4a45@FreeBSD.org>
Content-Language: en-US
X-Virus-Status: No
X-Virus-Checker-Version: clamassassin 1.2.4 with clamdscan / ClamAV
0.100.1/24924/Wed Sep 12 02:52:24 2018
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit
X-Content-Filtered-By: Mailman/MimeDel 2.1.27
X-BeenThere: freebsd-ports@freebsd.org
X-Mailman-Version: 2.1.27
Precedence: list
List-Id: Porting software to FreeBSD <freebsd-ports.freebsd.org>
List-Unsubscribe: <https://lists.freebsd.org/mailman/options/freebsd-ports>,
<mailto:freebsd-ports-request@freebsd.org?subject=unsubscribe>
List-Archive: <http://lists.freebsd.org/pipermail/freebsd-ports/>;
List-Post: <mailto:freebsd-ports@freebsd.org>
List-Help: <mailto:freebsd-ports-request@freebsd.org?subject=help>
List-Subscribe: <https://lists.freebsd.org/mailman/listinfo/freebsd-ports>,
<mailto:freebsd-ports-request@freebsd.org?subject=subscribe>
X-List-Received-Date: Wed, 12 Sep 2018 04:42:23 -0000
Mailtrouble - hopefully this is not duplicated.
Thanks for your response
On 10-09-2018 08:11, Matthew Seaman wrote:
> On 09/09/2018 19:34, Bjarne wrote:
>> I have been using python 2.7 so far for all ports, which means all
>> python packages are built as py27-something. These python packages are
>> all automaticcaly build as dependencies from other packages, for example
>> like py27-dnspython which is a requirement of mailman.
>>
>> Now I am trying to change to python36, but can't get the py36 packages
>> to build. In the transition period, I would like to simultaneously have:
>> py27-something
>> py36-something
>>
>>
>> In make.conf for the jail I set:
>> DEFAULT_VERSIONS+= python=3.6 python=2.7
> This does not do what you're expecting, and will be equivalent to just
> 'python=2.7'
OK, I see. I saw this in an old post, hence the test.
>> I would expect a new "poudriere bulk" command would build all
>> py36-something for me, but no, got nothing.
>> No packages where build.
>>
>>
>> I added the follwing to poudriere.conf:
>> FLAVOR_DEFAULT_ALL=yes
>> Still without any luck.
>>
>> I can of course specify that I want to build for example dnspython and
>> then poudriere builds py36-dnspython, but that means I will have to go
>> through all dependencies by hand.
>>
>> So what am I supposed to do.
> OK, there are two ways of handling this.
>
> Firstly you can specify a package as:
>
> some/port@all
>
> in the list of packages you feed to poudriere. I think you can use that
> on a package which is not itself flavoured, and the effect is inherited
> by flavoured dependencies, but you'll need to experiment. If you do
> this explicitly for python ports it will result in building both
> python-2.7 and python-3.6 versions.
That seems to work . At the same time I get all php7 and php56 packages. I did not foresee that.
That is the next update project.
setting FLAVOR_DEFAULT_ALL=yes in poudriere.conf has the same effect, without adding @all to the
port names.
> Secondly you can build your packages with one default setting, and then
> do an incremental bulk using the other default setting, which should
> result in you ending up with both flavours in your repository.
> Something like:
>
> # echo 'DEFAULT_VERSIONS+= python=3.6' >
> /usr/local/etc/poudriere.d/python36-make.conf
> # poudriere bulk -c -f /usr/local/etc/poudriere.d/my-ports
> # poudriere bulk -z python36 -f /usr/local/etc/poudriere.d/my-ports
Interesting - i was not aware of sets, thanks for pointing that out to me.
However, This seems to result in an extra repository containing ALL packages with the new options:
00:00:01] [Dry Run] Mounting system devices for freebsd_11-2-HEAD-python27
[00:00:01] [Dry Run] Mounting ports/packages/distfiles
[00:00:01] [Dry Run] Stashing existing package repository
[00:00:01] [Dry Run] Mounting packages from:
/tank/poudriere/data/packages/freebsd_11-2-HEAD-python27
[00:00:01] [Dry Run] Copying /var/db/ports from:
/usr/local/etc/poudriere.d/freebsd_11-2-HEAD-options
[00:00:01] [Dry Run] Appending to make.conf: /usr/local/etc/poudriere.d/freebsd_11-2-make.conf
[00:00:01] [Dry Run] Appending to make.conf:
/usr/local/etc/poudriere.d/freebsd_11-2-python27-make.conf
/etc/resolv.conf -> /tank/poudriere/data/.m/freebsd_11-2-HEAD-python27/ref/etc/resolv.conf
[00:00:01] [Dry Run] Starting jail freebsd_11-2-HEAD-python27
[00:00:01] [Dry Run] Logs:
/tank/poudriere/data/logs/bulk/freebsd_11-2-HEAD-python27/2018-09-10_17h51m05s
[00:00:01] [Dry Run] WWW:
xxxxxxxxxxxxxx/build.html?mastername=freebsd_11-2-HEAD-python27&build=2018-09-10_17h51m05s
[00:00:01] [Dry Run] Loading MOVED for
/tank/poudriere/data/.m/freebsd_11-2-HEAD-python27/ref/usr/ports
[00:00:02] [Dry Run] Ports supports: FLAVORS SELECTED_OPTIONS
[00:00:02] [Dry Run] Gathering ports metadata
[00:00:04] [Dry Run] Calculating ports order and dependencies
[00:00:05] [Dry Run] pkg package missing, skipping sanity
[00:00:05] [Dry Run] Skipping incremental rebuild and repository sanity checks
[00:00:05] [Dry Run] Cleaning the build queue
[00:00:05] [Dry Run] Sanity checking build queue
[00:00:05] [Dry Run] Processing PRIORITY_BOOST
[00:00:05] [Dry Run] Balancing pool
[00:00:05] [Dry Run] Dry run mode, cleaning up and exiting
[00:00:05] [Dry Run] Would build 340 packages using 5 builders
I was kind of hoping i could end with one repository, containing both py27 and py36, but maybe this
is better for some projects.
> :snip
>
> However, your example of trying to treat the mail/mailman port in this
> way is unfortunately doomed to failure, as mailman is specifically
> restricted to python-2.7 only.
oh bummer - I missed that. Decision time for the future of mailman....
Ok, in my case, I think adding FLAVOR_DEFAULT_ALL=yes to poudriere.conf seems to be the way to go.
That will give me acces to all versions from the same repository and i can work my way through the
different servers to update python and php packages.
Python and php - what a lovely couple!
Thanks a lot for your input, that actually helped me understand poudriere a little better.
> Cheers,
>
> Matthew
>
--
mvh,
Bjarne
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?632795939.3873980.1536713054861>