Skip site navigation (1)Skip section navigation (2)
Date:      Sat, 14 Nov 2015 12:02:50 -0800
From:      Bryan Drewery <bdrewery@FreeBSD.org>
To:        Cy Schubert <Cy.Schubert@komquats.com>
Cc:        freebsd-ports@freebsd.org
Subject:   Re: Poudriere Timeout
Message-ID:  <5647936A.7060506@FreeBSD.org>
In-Reply-To: <201501230234.t0N2YZbf033345@slippy.cwsent.com>
References:  <201501230234.t0N2YZbf033345@slippy.cwsent.com>

next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
--dxlsE4Jq31xwkgR9vA3E5pEQ3PgpFGch6
Content-Type: text/plain; charset=windows-1252
Content-Transfer-Encoding: quoted-printable

On 1/22/2015 6:34 PM, Cy Schubert wrote:
> In message <54C18193.1000701@FreeBSD.org>, Bryan Drewery writes:
>> This is an OpenPGP/MIME signed message (RFC 4880 and 3156)
>> --NvIRPgp2pVcRmjhwtM9TwAvH1900GK90a
>> Content-Type: text/plain; charset=3Dwindows-1252
>> Content-Transfer-Encoding: quoted-printable
>>
>> On 1/18/2015 7:45 PM, Cy Schubert wrote:
>>> Hi,
>>> =3D20
>>> =3D20
>>> Has anyone seen this before?=3D20
>>> =3D20
>>> print/texlive-texmf texlive-texmf-20140525_4 package/timeout runaway_=
pr=3D
>> ocess
>>> =3D20
>>> =3D20
>>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/=
lo=3D
>> cal/s
>>> hare
>>> /texmf-dist/doc/.keep_me
>>> /bin/mkdir -p /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/l=
oc=3D
>> al/sh
>>> are/
>>> texmf-dist/source
>>> /usr/bin/touch /wrkdirs/usr/ports/print/texlive-texmf/work/stage/usr/=
lo=3D
>> cal/s
>>> hare
>>> /texmf-dist/source/.keep_me
>>> =3D3D=3D3D=3D3D=3D3D> Compressing man pages (compress-man)
>>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3=
D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D
>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=
=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D
>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=
=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D
>> =3D3D
>>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3=
D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D<p=3D
>> hase: package        >=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D=
3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D
>> =3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D=3D3D
>>> =3D3D=3D3D=3D3D>  Building package for texlive-texmf-20140525_4
>>> =3D3D=3D3D=3D3D=3D3D>> Killing timed out build after 3600 seconds
>>> =3D3D=3D3D=3D3D=3D3D>> Cleaning up wrkdir
>>> =3D3D=3D3D=3D3D>  Cleaning for texlive-texmf-20140525_4
>>> build of print/texlive-texmf ended at Fri Jan 16 23:49:09 PST 2015
>>> build time: 02:41:43
>>> !!! build failure encountered !!!
>>> =3D20
>>> Building the port by hand, make package, took just over 19 minutes (1=
15=3D
>> 0=3D20
>>> seconds). Would increasing the timeout from 3600 to something larger =
(l=3D
>> ike=3D20
>>> 7200 -- I know this will require hacking the code) address the issue?=

>>> =3D20
>>> =3D20
>>
>> I'm curious why building outside of poudriere took 19 minutes, but
>> inside took over 60 minutes. Did you have MFS or TMPFS enabled at the
>> time of 60+ minutes?
>=20
> No. I don't have enough memory to support mfs or tmpfs except for /tmp.=
=20
> Having said that, my poudriere jails don't have tmpfs /tmp while all my=
=20
> servers (and laptop) do.
>=20
>>
>> Is pkg the same version in the jail as your host? It may be a recent p=
kg
>> create regression.
>=20
> All the software is the same. The difference is that the failed build w=
as=20
> on an AMD 64 X2 4600+ (dual core with 5.5 GB) whereas the successful bu=
ild=20
> was on an Intel Core I3 dual core with four threads with 6 GB. All=20
> filesystems are ZFS.
>=20
> My guess is that the speed of the processors may have had something to =
do=20
> with it. I don't think the extra 500 MB ram mattered much. All my build=
=20
> systems are amd64 architecture.
>=20
>=20

My guess is that MAKE_JOBS was disabled for the build inside of
Poudriere. By default (for bulk) it will parallelizing building multiple
packages at once, and each port build gets only -j1. This is something I
would like to improve with dynamic cpusets and/or racct type things. I
just haven't gotten there yet.

testport defaults to using MAKE_JOBS though.

--=20
Regards,
Bryan Drewery


--dxlsE4Jq31xwkgR9vA3E5pEQ3PgpFGch6
Content-Type: application/pgp-signature; name="signature.asc"
Content-Description: OpenPGP digital signature
Content-Disposition: attachment; filename="signature.asc"

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2

iQEcBAEBAgAGBQJWR5NqAAoJEDXXcbtuRpfPZRAIAMOUTdIgAbr11K0jobF/xOS/
tv1FLzXQV1pb66n8FXNVfQ3Tsog0uQz4Dr1VyN0n7MnqyJ9LoYlhiiS9YAxHVHnC
1E/iDFEh1d5ub51Q6VdL4eyODEDFTAnT9at3SIr9Es/sgJolmZKpNgc8GqyR/Blf
3SHlHcxNAGw9/AMB76Lr/UTziK31iRMY5xquEQvj7xi83eiRaRcFPOQgtnq0NCjf
oVRbmyub356lEIxr+mim6OI9181wUUdkXGQIYrFGqpuL2Rhj3GGlvSctl8HB+zWQ
ubUeaa8F84bTpzjqtp8E8y/sRvgagGDiMPWbp/vvHQGP5uN7QaqpTT2H694xCH0=
=ySoK
-----END PGP SIGNATURE-----

--dxlsE4Jq31xwkgR9vA3E5pEQ3PgpFGch6--



Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?5647936A.7060506>