Date: Fri, 12 Sep 2014 16:46:18 -0500 From: Bryan Drewery <bdrewery@FreeBSD.org> To: Michael Jung <mikej@mikej.com>, freebsd-ports@freebsd.org Subject: Re: "poudriere bulk" - why does it fail on single package with missing port origin? Message-ID: <541369AA.9080609@FreeBSD.org> In-Reply-To: <08d567943bd91144edc2e17a06214468@mail.mikej.com> References: <08d567943bd91144edc2e17a06214468@mail.mikej.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --SpDGqoVKXP5mio732jLEvepao76kwwsT5 Content-Type: text/plain; charset=windows-1252 Content-Transfer-Encoding: quoted-printable On 9/11/2014 8:51 AM, Michael Jung wrote: > Why does "poudriere bulk" need to bail because a single package has a > missing port origin and not continue to build other packages in the > package list? >=20 > If I remove x11/mate from my package list poudriere rocks on building > all my other ports. >=20 > The missing origin is a RUN_DEPENDS in the x11/mate Makefile, but that > dependency should only be for x11/mate right? >=20 > I can't seem to find a good explanation in the general man pages or > searching the web. >=20 > Educate me please ;-) A lot of the reason is just the way poudriere handles looking up dependencies. I'm willing to explore moving this fatal error such that the port is just listed as FAILED and anything depending on it is SKIPPED. There's currently no way to do that without more logic. This sort of error hits the package build system quite often. When someone breaks INDEX they also break package building because of this error. I am more and more convinced that we should not consider these immediately fatal. However, we should also consider a threshold feature such that too many failures for bulk will cause the set to not be published. 3.1 adds a feature called "atomic package repository" that builds packages outside of the normal repository dir. Once the build is done the packages are synced over. I added a way to prevent publishing the set if ANYTHING fails, but it's not using a threshold yet. I'll improve that. This will have to wait until after 3.1 though. It will be releasing once I find time to focus on getting it out. >=20 > --mikej >=20 > Example: >=20 > poudriere 3.0.17/11.0-CURRENT #1 r264318M amd64 >=20 >=20 > [root@bsd11 /usr/local/poudriere/ports/default/x11/mate]# poudriere bul= k > -j 10stable -f /usr/local/etc/charon-list > =3D=3D=3D=3D>> Creating the reference jail... done > =3D=3D=3D=3D>> Mounting system devices for 10stable-default > =3D=3D=3D=3D>> Mounting ports/packages/distfiles > =3D=3D=3D=3D>> Mounting ccache from: /var/cache/ccache > =3D=3D=3D=3D>> Mounting packages from: > /usr/local/poudriere/data/packages/10stable-default > =3D=3D=3D=3D>> Logs: > /usr/local/poudriere/data/logs/bulk/10stable-default/2014-09-10_12h18m1= 5s > =3D=3D=3D=3D>> Appending to make.conf: > /usr/local/etc/poudriere.d/10stable-make.conf > /etc/resolv.conf -> > /usr/local/poudriere/data/build/10stable-default/ref/etc/resolv.conf > =3D=3D=3D=3D>> Starting jail 10stable-default > =3D=3D=3D=3D>> Loading MOVED > =3D=3D=3D=3D>> Calculating ports order and dependencies > =3D=3D=3D=3D>> MOVED: databases/db41 renamed to databases/db48 > =3D=3D=3D=3D>> MOVED: databases/db42 renamed to databases/db48 > =3D=3D=3D=3D>> Error: Invalid port origin 'archivers/mate-file-archiver= ' not found. > =3D=3D=3D=3D>> Cleaning up > =3D=3D=3D=3D>> Umounting file systems > [root@bsd11 /usr/local/poudriere/ports/default/x11/mate]# >=20 >=20 > AFTER remove x11/mate from the list "charon-list" >=20 >=20 > [root@bsd11 /usr/local/poudriere/ports/default/x11/mate]# poudriere bul= k > -j 10stable -f /usr/local/etc/charon-list > =3D=3D=3D=3D>> Creating the reference jail... done > =3D=3D=3D=3D>> Mounting system devices for 10stable-default > =3D=3D=3D=3D>> Mounting ports/packages/distfiles > =3D=3D=3D=3D>> Mounting ccache from: /var/cache/ccache > =3D=3D=3D=3D>> Mounting packages from: > /usr/local/poudriere/data/packages/10stable-default > =3D=3D=3D=3D>> Logs: > /usr/local/poudriere/data/logs/bulk/10stable-default/2014-09-10_12h20m1= 4s > =3D=3D=3D=3D>> Appending to make.conf: > /usr/local/etc/poudriere.d/10stable-make.conf > /etc/resolv.conf -> > /usr/local/poudriere/data/build/10stable-default/ref/etc/resolv.conf > =3D=3D=3D=3D>> Starting jail 10stable-default > =3D=3D=3D=3D>> Loading MOVED > =3D=3D=3D=3D>> Calculating ports order and dependencies > =3D=3D=3D=3D>> MOVED: databases/db41 renamed to databases/db48 > =3D=3D=3D=3D>> MOVED: databases/db42 renamed to databases/db48 > =3D=3D=3D=3D>> Sanity checking the repository > =3D=3D=3D=3D>> Deleting old version: liboil-0.3.17_1.txz > =3D=3D=3D=3D>> Deleting old version: p5-DBD-Pg-3.4.0.txz > =3D=3D=3D=3D>> Deleting old version: p5-Net-SSLeay-1.65.txz > =3D=3D=3D=3D>> Deleting stale symlinks > =3D=3D=3D=3D>> Deleting empty directories > =3D=3D=3D=3D>> Cleaning the build queue > =3D=3D=3D=3D>> Building 490 packages using 8 builders > =3D=3D=3D=3D>> Starting/Cloning builders > =3D=3D=3D=3D>> Hit CTRL+t at any time to see build progress and stats > _______________________________________________ > freebsd-ports@freebsd.org mailing list > http://lists.freebsd.org/mailman/listinfo/freebsd-ports > To unsubscribe, send any mail to "freebsd-ports-unsubscribe@freebsd.org= " --=20 Regards, Bryan Drewery --SpDGqoVKXP5mio732jLEvepao76kwwsT5 Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.10 (MingW32) iQEcBAEBAgAGBQJUE2mqAAoJEDXXcbtuRpfPk1gH/2OunRDXVjSn1qDc/3SD0Z3k MC9OUAV3Xoq+7RvqCVfcRXwbsUjFZaLRKQKT13SRYGA7QGgow0BHAweJwy6fNTt4 9ZWG3ebC4VAIHRmuCoVaHg7sMyT1p3PNJlzyy+YncQi0J2bpB7W8zXY3r5Ka4pvE 8gLPBHZG2pBC+l9pCN7temwgXIwvIlIpPUQ2KZoT9CayB5yAPP4puKDxP30jXDkh eGSW/al82FSXk9SjmJF7SXu/KePshk9VIBa/0k/CcZdxhVmk5Y+qkG7aJXl6GZlW H8irG9DrJSmlUHxduAF8s5u+lq1FOUEqxX+kbXwQdnFyzMx7vYHte/j59s8zY6E= =6e9g -----END PGP SIGNATURE----- --SpDGqoVKXP5mio732jLEvepao76kwwsT5--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?541369AA.9080609>