From owner-freebsd-ports@FreeBSD.ORG Wed Apr 3 11:26:50 2013 Return-Path: Delivered-To: freebsd-ports@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by hub.freebsd.org (Postfix) with ESMTP id 47C97B9; Wed, 3 Apr 2013 11:26:50 +0000 (UTC) (envelope-from stb@lassitu.de) Received: from gilb.zs64.net (gilb.zs64.net [IPv6:2a00:14b0:4200:32e0::1ea]) by mx1.freebsd.org (Postfix) with ESMTP id B7C117A0; Wed, 3 Apr 2013 11:26:49 +0000 (UTC) Received: by gilb.zs64.net (Postfix, from stb@lassitu.de) id B4D5616018D; Wed, 3 Apr 2013 11:26:48 +0000 (UTC) Subject: Re: poudriere builds all dependencies, even if packages have already been built Mime-Version: 1.0 (Apple Message framework v1283) Content-Type: text/plain; charset=iso-8859-1 From: Stefan Bethke In-Reply-To: <515C0A2D.3070504@FreeBSD.org> Date: Wed, 3 Apr 2013 13:26:47 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <7347248E-693F-443D-8219-9CD26867F0BF@lassitu.de> References: <515C0A2D.3070504@FreeBSD.org> To: Bryan Drewery X-Mailer: Apple Mail (2.1283) Cc: freebsd-ports@freebsd.org X-BeenThere: freebsd-ports@freebsd.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: Porting software to FreeBSD List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 03 Apr 2013 11:26:50 -0000 Am 03.04.2013 um 12:53 schrieb Bryan Drewery: > On 4/3/2013 4:17 AM, Stefan Bethke wrote: >> Firstly, is there a better mailing list to discuss poudriere? >>=20 >> I'm just getting my feet wet with poudriere, and are a bit surprised = that all dependencies for a port are built, instead of installing the = packages that got built earlier already. Is this intentional? Is there = a configuration option to have the requisite packages installed before = building a port? >>=20 >>=20 >> Thanks, >> Stefan >>=20 >=20 > Here or pkg@ is fine. >=20 > This is exactly what it does. It builds the dependencies one time then > installs then builds the port needing them. On the next run if the > dependencies have not updated it reuses them. That's what I would expect, but that's not what I'm seeing. I've been running build incrementally, fixing a problem, then running = bulk again. As expected, only the packages that hadn't been built = successfully yet were built. However, dependencies for these ports are = not installed from the already created packages, but are recompiled = again. In this build log, you can see that pkg is installed from the = port instead of from the package; I seem to get this for a large number = of builds. I wouldn't really mind except for the enormous amount of = time it takes to rebuild the same ports over and over again. I've had some trouble with poudriere not mounting things where they = belong. I manually created /usr/ports and /wrkdirs and recreated the = "clean" snapshot. This worked around the "mount: no such file or = directory" problems, but I guess there might be an underlying cause to = these and a couple more issues. How would I go about identifying these? = I think I followed the installation instructions very carefully. $ head -100 ImageMagick-6.8.0.7_1.log=20 build started at Wed Apr 3 07:31:08 UTC 2013 port directory: /usr/ports/graphics/ImageMagick building for: 9.1-STABLE amd64 maintained by: c.petrik.sosa@gmail.com Makefile ident: $FreeBSD: head/graphics/ImageMagick/Makefile 315309 = 2013-03-26 15:55:59Z bapt $ Poudriere version: 2.4.1 ---Begin Environment--- BLOCKSIZE=3DK MAIL=3D/var/mail/root STATUS=3D1 PKG_EXT=3Dtxz FORCE_PACKAGE=3Dyes tpid=3D97139 = PATH=3D/sbin:/bin:/usr/sbin:/usr/bin:/usr/games:/usr/local/sbin:/usr/local= /bin:/root/bin POUDRIERE_BUILD_TYPE=3Dbulk NBPARALLEL=3D4 PKGNG=3D1 PKG_DELETE=3D/usr/local/sbin/pkg delete -y -f PKG_ADD=3D/usr/local/sbin/pkg add PWD=3D/root/eisenboot LOGS=3D/var/poudriere/data/logs HOME=3D/root USER=3Droot SKIPSANITY=3D0 LOCALBASE=3D/usr/local PACKAGE_BUILDING=3Dyes VERSION=3D2.4.1 ---End Environment--- ---Begin make.conf--- #### /root/eisenboot/poudriere.d/make.conf #### WITH_PKGNG=3Dyes # Das sollte eigentlich poudriere selber machen WRKDIRPREFIX?=3D /wrkdirs WRKDIR?=3D ${WRKDIRPREFIX}${.CURDIR:S/${PORTSDIR}//} MASTER_SITE_BACKUP?=3D \ = http://mirror.hanse.de/pub/FreeBSD/ports/distfiles/${DIST_SUBDIR}/ MASTER_SITE_OVERRIDE?=3D ${MASTER_SITE_BACKUP} # Port-Konfiguration openvpn_UNSET=3D EASYRSA PACKAGE_BUILDING=3Dyes DISABLE_MAKE_JOBS=3Dyes ---End make.conf--- ---Begin OPTIONS List--- =3D=3D=3D> The following configuration options are available for = ImageMagick-6.8.0.7_1: 16BIT_PIXEL=3Don: 16bit pixel support BZIP2=3Don: bzip2 compression support DJVU=3Doff: DJVU format support (needs THREADS) DOCS=3Don: Build and/or install documentation FFTW=3Don: Discrete Fourier Transform support FONTCONFIG=3Don: X11 font configuration support FPX=3Don: FlashPix image format support FREETYPE=3Don: TrueType font rendering support GRAPHVIZ=3Doff: Graphviz support GSLIB=3Doff: libgs (Postscript SHLIB) support HDRI=3Doff: High dynamic range images support JASPER=3Don: JPEG 2000 support via JasPer JBIG=3Don: JBIG image format support JPEG=3Don: JPEG image format support LCMS2=3Don: LCMS2 support LQR=3Don: Liquid Rescale support LZMA=3Don: LZMA compression support MODULES=3Don: Modules support OPENEXR=3Doff: HDR image format support via OpenEXR OPENMP=3Doff: Parallel processing support via OpenMP PANGO=3Doff: Pango rendering library support PDF=3Don: PDF document support PERL=3Don: Perl scripting language support PNG=3Don: PNG image format support SVG=3Don: SVG vector image format support TESTS=3Doff: Run bundled self-tests after build THREADS=3Doff: Threading support TIFF=3Don: TIFF image format support WEBP=3Don: WebP image format support WMF=3Don: Windows Metafile support =3D=3D=3D> Use 'make config' to modify these settings ---End OPTIONS List--- =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D =3D=3D=3D> ImageMagick-6.8.0.7_1 depends on file: /usr/local/sbin/pkg = - not found =3D=3D=3D> Verifying install for /usr/local/sbin/pkg in = /usr/ports/ports-mgmt/pkg =3D=3D=3D> License BSD accepted by the user =3D=3D=3D> Fetching all distfiles required by pkg-1.0.11 for building =3D=3D=3D> Extracting for pkg-1.0.11 =3D=3D=3D> License BSD accepted by the user =3D=3D=3D> Fetching all distfiles required by pkg-1.0.11 for building =3D> SHA256 Checksum OK for pkg-1.0.11.tar.xz. =3D=3D=3D> Patching for pkg-1.0.11 =3D=3D=3D> Configuring for pkg-1.0.11 =3D=3D=3D> Building for pkg-1.0.11 sed -e 's,%%PKGVERSION%%,1.0.11,' Doxyfile.in > Doxyfile =3D=3D=3D> external (all) =3D=3D=3D> external/sqlite (all) Warning: Object directory not changed from original = /wrkdirs/ports-mgmt/pkg/pkg-1.0.11/external/sqlite cc -O2 -pipe -fno-strict-aliasing -fPIC -DHAVE_READLINE=3D1 = -I/usr/include/edit -DSQLITE_OMIT_AUTOVACUUM -DSQLITE_OMIT_BLOB_LITERAL = -DSQLITE_OMIT_DECLTYPE -DSQLITE_OMIT_EXPLAIN -DSQLITE_OMIT_DEPRECATED = -DSQLITE_OMIT_LOAD_EXTENSION -DSQLITE_OMIT_PROGRESS_CALLBACK = -DSQLITE_OMIT_TCL_VARIABLE -DSQLITE_OMIT_UTF16 -DSQLITE_OMIT_CAT = -DSQLITE_OMIT_CHECK -DSQLITE_OMIT_AUTOINIT = -DSQLITE_OMIT_COMPILEOPTION_DIAGS -DSQLITE_OMIT_INTEGRITY_CHECK = -DSQLITE_OMIT_BUILTIN_TEST -DSQLITE_OMIT_SHARED_CACHE -DUSE_PREAD = -DSQLITE_THREADSAFE=3D1 -DSQLITE_TEMP_STORE=3D3 -Dmain=3Dsqlite3_shell = -DNDEBUG -std=3Dgnu99 -fstack-protector -Wsystem-headers -Werror = -Wno-pointer-sign -Wformat=3D2 -Wno-format-extra-args -Werror -c = sqlite3.c -o sqlite3.o cc -O2 -pipe -fno-strict-aliasing -fPIC -DHAVE_READLINE=3D1 = -I/usr/include/edit -DSQLITE_OMIT_AUTOVACUUM -DSQLITE_OMIT_BLOB_LITERAL = -DSQLITE_OMIT_DECLTYPE -DSQLITE_OMIT_EXPLAIN -DSQLITE_OMIT_DEPRECATED = -DSQLITE_OMIT_LOAD_EXTENSION -DSQLITE_OMIT_PROGRESS_CALLBACK = -DSQLITE_OMIT_TCL_VARIABLE -DSQLITE_OMIT_UTF16 -DSQLITE_OMIT_CAT = -DSQLITE_OMIT_CHECK -DSQLITE_OMIT_AUTOINIT = -DSQLITE_OMIT_COMPILEOPTION_DIAGS -DSQLITE_OMIT_INTEGRITY_CHECK = -DSQLITE_OMIT_BUILTIN_TEST -DSQLITE_OMIT_SHARED_CACHE -DUSE_PREAD = -DSQLITE_THREADSAFE=3D1 -DSQLITE_TEMP_STORE=3D3 -Dmain=3Dsqlite3_shell = -DNDEBUG -std=3Dgnu99 -fstack-protector -Wsystem-headers -Werror = -Wno-pointer-sign -Wformat=3D2 -Wno-format-extra-args -Werror -c shell.c = -o shell.o building static sqlite3 library ranlib libsqlite3.a =3D=3D=3D> external/libyaml (all) --=20 Stefan Bethke Fon +49 151 14070811