Skip site navigation (1)Skip section navigation (2)
Date:      Mon, 7 Jul 2014 17:27:25 -0600
From:      Warner Losh <imp@bsdimp.com>
To:        Ian Lepore <ian@FreeBSD.org>
Cc:        sbruno@FreeBSD.org, freebsd-arch@FreeBSD.org
Subject:   Re: Total confusion over toolchain/xdev behavior
Message-ID:  <20B72004-1499-4F99-A7C7-13173C50C7C6@bsdimp.com>
In-Reply-To: <1404766292.65432.43.camel@revolution.hippie.lan>
References:  <1404688077.1059.115.camel@bruno> <1404766292.65432.43.camel@revolution.hippie.lan>

index | next in thread | previous in thread | raw e-mail

[-- Attachment #1 --]

On Jul 7, 2014, at 2:51 PM, Ian Lepore <ian@FreeBSD.org> wrote:

> On Sun, 2014-07-06 at 16:07 -0700, Sean Bruno wrote:
>> Objective:  install an xcompile toolchain into a jail for use by
>> poudriere during arm/mips/sparc/power ports pkgs builds.  The build
>> should be possible from a non-root user.
>> 
>> As far as I can tell, the xdev target is completely busted for non-clang
>> arch's right now as it tries to build clang no matter what I do.  Its
>> missing some pretty key documentation to making it work correctly, so a
>> lot of my attempts have been "guess and check" with verbose make.
>> 
>> -----------------------------------------------------------------------
>> Attempt #1:
>> I have been trying non-root xdev builds:
>> MAKEOBJDIRPREFIX=/var/tmp make -s -j8 xdev XDEV=mips XDEV_ARCH=mips
>> -- dies because it tries to compile CLANG.
>> -----------------------------------------------------------------------
>> 
>> Attempt #2:
>> Apply a hack from Baptiste that isn't quite right, but at least gets
>> farther, note the missing variable causing "//usr/mips-freebsd"
>> http://people.freebsd.org/~sbruno/src.ops.mk.diff
>> 
>> ===> gnu/usr.bin/cc/gcov (all)
>> mtree populating //usr/mips-freebsd
>> mkdir: //usr/mips-freebsd: Permission denied
>> *** Error code 1
>> -----------------------------------------------------------------------
>> 
>> Attempt #3: Add XDTP
>> MAKEOBJDIRPREFIX=/var/tmp make -s xdev XDEV=mips XDEV_ARCH=mips
>> XDTP=/var/tmp/mips_cc
>> 
>> Try defining a XDTP=/var/tmp/mips_cc with the above patch applied, get's
>> a bit farther but compile failure in locating critical include files.
>> 
>> ===> gnu/lib/libstdc++ (obj,depend,all,install)
>> In file included from /home/sbruno/bsd/fbsd_head/gnu/lib/libstdc
>> ++/../../../contrib/libstdc++/src/bitmap_allocator.cc:30:
>> /home/sbruno/bsd/fbsd_head/gnu/lib/libstdc++/../../../contrib/libstdc
>> ++/include/ext/bitmap_allocator.h:37:54: error: cstddef: No such file or
>> directory
>> -----------------------------------------------------------------------
>> 
>> Attempt #4: Add the additional XDDESTDIR
>> MAKEOBJDIRPREFIX=/var/tmp make -s xdev XDEV=mips XDEV_ARCH=mips
>> XDTP=/var/tmp/mips_cc XDESTDIR=/var/tmp/mips_dst
>> -- Same results as attempt #3
>> -----------------------------------------------------------------------
>> 
>> Even attempting to do stuff for *clang* enabled architectures bails
>> because its not respecting prefixes:
>> MAKEOBJDIRPREFIX=/var/tmp make -s -j 8 xdev XDEV=arm XDEV_ARCH=armv6
>> -- bails because it tries to:
>> ===> usr.bin/clang/tblgen (all)
>> mtree populating //usr/armv6-freebsd
>> mtree: etc/ntp: Permission denied
>> _xi-cross-tools
>> ===> xdev gnu/usr.bin/binutils (install)
>> ===> gnu/usr.bin/binutils/libiberty (install)
>> ===> gnu/usr.bin/binutils/libbfd (install)
>> ===> gnu/usr.bin/binutils/libopcodes (install)
>> ===> gnu/usr.bin/binutils/libbinutils (install)
>> ===> gnu/usr.bin/binutils/addr2line (install)
>> ===> gnu/usr.bin/binutils/as (install)
>> ===> gnu/usr.bin/binutils/ld (install)
>> install: //usr/armv6-freebsd/usr/bin/ld: Permission denied
>> *** Error code 71
>> 
>> -----------------------------------------------------------------------
>> Adding XDTP and XDDESTDIR results in a little more progress but obvious
>> failures to attempt and install things directly into my host system:
>> 
>> MAKEOBJDIRPREFIX=/var/tmp make -s xdev XDEV=arm XDEV_ARCH=armv6
>> XDDESTDIR=/var/tmp/arm_cc XDTP=/var/tmp/armv6_cc
>> ===> secure/lib/libssh (install)
>> ===> usr.bin/lex/lib (obj,depend,all,install)
>> mkdir: ../../../../usr: Permission denied
>> *** Error code 1
>> 
>> Stop.
>> make[1]: stopped in /home/sbruno/bsd/fbsd_head
>> *** Error code 1
>> 
>> Stop.
>> make: stopped in /home/sbruno/bsd/fbsd_head
> 
> It looks to me like the permission part of the problem is being caused
> by a lack of DESTDIR=.  Without that, it's trying to install to /usr and
> you don't have permission for that.  Maybe the confusion is because the
> xdev target inherently builds-and-installs, unlike most other targets
> that separate those two actions.

OK. After some detective work, it looks like libstdc++ needs to be done before libsupc++ is done. I’ve added this dependency in r268377 and was able to do a full xdev build with a clean obj dir:

	rm -rf $HOME/F $MAKEOBJDIRPREFIX/mips-freebsd
	mkdir $HOME/F
	make xdev DESTDIR=$HOME/F XDEV=mips XDEV_ARCH=mips WITHOUT_CLANG=t WITHOUT_CLANG_BOOTSTRAP=t WITH_GCC=t WITH_GCC_BOOTSTRAP=t WITH_GNUCXX=t -j 20

Sean, can you see if this works for you now? And sorry about the cumbersome options. Those are in line to get fixed, but I wanna fix the build-in-tree issues first (which, alas, are harder than you’d think). I suspect that bapt’s src.opts.mk diffs are likely good candidates to be used committed too, but the above works w/o it. Also, I just built the binaries, I didn’t see if they worked.

Warner

[-- Attachment #2 --]
-----BEGIN PGP SIGNATURE-----
Comment: GPGTools - https://gpgtools.org

iQIcBAEBCgAGBQJTuyzdAAoJEGwc0Sh9sBEArLsP/id8fth4V1UeN+54B2oIDDVf
bttt5/22zrONP2Jk5NZXPxQvyVIFnNs8d24u0hdhApqjl++hjF5oXfao7hv4qysh
Pcwik+x9lmoORQE8rGRpZAJu3VxdDH2mEsokJVLq0H6cV0LT46K1mgqQloe91ok4
6JrjJKNMuuv9X+2nY8fqglRFAVOV8Jf82i0gqRBrU0blzH07prJZKpIvrjsKpSgy
x+UYzFfP2vlq4NcQlXZeYIKmVW4JHmKQA8hkTobO1KJMrvaY+/XK1s+dn4nCOIjP
VIXK01/cQmSII/sBDtobDwa4LHttMY9JHLxGbmF5pnbisRurwErYXJycMbfU89Gn
AfVYmmCH0po34lxFotMF6MLcMgJfnUfn9FABUr9jGk01Xu8q2f/OiHJ64LaZlE3Y
Rmcb5twJr3u9hhrC1fb4ILDL4vMP5C6f2l+Su7Rx6SFhVYmdRqbsx4rN6A6On2+U
hVW4aHpTHQItjUvi5t8p2ya30A6D89qBVpgjpsIzZyrsQOxjZxv7HpxZSUvxOlpr
EXSkNKDOT7/RV2C/c4NHjdvdQuu8xwCx0eewM0izdThSp1wgDSC15+43mR+BWPaG
tehBPq3gtFJClP1Z7XuvqnFVXTZOpULtd4ST8I3ZycB1EHW7N6sVc8Uv2Klwt88A
KORvWsnAR1Yt1IC1XIsu
=LExT
-----END PGP SIGNATURE-----
help

Want to link to this message? Use this
URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?20B72004-1499-4F99-A7C7-13173C50C7C6>