From owner-freebsd-toolchain@freebsd.org Mon Dec 4 04:56:41 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id C35CFDEDBE1 for ; Mon, 4 Dec 2017 04:56:41 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-127.reflexion.net [208.70.210.127]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 73DFD7878C for ; Mon, 4 Dec 2017 04:56:41 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 20367 invoked from network); 4 Dec 2017 04:29:54 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 4 Dec 2017 04:29:54 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Sun, 03 Dec 2017 23:29:54 -0500 (EST) Received: (qmail 9133 invoked from network); 4 Dec 2017 04:29:54 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 4 Dec 2017 04:29:54 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id 508C6EC8B66; Sun, 3 Dec 2017 20:29:53 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH Message-Id: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> Date: Sun, 3 Dec 2017 20:29:52 -0800 To: Bryan Drewery , FreeBSD Toolchain , FreeBSD Ports X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Dec 2017 04:56:41 -0000 Note: /usr/ports/ (and so poudriere-devel) as of -r425204=20 (poudriere-devel-3.2.99.20171129). I expect that the below is from ports-mgmt/poudriere-=3Ddevel -r454996 and its: - ports/jail -c NOZFS: Consider non-empty-already-existing-directory a = failure where the change did not cover an explicit use of -m null also being involved to deliberately being using a pre-built world that is located via use of -M PATH . [There is one other side note about a potential issue later below.] # poudriere jail -c -j FBSDjailRPI2 -m null -M = /usr/obj/DESTDIRs/clang-armv7-installworld-poud -S /usr/src -v = 12.0-CURRENT [00:00:00] Creating FBSDjailRPI2 fs at = /usr/obj/DESTDIRs/clang-armv7-installworld-poud... fail [00:00:00] Error: Directory not empty at = /usr/obj/DESTDIRs/clang-armv7-installworld-poud # ls -lTdt /usr/obj/DESTDIRs/clang-armv7-installworld-poud/* drwxr-xr-x 26 root wheel 2048 Nov 27 00:33:01 2017 = /usr/obj/DESTDIRs/clang-armv7-installworld-poud/etc drwxr-xr-x 2 root wheel 2560 Nov 27 00:29:51 2017 = /usr/obj/DESTDIRs/clang-armv7-installworld-poud/rescue . . . (So: a pre-built world, created via a cross build and copied over beforehand.) # poudriere jail -c -j FBSDjailRPI2 -m null -M = /usr/obj/DESTDIRs/clang-armv7-installworld-poud -S /usr/src -v = 12.0-CURRENT [00:00:00] Creating FBSDjailRPI2 fs at = /usr/obj/DESTDIRs/clang-armv7-installworld-poud... fail [00:00:00] Error: Directory not empty at = /usr/obj/DESTDIRs/clang-armv7-installworld-poud /usr/local/etc/poudriere.conf has: NO_ZFS=3Dyes /usr/local/share/poudriere/include/fs.sh has: createfs() { [ $# -ne 3 ] && eargs createfs name mnt fs local name mnt fs name=3D$1 mnt=3D$(echo $2 | sed -e "s,//,/,g") fs=3D$3 [ -z "${NO_ZFS}" ] || fs=3Dnone if [ -n "${fs}" -a "${fs}" !=3D "none" ]; then . . . else msg_n "Creating ${name} fs at ${mnt}..." if ! mkdir -p "${mnt}"; then echo " fail" err 1 "Failed to create directory ${mnt}" fi # If the directory is non-empty then we didn't create = it. if ! dirempty "${mnt}"; then echo " fail" err 1 "Directory not empty at ${mnt}" fi echo " done" fi } For -m null here -M /usr/obj/DESTDIRs/clang-armv7-installworld-poud should point to a non-empty directory as far as I can tell. And it does. But that leads to the above code rejecting the -M path. [Note: I also question, if, with -S /usr/src in use, the SRC_BASE assignment below is correct.] /usr/local/share/poudriere/jail.sh has: create_jail() { [ "${JAILNAME#*.*}" =3D "${JAILNAME}" ] || err 1 "The jailname cannot contain a period (.). See = jail(8)" =20 if [ "${METHOD}" =3D "null" ]; then [ -z "${JAILMNT}" ] && \ err 1 "Must set -M to path of jail to use" [ "${JAILMNT}" =3D "/" ] && \ err 1 "Cannot use / for -M" fi . . . SRC_BASE=3D"${JAILMNT}/usr/src" =20 case ${METHOD} in . . . null) JAILFS=3Dnone FCT=3D ;; esac =20 if [ "${JAILFS}" !=3D "none" ]; then [ -d "${JAILMNT}" ] && \ err 1 "Directory ${JAILMNT} already exists" fi =20 createfs ${JAILNAME} ${JAILMNT} ${JAILFS:-none} . . . =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Mon Dec 4 18:53:19 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 55907E680A9 for ; Mon, 4 Dec 2017 18:53:19 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-168.reflexion.net [208.70.210.168]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 18FFC74CEE for ; Mon, 4 Dec 2017 18:53:18 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 31421 invoked from network); 4 Dec 2017 18:26:37 -0000 Received: from unknown (HELO rtc-sm-01.app.dca.reflexion.local) (10.81.150.1) by 0 (rfx-qmail) with SMTP; 4 Dec 2017 18:26:37 -0000 Received: by rtc-sm-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Mon, 04 Dec 2017 13:26:37 -0500 (EST) Received: (qmail 15285 invoked from network); 4 Dec 2017 18:26:37 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 4 Dec 2017 18:26:37 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id A2EFEEC8B8D; Mon, 4 Dec 2017 10:26:36 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: head -r326192: Under clang pkg-static (1.10.2) fails to link on powerpc64: "libtool: warning: complete static linking is impossible in this configuration" (later crashes) Message-Id: <34DAC1A0-81A5-4381-BF25-07BF7C42A761@dsl-only.net> Date: Mon, 4 Dec 2017 10:26:35 -0800 To: FreeBSD Toolchain , FreeBSD PowerPC ML X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Dec 2017 18:53:19 -0000 [I experiment with clang based worlds and kernels on powerpc64 and powerpc.] This was a poudriere-style build. pkg builds too early to allow devel/binutils or devel/powerpc64-binutils to be build first in order to use that linker or other such utilities. Thus, /usr/bin/ld is in use. (lld is not yet an option, last I knew anyway.) This make poudriere ineffective for the powerpc64 context with clang as the system compiler.=20 libtool: warning: complete static linking is impossible in this = configuration /usr/libexec/gdb shows: (/usr/local/bin/gdb core dumps) Core was generated by `/usr/bin/ld --eh-frame-hdr -dynamic-linker = /libexec/ld-elf.so.1 --enable-new-dta'. . . . Program terminated with signal 11, Segmentation fault. #0 0x000000001002e170 in ppc64_elf_tls_optimize (obfd=3D, info=3D) at = /usr/src/gnu/usr.bin/binutils/libbfd/../../../../contrib/binutils/bfd/elf6= 4-ppc.c:7172 7172 for (ent =3D = htab->tls_get_addr->elf.plt.plist; (gdb) bt #0 0x000000001002e170 in ppc64_elf_tls_optimize (obfd=3D, info=3D) at = /usr/src/gnu/usr.bin/binutils/libbfd/../../../../contrib/binutils/bfd/elf6= 4-ppc.c:7172 #1 0x0000000010001034 in ppc_before_allocation () at = eelf64ppc_fbsd.c:204 #2 0x0000000010009be4 in ldemul_before_allocation () at = /usr/src/gnu/usr.bin/binutils/ld/../../../../contrib/binutils/ld/ldemul.c:= 78 #3 0x0000000010017b00 in lang_process () at = /usr/src/gnu/usr.bin/binutils/ld/../../../../contrib/binutils/ld/ldlang.c:= 5785 #4 0x0000000010021ce0 in main (argc=3D0, argv=3D) = at = /usr/src/gnu/usr.bin/binutils/ld/../../../../contrib/binutils/ld/ldmain.c:= 459 #5 0x00000000100004a8 in _start (argc=3D0, argv=3D0x50a29380, = env=3D0x50f0e5c8, obj=3D, cleanup=3D, ps_strings=3D) at /usr/src/lib/csu/powerpc64/crt1.c:94 Current language: auto; currently minimal --- pkg-static --- /bin/sh ../libtool --tag=3DCC --mode=3Dlink cc -O2 -pipe = -Wno-error -g -fno-strict-aliasing -Wall -Wno-unused-function = -D_BSD_SOURCE -DINET6=3D1 -all-static -Wl,--enable-new-dtags -o = pkg-static pkg-add.o pkg-alias.o pkg-annotate.o pkg-audit.o = pkg-autoremove.o pkg-backup.o pkg-check.o pkg-clean.o pkg-config.o = pkg-convert.o pkg-create.o pkg-delete.o pkg-event.o pkg-fetch.o = pkg-globals.o pkg-info.o pkg-install.o pkg-lock.o pkg-main.o = pkg-plugins.o pkg-query.o pkg-register.o pkg-repo.o pkg-rquery.o = pkg-search.o pkg-set.o pkg-shell.o pkg-shlib.o pkg-ssh.o pkg-stats.o = pkg-update.o pkg-updating.o pkg-upgrade.o pkg-utils.o pkg-version.o = pkg-which.o ../libpkg/libpkg_static.la ../compat/libbsd_compat.la = -ljail -larchive -lz -lutil -lbz2 -llzma -lssl -lcrypto -lm -lelf = -ljail -larchive -lz -lbz2 -llzma libtool: warning: complete static linking is impossible in this = configuration libtool: link: cc -O2 -pipe -Wno-error -g -fno-strict-aliasing -Wall = -Wno-unused-function -D_BSD_SOURCE -DINET6=3D1 -Wl,--enable-new-dtags -o = pkg-static pkg-add.o pkg-alias.o pkg-annotate.o pkg-audit.o = pkg-autoremove.o pkg-backup.o pkg-check.o pkg-clean.o pkg-config.o = pkg-convert.o pkg-create.o pkg-delete.o pkg-event.o pkg-fetch.o = pkg-globals.o pkg-info.o pkg-install.o pkg-lock.o pkg-main.o = pkg-plugins.o pkg-query.o pkg-register.o pkg-repo.o pkg-rquery.o = pkg-search.o pkg-set.o pkg-shell.o pkg-shlib.o pkg-ssh.o pkg-stats.o = pkg-update.o pkg-updating.o pkg-upgrade.o pkg-utils.o pkg-version.o = pkg-which.o ../libpkg/.libs/libpkg_static.a = ../compat/.libs/libbsd_compat.a -lutil -lssl -lcrypto -lm -lelf -ljail = -larchive -lz -lbz2 -llzma . . . --- pkg-static --- cc: error: unable to execute command: Segmentation fault (core dumped) cc: error: linker command failed due to signal (use -v to see = invocation) *** [pkg-static] Error code 254 make[4]: stopped in = /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2/src 1 error make[4]: stopped in = /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2/src *** [all-recursive] Error code 1 make[3]: stopped in /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2 1 error make[3]: stopped in /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2 *** [all] Error code 2 make[2]: stopped in /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2 1 error make[2]: stopped in /wrkdirs/usr/ports/ports-mgmt/pkg/work/pkg-1.10.2 =3D=3D=3D> Compilation failed unexpectedly. Context details: # uname -apKU FreeBSD FBSDG5L 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc = powerpc64 1200054 1200054 # svnlite info /usr/ports/ | grep "Re[plv]" Relative URL: ^/head Repository Root: svn://svn0.us-west.freebsd.org/ports Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 Revision: 455204 Last Changed Rev: 455204 (The last before FLAVORS was enabled.) =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Mon Dec 4 21:59:45 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA534E6C1A7; Mon, 4 Dec 2017 21:59:45 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 802C17B8F3; Mon, 4 Dec 2017 21:59:45 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (unknown [127.0.1.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id A47E32CD4; Mon, 4 Dec 2017 21:59:44 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (localhost [172.31.3.2]) by mail.xzibition.com (Postfix) with ESMTP id E488D7FB3; Mon, 4 Dec 2017 21:59:43 +0000 (UTC) X-Virus-Scanned: amavisd-new at mail.xzibition.com Received: from mail.xzibition.com ([172.31.3.2]) by mail.xzibition.com (mail.xzibition.com [172.31.3.2]) (amavisd-new, port 10026) with LMTP id DPe-HGflz7aO; Mon, 4 Dec 2017 21:59:39 +0000 (UTC) Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH DKIM-Filter: OpenDKIM Filter v2.9.2 mail.xzibition.com 6A2257FAD To: Mark Millard , FreeBSD Toolchain , FreeBSD Ports References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> From: Bryan Drewery Openpgp: id=F9173CB2C3AAEA7A5C8A1F0935D771BB6E4697CF; url=http://www.shatow.net/bryan/bryan2.asc Organization: FreeBSD Message-ID: Date: Mon, 4 Dec 2017 13:59:38 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="aHEnCxxEcPXmoXOnohx0Gm10sknLwxk7U" X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Dec 2017 21:59:45 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --aHEnCxxEcPXmoXOnohx0Gm10sknLwxk7U Content-Type: multipart/mixed; boundary="FivTWtfcVjsALxOM27oIeVHrHxmq0vHLs"; protected-headers="v1" From: Bryan Drewery To: Mark Millard , FreeBSD Toolchain , FreeBSD Ports Message-ID: Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> In-Reply-To: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> --FivTWtfcVjsALxOM27oIeVHrHxmq0vHLs Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 12/3/2017 8:29 PM, Mark Millard wrote: > Note: /usr/ports/ (and so poudriere-devel) as of -r425204=20 > (poudriere-devel-3.2.99.20171129). >=20 > I expect that the below is from ports-mgmt/poudriere-=3Ddevel > -r454996 and its: >=20 > - ports/jail -c NOZFS: Consider non-empty-already-existing-directory = a failure >=20 > where the change did not cover an explicit use of -m null also > being involved to deliberately being using a pre-built > world that is located via use of -M PATH . >=20 > [There is one other side note about a potential > issue later below.] >=20 > # poudriere jail -c -j FBSDjailRPI2 -m null -M /usr/obj/DESTDIRs/clang-= armv7-installworld-poud -S /usr/src -v 12.0-CURRENT > [00:00:00] Creating FBSDjailRPI2 fs at /usr/obj/DESTDIRs/clang-armv7-in= stallworld-poud... fail > [00:00:00] Error: Directory not empty at /usr/obj/DESTDIRs/clang-armv7-= installworld-poud >=20 > # ls -lTdt /usr/obj/DESTDIRs/clang-armv7-installworld-poud/* > drwxr-xr-x 26 root wheel 2048 Nov 27 00:33:01 2017 /usr/obj/DESTDIRs= /clang-armv7-installworld-poud/etc > drwxr-xr-x 2 root wheel 2560 Nov 27 00:29:51 2017 /usr/obj/DESTDIRs= /clang-armv7-installworld-poud/rescue > . . . >=20 > (So: a pre-built world, created via a cross build and > copied over beforehand.) >=20 > # poudriere jail -c -j FBSDjailRPI2 -m null -M /usr/obj/DESTDIRs/clang-= armv7-installworld-poud -S /usr/src -v 12.0-CURRENT > [00:00:00] Creating FBSDjailRPI2 fs at /usr/obj/DESTDIRs/clang-armv7-in= stallworld-poud... fail > [00:00:00] Error: Directory not empty at /usr/obj/DESTDIRs/clang-armv7-= installworld-poud Yup will fix for 3.2.3 today. >=20 >=20 > /usr/local/etc/poudriere.conf has: >=20 > NO_ZFS=3Dyes >=20 >=20 > /usr/local/share/poudriere/include/fs.sh has: >=20 > createfs() { > [ $# -ne 3 ] && eargs createfs name mnt fs > local name mnt fs > name=3D$1 > mnt=3D$(echo $2 | sed -e "s,//,/,g") > fs=3D$3 >=20 > [ -z "${NO_ZFS}" ] || fs=3Dnone >=20 > if [ -n "${fs}" -a "${fs}" !=3D "none" ]; then > . . . > else > msg_n "Creating ${name} fs at ${mnt}..." > if ! mkdir -p "${mnt}"; then > echo " fail" > err 1 "Failed to create directory ${mnt}" > fi > # If the directory is non-empty then we didn't create i= t. > if ! dirempty "${mnt}"; then > echo " fail" > err 1 "Directory not empty at ${mnt}" > fi > echo " done" > fi > } >=20 > For -m null here -M /usr/obj/DESTDIRs/clang-armv7-installworld-poud > should point to a non-empty directory as far as I can tell. And > it does. But that leads to the above code rejecting the -M > path. >=20 >=20 >=20 > [Note: I also question, if, with -S /usr/src > in use, the SRC_BASE assignment below is > correct.] Yeah it's a bit off. I have a pending bug to fix here from earlier reports from you as well that I haven't gotten to yet. >=20 > /usr/local/share/poudriere/jail.sh has: >=20 > create_jail() { > [ "${JAILNAME#*.*}" =3D "${JAILNAME}" ] || > err 1 "The jailname cannot contain a period (.). See ja= il(8)" > =20 > if [ "${METHOD}" =3D "null" ]; then > [ -z "${JAILMNT}" ] && \ > err 1 "Must set -M to path of jail to use" > [ "${JAILMNT}" =3D "/" ] && \ > err 1 "Cannot use / for -M" > fi > . . . > SRC_BASE=3D"${JAILMNT}/usr/src" > =20 > case ${METHOD} in > . . . > null) > JAILFS=3Dnone > FCT=3D > ;; > esac > =20 > if [ "${JAILFS}" !=3D "none" ]; then > [ -d "${JAILMNT}" ] && \ > err 1 "Directory ${JAILMNT} already exists" > fi > =20 > createfs ${JAILNAME} ${JAILMNT} ${JAILFS:-none} > . . . >=20 >=20 >=20 > =3D=3D=3D > Mark Millard > markmi at dsl-only.net >=20 --=20 Regards, Bryan Drewery --FivTWtfcVjsALxOM27oIeVHrHxmq0vHLs-- --aHEnCxxEcPXmoXOnohx0Gm10sknLwxk7U Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBAgAGBQJaJcVKAAoJEDXXcbtuRpfPpz0H/02EPOsS/hnTwORIAsltFKYy VblRM4optjm+V7IA3O1MWJcxop3E9QeukuM9InovCe/yXkuWWZV2PRdk5AO4zvR2 YnYc4OF3HnVdxFiaAIM4iFwHQVWsGMAjI5U0cY3RlTAepIZl4pvuHxApbC7FBcQh ox/8ZB4izbgDlU8teYGAI5ovXVahywcEBMfHgmpY10LfVNjdU1kWQc1m4tgvCwtC MoZR2hByJ+G+XLFLXiuxJ39Nuzb3+g8FJKphOErXBnVap+y7xJN43BvmjSn+ww6e 8fxy0w4p7tpMEo30Jl5gR9Laqm8Q0uilstE+M09g83DdnZ7Tiua9KBoUrI4GF5o= =MVgj -----END PGP SIGNATURE----- --aHEnCxxEcPXmoXOnohx0Gm10sknLwxk7U-- From owner-freebsd-toolchain@freebsd.org Mon Dec 4 23:54:07 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id E9358E6EB5B; Mon, 4 Dec 2017 23:54:07 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [96.47.72.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id B8C477F34F; Mon, 4 Dec 2017 23:54:07 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (unknown [127.0.1.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id 0BFBA43E4; Mon, 4 Dec 2017 23:54:07 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (localhost [172.31.3.2]) by mail.xzibition.com (Postfix) with ESMTP id 068AB81A7; Mon, 4 Dec 2017 23:54:06 +0000 (UTC) X-Virus-Scanned: amavisd-new at mail.xzibition.com Received: from mail.xzibition.com ([172.31.3.2]) by mail.xzibition.com (mail.xzibition.com [172.31.3.2]) (amavisd-new, port 10026) with LMTP id 6YMIidJ2pDTI; Mon, 4 Dec 2017 23:54:04 +0000 (UTC) Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH DKIM-Filter: OpenDKIM Filter v2.9.2 mail.xzibition.com A303581A2 To: Mark Millard , FreeBSD Toolchain , FreeBSD Ports References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> From: Bryan Drewery Openpgp: id=F9173CB2C3AAEA7A5C8A1F0935D771BB6E4697CF; url=http://www.shatow.net/bryan/bryan2.asc Organization: FreeBSD Message-ID: <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> Date: Mon, 4 Dec 2017 15:54:03 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.4.0 MIME-Version: 1.0 In-Reply-To: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="7tvo4BEuHptu68Bw8MPEGSDesPQguxVrl" X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Dec 2017 23:54:08 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --7tvo4BEuHptu68Bw8MPEGSDesPQguxVrl Content-Type: multipart/mixed; boundary="WPh6XpErk68XNvNPnSVNW2LjF7EoJAbDT"; protected-headers="v1" From: Bryan Drewery To: Mark Millard , FreeBSD Toolchain , FreeBSD Ports Message-ID: <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> In-Reply-To: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> --WPh6XpErk68XNvNPnSVNW2LjF7EoJAbDT Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 12/3/2017 8:29 PM, Mark Millard wrote: > Note: /usr/ports/ (and so poudriere-devel) as of -r425204=20 > (poudriere-devel-3.2.99.20171129). >=20 > I expect that the below is from ports-mgmt/poudriere-=3Ddevel > -r454996 and its: >=20 > - ports/jail -c NOZFS: Consider non-empty-already-existing-directory = a failure >=20 > where the change did not cover an explicit use of -m null also > being involved to deliberately being using a pre-built > world that is located via use of -M PATH . >=20 > [There is one other side note about a potential > issue later below.] This and the -S issue should both be fixed in poudriere-devel-3.2.99.20171204_1 I will release it to 3.2.3 later today. Please let me know if it works for you. --=20 Regards, Bryan Drewery --WPh6XpErk68XNvNPnSVNW2LjF7EoJAbDT-- --7tvo4BEuHptu68Bw8MPEGSDesPQguxVrl Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBAgAGBQJaJeAbAAoJEDXXcbtuRpfPwkAH/09RStrEtMhpJNqI+o33hWCQ FBaj8HtfrG8ec4ycegGSkx0YbG1QinlijHRnJPswxAa1eRVxMyYymijqtPdTl9aT UZEnFRWBeUhX/+cwVhJRpnl6FLftffuRt93S8Rnzu1RFdYywIF8wYOn9E4DvAauP 2MDka6rrY+3A/cDyMdqJYHOaZ3Fijtth7G0AvfwHW5v68cow+2ogm9of/9r/kMiM 9Mq4LqGE6bS2W4TlO/e/yYxF7GmX2mrhkf0SjqC8cP8q8vbG/A0dJaWUCxU1YS4s 2AMxVj9Shw5RWIrUKEHIwvOMl6EcspyNy1yZRZqm4xMMNDteFcHltLI+HsBU+W8= =RM0i -----END PGP SIGNATURE----- --7tvo4BEuHptu68Bw8MPEGSDesPQguxVrl-- From owner-freebsd-toolchain@freebsd.org Tue Dec 5 01:04:22 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 02941E70CE8 for ; Tue, 5 Dec 2017 01:04:22 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-151.reflexion.net [208.70.210.151]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id A8ED31AB0 for ; Tue, 5 Dec 2017 01:04:20 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 15142 invoked from network); 5 Dec 2017 00:37:34 -0000 Received: from unknown (HELO rtc-sm-01.app.dca.reflexion.local) (10.81.150.1) by 0 (rfx-qmail) with SMTP; 5 Dec 2017 00:37:34 -0000 Received: by rtc-sm-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Mon, 04 Dec 2017 19:37:34 -0500 (EST) Received: (qmail 2972 invoked from network); 5 Dec 2017 00:37:34 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 5 Dec 2017 00:37:34 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id CB2C4EC81E6; Mon, 4 Dec 2017 16:37:33 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH From: Mark Millard In-Reply-To: <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> Date: Mon, 4 Dec 2017 16:37:33 -0800 Cc: FreeBSD Toolchain , FreeBSD Ports Content-Transfer-Encoding: quoted-printable Message-Id: References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> To: Bryan Drewery X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Dec 2017 01:04:22 -0000 On 2017-Dec-4, at 3:54 PM, Bryan Drewery = wrote: > On 12/3/2017 8:29 PM, Mark Millard wrote: >> Note: /usr/ports/ (and so poudriere-devel) as of -r425204=20 >> (poudriere-devel-3.2.99.20171129). >>=20 >> I expect that the below is from ports-mgmt/poudriere-=3Ddevel >> -r454996 and its: >>=20 >> - ports/jail -c NOZFS: Consider non-empty-already-existing-directory = a failure >>=20 >> where the change did not cover an explicit use of -m null also >> being involved to deliberately being using a pre-built >> world that is located via use of -M PATH . >>=20 >> [There is one other side note about a potential >> issue later below.] >=20 > This and the -S issue should both be fixed in > poudriere-devel-3.2.99.20171204_1 > I will release it to 3.2.3 later today. Please let me know if it works > for you. Thanks. I've got competing non-FreeBSD time and multiple issues across multiple TARGET_ARCH environments, just trying to get to /usr/ports/ -r455204 (the last before FLAVORS was enabled). It may be a while before my /usr/ports/ vintage catches up to referencing the 3.2.3 vintage. I have more to analyze and report on, probably no ports-mgmt/poudriere-devel fixes being involved(?). I'm not sure when I'll get to that analysis. When I get that far, I'll try to remember to let you know. On powerpc64 there is a blocking issue for my system-clang-based context and building pkg in poudriere (or anywhere without a devel/powerpc64-binutils equivalent being available at the time): It used to be that the system binutils was sufficient for that but now it is not. This need not be viewed as poudriere's problem but does stop my testing poudriere in that context. With a /usr/ports vintage with FLAVORS enabled I'll likely be limited to direct Makefile use on clang-based powerpc64, if understand the state of things correctly. Back to the non-FreeBSD activity. . . =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Tue Dec 5 04:21:35 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CDE00DF3046 for ; Tue, 5 Dec 2017 04:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id BBE3569585 for ; Tue, 5 Dec 2017 04:21:35 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vB54LZBx039073 for ; Tue, 5 Dec 2017 04:21:35 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-toolchain@FreeBSD.org Subject: [Bug 223848] mips64 native-xtools build failure Date: Tue, 05 Dec 2017 04:21:35 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: misc X-Bugzilla-Version: CURRENT X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: sbruno@FreeBSD.org X-Bugzilla-Status: Closed X-Bugzilla-Resolution: FIXED X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: resolution bug_status Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Dec 2017 04:21:35 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223848 Sean Bruno changed: What |Removed |Added ---------------------------------------------------------------------------- Resolution|--- |FIXED Status|New |Closed --- Comment #1 from Sean Bruno --- Author: bdrewery Date: Tue Dec 5 02:23:36 2017 New Revision: 326553 URL: https://svnweb.freebsd.org/changeset/base/326553 Log: native-xtools: Fix build without META_MODE for GCC archs. The initial kernel-toolchain is built with TARGET=3DMACHINE but we want GCC to have files generated for TARGET=3DNXB_TARGET instead later on. Just clean the files between building of the toolchain and nxb binaries which will let it rebuild when needed. Reported by: sbruno X-MFC-With: r325001 MFC after: 1 month Sponsored by: Dell EMC --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Tue Dec 5 18:42:58 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 95487E74416 for ; Tue, 5 Dec 2017 18:42:58 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-113.reflexion.net [208.70.210.113]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 41FF168427 for ; Tue, 5 Dec 2017 18:42:57 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 23105 invoked from network); 5 Dec 2017 18:42:51 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 5 Dec 2017 18:42:51 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Tue, 05 Dec 2017 13:42:51 -0500 (EST) Received: (qmail 26994 invoked from network); 5 Dec 2017 18:42:50 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 5 Dec 2017 18:42:50 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id 44F59EC814E; Tue, 5 Dec 2017 10:42:50 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: 32-bit powerpc system-clang based builds of devel/llvm40 and devel/llvm50: fails via "Host compiler appears to require libatomic, but cannot find it" Message-Id: Date: Tue, 5 Dec 2017 10:42:49 -0800 To: FreeBSD Toolchain , FreeBSD PowerPC ML , FreeBSD Ports X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Dec 2017 18:42:58 -0000 [I experiment with system-clang based buildworld and/or buildkernel based TARGET_ARCH=3Dpowerpc64 and TARGET_ARCH=3Dpowerpc environments.] For TARGET_ARCH=3Dpowerpc devel/llvm40 and devel/llvm50 get failure reports like: -- Looking for __atomic_load_8 in atomic - not found CMake Error at cmake/modules/CheckAtomic.cmake:74 (message): Host compiler appears to require libatomic, but cannot find it. Call Stack (most recent call first): cmake/config-ix.cmake:307 (include) CMakeLists.txt:582 (include) I had tried to avoid any need for 8-Byte atomics (among other things) by avoiding LIT, LLD, and LLDB: # more /usr/local/etc/poudriere.d/options/devel_llvm50/options # This file is auto-generated by 'make config'. # Options for llvm50-5.0.0_1 _OPTIONS_READ=3Dllvm50-5.0.0_1 _FILE_COMPLETE_OPTIONS_LIST=3DCLANG DOCS EXTRAS LIT LLD LLDB OPTIONS_FILE_SET+=3DCLANG OPTIONS_FILE_SET+=3DDOCS OPTIONS_FILE_SET+=3DEXTRAS OPTIONS_FILE_UNSET+=3DLIT OPTIONS_FILE_UNSET+=3DLLD OPTIONS_FILE_UNSET+=3DLLDB # more /usr/local/etc/poudriere.d/options/devel_llvm40/options # This file is auto-generated by 'make config'. # Options for llvm40-4.0.1_1 _OPTIONS_READ=3Dllvm40-4.0.1_1 _FILE_COMPLETE_OPTIONS_LIST=3DCLANG DOCS EXTRAS LIT LLD LLDB OPTIONS_FILE_SET+=3DCLANG OPTIONS_FILE_SET+=3DDOCS OPTIONS_FILE_SET+=3DEXTRAS OPTIONS_FILE_UNSET+=3DLIT OPTIONS_FILE_UNSET+=3DLLD OPTIONS_FILE_UNSET+=3DLLDB For clang-based buildworld avoiding such things prevents running into the 8-Byte atomics based build failures: WITH_LIBCPLUSPLUS=3D WITH_BINUTILS_BOOTSTRAP=3D WITH_ELFTOOLCHAIN_BOOTSTRAP=3D #WITH_CLANG_BOOTSTRAP=3D WITH_CLANG=3D WITH_CLANG_IS_CC=3D WITH_CLANG_FULL=3D WITH_CLANG_EXTRAS=3D WITH_LLD=3D # lldb requires missing atomic 8-byte operations for powerpc (non-64) WITHOUT_LLDB=3D # WITH_BOOT=3D (Note: buildkernel currently fails.) # clang++ --version FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on = LLVM 5.0.0svn) Target: powerpc-unknown-freebsd12.0 Thread model: posix InstalledDir: /usr/bin # uname -apKU FreeBSD FBSDG4S 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc = powerpc 1200054 1200054 # svnlite info /usr/ports/ | grep "Re[plv]" Relative URL: ^/head Repository Root: https://svn.freebsd.org/ports Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 Revision: 455204 Last Changed Rev: 455204 =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Tue Dec 5 18:59:45 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CA40BE74ED3 for ; Tue, 5 Dec 2017 18:59:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id B8135693CA for ; Tue, 5 Dec 2017 18:59:45 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vB5Ixjh8057249 for ; Tue, 5 Dec 2017 18:59:45 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-toolchain@FreeBSD.org Subject: [Bug 223776] ports-mgmt/pkg: lld confuses shared library tracking Date: Tue, 05 Dec 2017 18:59:45 +0000 X-Bugzilla-Reason: CC X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Ports & Packages X-Bugzilla-Component: Individual Port(s) X-Bugzilla-Version: Latest X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Some People X-Bugzilla-Who: emaste@freebsd.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: emaste@freebsd.org X-Bugzilla-Flags: maintainer-feedback? X-Bugzilla-Changed-Fields: Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Dec 2017 18:59:45 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D223776 --- Comment #3 from Ed Maste --- This should be fixed in pkg 1.10.3 --=20 You are receiving this mail because: You are on the CC list for the bug.= From owner-freebsd-toolchain@freebsd.org Tue Dec 5 20:48:31 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id EF35EE80F51; Tue, 5 Dec 2017 20:48:31 +0000 (UTC) (envelope-from rdivacky@vlakno.cz) Received: from vlakno.cz (mail.vlakno.cz [91.217.96.224]) by mx1.freebsd.org (Postfix) with ESMTP id 73AF36EA26; Tue, 5 Dec 2017 20:48:30 +0000 (UTC) (envelope-from rdivacky@vlakno.cz) Received: by vlakno.cz (Postfix, from userid 1002) id 63A2546D20F; Tue, 5 Dec 2017 21:39:32 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple; d=vlakno.cz; s=mail; t=1512506372; bh=/wBElwnwyoB0baxRBjwecbDB5fVvTJBjEkNj+UHz40A=; h=Date:From:To:Cc:Subject:References:In-Reply-To; b=FgnMbabsdwfdUhLYuRI3HG4f9H7Iv2AzuHrfiDYTS8Gnvp7NDUA9wgh7MTl4Zg0AC qTAVm0C59cKcGE5lhaJMZZOeOYAwsqHgAKNMtTkuAXBYpBy7qhFoM4o/u1iAe0j75j ag6Nrrh9fUvL1eR7Z7gmYCbo4wPjccFA1Talgsdk= Date: Tue, 5 Dec 2017 21:39:32 +0100 From: Roman Divacky To: Mark Millard Cc: FreeBSD Toolchain , FreeBSD PowerPC ML , FreeBSD Ports Subject: Re: 32-bit powerpc system-clang based builds of devel/llvm40 and devel/llvm50: fails via "Host compiler appears to require libatomic, but cannot find it" Message-ID: <20171205203932.GA53800@vlakno.cz> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.9.1 (2017-09-22) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Dec 2017 20:48:32 -0000 The cmake test just tries to compile: #include std::atomic x; int main() { return x; } What happens if you try to compile this small code with your host compiler? Roman On Tue, Dec 05, 2017 at 10:42:49AM -0800, Mark Millard wrote: > [I experiment with system-clang based > buildworld and/or buildkernel based > TARGET_ARCH=powerpc64 and > TARGET_ARCH=powerpc environments.] > > For TARGET_ARCH=powerpc devel/llvm40 and > devel/llvm50 get failure reports like: > > -- Looking for __atomic_load_8 in atomic - not found > CMake Error at cmake/modules/CheckAtomic.cmake:74 (message): > Host compiler appears to require libatomic, but cannot find it. > Call Stack (most recent call first): > cmake/config-ix.cmake:307 (include) > CMakeLists.txt:582 (include) > > > I had tried to avoid any need for 8-Byte atomics > (among other things) by avoiding LIT, LLD, and LLDB: > > # more /usr/local/etc/poudriere.d/options/devel_llvm50/options > # This file is auto-generated by 'make config'. > # Options for llvm50-5.0.0_1 > _OPTIONS_READ=llvm50-5.0.0_1 > _FILE_COMPLETE_OPTIONS_LIST=CLANG DOCS EXTRAS LIT LLD LLDB > OPTIONS_FILE_SET+=CLANG > OPTIONS_FILE_SET+=DOCS > OPTIONS_FILE_SET+=EXTRAS > OPTIONS_FILE_UNSET+=LIT > OPTIONS_FILE_UNSET+=LLD > OPTIONS_FILE_UNSET+=LLDB > > # more /usr/local/etc/poudriere.d/options/devel_llvm40/options > # This file is auto-generated by 'make config'. > # Options for llvm40-4.0.1_1 > _OPTIONS_READ=llvm40-4.0.1_1 > _FILE_COMPLETE_OPTIONS_LIST=CLANG DOCS EXTRAS LIT LLD LLDB > OPTIONS_FILE_SET+=CLANG > OPTIONS_FILE_SET+=DOCS > OPTIONS_FILE_SET+=EXTRAS > OPTIONS_FILE_UNSET+=LIT > OPTIONS_FILE_UNSET+=LLD > OPTIONS_FILE_UNSET+=LLDB > > For clang-based buildworld avoiding such things > prevents running into the 8-Byte atomics based > build failures: > > WITH_LIBCPLUSPLUS= > WITH_BINUTILS_BOOTSTRAP= > WITH_ELFTOOLCHAIN_BOOTSTRAP= > #WITH_CLANG_BOOTSTRAP= > WITH_CLANG= > WITH_CLANG_IS_CC= > WITH_CLANG_FULL= > WITH_CLANG_EXTRAS= > WITH_LLD= > # lldb requires missing atomic 8-byte operations for powerpc (non-64) > WITHOUT_LLDB= > # > WITH_BOOT= > > (Note: buildkernel currently fails.) > > # clang++ --version > FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on LLVM 5.0.0svn) > Target: powerpc-unknown-freebsd12.0 > Thread model: posix > InstalledDir: /usr/bin > > # uname -apKU > FreeBSD FBSDG4S 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc powerpc 1200054 1200054 > > # svnlite info /usr/ports/ | grep "Re[plv]" > Relative URL: ^/head > Repository Root: https://svn.freebsd.org/ports > Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 > Revision: 455204 > Last Changed Rev: 455204 > > > === > Mark Millard > markmi at dsl-only.net > > _______________________________________________ > freebsd-toolchain@freebsd.org mailing list > https://lists.freebsd.org/mailman/listinfo/freebsd-toolchain > To unsubscribe, send any mail to "freebsd-toolchain-unsubscribe@freebsd.org" From owner-freebsd-toolchain@freebsd.org Wed Dec 6 00:23:26 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 31CF6E88B8C for ; Wed, 6 Dec 2017 00:23:26 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-125.reflexion.net [208.70.210.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EAC4E7A7E5 for ; Wed, 6 Dec 2017 00:23:24 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 27550 invoked from network); 5 Dec 2017 21:36:38 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 5 Dec 2017 21:36:38 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Tue, 05 Dec 2017 16:36:38 -0500 (EST) Received: (qmail 15186 invoked from network); 5 Dec 2017 21:36:37 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 5 Dec 2017 21:36:37 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id 1BB8AEC94F6; Tue, 5 Dec 2017 13:36:37 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: 32-bit powerpc system-clang based builds of devel/llvm40 and devel/llvm50: fails via "Host compiler appears to require libatomic, but cannot find it" From: Mark Millard In-Reply-To: <20171205203932.GA53800@vlakno.cz> Date: Tue, 5 Dec 2017 13:36:36 -0800 Cc: FreeBSD Toolchain , FreeBSD PowerPC ML , FreeBSD Ports Content-Transfer-Encoding: quoted-printable Message-Id: <92AC463A-4A91-4DC2-8536-1026DD5212B6@dsl-only.net> References: <20171205203932.GA53800@vlakno.cz> To: Roman Divacky X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Dec 2017 00:23:26 -0000 On 2017-Dec-5, at 12:39 PM, Roman Divacky wrote: > The cmake test just tries to compile: >=20 > #include > std::atomic x; > int main() { > return x; > } >=20 > What happens if you try to compile this small code with your host = compiler? >=20 > Roman [I later show that it seems to be testing with: std::atomic x (0) instead and is also using a line the example does not have (devel/llvm50 example): uint64_t i =3D x.load(std::memory_order_relaxed); .] # uname -apKU FreeBSD FBSDG4S 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc = powerpc 1200054 1200054 # more cpp_atomic.cpp=20 #include std::atomic x; int main() { return x; } # clang++ -v cpp_atomic.cpp FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on = LLVM 5.0.0svn) Target: powerpc-unknown-freebsd12.0 Thread model: posix InstalledDir: /usr/bin "/usr/bin/clang++" -cc1 -triple powerpc-unknown-freebsd12.0 -emit-obj = -mrelax-all -disable-free -main-file-name cpp_atomic.cpp = -mrelocation-model static -mthread-model posix -mdisable-fp-elim = -masm-verbose -mconstructor-aliases -target-cpu ppc -mfloat-abi hard -v = -dwarf-column-info -debugger-tuning=3Dgdb -resource-dir = /usr/lib/clang/5.0.0 -internal-isystem /usr/include/c++/v1 = -fdeprecated-macro -fdebug-compilation-dir /root/c_tests -ferror-limit = 19 -fmessage-length 200 -fno-signed-char -fobjc-runtime=3Dgnustep = -fcxx-exceptions -fexceptions -fdiagnostics-show-option = -fcolor-diagnostics -o /tmp/cpp_atomic-3b1ae2.o -x c++ cpp_atomic.cpp clang -cc1 version 5.0.0 based upon LLVM 5.0.0svn default target = powerpc-unknown-freebsd12.0 #include "..." search starts here: #include <...> search starts here: /usr/include/c++/v1 /usr/lib/clang/5.0.0/include /usr/include End of search list. "/usr/bin/ld" --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 = --enable-new-dtags -m elf32ppc_fbsd -o a.out /usr/lib/crt1.o = /usr/lib/crti.o /usr/lib/crtbegin.o -L/usr/lib /tmp/cpp_atomic-3b1ae2.o = -lc++ -lm -lgcc --as-needed -lgcc_s --no-as-needed -lc -lgcc --as-needed = -lgcc_s --no-as-needed /usr/lib/crtend.o /usr/lib/crtn.o # ./a.out # So, the example works fine. Nothing about that example program would seem to match the note: -- Looking for __atomic_load_8 in atomic I would guess that the __atomic_load_8 test is somewhat different. . . Looking at an expansion of a wrkdirs' .tbz that poudriere produced, CheckAtomic.cmake has . . . . . . # Check for 64 bit atomic operations. if(MSVC) set(HAVE_CXX_ATOMICS64_WITHOUT_LIB True) else() check_working_cxx_atomics64(HAVE_CXX_ATOMICS64_WITHOUT_LIB) endif() # If not, check if the library exists, and atomics work with it. if(NOT HAVE_CXX_ATOMICS64_WITHOUT_LIB) check_library_exists(atomic __atomic_load_8 "" HAVE_CXX_LIBATOMICS64) if(HAVE_CXX_LIBATOMICS64) list(APPEND CMAKE_REQUIRED_LIBRARIES "atomic") check_working_cxx_atomics64(HAVE_CXX_ATOMICS64_WITH_LIB) if (NOT HAVE_CXX_ATOMICS64_WITH_LIB) message(FATAL_ERROR "Host compiler must support std::atomic!") endif() else() message(FATAL_ERROR "Host compiler appears to require libatomic, but = cannot find it.") endif() endif() . . . =46rom this I get: A) check_working_cxx_atomics64(HAVE_CXX_ATOMICS64_WITHOUT_LIB) set: NOT HAVE_CXX_ATOMICS64_WITHOUT_LIB B) check_library_exists(atomic __atomic_load_8 "" HAVE_CXX_LIBATOMICS64) set: NOT HAVE_CXX_LIBATOMICS64 For (A), looking at the test code (found by name-text matching): function(check_working_cxx_atomics64 varname) set(OLD_CMAKE_REQUIRED_FLAGS ${CMAKE_REQUIRED_FLAGS}) set(CMAKE_REQUIRED_FLAGS "-std=3Dc++11 ${CMAKE_REQUIRED_FLAGS}") CHECK_CXX_SOURCE_COMPILES(" #include #include std::atomic x (0); int main() { uint64_t i =3D x.load(std::memory_order_relaxed); return 0; } " ${varname}) set(CMAKE_REQUIRED_FLAGS ${OLD_CMAKE_REQUIRED_FLAGS}) endfunction(check_working_cxx_atomics64) I see: #include #include std::atomic x (0); int main() { uint64_t i =3D x.load(std::memory_order_relaxed); return 0; } Trying that example I see: /tmp/cpp_atomic_64_test-1fa999.o: In function `main': cpp_atomic_64_test.cpp:(.text+0xa8): undefined reference to = `__atomic_load_8' clang++: error: linker command failed with exit code 1 (use -v to see = invocation) Details: # more cpp_atomic_64_test.cpp=20 #include #include std::atomic x (0); int main() { uint64_t i =3D x.load(std::memory_order_relaxed); return 0; } # clang++ -v cpp_atomic_64_test.cpp=20 FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on = LLVM 5.0.0svn) Target: powerpc-unknown-freebsd12.0 Thread model: posix InstalledDir: /usr/bin "/usr/bin/clang++" -cc1 -triple powerpc-unknown-freebsd12.0 -emit-obj = -mrelax-all -disable-free -main-file-name cpp_atomic_64_test.cpp = -mrelocation-model static -mthread-model posix -mdisable-fp-elim = -masm-verbose -mconstructor-aliases -target-cpu ppc -mfloat-abi hard -v = -dwarf-column-info -debugger-tuning=3Dgdb -resource-dir = /usr/lib/clang/5.0.0 -internal-isystem /usr/include/c++/v1 = -fdeprecated-macro -fdebug-compilation-dir /root/c_tests -ferror-limit = 19 -fmessage-length 200 -fno-signed-char -fobjc-runtime=3Dgnustep = -fcxx-exceptions -fexceptions -fdiagnostics-show-option = -fcolor-diagnostics -o /tmp/cpp_atomic_64_test-1fa999.o -x c++ = cpp_atomic_64_test.cpp clang -cc1 version 5.0.0 based upon LLVM 5.0.0svn default target = powerpc-unknown-freebsd12.0 #include "..." search starts here: #include <...> search starts here: /usr/include/c++/v1 /usr/lib/clang/5.0.0/include /usr/include End of search list. "/usr/bin/ld" --eh-frame-hdr -dynamic-linker /libexec/ld-elf.so.1 = --enable-new-dtags -m elf32ppc_fbsd -o a.out /usr/lib/crt1.o = /usr/lib/crti.o /usr/lib/crtbegin.o -L/usr/lib = /tmp/cpp_atomic_64_test-1fa999.o -lc++ -lm -lgcc --as-needed -lgcc_s = --no-as-needed -lc -lgcc --as-needed -lgcc_s --no-as-needed = /usr/lib/crtend.o /usr/lib/crtn.o /tmp/cpp_atomic_64_test-1fa999.o: In function `main': cpp_atomic_64_test.cpp:(.text+0xa8): undefined reference to = `__atomic_load_8' clang++: error: linker command failed with exit code 1 (use -v to see = invocation) > On Tue, Dec 05, 2017 at 10:42:49AM -0800, Mark Millard wrote: >> [I experiment with system-clang based >> buildworld and/or buildkernel based >> TARGET_ARCH=3Dpowerpc64 and >> TARGET_ARCH=3Dpowerpc environments.] >>=20 >> For TARGET_ARCH=3Dpowerpc devel/llvm40 and >> devel/llvm50 get failure reports like: >>=20 >> -- Looking for __atomic_load_8 in atomic - not found >> CMake Error at cmake/modules/CheckAtomic.cmake:74 (message): >> Host compiler appears to require libatomic, but cannot find it. >> Call Stack (most recent call first): >> cmake/config-ix.cmake:307 (include) >> CMakeLists.txt:582 (include) >>=20 >>=20 >> I had tried to avoid any need for 8-Byte atomics >> (among other things) by avoiding LIT, LLD, and LLDB: >>=20 >> # more /usr/local/etc/poudriere.d/options/devel_llvm50/options >> # This file is auto-generated by 'make config'. >> # Options for llvm50-5.0.0_1 >> _OPTIONS_READ=3Dllvm50-5.0.0_1 >> _FILE_COMPLETE_OPTIONS_LIST=3DCLANG DOCS EXTRAS LIT LLD LLDB >> OPTIONS_FILE_SET+=3DCLANG >> OPTIONS_FILE_SET+=3DDOCS >> OPTIONS_FILE_SET+=3DEXTRAS >> OPTIONS_FILE_UNSET+=3DLIT >> OPTIONS_FILE_UNSET+=3DLLD >> OPTIONS_FILE_UNSET+=3DLLDB >>=20 >> # more /usr/local/etc/poudriere.d/options/devel_llvm40/options >> # This file is auto-generated by 'make config'. >> # Options for llvm40-4.0.1_1 >> _OPTIONS_READ=3Dllvm40-4.0.1_1 >> _FILE_COMPLETE_OPTIONS_LIST=3DCLANG DOCS EXTRAS LIT LLD LLDB >> OPTIONS_FILE_SET+=3DCLANG >> OPTIONS_FILE_SET+=3DDOCS >> OPTIONS_FILE_SET+=3DEXTRAS >> OPTIONS_FILE_UNSET+=3DLIT >> OPTIONS_FILE_UNSET+=3DLLD >> OPTIONS_FILE_UNSET+=3DLLDB >>=20 >> For clang-based buildworld avoiding such things >> prevents running into the 8-Byte atomics based >> build failures: >>=20 >> WITH_LIBCPLUSPLUS=3D >> WITH_BINUTILS_BOOTSTRAP=3D >> WITH_ELFTOOLCHAIN_BOOTSTRAP=3D >> #WITH_CLANG_BOOTSTRAP=3D >> WITH_CLANG=3D >> WITH_CLANG_IS_CC=3D >> WITH_CLANG_FULL=3D >> WITH_CLANG_EXTRAS=3D >> WITH_LLD=3D >> # lldb requires missing atomic 8-byte operations for powerpc (non-64) >> WITHOUT_LLDB=3D >> # >> WITH_BOOT=3D >>=20 >> (Note: buildkernel currently fails.) >>=20 >> # clang++ --version >> FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on = LLVM 5.0.0svn) >> Target: powerpc-unknown-freebsd12.0 >> Thread model: posix >> InstalledDir: /usr/bin >>=20 >> # uname -apKU >> FreeBSD FBSDG4S 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc = powerpc 1200054 1200054 >>=20 >> # svnlite info /usr/ports/ | grep "Re[plv]" >> Relative URL: ^/head >> Repository Root: https://svn.freebsd.org/ports >> Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 >> Revision: 455204 >> Last Changed Rev: 455204 >=20 Side note: I see that you have been working on the powerpc/powerpc64 problem for generating libraries to handle thrown C++ exceptions, even making the problem description better/more-detailed/specific for the llvm bugzilla entry, now: __builtin_eh_return is not implemented for PPC nor PPC64 and referencing a start at changes for this: I have a WIP patch at http://vlakno.cz/~rdivacky/ppc64.eh_return.patch if anyone wants to take a look and finish it. Cool --and thanks! =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Wed Dec 6 04:46:35 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9C037E901F9 for ; Wed, 6 Dec 2017 04:46:35 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-168.reflexion.net [208.70.210.168]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 5E9803390 for ; Wed, 6 Dec 2017 04:46:34 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 25817 invoked from network); 6 Dec 2017 04:46:33 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 6 Dec 2017 04:46:33 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Tue, 05 Dec 2017 23:46:33 -0500 (EST) Received: (qmail 23395 invoked from network); 6 Dec 2017 04:46:33 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 6 Dec 2017 04:46:33 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id 99622EC814E; Tue, 5 Dec 2017 20:46:32 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: powerpc64 & system-clang vs. building the likes of lang/gcc7 (at least): vec_step name pollution causes compile failures, should gcc7 source code avoid the name? Message-Id: Date: Tue, 5 Dec 2017 20:46:31 -0800 Cc: Gerald Pfeifer To: FreeBSD Toolchain , FreeBSD PowerPC ML , FreeBSD Ports X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Dec 2017 04:46:35 -0000 [I experiment with clang-based worlds and kernels on powerpc64 and powerpc. But I'm not sure that such is the only type of context is required to see the below problem.] Attempting to build lang/gcc7 on a system-clang based powerpc64 (world and kernel) gets: = /wrkdirs/usr/ports/lang/gcc7/work/gcc-7.2.0/gcc/tree-vect-loop.c:3835:27: = error: expected unqualified-id tree new_vec, vec_init, vec_step, t; ^ = /wrkdirs/usr/ports/lang/gcc7/work/gcc-7.2.0/gcc/tree-vect-loop.c:3835:26: = error: expected ';' at end of declaration tree new_vec, vec_init, vec_step, t; ^ ; Well, it turns out that vec_step has the following potential naming conflicts, one for powerpc64 FreeBSD specifics, and one for clang specifics (for support of OpenCL). . . For powerpc64: /usr/src/contrib/gcc/config/rs6000/altivec.h:#define vec_step(x) = __builtin_vec_step (* (__typeof__ (x) *) 0) (I'm point the above out despite my clang-based context.) For clang: /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp:/// vec_step = and we are at the start of an expression or a parenthesized /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp:/// [OpenCL = 1.1 6.11.12] vec_step built-in function: /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp:/// = vec_step ( expressions ) /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp:/// = vec_step ( type-name ) /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp: "Not = a typeof/sizeof/alignof/vec_step expression!"); /usr/src/contrib/llvm/tools/clang/lib/Parse/ParseExpr.cpp: "Not = a sizeof/alignof/vec_step expression!"); /usr/src/contrib/llvm/tools/clang/lib/Sema/SemaExpr.cpp: // [OpenCL 1.1 = 6.11.12] "The vec_step built-in function takes a built-in /usr/src/contrib/llvm/tools/clang/lib/Sema/TreeTransform.h: /// \brief = Build a new sizeof, alignof or vec_step expression with a /usr/src/contrib/llvm/tools/clang/include/clang/AST/Expr.h:/// vec_step = (OpenCL 1.1 6.11.12). = /usr/src/contrib/llvm/tools/clang/include/clang/ASTMatchers/ASTMatchers.h:= /// \brief Matches sizeof (C99), alignof (C++11) and vec_step (OpenCL) = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "invalid application of '%select{sizeof|alignof|vec_step}0' to a " = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "invalid application of '%select{sizeof|alignof|vec_step}0' to a = void " = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "invalid application of = '%select{sizeof|alignof|vec_step|__builtin_omp_required_simd_align}0' to = a void type">; = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "invalid application of = '%select{sizeof|alignof|vec_step|__builtin_omp_required_simd_align}0' to = an " = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "invalid application of = '%select{sizeof|alignof|vec_step|__builtin_omp_required_simd_align}0' to = a " = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/DiagnosticSemaKinds.= td: "'vec_step' requires built-in scalar or vector type, %0 invalid">; = /usr/src/contrib/llvm/tools/clang/include/clang/Basic/TokenKinds.def:KEYWO= RD(vec_step , KEYOPENCL|KEYALTIVEC|KEYZVECTOR) (The lists were extracted from a: grep -r "\" /usr/src/* Some material was omitted from the reported matches.) Given the clang extension for having vec_step for OpenCL, it might be best if lang/gcc7 was updated to avoid the name (upstream as well). devel/llvm50 likely has the same vec_step as system-clang. I'm not sure about devel/llvm40 . This might be true of some other lang/gcc*'s: I just happen to build lang/gcc7 but not the others (generally). Context details: # uname -apKU FreeBSD FBSDG5L 12.0-CURRENT FreeBSD 12.0-CURRENT r326192M powerpc = powerpc64 1200054 1200054 # svnlite info /usr/ports/ | grep "Re[plv]" Relative URL: ^/head Repository Root: svn://svn0.us-west.freebsd.org/ports Repository UUID: 35697150-7ecd-e111-bb59-0022644237b5 Revision: 455204 Last Changed Rev: 455204 (Last before FLAVORS is enabled.) =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Fri Dec 8 12:59:11 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 0A286E82E97 for ; Fri, 8 Dec 2017 12:59:11 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id EC4DA7119E for ; Fri, 8 Dec 2017 12:59:10 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vB8CxA2P054300 for ; Fri, 8 Dec 2017 12:59:10 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-toolchain@FreeBSD.org Subject: [Bug 224174] cc: error: unable to execute command: segmentation fault Date: Fri, 08 Dec 2017 12:59:11 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: cem@freebsd.org X-Bugzilla-Status: New X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: freebsd-toolchain@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: cc assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Dec 2017 12:59:11 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D224174 Conrad Meyer changed: What |Removed |Added ---------------------------------------------------------------------------- CC| |cem@freebsd.org, | |dim@FreeBSD.org Assignee|freebsd-bugs@FreeBSD.org |freebsd-toolchain@FreeBSD.o | |rg --- Comment #1 from Conrad Meyer --- Clang 4.0.0 crash. Does the toolchain list own the compiler, or just as/ld etc? --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Fri Dec 8 16:15:19 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 4F8CEE8799A for ; Fri, 8 Dec 2017 16:15:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from kenobi.freebsd.org (kenobi.freebsd.org [IPv6:2001:1900:2254:206a::16:76]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 3D35B78D78 for ; Fri, 8 Dec 2017 16:15:19 +0000 (UTC) (envelope-from bugzilla-noreply@freebsd.org) Received: from bugs.freebsd.org ([127.0.1.118]) by kenobi.freebsd.org (8.15.2/8.15.2) with ESMTP id vB8GFJgv099168 for ; Fri, 8 Dec 2017 16:15:19 GMT (envelope-from bugzilla-noreply@freebsd.org) From: bugzilla-noreply@freebsd.org To: freebsd-toolchain@FreeBSD.org Subject: [Bug 224174] cc: error: unable to execute command: segmentation fault Date: Fri, 08 Dec 2017 16:15:19 +0000 X-Bugzilla-Reason: AssignedTo X-Bugzilla-Type: changed X-Bugzilla-Watch-Reason: None X-Bugzilla-Product: Base System X-Bugzilla-Component: bin X-Bugzilla-Version: 11.1-RELEASE X-Bugzilla-Keywords: X-Bugzilla-Severity: Affects Only Me X-Bugzilla-Who: dim@FreeBSD.org X-Bugzilla-Status: In Progress X-Bugzilla-Resolution: X-Bugzilla-Priority: --- X-Bugzilla-Assigned-To: dim@FreeBSD.org X-Bugzilla-Flags: X-Bugzilla-Changed-Fields: bug_status assigned_to Message-ID: In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable X-Bugzilla-URL: https://bugs.freebsd.org/bugzilla/ Auto-Submitted: auto-generated MIME-Version: 1.0 X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Dec 2017 16:15:19 -0000 https://bugs.freebsd.org/bugzilla/show_bug.cgi?id=3D224174 Dimitry Andric changed: What |Removed |Added ---------------------------------------------------------------------------- Status|New |In Progress Assignee|freebsd-toolchain@FreeBSD.o |dim@FreeBSD.org |rg | --- Comment #2 from Dimitry Andric --- All your test cases compile just fine for me, with both clang 4.0.0, 5.0.0 = and 5.0.1. Are these segfaults repeatable? If not, please test your hardware carefully, especially the RAM. --=20 You are receiving this mail because: You are the assignee for the bug.= From owner-freebsd-toolchain@freebsd.org Sat Dec 9 23:16:00 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 6D77EE9B548 for ; Sat, 9 Dec 2017 23:16:00 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-111.reflexion.net [208.70.210.111]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 1AA7A79673 for ; Sat, 9 Dec 2017 23:15:59 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 25751 invoked from network); 9 Dec 2017 23:15:53 -0000 Received: from unknown (HELO mail-cs-01.app.dca.reflexion.local) (10.81.19.1) by 0 (rfx-qmail) with SMTP; 9 Dec 2017 23:15:53 -0000 Received: by mail-cs-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Sat, 09 Dec 2017 18:15:53 -0500 (EST) Received: (qmail 5465 invoked from network); 9 Dec 2017 23:15:53 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 9 Dec 2017 23:15:53 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id AC08EEC91C1; Sat, 9 Dec 2017 15:15:52 -0800 (PST) From: Mark Millard Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: parallel_run start_builder and clonefs for UFS in ports-mgmt/poudriere-devel: avoiding elapsed-time spent in the getblk wait channel, sleep a little Message-Id: <2F45D0AB-79E8-44B8-9B3C-25B0FF012298@dsl-only.net> Date: Sat, 9 Dec 2017 15:15:52 -0800 To: Bryan Drewery , FreeBSD Toolchain X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Dec 2017 23:16:00 -0000 I've been experimenting with using devel/poudriere-devel in the contexts: rpi2, bpi-m3 (Cortex-A7's, 4 core effective, 1 GiByte and 2 GiByte RAM) rpi3, Pine64+ 2GB (Cortex-A53's, 4 core, 1 GiByte and 2 GiByte RAM) powerpc64 (32-bit) powerpc (so-called Quad-Core PowerMacs, 16GiBYte and = 2 GiByte effective RAM) amd64 (Ryzen Threadripper 16-core/32-thread-total, 128 GiByte RAM) As part of this even the large configurations are currently set up for UFS so that aspect is uniform. One thing that I've noted (using the amd64 context as an example) is a non-linear relationship between builders and starting/cloning time: [00:00:26] Building 47 packages using 4 builders [00:00:26] Starting/Cloning builders [00:00:32] Hit CTRL+t at any time to see build progress and stats [00:00:22] Building 49 packages using 14 builders [00:00:22] Starting/Cloning builders [00:05:07] Hit CTRL+t at any time to see build progress and stats [00:00:33] Building 38 packages using 29 builders [00:00:33] Starting/Cloning builders [00:17:22] Hit CTRL+t at any time to see build progress and stats Monitoring the longer running ones I see lots of: getblk=20 (Waiting to access file data that is being accessed by another thread) So I tried a crude form of staggering the cloning by adding a 1 second sleep in start_builders ( /usr/local/share/poudriere/common.sh ): start_builders() { local arch=3D$(injail uname -p) msg "Starting/Cloning builders" bset status "starting_jobs:" run_hook start_builders start bset builders "${JOBS}" bset status "starting_builders:" parallel_start for j in ${JOBS}; do parallel_run start_builder ${j} ${arch} sleep 1 done parallel_stop run_hook start_builders stop } The result for 14 was: [00:00:14] Building 23 packages using 14 builders [00:00:14] Starting/Cloning builders [00:00:53] Hit CTRL+t at any time to see build progress and stats For 23 (I no longer had more to build) the result was: [00:00:12] Building 23 packages using 23 builders [00:00:12] Starting/Cloning builders [00:04:49] Hit CTRL+t at any time to see build progress and stats Trying 5 seconds instead of 1 second for the sleep time: The result for 14 was: [00:00:12] Building 23 packages using 14 builders [00:00:12] Starting/Cloning builders [00:01:25] Hit CTRL+t at any time to see build progress and stats For 23 the result was: [00:00:12] Building 23 packages using 23 builders [00:00:12] Starting/Cloning builders [00:02:11] Hit CTRL+t at any time to see build progress and stats It appears that a few second sleep is of significant help for having lots of builders. =3D=3D=3D Mark Millard markmi at dsl-only.net From owner-freebsd-toolchain@freebsd.org Sat Dec 9 23:20:27 2017 Return-Path: Delivered-To: freebsd-toolchain@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 40524E9B6F7 for ; Sat, 9 Dec 2017 23:20:27 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: from asp.reflexion.net (outbound-mail-210-125.reflexion.net [208.70.210.125]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id DECB879983 for ; Sat, 9 Dec 2017 23:20:25 +0000 (UTC) (envelope-from markmi@dsl-only.net) Received: (qmail 21917 invoked from network); 9 Dec 2017 23:13:39 -0000 Received: from unknown (HELO rtc-sm-01.app.dca.reflexion.local) (10.81.150.1) by 0 (rfx-qmail) with SMTP; 9 Dec 2017 23:13:39 -0000 Received: by rtc-sm-01.app.dca.reflexion.local (Reflexion email security v8.40.3) with SMTP; Sat, 09 Dec 2017 18:13:39 -0500 (EST) Received: (qmail 25892 invoked from network); 9 Dec 2017 23:13:39 -0000 Received: from unknown (HELO iron2.pdx.net) (69.64.224.71) by 0 (rfx-qmail) with (AES256-SHA encrypted) SMTP; 9 Dec 2017 23:13:39 -0000 Received: from [192.168.1.25] (c-76-115-7-162.hsd1.or.comcast.net [76.115.7.162]) by iron2.pdx.net (Postfix) with ESMTPSA id 1E542EC953F; Sat, 9 Dec 2017 15:13:39 -0800 (PST) Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Mac OS X Mail 10.3 \(3273\)) Subject: Re: poudriere jail -c -j JNAME -m null -M PREBUILT-WORLD-PATH -S /usr/src -v 12.0-CURRENT complains about "DIrectory not empty" for PREBUILT-WORLD-PATH From: Mark Millard In-Reply-To: <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> Date: Sat, 9 Dec 2017 15:13:38 -0800 Cc: FreeBSD Toolchain , FreeBSD Ports Content-Transfer-Encoding: quoted-printable Message-Id: References: <225E5187-55F9-4BEA-907D-79E04B1FA4A1@dsl-only.net> <9f7e4ac6-7d0e-d21b-3fa5-33a2e5927546@FreeBSD.org> To: Bryan Drewery X-Mailer: Apple Mail (2.3273) X-BeenThere: freebsd-toolchain@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Maintenance of FreeBSD's integrated toolchain List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Dec 2017 23:20:27 -0000 On 2017-Dec-4, at 3:54 PM, Bryan Drewery = wrote: > On 12/3/2017 8:29 PM, Mark Millard wrote: >> Note: /usr/ports/ (and so poudriere-devel) as of -r425204=20 >> (poudriere-devel-3.2.99.20171129). >>=20 >> I expect that the below is from ports-mgmt/poudriere-=3Ddevel >> -r454996 and its: >>=20 >> - ports/jail -c NOZFS: Consider non-empty-already-existing-directory = a failure >>=20 >> where the change did not cover an explicit use of -m null also >> being involved to deliberately being using a pre-built >> world that is located via use of -M PATH . >>=20 >> [There is one other side note about a potential >> issue later below.] >=20 > This and the -S issue should both be fixed in > poudriere-devel-3.2.99.20171204_1 > I will release it to 3.2.3 later today. Please let me know if it works > for you. I finally am dedicating a non-trivial block of time to FreeBSD and updating my builds. As of /usr/ports/ -r455873 that I updated to, for devel/poudriere-devel the 2 issues are resolved for how I've been using poudriere. Thanks. =3D=3D=3D Mark Millard markmi at dsl-only.net