From owner-freebsd-current@freebsd.org Tue Mar 6 19:43:23 2018 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 9D66FF27832 for ; Tue, 6 Mar 2018 19:43:23 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from freefall.freebsd.org (freefall.freebsd.org [IPv6:2610:1c1:1:6074::16:84]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "freefall.freebsd.org", Issuer "Let's Encrypt Authority X3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 453F9871A1 for ; Tue, 6 Mar 2018 19:43:23 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (unknown [127.0.1.132]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by freefall.freebsd.org (Postfix) with ESMTPS id CDED118B9F for ; Tue, 6 Mar 2018 19:43:22 +0000 (UTC) (envelope-from bdrewery@FreeBSD.org) Received: from mail.xzibition.com (localhost [172.31.3.2]) by mail.xzibition.com (Postfix) with ESMTP id E220317D for ; Tue, 6 Mar 2018 19:43:21 +0000 (UTC) X-Virus-Scanned: amavisd-new at mail.xzibition.com Received: from mail.xzibition.com ([172.31.3.2]) by mail.xzibition.com (mail.xzibition.com [172.31.3.2]) (amavisd-new, port 10026) with LMTP id WKUQ_J-mJcFZ for ; Tue, 6 Mar 2018 19:43:18 +0000 (UTC) Subject: Re: Possible race in buildworld, @r330236 -> @r330274 DKIM-Filter: OpenDKIM Filter v2.10.3 mail.xzibition.com E3012178 To: freebsd-current@freebsd.org References: <20180302130244.GI1144@albert.catwhisker.org> From: Bryan Drewery Openpgp: id=F9173CB2C3AAEA7A5C8A1F0935D771BB6E4697CF; url=http://www.shatow.net/bryan/bryan2.asc Organization: FreeBSD Message-ID: <702c0a01-a583-3a1d-013e-1bfaabd67388@FreeBSD.org> Date: Tue, 6 Mar 2018 11:43:19 -0800 User-Agent: Mozilla/5.0 (Windows NT 10.0; WOW64; rv:52.0) Gecko/20100101 Thunderbird/52.6.0 MIME-Version: 1.0 In-Reply-To: <20180302130244.GI1144@albert.catwhisker.org> Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="FzLs8T1YzFr2FrPmYYiLfRNVjLGgSj5lV" X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.25 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 Mar 2018 19:43:23 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --FzLs8T1YzFr2FrPmYYiLfRNVjLGgSj5lV Content-Type: multipart/mixed; boundary="548mgvBWiFfFEycErBkfCMLPLo342H6ED"; protected-headers="v1" From: Bryan Drewery To: freebsd-current@freebsd.org Message-ID: <702c0a01-a583-3a1d-013e-1bfaabd67388@FreeBSD.org> Subject: Re: Possible race in buildworld, @r330236 -> @r330274 References: <20180302130244.GI1144@albert.catwhisker.org> In-Reply-To: <20180302130244.GI1144@albert.catwhisker.org> --548mgvBWiFfFEycErBkfCMLPLo342H6ED Content-Type: text/plain; charset=windows-1252 Content-Language: en-US Content-Transfer-Encoding: quoted-printable On 3/2/2018 5:02 AM, David Wolfskill wrote: > On the two machines where I track head daily, I had failures during > "make buildworld" ... in different places on the two machines; re-tryin= g > the build succeeded (in each case). >=20 > Lately, I have (also) been tracking head on these machines with > /etc/src.conf augmented with: >=20 > # For Lua loader experiments > WITHOUT_FORTH=3Dyes > WITH_LOADER_LUA=3Dyes >=20 >=20 > (on a separate slice, so each machine is booted to that environment and= > an upgrade-in-place build is done). Curiously, no failures were > observed in the case where he Lua loader is being used & built. (I am > explicitly NOT claiming any causal relationship here.) >=20 > I have copied the build typescripts for each combination of machine > and boot loader, together with the associated /etc/make.conf, > src.conf, and src-env.conf for each to my Web server. The build > typescripts also have compressed copies -- the Web server is on the > "consumer" end of a residential ADSL: it works, but it's not fast. >=20 > For the above-cited material, please see > ; here's > what's there: >=20 > albert(11.1-S)[9] ls -lhRT > total 1 > drwxr-xr-x 4 david staff 4B Mar 2 04:36:15 2018 Forth > drwxr-xr-x 4 david staff 4B Mar 2 04:36:15 2018 Lua >=20 > ./Forth: > total 33 > drwxr-xr-x 2 david staff 7B Mar 2 04:49:55 2018 freebeast > drwxr-xr-x 2 david staff 7B Mar 2 04:49:57 2018 laptop >=20 > ./Forth/freebeast: > total 1609 > -rw-r--r-- 1 david staff 5.4M Mar 2 04:11:28 2018 build.txt > -rw-r--r-- 1 david staff 351K Mar 2 04:11:28 2018 build.txt.bz2 > -r--r--r-- 1 david staff 108B Feb 4 10:01:28 2014 make.conf > -r--r--r-- 1 david staff 19B May 24 10:28:11 2017 src-env.conf > -r--r--r-- 1 david staff 48B Mar 22 04:35:38 2016 src.conf >=20 > ./Forth/laptop: > total 1865 > -rw-r--r-- 1 david staff 6.1M Mar 2 04:11:29 2018 build.txt > -rw-r--r-- 1 david staff 403K Mar 2 04:11:29 2018 build.txt.bz2 > -r--r--r-- 1 david staff 503B Jul 30 03:55:27 2017 make.conf > -r--r--r-- 1 david staff 19B May 30 04:15:48 2016 src-env.conf > -r--r--r-- 1 david staff 197B Jul 8 02:58:12 2017 src.conf >=20 > ./Lua: > total 33 > drwxr-xr-x 2 david staff 7B Mar 2 04:49:59 2018 freebeast > drwxr-xr-x 2 david staff 7B Mar 2 04:50:00 2018 laptop >=20 > ./Lua/freebeast: > total 1529 > -rw-r--r-- 1 david staff 5.1M Mar 2 04:37:38 2018 build.txt > -rw-r--r-- 1 david staff 337K Mar 2 04:37:38 2018 build.txt.bz2 > -r--r--r-- 1 david staff 108B Feb 4 10:01:28 2014 make.conf > -r--r--r-- 1 david staff 19B May 24 10:28:11 2017 src-env.conf > -r--r--r-- 1 david staff 115B Feb 13 05:39:36 2018 src.conf >=20 > ./Lua/laptop: > total 1545 > -rw-r--r-- 1 david staff 5.1M Mar 2 04:28:53 2018 build.txt > -rw-r--r-- 1 david staff 341K Mar 2 04:28:53 2018 build.txt.bz2 > -r--r--r-- 1 david staff 503B Jul 30 03:55:27 2017 make.conf > -r--r--r-- 1 david staff 19B May 30 04:15:48 2016 src-env.conf > -r--r--r-- 1 david staff 264B Feb 13 06:09:49 2018 src.conf > albert(11.1-S)[10]=20 >=20 >=20 > (Files were copied with -p; I thought having timestamps that showed whe= n > they actually were last modified make be of some use.) >=20 > Peace, > david >=20 http://www.catwhisker.org/~david/FreeBSD/head/race@r330274/Forth/freebeas= t/build.txt > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: unable to fin= d library -lgcc_s > --- kerberos5/lib/libroken__L --- > Building /common/S4/obj/usr/src/amd64.amd64/kerberos5/lib/libroken/vis.= pico > --- secure/lib/libcrypto__L --- > cc: error: linker command failed with exit code 1 (use -v to see invoca= tion) > *** [libgost.so] Error code 1 >=20 > make[6]: stopped in /usr/src/secure/lib/libcrypto/engines/libgost Looks like the existing -lgcc_s race I know about already. It comes down to tools/install.sh not supporting -S properly. http://www.catwhisker.org/~david/FreeBSD/head/race@r330274/Forth/laptop/b= uild.txt No clue about this one though... > Building /common/S4/obj/usr/src/amd64.amd64/obj-lib32/kerberos5/lib/lib= gssapi_krb5/arcfour.po > --- lib__L --- > sh /usr/src/tools/install.sh -l s ../numeric /common/S4/obj/usr/src/am= d64.amd64/obj-lib32/tmp/usr/include/c++/v1/tr1/numeric > --- cddl/lib__L --- > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: __stack_chk_guard in readonly= segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libc.so.7 >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against local symbol in readonly segment; rec= ompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_128 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_128 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_128 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_128 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_160 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_160 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_160 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_160 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: .LCPI0_0 in readonly segment;= recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_PC32 against symbol: Skein_256_Process_Block in = readonly segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein_block.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_224 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_224 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_224 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_224 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_256 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_256 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_256 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: can't create = dynamic relocation R_386_32 against symbol: SKEIN_256_IV_256 in readonly = segment; recompile object files with -fPIC >>>> defined in /common/S4/obj/usr/src/amd64.amd64/obj-lib32/tmp/usr/lib3= 2/libmd.a(skein.o) >>>> referenced by skein.c >>>> skein.o:(Skein_256_Init) in archive /common/S4/obj/usr= /src/amd64.amd64/obj-lib32/tmp/usr/lib32/libmd.a >=20 > /common/S4/obj/usr/src/amd64.amd64/tmp/usr/bin/ld: error: too many erro= rs emitted, stopping now (use -error-limit=3D0 to see all errors) > --- lib__L --- > --- realinstall_subdir_lib/libopenbsd --- > =3D=3D=3D> lib/libopenbsd (install) > --- kerberos5/lib__L --- > Building /common/S4/obj/usr/src/amd64.amd64/obj-lib32/kerberos5/lib/lib= gssapi_krb5/authorize_localname.po > --- cddl/lib__L --- > cc: error: linker command failed with exit code 1 (use -v to see invoca= tion) > --- lib__L --- > --- realinstall_subdir_lib/libnv --- > Building /common/S4/obj/usr/src/amd64.amd64/obj-lib32/lib/libnv/_libins= tall > --- realinstall_subdir_lib/libc++ --- > sh /usr/src/tools/install.sh -l s ../optional /common/S4/obj/usr/src/a= md64.amd64/obj-lib32/tmp/usr/include/c++/v1/tr1/optional > --- cddl/lib__L --- > *** [libzpool.so.2] Error code 1 >=20 --=20 Regards, Bryan Drewery --548mgvBWiFfFEycErBkfCMLPLo342H6ED-- --FzLs8T1YzFr2FrPmYYiLfRNVjLGgSj5lV Content-Type: application/pgp-signature; name="signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="signature.asc" -----BEGIN PGP SIGNATURE----- Version: GnuPG v2 iQEcBAEBAgAGBQJanu9XAAoJEDXXcbtuRpfPPNMIAKL54Y+BUIl9wUfEWJKMkppl 47g1Iv3xAmrhHOsFtAHYkoo6gELlnY1nU1MHfTQLq+ZxNgmKx8G16+UKKXPNovHa AFRvzsG7bdSCU/u6FIR9Fo/wSyZAxT7Zp30FhwpRMJDfZUoBZU8320AstEsdFK+L f275cEPR/Zzc9KuOMINK/aL+Z1UaEwrp/OBowZ3vtL9h5jcBjGDDvyjsaqNAfi34 T3lpeq+hv2NQEyKrjEerb2stlrHPZFEuNws/FPCpwY+4BLYMkms+SGFZf1UKSQTi IAmaFb1+7oDGnoOWBuTBscTWvPJ9Bp22GnOXnlY3INZFfPRxe0I1biQZABpnJYY= =au1V -----END PGP SIGNATURE----- --FzLs8T1YzFr2FrPmYYiLfRNVjLGgSj5lV--