From owner-freebsd-current@freebsd.org Sun May 19 23:53:24 2019 Return-Path: Delivered-To: freebsd-current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 584F11595E34 for ; Sun, 19 May 2019 23:53:24 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from mailman.ysv.freebsd.org (mailman.ysv.freebsd.org [IPv6:2001:1900:2254:206a::50:5]) by mx1.freebsd.org (Postfix) with ESMTP id C89CE82DF2 for ; Sun, 19 May 2019 23:53:23 +0000 (UTC) (envelope-from jhs@berklix.com) Received: by mailman.ysv.freebsd.org (Postfix) id 842E71595E32; Sun, 19 May 2019 23:53:23 +0000 (UTC) Delivered-To: current@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id 434671595E30 for ; Sun, 19 May 2019 23:53:23 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from slim.berklix.org (slim.berklix.org [94.185.90.68]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "slim.berklix.org", Issuer "slim.berklix.org" (not verified)) by mx1.freebsd.org (Postfix) with ESMTPS id 5055E82DEE; Sun, 19 May 2019 23:53:19 +0000 (UTC) (envelope-from jhs@berklix.com) Received: from mart.js.berklix.net (p2E52CF95.dip0.t-ipconnect.de [46.82.207.149]) (authenticated bits=128) by slim.berklix.org (8.15.2/8.15.2) with ESMTPSA id x4JNrCft071350 (version=TLSv1 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Mon, 20 May 2019 01:53:17 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (fire.js.berklix.net [192.168.91.41]) by mart.js.berklix.net (8.14.3/8.14.3) with ESMTP id x4JNrBdJ009529; Mon, 20 May 2019 01:53:11 +0200 (CEST) (envelope-from jhs@berklix.com) Received: from fire.js.berklix.net (localhost [127.0.0.1]) by fire.js.berklix.net (8.14.7/8.14.7) with ESMTP id x4JNr0lA014165; Mon, 20 May 2019 01:53:12 +0200 (CEST) (envelope-from jhs@berklix.com) Message-Id: <201905192353.x4JNr0lA014165@fire.js.berklix.net> To: Dimitry Andric cc: current@FreeBSD.org, Li-Wen Hsu Subject: Re: lib/libgcc_s fails on make all after make world succeeds From: "Julian H. Stacey" Organization: http://berklix.com/jhs http://stolenvotes.uk User-agent: EXMH on FreeBSD http://berklix.com/free/ X-From: http://www.berklix.org/~jhs/ In-reply-to: Your message "Sun, 19 May 2019 23:54:18 +0200." <0A149CA1-508B-41C3-BBA3-B4F6E0A416C5@FreeBSD.org> Date: Mon, 20 May 2019 01:53:00 +0200 X-Rspamd-Queue-Id: 5055E82DEE X-Spamd-Bar: ++ Authentication-Results: mx1.freebsd.org X-Spamd-Result: default: False [2.93 / 15.00]; ARC_NA(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; DMARC_NA(0.00)[berklix.com]; AUTH_NA(1.00)[]; NEURAL_SPAM_MEDIUM(0.50)[0.498,0]; NEURAL_SPAM_SHORT(0.85)[0.846,0]; HAS_ORG_HEADER(0.00)[]; RCVD_COUNT_THREE(0.00)[4]; IP_SCORE(0.14)[ip: (0.51), ipnet: 94.185.88.0/22(0.25), asn: 33824(-0.06), country: DE(-0.01)]; MX_GOOD(-0.01)[cached: slim.berklix.com]; NEURAL_SPAM_LONG(0.56)[0.560,0]; RCVD_IN_DNSWL_NONE(0.00)[68.90.185.94.list.dnswl.org : 127.0.10.0]; R_SPF_NA(0.00)[]; RECEIVED_SPAMHAUS_PBL(0.00)[149.207.82.46.zen.spamhaus.org : 127.0.0.10]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:33824, ipnet:94.185.88.0/22, country:DE]; RCVD_TLS_LAST(0.00)[]; FROM_EQ_ENVFROM(0.00)[] X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 19 May 2019 23:53:24 -0000 > On 19 May 2019, at 23:29, Julian H. Stacey wrote: > > > > Hi current@freebsd.org > > On current src/ on 2 boxes, I have seen the same break for a week or 2, > > lib/libgcc_s fails on make all after make world succeeds, > > Anyone else seen it or got ideas please ? Notes below the sample. > > > > ===> lib/libgcc_s (all) > > building shared library libgcc_s.so.1 > > cc -nodefaultlibs -Wl,--version-script=/usr/src/lib/libgcc_s/Version.map > > -shared -Wl,-x -Wl,--fatal-warnings -Wl,--warn-shared-textrel -o \ > > libgcc_s.so.1.full -Wl,-soname,libgcc_s.so.1 > ... > > -L/usr/obj/usr/src/amd64.amd64/lib/libc -lc \ > > ld: error: can't create dynamic relocation R_X86_64_32S \ > > against symbol: __je_sz_size2index_tab in readonly segment; \ > > recompile object files with -fPIC or pass '-Wl,-z,notext' \ > > to allow text relocations in the output > >>>> defined in /usr/obj/usr/src/amd64.amd64/lib/libc/libc.a(jemalloc_sz.o) > > It looks like for some reason, it chooses to link with libc.a instead of > libc.so here. Maybe your libc.so is not getting built at all, because > of your environment? I've removed my environment variables & src.conf & make.conf, & new test running. > Or maybe you are hitting some build race where libc.a is done, but > libc.so is still being built, while at the same time, libgcc_s.so.1 is > being linked? > > There are some difficult-to-reproduce races with libgcc_s, which are > sometimes also hit by CI (I think Li-Wen mentioned them multiple times > now). But usually I would expect this to be "solved" by simply > re-running buildworld, as the race window is very small, and you have > to be quite lucky (or unlucky, depending on your point of view :) to hit > it. > > -Dimitry Thanks Dimitry, I'll re-read & consider but re. Race conditions, I hadnt thought of that. I never use make [-j max_jobs] and ls -l ~jhs/.MAKE.JOBS ~root/.MAKE.JOBS # shows nothing cd /usr/share/mk ; grep '\-j' * bsd.cpu.mk:_CPUCFLAGS = -march=i686 -falign-functions=0 -falign-jumps=0 -falign-loops=0 bsd.info.mk:.if !empty(.MAKEFLAGS:M-j) bsd.suffixes.mk:# XXX not -j safe bsd.suffixes.mk:# XXX not -j safe bsd.suffixes.mk:# XXX not -j safe gendirdeps.mk: echo '# local dependencies - needed for -jN in clean tree'; \ meta.stage.mk:# for non-jobs mode the order here matters cd /usr/src; grep '\-j' * Makefile:# make universe -DMAKE_JUST_KERNELS JFLAG=-j${_jflag} Makefile.inc1: echo "ncpu: $$(sysctl -n hw.ncpu)${.MAKE.JOBS:S/^/, make -j/}" Makefile.inc1:.if ${.MAKEFLAGS:M-j} Makefile.inc1:.error The buildenv target is incompatible with -j Makefile.inc1: echo "ncpu: $$(sysctl -n hw.ncpu)${.MAKE.JOBS:S/^/, make -j/}" Makefile.inc1: ${MAKE} -f Makefile.inc1 create-world-packages-jobs \ Makefile.inc1:.if make(create-world-packages-jobs) Makefile.inc1:create-world-packages-jobs: .PHONY Makefile.inc1:create-world-packages-jobs: create-world-package-${pkgname} UPDATING: Avoid using make -j when upgrading. While generally safe, there are UPDATING: sometimes problems using -j to upgrade. If your upgrade fails with UPDATING: -j, please try again without -j. From time to time in the past there UPDATING: have been problems using -j with buildworld and/or installworld. This My 2 current hosts are old, a lot slower than I guess most developers use: ------- FreeBSD 13.0-CURRENT #14033: Sat May 11 18:48:02 CEST 2019 jhs@blak.js.berklix.net:/usr/src/sys/amd64/compile/BLAK.small amd64 FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) VT(vga): resolution 640x480 CPU: Intel(R) Core(TM)2 Duo CPU E6850 @ 3.00GHz (3000.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x6fb Family=0x6 Model=0xf Stepping=11 Features=0xbfebfbff Features2=0xe3fd AMD Features=0x20100800 AMD Features2=0x1 VT-x: HLT,PAUSE TSC: P-state invariant, performance statistics real memory = 4294967296 (4096 MB) avail memory = 4096159744 (3906 MB) Event timer "LAPIC" quality 100 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) __stack_chk_init: WARNING: Initializing stack protection with non-random cookies! __stack_chk_init: WARNING: This severely limits the benefit of -fstack-protector! ioapic0: Changing APIC ID to 2 ------- FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 13.0-CURRENT #14033: Sat May 11 18:56:03 CEST 2019 jhs@lapr.js.berklix.net:/usr/src/sys/amd64/compile/LAPR.small amd64 FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0) VT(vga): resolution 640x480 module urndis already present! module_register: cannot register pccard/wi from kernel; already loaded from if_wi.ko Module pccard/wi failed to register: 17 module_register: cannot register pci/wi from kernel; already loaded from if_wi.ko Module pci/wi failed to register: 17 CPU: Intel(R) Core(TM) i3 CPU M 330 @ 2.13GHz (2128.42-MHz K8-class CPU) Origin="GenuineIntel" Id=0x20652 Family=0x6 Model=0x25 Stepping=2 Features=0xbfebfbff Features2=0x98e3bd AMD Features=0x28100800 AMD Features2=0x1 VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID TSC: P-state invariant, performance statistics real memory = 3221225472 (3072 MB) avail memory = 2775531520 (2646 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 hardware threads __stack_chk_init: WARNING: Initializing stack protection with non-random cookies! __stack_chk_init: WARNING: This severely limits the benefit of -fstack-protector! ioapic0: Changing APIC ID to 2 ------- Cheers, Julian -- Julian Stacey, Consultant Systems Engineer, BSD Linux Unix, Munich Aachen Kent http://stolenvotes.uk Brexit ref. stole votes from 700,000 Brits in EU. Lies bought; Groups fined; 1.9 M young had no vote, 1.3 M old leavers died.