From owner-freebsd-arch@FreeBSD.ORG Sun Apr 5 00:49:58 2015 Return-Path: Delivered-To: freebsd-arch@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1.2 with cipher AECDH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id 8BBCF1CB; Sun, 5 Apr 2015 00:49:58 +0000 (UTC) Received: from relay.mailchannels.net (aso-006-i437.relay.mailchannels.net [23.91.64.118]) by mx1.freebsd.org (Postfix) with ESMTP id AE71A95A; Sun, 5 Apr 2015 00:49:57 +0000 (UTC) X-Sender-Id: duocircle|x-authuser|hippie Received: from smtp4.ore.mailhop.org (ip-10-229-11-165.us-west-2.compute.internal [10.229.11.165]) by relay.mailchannels.net (Postfix) with ESMTPA id 6159842C2; Sun, 5 Apr 2015 00:49:48 +0000 (UTC) X-Sender-Id: duocircle|x-authuser|hippie Received: from smtp4.ore.mailhop.org (smtp4.ore.mailhop.org [10.83.15.107]) (using TLSv1 with cipher DHE-RSA-AES256-SHA) by 0.0.0.0:2500 (trex/5.4.8); Sun, 05 Apr 2015 00:49:49 +0000 X-MC-Relay: Neutral X-MailChannels-SenderId: duocircle|x-authuser|hippie X-MailChannels-Auth-Id: duocircle X-MC-Loop-Signature: 1428194988475:4099112875 X-MC-Ingress-Time: 1428194988475 Received: from c-73-34-117-227.hsd1.co.comcast.net ([73.34.117.227] helo=ilsoft.org) by smtp4.ore.mailhop.org with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.82) (envelope-from ) id 1YeYl1-00008i-EP; Sun, 05 Apr 2015 00:49:47 +0000 Received: from revolution.hippie.lan (revolution.hippie.lan [172.22.42.240]) by ilsoft.org (8.14.9/8.14.9) with ESMTP id t350nkde069355; Sat, 4 Apr 2015 18:49:46 -0600 (MDT) (envelope-from ian@freebsd.org) X-Mail-Handler: DuoCircle Outbound SMTP X-Originating-IP: 73.34.117.227 X-Report-Abuse-To: abuse@duocircle.com (see https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information for abuse reporting information) X-MHO-User: U2FsdGVkX19ljUU3GS0qn4VTsKyGvj1g Message-ID: <1428194986.82583.149.camel@freebsd.org> Subject: Re: make universe failures? From: Ian Lepore To: Garrett Cooper Date: Sat, 04 Apr 2015 18:49:46 -0600 In-Reply-To: References: <310573CF-443F-47BA-9F96-630107A4BD52@gmail.com> <43D75544-1458-4AE1-BCC1-DC5DB5AB72DA@gmail.com> <1428194276.82583.144.camel@freebsd.org> Content-Type: text/plain; charset="iso-2022-jp" X-Mailer: Evolution 3.12.10 FreeBSD GNOME Team Port Mime-Version: 1.0 Content-Transfer-Encoding: 7bit X-AuthUser: hippie Cc: Adrian Chadd , "freebsd-arch@freebsd.org" X-BeenThere: freebsd-arch@freebsd.org X-Mailman-Version: 2.1.18-1 Precedence: list List-Id: Discussion related to FreeBSD architecture List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 05 Apr 2015 00:49:58 -0000 On Sat, 2015-04-04 at 17:41 -0700, Garrett Cooper wrote: > On Apr 4, 2015, at 17:37, Ian Lepore wrote: > > > On Sat, 2015-04-04 at 17:36 -0700, Garrett Cooper wrote: > >> On Apr 4, 2015, at 17:33, Adrian Chadd wrote: > >> > >>> On 4 April 2015 at 17:25, Garrett Cooper wrote: > >>>> On Apr 4, 2015, at 17:22, Adrian Chadd wrote: > >>>> > >>>>> On 4 April 2015 at 16:33, Garrett Cooper wrote: > >>>>>> On Apr 4, 2015, at 16:28, Adrian Chadd wrote: > >>>>>> > >>>>>>> Hi, > >>>>>>> > >>>>>>> cc -O -pipe -I/usr/home/adrian/work/freebsd/uverse/head/lib/libcrypt > >>>>>>> -std=gnu99 -Qunused-arguments > >>>>>>> -L/home/adrian/work/freebsd/uverse/obj/arm.arm/usr/home/adrian/work/freebsd/uverse/head/tmp/usr/lib/private > >>>>>>> -rpath /usr/lib/private -rpath /usr/lib/private -o crypt_tests > >>>>>>> crypt_tests.o /home/adrian/work/freebsd/uverse/obj/arm.arm/usr/home/adrian/work/freebsd/uverse/head/lib/atf/libatf-c/libatf-c.so > >>>>>>> -lcrypt > >>>>>>> cc: error: no such file or directory: > >>>>>>> '/home/adrian/work/freebsd/uverse/obj/arm.arm/usr/home/adrian/work/freebsd/uverse/head/lib/atf/libatf-c/libatf-c.so' > >>>>>>> > >>>>>>> .. this happens for make universe on at least amd64, arm and armeb. > >>>>>>> I'm still waiting for the others to (not) complete. > >>>>>> > >>>>>> Might be related to r280179 and r273449, but more info´s needed. Your src.conf for the build host and targets would be helpful. > >>>>>> Thanks! > >>>>> > >>>>> adrian@bruce:~/work/freebsd/uverse/head % cat /etc/make.conf > >>>>> cat: /etc/make.conf: No such file or directory > >>>>> adrian@bruce:~/work/freebsd/uverse/head % cat /etc/src.conf > >>>>> cat: /etc/src.conf: No such file or directory > >>>>> > >>>>> adrian@bruce:~/work/freebsd/uverse/head % env > >>>>> MAKEOBJDIRPREFIX=/home/adrian/work/freebsd/uverse/obj make -j2 > >>>>> universe JFLAG=-j8 > >>>>> > >>>>> Thanks for replying so quickly! > >>>> > >>>> -j2 and JFLAG probably isn´t the best idea in the world. JFLAG should be ok... > >>> > >>> Why not? > >> > >> Based on personal experience, parallelizing on two levels just seems like a bad idea, especially with recursive make and when dealing with .PHONY targets. I haven´t followed through the logic exactly to know where it falls apart, but I know I always run into issues when I use -j instead of JFLAG for specifying -j. > >> Cheers, > > > > Strange. I've never heard of JFLAG and have only ever used -j > > JFLAG’s a make tinderbox/universe thing. -j would build multiple universe targets in parallel with up to -j jobs each. > > Again, I don’t know where and why things fall apart… it’s just that running multiple universes for me -j tends to get me in trouble. I’d have to go through and audit uses of ${.OBJDIR} to get a better idea of why things fail... > > HTH! Maybe the j*j thing happened with fmake, I vaguely remember that. With bmake the -j value propagates in some magic way so that even though you're building arches in parallel, the total number of jobs is the -j value (which you can see pretty clearly in top, after a few minutes the load averages pretty much lock onto the -j value plus some fraction). I've never had any problems with objdir stuff building all the arches in parallel at any value for -j (but I typically never use numbers higher than 14 unless I'm testing build stuff). -- Ian