From owner-freebsd-current@FreeBSD.ORG Tue May 6 14:28:54 2014 Return-Path: Delivered-To: current@freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2001:1900:2254:206a::19:1]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by hub.freebsd.org (Postfix) with ESMTPS id BDDD61C4 for ; Tue, 6 May 2014 14:28:54 +0000 (UTC) Received: from mail-pa0-f54.google.com (mail-pa0-f54.google.com [209.85.220.54]) (using TLSv1 with cipher ECDHE-RSA-RC4-SHA (128/128 bits)) (Client CN "smtp.gmail.com", Issuer "Google Internet Authority G2" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 7DAC1890 for ; Tue, 6 May 2014 14:28:54 +0000 (UTC) Received: by mail-pa0-f54.google.com with SMTP id lf10so11253846pab.41 for ; Tue, 06 May 2014 07:28:47 -0700 (PDT) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:sender:content-type:mime-version:subject:from :in-reply-to:date:cc:message-id:references:to; bh=qjGlpeJotw0Q60EjiHhBFaIrRJn8oLzrNVdgXvvHLW0=; b=YThx0AjIBdpwD9ZptwpBzK5K2RSz6x9elsTxSGY47lSSViJDrhS1/zVg/HgLQkyHTZ O0zDGxGqI2f/lEsE/x0f9RfYr8GH9UOn2taxOMinro09XZKh8Ykw82bj+fx2p2t7/lKO ZGOicogmO0uKboDykY6BL3cSLua2EVhrPJjsGHdjyf69FPUWDba9IfpN0vPQ00NnPD1J ldV4h8T9NRPkm70o/lBTBEBHh8exKUIZAbJKBivD4XZz3uY0MmRJAAQVrTi1Y+DXFdCC 9ht69hnUUMeJYHbLLyT+QAonFtQLTkR376x0xaSB0PBt/1mCx9bBCPtbjf00O5zFBp9Q CoBg== X-Gm-Message-State: ALoCoQltmFBIz1Pbjc1QleNmusggqbO3Y554onXd1N8LAmI/UdSqtmirtZ0t6oN/aFsVDqrBbcQ/ X-Received: by 10.67.2.34 with SMTP id bl2mr6943412pad.58.1399386527695; Tue, 06 May 2014 07:28:47 -0700 (PDT) Received: from [10.64.26.239] (dc1-prod.netflix.com. [69.53.236.251]) by mx.google.com with ESMTPSA id nw13sm99885576pab.37.2014.05.06.07.28.46 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 06 May 2014 07:28:47 -0700 (PDT) Sender: Warner Losh Content-Type: multipart/signed; boundary="Apple-Mail=_CAA55270-FF1F-4D47-A2B6-EDC02749B69A"; protocol="application/pgp-signature"; micalg=pgp-sha512 Mime-Version: 1.0 (Mac OS X Mail 7.2 \(1874\)) Subject: Re: buildworld fails (missing /usr/share/mk/src.opts.mk) From: Warner Losh In-Reply-To: <5368ED8C.5040402@freebsd.org> Date: Tue, 6 May 2014 08:28:44 -0600 Message-Id: References: <5368B0C5.6040309@freebsd.org> <5368C675.1070700@freebsd.org> <5368D7F1.4040009@freebsd.org> <5368ED8C.5040402@freebsd.org> To: Stefan Esser X-Mailer: Apple Mail (2.1874) Cc: "current@freebsd.org" , Trond.Endrestol@fagskolen.gjovik.no X-BeenThere: freebsd-current@freebsd.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussions about the use of FreeBSD-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 06 May 2014 14:28:54 -0000 --Apple-Mail=_CAA55270-FF1F-4D47-A2B6-EDC02749B69A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=windows-1252 First off, thanks for looking into this. Build issues are no fun. :( On May 6, 2014, at 8:11 AM, Stefan Esser wrote: > Am 06.05.2014 15:18, schrieb Warner Losh: >>=20 >> On May 6, 2014, at 7:16 AM, Warner Losh wrote: >>=20 >>>=20 >>> On May 6, 2014, at 6:39 AM, Stefan Esser wrote: >>>=20 >>>> Am 06.05.2014 13:44, schrieb Trond Endrest=F8l: >>>>> On Tue, 6 May 2014 13:24+0200, Stefan Esser wrote: >>>>>> Am 06.05.2014 11:52, schrieb Stefan Esser: >>>>>>> Hi Warner, >>>>>>>=20 >>>>>>> as already reported by Jenkins, HEAD does not build. >>>>>>>=20 >>>>>>> Seems that this is caused by src.opts.mk missing in >>>>>>> /usr/share/mk during the cleandir phase. I guess this is >>>>>>> kind of a bootstrap issue - the definitions are looked up >>>>>>> in the installed base, not in the src tree - but did not >>>>>>> verify this assumption. >>>>>>>=20 >>>>>>> A work-around is to manually install src.opts.mk: >>>>>>>=20 >>>>>>> # make -C /usr/src/share/mk install >>>>>>>=20 >>>>>>> (which might deserve an UPDATING entry). Falling back on >>>>>>> the file in the src directory might be a better solution >>>>>>> ... >>>>>>>=20 >>>>>>> Regards, STefan >>>>>>=20 >>>>>> Following up to my earlier mail: >>>>>>=20 >>>>>> The diagnosis was wrong - the main Makefiles include >>>>>> src.opts.mk from the source directory. But two sub-ordinate >>>>>> Makefiles missed to include the new options file >>>>>> (sys/conf/kmod.mk and sys/modules/drm2/Makefile). >>>>>>=20 >>>>>> I committed a fix/work-around to stop the flood of >>>>>> tinderbox messages (r265433). >>>>>=20 >>>>> tinderbox still complains about usr.bin/bmake/Makefile.inc. >>>>=20 >>>> Hmmm, I managed to buildworld -HEAD after this patch, but it >>>> is possible, that I had src.opts.mk installed in /usr/share/mk >>>> when I started the build. >>>>=20 >>>> (I later deleted it, to be sure that the version in the source=20 >>>> directory was found and used when building modules, which the=20 >>>> commit actually fixed.) >>>>=20 >>>> I guess the remaining problem is caused by >>>>=20 >>>> .include "src.opts.mk" >>>>=20 >>>> in line 3 of src/usr.bin/bmake/Makefile.inc >>>>=20 >>>> Changing this line to read ".include " seems to >>>> fix it on my system. >>>>=20 >>>> --- usr.bin/bmake/Makefile.inc~ +++ usr.bin/bmake/Makefile.inc=20 >>>> @@ -1,6 +1,6 @@ # $FreeBSD$ >>>>=20 >>>> -.include "src.opts.mk" +.include This change I think actually is right. And it needs to be an =91sinclude=92= to support the fmake upgrade path, but I need to double check that can=92t be worked around in the environment. >>>> .if defined(.PARSEDIR) # make sure this is available to >>>> unit-tests/Makefile >>>>=20 >>>> It is possible, that the build will still fail at a latter >>>> stage, though (buildworld is still running). >>>>=20 >>>> I committed the above patch, since it gets buildworld through >>>> the bmake subdirectory at least (r265436). If buildworld fails >>>> again, then I'll commit any further missing fixes in one go. >>>> I'll know in some 20 minutes. >>>=20 >>> What is your source system? This is absolutely the wrong change, >>> and shouldn=92t be necessary at all. These changes survived a >>> universe run and a few build worlds on other systems. >=20 > I'm on a fresh -CURRENT (built the previous day) and with sources > as of r265439. OK. My current is a bit dated, so I=92ll spin up a new one. > I agree, that the change to bmake/Makefile.inc was wrong - though > it was needed to get a "make cleandir" working in that directory. Yea, I=92m trying to get one that works all the time=85 I think I have = it which should silence the tinderboxes=85 In hind sight, perhaps I should have pushed this in first thing this morning rather than last thing last night... >> >>=20 >> so I=92d like to know how to recreate it, since I didn=92t see this = in >> any of my testing over the last two weeks... >=20 > The tinderbox builds all fail in bmake, and while I changed > Makefile.inc to fix just that kind of problem on my system, it > may have worked by accident (because of a forgotten src.opts.mk > in /usr/share/mk - it had been installed by a previous attempt > to work around these problems). The initial bootstrap of bmake, or the later build of bmake? I was able to reproduce the former, but haven=92t seen the latter fail. > To recapitulate the order of events: >=20 > 1) make buildkernel failed due to 2 missing includes of > src.opts.mk. The affected files files were: >=20 > sys/conf/kmod.mk > sys/modules/drm2/Makefile >=20 > Adding an .include seems to have fixed this > problem. Maybe "src.opts.mk" would have been more correct, > but I checked without src.opts.mk in /usr/share/mk and the > file was found in src/share/mk. I=92ll look at these. I might have introduced the issues after I stopped building the 75 kernels in make universe after I made it through once. My bad... > 2) tinderbox still complained about the test for MK_SHARED_TOOLCHAIN > in bmake/Makefile.inc (I deleted the mails and thus cannot > easily quote the exact error message). I tried to fix this by > changing the include syntax in bmake/Makefile.inc, but have > just reverted this change. It made buildworld complete on my > system, but tinderbox complains loudly. I=92ll look at this as well... > A work-around for the second problem is to manually install > src.opts.mk in /usr/share/mk before attempting to build bmake. Yea, and we don=92t really want to do that. The other workaround is mentioned in updating=85 Setting MAKESYSPATH. I need to make sure my testing wasn=92t contaminated with this somehow. Warner --Apple-Mail=_CAA55270-FF1F-4D47-A2B6-EDC02749B69A Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename=signature.asc Content-Type: application/pgp-signature; name=signature.asc Content-Description: Message signed with OpenPGP using GPGMail -----BEGIN PGP SIGNATURE----- Comment: GPGTools - https://gpgtools.org iQIcBAEBCgAGBQJTaPGcAAoJEGwc0Sh9sBEATOkP/j+b92dFAsRMFOiaah0UzxuJ boNHenGift52ghmEdvuBKznyCE/s2ZRZzHP0Neu3zkCMW/sIj1wGD0QkyinZvPh4 PRNXprXd3fBfMRg94TMgKsYOsxUK/1v+b4wN/VJa4EuLz943k7GMA5rgWjPkkxBI nsdL1JYVSQ0j2iuClwNBr9PhiChp60NrjCXpWqrGSx8ZWbV2GNWSLrD8UXMbXVdU hoWwZEnAOcW1s4u5Vo1rJaO3TXi7e3sWKCwsyIGVMrbZ5fqFgo2fKNzlwey8kr1W pC8NtxHjzgEmsGsQHVolM7Q6zlxzFbfi30Oy6LrHNU23+KqZJQxM0Dl+LlHgdCF8 o84xCSRm70ieQoB+cbHTVc128nUaoUKFXW8XBH2Edb5yW68NcUlPqoWEq0mY1Xll HV6d2i5aCww7B1V7vrh+kO4VIXsONe9vJXGUW0Cd4++y+8mS6VOMLr/4pVPqcxDk z2ArFY8cw8AOcQ4so8qprleILLGSYLAnMwUXr4wkfT8LtJeyjGKEROKjT51SQevg a72ArwdM47H84xYhHmGyvOas6JsK5TpAwT4HPOMIa2V4lZDqCwsTb1EUph7eJlzp QeBw+frrtkbf32EOhoLZ1O32gRvbZoCuTt3DUZTPmbsormkWZdGUwJQqXAoYVV/d 7msfek/QNQ9cIXmV8IDA =ERjC -----END PGP SIGNATURE----- --Apple-Mail=_CAA55270-FF1F-4D47-A2B6-EDC02749B69A--