From owner-freebsd-stable@freebsd.org Sun Feb 28 14:51:26 2021 Return-Path: Delivered-To: freebsd-stable@mailman.nyi.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.nyi.freebsd.org (Postfix) with ESMTP id 19E4056D653 for ; Sun, 28 Feb 2021 14:51:26 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from plan-b.pwste.edu.pl (plan-b.pwste.edu.pl [IPv6:2001:678:618::40]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client CN "plan-b.pwste.edu.pl", Issuer "R3" (verified OK)) by mx1.freebsd.org (Postfix) with ESMTPS id 4DpRDF0VrDz3vvM; Sun, 28 Feb 2021 14:51:24 +0000 (UTC) (envelope-from zarychtam@plan-b.pwste.edu.pl) Received: from fomalhaut.potoki.eu ([IPv6:2001:470:71:d47:6163:a1eb:8b2:886f]) (authenticated bits=0) by plan-b.pwste.edu.pl (8.16.1/8.16.1) with ESMTPSA id 11SEpBpo080187 (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128 verify=NO); Sun, 28 Feb 2021 15:51:12 +0100 (CET) (envelope-from zarychtam@plan-b.pwste.edu.pl) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=plan-b.pwste.edu.pl; s=plan-b-mailer; t=1614523872; bh=957I5w2XxArO2HpyYtTnsrvNpO/OwVWBpv9XSSKk1Ho=; h=To:Cc:References:From:Subject:Date:In-Reply-To; b=LvUGTULWHyhiCEG88ffwUKcZ2A8z7nUkttfcyvBCFoUxKWzoyzPImL+X+7z5wdX9h MJrniLqZDLpxvlJDyKxESuTvi5v6rIbqlJbjdZ34OhJeAWbhfjVNAFPbbsAQ09ufVf wa0JHCov+Q6kU1B4oK4BCju+iMIVy6McmgaXmD7qHyyueri3ND2UuhqEjnXzeUxhLz Lgs+WC6qr53oUAyAP3maHVhUodjQN+hD9pj4TK31DTKeGxxRwAbLQSHsoxQLNSKXm7 KDa7eQfPJjhbZbvnQcWNFdcsM1BPSoPt4P2dCrJ6mkjQTIhJ9qjyY1txjBs8Tay/dt cCVOVSw93eoQg== X-Authentication-Warning: plan-b.pwste.edu.pl: Host [IPv6:2001:470:71:d47:6163:a1eb:8b2:886f] claimed to be fomalhaut.potoki.eu To: Kyle Evans , dweimer@dweimer.net Cc: FreeBSD Stable References: <909bf509b35ec1cda7b70c749edc6b75@dweimer.net> <0b5141137f69e2f86dd49edd4ffd1e78@dweimer.net> From: Marek Zarychta Subject: Re: 13-BETA3 installation from source problems. Message-ID: Date: Sun, 28 Feb 2021 15:51:10 +0100 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:78.0) Gecko/20100101 Thunderbird/78.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: multipart/signed; micalg=pgp-sha256; protocol="application/pgp-signature"; boundary="s08WJf0qWT3uRP4AO9WFd20vxNB01MP7Y" X-Rspamd-Queue-Id: 4DpRDF0VrDz3vvM X-Spamd-Bar: ------- Authentication-Results: mx1.freebsd.org; dkim=pass header.d=plan-b.pwste.edu.pl header.s=plan-b-mailer header.b=LvUGTULW; dmarc=pass (policy=none) header.from=plan-b.pwste.edu.pl; spf=none (mx1.freebsd.org: domain of zarychtam@plan-b.pwste.edu.pl has no SPF policy when checking 2001:678:618::40) smtp.mailfrom=zarychtam@plan-b.pwste.edu.pl X-Spamd-Result: default: False [-7.90 / 15.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; TO_DN_SOME(0.00)[]; HAS_ATTACHMENT(0.00)[]; HAS_XAW(0.00)[]; DKIM_TRACE(0.00)[plan-b.pwste.edu.pl:+]; DMARC_POLICY_ALLOW(-0.50)[plan-b.pwste.edu.pl,none]; NEURAL_HAM_SHORT(-1.00)[-1.000]; SIGNED_PGP(-2.00)[]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~]; RBL_DBL_DONT_QUERY_IPS(0.00)[2001:678:618::40:from]; ASN(0.00)[asn:206006, ipnet:2001:678:618::/48, country:PL]; MID_RHS_MATCH_FROM(0.00)[]; ARC_NA(0.00)[]; NEURAL_HAM_MEDIUM(-1.00)[-1.000]; R_DKIM_ALLOW(-0.20)[plan-b.pwste.edu.pl:s=plan-b-mailer]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[3]; DWL_DNSWL_MED(-2.00)[pwste.edu.pl:dkim]; NEURAL_HAM_LONG(-1.00)[-1.000]; MIME_GOOD(-0.20)[multipart/signed,multipart/mixed,text/plain]; SPAMHAUS_ZRD(0.00)[2001:678:618::40:from:127.0.2.255]; TO_MATCH_ENVRCPT_SOME(0.00)[]; R_SPF_NA(0.00)[no SPF record]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MAILMAN_DEST(0.00)[freebsd-stable] X-BeenThere: freebsd-stable@freebsd.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: Production branch of FreeBSD source code List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 28 Feb 2021 14:51:26 -0000 This is an OpenPGP/MIME signed message (RFC 4880 and 3156) --s08WJf0qWT3uRP4AO9WFd20vxNB01MP7Y Content-Type: multipart/mixed; boundary="CFXMKMv3D9ATwoUfc6NThZEA5v1RkDvFq"; protected-headers="v1" From: Marek Zarychta To: Kyle Evans , dweimer@dweimer.net Cc: FreeBSD Stable Message-ID: Subject: Re: 13-BETA3 installation from source problems. References: <909bf509b35ec1cda7b70c749edc6b75@dweimer.net> <0b5141137f69e2f86dd49edd4ffd1e78@dweimer.net> In-Reply-To: --CFXMKMv3D9ATwoUfc6NThZEA5v1RkDvFq Content-Type: text/plain; charset=utf-8 Content-Language: pl Content-Transfer-Encoding: quoted-printable W dniu 24.02.2021 o=C2=A020:03, Kyle Evans pisze: > On Wed, Feb 24, 2021 at 12:57 PM Dean E. Weimer w= rote: >> >> On 2021-02-23 12:34 pm, Kyle Evans wrote: >>> The more I look at `make -dm` output, the less sense it makes. Your >>> patch is decidedly correct regardless of how this specific scenario i= s >>> playing out: >>> >>> 1.) As you noted, it's wrong to clean something that's built >>> elsewhere. You can reasonably expect `make clean all` to work pretty >>> much everywhere else. >>> >>> 2.) i386/loader cannot make an informed decision about whether it's >>> out-of-date, which is sufficient to tell that the existing addition t= o >>> OBJS was not the correct implementation in hindsight. >>> >>> 3.) The failure mode if it's *missing* is exactly the same before and= >>> after your patch; file can't be found, cannot build it. >>> >>> On Tue, Feb 23, 2021 at 12:09 PM Warner Losh wrote: >>>> >>>> I'm unsure of the mechanics as well. I do know that we shouldn't >>>> delete stuff in OTHER directories, though. the btx stuff is trying t= o >>>> do a bit of an end run around the link only with the installed stuff= >>>> here and using crt0.o as a library from the 'where it was built' >>>> directory which I think creates one too many dependencies... I've no= t >>>> yet puzzled through all of them to find out which one is causing us = to >>>> think we need to rebuild though. >>>> >>>> Warner >>>> >>>> On Tue, Feb 23, 2021 at 9:21 AM Kyle Evans wrot= e: >>>>> >>>>> Hi, >>>>> >>>>> What I don't understand here is, why are these being considered >>>>> out-of-date? That seems like it is indicative of a larger problem >>>>> that >>>>> we'd surely fall over elsewhere on if not for here, that the source= >>>>> tree's timestamps are post-dated w.r.t. the objdir. >>>>> >>>>> Thanks, >>>>> >>>>> Kyle Evans >>>>> >>>>> On Mon, Feb 22, 2021 at 5:52 PM Warner Losh wrote:= >>>>>> >>>>>> What does this patch do for you? >>>>>> >>>>>> diff --git a/stand/i386/loader/Makefile b/stand/i386/loader/Makefi= le >>>>>> index ad95948ec50a..cbbe15bd1fc0 100644 >>>>>> --- a/stand/i386/loader/Makefile >>>>>> +++ b/stand/i386/loader/Makefile >>>>>> @@ -90,7 +90,8 @@ FILES+=3D ${LOADER} >>>>>> FILESMODE_${LOADER}=3D ${BINMODE} -b >>>>>> >>>>>> # XXX crt0.o needs to be first for pxeboot(8) to work >>>>>> -OBJS=3D ${BTXCRT} >>>>>> +# Can't add it to OBJS w/o pain and suffering >>>>>> +LDFLAGS+=3D ${BTXCRT} >>>>>> >>>>>> DPADD=3D ${LDR_INTERP32} ${LIBFIREWIRE} ${LIBI386} ${LIBSA32} >>>>>> LDADD=3D ${LDR_INTERP32} ${LIBFIREWIRE} ${LIBI386} ${LIBSA32} >>>>>> >>>>>> Anything? >>>>>> >>>>>> Warner >>>>>> >>>>>> On Mon, Feb 22, 2021 at 4:17 PM Dean E. Weimer wrote: >>>>>> >>>>>>> On 2021-02-22 10:53 am, Dean E. Weimer wrote: >>>>>>>> On 2021-02-22 9:38 am, Dean E. Weimer via freebsd-stable wrote: >>>>>>>>> On 2021-02-22 9:29 am, Warner Losh wrote: >>>>>>>>> >>>>>>>>>> On Mon, Feb 22, 2021 at 8:24 AM Dean E. Weimer via freebsd-sta= ble >>>>>>>>>> wrote: >>>>>>>>>> >>>>>>>>>>> I was able to successfully build and install BETA2 from sourc= e, >>>>>>>>>>> however >>>>>>>>>>> I am now attempting to upgrade the same machine to BETA3 buil= dworld >>>>>>>>>>> and >>>>>>>>>>> buildkernel complete. installkernel also completes, but insta= llworld >>>>>>>>>>> fails, it appears to not find a file for i386 boot. >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>> /jails/devel/ROOT/usr/obj/jails/devel/ROOT/usr/src/amd64.amd64/st= and/i386/btx/btx/btx >>>>>>>>>>> -l boot2.ldr -o boot2.ld -P 1 boot2.bin >>>>>>>>>>> make[6]: exec(btxld) failed (No such file or directory) >>>>>>>>>> >>>>>>>>>> Does this happen every time, or only sometimes? Do you have th= e >>>>>>>>>> complete log? Why we're trying to run btxld and objcopy in the= >>>>>>>>>> *INSTALL* phase is likely why (paths are different between the= two) >>>>>>>>>> >>>>>>>>>> Warner >>>>>>>>>> >>>>>>>>>>> mail to "freebsd-stable-unsubscribe@freebsd.org" >>>>>>>>> >>>>>>>>> Everytime, not sure why I am trying to run btxld and objcopy in= >>>>>>>>> install phase, I am simply running the command make installworl= d >>>>>>>>> >>>>>>>>> I do use env variables to change paths, as I install to a ZFS c= lone of >>>>>>>>> the original system dataset then change boot setting on pool an= d >>>>>>>>> reboot. >>>>>>>>> >>>>>>>>> Environment Variables used during build and install, been doing= this >>>>>>>>> process ever since I started using ZFS boot on FreeBSD 9.2. >>>>>>>>> >>>>>>>>> setenv MAKEOBJDIRPREFIX /jails/devel/ROOT/usr/obj >>>>>>>>> setenv DESTDIR /jails/devel/ROOT >>>>>>>>> setenv __MAKE_CONF /jails/devel/ROOT/etc/make.conf >>>>>>>>> setenv SRCCONF /jails/devel/ROOT/etc/src.conf >>>>>>>> >>>>>>>> I had already started a new build specifying CPUTYPE=3Dsilvermon= t in >>>>>>>> make.conf, as attempt work around. It failed as well. I did chec= k and >>>>>>>> the path above exists on the system >>>>>>>> >>>>>>>> >>>>>>> :/jails/devel/ROOT/usr/obj/jails/devel/ROOT/usr/src/amd64.amd64/s= tand/i386/btx/btx >>>>>>>> # ll >>>>>>>> total 10 >>>>>>>> -rw-r--r-- 1 root wheel 117B Feb 22 10:13 .depend.btx.o >>>>>>>> -rwxr-xr-x 1 root wheel 1.7K Feb 22 10:37 btx* >>>>>>>> -rw-r--r-- 1 root wheel 5.4K Feb 22 10:13 btx.o >>>>>>>> drwxr-xr-x 2 root wheel 4B Feb 22 10:13 include/ >>>>>>>> >>>>>>>> I have removed my CPU Type specification and will run a new make= and >>>>>>>> install capturing full logs so that I can post a link to full lo= gs. >>>>>>> >>>>>>> I did a new build and capture output from full buildworld and >>>>>>> installworld, but first I cleared ccache same error was a result.= >>>>>>> >>>>>>> Here is the entire output along with my make.conf and src.conf fi= les. >>>>>>> https://nextcloud.dweimer.net/index.php/s/YYx6WX7KieatM9L >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Thanks, >>>>>>> Dean E. Weimer >>>>>>> http://www.dweimer.net/ >>>>>>> >>>>>> _______________________________________________ >>>>>> freebsd-stable@freebsd.org mailing list >>>>>> https://lists.freebsd.org/mailman/listinfo/freebsd-stable >>>>>> To unsubscribe, send any mail to "freebsd-stable-unsubscribe@freeb= sd.org" >> >> Do you guys know which part of my configuration is triggering this >> issue, so I can work around it for now? My last build attempt with the= >> latest updates for the security fixes failed to install even with patc= h. >> >=20 > I've been able to reproduce it locally with a stock config twice or > so, but it's non-trivial and only seems to reproduce with at least a > nullfs objdir. A good data point would be to point your > MAKEOBJDIRPREFIX at /jails/devel/host-usr-obj (assuming that's not > null-mounted) -- as long as you're still operating out of > /jails/devel/ROOT/usr/src, the paths relative to it will work out the > same. >=20 > Thanks, >=20 > Kyle Evans Is there any other way to make it working for nullfs objdir? I export real objdir over NFS for other systems and mount it as /usr/obj. Adding MAKEOBJDIRPREFIX for each src.conf and changing mount points would be even more headache than running once more barren "make buildworld", which with one job take usually about 10 minutes and sorts it out. Best regards, --=20 Marek Zarychta --CFXMKMv3D9ATwoUfc6NThZEA5v1RkDvFq-- --s08WJf0qWT3uRP4AO9WFd20vxNB01MP7Y Content-Type: application/pgp-signature; name="OpenPGP_signature.asc" Content-Description: OpenPGP digital signature Content-Disposition: attachment; filename="OpenPGP_signature" -----BEGIN PGP SIGNATURE----- wsB5BAABCAAjFiEEMOqvKm6wKvS1/ZeCdZ/s//1SjSwFAmA7rd4FAwAAAAAACgkQdZ/s//1SjSxE dAf9HJvrMznZl256coLq2Az+7mjj8knTbPEjGHof6ndpJvK9ga+1eGWPKk4hXzVpEMZLizJFj1M5 rQIaOig3TwsXv6lCoUvs4GtXjioX5K2slZqBEE2WgzA/Jv4R//Ttae6G3fS8IAoO7y+OFz2bvfGd 4i73NRUG7YmYTAdlBp6pT0Y5E4hvujT0S/SrTrK5LgFft5z5x6r75zIBalBFjvYHAAbqyAw4OMJK nMgSP1VtZOVF7KnSsxAkiX7l+0oAH7AET/+MF7QLFkysXIKD4CVisjXkerm+mRxCW4USyhwRjLx8 CEYP2b+xLX1PH8GZ2FkhnuNxSogi9WeOaK2wFL/4lw== =ykGK -----END PGP SIGNATURE----- --s08WJf0qWT3uRP4AO9WFd20vxNB01MP7Y--