From owner-svn-src-head@freebsd.org Thu Jul 26 15:05:32 2018 Return-Path: Delivered-To: svn-src-head@mailman.ysv.freebsd.org Received: from mx1.freebsd.org (mx1.freebsd.org [IPv6:2610:1c1:1:606c::19:1]) by mailman.ysv.freebsd.org (Postfix) with ESMTP id CB6AE1051F8D for ; Thu, 26 Jul 2018 15:05:32 +0000 (UTC) (envelope-from ian@freebsd.org) Received: from outbound1b.ore.mailhop.org (outbound1b.ore.mailhop.org [54.200.247.200]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (Client did not present a certificate) by mx1.freebsd.org (Postfix) with ESMTPS id 57E2693989 for ; Thu, 26 Jul 2018 15:05:32 +0000 (UTC) (envelope-from ian@freebsd.org) X-MHO-RoutePath: aGlwcGll X-MHO-User: 4fa5b29f-90e5-11e8-93fa-f3ebd9db2b94 X-Report-Abuse-To: https://support.duocircle.com/support/solutions/articles/5000540958-duocircle-standard-smtp-abuse-information X-Originating-IP: 67.177.211.60 X-Mail-Handler: DuoCircle Outbound SMTP Received: from ilsoft.org (unknown [67.177.211.60]) by outbound1.ore.mailhop.org (Halon) with ESMTPSA id 4fa5b29f-90e5-11e8-93fa-f3ebd9db2b94; Thu, 26 Jul 2018 15:05:20 +0000 (UTC) Received: from rev (rev [172.22.42.240]) by ilsoft.org (8.15.2/8.15.2) with ESMTP id w6QF5J9T021387; Thu, 26 Jul 2018 09:05:19 -0600 (MDT) (envelope-from ian@freebsd.org) Message-ID: <1532617518.61594.31.camel@freebsd.org> Subject: Re: svn commit: r336526 - head From: Ian Lepore To: Roger Pau =?ISO-8859-1?Q?Monn=E9?= Cc: src-committers@freebsd.org, svn-src-all@freebsd.org, svn-src-head@freebsd.org Date: Thu, 26 Jul 2018 09:05:18 -0600 In-Reply-To: <20180726145412.zp4zjznpwmhbaj65@mac.bytemobile.com> References: <201807200044.w6K0i4QQ079894@repo.freebsd.org> <20180726135806.foqjgb555vhwhqun@mac.bytemobile.com> <1532616552.61594.23.camel@freebsd.org> <20180726145412.zp4zjznpwmhbaj65@mac.bytemobile.com> Content-Type: text/plain; charset="ISO-8859-1" X-Mailer: Evolution 3.18.5.1 FreeBSD GNOME Team Port Mime-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: svn-src-head@freebsd.org X-Mailman-Version: 2.1.27 Precedence: list List-Id: SVN commit messages for the src tree for head/-current List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 26 Jul 2018 15:05:33 -0000 On Thu, 2018-07-26 at 16:54 +0200, Roger Pau Monné wrote: > On Thu, Jul 26, 2018 at 08:49:12AM -0600, Ian Lepore wrote: > > > > On Thu, 2018-07-26 at 15:58 +0200, Roger Pau Monné wrote: > > > > > > On Fri, Jul 20, 2018 at 12:44:04AM +0000, Ian Lepore wrote: > > > > > > > > > > > > Author: ian > > > > Date: Fri Jul 20 00:44:04 2018 > > > > New Revision: 336526 > > > > URL: https://svnweb.freebsd.org/changeset/base/336526 > > > > > > > > Log: > > > >   Add ntpd to the list of users/groups to check before > > > > installing. > > > The Xen CI loop is getting this when trying to create dist media > > > for HEAD FreeBSD (`make -C release ftp`): > > > > > > + LC_ALL=C > > > + export LC_ALL > > > + > > > PATH=/usr/lib/ccache:/sbin:/bin:/usr/sbin:/usr/bin:/usr/local/sbi > > > n:/u > > > sr/local/bin:/root/bin:/usr/lib/git-core > > > + http_proxy=http://cache:3128/ > > > + export http_proxy > > > + https_proxy=http://cache:3128/ > > > + export https_proxy > > > + exec > > > + cd /home/osstest/build.125515.build-amd64-freebsd > > > + rm -f build-ok-stamp > > > + cd freebsd > > > + export 'MAKEOBJDIRPREFIX=/home/osstest/build.125515.build- > > > amd64- > > > freebsd/obj' > > > + export 'TARGET=amd64' > > > + make -C release ftp -DWITHOUT_AUTO_OBJ > > > + tee ../release-ftp-log > > > mkdir -p dist > > > cd /usr/home/osstest/build.125515.build-amd64- > > > freebsd/freebsd/release/.. && make TARGET_ARCH=amd64 TARGET=amd64 > > > distributeworld DISTDIR=/usr/home/osstest/build.125515.build- > > > amd64- > > > freebsd/freebsd/release/dist > > > make[2]: "/usr/home/osstest/build.125515.build-amd64- > > > freebsd/obj/usr/home/osstest/build.125515.build-amd64- > > > freebsd/freebsd/amd64.amd64/toolchain-metadata.mk" line 1: Using > > > cached toolchain metadata from build at  on Mon Jul 23 10:29:23 > > > UTC > > > 2018 > > > ERROR: Required ntpd user is missing, see /usr/src/UPDATING. > > > *** Error code 1 > > > > > > Stop. > > > make[2]: stopped in /usr/home/osstest/build.125515.build-amd64- > > > freebsd/freebsd > > > *** Error code 1 > > > > > > Stop. > > > make[1]: stopped in /usr/home/osstest/build.125515.build-amd64- > > > freebsd/freebsd > > > *** Error code 1 > > > > > > Stop. > > > make: stopped in /usr/home/osstest/build.125515.build-amd64- > > > freebsd/freebsd/release > > > > > > The full build log can be found at: > > > > > > http://logs.test-lab.xenproject.org/osstest/logs/125569/build-amd > > > 64-f > > > reebsd/7.ts-freebsd-build.log > > > > > > Note that it's ~100MB. > > > > > > Thanks, Roger. > > > > > If the script is creating a new distribution image from scratch, it > > should be using -DDB_FROM_SRC on all distrib* and install* make > > targets, to avoid using (and verifying against) the passwd database > > on > > the build system. > Shouldn't then that be set by default for the ftp release target? > The sole purpose of that target is to create the sets that go to the > servers AFAICT. > > Or maybe it's the distributeworld target the one missing the > DB_FROM_SRC? > > Roger. > I don't know anything about the release scripts or how they work. I started down the path of trying to make the build system automatically set DB_FROM_SRC if DESTDIR is anything other than "/", but I realized that's wrong too... I occasionally mount an sdcard from some embedded system on my build machine and update it from a crossbuild using DESTDIR=/mnt, and in a case like that, using the passwd database from the system being updated is the right thing to do and DB_FROM_SRC isn't right (although it would work most of the time for most people). Right now there's no way to even properly use the passwd data from the target system, and when I tried to do that, I ran into other bugs. The only options now are to use the running system even when it's not what's being installed (clearly wrong) or use DB_FROM_SRC to bypass the checks, but also bypass using the passwd data from the target system (but it works okay as long as none of the names/uids < 1024 have been changed on the target system/image). -- Ian